
scylla
by MikeChongCan (personal account)
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era (description from the project’s GitHub page)
Repository facts
- Stars
- 4,021
- Forks
- 469
- Open issues and pull requests
- 48
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- MikeChongCan · Personal account
- Created
- Apr 10, 2018
- Last push
- Jun 9, 2025
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 50: D4Vinci/Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily…
88,435 starsPythonBSD-3-ClauseLast push Oct 18, 2026
Rank 52: unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
85,765 starsPythonApache-2.0Last push Oct 15, 2026
Rank 854: apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files…
9,597 starsPythonApache-2.0Last push Oct 16, 2026
Rank 1,010: alirezamika/autoscraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
8,054 starsPythonMITLast push Jul 29, 2026
Rank 4,176: YoongiKim/AutoCrawler
Google, Naver multiprocess image web crawler (Selenium)
1,696 starsPythonApache-2.0Last push Aug 30, 2026
Rank 4,401: eatmoreduck/boss-zhipin-scraper
Boss直聘爬虫 / BOSS直聘职位数据抓取工具,基于 Chrome CDP 协议复用真实登录态,绕过字体反爬,输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
1,589 starsPythonMITLast push Oct 14, 2026