crawl4ai
by unclecode (personal account)
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. (description from the project’s GitHub page)
Repository facts
- Stars
- 85,765
- Forks
- 8,913
- Open issues and pull requests
- 263
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- unclecode · Personal account
- Created
- May 9, 2024
- Last push
- Oct 15, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 10: firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
192,681 starsTypeScriptAGPL-3.0Last push Oct 18, 2026
Rank 5,575: fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search…
1,150 starsRustAGPL-3.0Last push Oct 17, 2026
Rank 854: apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files…
9,597 starsPythonApache-2.0Last push Oct 16, 2026
Rank 239: ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
31,902 starsPythonMITLast push Oct 6, 2026
Rank 313: apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML,…
26,183 starsTypeScriptApache-2.0Last push Oct 16, 2026
Rank 50: D4Vinci/Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily…
88,435 starsPythonBSD-3-ClauseLast push Oct 18, 2026