crawlee
by apify (organization)
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both… (description from the project’s GitHub page)
Repository facts
- Stars
- 26,183
- Forks
- 1,712
- Open issues and pull requests
- 155
- Primary language
- TypeScript
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- apify · Organization
- Created
- Aug 26, 2016
- Last push
- Oct 16, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 854: apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files…
9,597 starsPythonApache-2.0Last push Oct 16, 2026
Rank 52: unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
85,765 starsPythonApache-2.0Last push Oct 15, 2026
Rank 459: getmaxun/maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
17,888 starsTypeScriptAGPL-3.0Last push Oct 18, 2026
Rank 694: jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
11,676 starsJavaScriptMITLast push Oct 16, 2026
Rank 50: D4Vinci/Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily…
88,435 starsPythonBSD-3-ClauseLast push Oct 18, 2026
Rank 10: firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
192,681 starsTypeScriptAGPL-3.0Last push Oct 18, 2026