trafilatura

Repository facts

Stars

6,985

Forks

460

Open issues and pull requests

87

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

adbar · Personal account

Created

Apr 8, 2019

Last push

Oct 6, 2026

Topics

• article-extractor
• corpus-builder
• corpus-tools
• crawler
• html-to-markdown
• html2text
• llm
• news-aggregator
• news-crawler
• nlp
• rag
• readability
• rss-feed
• scraping
• tei
• text-cleaning
• text-extraction
• text-mining
• text-preprocessing
• web-scraping

Rank #1,162 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 5,998

  Rank 5,998: jfilter/clean-text

  🧹 Python package for text cleaning

  1,031 starsPythonOther licenseLast push May 15, 2026

• 10

  Rank 10: firecrawl/firecrawl

  Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

  192,681 starsTypeScriptAGPL-3.0Last push Oct 18, 2026

• 239

  Rank 239: ScrapeGraphAI/Scrapegraph-ai

  Python scraper based on AI

  31,902 starsPythonMITLast push Oct 6, 2026

• 2,716

  Rank 2,716: jbesomi/texthero

  Text preprocessing, representation and visualization from zero to hero.

  2,905 starsPythonMITLast push Aug 29, 2023

• 5,575

  Rank 5,575: fastcrw/crw

  Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search…

  1,150 starsRustAGPL-3.0Last push Oct 17, 2026

• 52

  Rank 52: unclecode/crawl4ai

  Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

  85,765 starsPythonApache-2.0Last push Oct 15, 2026