bookcorpus

Repository facts

Stars

864

Forks

112

Open issues and pull requests

6

Primary language

Python

License

MIT License (MIT)

Owner

soskek · Personal account

Created

Jul 14, 2018

Last push

Jul 14, 2023

Topics

• bookcorpus
• corpus
• crawler
• nlp
• scraper

Rank #6,718 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 52

  Rank 52: unclecode/crawl4ai

  Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

  85,765 starsPythonApache-2.0Last push Oct 15, 2026

• 854

  Rank 854: apify/crawlee-python

  Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files…

  9,597 starsPythonApache-2.0Last push Oct 16, 2026

• 1,010

  Rank 1,010: alirezamika/autoscraper

  A Smart, Automatic, Fast and Lightweight Web Scraper for Python

  8,054 starsPythonMITLast push Jul 29, 2026

• 4,401

  Rank 4,401: eatmoreduck/boss-zhipin-scraper

  Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.

  1,589 starsPythonMITLast push Oct 14, 2026

• 1,797

  Rank 1,797: CLUEbenchmark/CLUEDatasetSearch

  搜索所有中文NLP数据集，附常用英文NLP数据集

  4,455 starsPythonNo license file detectedLast push Nov 21, 2022

• 4,777

  Rank 4,777: gunthercox/chatterbot-corpus

  A multilingual dialog corpus

  1,417 starsPythonBSD-3-ClauseLast push Mar 24, 2026