data-prep-kit

Repository facts

Stars

968

Forks

257

Open issues and pull requests

230

Primary language

HTML

License

Apache License 2.0 (Apache-2.0)

Owner

data-prep-kit · Organization

Created

Apr 8, 2024

Last push

Sep 29, 2026

Topics

• code-quality
• data
• data-prep
• data-preparation
• data-preprocessing
• data-preprocessing-pipelines
• datacuration
• datarecipes
• deduplication
• finetuning
• large-language-models
• large-scale-data-processing
• llm
• llmapps
• malware
• python
• ray
• spark

Rank #6,231 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,955

  Rank 3,955: NVIDIA-NeMo/Curator

  Scalable data pre processing and curation toolkit for LLMs

  1,814 starsPythonApache-2.0Last push Oct 18, 2026

• 4,266

  Rank 4,266: skrub-data/skrub

  Machine learning with dataframes

  1,655 starsPythonBSD-3-ClauseLast push Oct 16, 2026

• 138

  Rank 138: ray-project/ray

  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  44,061 starsPythonApache-2.0Last push Oct 18, 2026

• 3,176

  Rank 3,176: adithya-s-k/AI-Engineering.academy

  Mastering Applied AI, One Concept at a Time

  2,383 starsJupyter NotebookMITLast push Feb 27, 2026

• 2,416

  Rank 2,416: lakesoul-io/LakeSoul

  LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector sear…

  3,257 starsRustApache-2.0Last push Oct 18, 2026

• 2,029

  Rank 2,029: LazyAGI/LazyLLM

  Easiest and laziest way for building multi-agent LLMs applications.

  3,889 starsPythonApache-2.0Last push Oct 13, 2026