mixtral-offloading

Repository facts

Stars

2,336

Forks

225

Open issues and pull requests

26

Primary language

Python

License

MIT License (MIT)

Owner

dvmazur · Personal account

Created

Dec 15, 2023

Last push

Apr 8, 2024

Topics

• colab-notebook
• deep-learning
• google-colab
• language-model
• llm
• mixture-of-experts
• offloading
• pytorch
• quantization

Rank #3,232 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,025

  Rank 4,025: tugstugi/dl-colab-notebooks

  Try out deep learning models online on Google Colab

  1,776 starsJupyter NotebookNo license file detectedLast push Mar 10, 2022

• 4,309

  Rank 4,309: yoshitomo-matsubara/torchdistill

  A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurI…

  1,634 starsPythonMITLast push Oct 12, 2026

• 2,899

  Rank 2,899: stochasticai/xTuring

  Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: ht…

  2,674 starsPythonApache-2.0Last push Oct 18, 2026

• 908

  Rank 908: FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  9,094 starsCApache-2.0Last push Oct 2, 2026

• 4,406

  Rank 4,406: RWKV/rwkv.cpp

  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  1,587 starsC++MITLast push Mar 23, 2025

• 4,827

  Rank 4,827: RahulSChand/gpu_poor

  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

  1,400 starsJavaScriptNo license file detectedLast push Dec 3, 2024