distributed-llama

Repository facts

Stars

3,112

Forks

265

Open issues and pull requests

48

Primary language

C++

License

MIT License (MIT)

Owner

b4rtaz · Personal account

Created

Dec 4, 2023

Last push

Oct 14, 2026

Topics

• distributed-computing
• distributed-llm
• llama2
• llama3
• llm
• llm-inference
• llms
• neural-network
• open-llm

Rank #2,528 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,005

  Rank 1,005: InternLM/lmdeploy

  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

  8,108 starsPythonApache-2.0Last push Oct 16, 2026

• 6,966

  Rank 6,966: mukel/llama3.java

  Llama 3+ inference in pure Java

  820 starsJavaMITLast push Apr 24, 2026

• 3,926

  Rank 3,926: beam-cloud/beta9

  Ultrafast serverless GPU inference, sandboxes, and background jobs

  1,824 starsGoAGPL-3.0Last push Oct 18, 2026

• 8,868

  Rank 8,868: jaylfc/taOS

  Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framewor…

  566 starsPythonAGPL-3.0Last push Oct 18, 2026

• 1,214

  Rank 1,214: yangjianxin1/Firefly

  Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya…

  6,647 starsPythonNo license file detectedLast push Oct 24, 2024

• 2,080

  Rank 2,080: SciSharp/LLamaSharp

  A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

  3,813 starsC#MITLast push Oct 17, 2026