
StartLux-Decision
by StartLuxLabs (organization)
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX. (description from the project’s GitHub page)
Repository facts
- Stars
- 676
- Forks
- 62
- Open issues and pull requests
- 5
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- StartLuxLabs · Organization
- Created
- Sep 29, 2026
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 8,943: llmmanorg/llmman
Run any agent on any model, models stored as OCI images
558 starsRustApache-2.0Last push Oct 18, 2026
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 2,323: AtomicBot-ai/atomic-agent
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
3,392 starsTypeScriptMITLast push Oct 17, 2026