node-llama-cpp
by withcatai (organization)
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level (description from the project’s GitHub page)
Repository facts
- Stars
- 2,191
- Forks
- 240
- Open issues and pull requests
- 43
- Primary language
- TypeScript
- License
- MIT License (MIT)
- Owner
- withcatai · Organization
- Created
- Aug 12, 2023
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 8,065: hybridgroup/yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
654 starsGoOther licenseLast push Oct 17, 2026
Rank 4,136: tenstorrent/tt-metal
TT-NN operator library, and TT-Metalium low level kernel programming model.
1,715 starsPythonApache-2.0Last push Oct 18, 2026
Rank 8,611: zhongkaifu/TensorSharp
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-comp…
592 starsC#BSD-3-ClauseLast push Oct 18, 2026
Rank 742: getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10,921 starsTypeScriptMITLast push Apr 23, 2024
Rank 1,372: lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
5,927 starsC++Apache-2.0Last push Oct 18, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026