
TensorSharp
by zhongkaifu (personal account)
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability (description from the project’s GitHub page)
Repository facts
- Stars
- 592
- Forks
- 63
- Open issues and pull requests
- 10
- Primary language
- C#
- License
- BSD 3-Clause "New" or "Revised" License (BSD-3-Clause)
- Owner
- zhongkaifu · Personal account
- Created
- Apr 3, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,383: xLLM-AI/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
1,601 starsC++Apache-2.0Last push Oct 18, 2026
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026