TinyChatEngine

Repository facts

Stars

968

Forks

102

Open issues and pull requests

41

Primary language

C++

License

MIT License (MIT)

Owner

mit-han-lab · Organization

Created

May 24, 2023

Last push

Jul 4, 2024

Topics

• arm
• c
• cpp
• cuda-programming
• deep-learning
• edge-computing
• large-language-models
• on-device-ai
• quantization
• x86-64

Rank #6,233 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,238

  Rank 6,238: mit-han-lab/tinyengine

  [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Devic…

  967 starsCMITLast push Nov 27, 2024

• 1,946

  Rank 1,946: uxlfoundation/oneDNN

  Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, a…

  4,067 starsC++Apache-2.0Last push Oct 18, 2026

• 8,807

  Rank 8,807: Maknee/minigpt4.cpp

  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

  572 starsC++MITLast push Aug 8, 2023

• 1,768

  Rank 1,768: OAID/Tengine

  Tengine is a lite, high performance, modular inference engine for embedded device

  4,533 starsC++Apache-2.0Last push Mar 6, 2025

• 4,188

  Rank 4,188: microsoft/EdgeML

  This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

  1,691 starsC++Other licenseLast push May 20, 2024

• 5,643

  Rank 5,643: Dobiasd/frugally-deep

  A lightweight header-only library for using Keras (TensorFlow) models in C++.

  1,128 starsC++MITLast push May 6, 2026