
minigpt4.cpp
by Maknee (personal account)
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML) (description from the project’s GitHub page)
Repository facts
- Stars
- 572
- Forks
- 28
- Open issues and pull requests
- 7
- Primary language
- C++
- License
- MIT License (MIT)
- Owner
- Maknee · Personal account
- Created
- Jul 15, 2023
- Last push
- Aug 8, 2023
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 8,823: monatis/clip.cpp
CLIP inference in plain C/C++ with no extra dependencies
571 starsC++MITLast push Aug 24, 2026
Rank 6,233: mit-han-lab/TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
968 starsC++MITLast push Jul 4, 2024
Rank 6,238: mit-han-lab/tinyengine
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Devic…
967 starsCMITLast push Nov 27, 2024
Rank 4,406: RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
1,587 starsC++MITLast push Mar 23, 2025
Rank 4,123: EnzymeAD/Enzyme
High-performance automatic differentiation of LLVM and MLIR.
1,719 starsLLVMOther licenseLast push Oct 18, 2026
Rank 1,708: OpenNMT/CTranslate2
Fast inference engine for Transformer models
4,713 starsC++MITLast push Oct 18, 2026