
sentencepiece
by google (organization)
Unsupervised text tokenizer for Neural Network-based text generation. (description from the project’s GitHub page)
Repository facts
- Stars
- 12,138
- Forks
- 1,387
- Open issues and pull requests
- 6
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- google · Organization
- Created
- Mar 7, 2017
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,891: vncorenlp/VnCoreNLP
A Vietnamese natural language processing toolkit (NAACL 2018)
679 starsJavaOther licenseLast push Feb 12, 2023
Rank 2,807: NiuTrans/MTBook
《机器翻译:基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models
2,795 starsTeXNo license file detectedLast push Sep 14, 2024
Rank 3,578: delip/PyTorchNLPBook
Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L
2,058 starsJupyter NotebookApache-2.0Last push Mar 12, 2023
Rank 4,608: OpenNMT/OpenNMT-tf
Neural machine translation and sequence learning using TensorFlow
1,486 starsPythonMITLast push Oct 14, 2023
Rank 1,708: OpenNMT/CTranslate2
Fast inference engine for Transformer models
4,713 starsC++MITLast push Oct 18, 2026