Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI
Generated blue orbit artwork for niieani/gpt-tokenizer, labeled USASI · AI on GitHub, with Personal account · TypeScript · MIT.
Rank #6,768 855 starsTypeScript

gpt-tokenizer

by niieani (personal account)

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features. (description from the project’s GitHub page)

Repository facts

Stars
855
Forks
63
Open issues and pull requests
2
Primary language
TypeScript
License
MIT License (MIT)
Owner
niieani · Personal account
Created
Mar 22, 2023
Last push
Oct 18, 2026

Topics

Rank #6,768 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Projects that share this one’s GitHub topics.

Support Us

Help keep USASI useful.

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project