Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated purple circuit-trace artwork for openai/tiktoken, labeled USASI · AI on GitHub, with Organization · Python · MIT.
Rank #417 19,487 starsPython

tiktoken

by openai (organization)

tiktoken is a fast BPE tokeniser for use with OpenAI's models. (description from the project’s GitHub page)

View on GitHub (external site: github.com)

In the USASI catalog: tiktoken

Repository facts

Stars
19,487
Forks
1,650
Open issues and pull requests
143
Primary language
Python
License
MIT License (MIT)
Owner
openai · Organization
Created
Dec 1, 2022
Last push
Aug 17, 2026

Rank #417 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project