Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

AlphaUncommon

tiktoken-go/tokenizer

Pure Go implementation of OpenAI's tiktoken tokenizer

Owner: tiktoken-go (organization)
Stars: Stars: 460
Forks: Forks: 39
Language: Go
License: MIT
Created: 2023
Tier: Alpha (250 to 699 ★) What this tier means

Nearby in Go

iximiuz/labctlStars: 460GoAlpha
langgenius/dify-plugin-daemonStars: 460GoAlpha
programmersd21/flowStars: 460GoAlpha
facebookarchive/httpcontrolStars: 460GoAlpha
siddontang/goStars: 460GoAlpha
sselph/scraperStars: 460GoAlpha