Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

gautierdag/bpeasy

Fast bare-bones BPE for modern tokenizer training

Owner
gautierdag (personal account)
Stars
Stars: 180
Forks
Forks: 6
Language
Python
License
MIT
Created
2023
Topics
bpetokenizationtokenizer
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos