Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

clipperhouse/uax29

A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split graphemes, words, sentences.

Owner
clipperhouse (personal account)
Stars
Stars: 125
Forks
Forks: 7
Language
Go
License
MIT
Created
2020
Topics
unicodetokenizationuax29gogolangnlptokenizer
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by clipperhouse

All 3 repos by clipperhouse

Nearby in Go

All Go repos