AlphaUncommon
dmitry-brazhenko/SharpToken
SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
- Owner
- dmitry-brazhenko (personal account)
- Stars
- Stars: 263
- Forks
- Forks: 19
- Language
- C#
- License
- MIT
- Created
- 2023
- Topics
- gptgpt-3openaitokenizercsharpcl100kbasegpt-4
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in C#
All C# repos- VE3NEA/SkyRoofStars: 263C#Alpha
- KernelErr/dnSpy.Extension.MCPStars: 263C#Alpha
- theantipopau/omencoreStars: 263C#Alpha
- mono/ngitStars: 263C#Alpha
- casascius/Bitcoin-Address-UtilityStars: 263C#Alpha
- SteamRE/open-steamworksStars: 263C#Alpha