# taishi-i/toiro

<https://repo.masters-masters.com/en/repos/taishi-i/toiro>

[Home](https://repo.masters-masters.com/en) › [taishi-i](https://repo.masters-masters.com/en/owners/taishi-i) › [toiro](https://repo.masters-masters.com/en/repos/taishi-i/toiro)

taishi-i/toiro has 122 stars on GitHub. Its RepoMasters card: Prototype tier. A tool for comparing tokenizers Language: Python.

| Field | Value |
| --- | --- |
| Owner | [taishi-i](https://repo.masters-masters.com/en/owners/taishi-i) |
| Stars | 122 |
| Forks | 9 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2020 |
| Topics | nlp, natural-language-processing, japanese, word-segmentation, nlp-library, llm-tools |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [taishi-i/toiro](https://github.com/taishi-i/toiro) |

## Repository

A tool for comparing tokenizers

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by taishi-i

- [taishi-i/awesome-ChatGPT-repositories · ★ 3,346 · Python · RC](https://repo.masters-masters.com/en/repos/taishi-i/awesome-ChatGPT-repositories)
- [taishi-i/awesome-japanese-nlp-resources · ★ 1,026 · Beta](https://repo.masters-masters.com/en/repos/taishi-i/awesome-japanese-nlp-resources)
- [taishi-i/nagisa · ★ 423 · Python · Alpha](https://repo.masters-masters.com/en/repos/taishi-i/nagisa)

## Nearby in Python

- [Bryce-border/McLottery-Alchemist · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/Bryce-border/McLottery-Alchemist)
- [Lico124378/macau-hidden-bites · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/Lico124378/macau-hidden-bites)
- [BlueKnightNet/Blue-Knight-Proxy-BotHosting · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/BlueKnightNet/Blue-Knight-Proxy-BotHosting)
- [svetlyak40wt/django-fields · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/svetlyak40wt/django-fields)
- [metajack/notify-webhook · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/metajack/notify-webhook)
- [bmander/graphserver · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/bmander/graphserver)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.