# howl-anderson/MicroTokenizer

<https://repo.masters-masters.com/repos/howl-anderson/MicroTokenizer>

[Accueil](https://repo.masters-masters.com/) › [howl-anderson](https://repo.masters-masters.com/owners/howl-anderson) › [MicroTokenizer](https://repo.masters-masters.com/repos/howl-anderson/MicroTokenizer)

howl-anderson/MicroTokenizer, dépôt open source à 160 étoiles sur GitHub. Carte Prototype de RepoMasters. 一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A…

| Champ | Valeur |
| --- | --- |
| Propriétaire | [howl-anderson](https://repo.masters-masters.com/owners/howl-anderson) |
| Étoiles | 160 |
| Forks | 22 |
| Langage | [Python](https://repo.masters-masters.com/languages/python) |
| Licence | MIT |
| Création | 2018 |
| Sujets | chinese-nlp, tokenizer, chinese-tokenizer, dag-network, nlp-machine-learning, chinese-word-segmentation, educational-project |
| Rang | [Prototype (100 à 249 ★)](https://repo.masters-masters.com/ranks/rush) |
| Voir sur GitHub | [howl-anderson/MicroTokenizer](https://github.com/howl-anderson/MicroTokenizer) |

## Fiche du dépôt

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers,…

Rang des dépôts qui ont 100 à 249 ★ sur GitHub. Probabilité publiée par carte tirée : 70 %. Rareté : Commune.

## Autres dépôts de howl-anderson

- [howl-anderson/unlocking-the-power-of-llms · ★ 2 469 · Shell · RC](https://repo.masters-masters.com/repos/howl-anderson/unlocking-the-power-of-llms)
- [howl-anderson/Chinese\_models\_for\_SpaCy · ★ 673 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/repos/howl-anderson/Chinese_models_for_SpaCy)
- [howl-anderson/agentsilex · ★ 458 · Python · Alpha](https://repo.masters-masters.com/repos/howl-anderson/agentsilex)
- [howl-anderson/hanzi\_chaizi · ★ 432 · Python · Alpha](https://repo.masters-masters.com/repos/howl-anderson/hanzi_chaizi)
- [howl-anderson/hanzi\_char\_featurizer · ★ 302 · Python · Alpha](https://repo.masters-masters.com/repos/howl-anderson/hanzi_char_featurizer)
- [howl-anderson/tools\_for\_corpus\_of\_people\_daily · ★ 293 · Python · Alpha](https://repo.masters-masters.com/repos/howl-anderson/tools_for_corpus_of_people_daily)

## D’autres dépôts Python

- [Video-Rebirth/hyperflow · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/Video-Rebirth/hyperflow)
- [alexyc9381/hiring-panel-skill · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/alexyc9381/hiring-panel-skill)
- [UnderleveledBuilder/awesome-social-media-skills · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/UnderleveledBuilder/awesome-social-media-skills)
- [sethtrain/django-git · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/sethtrain/django-git)
- [knipknap/Gelatin · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/knipknap/Gelatin)
- [niemeyer/hsandbox · ★ 160 · Python · Prototype](https://repo.masters-masters.com/repos/niemeyer/hsandbox)

---
Données : GitHub · Illustration dessinée par RepoMasters à partir de l’identifiant du dépôt et de la couleur de son langage.
