# THUDM/icetk

<https://repo.masters-masters.com/en/repos/THUDM/icetk>

[Home](https://repo.masters-masters.com/en) › [THUDM](https://repo.masters-masters.com/en/owners/THUDM) › [icetk](https://repo.masters-masters.com/en/repos/THUDM/icetk)

THUDM/icetk has 153 stars on GitHub. Its RepoMasters card: Prototype tier. A unified tokenization tool for Images, Chinese and English. Language: Python.

| Field | Value |
| --- | --- |
| Owner | [THUDM](https://repo.masters-masters.com/en/owners/THUDM) |
| Stars | 153 |
| Forks | 16 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2021 |
| Topics | tokenization, transformer |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [THUDM/icetk](https://github.com/THUDM/icetk) |

## Repository

A unified tokenization tool for Images, Chinese and English.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by THUDM

- [THUDM/slime · ★ 8,786 · Python · Stable](https://repo.masters-masters.com/en/repos/THUDM/slime)
- [THUDM/AgentBench · ★ 3,810 · Python · RC](https://repo.masters-masters.com/en/repos/THUDM/AgentBench)
- [THUDM/GLM · ★ 3,693 · Python · RC](https://repo.masters-masters.com/en/repos/THUDM/GLM)
- [THUDM/P-tuning-v2 · ★ 2,077 · Python · RC](https://repo.masters-masters.com/en/repos/THUDM/P-tuning-v2)
- [THUDM/LongWriter · ★ 1,881 · Python · Beta](https://repo.masters-masters.com/en/repos/THUDM/LongWriter)
- [THUDM/CogDL · ★ 1,820 · Python · Beta](https://repo.masters-masters.com/en/repos/THUDM/CogDL)

## Nearby in Python

- [lexifina/romania-law · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/lexifina/romania-law)
- [PlantCraft/PlantCraft · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/PlantCraft/PlantCraft)
- [YeJe-cpu/easy-jianying · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/YeJe-cpu/easy-jianying)
- [heynemann/pynq · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/heynemann/pynq)
- [deepthawtz/faker · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/deepthawtz/faker)
- [softlayer/softlayer-python · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/softlayer/softlayer-python)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.