# taishan1994/sentencepiece\_chinese\_bpe

<https://repo.masters-masters.com/en/repos/taishan1994/sentencepiece_chinese_bpe>

[Home](https://repo.masters-masters.com/en) › [taishan1994](https://repo.masters-masters.com/en/owners/taishan1994) › [sentencepiece\_chinese\_bpe](https://repo.masters-masters.com/en/repos/taishan1994/sentencepiece_chinese_bpe)

taishan1994/sentencepiece\_chinese\_bpe has 118 stars on GitHub. Its RepoMasters card: Prototype tier. 使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。

| Field | Value |
| --- | --- |
| Owner | [taishan1994](https://repo.masters-masters.com/en/owners/taishan1994) |
| Stars | 118 |
| Forks | 17 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2023 |
| Topics | sentencepiece, tokenization, chinese-vocab |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [taishan1994/sentencepiece\_chinese\_bpe](https://github.com/taishan1994/sentencepiece_chinese_bpe) |

## Repository

使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by taishan1994

- [taishan1994/awesome-chinese-ner · ★ 770 · Beta](https://repo.masters-masters.com/en/repos/taishan1994/awesome-chinese-ner)
- [taishan1994/pytorch\_bert\_bilstm\_crf\_ner · ★ 587 · Python · Alpha](https://repo.masters-masters.com/en/repos/taishan1994/pytorch_bert_bilstm_crf_ner)
- [taishan1994/BERT-BILSTM-CRF · ★ 496 · Python · Alpha](https://repo.masters-masters.com/en/repos/taishan1994/BERT-BILSTM-CRF)
- [taishan1994/pytorch\_triple\_extraction · ★ 368 · Python · Alpha](https://repo.masters-masters.com/en/repos/taishan1994/pytorch_triple_extraction)
- [taishan1994/chinese\_information\_extraction · ★ 262 · Python · Alpha](https://repo.masters-masters.com/en/repos/taishan1994/chinese_information_extraction)
- [taishan1994/langchain-learning · ★ 239 · Prototype](https://repo.masters-masters.com/en/repos/taishan1994/langchain-learning)

## Nearby in Python

- [null0526/dario-genesis · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/null0526/dario-genesis)
- [AetherLabsAI/RobotAgentBench · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/AetherLabsAI/RobotAgentBench)
- [Sac-Y/match-cut · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/Sac-Y/match-cut)
- [milianw/springer\_download · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/milianw/springer_download)
- [bartTC/django-wakawaka · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/bartTC/django-wakawaka)
- [danielgtaylor/arista · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/danielgtaylor/arista)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.