PrototypeCommon
taishan1994/sentencepiece_chinese_bpe
使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。
- Owner
- taishan1994 (personal account)
- Stars
- Stars: 118
- Forks
- Forks: 17
- Language
- Python
- License
- None
- Created
- 2023
- Topics
- sentencepiecetokenizationchinese-vocab
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by taishan1994
All 13 repos by taishan1994- taishan1994/awesome-chinese-nerStars: 770Beta
- taishan1994/pytorch_bert_bilstm_crf_nerStars: 587PythonAlpha
- taishan1994/BERT-BILSTM-CRFStars: 496PythonAlpha
- taishan1994/pytorch_triple_extractionStars: 368PythonAlpha
- taishan1994/chinese_information_extractionStars: 262PythonAlpha
- taishan1994/langchain-learningStars: 239Prototype
Nearby in Python
All Python repos- null0526/dario-genesisStars: 118PythonPrototype
- AetherLabsAI/RobotAgentBenchStars: 118PythonPrototype
- Sac-Y/match-cutStars: 118PythonPrototype
- milianw/springer_downloadStars: 118PythonPrototype
- bartTC/django-wakawakaStars: 118PythonPrototype
- danielgtaylor/aristaStars: 118PythonPrototype