Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

extreme-bert/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

Owner
extreme-bert (organization)
Stars
Stars: 268
Forks
Forks: 14
Language
Python
License
Apache-2.0
Created
2022
Topics
machine-learningnatural-language-processingnlppythondeep-learningbertlanguage-modellanguage-modelspytorchtransformer
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos