AlphaUncommon
sangmichaelxie/doremi
Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
- Owner
- sangmichaelxie (personal account)
- Stars
- Stars: 362
- Forks
- Forks: 34
- Language
- HTML
- License
- MIT
- Created
- 2023
- Topics
- data-centric-machine-learninglarge-language-modelsnlp
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by sangmichaelxie
All 2 repos by sangmichaelxie- sangmichaelxie/cs324_p2Stars: 104PythonPrototype
Nearby in HTML
All HTML repos- zhheo/HeoWebStars: 362HTMLAlpha
- logankilpatrick/ChatGPT-SimpleStars: 362HTMLAlpha
- mohitmishra786/exploring-osStars: 362HTMLAlpha
- Netflix/ndbenchStars: 362HTMLAlpha
- AnsonZnl/makesenStars: 362HTMLAlpha
- biggerwing/nsfocus-rsas-knowledge-baseStars: 362HTMLAlpha