# sangmichaelxie/doremi

<https://repo.masters-masters.com/en/repos/sangmichaelxie/doremi>

[Home](https://repo.masters-masters.com/en) › [sangmichaelxie](https://repo.masters-masters.com/en/owners/sangmichaelxie) › [doremi](https://repo.masters-masters.com/en/repos/sangmichaelxie/doremi)

sangmichaelxie/doremi has 362 stars on GitHub. Its RepoMasters card: Alpha tier. Pytorch implementation of DoReMi, a method for optimizing the data mixture…

| Field | Value |
| --- | --- |
| Owner | [sangmichaelxie](https://repo.masters-masters.com/en/owners/sangmichaelxie) |
| Stars | 362 |
| Forks | 34 |
| Language | [HTML](https://repo.masters-masters.com/en/languages/html) |
| License | MIT |
| Created | 2023 |
| Topics | data-centric-machine-learning, large-language-models, nlp |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [sangmichaelxie/doremi](https://github.com/sangmichaelxie/doremi) |

## Repository

Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by sangmichaelxie

- [sangmichaelxie/cs324\_p2 · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/sangmichaelxie/cs324_p2)

## Nearby in HTML

- [logankilpatrick/ChatGPT-Simple · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/logankilpatrick/ChatGPT-Simple)
- [mohitmishra786/exploring-os · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/mohitmishra786/exploring-os)
- [manyuegong33/r0crawl\_skills · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/manyuegong33/r0crawl_skills)
- [Netflix/ndbench · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/Netflix/ndbench)
- [AnsonZnl/makesen · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/AnsonZnl/makesen)
- [biggerwing/nsfocus-rsas-knowledge-base · ★ 362 · HTML · Alpha](https://repo.masters-masters.com/en/repos/biggerwing/nsfocus-rsas-knowledge-base)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.