# duoan/mega-data-factory

<https://repo.masters-masters.com/en/repos/duoan/mega-data-factory>

[Home](https://repo.masters-masters.com/en) › [duoan](https://repo.masters-masters.com/en/owners/duoan) › [mega-data-factory](https://repo.masters-masters.com/en/repos/duoan/mega-data-factory)

duoan/mega-data-factory has 380 stars on GitHub. Its RepoMasters card: Alpha tier. 🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

| Field | Value |
| --- | --- |
| Owner | [duoan](https://repo.masters-masters.com/en/owners/duoan) |
| Stars | 380 |
| Forks | 46 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2026 |
| Topics | datapipeline, deeplearning, image-editing, machine-learning, mllm, multimodal, ray, rust, vlm, data-curation |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [duoan/mega-data-factory](https://github.com/duoan/mega-data-factory) |

## Repository

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by duoan

- [duoan/TorchCode · ★ 4,731 · Jupyter Notebook · RC](https://repo.masters-masters.com/en/repos/duoan/TorchCode)
- [duoan/mini-rpc · ★ 235 · Java · Prototype](https://repo.masters-masters.com/en/repos/duoan/mini-rpc)
- [duoan/OpenKettleWebUI · ★ 154 · Java · Prototype](https://repo.masters-masters.com/en/repos/duoan/OpenKettleWebUI)

## Nearby in Python

- [jiaran-king/Re-Zero---Starting-LLM- · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/jiaran-king/Re-Zero---Starting-LLM-)
- [liconstudio/ComfyUI-Licon-MSR · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/liconstudio/ComfyUI-Licon-MSR)
- [alexturkey/voxcpm2-turkce-ses-tasarimi · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/alexturkey/voxcpm2-turkce-ses-tasarimi)
- [munificent/magpie · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/munificent/magpie)
- [srounet/Pymem · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/srounet/Pymem)
- [maxcutler/python-wordpress-xmlrpc · ★ 380 · Python · Alpha](https://repo.masters-masters.com/en/repos/maxcutler/python-wordpress-xmlrpc)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.