# wei-potato/Train-llm-from-scratch

<https://repo.masters-masters.com/en/repos/wei-potato/Train-llm-from-scratch>

[Home](https://repo.masters-masters.com/en) › [wei-potato](https://repo.masters-masters.com/en/owners/wei-potato) › [Train-llm-from-scratch](https://repo.masters-masters.com/en/repos/wei-potato/Train-llm-from-scratch)

wei-potato/Train-llm-from-scratch has 166 stars on GitHub. Its RepoMasters card: Prototype tier. 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力

| Field | Value |
| --- | --- |
| Owner | [wei-potato](https://repo.masters-masters.com/en/owners/wei-potato) |
| Stars | 166 |
| Forks | 21 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [wei-potato/Train-llm-from-scratch](https://github.com/wei-potato/Train-llm-from-scratch) |

## Repository

使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Python

- [d4ncboz/museai · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/d4ncboz/museai)
- [ashukae/ComfyUI-MangaScreen · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/ashukae/ComfyUI-MangaScreen)
- [qqqqqq-stu/mcparallel · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/qqqqqq-stu/mcparallel)
- [hmason/tc · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/hmason/tc)
- [zinka/arraytool · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/zinka/arraytool)
- [brutasse/django-ratelimit-backend · ★ 166 · Python · Prototype](https://repo.masters-masters.com/en/repos/brutasse/django-ratelimit-backend)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.