# KaihuaTang/Building-a-Small-LLM-from-Scratch

<https://repo.masters-masters.com/en/repos/KaihuaTang/Building-a-Small-LLM-from-Scratch>

[Home](https://repo.masters-masters.com/en) › [KaihuaTang](https://repo.masters-masters.com/en/owners/KaihuaTang) › [Building-a-Small-LLM-from-Scratch](https://repo.masters-masters.com/en/repos/KaihuaTang/Building-a-Small-LLM-from-Scratch)

KaihuaTang/Building-a-Small-LLM-from-Scratch has 384 stars on GitHub. Its RepoMasters card: Alpha tier. 该系列的目的是让读者可以在基础的pytorch上，不依赖任何其他现成的外部库，从零开始理解并实现一个大语言模型…

| Field | Value |
| --- | --- |
| Owner | [KaihuaTang](https://repo.masters-masters.com/en/owners/KaihuaTang) |
| Stars | 384 |
| Forks | 29 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2025 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [KaihuaTang/Building-a-Small-LLM-from-Scratch](https://github.com/KaihuaTang/Building-a-Small-LLM-from-Scratch) |

## Repository

该系列的目的是让读者可以在基础的pytorch上，不依赖任何其他现成的外部库，从零开始理解并实现一个大语言模型的所有组成部分，以及训练微调代码，因此读者仅需python，pytorch和最基础深度学习背景知识即可。

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by KaihuaTang

- [KaihuaTang/Scene-Graph-Benchmark.pytorch · ★ 1,199 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/KaihuaTang/Scene-Graph-Benchmark.pytorch)
- [KaihuaTang/Long-Tailed-Recognition.pytorch · ★ 571 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/KaihuaTang/Long-Tailed-Recognition.pytorch)
- [KaihuaTang/VQA2.0-Recent-Approachs-2018.pytorch · ★ 300 · Python · Alpha](https://repo.masters-masters.com/en/repos/KaihuaTang/VQA2.0-Recent-Approachs-2018.pytorch)
- [KaihuaTang/ResNet50-Pytorch-Face-Recognition · ★ 177 · Python · Prototype](https://repo.masters-masters.com/en/repos/KaihuaTang/ResNet50-Pytorch-Face-Recognition)
- [KaihuaTang/Generalized-Long-Tailed-Benchmarks.pytorch · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/KaihuaTang/Generalized-Long-Tailed-Benchmarks.pytorch)
- [KaihuaTang/VCTree-Scene-Graph-Generation · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/KaihuaTang/VCTree-Scene-Graph-Generation)

## Nearby in Python

- [gts360/django-mcp-server · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/gts360/django-mcp-server)
- [leeyeel/Sketch2Motion · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/leeyeel/Sketch2Motion)
- [509992828/grok-register · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/509992828/grok-register)
- [clockfort/GitHub-Backup · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/clockfort/GitHub-Backup)
- [mixcloud/django-experiments · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/mixcloud/django-experiments)
- [coddingtonbear/django-mailbox · ★ 384 · Python · Alpha](https://repo.masters-masters.com/en/repos/coddingtonbear/django-mailbox)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.