# codewithdark-git/Building-LLMs-from-scratch

<https://repo.masters-masters.com/en/repos/codewithdark-git/Building-LLMs-from-scratch>

[Home](https://repo.masters-masters.com/en) › [codewithdark-git](https://repo.masters-masters.com/en/owners/codewithdark-git) › [Building-LLMs-from-scratch](https://repo.masters-masters.com/en/repos/codewithdark-git/Building-LLMs-from-scratch)

codewithdark-git/Building-LLMs-from-scratch has 137 stars on GitHub. Its RepoMasters card: Prototype tier. This repository guides you through the process of…

| Field | Value |
| --- | --- |
| Owner | [codewithdark-git](https://repo.masters-masters.com/en/owners/codewithdark-git) |
| Stars | 137 |
| Forks | 45 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | MIT |
| Created | 2025 |
| Topics | 30dayscodechallenge, book, building-block, huggingface, huggingface-transformers, llm, notebook, nuts-n-bolts, python, python3 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [codewithdark-git/Building-LLMs-from-scratch](https://github.com/codewithdark-git/Building-LLMs-from-scratch) |

## Repository

This repository guides you through the process of building a GPT-style Large Language Model (LLM) from scratch using PyTorch. The structure and approach are inspired by the book Build a Large Language Model (From Scratch) by Sebastian Raschka.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by codewithdark-git

- [codewithdark-git/DarkGPT · ★ 200 · Python · Prototype](https://repo.masters-masters.com/en/repos/codewithdark-git/DarkGPT)

## Nearby in Jupyter Notebook

- [norhum/reinforcement-learning-from-scratch · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/norhum/reinforcement-learning-from-scratch)
- [vdblm/CausalPFN · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/vdblm/CausalPFN)
- [roostorg/model-community · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/roostorg/model-community)
- [skyfielders/astronomy-notebooks · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/skyfielders/astronomy-notebooks)
- [wqw547243068/wangqiwen · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/wqw547243068/wangqiwen)
- [root-project/training · ★ 137 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/root-project/training)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.