# jzhang38/TinyLlama

<https://repo.masters-masters.com/en/repos/jzhang38/TinyLlama>

[Home](https://repo.masters-masters.com/en) › [jzhang38](https://repo.masters-masters.com/en/owners/jzhang38) › [TinyLlama](https://repo.masters-masters.com/en/repos/jzhang38/TinyLlama)

jzhang38/TinyLlama has 9,009 stars on GitHub. Its RepoMasters card: Stable tier. The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3…

| Field | Value |
| --- | --- |
| Owner | [jzhang38](https://repo.masters-masters.com/en/owners/jzhang38) |
| Stars | 9,009 |
| Forks | 633 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [jzhang38/TinyLlama](https://github.com/jzhang38/TinyLlama) |

## Repository

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Archived: this repository is read-only

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by jzhang38

- [jzhang38/EasyContext · ★ 761 · Python · Beta](https://repo.masters-masters.com/en/repos/jzhang38/EasyContext)
- [jzhang38/LongMamba · ★ 223 · Python · Prototype](https://repo.masters-masters.com/en/repos/jzhang38/LongMamba)

## Nearby in Python

- [apple-aiml-research/ml-sharp · ★ 9,029 · Python · Stable](https://repo.masters-masters.com/en/repos/apple-aiml-research/ml-sharp)
- [frappe/hrms · ★ 9,017 · Python · Stable](https://repo.masters-masters.com/en/repos/frappe/hrms)
- [MIC-DKFZ/nnUNet · ★ 9,009 · Python · Stable](https://repo.masters-masters.com/en/repos/MIC-DKFZ/nnUNet)
- [n1nj4sec/pupy · ★ 9,004 · Python · Stable](https://repo.masters-masters.com/en/repos/n1nj4sec/pupy)
- [Uberi/speech\_recognition · ★ 9,000 · Python · Stable](https://repo.masters-masters.com/en/repos/Uberi/speech_recognition)
- [NVIDIA/apex · ★ 9,000 · Python · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/apex)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.