# Lightning-AI/lit-llama

<https://repo.masters-masters.com/en/repos/Lightning-AI/lit-llama>

[Home](https://repo.masters-masters.com/en) › [Lightning-AI](https://repo.masters-masters.com/en/owners/Lightning-AI) › [lit-llama](https://repo.masters-masters.com/en/repos/Lightning-AI/lit-llama)

Lightning-AI/lit-llama has 6,083 stars on GitHub. Its RepoMasters card: Stable tier. Implementation of the LLaMA language model based on nanoGPT. Supports…

| Field | Value |
| --- | --- |
| Owner | [Lightning-AI](https://repo.masters-masters.com/en/owners/Lightning-AI) |
| Stars | 6,083 |
| Forks | 516 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [Lightning-AI/lit-llama](https://github.com/Lightning-AI/lit-llama) |

## Repository

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by Lightning-AI

- [Lightning-AI/pytorch-lightning · ★ 31,441 · Python · LTS](https://repo.masters-masters.com/en/repos/Lightning-AI/pytorch-lightning)
- [Lightning-AI/litgpt · ★ 13,745 · Python · Stable](https://repo.masters-masters.com/en/repos/Lightning-AI/litgpt)
- [Lightning-AI/LitServe · ★ 3,986 · Python · RC](https://repo.masters-masters.com/en/repos/Lightning-AI/LitServe)
- [Lightning-AI/torchmetrics · ★ 2,481 · Python · RC](https://repo.masters-masters.com/en/repos/Lightning-AI/torchmetrics)
- [Lightning-AI/lightning-thunder · ★ 1,476 · Python · Beta](https://repo.masters-masters.com/en/repos/Lightning-AI/lightning-thunder)
- [Lightning-AI/deep-learning-project-template · ★ 1,287 · Python · Beta](https://repo.masters-masters.com/en/repos/Lightning-AI/deep-learning-project-template)

## Nearby in Python

- [cloud-custodian/cloud-custodian · ★ 6,106 · Python · Stable](https://repo.masters-masters.com/en/repos/cloud-custodian/cloud-custodian)
- [microsoft/CUAWright · ★ 6,089 · Python · Stable](https://repo.masters-masters.com/en/repos/microsoft/CUAWright)
- [princeton-nlp/tree-of-thought-llm · ★ 6,087 · Python · Stable](https://repo.masters-masters.com/en/repos/princeton-nlp/tree-of-thought-llm)
- [sooperset/mcp-atlassian · ★ 6,080 · Python · Stable](https://repo.masters-masters.com/en/repos/sooperset/mcp-atlassian)
- [pallets-eco/flask-admin · ★ 6,072 · Python · Stable](https://repo.masters-masters.com/en/repos/pallets-eco/flask-admin)
- [openstack/openstack · ★ 6,072 · Python · Stable](https://repo.masters-masters.com/en/repos/openstack/openstack)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.