Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

Lightning-AI/lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Owner
Lightning-AI (organization)
Stars
Stars: 6,083
Forks
Forks: 516
Language
Python
License
Apache-2.0
Created
2023
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by Lightning-AI

All 11 repos by Lightning-AI

Nearby in Python

All Python repos