# Lightning-AI/LitServe

<https://repo.masters-masters.com/en/repos/Lightning-AI/LitServe>

[Home](https://repo.masters-masters.com/en) › [Lightning-AI](https://repo.masters-masters.com/en/owners/Lightning-AI) › [LitServe](https://repo.masters-masters.com/en/repos/Lightning-AI/LitServe)

Lightning-AI/LitServe has 3,980 stars on GitHub. Its RepoMasters card: RC tier. A minimal Python framework for building custom AI inference servers with full…

| Field | Value |
| --- | --- |
| Owner | [Lightning-AI](https://repo.masters-masters.com/en/owners/Lightning-AI) |
| Stars | 3,980 |
| Forks | 323 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | ai, api, serving, artificial-intelligence, deep-learning, developer-tools, fastapi, rest-api, web |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [Lightning-AI/LitServe](https://github.com/Lightning-AI/LitServe) |

## Repository

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by Lightning-AI

- [Lightning-AI/pytorch-lightning · ★ 31,439 · Python · LTS](https://repo.masters-masters.com/en/repos/Lightning-AI/pytorch-lightning)
- [Lightning-AI/litgpt · ★ 13,743 · Python · Stable](https://repo.masters-masters.com/en/repos/Lightning-AI/litgpt)
- [Lightning-AI/lit-llama · ★ 6,083 · Python · Stable](https://repo.masters-masters.com/en/repos/Lightning-AI/lit-llama)
- [Lightning-AI/torchmetrics · ★ 2,481 · Python · RC](https://repo.masters-masters.com/en/repos/Lightning-AI/torchmetrics)
- [Lightning-AI/lightning-thunder · ★ 1,476 · Python · Beta](https://repo.masters-masters.com/en/repos/Lightning-AI/lightning-thunder)
- [Lightning-AI/deep-learning-project-template · ★ 1,287 · Python · Beta](https://repo.masters-masters.com/en/repos/Lightning-AI/deep-learning-project-template)

## Nearby in Python

- [amazon-science/mm-cot · ★ 3,983 · Python · RC](https://repo.masters-masters.com/en/repos/amazon-science/mm-cot)
- [neuraloperator/neuraloperator · ★ 3,982 · Python · RC](https://repo.masters-masters.com/en/repos/neuraloperator/neuraloperator)
- [arman-bd/guppylm · ★ 3,981 · Python · RC](https://repo.masters-masters.com/en/repos/arman-bd/guppylm)
- [tox-dev/tox · ★ 3,978 · Python · RC](https://repo.masters-masters.com/en/repos/tox-dev/tox)
- [snipsco/snips-nlu · ★ 3,975 · Python · RC](https://repo.masters-masters.com/en/repos/snipsco/snips-nlu)
- [AnswerDotAI/RAGatouille · ★ 3,975 · Python · RC](https://repo.masters-masters.com/en/repos/AnswerDotAI/RAGatouille)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.