RCEpic
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- Owner
- Lightning-AI (organization)
- Stars
- Stars: 3,979
- Forks
- Forks: 320
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- aiapiservingartificial-intelligencedeep-learningdeveloper-toolsfastapirest-apiweb
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by Lightning-AI
All 11 repos by Lightning-AI- Lightning-AI/pytorch-lightningStars: 31,438PythonLTS
- Lightning-AI/litgptStars: 13,742PythonStable
- Lightning-AI/lit-llamaStars: 6,083PythonStable
- Lightning-AI/torchmetricsStars: 2,481PythonRC
- Lightning-AI/lightning-thunderStars: 1,476PythonBeta
- Lightning-AI/deep-learning-project-templateStars: 1,287PythonBeta
Nearby in Python
All Python repos- arman-bd/guppylmStars: 3,980PythonRC
- tox-dev/toxStars: 3,979PythonRC
- aasthas2022/SDE-Interview-and-Prep-RoadmapStars: 3,979PythonRC
- masterking32/MasterHttpRelayVPNStars: 3,976PythonRC
- snipsco/snips-nluStars: 3,974PythonRC