RCEpic
predibase/lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Archived: this repository is read-only
- Owner
- predibase (organization)
- Stars
- Stars: 3,834
- Forks
- Forks: 329
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- fine-tuninggptllamallmllm-inferencellm-servingllmopsloramodel-servingpytorch
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by predibase
All 2 repos by predibase- predibase/llm_distillation_playbookStars: 646Jupyter NotebookAlpha
Nearby in Python
All Python repos- HumanAIGC-Engineering/OpenAvatarChatStars: 3,842PythonRC
- PyCQA/flake8Stars: 3,834PythonRC
- benfred/implicitStars: 3,834PythonRC
- sentient-agi/OpenDeepSearchStars: 3,833PythonRC
- newpanjing/simpleuiStars: 3,832PythonRC