# xorbitsai/inference

<https://repo.masters-masters.com/en/repos/xorbitsai/inference>

[Home](https://repo.masters-masters.com/en) › [xorbitsai](https://repo.masters-masters.com/en/owners/xorbitsai) › [inference](https://repo.masters-masters.com/en/repos/xorbitsai/inference)

xorbitsai/inference has 9,638 stars on GitHub. Its RepoMasters card: Stable tier. Swap GPT for any LLM by changing a single line of code. Xinference lets you…

| Field | Value |
| --- | --- |
| Owner | [xorbitsai](https://repo.masters-masters.com/en/owners/xorbitsai) |
| Stars | 9,638 |
| Forks | 892 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | pytorch, llm, artificial-intelligence, machine-learning, whisper, inference, openai-api, gemma, llamacpp, vllm |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [xorbitsai/inference](https://github.com/xorbitsai/inference) |

## Repository

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by xorbitsai

- [xorbitsai/xorbits · ★ 1,198 · Python · Beta](https://repo.masters-masters.com/en/repos/xorbitsai/xorbits)
- [xorbitsai/xagent · ★ 307 · Python · Alpha](https://repo.masters-masters.com/en/repos/xorbitsai/xagent)
- [xorbitsai/xoscar · ★ 177 · Python · Prototype](https://repo.masters-masters.com/en/repos/xorbitsai/xoscar)

## Nearby in Python

- [wangshub/Douyin-Bot · ★ 9,656 · Python · Stable](https://repo.masters-masters.com/en/repos/wangshub/Douyin-Bot)
- [polakowo/vectorbt · ★ 9,651 · Python · Stable](https://repo.masters-masters.com/en/repos/polakowo/vectorbt)
- [apify/crawlee-python · ★ 9,638 · Python · Stable](https://repo.masters-masters.com/en/repos/apify/crawlee-python)
- [AirtestProject/Airtest · ★ 9,633 · Python · Stable](https://repo.masters-masters.com/en/repos/AirtestProject/Airtest)
- [arogozhnikov/einops · ★ 9,630 · Python · Stable](https://repo.masters-masters.com/en/repos/arogozhnikov/einops)
- [PeterL1n/RobustVideoMatting · ★ 9,586 · Python · Stable](https://repo.masters-masters.com/en/repos/PeterL1n/RobustVideoMatting)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.