# toverainc/willow-inference-server

<https://repo.masters-masters.com/en/repos/toverainc/willow-inference-server>

[Home](https://repo.masters-masters.com/en) › [toverainc](https://repo.masters-masters.com/en/owners/toverainc) › [willow-inference-server](https://repo.masters-masters.com/en/repos/toverainc/willow-inference-server)

toverainc/willow-inference-server has 511 stars on GitHub. Its RepoMasters card: Alpha tier. Open source, local, and self-hosted highly optimized language…

| Field | Value |
| --- | --- |
| Owner | [toverainc](https://repo.masters-masters.com/en/owners/toverainc) |
| Stars | 511 |
| Forks | 60 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | cuda, deep-learning, llama, llm, privacy, speech-recognition, speech-to-text, text-to-speech, vicuna, webrtc |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [toverainc/willow-inference-server](https://github.com/toverainc/willow-inference-server) |

## Repository

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Python

- [Tommy-yw/RunbookHermes · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/Tommy-yw/RunbookHermes)
- [adongwanai/learn-workbuddy · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/adongwanai/learn-workbuddy)
- [Tencent/WeVisDoc · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/Tencent/WeVisDoc)
- [ponty/pyscreenshot · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/ponty/pyscreenshot)
- [theelous3/asks · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/theelous3/asks)
- [crflynn/stochastic · ★ 511 · Python · Alpha](https://repo.masters-masters.com/en/repos/crflynn/stochastic)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.