Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

toverainc/willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

Owner
toverainc (organization)
Stars
Stars: 511
Forks
Forks: 60
Language
Python
License
Apache-2.0
Created
2023
Topics
cudadeep-learningllamallmprivacyspeech-recognitionspeech-to-texttext-to-speechvicunawebrtc
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos