PrototypeCommon
npuichigo/openai_trtllm
OpenAI compatible API for TensorRT LLM triton backend
- Owner
- npuichigo (personal account)
- Stars
- Stars: 221
- Forks
- Forks: 32
- Language
- Rust
- License
- MIT
- Created
- 2023
- Topics
- langchainllmopenai-apitensorrt-llmtriton-inference-server
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by npuichigo
All 2 repos by npuichigo- npuichigo/waveglowStars: 205PythonPrototype
Nearby in Rust
All Rust repos- DawnMagnet/hearthstone-linux-guiStars: 221RustPrototype
- slaterain/nv-rsStars: 221RustPrototype
- crystalmasta/unbihexStars: 221RustPrototype
- discord/loquiStars: 221RustPrototype
- openrr/kStars: 221RustPrototype
- softprops/dynomiteStars: 221RustPrototype