# npuichigo/openai\_trtllm

<https://repo.masters-masters.com/en/repos/npuichigo/openai_trtllm>

[Home](https://repo.masters-masters.com/en) › [npuichigo](https://repo.masters-masters.com/en/owners/npuichigo) › [openai\_trtllm](https://repo.masters-masters.com/en/repos/npuichigo/openai_trtllm)

npuichigo/openai\_trtllm has 221 stars on GitHub. Its RepoMasters card: Prototype tier. OpenAI compatible API for TensorRT LLM triton backend Language: Rust.

| Field | Value |
| --- | --- |
| Owner | [npuichigo](https://repo.masters-masters.com/en/owners/npuichigo) |
| Stars | 221 |
| Forks | 32 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | MIT |
| Created | 2023 |
| Topics | langchain, llm, openai-api, tensorrt-llm, triton-inference-server |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [npuichigo/openai\_trtllm](https://github.com/npuichigo/openai_trtllm) |

## Repository

OpenAI compatible API for TensorRT LLM triton backend

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by npuichigo

- [npuichigo/waveglow · ★ 205 · Python · Prototype](https://repo.masters-masters.com/en/repos/npuichigo/waveglow)

## Nearby in Rust

- [DawnMagnet/hearthstone-linux-gui · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/DawnMagnet/hearthstone-linux-gui)
- [slaterain/nv-rs · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/slaterain/nv-rs)
- [crystalmasta/unbihex · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/crystalmasta/unbihex)
- [discord/loqui · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/discord/loqui)
- [openrr/k · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/openrr/k)
- [softprops/dynomite · ★ 221 · Rust · Prototype](https://repo.masters-masters.com/en/repos/softprops/dynomite)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.