# NetEase-Media/grps\_trtllm

<https://repo.masters-masters.com/en/repos/NetEase-Media/grps_trtllm>

[Home](https://repo.masters-masters.com/en) › [NetEase-Media](https://repo.masters-masters.com/en/owners/NetEase-Media) › [grps\_trtllm](https://repo.masters-masters.com/en/repos/NetEase-Media/grps_trtllm)

NetEase-Media/grps\_trtllm has 161 stars on GitHub. Its RepoMasters card: Prototype tier. Higher performance OpenAI LLM service than vLLM serve: A pure C++…

| Field | Value |
| --- | --- |
| Owner | [NetEase-Media](https://repo.masters-masters.com/en/owners/NetEase-Media) |
| Stars | 161 |
| Forks | 12 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | llm, openai, tensorrt-llm, chatglm, llama3, qwen2, function-call, ai-agent, llama-index, multi-modal |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [NetEase-Media/grps\_trtllm](https://github.com/NetEase-Media/grps_trtllm) |

## Repository

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by NetEase-Media

- [NetEase-Media/easy-ngo · ★ 300 · Go · Alpha](https://repo.masters-masters.com/en/repos/NetEase-Media/easy-ngo)
- [NetEase-Media/ngo · ★ 183 · Go · Prototype](https://repo.masters-masters.com/en/repos/NetEase-Media/ngo)
- [NetEase-Media/grps · ★ 172 · C++ · Prototype](https://repo.masters-masters.com/en/repos/NetEase-Media/grps)

## Nearby in Python

- [timpratim/macbrow · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/timpratim/macbrow)
- [avi691/linkedin-agent-skill · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/avi691/linkedin-agent-skill)
- [Aoisop/mawoagent · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/Aoisop/mawoagent)
- [lilspikey/django-batch-select · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/lilspikey/django-batch-select)
- [benosteen/FaceRecognition · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/benosteen/FaceRecognition)
- [defnull/multipart · ★ 161 · Python · Prototype](https://repo.masters-masters.com/en/repos/defnull/multipart)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.