PrototypeCommon
NVIDIA/trt-llm-as-openai-windows
This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
- Owner
- NVIDIA (organization)
- Stars
- Stars: 126
- Forks
- Forks: 21
- Language
- Python
- License
- None
- Created
- 2023
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by NVIDIA
All 267 repos by NVIDIA- NVIDIA/SkillSpectorStars: 24,257PythonLTS
- NVIDIA/NemoClawStars: 22,934TypeScriptLTS
- NVIDIA/OpenShellStars: 21,062RustLTS
- NVIDIA/Megatron-LMStars: 18,324PythonStable
- NVIDIA/nvidia-dockerStars: 17,609Stable
- NVIDIA/open-gpu-kernel-modulesStars: 17,550CStable
Nearby in Python
All Python repos- yuzushi-dev/hermes-seoStars: 126PythonPrototype
- markklab1903d9/CS2-FPS-Optimizer-Performance-Boost-Lag-Fix-Tool-2026Stars: 126PythonPrototype
- o-Sakurajimamai-o/cet-practiceStars: 126PythonPrototype
- agiliq/DinetteStars: 126PythonPrototype
- miracle2k/android2poStars: 126PythonPrototype
- deldotdr/txRedisStars: 126PythonPrototype