# NVIDIA/TensorRT-LLM

<https://repo.masters-masters.com/en/repos/NVIDIA/TensorRT-LLM>

[Home](https://repo.masters-masters.com/en) › [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) › [TensorRT-LLM](https://repo.masters-masters.com/en/repos/NVIDIA/TensorRT-LLM)

NVIDIA/TensorRT-LLM has 14,990 stars on GitHub. Its RepoMasters card: Stable tier. TensorRT LLM provides users with an easy-to-use Python API to define Large…

| Field | Value |
| --- | --- |
| Owner | [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) |
| Stars | 14,990 |
| Forks | 2,897 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2023 |
| Topics | blackwell, cuda, moe, pytorch, llm-serving |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [NVIDIA/TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) |

## Repository

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execu…

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by NVIDIA

- [NVIDIA/SkillSpector · ★ 23,897 · Python · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/SkillSpector)
- [NVIDIA/NemoClaw · ★ 22,915 · TypeScript · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/NemoClaw)
- [NVIDIA/OpenShell · ★ 20,930 · Rust · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/OpenShell)
- [NVIDIA/Megatron-LM · ★ 18,312 · Python · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/Megatron-LM)
- [NVIDIA/nvidia-docker · ★ 17,607 · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/nvidia-docker)
- [NVIDIA/open-gpu-kernel-modules · ★ 17,544 · C · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/open-gpu-kernel-modules)

## Nearby in Python

- [maurosoria/dirsearch · ★ 15,033 · Python · Stable](https://repo.masters-masters.com/en/repos/maurosoria/dirsearch)
- [nikopueringer/CorridorKey · ★ 15,005 · Python · Stable](https://repo.masters-masters.com/en/repos/nikopueringer/CorridorKey)
- [optuna/optuna · ★ 15,001 · Python · Stable](https://repo.masters-masters.com/en/repos/optuna/optuna)
- [pjialin/py12306 · ★ 14,972 · Python · Stable](https://repo.masters-masters.com/en/repos/pjialin/py12306)
- [myhhub/stock · ★ 14,952 · Python · Stable](https://repo.masters-masters.com/en/repos/myhhub/stock)
- [wifiphisher/wifiphisher · ★ 14,932 · Python · Stable](https://repo.masters-masters.com/en/repos/wifiphisher/wifiphisher)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.