# NVIDIA/TransformerEngine

<https://repo.masters-masters.com/en/repos/NVIDIA/TransformerEngine>

[Home](https://repo.masters-masters.com/en) › [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) › [TransformerEngine](https://repo.masters-masters.com/en/repos/NVIDIA/TransformerEngine)

NVIDIA/TransformerEngine has 3,599 stars on GitHub. Its RepoMasters card: RC tier. A library for accelerating Transformer models on NVIDIA GPUs, including…

| Field | Value |
| --- | --- |
| Owner | [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) |
| Stars | 3,599 |
| Forks | 885 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2022 |
| Topics | cuda, deep-learning, gpu, machine-learning, python, pytorch, fp8, jax, fp4 |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [NVIDIA/TransformerEngine](https://github.com/NVIDIA/TransformerEngine) |

## Repository

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by NVIDIA

- [NVIDIA/SkillSpector · ★ 23,897 · Python · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/SkillSpector)
- [NVIDIA/NemoClaw · ★ 22,915 · TypeScript · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/NemoClaw)
- [NVIDIA/OpenShell · ★ 20,930 · Rust · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/OpenShell)
- [NVIDIA/Megatron-LM · ★ 18,312 · Python · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/Megatron-LM)
- [NVIDIA/nvidia-docker · ★ 17,607 · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/nvidia-docker)
- [NVIDIA/open-gpu-kernel-modules · ★ 17,544 · C · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/open-gpu-kernel-modules)

## Nearby in Python

- [subbarayudu-j/TheAlgorithms-Python · ★ 3,602 · Python · RC](https://repo.masters-masters.com/en/repos/subbarayudu-j/TheAlgorithms-Python)
- [RUC-NLPIR/FlashRAG · ★ 3,602 · Python · RC](https://repo.masters-masters.com/en/repos/RUC-NLPIR/FlashRAG)
- [ljagiello/ctf-skills · ★ 3,601 · Python · RC](https://repo.masters-masters.com/en/repos/ljagiello/ctf-skills)
- [ZhaoJ9014/face.evoLVe · ★ 3,598 · Python · RC](https://repo.masters-masters.com/en/repos/ZhaoJ9014/face.evoLVe)
- [AiuniAI/Unique3D · ★ 3,597 · Python · RC](https://repo.masters-masters.com/en/repos/AiuniAI/Unique3D)
- [welliamcao/OpsManage · ★ 3,595 · Python · RC](https://repo.masters-masters.com/en/repos/welliamcao/OpsManage)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.