# vectorch-ai/ScaleLLM

<https://repo.masters-masters.com/en/repos/vectorch-ai/ScaleLLM>

[Home](https://repo.masters-masters.com/en) › [vectorch-ai](https://repo.masters-masters.com/en/owners/vectorch-ai) › [ScaleLLM](https://repo.masters-masters.com/en/repos/vectorch-ai/ScaleLLM)

vectorch-ai/ScaleLLM has 498 stars on GitHub. Its RepoMasters card: Alpha tier. A high-performance inference system for large language models, designed for…

| Field | Value |
| --- | --- |
| Owner | [vectorch-ai](https://repo.masters-masters.com/en/owners/vectorch-ai) |
| Stars | 498 |
| Forks | 41 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | cuda, inference, llm, llm-inference, model, production, serving, speculative, transformer, efficiency |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [vectorch-ai/ScaleLLM](https://github.com/vectorch-ai/ScaleLLM) |

## Repository

A high-performance inference system for large language models, designed for production environments.

Archived: this repository is read-only

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in C++

- [keenon/nimblephysics · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/keenon/nimblephysics)
- [anysphere/gpt-4-for-code · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/anysphere/gpt-4-for-code)
- [rashevskyv/4IFIR · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/rashevskyv/4IFIR)
- [stxxl/stxxl · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/stxxl/stxxl)
- [mariadb-corporation/galera · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/mariadb-corporation/galera)
- [MAPIRlab/rf2o\_laser\_odometry · ★ 498 · C++ · Alpha](https://repo.masters-masters.com/en/repos/MAPIRlab/rf2o_laser_odometry)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.