# InftyAI/llmaz

<https://repo.masters-masters.com/en/repos/InftyAI/llmaz>

[Home](https://repo.masters-masters.com/en) › [InftyAI](https://repo.masters-masters.com/en/owners/InftyAI) › [llmaz](https://repo.masters-masters.com/en/repos/InftyAI/llmaz)

InftyAI/llmaz has 315 stars on GitHub. Its RepoMasters card: Alpha tier. ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star…

| Field | Value |
| --- | --- |
| Owner | [InftyAI](https://repo.masters-masters.com/en/owners/InftyAI) |
| Stars | 315 |
| Forks | 48 |
| Language | [Go](https://repo.masters-masters.com/en/languages/go) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | kubernetes, llm, llamacpp, sglang, vllm, text-generation-inference, huggingface, modelscope, ollama, inference |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [InftyAI/llmaz](https://github.com/InftyAI/llmaz) |

## Repository

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work\!

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by InftyAI

- [InftyAI/Awesome-LLMOps · ★ 269 · Python · Alpha](https://repo.masters-masters.com/en/repos/InftyAI/Awesome-LLMOps)

## Nearby in Go

- [praetorian-inc/augustus · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/praetorian-inc/augustus)
- [tawanorg/claude-sync · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/tawanorg/claude-sync)
- [Higangssh/homebutler · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/Higangssh/homebutler)
- [dustin/gomemcached · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/dustin/gomemcached)
- [GeertJohan/gomatrix · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/GeertJohan/gomatrix)
- [bg5sbk/go-labs · ★ 315 · Go · Alpha](https://repo.masters-masters.com/en/repos/bg5sbk/go-labs)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
