# AI-Hypercomputer/JetStream

<https://repo.masters-masters.com/en/repos/AI-Hypercomputer/JetStream>

[Home](https://repo.masters-masters.com/en) › [AI-Hypercomputer](https://repo.masters-masters.com/en/owners/AI-Hypercomputer) › [JetStream](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/JetStream)

AI-Hypercomputer/JetStream has 472 stars on GitHub. Its RepoMasters card: Alpha tier. JetStream is a throughput and memory optimized engine for LLM inference…

| Field | Value |
| --- | --- |
| Owner | [AI-Hypercomputer](https://repo.masters-masters.com/en/owners/AI-Hypercomputer) |
| Stars | 472 |
| Forks | 70 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, model-serving |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [AI-Hypercomputer/JetStream](https://github.com/AI-Hypercomputer/JetStream) |

## Repository

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by AI-Hypercomputer

- [AI-Hypercomputer/maxtext · ★ 2,455 · Python · RC](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/maxtext)
- [AI-Hypercomputer/maxdiffusion · ★ 394 · Python · Alpha](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/maxdiffusion)
- [AI-Hypercomputer/RecML · ★ 230 · Python · Prototype](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/RecML)
- [AI-Hypercomputer/xpk · ★ 196 · Python · Prototype](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/xpk)
- [AI-Hypercomputer/gpu-recipes · ★ 144 · Python · Prototype](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/gpu-recipes)
- [AI-Hypercomputer/tpu-recipes · ★ 136 · Shell · Prototype](https://repo.masters-masters.com/en/repos/AI-Hypercomputer/tpu-recipes)

## Nearby in Python

- [tizzy916/humanities-writing-companion · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/tizzy916/humanities-writing-companion)
- [https-deeplearning-ai/deeplearning-ai · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/https-deeplearning-ai/deeplearning-ai)
- [RongleCat/awesome-grok-bot · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/RongleCat/awesome-grok-bot)
- [tildaslash/RatticWeb · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/tildaslash/RatticWeb)
- [Gifts/Rogue-MySql-Server · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/Gifts/Rogue-MySql-Server)
- [foospidy/HoneyPy · ★ 472 · Python · Alpha](https://repo.masters-masters.com/en/repos/foospidy/HoneyPy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.