# FMInference/H2O

<https://repo.masters-masters.com/en/repos/FMInference/H2O>

[Home](https://repo.masters-masters.com/en) › [FMInference](https://repo.masters-masters.com/en/owners/FMInference) › [H2O](https://repo.masters-masters.com/en/repos/FMInference/H2O)

FMInference/H2O has 537 stars on GitHub. Its RepoMasters card: Alpha tier. \[NeurIPS'23\] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large…

| Field | Value |
| --- | --- |
| Owner | [FMInference](https://repo.masters-masters.com/en/owners/FMInference) |
| Stars | 537 |
| Forks | 92 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2023 |
| Topics | gpt-3, heavy-hitters, high-throughput, kv-cache, large-language-models, sparsity |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [FMInference/H2O](https://github.com/FMInference/H2O) |

## Repository

\[NeurIPS'23\] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by FMInference

- [FMInference/FlexLLMGen · ★ 9,343 · Python · Stable](https://repo.masters-masters.com/en/repos/FMInference/FlexLLMGen)
- [FMInference/DejaVu · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/FMInference/DejaVu)

## Nearby in Python

- [ARCANGEL0/Mitsu · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/ARCANGEL0/Mitsu)
- [lasselian/prism-desktop · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/lasselian/prism-desktop)
- [RosettaCommons/RFD4-Proteina · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/RosettaCommons/RFD4-Proteina)
- [Pymol-Scripts/Pymol-script-repo · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/Pymol-Scripts/Pymol-script-repo)
- [Valloric/MatchTagAlways · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/Valloric/MatchTagAlways)
- [benhoyt/scandir · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/benhoyt/scandir)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.