# IST-DASLab/marlin

<https://repo.masters-masters.com/en/repos/IST-DASLab/marlin>

[Home](https://repo.masters-masters.com/en) › [IST-DASLab](https://repo.masters-masters.com/en/owners/IST-DASLab) › [marlin](https://repo.masters-masters.com/en/repos/IST-DASLab/marlin)

IST-DASLab/marlin has 1,174 stars on GitHub. Its RepoMasters card: Beta tier. FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to…

| Field | Value |
| --- | --- |
| Owner | [IST-DASLab](https://repo.masters-masters.com/en/owners/IST-DASLab) |
| Stars | 1,174 |
| Forks | 95 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | 4bit, kernel, llm, quantization |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [IST-DASLab/marlin](https://github.com/IST-DASLab/marlin) |

## Repository

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by IST-DASLab

- [IST-DASLab/gptq · ★ 2,389 · Python · RC](https://repo.masters-masters.com/en/repos/IST-DASLab/gptq)
- [IST-DASLab/sparsegpt · ★ 902 · Python · Beta](https://repo.masters-masters.com/en/repos/IST-DASLab/sparsegpt)
- [IST-DASLab/PanzaMail · ★ 305 · Python · Alpha](https://repo.masters-masters.com/en/repos/IST-DASLab/PanzaMail)
- [IST-DASLab/qmoe · ★ 279 · Python · Alpha](https://repo.masters-masters.com/en/repos/IST-DASLab/qmoe)
- [IST-DASLab/llmq · ★ 266 · C++ · Alpha](https://repo.masters-masters.com/en/repos/IST-DASLab/llmq)
- [IST-DASLab/qutlass · ★ 204 · C++ · Prototype](https://repo.masters-masters.com/en/repos/IST-DASLab/qutlass)

## Nearby in Python

- [goodreasonai/ScrapeServ · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/goodreasonai/ScrapeServ)
- [viticci/shortcuts-playground-plugin · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/viticci/shortcuts-playground-plugin)
- [Dpro-at/Tel-Agent · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/Dpro-at/Tel-Agent)
- [muricoca/crab · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/muricoca/crab)
- [tomchop/malcom · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/tomchop/malcom)
- [SamR1/FitTrackee · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/SamR1/FitTrackee)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.