# interestingLSY/swiftLLM

<https://repo.masters-masters.com/en/repos/interestingLSY/swiftLLM>

[Home](https://repo.masters-masters.com/en) › [interestingLSY](https://repo.masters-masters.com/en/owners/interestingLSY) › [swiftLLM](https://repo.masters-masters.com/en/repos/interestingLSY/swiftLLM)

interestingLSY/swiftLLM has 363 stars on GitHub. Its RepoMasters card: Alpha tier. A tiny yet powerful LLM inference system tailored for researching purpose…

| Field | Value |
| --- | --- |
| Owner | [interestingLSY](https://repo.masters-masters.com/en/owners/interestingLSY) |
| Stars | 363 |
| Forks | 43 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | transformer, transformers, cuda, inference, inference-engine, pytorch, gpt, llama, llm, llm-inference |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [interestingLSY/swiftLLM](https://github.com/interestingLSY/swiftLLM) |

## Repository

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by interestingLSY

- [interestingLSY/CUDA-From-Correctness-To-Performance-Code · ★ 187 · C++ · Prototype](https://repo.masters-masters.com/en/repos/interestingLSY/CUDA-From-Correctness-To-Performance-Code)

## Nearby in Python

- [notepower2k1/CapCap · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/notepower2k1/CapCap)
- [eliautobot/my-virtual-office · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/eliautobot/my-virtual-office)
- [Wan-Video/Wan-Animate-2 · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/Wan-Video/Wan-Animate-2)
- [sbraz/pymediainfo · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/sbraz/pymediainfo)
- [albertz/PyCParser · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/albertz/PyCParser)
- [openaddresses/pyesridump · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/openaddresses/pyesridump)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.