# lumia431/photon\_infer

<https://repo.masters-masters.com/en/repos/lumia431/photon_infer>

[Home](https://repo.masters-masters.com/en) › [lumia431](https://repo.masters-masters.com/en/owners/lumia431) › [photon\_infer](https://repo.masters-masters.com/en/repos/lumia431/photon_infer)

lumia431/photon\_infer has 122 stars on GitHub. Its RepoMasters card: Prototype tier. A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

| Field | Value |
| --- | --- |
| Owner | [lumia431](https://repo.masters-masters.com/en/owners/lumia431) |
| Stars | 122 |
| Forks | 7 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | MIT |
| Created | 2025 |
| Topics | ai-infra, continuous-batching, inference-engine, llm-inference, modern-cpp, paged-attention, vllm |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [lumia431/photon\_infer](https://github.com/lumia431/photon_infer) |

## Repository

A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by lumia431

- [lumia431/reaction · ★ 607 · C++ · Alpha](https://repo.masters-masters.com/en/repos/lumia431/reaction)

## Nearby in C++

- [lxw112190/lw.Web2Android · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/lxw112190/lw.Web2Android)
- [zmodelerlover/OpenNR-ReShade · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/zmodelerlover/OpenNR-ReShade)
- [badcompany94-rcmp/project-tandem · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/badcompany94-rcmp/project-tandem)
- [sztupy/adbputty · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/sztupy/adbputty)
- [shafreeck/pb2json · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/shafreeck/pb2json)
- [openigtlink/OpenIGTLink · ★ 122 · C++ · Prototype](https://repo.masters-masters.com/en/repos/openigtlink/OpenIGTLink)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.