PrototypeCommon
lumia431/photon_infer
A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching
- Owner
- lumia431 (personal account)
- Stars
- Stars: 122
- Forks
- Forks: 7
- Language
- C++
- License
- MIT
- Created
- 2025
- Topics
- ai-infracontinuous-batchinginference-enginellm-inferencemodern-cpppaged-attentionvllm
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by lumia431
All 2 repos by lumia431- lumia431/reactionStars: 607C++Alpha
Nearby in C++
All C++ repos- lxw112190/lw.Web2AndroidStars: 122C++Prototype
- zmodelerlover/OpenNR-ReShadeStars: 122C++Prototype
- badcompany94-rcmp/project-tandemStars: 122C++Prototype
- sztupy/adbputtyStars: 122C++Prototype
- shafreeck/pb2jsonStars: 122C++Prototype
- openigtlink/OpenIGTLinkStars: 122C++Prototype