PrototypeCommon
infinigence/Semi-PD
A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
- Owner
- infinigence (organization)
- Stars
- Stars: 141
- Forks
- Forks: 17
- Language
- Python
- License
- Apache-2.0
- Created
- 2025
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by infinigence
All 5 repos by infinigence- infinigence/Infini-MegrezStars: 337Alpha
- infinigence/FlashOverlapStars: 252PythonAlpha
- infinigence/Infini-Megrez-OmniStars: 243PythonPrototype
- infinigence/FUSCOStars: 127PythonPrototype
Nearby in Python
All Python repos- logabell/dewarrStars: 141PythonPrototype
- apromisedland/Tame_3DStars: 141PythonPrototype
- 1314521gjy/ComfyUI-Local-Infinite-CanvasStars: 141PythonPrototype
- pelme/django-compressStars: 141PythonPrototype
- simonw/ratelimitcacheStars: 141PythonPrototype
- lmacken/liveusb-creatorStars: 141PythonPrototype