AlphaUncommon
intel/neural-speed
An innovative library for efficient LLM inference via low-bit quantization
Archived: this repository is read-only
- Owner
- intel (organization)
- Stars
- Stars: 350
- Forks
- Forks: 36
- Language
- C++
- License
- Apache-2.0
- Created
- 2023
- Topics
- cpufp8gaudi2gpuint4int8llm-inferencelow-bitsparsityfp4
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by intel
All 187 repos by intel- intel/intel-one-monoStars: 10,202Stable
- intel/ipex-llmStars: 8,845PythonStable
- intel/hyperscanStars: 5,513C++Stable
- intel/pcmStars: 3,353C++RC
- intel/haxmStars: 3,306CRC
- intel/acatStars: 3,231C#RC
Nearby in C++
All C++ repos- SnowballXueQiu/sb.hStars: 350C++Alpha
- ModelEngine-Group/unified-cache-managementStars: 350C++Alpha
- chaert-s/spektrafilm-ofxStars: 350C++Alpha
- linthesia/linthesiaStars: 350C++Alpha
- Boyle-Lab/BlacklistStars: 350C++Alpha
- dborth/vbagxStars: 350C++Alpha