PrototypeCommon
AXERA-TECH/ax-llm
Explore LLM model deployment based on AXera's AI chips, It provides OpenAI‑compatible APIs and supports AX620E, AX650 and AX637 series chips.
- Owner
- AXERA-TECH (organization)
- Stars
- Stars: 170
- Forks
- Forks: 34
- Language
- C++
- License
- BSD-3-Clause
- Created
- 2024
- Topics
- edge-computinghuggingfacellmtransformergemma2internvl2llama3minicpmminicpm-vqwen2
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by AXERA-TECH
All 2 repos by AXERA-TECH- AXERA-TECH/ax-samplesStars: 306CMakeAlpha
Nearby in C++
All C++ repos- ShizCalev/MGSPatriotFixStars: 170C++Prototype
- misterblack1/HU-058_ESPHomeStars: 170C++Prototype
- spuicey/loopcutStars: 170C++Prototype
- gree/flareStars: 170C++Prototype
- eglaysher/rlvmStars: 170C++Prototype
- moai/luamongoStars: 170C++Prototype