AlphaUncommon
usyd-fsalab/fp6_llm
An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
- Owner
- usyd-fsalab (organization)
- Stars
- Stars: 282
- Forks
- Forks: 26
- Language
- Cuda
- License
- Apache-2.0
- Created
- 2024
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in Cuda
All Cuda repos- facebookarchive/fbcudaStars: 284CudaAlpha
- leimao/CUDA-GEMM-OptimizationStars: 283CudaAlpha
- NVIDIA-BioNeMo/nvMolKitStars: 282CudaAlpha
- nerficg-project/faster-gaussian-splattingStars: 278CudaAlpha
- ColfaxResearch/cutlass-kernelsStars: 271CudaAlpha
- LitLeo/OpenCUDAStars: 269CudaAlpha