AlphaUncommon
dusty-nv/NanoLLM
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
- Owner
- dusty-nv (personal account)
- Stars
- Stars: 379
- Forks
- Forks: 67
- Language
- Python
- License
- MIT
- Created
- 2024
- Topics
- edge-aillm-inferencemultimodalspeechragvector-databasevision-transformer
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by dusty-nv
All 8 repos by dusty-nv- dusty-nv/jetson-inferenceStars: 9,032C++Stable
- dusty-nv/jetson-containersStars: 4,898Jupyter NotebookRC
- dusty-nv/ros_deep_learningStars: 984C++Beta
- dusty-nv/jetson-reinforcementStars: 934C++Beta
- dusty-nv/jetson-utilsStars: 915C++Beta
- dusty-nv/jetbot_rosStars: 402PythonAlpha
Nearby in Python
All Python repos- monarchjuno/tradingcodexStars: 379PythonAlpha
- Sallyn0225/eidolon-scStars: 379PythonAlpha
- arnaldolima1/gow-ascension-pcStars: 379PythonAlpha
- disqus/nydusStars: 379PythonAlpha
- adriank/ObjectPathStars: 379PythonAlpha
- princehaku/pyrailgunStars: 379PythonAlpha