# dusty-nv/NanoLLM

<https://repo.masters-masters.com/en/repos/dusty-nv/NanoLLM>

[Home](https://repo.masters-masters.com/en) › [dusty-nv](https://repo.masters-masters.com/en/owners/dusty-nv) › [NanoLLM](https://repo.masters-masters.com/en/repos/dusty-nv/NanoLLM)

dusty-nv/NanoLLM has 379 stars on GitHub. Its RepoMasters card: Alpha tier. Optimized local inference for LLMs with HuggingFace-like APIs for quantization…

| Field | Value |
| --- | --- |
| Owner | [dusty-nv](https://repo.masters-masters.com/en/owners/dusty-nv) |
| Stars | 379 |
| Forks | 67 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | edge-ai, llm-inference, multimodal, speech, rag, vector-database, vision-transformer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [dusty-nv/NanoLLM](https://github.com/dusty-nv/NanoLLM) |

## Repository

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by dusty-nv

- [dusty-nv/jetson-inference · ★ 9,032 · C++ · Stable](https://repo.masters-masters.com/en/repos/dusty-nv/jetson-inference)
- [dusty-nv/jetson-containers · ★ 4,898 · Jupyter Notebook · RC](https://repo.masters-masters.com/en/repos/dusty-nv/jetson-containers)
- [dusty-nv/ros\_deep\_learning · ★ 984 · C++ · Beta](https://repo.masters-masters.com/en/repos/dusty-nv/ros_deep_learning)
- [dusty-nv/jetson-reinforcement · ★ 934 · C++ · Beta](https://repo.masters-masters.com/en/repos/dusty-nv/jetson-reinforcement)
- [dusty-nv/jetson-utils · ★ 915 · C++ · Beta](https://repo.masters-masters.com/en/repos/dusty-nv/jetson-utils)
- [dusty-nv/jetbot\_ros · ★ 402 · Python · Alpha](https://repo.masters-masters.com/en/repos/dusty-nv/jetbot_ros)

## Nearby in Python

- [OhMyMeme/OhMyMeme · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/OhMyMeme/OhMyMeme)
- [NulightJens/humanizer-stack · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/NulightJens/humanizer-stack)
- [humanfia/humanize · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/humanfia/humanize)
- [disqus/nydus · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/disqus/nydus)
- [adriank/ObjectPath · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/adriank/ObjectPath)
- [princehaku/pyrailgun · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/princehaku/pyrailgun)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.