Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
RCEpic

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Owner
withcatai (organization)
Stars
Stars: 2,197
Forks
Forks: 228
Language
TypeScript
License
MIT
Created
2023
Topics
aibindingscataillamallama-cppllmnodejsprebuilt-binariesgrammargguf
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

More repos by withcatai

All 2 repos by withcatai

Nearby in TypeScript

All TypeScript repos