Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

songmzhang/KDFlow

A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, full vocab on-policy (OPD), cross-tokenizer, multimodal, and on-policy self-distillation.

Owner
songmzhang (personal account)
Stars
Stars: 255
Forks
Forks: 18
Language
Python
License
MIT
Created
2026
Topics
knowledge-distillationon-policy-distillationdistillationlarge-languge-modelscross-tokenizer-distillation
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos