BetaRare
Tebmer/Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
- Owner
- Tebmer (personal account)
- Stars
- Stars: 1,318
- Forks
- Forks: 76
- Language
- No language
- License
- None
- Created
- 2024
- Topics
- data-augmentationinstruction-followingkdknowledge-distillationlarge-language-modelllmself-trainingsurveycompressiondata-synthesis
- Tier
- Beta (700 to 1,999 ★) What this tier means