# Tebmer/Awesome-Knowledge-Distillation-of-LLMs

<https://repo.masters-masters.com/en/repos/Tebmer/Awesome-Knowledge-Distillation-of-LLMs>

[Home](https://repo.masters-masters.com/en) › [Tebmer](https://repo.masters-masters.com/en/owners/Tebmer) › [Awesome-Knowledge-Distillation-of-LLMs](https://repo.masters-masters.com/en/repos/Tebmer/Awesome-Knowledge-Distillation-of-LLMs)

Tebmer/Awesome-Knowledge-Distillation-of-LLMs has 1,318 stars on GitHub. Its RepoMasters card: Beta tier. This repository collects papers for "A Survey on…

| Field | Value |
| --- | --- |
| Owner | [Tebmer](https://repo.masters-masters.com/en/owners/Tebmer) |
| Stars | 1,318 |
| Forks | 76 |
| Language | No language |
| License | None |
| Created | 2024 |
| Topics | data-augmentation, instruction-following, kd, knowledge-distillation, large-language-model, llm, self-training, survey, compression, data-synthesis |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [Tebmer/Awesome-Knowledge-Distillation-of-LLMs](https://github.com/Tebmer/Awesome-Knowledge-Distillation-of-LLMs) |

## Repository

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.