# sanyalsunny111/LLM-Inheritune

<https://repo.masters-masters.com/en/repos/sanyalsunny111/LLM-Inheritune>

[Home](https://repo.masters-masters.com/en) › [sanyalsunny111](https://repo.masters-masters.com/en/owners/sanyalsunny111) › [LLM-Inheritune](https://repo.masters-masters.com/en/repos/sanyalsunny111/LLM-Inheritune)

sanyalsunny111/LLM-Inheritune has 126 stars on GitHub. Its RepoMasters card: Prototype tier. \[TMLR 2025\] When Attention Collapses: How Degenerate Layers in…

| Field | Value |
| --- | --- |
| Owner | [sanyalsunny111](https://repo.masters-masters.com/en/owners/sanyalsunny111) |
| Stars | 126 |
| Forks | 9 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | None |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [sanyalsunny111/LLM-Inheritune](https://github.com/sanyalsunny111/LLM-Inheritune) |

## Repository

\[TMLR 2025\] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Jupyter Notebook

- [jamesmontemagno/MonkeyMCP · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/jamesmontemagno/MonkeyMCP)
- [Mayankpratapsingh022/DeepSeek-from-Scratch · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/Mayankpratapsingh022/DeepSeek-from-Scratch)
- [togethercomputer/EinsteinArena-new-SOTA · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/togethercomputer/EinsteinArena-new-SOTA)
- [pyannote/pyannote-core · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/pyannote/pyannote-core)
- [albanie/shot-detection-benchmarks · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/albanie/shot-detection-benchmarks)
- [greenelab/pancancer · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/greenelab/pancancer)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.