Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

CASE-Lab-UMD/LLM-Drop

The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".

Owner
CASE-Lab-UMD (organization)
Stars
Stars: 193
Forks
Forks: 23
Language
Python
License
Apache-2.0
Created
2024
Topics
attention-mechanismdeep-learninglarge-language-modelsmachine-learningmodel-compressionnatural-language-processing
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos