# EvolvingLMMs-Lab/lmms-eval

<https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/lmms-eval>

[Home](https://repo.masters-masters.com/en) › [EvolvingLMMs-Lab](https://repo.masters-masters.com/en/owners/EvolvingLMMs-Lab) › [lmms-eval](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/lmms-eval)

EvolvingLMMs-Lab/lmms-eval has 4,479 stars on GitHub. Its RepoMasters card: RC tier. One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and…

| Field | Value |
| --- | --- |
| Owner | [EvolvingLMMs-Lab](https://repo.masters-masters.com/en/owners/EvolvingLMMs-Lab) |
| Stars | 4,479 |
| Forks | 683 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2024 |
| Topics | agi, evaluation, large-language-models, multimodal, audio-evaluation, benchmark, llm-evaluation, video-understanding, vision-language-model, vlm |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [EvolvingLMMs-Lab/lmms-eval](https://github.com/EvolvingLMMs-Lab/lmms-eval) |

## Repository

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by EvolvingLMMs-Lab

- [EvolvingLMMs-Lab/Otter · ★ 3,443 · Python · RC](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/Otter)
- [EvolvingLMMs-Lab/open-r1-multimodal · ★ 1,605 · Python · Beta](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/open-r1-multimodal)
- [EvolvingLMMs-Lab/LLaVA-OneVision-2 · ★ 1,229 · Python · Beta](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/LLaVA-OneVision-2)
- [EvolvingLMMs-Lab/NEO · ★ 910 · Python · Beta](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/NEO)
- [EvolvingLMMs-Lab/lmms-engine · ★ 833 · Python · Beta](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/lmms-engine)
- [EvolvingLMMs-Lab/RelateAnything · ★ 527 · Python · Alpha](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/RelateAnything)

## Nearby in Python

- [lennylxx/ipv6-hosts · ★ 4,484 · Python · RC](https://repo.masters-masters.com/en/repos/lennylxx/ipv6-hosts)
- [microsoft/LMOps · ★ 4,484 · Python · RC](https://repo.masters-masters.com/en/repos/microsoft/LMOps)
- [microsoft/BioGPT · ★ 4,482 · Python · RC](https://repo.masters-masters.com/en/repos/microsoft/BioGPT)
- [Kyubyong/transformer · ★ 4,475 · Python · RC](https://repo.masters-masters.com/en/repos/Kyubyong/transformer)
- [open-compass/VLMEvalKit · ★ 4,472 · Python · RC](https://repo.masters-masters.com/en/repos/open-compass/VLMEvalKit)
- [thunlp/OpenNRE · ★ 4,469 · Python · RC](https://repo.masters-masters.com/en/repos/thunlp/OpenNRE)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.