# open-compass/VLMEvalKit

<https://repo.masters-masters.com/en/repos/open-compass/VLMEvalKit>

[Home](https://repo.masters-masters.com/en) › [open-compass](https://repo.masters-masters.com/en/owners/open-compass) › [VLMEvalKit](https://repo.masters-masters.com/en/repos/open-compass/VLMEvalKit)

open-compass/VLMEvalKit has 4,472 stars on GitHub. Its RepoMasters card: RC tier. Open-source evaluation toolkit of large multi-modality models (LMMs)…

| Field | Value |
| --- | --- |
| Owner | [open-compass](https://repo.masters-masters.com/en/owners/open-compass) |
| Stars | 4,472 |
| Forks | 788 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | gpt-4v, large-language-models, llava, multi-modal, openai, vqa, llm, openai-api, qwen, gpt |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [open-compass/VLMEvalKit](https://github.com/open-compass/VLMEvalKit) |

## Repository

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by open-compass

- [open-compass/opencompass · ★ 7,563 · Python · Stable](https://repo.masters-masters.com/en/repos/open-compass/opencompass)
- [open-compass/MixtralKit · ★ 768 · Python · Beta](https://repo.masters-masters.com/en/repos/open-compass/MixtralKit)
- [open-compass/LawBench · ★ 457 · Python · Alpha](https://repo.masters-masters.com/en/repos/open-compass/LawBench)
- [open-compass/T-Eval · ★ 313 · Python · Alpha](https://repo.masters-masters.com/en/repos/open-compass/T-Eval)
- [open-compass/MMBench · ★ 312 · Alpha](https://repo.masters-masters.com/en/repos/open-compass/MMBench)
- [open-compass/AgentCompass · ★ 188 · Python · Prototype](https://repo.masters-masters.com/en/repos/open-compass/AgentCompass)

## Nearby in Python

- [microsoft/BioGPT · ★ 4,482 · Python · RC](https://repo.masters-masters.com/en/repos/microsoft/BioGPT)
- [EvolvingLMMs-Lab/lmms-eval · ★ 4,479 · Python · RC](https://repo.masters-masters.com/en/repos/EvolvingLMMs-Lab/lmms-eval)
- [Kyubyong/transformer · ★ 4,475 · Python · RC](https://repo.masters-masters.com/en/repos/Kyubyong/transformer)
- [thunlp/OpenNRE · ★ 4,469 · Python · RC](https://repo.masters-masters.com/en/repos/thunlp/OpenNRE)
- [GerbenJavado/LinkFinder · ★ 4,468 · Python · RC](https://repo.masters-masters.com/en/repos/GerbenJavado/LinkFinder)
- [facebookresearch/DrQA · ★ 4,468 · Python · RC](https://repo.masters-masters.com/en/repos/facebookresearch/DrQA)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.