Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

prometheus-eval/prometheus

[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.

Owner
prometheus-eval (organization)
Stars
Stars: 327
Forks
Forks: 18
Language
Python
License
MIT
Created
2023
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by prometheus-eval

All 2 repos by prometheus-eval

Nearby in Python

All Python repos