# bigcode-project/bigcode-evaluation-harness

<https://repo.masters-masters.com/en/repos/bigcode-project/bigcode-evaluation-harness>

[Home](https://repo.masters-masters.com/en) › [bigcode-project](https://repo.masters-masters.com/en/owners/bigcode-project) › [bigcode-evaluation-harness](https://repo.masters-masters.com/en/repos/bigcode-project/bigcode-evaluation-harness)

bigcode-project/bigcode-evaluation-harness has 1,063 stars on GitHub. Its RepoMasters card: Beta tier. A framework for the evaluation of autoregressive code…

| Field | Value |
| --- | --- |
| Owner | [bigcode-project](https://repo.masters-masters.com/en/owners/bigcode-project) |
| Stars | 1,063 |
| Forks | 262 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2022 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [bigcode-project/bigcode-evaluation-harness](https://github.com/bigcode-project/bigcode-evaluation-harness) |

## Repository

A framework for the evaluation of autoregressive code generation language models.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by bigcode-project

- [bigcode-project/starcoder · ★ 7,501 · Python · Stable](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder)
- [bigcode-project/starcoder2 · ★ 2,095 · Python · RC](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder2)
- [bigcode-project/bigcodebench · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/bigcodebench)
- [bigcode-project/bigcode-dataset · ★ 501 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/bigcode-dataset)
- [bigcode-project/octopack · ★ 481 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/octopack)
- [bigcode-project/starcoder.cpp · ★ 459 · C · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder.cpp)

## Nearby in Python

- [splx-ai/agentic-radar · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/splx-ai/agentic-radar)
- [SakuraMathcraft/LaTeXSnipper · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/SakuraMathcraft/LaTeXSnipper)
- [doccker/cc-use-exp · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/doccker/cc-use-exp)
- [furlongm/openvpn-monitor · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/furlongm/openvpn-monitor)
- [SavinaRoja/PyUserInput · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/SavinaRoja/PyUserInput)
- [un33k/django-ipware · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/un33k/django-ipware)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.
