# bigcode-project/bigcodebench

<https://repo.masters-masters.com/en/repos/bigcode-project/bigcodebench>

[Home](https://repo.masters-masters.com/en) › [bigcode-project](https://repo.masters-masters.com/en/owners/bigcode-project) › [bigcodebench](https://repo.masters-masters.com/en/repos/bigcode-project/bigcodebench)

bigcode-project/bigcodebench has 517 stars on GitHub. Its RepoMasters card: Alpha tier. \[ICLR'25\] BigCodeBench: Benchmarking Code Generation Towards AGI

| Field | Value |
| --- | --- |
| Owner | [bigcode-project](https://repo.masters-masters.com/en/owners/bigcode-project) |
| Stars | 517 |
| Forks | 77 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | benchmark, chatgpt, code-generation, large-language-models, program-synthesis, tool-use, function-calling, instruction-following, claude-3, gemini |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [bigcode-project/bigcodebench](https://github.com/bigcode-project/bigcodebench) |

## Repository

\[ICLR'25\] BigCodeBench: Benchmarking Code Generation Towards AGI

Archived: this repository is read-only

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by bigcode-project

- [bigcode-project/starcoder · ★ 7,501 · Python · Stable](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder)
- [bigcode-project/starcoder2 · ★ 2,095 · Python · RC](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder2)
- [bigcode-project/bigcode-evaluation-harness · ★ 1,063 · Python · Beta](https://repo.masters-masters.com/en/repos/bigcode-project/bigcode-evaluation-harness)
- [bigcode-project/bigcode-dataset · ★ 501 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/bigcode-dataset)
- [bigcode-project/octopack · ★ 481 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/octopack)
- [bigcode-project/starcoder.cpp · ★ 459 · C · Alpha](https://repo.masters-masters.com/en/repos/bigcode-project/starcoder.cpp)

## Nearby in Python

- [ttlequals0/MinusPod · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/ttlequals0/MinusPod)
- [Charles-0509/Grok-Register · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/Charles-0509/Grok-Register)
- [lvzuojing/mcd-wrapped · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/lvzuojing/mcd-wrapped)
- [djangonauts/django-hstore · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/djangonauts/django-hstore)
- [karpathy/researchpooler · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/karpathy/researchpooler)
- [mcs07/PubChemPy · ★ 517 · Python · Alpha](https://repo.masters-masters.com/en/repos/mcs07/PubChemPy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.