---
title: "HumanEval / MBPP: research papers using this data"
description: "From Nov 2023 to Oct 2026, 34 archived papers mentioned HumanEval / MBPP in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jan 2026 (5)."
url: https://scholar4ai.com/datasets/humaneval-mbpp
markdown_url: https://scholar4ai.com/datasets/humaneval-mbpp.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "From Nov 2023 to Oct 2026, 34 archived papers mentioned HumanEval / MBPP in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jan 2026 (5). (as of 2026-11-04)"
data_url: https://scholar4ai.com/data/rankings.json
updated: 2026-11-04T18:03:26+09:00
window: 2026-10-06 to 2026-11-04
source: OpenAlex (CC0)
---

# HumanEval / MBPP

[Browse dataset profiles](https://scholar4ai.com/datasets/directory/page/3.md)

Benchmarks used to compare large language models on knowledge, reasoning, math and code.

- data category: LLM evaluation benchmarks
- 0 papers in the last 7 days
- Names searched for: HumanEval, MBPP

Most-used data: https://scholar4ai.com/rankings/datasets.md · All LLM evaluation benchmarks datasets: https://scholar4ai.com/datasets/llm-evaluation-benchmarks.md



## Key findings

- From Nov 2023 to Oct 2026, 34 archived papers mentioned HumanEval / MBPP in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jan 2026 (5).
- No paper of the tracked journals mentioned HumanEval / MBPP in the last 30 days (2026-10-06 to 2026-11-04).
- From 2017 to 2026 (so far), HumanEval / MBPP was mentioned in 34 papers in the tracked journals, most of them in AI (32) and operations research (2).
- 14 of them were published in 2025, against 0 in 2017.
- Since 2023, the institutions with the most of these papers were National University of Singapore (3), South China University of Technology (3) and Chinese Academy of Sciences (2).
- The journals publishing most of them were IEEE Transactions on Pattern Analysis and Machine Intelligence (4), Artificial Intelligence Review (3) and Expert Systems with Applications (3).
- The most-cited of them is “A Survey on Mixture of Experts in Large Language Models” (IEEE Transactions on Knowledge and Data Engineering, 2025), with 172 citations.
- Papers use HumanEval / MBPP most often with MMLU (18), GSM8K / MATH (16) and Hugging Face Hub (10); it has 10 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

## Mentions over 36 months

*Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)*

| Trend | Nov 23–Oct 24 | Nov 24–Oct 25 | Nov 25–Oct 26 | 36 months |
|---|---:|---:|---:|---:|
|  | 1 | 12 | 21 | 34 |

## Papers per year

*Papers per publication year and category*

| Category | 2017 | 2018 | 2019 | 2020 | 2021 | 2022 | 2023 | 2024 | 2025 | 2026 (so far) |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| [AI](https://scholar4ai.com/categories/ai.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 13 | 17 |
| [Operations Research](https://scholar4ai.com/categories/operations-research.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
| All categories | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 14 | 18 |

## Where the papers come from

*Journals with the most papers, since 2023*

| # | Journal | Papers |
|---:|---|---:|
| 1 | [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-pattern-analysis-and-machine-intelligence.md) | 4 |
| 2 | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | 3 |
| 3 | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | 3 |
| 4 | [IEEE Transactions on Artificial Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-artificial-intelligence.md) | 3 |
| 5 | [Information Processing & Management](https://scholar4ai.com/journals/information-processing-management.md) | 2 |
| 6 | [IEEE Transactions on Evolutionary Computation](https://scholar4ai.com/journals/ieee-transactions-on-evolutionary-computation.md) | 2 |
| 7 | [Information Fusion](https://scholar4ai.com/journals/information-fusion.md) | 2 |
| 8 | [Nature Machine Intelligence](https://scholar4ai.com/journals/nature-machine-intelligence.md) | 2 |
| 9 | [Information Sciences](https://scholar4ai.com/journals/information-sciences.md) | 1 |
| 10 | [Pattern Recognition](https://scholar4ai.com/journals/pattern-recognition.md) | 1 |

*Institutions with the most papers, since 2023*

| # | Institution | Papers |
|---:|---|---:|
| 1 | [National University of Singapore](https://scholar4ai.com/institutions/national-university-of-singapore.md) | 3 |
| 2 | [South China University of Technology](https://scholar4ai.com/institutions/south-china-university-of-technology.md) | 3 |
| 3 | [Chinese Academy of Sciences](https://scholar4ai.com/institutions/chinese-academy-of-sciences.md) | 2 |
| 4 | KIIT University | 2 |
| 5 | [Massachusetts Institute of Technology](https://scholar4ai.com/institutions/massachusetts-institute-of-technology.md) | 2 |
| 6 | [National University of Defense Technology](https://scholar4ai.com/institutions/national-university-of-defense-technology.md) | 2 |
| 7 | [Shandong University](https://scholar4ai.com/institutions/shandong-university.md) | 2 |
| 8 | [Singapore Management University](https://scholar4ai.com/institutions/singapore-management-university.md) | 2 |
| 9 | [Tsinghua University](https://scholar4ai.com/institutions/tsinghua-university.md) | 2 |
| 10 | Universiti Teknikal Malaysia Melaka | 2 |

*Countries with the most papers, since 2023*

| # | Country | Papers |
|---:|---|---:|
| 1 | China | 16 |
| 2 | United States | 7 |
| 3 | Singapore | 4 |
| 4 | Australia | 3 |
| 5 | Germany | 3 |
| 6 | United Arab Emirates | 2 |
| 7 | Canada | 2 |
| 8 | Hong Kong | 2 |
| 9 | India | 2 |
| 10 | Malaysia | 2 |

*Keywords with the most papers, since 2023*

| # | Keyword | Papers |
|---:|---|---:|
| 1 | [large language models](https://scholar4ai.com/keywords/large-language-models.md) | 26 |
| 2 | code generation | 6 |
| 3 | prompt engineering | 4 |
| 4 | LLM agents | 3 |
| 5 | low-rank adaptation | 3 |
| 6 | mixture of experts | 3 |
| 7 | [multi-agent systems](https://scholar4ai.com/keywords/multi-agent-systems.md) | 3 |
| 8 | CodeLlama | 2 |
| 9 | GPT-4 | 2 |
| 10 | HumanEval | 2 |

## Most-cited papers

*Most-cited papers since 2017*

| # | Citations | Per month | Title | Journal | Published | Authors |
|---:|---:|---:|---|---|---|---|
| 1 | 172 | 7.8 | [A Survey on Mixture of Experts in Large Language Models](https://doi.org/10.1109/tkde.2025.3554028) | [IEEE Transactions on Knowledge and Data Engineering](https://scholar4ai.com/journals/ieee-transactions-on-knowledge-and-data-engineering.md) | 2025-01-01 | Weilin Cai, Juyong Jiang, Fan Wang et al. |
| 2 | 119 | 9.8 | [Datasets for large language models: a comprehensive survey](https://doi.org/10.1007/s10462-025-11403-7) | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | 2025-10-31 | Yang Liu, Jiahuan Cao, Chongyu Liu et al. |
| 3 | 104 | 5.9 | [Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence](https://doi.org/10.1109/tai.2025.3569516) | [IEEE Transactions on Artificial Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-artificial-intelligence.md) | 2025-05-13 | Timothy R. McIntosh, Teo Sušnjak, Nalin Asanka Gamagedara Arachchilage et al. |
| 4 | 34 | 2.0 | [Large language models for automated scholarly paper review: A survey](https://doi.org/10.1016/j.inffus.2025.103332) | [Information Fusion](https://scholar4ai.com/journals/information-fusion.md) | 2025-05-30 | Zhenzhen Zhuang, Jiandong Chen, Hongfeng Xu et al. |
| 5 | 34 | 2.5 | [Mixture of experts (MoE): A big data perspective](https://doi.org/10.1016/j.inffus.2025.103664) | [Information Fusion](https://scholar4ai.com/journals/information-fusion.md) | 2025-09-17 | Wensheng Gan, Zhenyao Ning, Zhenlian Qi et al. |

## Used together with

Papers use HumanEval / MBPP most often with MMLU (18), GSM8K / MATH (16) and Hugging Face Hub (10); it has 10 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

*What papers use HumanEval / MBPP together with (at least 3 papers; lift 1 = chance)*

| Used with | Type | Papers using both | Lift |
|---|---|---:|---:|
| [MMLU](https://scholar4ai.com/datasets/mmlu.md) | Dataset | 18 | 320.6 |
| [GSM8K / MATH](https://scholar4ai.com/datasets/gsm8k-math.md) | Dataset | 16 | 424.8 |
| [Hugging Face Hub](https://scholar4ai.com/datasets/hugging-face-hub.md) | Dataset | 10 | 30.1 |
| [BIG-bench](https://scholar4ai.com/datasets/big-bench.md) | Dataset | 8 | 363.1 |
| [TruthfulQA / HellaSwag / ARC](https://scholar4ai.com/datasets/truthfulqa-hellaswag-arc.md) | Dataset | 8 | 160.8 |
| [MT-Bench / Chatbot Arena](https://scholar4ai.com/datasets/mt-bench-chatbot-arena.md) | Dataset | 7 | 118.7 |
| [GLUE / SuperGLUE](https://scholar4ai.com/datasets/glue-superglue.md) | Dataset | 5 | 65.1 |
| [Wikipedia](https://scholar4ai.com/datasets/wikipedia.md) | Dataset | 5 | 6.9 |
| [ImageNet](https://scholar4ai.com/datasets/imagenet.md) | Dataset | 4 | 2.4 |
| [Retrieval and QA (MS MARCO, Natural Questions, HotpotQA)](https://scholar4ai.com/datasets/retrieval-and-qa-ms-marco-natural-questions-hotpotqa.md) | Dataset | 4 | 70.3 |

The whole network: https://scholar4ai.com/code/network.md

## Cite this page

Scholar4AI. (2026). HumanEval / MBPP. Journal and Conference Research Rankings. Retrieved November 4, 2026, from https://scholar4ai.com/datasets/humaneval-mbpp

```bibtex
@misc{scholar4ai-datasets-humaneval-mbpp,
  author = {{Scholar4AI}},
  title = {HumanEval / MBPP},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/humaneval-mbpp}},
  urldate = {2026-11-04},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).