HumanEval / MBPP

data category: LLM evaluation benchmarks · 0 papers in the last 7 days

← Most-used data · All LLM evaluation benchmarks datasets

Benchmarks used to compare large language models on knowledge, reasoning, math and code.

Names searched for: HumanEval, MBPP

Key findings#

From Nov 2023 to Oct 2026, 33 archived papers mentioned HumanEval / MBPP in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jan 2026 (5).
No paper of the tracked journals mentioned HumanEval / MBPP in the last 30 days (2026-10-06 to 2026-11-04).
From 2017 to 2026 (so far), HumanEval / MBPP was mentioned in 33 papers in the tracked journals, most of them in AI (31) and operations research (2).
14 of them were published in 2025, against 0 in 2017.
Since 2023, the institutions with the most of these papers were National University of Singapore (3), South China University of Technology (3) and Chinese Academy of Sciences (2).
The journals publishing most of them were IEEE Transactions on Pattern Analysis and Machine Intelligence (4), Artificial Intelligence Review (3) and Expert Systems with Applications (3).
The most-cited of them is “A Survey on Mixture of Experts in Large Language Models” (IEEE Transactions on Knowledge and Data Engineering, 2025), with 172 citations.
Papers use HumanEval / MBPP most often with MMLU (18), GSM8K / MATH (16) and Hugging Face Hub (10); it has 10 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

Mentions over 36 months#

Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)
Trend	Nov 23–Oct 24	Nov 24–Oct 25	Nov 25–Oct 26	36 months
	1	12	20	33

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2024	2025	2026 (so far)
AI	2	13	16
Operations Research	0	1	1
All categories	2	14	17

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	IEEE Transactions on Pattern Analysis and Machine Intelligence	4
2	Artificial Intelligence Review	3
3	Expert Systems with Applications	3
4	IEEE Transactions on Artificial Intelligence	3
5	Information Processing & Management	2
6	IEEE Transactions on Evolutionary Computation	2
7	Information Fusion	2
8	Nature Machine Intelligence	2
9	Pattern Recognition	1
10	Computers & Industrial Engineering	1

Institutions with the most papers, since 2023
#	Institution	Papers
1	National University of Singapore	3
2	South China University of Technology	3
3	Chinese Academy of Sciences	2
4	KIIT University	2
5	Massachusetts Institute of Technology	2
6	National University of Defense Technology	2
7	Shandong University	2
8	Singapore Management University	2
9	Tsinghua University	2
10	Universiti Teknikal Malaysia Melaka	2

Countries with the most papers, since 2023
#	Country	Papers
1	China	16
2	United States	7
3	Singapore	4
4	Australia	3
5	Germany	3
6	United Arab Emirates	2
7	Canada	2
8	Hong Kong	2
9	India	2
10	Malaysia	2

Keywords with the most papers, since 2023
#	Keyword	Papers
1	large language models	25
2	code generation	5
3	LLM agents	3
4	low-rank adaptation	3
5	mixture of experts	3
6	multi-agent systems	3
7	prompt engineering	3
8	CodeLlama	2
9	GPT-4	2
10	HumanEval	2

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	172	7.8	A Survey on Mixture of Experts in Large Language Models	IEEE Transactions on Knowledge and Data Engineering	2025-01-01	Weilin Cai, Juyong Jiang, Fan Wang et al.
2	119	9.8	Datasets for large language models: a comprehensive survey	Artificial Intelligence Review	2025-10-31	Yang Liu, Jiahuan Cao, Chongyu Liu et al.
3	104	5.9	Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence	IEEE Transactions on Artificial Intelligence	2025-05-13	Timothy R. McIntosh, Teo Sušnjak, Nalin Asanka Gamagedara Arachchilage et al.
4	34	2.0	Large language models for automated scholarly paper review: A survey	Information Fusion	2025-05-30	Zhenzhen Zhuang, Jiandong Chen, Hongfeng Xu et al.
5	34	2.5	Mixture of experts (MoE): A big data perspective	Information Fusion	2025-09-17	Wensheng Gan, Zhenyao Ning, Zhenlian Qi et al.

Archive counts by publication year: a paper counts when its title, abstract or keywords name the dataset, or when OpenAlex's full-text search finds it there (searched for the last 30 days' papers and, by a pass over the past years, for older ones). Names added to the list later are looked for in older papers as the archive is read again.

Used together with#

Papers use HumanEval / MBPP most often with MMLU (18), GSM8K / MATH (16) and Hugging Face Hub (10); it has 10 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok. The whole network →

What papers use HumanEval / MBPP together with (at least 3 papers; lift 1 = chance)
Used with	Type	Papers using both	Lift
MMLU	Dataset	18	287.3
GSM8K / MATH	Dataset	16	395.6
Hugging Face Hub	Dataset	10	27.4
BIG-bench	Dataset	8	325.4
TruthfulQA / HellaSwag / ARC	Dataset	8	144.1
MT-Bench / Chatbot Arena	Dataset	7	106.3
GLUE / SuperGLUE	Dataset	5	58.4
Wikipedia	Dataset	5	6.5
ImageNet	Dataset	4	2.2
Retrieval and QA (MS MARCO, Natural Questions, HotpotQA)	Dataset	4	67.2

Cite this page

Scholar4AI. (2026). HumanEval / MBPP. Journal and Conference Research Rankings. Retrieved November 4, 2026, from https://scholar4ai.com/datasets/humaneval-mbpp

@misc{scholar4ai-datasets-humaneval-mbpp,
  author = {{Scholar4AI}},
  title = {HumanEval / MBPP},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/humaneval-mbpp}},
  urldate = {2026-11-04},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).