MMLU

data category: LLM evaluation benchmarks · 0 papers in the last 7 days

← Most-used data · All LLM evaluation benchmarks datasets

Benchmarks used to compare large language models on knowledge, reasoning, math and code.

Names searched for: MMLU, Massive Multitask Language Understanding

Key findings#

From Nov 2023 to Oct 2026, 79 archived papers mentioned MMLU in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jul 2026 (10).
MMLU was mentioned in 1 paper in the last 30 days (2026-10-06 to 2026-11-04), ranking #172 of the 255 datasets mentioned.
By journal category: AI (1).
Most of them appeared in Artificial Intelligence Review (1).
From 2017 to 2026 (so far), MMLU was mentioned in 79 papers in the tracked journals, most of them in AI (72), operations research (2) and information systems (1).
34 of them were published in 2025, against 0 in 2017.
Since 2023, the institutions with the most of these papers were National University of Singapore (4), East China Normal University (3) and South China University of Technology (3).
The journals publishing most of them were IEEE Transactions on Pattern Analysis and Machine Intelligence (9), Artificial Intelligence Review (9) and Information Fusion (7).
The most-cited of them is “Large language models in medical and healthcare fields: applications, advances, and challenges” (Artificial Intelligence Review, 2024), with 247 citations.
Papers use MMLU most often with Hugging Face Hub (27), TruthfulQA / HellaSwag / ARC (25) and GSM8K / MATH (24); it has 21 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

Mentions over 36 months#

Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)
Trend	Nov 23–Oct 24	Nov 24–Oct 25	Nov 25–Oct 26	36 months
	8	29	42	79

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2024	2025	2026 (so far)
AI	8	32	32
Operations Research	0	1	1
Information Systems	0	0	1
Economics	0	0	1
Management	0	0	1
Accounting	1	0	0
Higher Education and Research	0	1	0
All categories	9	34	36

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	IEEE Transactions on Pattern Analysis and Machine Intelligence	9
2	Artificial Intelligence Review	9
3	Information Fusion	7
4	Nature Machine Intelligence	7
5	Knowledge-Based Systems	5
6	Information Processing & Management	4
7	AI & Society	3
8	IEEE Transactions on Knowledge and Data Engineering	3
9	Language Resources and Evaluation	3
10	IEEE Transactions on Neural Networks and Learning Systems	3

Institutions with the most papers, since 2023
#	Institution	Papers
1	National University of Singapore	4
2	East China Normal University	3
3	South China University of Technology	3
4	The Hong Kong University of Science and Technology (Guangzhou)	3
5	University of Hong Kong	3
6	Beijing National Research Center for Information Science and Technology	2
7	Carnegie Mellon University	2
8	Chinese Academy of Sciences	2
9	City University of Hong Kong	2
10	Harvard University	2

Countries with the most papers, since 2023
#	Country	Papers
1	China	29
2	United States	19
3	Hong Kong	7
4	Singapore	7
5	Australia	6
6	United Kingdom	6
7	Canada	5
8	Spain	5
9	United Arab Emirates	3
10	Brazil	3

Keywords with the most papers, since 2023
#	Keyword	Papers
1	large language models	56
2	prompt engineering	6
3	parameter-efficient fine-tuning	5
4	clinical decision support	4
5	fine-tuning	4
6	hallucination mitigation	4
7	medical question answering	4
8	responsible AI	4
9	trustworthy AI	4
10	ChatGPT	3

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	247	9.7	Large language models in medical and healthcare fields: applications, advances, and challenges	Artificial Intelligence Review	2024-09-20	Dandan Wang, Shiqing Zhang
2	210	9.8	What large language models know and what people think they know	Nature Machine Intelligence	2025-01-21	Mark Steyvers, Heliodoro Tejeda, Aakriti Kumar et al.
3	172	7.8	A Survey on Mixture of Experts in Large Language Models	IEEE Transactions on Knowledge and Data Engineering	2025-01-01	Weilin Cai, Juyong Jiang, Fan Wang et al.
4	158	6.0	Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectives	IEEE Transactions on Artificial Intelligence	2024-08-19	Desta Haileselassie Hagos, Rick Battle, Danda B. Rawat
5	136	14.7	Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment	IEEE Transactions on Pattern Analysis and Machine Intelligence	2026-01-27	Lingling Xu, Haoran Xie, S. Joe Qin et al.

Archive counts by publication year: a paper counts when its title, abstract or keywords name the dataset, or when OpenAlex's full-text search finds it there (searched for the last 30 days' papers and, by a pass over the past years, for older ones). Names added to the list later are looked for in older papers as the archive is read again.

Used together with#

Papers use MMLU most often with Hugging Face Hub (27), TruthfulQA / HellaSwag / ARC (25) and GSM8K / MATH (24); it has 21 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok. The whole network →

What papers use MMLU together with (at least 3 papers; lift 1 = chance)
Used with	Type	Papers using both	Lift
Hugging Face Hub	Dataset	27	35.0
TruthfulQA / HellaSwag / ARC	Dataset	25	216.3
GSM8K / MATH	Dataset	24	274.2
Wikipedia	Dataset	20	11.9
HumanEval / MBPP	Dataset	18	320.6
MT-Bench / Chatbot Arena	Dataset	14	102.1
Twitter / X	Dataset	12	1.6
BIG-bench	Dataset	10	195.3
Natural language inference (SNLI, MultiNLI)	Dataset	9	58.0
Pre-training corpora (Common Crawl, C4, The Pile)	Dataset	9	49.5
CoNLL	Dataset	8	38.1
Facebook	Dataset	8	1.6

Papers mentioning MMLU in the last 30 days, newest first.
Date	Title	Journal	Authors	Affiliations
2026-10-23	Retrieval-augmented generation in biomedicine: a survey of technologies, datasets, and clinical applications	Artificial Intelligence Review	Jiawei He, Boya Zhang, Hossein Rouhizadeh et al.	University of Geneva; Hunan City University; Henan University; …

Cite this page

Scholar4AI. (2026). MMLU. Journal and Conference Research Rankings. Retrieved November 4, 2026, from https://scholar4ai.com/datasets/mmlu

@misc{scholar4ai-datasets-mmlu,
  author = {{Scholar4AI}},
  title = {MMLU},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/mmlu}},
  urldate = {2026-11-04},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).