BIG-bench

data category: LLM evaluation benchmarks · 0 papers in the last 7 days

← Most-used data · All LLM evaluation benchmarks datasets

Benchmarks used to compare large language models on knowledge, reasoning, math and code.

Names searched for: BIG-bench, BIG-Bench Hard

Key findings#

From Nov 2023 to Oct 2026, 31 archived papers mentioned BIG-bench in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jul 2026 (4).
No paper of the tracked journals mentioned BIG-bench in the last 30 days (2026-10-06 to 2026-11-04).
From 2017 to 2026 (so far), BIG-bench was mentioned in 31 papers in the tracked journals, most of them in AI (27), information systems (2) and operations research (2).
10 of them were published in 2025, against 0 in 2017.
Since 2023, the institutions with the most of these papers were Tsinghua University (3), Carnegie Mellon University (2) and University of Cambridge (2).
The journals publishing most of them were Artificial Intelligence Review (4), IEEE Transactions on Knowledge and Data Engineering (4) and IEEE Transactions on Pattern Analysis and Machine Intelligence (2).
The most-cited of them is “Advances and Challenges in Meta-Learning: A Technical Review” (IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024), with 319 citations.
Papers use BIG-bench most often with GSM8K / MATH (11), Hugging Face Hub (10) and MMLU (10); it has 11 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

Mentions over 36 months#

Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)
Trend	Nov 23–Oct 24	Nov 24–Oct 25	Nov 25–Oct 26	36 months
	6	9	16	31

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2023	2024	2025	2026 (so far)
AI	0	6	9	12
Information Systems	1	0	0	1
Operations Research	0	0	1	1
All categories	1	6	10	14

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	Artificial Intelligence Review	4
2	IEEE Transactions on Knowledge and Data Engineering	4
3	IEEE Transactions on Pattern Analysis and Machine Intelligence	2
4	Machine Learning	2
5	Neural Computing and Applications	2
6	Language Resources and Evaluation	2
7	Nature Machine Intelligence	2
8	IEEE Transactions on Artificial Intelligence	2
9	Pattern Recognition	1
10	International Journal of Information Management	1

Institutions with the most papers, since 2023
#	Institution	Papers
1	Tsinghua University	3
2	Carnegie Mellon University	2
3	University of Cambridge	2
4	Adobe Systems (United States)	1
5	Agricultural Information Institute	1
6	Alibaba Group (China)	1
7	American University of Sharjah	1
8	Augusta University	1
9	Beihang University	1
10	Beijing Jiaotong University	1

Countries with the most papers, since 2023
#	Country	Papers
1	China	14
2	United States	6
3	United Kingdom	5
4	Australia	3
5	Canada	3
6	Germany	3
7	India	3
8	United Arab Emirates	2
9	Brazil	2
10	Hong Kong	2

Keywords with the most papers, since 2023
#	Keyword	Papers
1	large language models	21
2	knowledge distillation	3
3	prompt engineering	3
4	text-to-SQL	3
5	AI ethics	2
6	ChatGPT	2
7	LLM agents	2
8	LoRa	2
9	arithmetic reasoning	2
10	chain-of-thought prompting	2

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	319	9.6	Advances and Challenges in Meta-Learning: A Technical Review	IEEE Transactions on Pattern Analysis and Machine Intelligence	2024-01-24	Anna Vettoruzzo, Mohamed-Rafik Bouguelia, Joaquin Vanschoren et al.
2	188	7.1	Factuality challenges in the era of large language models and opportunities for fact-checking	Nature Machine Intelligence	2024-08-22	Isabelle Augenstein, Timothy Baldwin, Meeyoung Cha et al.
3	119	9.8	Datasets for large language models: a comprehensive survey	Artificial Intelligence Review	2025-10-31	Yang Liu, Jiahuan Cao, Chongyu Liu et al.
4	104	5.9	Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence	IEEE Transactions on Artificial Intelligence	2025-05-13	Timothy R. McIntosh, Teo Sušnjak, Nalin Asanka Gamagedara Arachchilage et al.
5	69	4.5	A Survey of Text-to-SQL in the Era of LLMs: Where Are We, and Where Are We Going?	IEEE Transactions on Knowledge and Data Engineering	2025-07-24	Xinyu Liu, Shuyu Shen, Boyan Li et al.

Archive counts by publication year: a paper counts when its title, abstract or keywords name the dataset, or when OpenAlex's full-text search finds it there (searched for the last 30 days' papers and, by a pass over the past years, for older ones). Names added to the list later are looked for in older papers as the archive is read again.

Used together with#

Papers use BIG-bench most often with GSM8K / MATH (11), Hugging Face Hub (10) and MMLU (10); it has 11 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok. The whole network →

What papers use BIG-bench together with (at least 3 papers; lift 1 = chance)
Used with	Type	Papers using both	Lift
GSM8K / MATH	Dataset	11	289.5
Hugging Face Hub	Dataset	10	29.2
MMLU	Dataset	10	169.9
TruthfulQA / HellaSwag / ARC	Dataset	9	172.6
Wikipedia	Dataset	9	12.6
GLUE / SuperGLUE	Dataset	8	99.4
HumanEval / MBPP	Dataset	8	325.4
Retrieval and QA (MS MARCO, Natural Questions, HotpotQA)	Dataset	5	89.5
ImageNet	Dataset	3	1.8
IMDb	Dataset	3	17.4
MT-Bench / Chatbot Arena	Dataset	3	48.5

Cite this page

Scholar4AI. (2026). BIG-bench. Journal and Conference Research Rankings. Retrieved November 4, 2026, from https://scholar4ai.com/datasets/big-bench

@misc{scholar4ai-datasets-big-bench,
  author = {{Scholar4AI}},
  title = {BIG-bench},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/big-bench}},
  urldate = {2026-11-04},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).