---
title: "BIG-bench: papers using this data, journals and trends"
description: "From Nov 2023 to Oct 2026, 31 archived papers mentioned BIG-bench in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jul 2026 (4)."
url: https://scholar4ai.com/datasets/big-bench
markdown_url: https://scholar4ai.com/datasets/big-bench.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "From Nov 2023 to Oct 2026, 31 archived papers mentioned BIG-bench in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jul 2026 (4). (as of 2026-11-04)"
data_url: https://scholar4ai.com/data/rankings.json
updated: 2026-11-04T18:03:26+09:00
window: 2026-10-06 to 2026-11-04
source: OpenAlex (CC0)
---

# BIG-bench

[Browse dataset profiles](https://scholar4ai.com/datasets/directory.md)

Benchmarks used to compare large language models on knowledge, reasoning, math and code.

- data category: LLM evaluation benchmarks
- 0 papers in the last 7 days
- Names searched for: BIG-bench, BIG-Bench Hard

Most-used data: https://scholar4ai.com/rankings/datasets.md · All LLM evaluation benchmarks datasets: https://scholar4ai.com/datasets/llm-evaluation-benchmarks.md



## Key findings

- From Nov 2023 to Oct 2026, 31 archived papers mentioned BIG-bench in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Jul 2026 (4).
- No paper of the tracked journals mentioned BIG-bench in the last 30 days (2026-10-06 to 2026-11-04).
- From 2017 to 2026 (so far), BIG-bench was mentioned in 31 papers in the tracked journals, most of them in AI (27), information systems (2) and operations research (2).
- 10 of them were published in 2025, against 0 in 2017.
- Since 2023, the institutions with the most of these papers were Tsinghua University (3), Carnegie Mellon University (2) and University of Cambridge (2).
- The journals publishing most of them were Artificial Intelligence Review (4), IEEE Transactions on Knowledge and Data Engineering (4) and IEEE Transactions on Pattern Analysis and Machine Intelligence (2).
- The most-cited of them is “Advances and Challenges in Meta-Learning: A Technical Review” (IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024), with 319 citations.
- Papers use BIG-bench most often with GSM8K / MATH (11), Hugging Face Hub (10) and MMLU (10); it has 11 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

## Mentions over 36 months

*Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)*

| Trend | Nov 23–Oct 24 | Nov 24–Oct 25 | Nov 25–Oct 26 | 36 months |
|---|---:|---:|---:|---:|
|  | 6 | 9 | 16 | 31 |

## Papers per year

*Papers per publication year and category*

| Category | 2017 | 2018 | 2019 | 2020 | 2021 | 2022 | 2023 | 2024 | 2025 | 2026 (so far) |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| [AI](https://scholar4ai.com/categories/ai.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 9 | 12 |
| [Information Systems](https://scholar4ai.com/categories/information-systems.md) | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 |
| [Operations Research](https://scholar4ai.com/categories/operations-research.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
| All categories | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 6 | 10 | 14 |

## Where the papers come from

*Journals with the most papers, since 2023*

| # | Journal | Papers |
|---:|---|---:|
| 1 | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | 4 |
| 2 | [IEEE Transactions on Knowledge and Data Engineering](https://scholar4ai.com/journals/ieee-transactions-on-knowledge-and-data-engineering.md) | 4 |
| 3 | [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-pattern-analysis-and-machine-intelligence.md) | 2 |
| 4 | [Machine Learning](https://scholar4ai.com/journals/machine-learning.md) | 2 |
| 5 | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | 2 |
| 6 | [Language Resources and Evaluation](https://scholar4ai.com/journals/language-resources-and-evaluation.md) | 2 |
| 7 | [Nature Machine Intelligence](https://scholar4ai.com/journals/nature-machine-intelligence.md) | 2 |
| 8 | [IEEE Transactions on Artificial Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-artificial-intelligence.md) | 2 |
| 9 | [Pattern Recognition](https://scholar4ai.com/journals/pattern-recognition.md) | 1 |
| 10 | [International Journal of Information Management](https://scholar4ai.com/journals/international-journal-of-information-management.md) | 1 |

*Institutions with the most papers, since 2023*

| # | Institution | Papers |
|---:|---|---:|
| 1 | [Tsinghua University](https://scholar4ai.com/institutions/tsinghua-university.md) | 3 |
| 2 | [Carnegie Mellon University](https://scholar4ai.com/institutions/carnegie-mellon-university.md) | 2 |
| 3 | [University of Cambridge](https://scholar4ai.com/institutions/university-of-cambridge.md) | 2 |
| 4 | [Adobe Systems (United States)](https://scholar4ai.com/companies/adobe-systems-united-states.md) | 1 |
| 5 | Agricultural Information Institute | 1 |
| 6 | [Alibaba Group (China)](https://scholar4ai.com/companies/alibaba-group-china.md) | 1 |
| 7 | American University of Sharjah | 1 |
| 8 | Augusta University | 1 |
| 9 | [Beihang University](https://scholar4ai.com/institutions/beihang-university.md) | 1 |
| 10 | [Beijing Jiaotong University](https://scholar4ai.com/institutions/beijing-jiaotong-university.md) | 1 |

*Countries with the most papers, since 2023*

| # | Country | Papers |
|---:|---|---:|
| 1 | China | 14 |
| 2 | United States | 6 |
| 3 | United Kingdom | 5 |
| 4 | Australia | 3 |
| 5 | Canada | 3 |
| 6 | Germany | 3 |
| 7 | India | 3 |
| 8 | United Arab Emirates | 2 |
| 9 | Brazil | 2 |
| 10 | Hong Kong | 2 |

*Keywords with the most papers, since 2023*

| # | Keyword | Papers |
|---:|---|---:|
| 1 | [large language models](https://scholar4ai.com/keywords/large-language-models.md) | 21 |
| 2 | [knowledge distillation](https://scholar4ai.com/keywords/knowledge-distillation.md) | 3 |
| 3 | prompt engineering | 3 |
| 4 | text-to-SQL | 3 |
| 5 | [AI ethics](https://scholar4ai.com/keywords/ai-ethics.md) | 2 |
| 6 | [ChatGPT](https://scholar4ai.com/keywords/chatgpt.md) | 2 |
| 7 | LLM agents | 2 |
| 8 | LoRa | 2 |
| 9 | arithmetic reasoning | 2 |
| 10 | chain-of-thought prompting | 2 |

## Most-cited papers

*Most-cited papers since 2017*

| # | Citations | Per month | Title | Journal | Published | Authors |
|---:|---:|---:|---|---|---|---|
| 1 | 319 | 9.6 | [Advances and Challenges in Meta-Learning: A Technical Review](https://doi.org/10.1109/tpami.2024.3357847) | [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-pattern-analysis-and-machine-intelligence.md) | 2024-01-24 | Anna Vettoruzzo, Mohamed-Rafik Bouguelia, Joaquin Vanschoren et al. |
| 2 | 188 | 7.1 | [Factuality challenges in the era of large language models and opportunities for fact-checking](https://doi.org/10.1038/s42256-024-00881-z) | [Nature Machine Intelligence](https://scholar4ai.com/journals/nature-machine-intelligence.md) | 2024-08-22 | Isabelle Augenstein, Timothy Baldwin, Meeyoung Cha et al. |
| 3 | 119 | 9.8 | [Datasets for large language models: a comprehensive survey](https://doi.org/10.1007/s10462-025-11403-7) | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | 2025-10-31 | Yang Liu, Jiahuan Cao, Chongyu Liu et al. |
| 4 | 104 | 5.9 | [Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence](https://doi.org/10.1109/tai.2025.3569516) | [IEEE Transactions on Artificial Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-artificial-intelligence.md) | 2025-05-13 | Timothy R. McIntosh, Teo Sušnjak, Nalin Asanka Gamagedara Arachchilage et al. |
| 5 | 69 | 4.5 | [A Survey of Text-to-SQL in the Era of LLMs: Where Are We, and Where Are We Going?](https://doi.org/10.1109/tkde.2025.3592032) | [IEEE Transactions on Knowledge and Data Engineering](https://scholar4ai.com/journals/ieee-transactions-on-knowledge-and-data-engineering.md) | 2025-07-24 | Xinyu Liu, Shuyu Shen, Boyan Li et al. |

## Used together with

Papers use BIG-bench most often with GSM8K / MATH (11), Hugging Face Hub (10) and MMLU (10); it has 11 partners in the code and data network, in the group around Twitter / X, Facebook, YouTube / TikTok.

*What papers use BIG-bench together with (at least 3 papers; lift 1 = chance)*

| Used with | Type | Papers using both | Lift |
|---|---|---:|---:|
| [GSM8K / MATH](https://scholar4ai.com/datasets/gsm8k-math.md) | Dataset | 11 | 320.3 |
| [Hugging Face Hub](https://scholar4ai.com/datasets/hugging-face-hub.md) | Dataset | 10 | 33.0 |
| [MMLU](https://scholar4ai.com/datasets/mmlu.md) | Dataset | 10 | 195.3 |
| [TruthfulQA / HellaSwag / ARC](https://scholar4ai.com/datasets/truthfulqa-hellaswag-arc.md) | Dataset | 9 | 198.4 |
| [Wikipedia](https://scholar4ai.com/datasets/wikipedia.md) | Dataset | 9 | 13.7 |
| [GLUE / SuperGLUE](https://scholar4ai.com/datasets/glue-superglue.md) | Dataset | 8 | 114.3 |
| [HumanEval / MBPP](https://scholar4ai.com/datasets/humaneval-mbpp.md) | Dataset | 8 | 363.1 |
| [Retrieval and QA (MS MARCO, Natural Questions, HotpotQA)](https://scholar4ai.com/datasets/retrieval-and-qa-ms-marco-natural-questions-hotpotqa.md) | Dataset | 5 | 96.5 |
| [ImageNet](https://scholar4ai.com/datasets/imagenet.md) | Dataset | 3 | 2.0 |
| [IMDb](https://scholar4ai.com/datasets/imdb.md) | Dataset | 3 | 19.7 |
| [MT-Bench / Chatbot Arena](https://scholar4ai.com/datasets/mt-bench-chatbot-arena.md) | Dataset | 3 | 55.8 |

The whole network: https://scholar4ai.com/code/network.md

## Cite this page

Scholar4AI. (2026). BIG-bench. Journal and Conference Research Rankings. Retrieved November 4, 2026, from https://scholar4ai.com/datasets/big-bench

```bibtex
@misc{scholar4ai-datasets-big-bench,
  author = {{Scholar4AI}},
  title = {BIG-bench},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/big-bench}},
  urldate = {2026-11-04},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).