Papers on “transformer models”

Research on “transformer models” in the 480 tracked journals: papers per year and category, the journals, institutions and countries publishing it, the keywords studied with it and its most-cited papers. It is not among the most frequent keywords of the last 30 days, so this page has no list of its latest papers. Also as Markdown.

← Top research keywords · Keyword trends

Key findings#

From 2017 to 2026 (so far), the keyword “transformer models” appeared in 1,309 papers in the tracked journals, most of them in AI (1,167), operations research (60) and finance (24).
392 of them were published in 2025, against 0 in 2017.
Since 2023, the institutions with the most of these papers were Chinese Academy of Sciences (46), Tsinghua University (26) and University of Chinese Academy of Sciences (24).
The journals publishing most of them were Expert Systems with Applications (214), Knowledge-Based Systems (109) and Pattern Recognition (94).
The most-cited of them is “A Survey on Vision Transformer” (IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022), with 4,688 citations.

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2019	2020	2021	2022	2023	2024	2025	2026 (so far)
AI	1	8	32	100	192	225	350	259
Operations Research	0	0	1	8	10	6	16	19
Finance	0	0	0	0	3	2	10	9
Economics	0	0	1	0	3	1	6	8
Information Systems	0	0	0	2	0	7	5	5
Management	0	0	1	0	2	0	1	2
Higher Education and Research	0	0	1	1	1	0	2	0
Tourism and Hospitality	0	0	0	0	0	2	2	0
Statistics	0	0	0	0	1	1	0	1
Marketing	0	0	0	1	1	0	0	0
All categories	1	8	36	112	213	244	392	303

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	Expert Systems with Applications	214
2	Knowledge-Based Systems	109
3	Pattern Recognition	94
4	Neural Computing and Applications	79
5	Neural Networks	70
6	Applied Intelligence	66
7	Artificial Intelligence Review	63
8	Information Fusion	63
9	IEEE Transactions on Pattern Analysis and Machine Intelligence	41
10	IEEE Transactions on Neural Networks and Learning Systems	34

Institutions with the most papers, since 2023
#	Institution	Papers
1	Chinese Academy of Sciences	46
2	Tsinghua University	26
3	University of Chinese Academy of Sciences	24
4	Peking University	20
5	Shanghai Jiao Tong University	19
6	Zhejiang University	19
7	University of Electronic Science and Technology of China	18
8	Beijing Institute of Technology	17
9	Huazhong University of Science and Technology	17
10	Hong Kong Polytechnic University	16

Countries with the most papers, since 2023
#	Country	Papers
1	China	697
2	United States	128
3	United Kingdom	60
4	India	57
5	Australia	53
6	Hong Kong	46
7	South Korea	41
8	Canada	36
9	Germany	34
10	Spain	32

Keywords with the most papers, since 2023
#	Keyword	Papers
1	self-attention	90
2	attention mechanism	84
3	convolutional neural networks	69
4	large language models	52
5	computational efficiency	41
6	long-range dependencies	41
7	multimodal fusion	38
8	graph neural networks	37
9	time series forecasting	37

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	4,688	83.0	A Survey on Vision Transformer	IEEE Transactions on Pattern Analysis and Machine Intelligence	2022-02-18	Kai Han, Yunhe Wang, Hanting Chen et al.
2	1,075	25.7	Multimodal Learning With Transformers: A Survey	IEEE Transactions on Pattern Analysis and Machine Intelligence	2023-05-11	Peng Xu, Xiatian Zhu, David Andrew Clifton
3	664	9.7	Transformer models for text-based emotion detection: a review of BERT-based approaches	Artificial Intelligence Review	2021-02-08	Francisca Adoma Acheampong, Henry Nunoo‐Mensah, Wenyu Chen
4	617	12.5	scBERT as a large-scale pretrained deep language model for cell type annotation of single-cell RNA-seq data	Nature Machine Intelligence	2022-09-26	Fan Yang, Wenchuan Wang, Fang Wang et al.
5	519	10.3	TransFuser: Imitation With Transformer-Based Sensor Fusion for Autonomous Driving	IEEE Transactions on Pattern Analysis and Machine Intelligence	2022-08-19	Kashyap Chitta, Aditya Prakash, Bernhard Jaeger et al.

Cite this page

Scholar4AI. (2026). Papers on “transformer models”. Journal and Conference Research Rankings. Retrieved November 3, 2026, from https://scholar4ai.com/keywords/transformer-models

@misc{scholar4ai-keywords-transformer-models,
  author = {{Scholar4AI}},
  title = {Papers on “transformer models”},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/keywords/transformer-models}},
  urldate = {2026-11-03},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).