OpenAI Gym / Gymnasium

data category: Reinforcement learning environments · 0 papers in the last 7 days

← Most-used data · All Reinforcement learning environments datasets

Simulators and benchmark suites for training and comparing reinforcement learning agents.

Names searched for: OpenAI Gym, Gym environment

Key findings#

From Nov 2023 to Oct 2026, 103 archived papers mentioned OpenAI Gym / Gymnasium in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Nov 2023 (8).
OpenAI Gym / Gymnasium was mentioned in 1 paper in the last 30 days (2026-10-07 to 2026-11-05), ranking #165 of the 246 datasets mentioned.
By journal category: Health Economics and Policy (1).
Most of them appeared in Health Policy OPEN (1).
From 2017 to 2026 (so far), OpenAI Gym / Gymnasium was mentioned in 124 papers in the tracked journals, most of them in AI (104), operations research (14) and information systems (2).
33 of them were published in 2025, against 0 in 2017.
Since 2023, the institutions with the most of these papers were Tsinghua University (6), Peking University (5) and Technical University of Munich (5).
The journals publishing most of them were IEEE Transactions on Neural Networks and Learning Systems (16), Machine Learning (12) and Neural Computing and Applications (8).
The most-cited of them is “Distributional Soft Actor-Critic With Three Refinements” (IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025), with 92 citations.
Papers use OpenAI Gym / Gymnasium most often with MuJoCo (32), Atari (Arcade Learning Environment) (24) and D4RL (8); it has 9 partners in the code and data network, in the group around ImageNet, CIFAR-10 / CIFAR-100, MNIST / Fashion-MNIST.

Mentions over 36 months#

Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)
Trend	Nov 23–Oct 24	Nov 24–Oct 25	Nov 25–Oct 26	36 months
	46	37	20	103

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2019	2020	2021	2022	2023	2024	2025	2026 (so far)
AI	1	5	4	5	17	34	25	13
Operations Research	0	0	0	0	2	5	6	1
Information Systems	0	0	0	0	1	1	0	0
Management	0	0	0	0	0	0	1	0
Health Economics and Policy	0	0	0	0	0	0	0	1
Statistics	0	0	0	0	1	0	0	0
Finance	0	0	0	0	0	0	1	0
All categories	1	5	4	5	21	40	33	15

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	IEEE Transactions on Neural Networks and Learning Systems	16
2	Machine Learning	12
3	Neural Computing and Applications	8
4	IEEE Transactions on Pattern Analysis and Machine Intelligence	6
5	Artificial Intelligence Review	6
6	Applied Intelligence	6
7	IEEE Transactions on Artificial Intelligence	5
8	Neural Networks	4
9	Expert Systems with Applications	4
10	IEEE Transactions on Evolutionary Computation	4

Institutions with the most papers, since 2023
#	Institution	Papers
1	Tsinghua University	6
2	Peking University	5
3	Technical University of Munich	5
4	Chinese Academy of Sciences	4
5	Hong Kong Polytechnic University	4
6	Southern University of Science and Technology	4
7	ETH Zurich	3
8	Shanghai Jiao Tong University	3
9	Tongji University	3
10	University at Buffalo, State University of New York	3

Countries with the most papers, since 2023
#	Country	Papers
1	China	40
2	United States	22
3	Germany	15
4	Australia	7
5	United Kingdom	7
6	Hong Kong	7
7	Spain	6
8	Netherlands	5
9	Canada	4
10	Switzerland	3

Keywords with the most papers, since 2023
#	Keyword	Papers
1	deep reinforcement learning	23
2	reinforcement learning	15
3	offline reinforcement learning	10
4	sample efficiency	9
5	continuous control	8
6	OpenAI Gym	7
7	convergence analysis	6
8	data efficiency	6
9	distribution shift	6
10	multi-agent reinforcement learning	6

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	92	4.3	Distributional Soft Actor-Critic With Three Refinements	IEEE Transactions on Pattern Analysis and Machine Intelligence	2025-01-30	Jingliang Duan, Wenxuan Wang, Liming Xiao et al.
2	91	1.1	Reducing Estimation Bias via Triplet-Average Deep Deterministic Policy Gradient	IEEE Transactions on Neural Networks and Learning Systems	2020-01-14	Dongming Wu, Xingping Dong, Jianbing Shen et al.
3	82	4.6	A survey on physics informed reinforcement learning: Review and open problems	Expert Systems with Applications	2025-05-14	Chayan Banerjee, Kien Nguyen, Clinton Fookes et al.
4	76	1.1	Toward a Reinforcement Learning Environment Toolbox for Intelligent Electric Motor Control	IEEE Transactions on Neural Networks and Learning Systems	2020-10-28	Arne Traue, Gerrit Book, Wilhelm Kirchgässner et al.
5	76	2.2	A novel Deep Reinforcement Learning based automated stock trading system using cascaded LSTM networks	Expert Systems with Applications	2023-12-01	Jie Zou, Jiashu Lou, Baohua Wang et al.

Archive counts by publication year: a paper counts when its title, abstract or keywords name the dataset, or when OpenAlex's full-text search finds it there (searched for the last 30 days' papers and, by a pass over the past years, for older ones). Names added to the list later are looked for in older papers as the archive is read again.

Used together with#

Papers use OpenAI Gym / Gymnasium most often with MuJoCo (32), Atari (Arcade Learning Environment) (24) and D4RL (8); it has 9 partners in the code and data network, in the group around ImageNet, CIFAR-10 / CIFAR-100, MNIST / Fashion-MNIST. The whole network →

What papers use OpenAI Gym / Gymnasium together with (at least 3 papers; lift 1 = chance)
Used with	Type	Papers using both	Lift
MuJoCo	Dataset	32	82.3
Atari (Arcade Learning Environment)	Dataset	24	72.3
D4RL	Dataset	8	56.1
StarCraft	Dataset	8	21.7
DeepMind Control Suite	Dataset	7	84.4
MNIST / Fashion-MNIST	Dataset	7	2.4
CIFAR-10 / CIFAR-100	Dataset	4	1.1
ImageNet	Dataset	4	0.7
UCI Machine Learning Repository	Dataset	4	2.5

Papers mentioning OpenAI Gym / Gymnasium in the last 30 days, newest first.
Date	Title	Journal	Authors	Affiliations
2026-10-07	Excluding nonuniversity-certified professionals from Spain’s personal training sector: a narrative review of epidemiological, legal, and economic implications	Health Policy OPEN	Gonzalo Quesada-Fernández, Santiago Jacomet Carrasco, Mario Muñoz López et al.	University of Andorra; Universidad Espíritu Santo; Universidad de Los Lagos

Cite this page

Scholar4AI. (2026). OpenAI Gym / Gymnasium. Journal and Conference Research Rankings. Retrieved November 5, 2026, from https://scholar4ai.com/datasets/openai-gym-gymnasium

@misc{scholar4ai-datasets-openai-gym-gymnasium,
  author = {{Scholar4AI}},
  title = {OpenAI Gym / Gymnasium},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/openai-gym-gymnasium}},
  urldate = {2026-11-05},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).