---
title: "OpenAI Gym / Gymnasium: research papers using this data"
description: "From Nov 2023 to Oct 2026, 103 archived papers mentioned OpenAI Gym / Gymnasium in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Nov 2023 (8)."
url: https://scholar4ai.com/datasets/openai-gym-gymnasium
markdown_url: https://scholar4ai.com/datasets/openai-gym-gymnasium.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "From Nov 2023 to Oct 2026, 103 archived papers mentioned OpenAI Gym / Gymnasium in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Nov 2023 (8). (as of 2026-11-05)"
data_url: https://scholar4ai.com/data/rankings.json
updated: 2026-11-05T06:02:37+09:00
window: 2026-10-07 to 2026-11-05
source: OpenAlex (CC0)
---

# OpenAI Gym / Gymnasium

[Browse dataset profiles](https://scholar4ai.com/datasets/directory/page/5.md)

Simulators and benchmark suites for training and comparing reinforcement learning agents.

- data category: Reinforcement learning environments
- 0 papers in the last 7 days
- Names searched for: OpenAI Gym, Gym environment

Most-used data: https://scholar4ai.com/rankings/datasets.md · All Reinforcement learning environments datasets: https://scholar4ai.com/datasets/reinforcement-learning-environments.md



## Key findings

- From Nov 2023 to Oct 2026, 103 archived papers mentioned OpenAI Gym / Gymnasium in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Nov 2023 (8).
- OpenAI Gym / Gymnasium was mentioned in 1 paper in the last 30 days (2026-10-07 to 2026-11-05), ranking #165 of the 246 datasets mentioned.
- By journal category: Health Economics and Policy (1).
- Most of them appeared in Health Policy OPEN (1).
- From 2017 to 2026 (so far), OpenAI Gym / Gymnasium was mentioned in 124 papers in the tracked journals, most of them in AI (104), operations research (14) and information systems (2).
- 33 of them were published in 2025, against 0 in 2017.
- Since 2023, the institutions with the most of these papers were Tsinghua University (6), Peking University (5) and Technical University of Munich (5).
- The journals publishing most of them were IEEE Transactions on Neural Networks and Learning Systems (16), Machine Learning (12) and Neural Computing and Applications (8).
- The most-cited of them is “Distributional Soft Actor-Critic With Three Refinements” (IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025), with 92 citations.
- Papers use OpenAI Gym / Gymnasium most often with MuJoCo (32), Atari (Arcade Learning Environment) (24) and D4RL (8); it has 9 partners in the code and data network, in the group around ImageNet, CIFAR-10 / CIFAR-100, MNIST / Fashion-MNIST.

## Mentions over 36 months

*Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)*

| Trend | Nov 23–Oct 24 | Nov 24–Oct 25 | Nov 25–Oct 26 | 36 months |
|---|---:|---:|---:|---:|
|  | 46 | 37 | 20 | 103 |

## Papers per year

*Papers per publication year and category*

| Category | 2017 | 2018 | 2019 | 2020 | 2021 | 2022 | 2023 | 2024 | 2025 | 2026 (so far) |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| [AI](https://scholar4ai.com/categories/ai.md) | 0 | 0 | 1 | 5 | 4 | 5 | 17 | 34 | 25 | 13 |
| [Operations Research](https://scholar4ai.com/categories/operations-research.md) | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 5 | 6 | 1 |
| [Information Systems](https://scholar4ai.com/categories/information-systems.md) | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 |
| [Management](https://scholar4ai.com/categories/management.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| [Health Economics and Policy](https://scholar4ai.com/categories/health-economics-and-policy.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| [Statistics](https://scholar4ai.com/categories/statistics.md) | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| [Finance](https://scholar4ai.com/categories/finance.md) | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| All categories | 0 | 0 | 1 | 5 | 4 | 5 | 21 | 40 | 33 | 15 |

## Where the papers come from

*Journals with the most papers, since 2023*

| # | Journal | Papers |
|---:|---|---:|
| 1 | [IEEE Transactions on Neural Networks and Learning Systems](https://scholar4ai.com/journals/ieee-transactions-on-neural-networks-and-learning-systems.md) | 16 |
| 2 | [Machine Learning](https://scholar4ai.com/journals/machine-learning.md) | 12 |
| 3 | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | 8 |
| 4 | [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-pattern-analysis-and-machine-intelligence.md) | 6 |
| 5 | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | 6 |
| 6 | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | 6 |
| 7 | [IEEE Transactions on Artificial Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-artificial-intelligence.md) | 5 |
| 8 | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | 4 |
| 9 | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | 4 |
| 10 | [IEEE Transactions on Evolutionary Computation](https://scholar4ai.com/journals/ieee-transactions-on-evolutionary-computation.md) | 4 |

*Institutions with the most papers, since 2023*

| # | Institution | Papers |
|---:|---|---:|
| 1 | [Tsinghua University](https://scholar4ai.com/institutions/tsinghua-university.md) | 6 |
| 2 | [Peking University](https://scholar4ai.com/institutions/peking-university.md) | 5 |
| 3 | [Technical University of Munich](https://scholar4ai.com/institutions/technical-university-of-munich.md) | 5 |
| 4 | [Chinese Academy of Sciences](https://scholar4ai.com/institutions/chinese-academy-of-sciences.md) | 4 |
| 5 | [Hong Kong Polytechnic University](https://scholar4ai.com/institutions/hong-kong-polytechnic-university.md) | 4 |
| 6 | [Southern University of Science and Technology](https://scholar4ai.com/institutions/southern-university-of-science-and-technology.md) | 4 |
| 7 | [ETH Zurich](https://scholar4ai.com/institutions/eth-zurich.md) | 3 |
| 8 | [Shanghai Jiao Tong University](https://scholar4ai.com/institutions/shanghai-jiao-tong-university.md) | 3 |
| 9 | [Tongji University](https://scholar4ai.com/institutions/tongji-university.md) | 3 |
| 10 | University at Buffalo, State University of New York | 3 |

*Countries with the most papers, since 2023*

| # | Country | Papers |
|---:|---|---:|
| 1 | China | 40 |
| 2 | United States | 22 |
| 3 | Germany | 15 |
| 4 | Australia | 7 |
| 5 | United Kingdom | 7 |
| 6 | Hong Kong | 7 |
| 7 | Spain | 6 |
| 8 | Netherlands | 5 |
| 9 | Canada | 4 |
| 10 | Switzerland | 3 |

*Keywords with the most papers, since 2023*

| # | Keyword | Papers |
|---:|---|---:|
| 1 | [deep reinforcement learning](https://scholar4ai.com/keywords/deep-reinforcement-learning.md) | 23 |
| 2 | [reinforcement learning](https://scholar4ai.com/keywords/reinforcement-learning.md) | 15 |
| 3 | offline reinforcement learning | 10 |
| 4 | sample efficiency | 9 |
| 5 | continuous control | 8 |
| 6 | OpenAI Gym | 7 |
| 7 | [convergence analysis](https://scholar4ai.com/keywords/convergence-analysis.md) | 6 |
| 8 | data efficiency | 6 |
| 9 | distribution shift | 6 |
| 10 | multi-agent reinforcement learning | 6 |

## Most-cited papers

*Most-cited papers since 2017*

| # | Citations | Per month | Title | Journal | Published | Authors |
|---:|---:|---:|---|---|---|---|
| 1 | 92 | 4.3 | [Distributional Soft Actor-Critic With Three Refinements](https://doi.org/10.1109/tpami.2025.3537087) | [IEEE Transactions on Pattern Analysis and Machine Intelligence](https://scholar4ai.com/journals/ieee-transactions-on-pattern-analysis-and-machine-intelligence.md) | 2025-01-30 | Jingliang Duan, Wenxuan Wang, Liming Xiao et al. |
| 2 | 91 | 1.1 | [Reducing Estimation Bias via Triplet-Average Deep Deterministic Policy Gradient](https://doi.org/10.1109/tnnls.2019.2959129) | [IEEE Transactions on Neural Networks and Learning Systems](https://scholar4ai.com/journals/ieee-transactions-on-neural-networks-and-learning-systems.md) | 2020-01-14 | Dongming Wu, Xingping Dong, Jianbing Shen et al. |
| 3 | 82 | 4.6 | [A survey on physics informed reinforcement learning: Review and open problems](https://doi.org/10.1016/j.eswa.2025.128166) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | 2025-05-14 | Chayan Banerjee, Kien Nguyen, Clinton Fookes et al. |
| 4 | 76 | 1.1 | [Toward a Reinforcement Learning Environment Toolbox for Intelligent Electric Motor Control](https://doi.org/10.1109/tnnls.2020.3029573) | [IEEE Transactions on Neural Networks and Learning Systems](https://scholar4ai.com/journals/ieee-transactions-on-neural-networks-and-learning-systems.md) | 2020-10-28 | Arne Traue, Gerrit Book, Wilhelm Kirchgässner et al. |
| 5 | 76 | 2.2 | [A novel Deep Reinforcement Learning based automated stock trading system using cascaded LSTM networks](https://doi.org/10.1016/j.eswa.2023.122801) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | 2023-12-01 | Jie Zou, Jiashu Lou, Baohua Wang et al. |

## Used together with

Papers use OpenAI Gym / Gymnasium most often with MuJoCo (32), Atari (Arcade Learning Environment) (24) and D4RL (8); it has 9 partners in the code and data network, in the group around ImageNet, CIFAR-10 / CIFAR-100, MNIST / Fashion-MNIST.

*What papers use OpenAI Gym / Gymnasium together with (at least 3 papers; lift 1 = chance)*

| Used with | Type | Papers using both | Lift |
|---|---|---:|---:|
| [MuJoCo](https://scholar4ai.com/datasets/mujoco.md) | Dataset | 32 | 82.3 |
| [Atari (Arcade Learning Environment)](https://scholar4ai.com/datasets/atari-arcade-learning-environment.md) | Dataset | 24 | 72.3 |
| [D4RL](https://scholar4ai.com/datasets/d4rl.md) | Dataset | 8 | 56.1 |
| [StarCraft](https://scholar4ai.com/datasets/starcraft.md) | Dataset | 8 | 21.7 |
| [DeepMind Control Suite](https://scholar4ai.com/datasets/deepmind-control-suite.md) | Dataset | 7 | 84.4 |
| [MNIST / Fashion-MNIST](https://scholar4ai.com/datasets/mnist-fashion-mnist.md) | Dataset | 7 | 2.4 |
| [CIFAR-10 / CIFAR-100](https://scholar4ai.com/datasets/cifar-10-cifar-100.md) | Dataset | 4 | 1.1 |
| [ImageNet](https://scholar4ai.com/datasets/imagenet.md) | Dataset | 4 | 0.7 |
| [UCI Machine Learning Repository](https://scholar4ai.com/datasets/uci-machine-learning-repository.md) | Dataset | 4 | 2.5 |

The whole network: https://scholar4ai.com/code/network.md

## Papers

*Papers mentioning OpenAI Gym / Gymnasium in the last 30 days, newest first.*

| Date | Title | Journal | Authors | Affiliations |
|---|---|---|---|---|
| 2026-10-07 | [Excluding nonuniversity-certified professionals from Spain’s personal training sector: a narrative review of epidemiological, legal, and economic implications](https://doi.org/10.1016/j.hpopen.2026.100186) | [Health Policy OPEN](https://scholar4ai.com/journals/health-policy-open.md) | Gonzalo Quesada-Fernández, Santiago Jacomet Carrasco, Mario Muñoz López et al. | University of Andorra; Universidad Espíritu Santo; Universidad de Los Lagos |

## Cite this page

Scholar4AI. (2026). OpenAI Gym / Gymnasium. Journal and Conference Research Rankings. Retrieved November 5, 2026, from https://scholar4ai.com/datasets/openai-gym-gymnasium

```bibtex
@misc{scholar4ai-datasets-openai-gym-gymnasium,
  author = {{Scholar4AI}},
  title = {OpenAI Gym / Gymnasium},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/datasets/openai-gym-gymnasium}},
  urldate = {2026-11-05},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).