---
title: "Q-learning: formula and 25 recent papers"
description: "Q-learning was mentioned in 25 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #37 of the 104 equations and models mentioned."
url: https://scholar4ai.com/equations/q-learning
markdown_url: https://scholar4ai.com/equations/q-learning.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "Q-learning was mentioned in 25 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #37 of the 104 equations and models mentioned."
data_url: https://scholar4ai.com/data/rankings.json
updated: 2026-10-26T14:32:25+09:00
window: 2026-09-27 to 2026-10-26
source: OpenAlex (CC0)
---

# Q-learning

$$
Q(s, a) \leftarrow Q(s, a) + \alpha\big[r + \gamma \max_{a'} Q(s', a') - Q(s, a)\big]
$$

Reinforcement learning of action values from rewards; deep Q-networks approximate Q with a neural network.

- area: Machine learning
- 3 papers in the last 7 days
- Names searched for: Q-learning, deep Q-network, DQN

Back to the ranking: https://scholar4ai.com/rankings/equations.md

## Key findings

- Q-learning was mentioned in 25 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #37 of the 104 equations and models mentioned.
- By journal category: AI (15), Operations Research (8) and Economics (2).
- Most of them appeared in Computers & Industrial Engineering (6), Expert Systems with Applications (6) and Applied Intelligence (3).
- Often mentioned together with Linear and integer programming (7), Proximal policy optimization (PPO) (4) and Nash equilibrium (2).
- Datasets named in the same papers: OR-Library (3), UCI Machine Learning Repository (2) and MNIST / Fashion-MNIST (2).
- From Oct 2023 to Sep 2026, 370 archived papers mentioned Q-learning in their title, abstract or keywords, most of them in Jul 2025 (22).

## Mentions over 36 months

*Papers mentioning it by publication month, Oct 2023 to Sep 2026 (titles, abstracts and keywords)*

| Trend | Oct 23–Sep 24 | Oct 24–Sep 25 | Oct 25–Sep 26 | 36 months |
|---|---:|---:|---:|---:|
|  | 141 | 184 | 45 | 370 |

*Papers mentioning Q-learning, newest first.*

| Date | Title | Journal | Authors | Affiliations |
|---|---|---|---|---|
| 2026-10-22 | [Learning-based bi-level optimization algorithm for collaborative scheduling of production and transportation in a reconfigurable assembly job shop](https://doi.org/10.1016/j.cie.2026.112473) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Lixin Cheng, Chao Wu, Yu Zhang et al. | Wuhan University of Science and Technology; Wuhan Ship Development & Design Institute |
| 2026-10-21 | [Two-stage Q-learning assisted MOEA/D for energy-efficient flexible job shop scheduling considering machine wear](https://doi.org/10.1016/j.eswa.2026.134752) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Da Wang, Kai Zhang, Qi Mu et al. | Shandong Normal University; South China University of Technology; Qufu Normal University |
| 2026-10-20 | [Multi-agent assisted co-evolutionary memetic algorithm for lot-streaming flexible job shop energy-efficient scheduling problem with asynchronous assembly](https://doi.org/10.1016/j.eswa.2026.134552) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Gan Jiang, Qiuhua Tang, Zikai Zhang et al. | Wuhan University of Science and Technology |
| 2026-10-19 | [Correction to: Constrained multi-objective optimization based on deep Q-Network and time series prediction](https://doi.org/10.1007/s10489-026-07333-8) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Peng Zhao, Jie Cao, Jianglin Zhang et al. | Lanzhou City University; Lanzhou University of Technology |
| 2026-10-17 | [MO-UDRL-H: hybrid Pareto-safe distributional reinforcement learning for multi-objective cloud task allocation](https://doi.org/10.1007/s10489-026-07534-1) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Chunhui Xu, Chundi Hu | Zhejiang Ocean University |
| 2026-10-15 | [A Cognitive, Quantum-Inspired Learning Framework for Energy-Efficient and Reliable Routing in Wireless Body Area Networks](https://doi.org/10.1007/s12559-026-10665-9) | [Cognitive Computation](https://scholar4ai.com/journals/cognitive-computation.md) | Soufiane Ben Othman, Naima Saeed | King Faisal University; University of Aden |
| 2026-10-13 | [Lagrangian-based safe Q-learning for nonlinear delayed stochastic systems](https://doi.org/10.1016/j.neunet.2026.109752) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | Kaidi Xing, Zhongyang Ming, Jiayue Sun | Northeastern University |
| 2026-10-09 | [A Q-Learning-Based hybrid optimization algorithm for storage space allocation and yard Crane cooperative scheduling in double U-shaped Automated container terminals](https://doi.org/10.1016/j.eswa.2026.134517) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Houming Fan, Wenxin Liu, Hao Fan et al. | Dalian University of Technology; Dalian University; Dalian Maritime University; … |
| 2026-10-09 | [Wind-aware deep reinforcement learning for autonomous UAV navigation without GPS/GNSS position feedback and visual perception](https://doi.org/10.1016/j.eswa.2026.134645) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Hüseyin Küçükerdem, Yilmaz Cemal, Hamdi Tolga Kahraman et al. | Ankara University; Gazi University; Karadeniz Technical University |
| 2026-10-07 | [RLDAL: A reinforcement learning-driven active learning framework for region-level sampling in medical image segmentation](https://doi.org/10.1016/j.eswa.2026.134667) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Yujie Diao, Ruiguo Yu, Xuewei Li et al. | Tianjin University; Tianjin Medical University Cancer Institute and Hospital; Tianjin Medical University |
| 2026-10-07 | [Discovering session-level demand patterns for reinforcement learning-based dynamic inventory allocation in live-streaming e-commerce](https://doi.org/10.1007/s10115-026-02895-y) | [Knowledge and Information Systems](https://scholar4ai.com/journals/knowledge-and-information-systems.md) | Thi-Linh Ho, Hiep Pham, Hoang Quan Dinh et al. | Ton Duc Thang University; RMIT Vietnam; University of Dubai; … |
| 2026-10-07 | [Q-learning based large neighborhood search with load-aware destroy for load-dependent multi depot heterogeneous fleet vehicle routing problem](https://doi.org/10.1016/j.cie.2026.112420) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Xinyi Wu, Shengguang Xiong, Jiaqing Li et al. | Wuhan University of Technology; University College London |
| 2026-10-03 | [Robust Trading Strategies Through Topological Features and Deep Reinforcement Learning](https://doi.org/10.1007/s10614-026-11422-8) | [Computational Economics](https://scholar4ai.com/journals/computational-economics.md) | Luiz Carlos de Jesus, Francisco Fernández‐Navarro, Mariano Carbonero-Ruz | Universidad Loyola Andalucía; Universidad de Málaga |
| 2026-10-01 | [OADPC-HSSA: Observation-Aware Dynamic Privacy Control for Federated Learning with Hierarchical Shuffling and Secure Aggregation](https://doi.org/10.1016/j.eswa.2026.134828) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Jianli Xie, Zishan Wu, Bing Bu et al. | Lanzhou Jiaotong University; Beijing Jiaotong University |
| 2026-10-01 | [Reinforcement learning-based evolutionary algorithm for home healthcare routing and scheduling problem considering caregiver routing time limitations](https://doi.org/10.1016/j.cie.2026.112460) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Jie Dong, Yaping Fu, Amir M. Fathollahi‐Fard et al. | Qingdao University; Laurentian University; Jiangnan University; … |
| 2026-10-01 | [Double deep Q-networks-based particle swarm optimization algorithm for solving knitting products production shop scheduling problem considering processing quality differences and worker factors](https://doi.org/10.1016/j.cie.2026.112471) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Xixing Li, Yongjun Ma, Hongdi Zhou et al. | Hubei University of Technology; Wuhan University of Technology |
| 2026-10-01 | [A Q-learning-based hyper-heuristic artificial bee colony algorithm for balancing and scheduling U-shaped mixed-model human–robot collaborative assembly lines](https://doi.org/10.1016/j.cie.2026.112466) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Seçil Kulaç, Alper Kiraz | Bursa Technical University; Sakarya University |
| 2026-10-01 | [Bi-dimensional empirical and wavelet decomposed hybrid chimp fuzzy Q-learning classifier for glaucoma identification](https://doi.org/10.1007/s00521-026-12489-y) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Gaurav Pandey, Rajneesh Sharma, Amit Kukker et al. | Netaji Subhas University of Technology; SRM Institute of Science and Technology; Institute of Management Technology |
| 2026-10-01 | [RLAX: A Reinforcement Learning-Based Framework for Explaining Anomalous Data](https://doi.org/10.1007/s10994-026-07182-z) | [Machine Learning](https://scholar4ai.com/journals/machine-learning.md) | Simone Amirato, Fabrizio Angiulli, Fabio Fassetti | University of Calabria |
| 2026-10-01 | [MATE-Hard and the count-invariance problem in multi-agent active perception](https://doi.org/10.1007/s10489-026-07524-3) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Huy Hoang Son Tran | Hanoi University |
| 2026-10-01 | [Berth and yard space allocation optimization with mobile shore power under two carbon policies](https://doi.org/10.1016/j.tre.2026.105288) | [Transportation Research Part E Logistics and Transportation Review](https://scholar4ai.com/journals/transportation-research-part-e-logistics-and-transportation-review.md) | Shumin Lin, 朱吟晨, Lu Zhen et al. | Hangzhou Dianzi University; Shanghai University; Xinjiang University |
| 2026-10-01 | [Computing and Learning Stationary Mean Field Equilibria with Low-Dimensional Interactions: Algorithms and Applications](https://doi.org/10.1016/j.jedc.2026.105441) | [Journal of Economic Dynamics and Control](https://scholar4ai.com/journals/journal-of-economic-dynamics-and-control.md) | Bar Light | National University of Singapore; Institute of Operations Research and Analytics |
| 2026-09-30 | [Solution methods for the dynamic and probabilistic profitable tour problem](https://doi.org/10.1007/s00291-026-00875-w) | [OR Spectrum](https://scholar4ai.com/journals/or-spectrum.md) | Marvin Caspar, Daniel Schermer, Oliver Wendt | University of Kaiserslautern; Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau |
| 2026-09-30 | [Formulations and efficient algorithms for the Cross-Dock Door Assignment Problem with makespan minimization](https://doi.org/10.1016/j.cie.2026.112403) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Belén Melián-Batista, José Marcos Moreno-Vega, Francisco Ángel-Bello | Universidad de La Laguna |
| 2026-09-28 | [Minute-scale training for microrobot navigation](https://doi.org/10.1038/s42256-026-01305-w) | [Nature Machine Intelligence](https://scholar4ai.com/journals/nature-machine-intelligence.md) | Yinghan Sun, Aoji Zhu, Xiang Ji et al. | Hong Kong Polytechnic University; Chinese University of Hong Kong; Harbin Institute of Technology |

## Cite this page

Scholar4AI. (2026). Q-learning. Journal Research Rankings. Retrieved October 26, 2026, from https://scholar4ai.com/equations/q-learning

```bibtex
@misc{scholar4ai-equations-q-learning,
  author = {{Scholar4AI}},
  title = {Q-learning},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/equations/q-learning}},
  urldate = {2026-10-26},
  note = {Journal Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).