--- title: "ReLU activation: formula and 36 recent papers" description: "ReLU activation was mentioned in 36 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #30 of the 104 equations and models mentioned." url: https://scholar4ai.com/equations/relu-activation markdown_url: https://scholar4ai.com/equations/relu-activation.md license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/) share_text: "ReLU activation was mentioned in 36 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #30 of the 104 equations and models mentioned." data_url: https://scholar4ai.com/data/rankings.json updated: 2026-10-26T14:52:47+09:00 window: 2026-09-27 to 2026-10-26 source: OpenAlex (CC0) --- # ReLU activation $$ \mathrm{ReLU}(x) = \max(0, x) $$ The most common activation function in deep networks. - area: Machine learning - 2 papers in the last 7 days - Names searched for: ReLU, rectified linear unit Back to the ranking: https://scholar4ai.com/rankings/equations.md ## Key findings - ReLU activation was mentioned in 36 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #30 of the 104 equations and models mentioned. - By journal category: AI (29), Operations Research (3), Finance (2), Management (1) and Economics (1). - Most of them appeared in Neural Networks (5), Neural Computing and Applications (5) and Applied Intelligence (4). - Often mentioned together with Cross-entropy loss (20), Convolutional neural network (CNN) (19) and Scaled dot-product attention (Transformer) (16). - Datasets named in the same papers: OR-Library (7), ImageNet (5) and MNIST / Fashion-MNIST (5). - From Oct 2023 to Sep 2026, 67 archived papers mentioned ReLU activation in their title, abstract or keywords, most of them in Sep 2026 (7). ## Mentions over 36 months *Papers mentioning it by publication month, Oct 2023 to Sep 2026 (titles, abstracts and keywords)* | Trend | Oct 23–Sep 24 | Oct 24–Sep 25 | Oct 25–Sep 26 | 36 months | |---|---:|---:|---:|---:| | | 28 | 22 | 17 | 67 | *Papers mentioning ReLU activation, newest first.* | Date | Title | Journal | Authors | Affiliations | |---|---|---|---|---| | 2026-10-24 | [A priority-aware dual-channel feature fusion method for urban rail service traffic classification](https://doi.org/10.1007/s10489-026-07560-z) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Xinpeng Liu, Junhui Zhao, Zhengyuan Wu et al. | Beijing Jiaotong University | | 2026-10-23 | [From pixels to profits: trading arbitrage portfolios based on image representations](https://doi.org/10.1007/s11408-026-00507-x) | [Financial markets and portfolio management](https://scholar4ai.com/journals/financial-markets-and-portfolio-management.md) | Niklas Paluszkiewicz | Universität Ulm | | 2026-10-19 | [DReX: An explainable deep learning-based multimodal recommendation framework](https://doi.org/10.1016/j.knosys.2026.117184) | [Knowledge-Based Systems](https://scholar4ai.com/journals/knowledge-based-systems.md) | Adamya Shyam, Venkateswara Rao Kagita, Bharti Rana et al. | University of Delhi; National Institute of Technology Warangal | | 2026-10-17 | [Multi-Perspective explainability in traffic prediction: A neuro-symbolic approach using CNN-LSTMs and concept lattices](https://doi.org/10.1007/s10489-026-07512-7) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Suraya Syazwani Mohamad Yusof, Hadhrami Ab Ghani, Nurul Izrin Md Saleh et al. | Universiti Malaysia Kelantan; Universiti Teknikal Malaysia Melaka; University of Technology Malaysia | | 2026-10-17 | [GLCN: a hybrid graph convolution and lite capsule network for robust and interpretable link prediction in complex networks](https://doi.org/10.1007/s10115-026-02906-y) | [Knowledge and Information Systems](https://scholar4ai.com/journals/knowledge-and-information-systems.md) | Indu, Varsha Sisaudia, Kapil Sharma | Delhi Technological University | | 2026-10-16 | [Generative deep learning for class imbalance in credit risk modeling: comparative evaluation of synthetic oversampling methods and an elastic oversampling extension](https://doi.org/10.1186/s40854-026-00970-5) | [Financial Innovation](https://scholar4ai.com/journals/financial-innovation.md) | Tae Yeon Kwon | Hankuk University of Foreign Studies | | 2026-10-16 | [The Challenges of Hyperparameter Tuning for Accurate Causal Effect Estimation](https://doi.org/10.1007/s10994-026-07140-9) | [Machine Learning](https://scholar4ai.com/journals/machine-learning.md) | Damian Machlanski, Spyridon Samothrakis, Paul Clarke | University of Edinburgh; University of Essex; Institute for Social and Economic Research | | 2026-10-15 | [pDOC-STANet: A spatiotemporal attention network for automatic assessment of prolonged disorders of consciousness using fNIRS](https://doi.org/10.1007/s10489-026-07542-1) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Zehai Li, Yuxin Xing, Shuwei Wang et al. | Zhejiang Normal University; Wenzhou Medical University; Zhejiang Taizhou Hospital; … | | 2026-10-15 | [A Cognitive, Quantum-Inspired Learning Framework for Energy-Efficient and Reliable Routing in Wireless Body Area Networks](https://doi.org/10.1007/s12559-026-10665-9) | [Cognitive Computation](https://scholar4ai.com/journals/cognitive-computation.md) | Soufiane Ben Othman, Naima Saeed | King Faisal University; University of Aden | | 2026-10-14 | [A single-loop bilevel deep learning method for optimal control of obstacle problems](https://doi.org/10.1016/j.neunet.2026.109761) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | Yongcun Song, Shangzhi Zeng, Jin Zhang et al. | Nanyang Technological University; Southern University of Science and Technology | | 2026-10-14 | [Dynamic gain neuromodulation attenuates stability gaps during continual joint training](https://doi.org/10.1016/j.neunet.2026.109767) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | Alejandro Rodriguez-Garcia, Anindya Ghosh, Srikanth Ramaswamy | Newcastle University | | 2026-10-06 | [Rising rested bandits: Lower bounds and efficient algorithms](https://doi.org/10.1016/j.artint.2026.104638) | [Artificial Intelligence](https://scholar4ai.com/journals/artificial-intelligence.md) | Marco Fiandri, Alberto Maria Metelli, Francesco Trovò | | | 2026-10-05 | [An innovative approach to stock forecasting: combining LSTM, VMD, and artificial rabbit optimization](https://doi.org/10.1186/s43093-026-00987-3) | [Future Business Journal](https://scholar4ai.com/journals/future-business-journal.md) | Homa Mehtarizadeh, Najme Mansouri, Behnam Mohammad Hasani Zade et al. | Shahid Bahonar University of Kerman | | 2026-10-03 | [Sparse oblique rule boosting for simpler additive rule ensembles](https://doi.org/10.1007/s10618-026-01241-8) | [Data Mining and Knowledge Discovery](https://scholar4ai.com/journals/data-mining-and-knowledge-discovery.md) | Shahrzad Behzadimanesh, Pierre Le Bodic, Geoffrey I. Webb et al. | Monash University; University of Haifa | | 2026-10-03 | [Uncertainty quantification for trustworthy deep learning: Methods and measures](https://doi.org/10.1016/j.neunet.2026.109699) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | H. Martin Gillis, Thomas P. Trappenberg | Dalhousie University | | 2026-10-02 | [RL-Axial: Learning When to Compute Global Context for Multimodal Segmentation](https://doi.org/10.1007/s12559-026-10661-z) | [Cognitive Computation](https://scholar4ai.com/journals/cognitive-computation.md) | Dong Xing, Hang Yang, Jinhe Zhang et al. | Chinese Academy of Sciences; Changchun Institute of Optics, Fine Mechanics and Physics; University of Chinese Academy of Sciences | | 2026-10-01 | [Convex-Relaxed Counterfactual Optimization for Non-differentiable Classifiers via Neural Surrogates](https://doi.org/10.1016/j.neunet.2026.109793) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | Ao Xu, Zihao Li, Tieru Wu | | | 2026-10-01 | [Alzheimer’s multimodal diagnosis: enhancing cross-attention between speech and text](https://doi.org/10.1007/s00521-026-12482-5) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Kewen Ding, Azadeh Noori Hoshyar, Tanusri Bhattacharya et al. | Federation University; Western Sydney University; Myer Foundation; … | | 2026-10-01 | [Class-based many-objective neural architecture search for deep classifiers](https://doi.org/10.1007/s00521-026-12510-4) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Guy Mardiks, Adham Salih, Amiram Moshaiov | Tel Aviv University; Braude College of Engineering Karmiel | | 2026-10-01 | [Patient-independent EEG seizure detection using channel attention and dual-branch time–frequency features](https://doi.org/10.1007/s00521-026-12518-w) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Hrishikesh Tiwary, Arnav Bhavsar, H Muralikrishna | Indian Institute of Technology Mandi; Manipal Academy of Higher Education | | 2026-10-01 | [CL3AN-GNN: curriculum-driven for incremental feature disentanglement with multi-phase attention for class-imbalanced node classification](https://doi.org/10.1007/s00521-026-12579-x) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Abdul Joseph Fofanah, David Chen, Lian Wen et al. | Griffith University; Chang'an University; Njala University | | 2026-10-01 | [Increased interpretability of simultaneous peak water flow estimation using monotonic neural networks](https://doi.org/10.1007/s00521-026-12496-z) | [Neural Computing and Applications](https://scholar4ai.com/journals/neural-computing-and-applications.md) | Sebastian Ferreyro Fernandez, Lynne Barbara Jack, Sarat C. Dass | Heriot-Watt University; Heriot-Watt University Malaysia | | 2026-10-01 | [Multi-view self-supervised learning for label-flipping robustness in tabular data: a comparative study](https://doi.org/10.1007/s10489-026-07452-2) | [Applied Intelligence](https://scholar4ai.com/journals/applied-intelligence.md) | Jinhyeok Jang, Sohee Park, Seung-Soo Nam et al. | Soongsil University | | 2026-10-01 | [From 3D perception to safety reasoning: an intelligent hybrid framework for real-time underground mine monitoring](https://doi.org/10.1016/j.eswa.2026.134601) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Pasindu Ranasinghe, Simit Raval, Dibyayan Patra et al. | UNSW Sydney; University of Southern Queensland | | 2026-10-01 | [Integrable elasticity via neural demand potentials](https://doi.org/10.1016/j.eswa.2026.134600) | [Expert Systems with Applications](https://scholar4ai.com/journals/expert-systems-with-applications.md) | Carlos Heredia, Daniel Roncel | | | 2026-10-01 | [Relaxation via separable estimators: arithmetic and implementation](https://doi.org/10.1007/s10898-026-01648-z) | [Journal of Global Optimization](https://scholar4ai.com/journals/journal-of-global-optimization.md) | Yanlin Zha, Mario E. Villanueva, Boris Houska et al. | Imperial College London; IMT School for Advanced Studies Lucca; ShanghaiTech University | | 2026-10-01 | [CLIDD: Cross-Layer Independent Deformable Description for Efficient and Discriminative Local Feature Representation](https://doi.org/10.1007/s11263-026-03063-z) | [International Journal of Computer Vision](https://scholar4ai.com/journals/international-journal-of-computer-vision.md) | Haodi Yao, Fenghua He, Ning Hao et al. | Harbin Institute of Technology; Beijing Institute for General Artificial Intelligence | | 2026-10-01 | [Parallelizable memory recurrent units](https://doi.org/10.1016/j.neunet.2026.109797) | [Neural Networks](https://scholar4ai.com/journals/neural-networks.md) | Florent De Geeter, Gaspard Lambrechts, Damien Ernst et al. | University of Liège | | 2026-10-01 | [Efficient Test-Time Prompt Tuning for Vision-Language Models](https://doi.org/10.1007/s11263-026-03019-3) | [International Journal of Computer Vision](https://scholar4ai.com/journals/international-journal-of-computer-vision.md) | Yuhan Zhu, Guozhen Zhang, Xu Chen et al. | Nanjing University; Shanghai Artificial Intelligence Laboratory | | 2026-09-30 | [Solution methods for the dynamic and probabilistic profitable tour problem](https://doi.org/10.1007/s00291-026-00875-w) | [OR Spectrum](https://scholar4ai.com/journals/or-spectrum.md) | Marvin Caspar, Daniel Schermer, Oliver Wendt | University of Kaiserslautern; Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau | | 2026-09-30 | [Towards optimized forward–forward training for neural networks](https://doi.org/10.1007/s10462-026-11668-6) | [Artificial Intelligence Review](https://scholar4ai.com/journals/artificial-intelligence-review.md) | Yomna Abdulgawad Elnady, Amany Mahmoud Sarhan, Mohammad Ali Eita | Tanta University; ElSewedy University of Technology | | 2026-09-29 | [Machine learning-enhanced column generation for large-scale capacity planning problems](https://doi.org/10.1016/j.cie.2026.112398) | [Computers & Industrial Engineering](https://scholar4ai.com/journals/computers-industrial-engineering.md) | Felipe Keim, Víctor Bucarey L., Qi Zhang et al. | University of Chile; University of O'Higgins; Complex Engineering System Institute; … | | 2026-09-28 | [Self-Organized Context Dependent Processing in Neural Networks](https://doi.org/10.1007/s12559-026-10624-4) | [Cognitive Computation](https://scholar4ai.com/journals/cognitive-computation.md) | Hao GuangFu, Yang Chen, Sainan Qin et al. | Chinese Academy of Sciences; Institute of Automation; University of Chinese Academy of Sciences; … | | 2026-09-28 | [CausalCACTUS: A Causally Consistent and Context-Aware Framework for Counterfactual Explanations](https://doi.org/10.1007/s10994-026-07155-2) | [Machine Learning](https://scholar4ai.com/journals/machine-learning.md) | Zhendong Wang, Diego García, José María Enguita et al. | KTH Royal Institute of Technology; Universidad de Oviedo | | 2026-09-28 | [Exploring the temporal consistency for point-level weakly-supervised temporal action localization](https://doi.org/10.1016/j.patcog.2026.114948) | [Pattern Recognition](https://scholar4ai.com/journals/pattern-recognition.md) | Yunchuan Ma, Laiyun Qing, Guorong Li et al. | University of Chinese Academy of Sciences; Macquarie University | | 2026-09-28 | [Treatment evaluation at the intensive and extensive margins](https://doi.org/10.1016/j.jeconom.2026.106344) | [Journal of Econometrics](https://scholar4ai.com/journals/journal-of-econometrics.md) | Phillip Heiler, Asbjørn Kaufmann, Bezirgen Veliyev | Aarhus University | ## Cite this page Scholar4AI. (2026). ReLU activation. Journal Research Rankings. Retrieved October 26, 2026, from https://scholar4ai.com/equations/relu-activation ```bibtex @misc{scholar4ai-equations-relu-activation, author = {{Scholar4AI}}, title = {ReLU activation}, year = {2026}, howpublished = {\url{https://scholar4ai.com/equations/relu-activation}}, urldate = {2026-10-26}, note = {Journal Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0} } ``` License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).