ReLU activation

area: Machine learning · 2 papers in the last 7 days

\mathrm{ReLU}(x) = \max(0, x)

The most common activation function in deep networks.

LaTeX: \mathrm{ReLU}(x) = \max(0, x)

Names searched for: ReLU, rectified linear unit

Key findings#

ReLU activation was mentioned in 36 papers in the last 30 days (2026-09-27 to 2026-10-26), ranking #30 of the 104 equations and models mentioned.
By journal category: AI (29), Operations Research (3), Finance (2), Management (1) and Economics (1).
Most of them appeared in Neural Networks (5), Neural Computing and Applications (5) and Applied Intelligence (4).
Often mentioned together with Cross-entropy loss (20), Convolutional neural network (CNN) (19) and Scaled dot-product attention (Transformer) (16).
Datasets named in the same papers: OR-Library (7), ImageNet (5) and MNIST / Fashion-MNIST (5).
From Oct 2023 to Sep 2026, 67 archived papers mentioned ReLU activation in their title, abstract or keywords, most of them in Sep 2026 (7).

Mentions over 36 months#

Papers mentioning it by publication month, Oct 2023 to Sep 2026 (titles, abstracts and keywords)
Trend	Oct 23–Sep 24	Oct 24–Sep 25	Oct 25–Sep 26	36 months
	28	22	17	67

Papers mentioning ReLU activation, newest first.
Date	Title	Journal	Authors	Affiliations
2026-10-24	A priority-aware dual-channel feature fusion method for urban rail service traffic classification	Applied Intelligence	Xinpeng Liu, Junhui Zhao, Zhengyuan Wu et al.	Beijing Jiaotong University
2026-10-23	From pixels to profits: trading arbitrage portfolios based on image representations	Financial markets and portfolio management	Niklas Paluszkiewicz	Universität Ulm
2026-10-19	DReX: An explainable deep learning-based multimodal recommendation framework	Knowledge-Based Systems	Adamya Shyam, Venkateswara Rao Kagita, Bharti Rana et al.	University of Delhi; National Institute of Technology Warangal
2026-10-17	Multi-Perspective explainability in traffic prediction: A neuro-symbolic approach using CNN-LSTMs and concept lattices	Applied Intelligence	Suraya Syazwani Mohamad Yusof, Hadhrami Ab Ghani, Nurul Izrin Md Saleh et al.	Universiti Malaysia Kelantan; Universiti Teknikal Malaysia Melaka; University of Technology Malaysia
2026-10-17	GLCN: a hybrid graph convolution and lite capsule network for robust and interpretable link prediction in complex networks	Knowledge and Information Systems	Indu, Varsha Sisaudia, Kapil Sharma	Delhi Technological University
2026-10-16	Generative deep learning for class imbalance in credit risk modeling: comparative evaluation of synthetic oversampling methods and an elastic oversampling extension	Financial Innovation	Tae Yeon Kwon	Hankuk University of Foreign Studies
2026-10-16	The Challenges of Hyperparameter Tuning for Accurate Causal Effect Estimation	Machine Learning	Damian Machlanski, Spyridon Samothrakis, Paul Clarke	University of Edinburgh; University of Essex; Institute for Social and Economic Research
2026-10-15	pDOC-STANet: A spatiotemporal attention network for automatic assessment of prolonged disorders of consciousness using fNIRS	Applied Intelligence	Zehai Li, Yuxin Xing, Shuwei Wang et al.	Zhejiang Normal University; Wenzhou Medical University; Zhejiang Taizhou Hospital; …
2026-10-15	A Cognitive, Quantum-Inspired Learning Framework for Energy-Efficient and Reliable Routing in Wireless Body Area Networks	Cognitive Computation	Soufiane Ben Othman, Naima Saeed	King Faisal University; University of Aden
2026-10-14	A single-loop bilevel deep learning method for optimal control of obstacle problems	Neural Networks	Yongcun Song, Shangzhi Zeng, Jin Zhang et al.	Nanyang Technological University; Southern University of Science and Technology
2026-10-14	Dynamic gain neuromodulation attenuates stability gaps during continual joint training	Neural Networks	Alejandro Rodriguez-Garcia, Anindya Ghosh, Srikanth Ramaswamy	Newcastle University
2026-10-06	Rising rested bandits: Lower bounds and efficient algorithms	Artificial Intelligence	Marco Fiandri, Alberto Maria Metelli, Francesco Trovò
2026-10-05	An innovative approach to stock forecasting: combining LSTM, VMD, and artificial rabbit optimization	Future Business Journal	Homa Mehtarizadeh, Najme Mansouri, Behnam Mohammad Hasani Zade et al.	Shahid Bahonar University of Kerman
2026-10-03	Sparse oblique rule boosting for simpler additive rule ensembles	Data Mining and Knowledge Discovery	Shahrzad Behzadimanesh, Pierre Le Bodic, Geoffrey I. Webb et al.	Monash University; University of Haifa
2026-10-03	Uncertainty quantification for trustworthy deep learning: Methods and measures	Neural Networks	H. Martin Gillis, Thomas P. Trappenberg	Dalhousie University
2026-10-02	RL-Axial: Learning When to Compute Global Context for Multimodal Segmentation	Cognitive Computation	Dong Xing, Hang Yang, Jinhe Zhang et al.	Chinese Academy of Sciences; Changchun Institute of Optics, Fine Mechanics and Physics; University of Chinese Academy of Sciences
2026-10-01	Convex-Relaxed Counterfactual Optimization for Non-differentiable Classifiers via Neural Surrogates	Neural Networks	Ao Xu, Zihao Li, Tieru Wu
2026-10-01	Alzheimer’s multimodal diagnosis: enhancing cross-attention between speech and text	Neural Computing and Applications	Kewen Ding, Azadeh Noori Hoshyar, Tanusri Bhattacharya et al.	Federation University; Western Sydney University; Myer Foundation; …
2026-10-01	Class-based many-objective neural architecture search for deep classifiers	Neural Computing and Applications	Guy Mardiks, Adham Salih, Amiram Moshaiov	Tel Aviv University; Braude College of Engineering Karmiel
2026-10-01	Patient-independent EEG seizure detection using channel attention and dual-branch time–frequency features	Neural Computing and Applications	Hrishikesh Tiwary, Arnav Bhavsar, H Muralikrishna	Indian Institute of Technology Mandi; Manipal Academy of Higher Education
2026-10-01	CL3AN-GNN: curriculum-driven for incremental feature disentanglement with multi-phase attention for class-imbalanced node classification	Neural Computing and Applications	Abdul Joseph Fofanah, David Chen, Lian Wen et al.	Griffith University; Chang'an University; Njala University
2026-10-01	Increased interpretability of simultaneous peak water flow estimation using monotonic neural networks	Neural Computing and Applications	Sebastian Ferreyro Fernandez, Lynne Barbara Jack, Sarat C. Dass	Heriot-Watt University; Heriot-Watt University Malaysia
2026-10-01	Multi-view self-supervised learning for label-flipping robustness in tabular data: a comparative study	Applied Intelligence	Jinhyeok Jang, Sohee Park, Seung-Soo Nam et al.	Soongsil University
2026-10-01	From 3D perception to safety reasoning: an intelligent hybrid framework for real-time underground mine monitoring	Expert Systems with Applications	Pasindu Ranasinghe, Simit Raval, Dibyayan Patra et al.	UNSW Sydney; University of Southern Queensland
2026-10-01	Integrable elasticity via neural demand potentials	Expert Systems with Applications	Carlos Heredia, Daniel Roncel
2026-10-01	Relaxation via separable estimators: arithmetic and implementation	Journal of Global Optimization	Yanlin Zha, Mario E. Villanueva, Boris Houska et al.	Imperial College London; IMT School for Advanced Studies Lucca; ShanghaiTech University
2026-10-01	CLIDD: Cross-Layer Independent Deformable Description for Efficient and Discriminative Local Feature Representation	International Journal of Computer Vision	Haodi Yao, Fenghua He, Ning Hao et al.	Harbin Institute of Technology; Beijing Institute for General Artificial Intelligence
2026-10-01	Parallelizable memory recurrent units	Neural Networks	Florent De Geeter, Gaspard Lambrechts, Damien Ernst et al.	University of Liège
2026-10-01	Efficient Test-Time Prompt Tuning for Vision-Language Models	International Journal of Computer Vision	Yuhan Zhu, Guozhen Zhang, Xu Chen et al.	Nanjing University; Shanghai Artificial Intelligence Laboratory
2026-09-30	Solution methods for the dynamic and probabilistic profitable tour problem	OR Spectrum	Marvin Caspar, Daniel Schermer, Oliver Wendt	University of Kaiserslautern; Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau
2026-09-30	Towards optimized forward–forward training for neural networks	Artificial Intelligence Review	Yomna Abdulgawad Elnady, Amany Mahmoud Sarhan, Mohammad Ali Eita	Tanta University; ElSewedy University of Technology
2026-09-29	Machine learning-enhanced column generation for large-scale capacity planning problems	Computers & Industrial Engineering	Felipe Keim, Víctor Bucarey L., Qi Zhang et al.	University of Chile; University of O'Higgins; Complex Engineering System Institute; …
2026-09-28	Self-Organized Context Dependent Processing in Neural Networks	Cognitive Computation	Hao GuangFu, Yang Chen, Sainan Qin et al.	Chinese Academy of Sciences; Institute of Automation; University of Chinese Academy of Sciences; …
2026-09-28	CausalCACTUS: A Causally Consistent and Context-Aware Framework for Counterfactual Explanations	Machine Learning	Zhendong Wang, Diego García, José María Enguita et al.	KTH Royal Institute of Technology; Universidad de Oviedo
2026-09-28	Exploring the temporal consistency for point-level weakly-supervised temporal action localization	Pattern Recognition	Yunchuan Ma, Laiyun Qing, Guorong Li et al.	University of Chinese Academy of Sciences; Macquarie University
2026-09-28	Treatment evaluation at the intensive and extensive margins	Journal of Econometrics	Phillip Heiler, Asbjørn Kaufmann, Bezirgen Veliyev	Aarhus University

Cite this page

Scholar4AI. (2026). ReLU activation. Journal Research Rankings. Retrieved October 26, 2026, from https://scholar4ai.com/equations/relu-activation

@misc{scholar4ai-equations-relu-activation,
  author = {{Scholar4AI}},
  title = {ReLU activation},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/equations/relu-activation}},
  urldate = {2026-10-26},
  note = {Journal Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).