ROC curve and AUC

area: Deep learning and language models · 3 papers in the last 7 days

← Most-used equations and models · All deep learning and language models equations

AUC = \int_0^1 TPR\; d(FPR)

Area under the receiver operating characteristic curve: how well a score separates two classes, from 0.5 to 1.

LaTeX: AUC = \int_0^1 TPR\; d(FPR)

Names searched for: receiver operating characteristic, area under the curve, area under the ROC curve, AUC, AUROC

Variables and notation#

TPR is true-positive rate and FPR false-positive rate as a score threshold varies; AUC integrates the ROC curve.

Worked example#

One positive score 0.8 exceeds negative scores 0.3 and 0.7, so empirical ranking AUC=2/2=1. Equal positive/negative scores usually contribute half credit.

ROC AUC summarizes ranking across thresholds; precision–recall AUC highlights performance relative to the positive prevalence. AUC does not choose an operating threshold or measure probability calibration.

Sources and further reading#

An introduction to ROC analysis

Examples use illustrative inputs, not observed research results. Logarithms are natural unless stated otherwise. Guide updated 2026-11-05. Prepared by Scholar4AI. Editorial and verification policy.

Key findings#

ROC curve and AUC was mentioned in 47 papers in the last 30 days (2026-10-07 to 2026-11-05), ranking #25 of the 248 equations and models mentioned.
By journal category: AI (12), Statistics (7), Information Systems (6), Finance (5), Operations Research (4), Health Economics and Policy (4), Management (3), Higher Education and Research (3), Economics (2) and Marketing (1).
Most of them appeared in Expert Systems with Applications (3), BMC Medical Research Methodology (2) and Computers & Security (2).
Often mentioned together with F1 score (15), Logistic regression (logit) (12) and Decision tree (CART) (8).
Datasets named in the same papers: Eurostat (2), American Community Survey (1) and US health surveys (NHANES, BRFSS, MEPS) (1).
From Nov 2023 to Oct 2026, 1,619 archived papers mentioned ROC curve and AUC in their title, abstract or keywords (the search of earlier months' full texts is still under way), most of them in Feb 2024 (57).
From 2017 to 2026 (so far), ROC curve and AUC was mentioned in 2,150 papers in the tracked journals, most of them in AI (1,398), statistics (215) and health economics and policy (129).
530 of them were published in 2025, against 48 in 2017.
Since 2023, the institutions with the most of these papers were Chinese Academy of Sciences (34), University of Oxford (27) and KU Leuven (22).
The journals publishing most of them were Expert Systems with Applications (124), Journal Of Big Data (123) and Artificial Intelligence Review (120).
The most-cited of them is “A systematic study of the class imbalance problem in convolutional neural networks” (Neural Networks, 2018), with 3,086 citations.

Mentions over 36 months#

Papers mentioning it by publication month, Nov 2023 to Oct 2026 (titles, abstracts and keywords; the full texts of earlier months are still being searched)
Trend	Nov 23–Oct 24	Nov 24–Oct 25	Nov 25–Oct 26	36 months
	514	529	576	1,619

Papers per year#

20172026 (so far)

Papers per publication year and category
Category	2017	2018	2019	2020	2021	2022	2023	2024	2025	2026 (so far)
AI	19	16	18	41	47	58	143	383	381	292
Statistics	11	6	16	18	15	19	22	29	27	52
Health Economics and Policy	15	13	7	10	8	8	9	15	19	25
Operations Research	1	1	1	1	2	5	12	27	34	31
Economics	0	4	0	1	1	2	8	16	22	20
Finance	0	0	0	1	1	1	2	24	18	26
Information Systems	0	1	0	2	2	8	5	14	16	19
Management	0	0	0	0	0	0	4	9	7	15
Higher Education and Research	2	0	0	0	1	5	4	5	3	8
Marketing	0	0	0	0	0	0	1	1	1	4
Accounting	0	0	0	0	0	0	0	4	1	2
Tourism and Hospitality	0	0	0	0	0	0	0	0	1	1
All categories	48	41	42	74	77	106	210	527	530	495

Where the papers come from#

Journals with the most papers, since 2023
#	Journal	Papers
1	Expert Systems with Applications	124
2	Journal Of Big Data	123
3	Artificial Intelligence Review	120
4	Neural Computing and Applications	109
5	BMC Medical Research Methodology	81
6	IEEE Transactions on Pattern Analysis and Machine Intelligence	65
7	IEEE Transactions on Neural Networks and Learning Systems	59
8	IEEE Transactions on Artificial Intelligence	55
9	Applied Intelligence	45
10	Pattern Recognition	44

Institutions with the most papers, since 2023
#	Institution	Papers
1	Chinese Academy of Sciences	34
2	University of Oxford	27
3	KU Leuven	22
4	University of Cambridge	22
5	Tsinghua University	21
6	Monash University	20
7	Hong Kong Polytechnic University	19
8	Shanghai Jiao Tong University	19
9	University of Chinese Academy of Sciences	19
10	UNSW Sydney	18

Countries with the most papers, since 2023
#	Country	Papers
1	China	451
2	United States	279
3	United Kingdom	238
4	Germany	124
5	Spain	121
6	Italy	119
7	Australia	116
8	India	84
9	Netherlands	82
10	Canada	68

Keywords with the most papers, since 2023
#	Keyword	Papers
1	class imbalance	131
2	explainable AI	100
3	random forest	86
4	deep learning	77
5	feature selection	72
6	XGBoost	66
7	graph neural networks	65
8	convolutional neural networks	62
9	SHAP	61
10	interpretability	56

Most-cited papers#

Most-cited papers since 2017
#	Citations	Per month	Title	Journal	Published	Authors
1	3,086	31.1	A systematic study of the class imbalance problem in convolutional neural networks	Neural Networks	2018-07-29	Mateusz Buda, Atsuto Maki, Maciej A. Mazurowski
2	2,995	40.3	A comparative analysis of gradient boosting algorithms	Artificial Intelligence Review	2020-08-24	Candice Bentéjac, Anna Csörgő, Gonzalo Martínez-Muñoz
3	1,114	34.5	A Comprehensive Survey of Continual Learning: Theory, Method and Application	IEEE Transactions on Pattern Analysis and Machine Intelligence	2024-02-26	Liyuan Wang, Xingxing Zhang, Hang Su et al.
4	633	20.2	Feature selection strategies: a comparative analysis of SHAP-value and importance-based methods	Journal Of Big Data	2024-03-26	Huanjing Wang, Qianxin Liang, John Hancock et al.
5	627	18.4	Deep learning models for digital image processing: a review	Artificial Intelligence Review	2024-01-01	R. Archana, P. S. Eliahim Jeevaraj
6	613	18.5	Autoencoders and their applications in machine learning: a survey	Artificial Intelligence Review	2024-02-03	Kamal Berahmand, Fatemeh Daneshfar, Elaheh Sadat Salehi et al.
7	548	15.7	A review of ensemble learning and data augmentation models for class imbalanced problems: Combination, implementation and evaluation	Expert Systems with Applications	2023-12-09	Azal Ahmad Khan, Omkar Chaudhari, Rohitash Chandra
8	522	16.4	Federated learning for medical image analysis: A survey	Pattern Recognition	2024-03-12	Hao Guan, Pew‐Thian Yap, Andrea Bozoki et al.
9	520	6.2	Extended Isolation Forest	IEEE Transactions on Knowledge and Data Engineering	2019-10-31	Sahand Hariri, M. Carrasco Kind, Robert J. Brunner
10	495	22.9	Deep learning and computer vision in plant disease detection: a comprehensive review of techniques, models, and trends in precision agriculture	Artificial Intelligence Review	2025-01-17	Abhishek Upadhyay, Narendra Singh Chandel, Krishna Pratap Singh et al.

Archive counts by publication year: a paper counts when its title, abstract or keywords name the equation, or when OpenAlex's full-text search finds it there (searched for the last 30 days' papers and, by a pass over the past years, for older ones). Names added to the list later are looked for in older papers as the archive is read again.

Papers mentioning ROC curve and AUC, newest first.
Date	Title	Journal	Authors	Affiliations
2026-11-03	Availability before precision: how the quality of inbound information governs the aircraft turnaround departure-delay decision	Journal of Air Transport Management	Parth Yogeshbhai Purohit	Technische Universität Braunschweig
2026-10-31	Cross-Sectoral Patterns of Circular Consumption Behaviours: Evidence from R-Strategies	Journal of Consumer Policy	Katarzyna Bentkowska, Agnieszka Szulc‐Obłoza	SGH Warsaw School of Economics; Nicolaus Copernicus University
2026-10-31	Validation of the Kythera Labs all-payer real-world data asset: a provenance-anchored nine-block framework for tokenized evidence generation	BMC Medical Research Methodology	Onur Başer	City University of New York; Boğaziçi University
2026-10-29	Acoustic–semantic equivalence: A trimodal framework for B2B sales communication effectiveness and training allocation	Journal of Business Research	Joona Mäntyvaara, Paavo Nevalainen, Jukka Heikkonen	University of Turku
2026-10-28	Cash Advances and Short-Horizon Liquidity Pressure: Evidence from a Turkish Bank	Journal of Financial Services Research	Banu Mutlu Memis, Ben J. Sopranzetti	New York Institute of Technology; Rutgers, The State University of New Jersey
2026-10-28	German farmers' preferences for peatland rewetting schemes: Autonomy, flexibility and institutional trust	Land Use Policy	Marius Michels, Oliver Mußhoff	University of Göttingen; Humboldt-Universität zu Berlin
2026-10-27	Interaction-aware graph learning for non-stationary extreme value modeling of crash risk using real-world pre-crash trajectories	Expert Systems with Applications	Kequan Chen, Yuxuan Wang, Zhibin Li et al.	Nanyang Technological University; Nanjing University of Aeronautics and Astronautics; Southeast University; …
2026-10-27	TempCTI-KG: Temporal validity and confidence decay modeling for Cyber Threat Intelligence knowledge graphs	Telematics and Informatics Reports	Doygun Demirol	Bingöl University
2026-10-27	Data-driven reweighting of the Charlson and Elixhauser comorbidity indices using German claims data: development for in-hospital mortality only, external validation across clinical and health-economic outcomes	Health Economics Review	Klaus Kaier, Derek Y. Hazard, Adrian Heidenreich et al.	University of Freiburg; University Medical Center Freiburg; Universitäts-Herzzentrum Freiburg-Bad Krozingen
2026-10-27	Beyond temporal encoding: Efficient and hierarchical model-level online adaptation for tabular distribution shift	Neural Networks	Tianyu Wang, Mian Li, Xi Vincent Wang et al.	KTH Royal Institute of Technology; Shanghai Jiao Tong University
2026-10-26	From unimodal to multimodal deep physiological signal analysis in healthcare: A survey of models, fusion and explainability	Knowledge-Based Systems	Thilini Bakmeedeniya, Selvarajah Thuseethan, Roshan Ragel et al.	University of Peradeniya; NSBM Green University; Charles Darwin University
2026-10-26	The Precautionary Principle and the Innovation Principle: Incompatible Guides?	Philosophy & Technology	Kim Kaivanto	Lancaster University
2026-10-24	Beyond membership inference: Distributional leakage in diffusion models	Computers & Security	Sergio Barezzani, Pasquale Coscia, Stefano Ferrari et al.	University of Milan
2026-10-24	AI vs. AI: An AI-Enabled Conversational Intervention to Inoculate Against AI-Generated Fake News	Information Systems Frontiers	Mohammad S. Najjar, Murtaza Nasir	Wichita State University
2026-10-23	Dynamic prediction of loss given default in Norwegian retail credit card debt: advanced machine learning versus statistical models	Digital Finance	Cathy Ho, Isabel A. C. Sandersen, Espen Selliken et al.	Norwegian University of Science and Technology
2026-10-23	Approaches to utility value assessment in NICE technology appraisals of targeted therapies for non-small-cell lung cancer: a critical examination and recommendations	The European Journal of Health Economics	Lotte Westerink, Maarten Jacobus Postma, Job F. M. van Boven et al.	University Medical Center Groningen; University of Groningen; Universitas Airlangga; …
2026-10-23	Gradual disturbance detection model inspired by dynamic graph theory for digital twin manufacturing cell	Journal of Industrial Information Integration	Yaguang Zhou, Guanghui Zhou, Chao Zhang et al.	Xi'an Jiaotong University; Brunel University of London
2026-10-23	Behavioural continuity does not guarantee cybersecurity risk portability: Evidence from device, intervention, and longitudinal perturbations	Computers & Security	Chattopadhyay Kausik, Pant Millie	Indian Institute of Technology Roorkee
2026-10-23	Improved classification of agricultural injuries from free-text analysis of pre-hospital care reports under temporal drift	BMC Medical Research Methodology	Laura Jones, Erika Scott, Nicole L. Krupa et al.	Bassett Medical Center; University of Michigan
2026-10-23	When Does Analytic Complexity Matter? A Theory-Informed Comparison of Regression-Based and Algorithmically Flexible Models of Student Success in Community Colleges	Innovative Higher Education	JoHyun Kim, Jeongmin Ji, Seung Won Yoon	Texas A&M University; Korea Institute for Curriculum and Evaluation
2026-10-22	Residual scenario generation for stochastic planning: An emergency medical services application	Transportation Research Part C Emerging Technologies	Paulo Abreu, Daniel Santos, Maximilian Schiffer et al.	University of Lisbon; Instituto Superior Técnico; Centro de Estudos de Gestão; …
2026-10-22	An automated online proctoring system with live suspicious activity detection using YOLOv11 pose estimation and multi-model classification	Computers and Education Artificial Intelligence	Md. Taslim Arif, Abu Salyh Muhammad Mussa, Abdullah Al Mamun et al.
2026-10-21	Responsible AI-driven decision-making for fair and efficient continuity of care among older adults	Omega	Somayeh Ghazalbash, Manaf Zargoush, Vedat Verter et al.	McMaster University; Queen's University; Northeastern University
2026-10-21	Auditable distillation of tabular foundation models into percentile-based fuzzy rules under a concept bottleneck	Information Sciences	Jacek Kluska, Tomasz Stachyra, Ewelina Jamrozik	Rzeszów University of Technology
2026-10-20	From NER to Business Process Automation: comparative evaluation of CNN, LSTM, and transformer models for address intelligence	Knowledge and Information Systems	Vikas Jalodia, Divya Srivastava, Saurabh Kumar Srivastava	Bennett University
2026-10-19	A systematic literature review of bank failure prediction models	Finance Research Open	Japheth Jev, Lukman Akanbi, Muhammad Bilal et al.	Birmingham City University; Birmingham Newman University; University of Greater Manchester
2026-10-19	Reusability report: multi-sample omics network inference operates in distinct robustness regimes defined by prior knowledge and data availability	Nature Machine Intelligence	Xabier Martinez‐de‐Morentin, Sameer Ahmad Khan, Itziar Cenzano et al.	King Abdullah University of Science and Technology; Ilia State University; Karolinska University Hospital; …
2026-10-17	Development and COSMIN-based psychometric evaluation of the activities of daily living questionnaire for elderly iranian patients with chronic obstructive pulmonary disease (ADLEC): a sequential exploratory mixed-methods study using hybrid concept analysis	Health and Quality of Life Outcomes	Fateme Monjazebi, Asghar Dalvandi, Fereshteh Najafi et al.	Shahid Beheshti University of Medical Sciences; University of Social Welfare and Rehabilitation Sciences; Zahedan University of Medical Sciences
2026-10-17	Tech Mining with LLMs: Unveiling Trends from Corporate Websites	Computational Economics	Xavier Martínez-Barbero, Ana Pastor-Merino, Josep Domènech	Universitat Politècnica de València
2026-10-16	Customer complaint analytics in digital financial services: temporal prediction of untimely responses and capacity-aware prioritization	Future Business Journal	Jinho Cha, Lam Trong Vu, Thanh-Tung Nguyen et al.	Gwinnett Technical College; CMC University; Texas A&M University – Corpus Christi
2026-10-16	Generative deep learning for class imbalance in credit risk modeling: comparative evaluation of synthetic oversampling methods and an elastic oversampling extension	Financial Innovation	Tae Yeon Kwon	Hankuk University of Foreign Studies
2026-10-16	Quality of measurement instruments assessing Planetary and One Health Literacy related constructs: a systematic review	Health and Quality of Life Outcomes	Lydia Reismann, Jennifer Kallenbach, Christian Apfelbacher et al.	University of Bayreuth; MSH Medical School Hamburg – University of Applied Sciences and Medical University; Otto-von-Guericke-Universität Magdeburg; …
2026-10-16	Detecting change points in the hemodynamic response in event-related functional magnetic resonance imaging	Computational Statistics & Data Analysis	Friederike Preusse, Thorsten Dickhaus, André Brechmann	University of Bremen; Leibniz Institute for Neurobiology
2026-10-16	The Challenges of Hyperparameter Tuning for Accurate Causal Effect Estimation	Machine Learning	Damian Machlanski, Spyridon Samothrakis, Paul Clarke	University of Edinburgh; University of Essex; Institute for Social and Economic Research
2026-10-14	From resources to results: how interim outputs improve and mediate R&D output prediction	Scientometrics	Hoon Ah Jang	Korea University
2026-10-13	A risk analytics framework for early brand risk detection using audience sentiment volatility in influencer marketing	Decision Analytics Journal	Tereza Semerádová, Petr Weinlich	Technical University of Liberec
2026-10-12	GM-DualTransAML++: A Multi-Source Graph–Transformer Framework with Statistical Risk Mining and Typology Supervision for Anti-Money Laundering Detection	Annals of Data Science	Kirti Akash Nimbhorkar, Vinod M. Patil, Priyanka V. Deshmukh	Symbiosis International University
2026-10-12	Performance uncertainty in medical image analysis: A large-scale investigation of confidence intervals	Medical Image Analysis	Pascaline André, Charles Heitz, Evangelia Christodoulou et al.	Centre National de la Recherche Scientifique; Inserm; Sorbonne Université; …
2026-10-11	Mobility creates reach, ecosystems determine conversion: Founder educational mobility and international engagement	Journal of Business Venturing Insights	Angélica Pigola, Bruno Brandão Fischer, Gustavo Hermínio Salati Marcondes de Moraes	Universidade Estadual de Campinas (UNICAMP)
2026-10-10	Streamline pathology foundation model by cross-magnification distillation	Medical Image Analysis	Ziyu Su, Abdul Akbar, Usama Sajjad et al.	The Ohio State University Wexner Medical Center; The Ohio State University
2026-10-09	Reliable and robust zero-watermarking against IBM attacks	Expert Systems with Applications	Jing Liu, Jiake Wang, Runchuan Liu	Northwest University; Xi'an University of Technology
2026-10-09	Accurate assessment of surgical HER2-low status based on core needle biopsy data of breast cancer	Diagnostic and Prognostic Research	Wen Li, Zixi Chen, Junyao Li et al.	Chongqing University; Chongqing Cancer Hospital; Hong Kong University of Science and Technology; …
2026-10-09	ROC curve analysis for functional markers	Journal of Multivariate Analysis	Ana M. Bianco, Graciela Boente, Juan Carlos Pardo–Fernández	Consejo Nacional de Investigaciones Científicas y Técnicas; Universidad de Buenos Aires; Universidade de Vigo
2026-10-08	A stability-validated unsupervised anomaly detection framework for identifying suspicious pre-listing trading behavior in cryptocurrency markets	Digital Finance	Gela Tsuladze, Frédérik Sinan Bernard, Marcos Machado	University of Twente
2026-10-08	ACCEPT 3.0: Recalibrating ACute COPD Exacerbation Prediction Tool (ACCEPT) for global use	Diagnostic and Prognostic Research	Laura Huey Mien Lim, Jeenat Mehareen, Amin Adibi et al.	University of British Columbia; National University of Singapore; University of Cambridge; …
2026-10-07	Hypergraph multi-view learning for ncRNA–drug association prediction with cluster anchors and contrastive alignment	Expert Systems with Applications	Zhihao Ma, Yu Chen, Hailing Wang et al.	Shanghai Key Laboratory of Trustworthy Computing; East China Normal University; Shanghai Normal University; …
2026-10-07	MRC-GAT: A meta-relational copula-based graph attention network for interpretable multimodal Alzheimer's disease diagnosis	Artificial Intelligence in Medicine	Fatemeh Khalvandi, Saadat Izadi, Abdolah Chalechale	Razi University

Cite this page

Scholar4AI. (2026). ROC curve and AUC. Journal and Conference Research Rankings. Retrieved November 5, 2026, from https://scholar4ai.com/equations/roc-curve-and-auc

@misc{scholar4ai-equations-roc-curve-and-auc,
  author = {{Scholar4AI}},
  title = {ROC curve and AUC},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/equations/roc-curve-and-auc}},
  urldate = {2026-11-05},
  note = {Journal and Conference Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}

Free to reuse for non-commercial purposes with attribution (CC BY-NC 4.0).