This study will evaluate whether artificial intelligence (AI) can enhance clinicians' accuracy, efficiency, and confidence in distinguishing lung adenocarcinoma (LUAD) from lung squamous cell carcinoma (LUSC) and kidney renal papillary cell carcinoma (KIRP) from kidney renal clear cell carcinoma (KIRC) using digitized pathology slides. These subtype classifications are routinely performed by pathologists but can be challenging and time-consuming, particularly in difficult cases.
During the study, participating clinicians will review lung and kidney pathology slides under three different conditions:
Clinicians will be randomly assigned to different review sequences to minimize potential order effects. This study design will enable us to assess the impact of AI assistance on diagnostic accuracy, interpretation time, and clinician confidence.
Inclusion Criteria for Pathology Slides (i.e., Cases):
Exclusion Criteria for Pathology Slides (i.e., Cases):
Inclusion Criteria for Readers (i.e., Participants):
Readers first complete Block X (Unaided) on their assigned subset SX. They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check). Within Block Y1, the order of SY1a and SY1b is randomized. They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look). Within Block Y2, the order of SY2a and SY2b is randomized. For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
Readers first complete Block X (Unaided) on their assigned subset SX. They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look). Within Block Y2, the order of SY2a and SY2b is randomized. They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check). Within Block Y1, the order of SY1a and SY1b is randomized. For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
Readers first complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check). Within Block Y1, the order of SY1a and SY1b is randomized. They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look). Within Block Y2, the order of SY2a and SY2b is randomized. Then readers complete Block X (Unaided) on their assigned subset SX. For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
Readers first complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look). Within Block Y2, the order of SY2a and SY2b is randomized. They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check). Within Block Y1, the order of SY1a and SY1b is randomized. Then readers complete Block X (Unaided) on their assigned subset SX. For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
Boston, Massachusetts 02115, United States
AI-Assisted Pathologist Performance Improvement: A Multicenter, Prospective, Randomized Controlled Trial
AI Models in Clinical Pathology Diagnosis: A Multicenter RCT
Evaluation of Use of Diagnostic AI for Lung Cancer in Practice
The Impact of AI Assistance on Radiologist Performance and Healthcare Costs in LDCT-Based Lung Cancer Screening
To Evaluate an MRI-based Optimized Prostate Cancer Diagnostic Pathway Powered by Artificial Intelligence
A Trial Comparing Screening Mammography With and Without Assistance From Artificial Intelligence for Breast Cancer Detection and Recall Rates in Adult Patients
Prostate MRI Analysis by Radiologists and Artificial Intelligence - Disease Identification and Guided Management
Investigation of Impact of AI on Prostate Cancer Workflow