A Multicentre, Randomised Diagnostic Accuracy Study Evaluating AI Assisted Diagnosis of Rare Diseases
A Multicentre, Randomised Diagnostic Accuracy Study Evaluating AI Assisted Diagnosis of Rare Diseases
A multicentre, randomised diagnostic accuracy study to evaluate whether the rare disease-specific AI can improve diagnostic accuracy and efficiency for physicians managing real-world clinical cases.
Rare diseases collectively affect approximately 300 million individuals worldwide. This prolonged diagnostic delay is attributable in large part to the breadth of over 7,000 recognized rare conditions, which far exceeds the clinical exposure of any individual physician. A rare disease-specific diagnostic AI was developed by Peking Union Medical College Hospital (PUMCH), supporting differential diagnosis generation, clinical workup planning, and genomic variant interpretation. A balanced crossover design ensures that each enrolled physician serves as their own control, substantially reducing confounding from inter-reader variability in baseline diagnostic competency. Within each physician, cases are randomly assigned at the case level to either the AI-assisted or unassisted condition, such that each physician reads a subset of cases with AI assistance and the remaining cases without. This within-reader, case-level randomization eliminates the need for a washout period and directly controls for inter-reader differences in baseline diagnostic competency. All cases are collected from real-world clinical settings with independently confirmed gold-standard diagnoses and span a pre-specified spectrum of rare and non-rare disease categories, reflecting the differential diagnostic challenge encountered in routine clinical practice, to ensure diagnostic breadth and clinical representativeness. Physician seniority (junior vs. senior) is incorporated as a pre-specified stratification and subgroup analysis variable. Diagnostic outputs are evaluated by an independent Expert Adjudication Committee, blinded to the assistance condition, using standardized scoring criteria established prior to data collection.
Inclusion Criteria:
Exclusion Criteria:
shuyangzhang103@163.com+86-13911667211
Beijing, China
shuyangzhang103@163.com+8613911667211
czszxyyirb@163.com+86-0317-2075013
ccsx_net2008@126.com+86-0431-88711699
dgrmyyirb@163.com+86-0769-28637333
jinye0320@163.com+86-0757-83833633
sytsb606@sina.com+86-0851-85937094
jlszxyy@163.com+86-0432-62456181
khyyyb@163.com+86-0871-63638800
wudong@pumch.cn+86-0891-6371322
setyyyb@tj.gov.cn022-87787101
whsrmyybgs@163.com+86-0473-2035041
403252559@qq.com+86-0971-8177911
zzfh2005@126.com+86-0596-2082950