Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Cangzhou Central Hospital | OTHER |
| Zhangzhou Municipal Hospital | OTHER |
| Dongguan People's Hospital | OTHER_GOV |
| First People's Hospital of Foshan |
Not provided
Not provided
Not provided
Not provided
A multicentre, prospective, cluster-randomised, parallel-controlled real-world effectiveness study evaluating whether a rare-disease diagnostic large language model can improve diagnostic quality, efficiency, and health-economic outcomes for physicians managing patients with suspected rare or diagnostically unresolved disease.
Rare disease patients commonly experience prolonged diagnostic odysseys rooted in limited rare disease recognition, phenotypic heterogeneity, and dispersed diagnostic clues. Diagnostic decision-support large language models may improve first-visit consultations by integrating prior records, generating structured analyses, and proposing candidate diagnoses, thereby shortening diagnostic pathways and improving appropriate genetic testing referral.
Here, rare diseases clinics are established at 12 clinical institutions using a two-level randomisation structure: (1) cluster randomisation of physicians stratified by seniority tier and centre, with physician arm fixed throughout to eliminate contamination; (2) eligible consented patients randomly assigned to consultation rooms, blinding patients to arm assignment and providing allocation concealment.
In the intervention arm, patients interact with the AI before their consultation; physicians will review the AI report and interact with AI when seeing patients. In the control arm, patients are seen under standard hospital workflow without any generative AI tools. Outcomes adjudicated by an independent Expert Committee blinded to arm assignment; adjudicators access no AI-generated materials.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| AI system | Experimental | Patients and physicians will use the study AI system prior to and during the encounter in addition to conventional clinical workflow. Use of other generative AI tools is prohibited. |
|
| Standard of care | No Intervention | Patients proceed directly to the consultation room without AI interaction. The attending physician conducts the encounter per standard hospital workflow using conventional clinical resources only. Use of any generative AI tool is prohibited. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| AI system | Other | Prior to consultation, the AI system will interact with patients to build a personalised medical profile, generate a structured clinical analysis, and recommend candidate diagnoses. During the encounter, the AI system will interact with and be reviewed by physicians. |
| Measure | Description | Time Frame |
|---|---|---|
| Top-3 Candidate Diagnostic Accuracy | The proportion of patients whose physician-provided up to 3 candidate diagnoses at the first study visit include at least one concordant with the final reference diagnosis (denominator: all randomised patients with a blinded-adjudicated confirmed reference diagnosis; intention-to-treat population). | From the first visit to final reference diagnosis adjudication, an average of 8 weeks. |
| Rare Genetic Disease Diagnostic Yield | The proportion of all randomised patients who underwent genetic testing and had a clinically significant genetic variant (pathogenic or likely pathogenic) confirmed by an independent review committee blinded to arm assignment (denominator: all randomised patients). Variant pathogenicity classified per predefined ACMG/AMP guidelines. | From the first visit to final reference diagnosis adjudication, an average of 8 weeks. |
| Measure | Description | Time Frame |
|---|---|---|
| Overall Diagnostic Yield | Proportion of all randomised patients who receive a confirmed clinical diagnosis (confirmed by independent expert review) during the trial period. | From the first visit to final reference diagnosis adjudication, an average of 8 weeks. |
| Overall Diagnostic Accuracy |
Not provided
Patient Inclusion Criteria:
Patient Exclusion Criteria:
Physician Inclusion Criteria
Physician Exclusion Criteria
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Role | Phone | Extension | |
|---|---|---|---|---|
| Shuyang Zhang, MD, PhD | Contact | +86-13911667211 | shuyangzhang103@163.com |
| Name | Affiliation | Role |
|---|---|---|
| Shuyang Zhang, MD, PhD | Peking Union Medical College Hospital | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Peking Union Medical College Hospital | Beijing | China |
Not provided
| ID | Term |
|---|---|
| D035583 | Rare Diseases |
| D004194 | Disease |
| ID | Term |
|---|---|
| D020969 | Disease Attributes |
| D010335 | Pathologic Processes |
| D013568 | Pathological Conditions, Signs and Symptoms |
Not provided
Not provided
| ID | Term |
|---|---|
| D000098403 | Intelligent Systems |
| ID | Term |
|---|---|
| D001185 | Artificial Intelligence |
| D000465 | Algorithms |
| D055641 | Mathematical Concepts |
Not provided
Not provided
| OTHER |
| Tibet Autonomous Region People's Hospital | OTHER |
| Guizhou Provincial People's Hospital | OTHER |
| Tianjin Children's Hospital | OTHER |
| The First People's Hospital of Yunnan | OTHER |
| Qinghai People's Hospital | OTHER |
Parallel Assignment with two-level randomisation. Level 1 - Physician/room stratified cluster randomisation. Unit = physician (= consultation room). Stratification: centre × seniority (junior/senior). 1:1 cluster allocation within each stratum, fixed for study duration. Allocation sequence will be generated by independent statistician.
Level 2 - Patient randomisation to consultation room. Eligible consented patients allocated in real time randomly to an available room within their centre (thereby determining arm); patients blinded to room arm, providing allocation concealment.
Not provided
Not provided
Patient level: open label (intervention arm patients must interact with AI before consultation, making concealment impossible).
Treating physicians: open label (as they cannot be blinded). Outcome adjudicators (independent expert committee) and statisticians: blinded. Adjudicators do not know arm assignment and are not shown any AI-generated or AI-attributed material; statistical analysis coded A/B until unblinding.
|
Among patients with a confirmed clinical diagnosis, the proportion whose diagnosis is concordant with the blinded-adjudicated final reference diagnosis. |
| From the first visit to final reference diagnosis adjudication, an average of 8 weeks. |
| Time to Diagnosis | Days from first visit to obtaining clinical diagnosis within the follow-up period. Patients without a confirmed diagnosis censored at end of follow-up. | From enrollment to the end of follow-up, up to 8 weeks. |
| Consultation Duration | In-room consultation time will be recorded, measured, and compared between arms. Pre-consultation AI interaction time and total visit time are additionally recorded for the intervention arm to fully characterise efficiency impact. | Assessed at each consultation (day 1), within 1 day. |
| Cost to Diagnosis | Cumulative costs from first visit to confirmed diagnosis (or end of follow-up for undiagnosed patients), including direct medical costs, direct non-medical costs, and indirect costs. | From enrollment to the end of follow-up, up to 8 weeks. |
| Physician-Reported Experience | Physicians will assess their experience of the diagnostic workflow. Responses will be recorded using a standardized rating scale (range 1-5, where higher scores indicate more positive experience). | Assessed at each consultation (day 1), within 1 day. |
| Patient-Reported Experience | Patients will assess their experience of the diagnostic workflow. Responses will be recorded using a standardized rating scale (range 1-5, where higher scores indicate more positive experience). | Assessed at each consultation (day 1), within 1 day. |
| Genetic Testing Referral Rate | Proportion of all randomised patients for whom the physician autonomously decides to refer for genetic testing, capturing the effect of AI intervention on referral behaviour. | Assessed at each consultation (day 1), within 1 day. |
| Positive Rate Among Referred Patients | The proportion in whom a clinically significant (pathogenic or likely pathogenic) genetic variant was detected among patients who completed genetic testing. | From the first visit to final reference diagnosis adjudication, an average of 8 weeks. |
| Cost-Effectiveness Analysis | Incremental cost-effectiveness ratio (incremental cost per additional correct diagnosis) as primary metric combining diagnostic yield with cumulative medical costs. | From the first visit to diagnosis or the end of follow-up, up to 8 weeks. |
| Cangzhou Central Hospital | Cangzhou | China |
|
| Changchun Sacred Heart Hospital | Changchun | China |
| Dongguan People's Hospital | Dongguan | China |
| First People's Hospital of Foshan | Foshan | China |
| Guizhou Provincial People's Hospital | Guiyang | China |
| Jilin Central General Hospital | Jilin City | China |
| The First People's Hospital of Yunnan Province | Kunming | China |
| Tibet Autonomous Region People's Hospital | Lhasa | China |
| Tianjin Children's Hospital | Tianjin | China |
| Wuhai People's Hospital | Wuhai | China |
| Qinghai Provincial People's Hospital | Xining | China |
| Zhangzhou Municipal Hospital of Fujian Province | Zhangzhou | China |