Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
This study is a prospective randomized controlled trial that aims to evaluate whether large language model (LLM) assistance improves physicians' diagnostic performance compared with conventional assistance.
The study population consists of licensed physicians who have completed at least two years of neurology training. Participants are randomly assigned in a 1:1 ratio to the LLM assistance group or the conventional assistance group. In the LLM assistance group, physicians are assisted by an in-house LLM and are allowed to use conventional resources (e.g., search engines, UpToDate, or clinical guidelines) before submitting a final diagnosis. Access to any other LLMs is not permitted. In the conventional assistance group, physicians use only conventional resources and do not have access to the in-house LLM or any other LLMs at any point during the study. The primary outcome is top-1 diagnostic accuracy. Secondary outcomes include top-3 diagnostic accuracy, the time required to complete each case, and physicians' diagnostic confidence.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| LLM assistance group | Experimental | Physicians are assisted by an in-house LLM and are allowed to use conventional resources. Access to any other LLMs is not permitted. |
|
| Conventional assistance group | No Intervention | Physicians use only conventional resources and do not have access to the in-house LLM or any other LLMs at any point during the study. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| LLM assistance | Other | Physicians are assisted by an in-house large language model and are allowed to use conventional resources. Access to any other LLMs is not permitted. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Top-1 diagnostic accuracy | Top-1 diagnosis is considered correct if the physician's final top-ranked diagnosis matches the reference diagnosis or a clinically similar diagnosis judged as equivalent by neurologists. | Baseline |
| Measure | Description | Time Frame |
|---|---|---|
| Top-3 diagnostic accuracy | Top-3 diagnosis is considered correct if the reference diagnosis or a clinically similar diagnosis judged as equivalent by neurologists appears among the physician's top three final diagnoses. | Baseline |
| Time spent on diagnosis |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Beijing Luhe Hospital affiliated to Capital Medical University | Beijing | Beijing Municipality | 100000 | China | ||
Not provided
Not provided
Not provided
Not provided
Not provided
Time participants spend per case. |
| Baseline |
| Diagnostic confidence | Physicians' diagnostic confidence will be measured using a five-point Likert scale (1=very unsure, 5=very sure). | Baseline |
| Xuanwu Hospital Capital Medical University |
| Beijing |
| Beijing Municipality |
| 100053 |
| China |
| Nanyang Central Hospital | Nanyang | Henan | 473000 | China |