Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
The goal of this randomized controlled trial is to evaluate the role of large language models in enhancing laypeople's ability to self-diagnose and triage common diseases. The main questions it aims to answer are:
Participants will:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| layperson-LLM integrated group | Experimental | After initially answering a clinical diagnosis and triage question without the aid of tools, the participants were asked to use a large language model (Deepseek v3 or r1) to retrieve health information and then answer the same question again |
|
| layperson-search engine group | Active Comparator | After initially answering a clinical diagnosis and triage question without the use of tools, the participants were required to use a search engine to retrieve health information and then answer the same question again |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| AI-assisted health information seeking | Behavioral | Participants in this group used a large language model (DeepSeek) to search for medical information related to a clinical vignette after providing initial diagnostic and triage decisions. They were instructed to interact freely with the model to gather insights and then update their diagnoses and triage recommendations. The intervention simulates real-world use of AI tools for personal health decision-making |
| Measure | Description | Time Frame |
|---|---|---|
| Top-3 Diagnostic Accuracy | The primary diagnostic outcome was defined as the proportion of participants who included the correct diagnosis in their top three differential diagnoses after using the assigned tool (LLM or search engine). Accuracy was assessed for each of the 48 clinical vignettes and aggregated across all participants in each group. | Immediately after intervention (within the same survey session) |
| Triage Accuracy (4-class exact match) | Triage accuracy was defined as the proportion of participants who selected the correct triage level (emergent care, within one day, within one week, or self-care) that matched the reference standard. There were 12 vignettes per triage category. | Immediately after intervention (within the same survey session) |
| Measure | Description | Time Frame |
|---|---|---|
| Top-1 Diagnostic Accuracy | The proportion of participants who selected the correct diagnosis as their top (first) diagnosis after using the assigned tool. This measures the precision of laypeople's final diagnostic judgment. | Immediately after intervention (within the same survey session) |
| Triage Accuracy (2-class binary match) |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Chenxi Liu | Huazhong University of Science and Technology | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Tongji Medical College of Huazhong University of Science & Technology School of Medicine and Health Management | Wuhan | Hubei | China |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| Conventional internet search for health information | Behavioral | Participants in this group used mainstream internet search engines (e.g., Baidu, Google, Bing) to look up information about the clinical vignette after making initial diagnostic and triage decisions. They were allowed to search freely but were not permitted to use any named AI chatbot or large language model platform. This group represents typical self-directed online health information seeking behavior. |
|
| Immediately after intervention (within the same survey session) |