Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| 347920 | Other Identifier | IRAS Project ID | |
| 26/EE/0111 | Other Identifier | REC reference |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Chest X-rays are commonly used to help diagnose and manage chest conditions. Artificial intelligence (AI) tools are increasingly being used to support chest X-ray interpretation. However, it is not yet clear whether the timing of AI information affects how clinicians review images, make decisions, and use AI support.
This study will look at whether showing AI information before or after a clinician first reviews a chest X-ray changes how they look at the image, how long they take, their interpretation decisions, their confidence, and their trust in AI support.
Healthcare professional participants will complete two chest X-ray interpretation sessions in a controlled NHS research setting. During each session, participants will review de-identified chest X-ray images while wearing eye-tracking equipment. Eye-tracking will record where a participant looks on the image and how long they spend looking at different areas.
In one session, AI information will be shown before the participant reviews the chest X-ray. In the other session, AI information will be shown after the participant has first reviewed the chest X-ray. The order of these two sessions will be balanced across participants.
The study uses de-identified chest X-ray images from existing examinations. It does not involve patients directly, does not change clinical care, and no clinical decisions will be made from the study readings. Participants will also complete a short questionnaire about their experience of using AI support. A separate anonymous survey will collect wider views from clinicians, patients, members of the public, and healthcare staff about the use of AI in chest X-ray interpretation.
CREAITED is a behavioural diagnostic reader study examining how the timing of artificial intelligence (AI) decision-support information influences chest X-ray interpretation by healthcare professionals. The study focuses on whether showing AI information before or after a participant first reviews a chest X-ray affects visual search behaviour, interpretation time, clinical decision-making, confidence, and trust in AI support.
Chest X-rays are widely used in clinical practice, but interpretation can be challenging because findings may be subtle and normal anatomy can overlap with abnormalities. AI systems are increasingly used to support image interpretation by highlighting suspected abnormalities. However, less is known about how clinicians use AI information during reporting tasks, including whether seeing AI output early changes attention, reliance, confidence, or interpretation strategy. Current clinical guidance generally supports independent image review before consulting decision-support tools, but direct evidence on AI timing in chest X-ray interpretation remains limited. This study is designed to provide controlled evidence on that question.
The main reader study is a single-site study at University Hospitals of Leicester NHS Trust. It uses a within-subject, counterbalanced, multi-reader, multi-case design. The exposure of interest is the timing of AI decision-support presentation during chest X-ray interpretation. The AI information is used only within the research task and is not used to guide real patient care.
Healthcare professional participants will complete two chest X-ray interpretation sessions in a controlled NHS research setting. Participants will include clinicians and healthcare professionals who interpret, review, check, or act on chest X-ray findings as part of their current or recent professional role. The study is not designed to assess individual competence. Individual participant results will not be used for employment, appraisal, training progression, formal assessment, or performance management.
Each participant will complete both AI timing conditions. In one session, AI information will be shown before the participant reviews the chest X-ray. In the other session, the participant will first review the chest X-ray without AI information, and AI information will then be shown afterwards. The order of these two-timing conditions will be balanced across participants using a pre-generated allocation schedule. The two sessions will be separated by at least four weeks to reduce recall and learning effects.
Each case will use a two-phase interpretation process. In the first phase, only one information source is shown, either the original chest X-ray or the AI output, depending on the timing condition. In the second phase, the alternative information source is introduced so that both the chest X-ray and AI information can be viewed. Participants complete a structured interpretation response after the first phase and may review or revise their response after seeing both information sources before submitting their final response for that case.
During each session, participants will review de-identified chest X-ray images using a dedicated diagnostic reporting workstation in a controlled reporting environment. The reader study is designed for approximately 20 complete participant datasets. Each participant will review 25 study chest X-ray cases per session across two sessions. The same study image set will be used across both sessions, with case order independently randomised for each session. Warm-up cases from a separate image pool will be used at the start of each session to familiarise participants with the task and equipment, and these warm-up cases will not be included in the main analysis.
The image set will include a mix of normal and abnormal chest X-rays and a range of diagnostic difficulty. Cases will be selected from routine clinical imaging and de-identified before use in the study. Ground truth labels and image areas of interest will be defined through a structured clinical review process. These reference data will support analysis of participant interpretation, localisation, and visual search behaviour.
Participants will wear lightweight eye-tracking equipment during the interpretation task. Eye-tracking will record where participants look on the image and how long they spend looking at different areas. These data will be used to assess visual search behaviour, including how attention is distributed across image areas, how participants view areas highlighted by the AI, and whether visual search differs between the AI-first and chest X-ray-first timing conditions.
Study sessions will be self-paced, with optional breaks to reduce fatigue. A researcher will be present to monitor equipment and provide technical support if needed, while minimising interaction that could influence participant behaviour. After completing the reader study sessions, participants will complete a short questionnaire about confidence, trust, perceived usefulness, workflow impact, and the influence of AI timing. Participants will also be debriefed about the study design and the reason for comparing different AI timing conditions.
The study will collect de-identified imaging data, eye-tracking data, structured reporting responses, timing data, localisation information, and questionnaire responses. The primary outcome is case interpretation time, measured for each chest X-ray case. Other outcomes include diagnostic performance, clinical interpretation or management responses, confidence in decision-making, participant perceptions of AI support, and eye-tracking measures of visual search behaviour.
The reader study uses de-identified chest X-ray images from existing examinations. No patients are recruited directly into the reader study, no clinical care is changed, and no clinical decisions will be made from participant study readings. The study does not involve investigational medicinal products, and no biological samples are collected.
Patient and public involvement informed the development of the study. Input from patients, members of the public, healthcare staff, and other stakeholders helped refine the focus on trust, confidence, transparency, human oversight, communication preferences, and the timing of AI information. This input also informed participant-facing materials and the topic areas included in the supplementary survey.
Alongside the main reader study, a separate anonymous supplementary survey will collect wider views about AI use in chest X-ray interpretation. This survey will be administered remotely and will be open to relevant groups, including clinicians, patients, members of the public, and healthcare staff. It will explore views on trust, safety, responsibility, communication, acceptability, governance, and expectations of AI-supported chest X-ray interpretation. The supplementary survey is independent of the reader study sessions and does not influence the image interpretation task.
Study data will be handled using study identifiers and secure NHS systems. Results will be reported in aggregate form so that individual participants are not identified. The findings are intended to help inform safer and more effective use of AI decision support in chest X-ray interpretation.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Original CXR First Sequence | Experimental | Participants complete the original chest X-ray first timing condition in Session 1, followed by the AI output first timing condition in Session 2. Sessions are separated by at least four weeks. |
|
| AI Output First Sequence | Experimental | Participants complete the AI output first timing condition in Session 1, followed by the original chest X-ray first timing condition in Session 2. Sessions are separated by at least four weeks. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Original CXR First Timing | Behavioral | Participants first review the original chest X-ray without AI output and complete an initial structured interpretation response. AI output is then introduced, and participants may review or revise their response before submitting the final response for that case. |
| Measure | Description | Time Frame |
|---|---|---|
| Change in Chest X-ray Case Interpretation Time | Case interpretation time is the duration, in seconds, from initial case display to final structured report submission. Change in case interpretation time will be measured between Session 1 and Session 2, displaying either original chest X-ray first or AI output first. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Change in Chest X-ray Case Diagnostic Accuracy | Diagnostic accuracy will be assessed using structured report outcomes compared with clinician-verified chest X-ray ground truth. Each participant's final structured interpretation for each chest X-ray case will be compared with the verified study ground truth for that case. Change in diagnostic accuracy will be measured between Session 1 and Session 2, displaying either original chest X-ray first or AI output first. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Change in Chest X-ray Case Visual Search Behaviour | Visual search behaviour will be assessed using predefined eye-tracking metrics that capture gaze location and search behaviour during chest X-ray interpretation. Metrics include time to first fixation, hit time, dwell time within abnormal case areas of interest, fixation count, mean fixation duration, revisit count, and fixation dispersion. Change in visual search behaviour will be measured between Session 1 and Session 2, displaying either original chest X-ray first or AI output first. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Trust in AI Support After Reader-Study Completion | Trust in AI support will be assessed using structured questionnaire ratings after participants have completed both Session 1 and Session 2. This measure captures participants' overall perceived usefulness, reliance on AI support, and willingness to revise decisions after reviewing AI information. |
| Measure | Description | Time Frame |
|---|---|---|
| Change in Chest X-ray Case Clinical Management Recommendations | Clinical management recommendations will be recorded from participants' structured report responses for each chest X-ray case. Change in clinical management recommendations will be measured between Session 1 and Session 2, displaying either original chest X-ray first or AI output first. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Measure | Description | Time Frame |
|---|---|---|
| Differences in Chest X-ray Case Diagnostic Accuracy, Visual Search Behaviour, and Trust in AI Support by Clinical Background and Experience | Subgroup differences between participants with different clinical background and years of experience. Differences between participant subgroups will be measured for diagnostic accuracy, visual search behaviour, and trust in AI support, obtained during Session 1 and Session 2. Diagnostic accuracy uses structured report outcomes. Visual search behaviour metrics include time to first fixation, hit time, dwell time within abnormal case areas of interest, fixation count, mean fixation duration, revisit count, and fixation dispersion. Trust in AI support uses structured questionnaire ratings. |
Inclusion Criteria:
Main reader study:
Supplementary survey:
Exclusion Criteria:
Main reader study:
Supplementary survey:
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Role | Phone | Extension | |
|---|---|---|---|---|
| Richard Farley | Contact | +44116258 6237 | richard.farley1@nhs.net |
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| University Hospitals of Leicester NHS Trust | Recruiting | Leicester | Leicestershire | LE1 5WW | United Kingdom |
Not provided
Participants are randomly assigned to one of two session orders. In one order, participants review the chest X-ray first in Session 1 and the AI information first in Session 2. In the other order, participants review the AI information first in Session 1 and the chest X-ray first in Session 2. Sessions are separated by at least four weeks.
Not provided
Not provided
No masking is used. It is clear to participants and study staff whether the chest X-ray or the AI information is shown first during each session.
Not provided
|
| AI Output First Timing | Behavioral | Participants first view AI output before reviewing the original chest X-ray. The original chest X-ray is then introduced, and participants complete or revise their structured interpretation response before submitting the final response for that case. |
|
| Immediately after Session 2, anticipated average 5 weeks after enrolment |
| Change in Chet X-ray Case Decision Confidence | Decision confidence will be recorded as the participant's confidence rating in their final diagnostic judgement for each chest X-ray case. Change in decision confidence will be measured between Session 1 and Session 2, displaying either original chest X-ray first or AI output first. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Overall Reflective Confidence After Reader-Study Completion | Overall reflective confidence will be assessed using structured questionnaire ratings after participants completed both Session 1 and Session 2. This measure captures participants' overall perceived confidence in their interpretive decisions across the reader study. | Immediately after Session 2, anticipated average 5 weeks after enrolment |
| Participant Perceptions of AI Support After Reader-Study Completion | Participant perceptions of AI support will be assessed using a post-study questionnaire after participants completed both Session 1 and Session 2. This measure captures participants' overall perceptions of usability, clarity, workflow implications, communication preferences, and responsibility. | Immediately after Session 2, anticipated average 5 weeks after enrolment |
| Broader Attitudes Toward AI in Chest X-ray Interpretation | Broader attitudes toward AI in chest X-ray interpretation will be assessed using a separate anonymous online supplementary survey. The survey will collect views on trust, responsibility, communication preferences, acceptability, and related perceptions from patients, members of the public, healthcare professionals, and healthcare staff. | 2 months |
| Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Association Between Chest X-ray Case Visual Search Behaviour and Diagnostic Accuracy | The association between visual search behaviour and diagnostic accuracy will be explored using outputs obtained during Session 1 and Session 2. Diagnostic accuracy will be assessed using structured report outcomes. Visual search behaviour metrics include time to first fixation, hit time, dwell time within abnormal case areas of interest, fixation count, mean fixation duration, revisit count, and fixation dispersion. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Association Between Chest X-ray Case Visual Search Behaviour and Case Complexity | The association between visual search behaviour and chest X-ray case complexity will be explored using outputs obtained during Session 1 and Session 2. Visual search behaviour metrics include time to first fixation, hit time, dwell time within abnormal case areas of interest, fixation count, mean fixation duration, revisit count, and fixation dispersion. Chest X-ray case complexity is predefined as low, moderate, or high. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Association Between Chest X-ray Case Visual Search Behaviour and AI Error Type | The association between visual search behaviour and chest X-ray case AI error type will be explored using outputs obtained during Session 1 and Session 2. Visual search behaviour metrics include time to first fixation, hit time, dwell time within abnormal case areas of interest, fixation count, mean fixation duration, revisit count, and fixation dispersion. Chest X-ray case AI error type is predefined as false-positive or false-negative. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |
| Visual Engagement with AI Output Interface Areas of Interest | Visual engagement with AI output interface elements will be assessed using predefined areas of interest drawn over the AI confidence indicator and other displayed AI interface features. Eye-tracking metrics will include time to first fixation, dwell time, fixation count, mean fixation duration, revisit count, and fixation dispersion within these areas of interest. Differences in these metrics will be assessed using data obtained during Session 1 and Session 2. | Session 1 at enrolment and Session 2 at least 4 weeks later, anticipated average 5 weeks |