Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
The goal of this observational study is to learn if an AI assistant tool can help doctors who read chest CT scans (called radiologists) write their reports faster and just as well or better. Chest CT scans are common pictures taken of the inside of the chest to help with diagnosis. The main questions the study aims to answer are: (1) Does using the AI tool save radiologists time when writing their reports? (2) Are the final reports written with the AI tool's help as good as or better than reports written without it? To answer these questions, researchers will compare two time periods at several hospitals. They will look at how long it took to write reports and how good the reports were, both from a time before the AI tool was available and from a time after it was in regular use. In this study, radiologists will use the AI tool as part of their normal daily work. The tool is built into the computer system they already use to look at scans. Researchers will then measure the time and quality of the reports produced during their regular shifts.
Here we provide a summary of the study's methodological framework, including a description of the AI system under evaluation, key quality control measures, and the data analysis plan. Comprehensive details regarding the full protocol, including eligibility criteria and outcome measures, can be found in the other modules of the study protocol.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Radiologists with/without chest CT interpretation AI assistant | This study employs a single-arm, within-subjects design. A cohort of radiologists will be followed through two sequential practice phases: (1) Baseline (Control) Phase: Participants interpret and report on chest CT scans using their standard clinical workflow without AI assistance. (2) AI-available phase: The same participants interpret and report on a different set of chest CT scans with the integrated AI-assisted reporting system activated in their workflow. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| An AI-assisted reporting system integrated into the clinical workflow, providing automated draft generation to assist with chest CT interpretation | Device | The intervention under evaluation is an AI-assisted diagnostic reporting system, integrated directly into the radiologists' workflow. The system analyzes the CT images in real time using an AI model and automatically generates a structured, preliminary radiology report draft. The interpreting radiologist reviews this AI-generated draft, which is presented within their familiar reporting interface. The radiologist then actively edits, confirms, supplements, or overrides the draft content as necessary before finalizing and signing the report. This intervention is distinguished from other AI tools by its focus on end-to-end reporting efficiency via integrated draft generation within the radiologist's classic workflow. It moves beyond simple abnormality detection or highlighting by generating a complete, structured narrative report draft, aiming to reduce dictation/typing time and minimize oversight of findings. |
| Measure | Description | Time Frame |
|---|---|---|
| Change in Average Image Interpretation Time | Comparison of the average time taken by participating radiologists to complete standard chest CT interpretation tasks, measured both with and without use of the automated interpretation tool. The time will be recorded from the start to the completion of each individual reading case. | Time of interpretation will be collected once the data become fully available (generally within 2 weeks after the planned primary completion date). Final aggregated analysis will be completed within 3 months after the collection of potential confounders. |
| Change in Chest CT Report Quality Score | Comparison of the subjective quality of chest CT reports written with and without automated tool support. Blinded external experts will evaluate the subjective quality of all sampled reports using a 10-point rating scale, with scores ranging from 1 (poorest quality) to 10 (highest quality). | Reports will be distributed to external experts for scoring once the data become available, with scoring results returned within 7 days. Final aggregated analysis will be completed within 3 months after the collection of potential confounders. |
Not provided
| Measure | Description | Time Frame |
|---|---|---|
| Radiologist Editing Intensity on AI-Generated Report Drafts | This measure quantifies the extent of modification a radiologist makes to the initial draft report generated by the AI system. Editing intensity will be algorithmically calculated for each report in the with-AI period. A common method is the normalized edit distance (e.g., Levenshtein distance) or the percentage of text modified between the AI-generated draft and the radiologist's final signed report. |
The study participants include both the radiologists whose performance is evaluated and the chest CT scans they interpret. Eligibility criteria are defined for both.
1. Inclusion Criteria
1.1 For Radiologists
1.2 For Chest CT Scans
2. Exclusion Criteria
2.1 For Radiologists:
2.2 For Chest CT Scans
Not provided
Not provided
Not provided
Not provided
The study population is defined as follows:
| Name | Role | Phone | Extension | |
|---|---|---|---|---|
| Xiaodan Ye, MD, PhD | Contact | +86-13761459998 | yuanyxd@163.com | |
| Weiqiu Jin, MD | Contact | jinwqzsh@fudan.edu.cn |
| Name | Affiliation | Role |
|---|---|---|
| Mengsu Zeng, MD, PhD | Department of Radiology, Zhongshan Hospital, Fudan University | Study Chair |
| Dinggang Shen, PhD | United Imaging Intelligence, Shanghai | Study Director |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai | Shanghai | China |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 41053447 | Background | Teo ZL, Thirunavukarasu AJ, Elangovan K, Cheng H, Moova P, Soetikno B, Nielsen C, Pollreisz A, Ting DSJ, Morris RJT, Shah NH, Langlotz CP, Ting DSW. Generative artificial intelligence in medicine. Nat Med. 2025 Oct;31(10):3270-3282. doi: 10.1038/s41591-025-03983-2. Epub 2025 Oct 6. | |
| 41776077 | Background | Chen SF, Alyakin A, Seas A, Yang E, Choi JJ, Lee JV, Chen AL, Warman PI, Bitolas RT, Steele RJ, Alber DA, Oermann EK. LLM-assisted systematic review of large language models in clinical medicine. Nat Med. 2026 Mar;32(3):1152-1159. doi: 10.1038/s41591-026-04229-5. Epub 2026 Mar 3. |
Not provided
Not provided
This is an observational study analyzing aggregated, de-identified operational metrics (e.g., radiologist efficiency, report quality scores) derived from routine clinical practice. The data are not collected as part of a prospective clinical trial and are not structured for independent analysis. Findings will be disseminated through peer-reviewed publications.
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| Report texts will be collected once the data become fully available (generally within 2 weeks after the planned primary completion date). Final aggregated analysis will be completed within 3 months after the collection of potential confounders. |
| Jianying Gu, MD, PhD |
| Department of Radiology, Zhongshan Hospital, Fudan University |
| Study Director |
| Dijia Wu, PhD | United Imaging Intelligence, Shanghai | Study Director |
| United Imaging Intelligence, Shanghai, Shanghai | Shanghai | China |
|
| ID | Term |
|---|---|
| D013896 | Thoracic Diseases |
| ID | Term |
|---|---|
| D012140 | Respiratory Tract Diseases |
Not provided
Not provided