Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
The goal of this observational study is to evaluate the accuracy, completeness, and clinical consistency of large language model-generated cardiac magnetic resonance (CMR) imaging reports compared with expert radiologist reports in patients undergoing routine clinical CMR examinations.
The main question(s) it aims to answer are:
Can automatically generated CMR reports produced by a large multimodal model accurately reflect key imaging findings and diagnoses when compared with reports written by experienced cardiovascular radiologists?
How does the quality of generated reports perform in terms of clinical correctness, completeness, and linguistic clarity, as assessed by quantitative metrics and expert review?
If there is a comparison group:
Researchers will compare AI-generated CMR reports with ground-truth reports authored by board-certified cardiovascular radiologists to see if the automated system achieves comparable diagnostic accuracy and report quality across different cardiac pathologies.
Participants will:
Undergo standard-of-care cardiac MRI examinations as part of routine clinical practice.
Have their anonymized CMR image data and corresponding radiologist reports retrospectively collected.
Contribute data that will be used to generate automated CMR reports, which will then be evaluated against expert reports using objective metrics (e.g., diagnostic agreement, entity-level accuracy) and subjective clinical scoring by radiologists.
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| large lanuage model | Other | The intervention consists of an automated CMR report generation system based on a large multimodal deep learning model. The model takes de-identified CMR image data as input, including standard clinical sequences (e.g., cine LGE), and automatically generates a free-text radiology report describing cardiac structure, function, and imaging findings. The generated reports are produced offline and retrospectively, and are not used for clinical decision-making or patient management. No changes are made to the imaging acquisition protocol or standard clinical workflow. For evaluation purposes, the AI-generated reports are compared with reference reports authored by experienced cardiovascular radiologists, using predefined quantitative accuracy metrics and expert qualitative assessment of clinical correctness, completeness, and readability. This intervention is intended solely for research and performance evaluation of automated report generation and does not influence patient care. |
| Measure | Description | Time Frame |
|---|---|---|
| Diagnostic Accuracy of AI-Generated Cardiac MRI Reports | The primary outcome is the diagnostic accuracy of automatically generated cardiac magnetic resonance (CMR) reports produced by a large multimodal model. Diagnostic accuracy is assessed by comparing AI-generated reports with reference reports written by board-certified cardiovascular radiologists. Agreement is evaluated at the level of key clinical findings and final imaging impressions, using predefined criteria. Accuracy metrics include correctness of major diagnoses and presence or absence of clinically relevant imaging findings. | Baseline |
Not provided
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
The study population consists of patients who underwent routine, clinically indicated cardiac magnetic resonance (CMR) examinations at a medical center,represents a real-world clinical population undergoing cardiac MRI for diagnostic evaluation of various cardiovascular diseases.
All CMR studies included in this observational study are retrospectively collected, fully de-identified, and accompanied by corresponding radiologist-authored clinical reports. The study population represents a real-world clinical cohort with a range of cardiac conditions commonly evaluated by CMR.
Not provided
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Fuwai Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College | Beijing | Beijing Municipality | 100037 | China |
Not provided
| ID | Term |
|---|---|
| D002312 | Cardiomyopathy, Hypertrophic |
| ID | Term |
|---|---|
| D009202 | Cardiomyopathies |
| D006331 | Heart Diseases |
| D002318 | Cardiovascular Diseases |
| D001020 | Aortic Stenosis, Subvalvular |
Not provided
Not provided
Not provided
Not provided
Not provided
| D001024 |
| Aortic Valve Stenosis |
| D000082862 | Aortic Valve Disease |
| D006349 | Heart Valve Diseases |