Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
The HEART-AI (Harnessing ECG Artificial Intelligence for Rapid Treatment and Accurate Interpretation) is an open-label, single-center, randomized controlled trial, that aims to deploy a platform called DeepECG at point-of-care for AI-analysis of 12-lead ECGs. The platform will be tested among healthcare professionals (medical students, residents, doctors, nurse practitioners) who read 12-lead ECGs. In the intervention group, the platform will display the ECHONeXT structural heart disease (SHD) scores in randomized patients to help doctors prioritize transthoracic echocardiography (TTEs) or magnetic resonance imaging (MRI) and reduce the time to diagnosis of structural heart disease. Also, this platform will display the DeepECG-AI interpretation which detects problems such as ischemic conditions, arrhythmias or chamber enlargements and acts an improved alternative to commercially available ECG interpretation systems such as MUSE.
Our primary objective is to assess the impact of displaying the ECHONeXT interpretation on 12-lead ECGs on the time to diagnosis of Structural Heart Disease (SHD) among newly referred patients at MHI. We will compare the time interval from the initial ECG to SHD diagnosis by transthoracic echocardiogram (TTE) or magnetic resonance imaging (MRI) between patients in the intervention arm (where ECHONeXT prediction of SHD and TTE priority recommendation are displayed) and patients in the control arm (where ECHONeXT prediction and recommendation are hidden).
The main secondary objective is to evaluate the rate of SHD detection on TTE or MRI among newly referred patients. We also aim to assess the delay between the time of the first ECG opened in the platform and the TTE or MRI evaluation among newly referred patients at high or intermediate risk of SHD.
By integrating an AI-analysis platform at the point of care and evaluating its impact on ECG interpretation accuracy and prioritization of incremental tests, the HEART-AI study aims to provide valuable insights into the potential of AI in improving cardiac care and patient outcomes.
The HEART-AI (Harnessing ECG Artificial Intelligence for Rapid Treatment and Accurate Interpretation) study primarily aims to assess the effect of displaying the ECHONeXT interpretation on the time interval from the initial ECG to the rate of Structural Heart Disease (SHD) diagnosis on transthoracic echocardiograms or magnetic resonance imaging.
We will achieve this by comparing the time between the first ECG and diagnosis of SHD on TTE or MRI between the intervention group, where the ECHONeXT interpretation is displayed to users, and the control group, where it is not displayed, thereby quantifying the influence of AI-supported diagnostics on clinical decision-making and patient management strategies.
For the purpose of the study, SHD will be defined as presence of any of the following on TTE or MRI:
LVEF ≤ 45%
Mild, moderate or severe RV Dysfunction
The presence of one or multiple valvulopathies in this list:
Moderate or severe pericardial effusion (Tamponade or any effusion > 1 cm)
LV wall thickness ≥ 1.3 cm
Apical cardiomyopathy
Pulmonary hypertension as defined using the systolic pressure of the pulmonary artery greater or equal to 25 mm Hg on TTE.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| ECHONEXT interpretation | Experimental | The ECHONeXT algorithm was trained to predict the presence of SHD on TTE using a single 12-lead ECG. It was developed at Columbia hospital, released as open-weights and validated at the MHI. It was trained on 800,000 ECG and TTE pairs. |
|
| No ECHONEXT interpretation | No Intervention | Not displaying the ECHONEXT algorithm interpretation. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| ECHONEXT | Other | ECHONEXT Artificial intelligence algorithm |
|
| Measure | Description | Time Frame |
|---|---|---|
| Assess the effect of displaying the ECHONeXT interpretation on the time to diagnosis of Structural Heart Disease (SHD) | Time interval from the first ECG opened in the platform to SHD diagnosis on TTE or MRI, calculated as: Date of SHD diagnosis on TTE - Date of access of the first ECG where an ECHONeXT interpretation was available and a user consulted the ECG | 18 months |
| Measure | Description | Time Frame |
|---|---|---|
| Assess the effect of displaying the ECHONeXT interpretation on the rate of SHD diagnosis on TTE | Diagnosis of SHD (Yes/No) on TTE | 18 months |
| Evaluate the effect of displaying the ECHONeXT interpretation on the delay between the ECG and the TTE evaluation for patients at high or intermediate risk of SHD |
| Measure | Description | Time Frame |
|---|---|---|
| Describe the engagement of users and the overall utilization of the DeepECG platform algorithm in the clinical setting | Number of ECGs accessed per user Number of days per user with at least 1 ECG accessed using the platform over total number of days the user is in the study (i.e. has access to the platform). | 18 months |
Inclusion Criteria:
Users
ECG
Patients
1. Patients aged 18 years or older
Additional Inclusion criteria for the randomization part of the study
Outpatients or patients who presented at the ambulatory emergency department. The location will be determined according to the ECG where it was recorded which is entered by the ECG technician. These locations will be included for the eligibility of the randomization:
a. locations_to_keep = ['21_URGENCE AMBULATOIRE', '1_CARDIOLOGIE GENERALE', "17_CLINIQUE D'ARYTHMIE"]
New patients without a prior formal evaluation by a cardiologist or internal medicine specialist for suspected or provisionally identified cardiac conditions, including:
Patients with previous TTE or MRI:
Exclusion Criteria:
Users
1. Users who are unable to commit to the duration of the study (approximately 1 month minimum) or adhere to the study protocol.
Additional Exclusion criteria for the randomization part of the study ECG
1. ECG with too many artefacts or without any QRS visible as interpretated by the MUSE GE algorithm.
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Montreal Heart Institute | Montreal | Quebec | H1T1C8 | Canada |
Not provided
| Label | URL |
|---|---|
| Related Info | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Delay between the time of the first ECG opened in the platform and the TTE calculated as: Date of TTE evaluation - Date of access of the first ECG where an ECHONeXT interpretation was available and a user consulted the ECG |
| 18 months |
| Assess the agreement of the users with the ECG-AI algorithm's interpretations | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on "thumbs up" on the platform. | 18 months |
| Determine the acceptability and usability of the DeepECG platform in clinical practice based on the end-of-study survey | Questions of the end-of-study survey on the usability and appreciation of the DeepECG platform and the ECHONeXT interpretation | 18 months |
| Determine the primary endpoint stratified according to the presence of a previous TTE > 24 months or no previous TTE (brand new patients) | Questions answer on the pre-ECG questionnaire | 18 months |
| Compare the TTE priority classification assigned by the user between the intervention and the control group |
TTE priority classification (A, B, C, D, E, etc.) assigned by the user on the post-ECG questionnaire to the first ECG recording where an ECHONeXT interpretation was available and a user consulted the ECG |
| 18 months |
| Compare the TTE priority classification assigned by the user between the intervention and the control group stratified by location (emergency vs outpatient | TTE priority classification (A, B, C, D, E, etc.) assigned by the user on the post-ECG questionnaire to the first ECG recording where an ECHONeXT interpretation was available and a user consulted the ECG. | 18 months |
| Review additional qualitative feedback and insights captured after reading an ECG | Narrative description put in the "other" field of the post-ECG questionnaire | 18 months |
| Assess the agreement of the user with the ECG-AI algorithm's interpretations according to practice type, number of years in practice, age of user and familiarity with AI tools (based on end of study questionnaire) | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on "thumbs up" on the platform. | 18 months |
| Describe the agreement of the user with the ECG-AI algorithm's interpretation according to the diagnosis category of the ECG-AI (ischemic, arrythmia, chamber enlargement, structural heart disease, other) | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation. Agreement is defined as the user clicking on "thumbs up" on the platform. | 18 months |
| Describe the agreement of the user with the ECG-AI algorithm's interpretation in the two subgroups. | Agreement (Yes/No) of the user with the ECG-AI algorithm's interpretation Agreement is defined as the user clicking on "thumbs up" on the platform. | 18 months |
| Evaluate the effect of displaying the ECHONeXT interpretation on the delay between the ECG and the TTE evaluation, by subgroups defined by the risk level of SHD (low/ intermediate/ high) | Delay between the time of the first ECG opened in the platform and the TTE calculated as: Date of TTE evaluation - Date of access of the first ECG where an ECHONeXT interpretation was available, and a user consulted the ECG | 18 months |
| Evaluate the model performance after applying continual learning | We will re-train the DeepECG models using examples that were downvoted by users or that users " bookmarked " in addition to the previous ECGs that were used for training the model. Model performance will be compared using the DeLong test for the AUC and AUPRC before and after retraining the model. Users will not be exposed ot this new model. | 18 months |
| Sensitivity and specificity of ECHONeXT to detect SHD on TTE | Assess the sensitivity and specificity of ECHONeXT to detect SHD on TTE | 18 months |