Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
This prospective multicenter observational study aims to evaluate the agreement between artificial intelligence (AI)-based interpretation and expert interpretation of rotational thromboelastometry (ROTEM) findings in clinically relevant settings. ROTEM is widely used to guide hemostatic therapy in perioperative and critically ill patients, but its interpretation is complex and subject to interobserver variability.
The primary objective is to determine whether AI-based interpretation achieves agreement comparable to variability between expert clinicians. Secondary objectives include comparison of interpretation time, assessment of consistency of AI outputs, and evaluation of potential differences in clinical decision-making.
ROTEM datasets will be independently assessed by multiple expert anesthesiologists and by an AI-based model using standardized input. Agreement between methods and variability of interpretation will be analyzed.
The study aims to determine whether AI-assisted interpretation could serve as a reliable decision-support tool and reduce variability in ROTEM-guided clinical practice.
This prospective multicenter observational study is designed to evaluate the agreement between artificial intelligence (AI)-based interpretation and expert interpretation of rotational thromboelastometry (ROTEM) findings, with a focus on clinical decision-making in critically ill patients.
ROTEM is a point-of-care viscoelastic method providing real-time information on coagulation, including clot formation, strength, and fibrinolysis. It is widely used to guide targeted hemostatic therapy in trauma, major surgery, and critical care. However, interpretation of ROTEM findings is complex and requires clinical expertise. Interobserver variability among clinicians may lead to inconsistent therapeutic decisions. Although algorithm-based approaches have been introduced, their implementation remains variable.
Artificial intelligence (AI) has the potential to standardize interpretation by integrating multiple ROTEM parameters and generating consistent recommendations. Previous studies have shown that machine learning models can predict clinical outcomes or transfusion requirements based on viscoelastic data. However, evidence on agreement between AI-based interpretation and expert interpretation, particularly in real-world clinical decision-making, remains limited.
The primary objective of this study is to determine whether AI-based interpretation achieves a level of agreement comparable to inter-expert variability in ROTEM interpretation. This study does not assume a single gold standard; instead, it evaluates agreement between methods, reflecting real-world clinical practice.
Secondary objectives include:
ROTEM measurements will be collected and presented in a standardized format, including graphical and numerical outputs. Each dataset will be independently evaluated by multiple expert anesthesiologists. The same datasets will be interpreted repeatedly by an AI-based large language model using a predefined standardized prompt, with multiple independent runs to assess intra-model variability.
For each ROTEM dataset, both experts and AI will assess:
Agreement between experts and AI, as well as inter-expert agreement, will be analyzed using appropriate statistical methods for categorical and continuous variables (e.g., kappa statistics and intraclass correlation coefficients). Time required for interpretation will also be recorded and compared.
This study is not designed to determine the absolute correctness of interpretation, but to quantify agreement and variability between human experts and AI. By identifying clinically relevant discrepancies, the study aims to evaluate whether AI-assisted interpretation may serve as a reliable decision-support tool and reduce variability in ROTEM-guided hemostatic management.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Patients indicated for thromboelastography. | Intensive care unit adult patients that are indicated for thromboelastography. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Large Language Model (LLM) artificial intelligence assesment | Other | The thromboelastography record will be assessed by LLM based artificial intelligence. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Agreement between AI-based and expert interpretation of ROTEM findings | Agreement between artificial intelligence (AI)-based interpretation and expert interpretation of ROTEM findings will be assessed and compared to inter-expert agreement. Agreement will be evaluated for predefined clinical decision outputs, including:
Agreement will be quantified using appropriate statistical methods for categorical and continuous data (e.g., Cohen's/Fleiss' kappa and intraclass correlation coefficients). | Up to 24 hours after ROTEM measurement (time required for interpretation and data recording). |
| Measure | Description | Time Frame |
|---|---|---|
| Interpretation time | Time required for interpretation of ROTEM findings by expert clinicians compared to AI-based interpretation. For experts, time will be measured from presentation of the ROTEM result to completion of responses. For AI, time will be measured from submission of the standardized query to completion of output generation. | Up to 24 hours after ROTEM measurement. |
| Measure | Description | Time Frame |
|---|---|---|
| Potential treatment change | Proportion of disagreement between expert panel and LLM based AI that would lead to treatment change. | Up to 24 hours after ROTEM measurement |
Inclusion Criteria:
Adult patients (age ≥18 years)
Exclusion Criteria:
Not provided
Not provided
Not provided
The study population will consist of adult patients undergoing rotational thromboelastometry (ROTEM) as part of routine clinical care in participating centers. Patients will be recruited from perioperative and intensive care settings, including major surgery, trauma, and critical illness, where assessment of coagulation status is clinically indicated.
This study reflects real-world practice, with no modification of standard care. The unit of analysis will be individual ROTEM measurements rather than individual patients, as repeated measurements may occur during clinical management.
Only ROTEM datasets with complete graphical and numerical outputs and meeting predefined quality criteria will be included.
Not provided
| ID | Term |
|---|---|
| D020141 | Hemostatic Disorders |
| ID | Term |
|---|---|
| D014652 | Vascular Diseases |
| D002318 | Cardiovascular Diseases |
| D006474 | Hemorrhagic Disorders |
| D006402 | Hematologic Diseases |
Not provided
Not provided
| ID | Term |
|---|---|
| D000098342 | Large Language Models |
| ID | Term |
|---|---|
| D000077321 | Deep Learning |
| D000069550 | Machine Learning |
| D001185 | Artificial Intelligence |
| D000465 | Algorithms |
Not provided
Not provided
Not provided
Not provided
Not provided
| Consistency of interpretation (intra-method variability) | Variability of AI-based interpretation across repeated independent runs will be assessed and compared with inter-expert variability. Consistency will be evaluated for all predefined outputs (diagnosis, treatment, dosing). | Up to 24 hours after ROTEM measurement |
| Proportion of clinically discordant decisions | Proportion of cases in which AI-based interpretation differs from expert interpretation in clinically relevant outputs, including:
| Up to 24 hours after ROTEM measurement |
| Inter-expert agreement | Agreement between individual expert clinicians in interpretation of ROTEM findings will be evaluated to define baseline interobserver variability and provide a reference for comparison with AI-based interpretation. | Up to 24 hours after ROTEM measurement |
| D006425 |
| Hemic and Lymphatic Diseases |
| D055641 |
| Mathematical Concepts |
| D016571 | Neural Networks, Computer |