Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Swiss National Science Foundation | OTHER |
Not provided
Not provided
Not provided
Not provided
10 to 35% of patients admitted to an emergency department receive an incorrect diagnosis. Not surprisingly, given the wide variety of health conditions encountered in emergency medicine, physicians often do not consider, remember, or know all possible diagnoses that fit the patient's symptoms. Nowadays, computer software (CDDS) is able to support physicians with a list of possible diagnoses by matching entered patient data to a large database with diagnoses. However, it is still unclear how the use of such a CDDS actually affects the diagnostic quality and workflow in 'real world' ER routine care. Therefore, the aim of this cluster-randomized cross-over trial is to evaluate the consequences of CDDS usage on diagnostic quality, patient outcomes and diagnostic workflow within the ER. Four ER's will provide a CDDS to the diagnosing physicians for specific periods (randomly and alternatingly allocated) in which physicians will be asked to use it for all included study patients. Outcomes between periods with and without the CDDS will be compared. Primary outcome is a diagnostic quality risk score composed of unscheduled ER revisits, unexpected hospitalization (both within 14 days), unexpected intensive medical care unit admission if hospitalized and diagnostic discrepancy between the ER discharge diagnosis and the current diagnosis after 14 days. In total, 1'184 patients will be included.
Background:
Misdiagnosis occurs in about 5% of outpatients, and in 10% to 35% of emergency room (ER) patients, sometimes with devastating medical and economic consequences. Nowadays, computerized diagnostic decision support programs (CDDS) exist, which suggest differential diagnoses (DDx) to physicians and thus have potential to improve diagnoses and hence, outcomes of patient care. The effects of such CDDS in 'real-world' ER settings are unknown. Controlled clinical trials investigating their effectiveness and safety are absent. In addition, most available CDDS are overcautious and suggest a wide variety of diagnostic options, likely increasing diagnostic resource consumption.
Objectives:
With this project, the investigators aim to understand the intended and unintended consequences of CDDS use by physicians on diagnostic quality and workflow in emergency medicine
Outcomes: Details given below
Design:
Cross sectional, multi-center, four-period cross-over controlled cluster-randomized trial. Four ER sites will randomly be allocated to one of two sequences with alternating intervention and control periods (ABAB vs. BABA) with each period lasting for two months. Recruitment will target 74 patients per period and cluster and 1'184 patients total.
Inclusion / Exclusion Criteria: Details given below
Intervention period: Details given below
Control period: Details given below.
Measurements and procedures:
For the primary outcome, data will be extracted from the electronic health records (i.e. ER diagnosis, intensive care unit admission or diagnosis after 14d if patients are still hospitalized). Additionally, patients and their general practitioner will be contacted via telephone by study nurses after 14d of study inclusion in order to collect information about patients' current diagnoses, and re-visits or hospitalization related to the initial ER visit. Data for secondary endpoints will be retrieved from the routinely collected data in the electronic health record system (e.g mortality, time to ER diagnosis, resource consumption). Additionally, interviews and focus groups with physicians will be performed to investigate diagnostic workflow changes, physician confidence and other process outcomes.
Statistical Analysis:
Statistical analysis will be based on multi-level general linear mixed modelling (GLMM) methods using appropriate post hoc techniques (e.g for subgroup analyses).
For the primary outcome (presence or no presence of a positive diagnostic quality risk score), a generalized linear mixed model (GLMM) with a binomial distribution family and exchangeable correlation structure will be performed. The GLMM takes into account a random effect for each site, resident and attending physician. Diagnosing resident and attending physicians are nested within sites. The condition (intervention and control) and the period (period 1 to 4) will be included as fixed factors under the assumption of equality of carry-over effects. Additionally, presenting chief complaint, patient's age, sex and comorbidity index will be added as covariates.
For all secondary endpoints, summary statistics appropriate to the distribution will be tabulated by treatment group. Analysis of secondary endpoints will parallel the primary analysis.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Usual Care + CDDS usage | Experimental | Patients presenting to the ER and included in the study during the ER's intervention period will be treated and diagnosed by the ER physicians as usual but with support of the CDDS. |
|
| Usual Care | No Intervention | Patients presenting to the ER and included in the study during the ER's intervention period will be treated and diagnosed by the ER physicians as usual without support of the CDDS. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Isabel Pro - The DDx generator (CDDS) | Device | Isabel Pro - the DDx generator is a software developped for health professionals with the intention to support them in broadening their differential diagnoses. After the first patient examination, the resident is asked to enter patient symptoms into Isabel Pro, which returns a list of possible diagnoses from its underlying database that matches the entered data. The diagnosing resident physicians will be asked to consult Isabel Pro at least once within the first hour after the first patient assessement. After entering patient symptoms into the software, Isabel Pro will itself return a list with possible diagnoses derived from their underlying database. It is then free to the physician to decide whether one or more of the suggested DDx should be considered for further diagnostic or treatment procedure based on clinical judgement. |
| Measure | Description | Time Frame |
|---|---|---|
| Diagnostic quality risk score | Primary endpoint is a binary score indicating a diagnostic quality risk, composed of:
| From emergency room discharge to 14 days after emergency room discharge |
| Measure | Description | Time Frame |
|---|---|---|
| Death within 14 days after Emergency Room discharge (yes/no) | Patient died within the timeframe of emergency discharge | From emergency room discharge to 14 days after emergency room discharge |
| Unexpected intensive care unit admission |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Wolf Hautz, Prof. MD | Prof. MD | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Dept. of internal and emergency medicine, Spital Münsigen | Münsingen | Canton of Bern | 3110 | Switzerland | ||
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 41673906 | Derived | Marcin T, Werthmuller N, Kolbener F, Muller M, Zwaan L, Hautz SC, Schuster A, Exadaktylos AK, Hautz WE. Identification of diagnostic discrepancies as a quality assurance measure in emergency medicine - a validation study. Scand J Trauma Resusc Emerg Med. 2026 Feb 11;34(1):56. doi: 10.1186/s13049-026-01572-x. | |
| 39890244 | Derived |
Not provided
Not provided
Researchers who wish to use IPD for a nested study need to submit a proposal to the Sponsor-Investigator and request permission. A concept sheet describing the planned analyses must be approved by the sponsor-investigator and PIs of the participating sites. Nested studies might need separate ethics permission.
Not provided
Not provided
Not provided
Not provided
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| SAP | No | Yes | No | Statistical Analysis Plan | Mar 21, 2023 | Mar 27, 2023 | SAP_000.pdf |
Not provided
| ID | Term |
|---|---|
| D004630 | Emergencies |
| ID | Term |
|---|---|
| D020969 | Disease Attributes |
| D010335 | Pathologic Processes |
| D013568 | Pathological Conditions, Signs and Symptoms |
Not provided
Not provided
Cluster-Randomized Cross-Over Trial
Not provided
Not provided
Not provided
|
Number of patients with unexpected intensive care unit admission from ward within 24 hours when hospitalized (yes/no)
| Within 24 hours from emergency room transfer to hospital ward |
| Diagnostic discrepancy | Number of patients with diagnostic discrepancy between the Emergency Room discharge diagnosis and the current diagnosis 14 days after ER discharge (yes/no) | From emergency room discharge to 14 days after emergency room discharge |
| Unscheduled medical care 72 hours, 7 days and 14 days | Number of patients with unscheduled medical care 72 hours, 7 days and 14 days after emergency room discharge | From emergency room discharge to 72 hours, 7 days and 14 days after emergency room discharge |
| Length of emergency room stay | Number of hours the patient spent in emergency room routine care | Time from emergency room admission to emergency room discharge, up to 24 hours |
| Length of hospital stay | Number of days the patient was hospitalized (if hospitalized) | Time from hospital admission to hospital discharge, up to 18 days |
| Diagnostic tests | Number of diagnostic tests performed during emergency room routine care | Time from emergency room admission to emergency room discharge, up to 24 hours |
| Resource consumption in the Emergency Department | Resource consumption (total costs for personnel and diagnostics) during emergency room | Time from emergency room admission to emergency room discharge, up to 24 hours |
| Resource consumption | Resource consumption (total costs for personnel and diagnostics) during hospitalization | Time from emergency room admission to emergency room discharge, up to 18 days |
| Discharge destination | Home / Hospital (intern) / Hospital (extern) / Nursing home / Rehabilitation / Other | Timepoint of emergency room discharge (according to clinical routine, up to 24 hours) |
| Number of differential diagnoses | Number of differential diagnoses provided by the physicians at emergency room discharge | Timepoint of emergency room discharge (according to clinical routine, up to 24 hours) |
| CDDS potential | Number of cases where the generated differential diagnosis list entails the diagnoses after 14 days | Time from emergency room admission to 14 days after emergency room discharge |
| Diagnostic error | Diagnostic error based on full chart review for a random subset | From emergency room discharge to 14 days after emergency room discharge |
| CDDS usage | Number of CDDS queries | Time from emergency room admission to emergency room discharge From 0 up to 24 hours. |
| Physician confidence calibration, advice seeking and collaboration | Assessed by qualitative methods such as observations of physicians or interviews and focus groups with physicians (no patients directly involved). | Exact timepoints to be defined, up to a maximum of 9 months. From June 2022 to March 2023 |
| Dept. of Internal and Emergency Medicine, Spital Tiefenau |
| Bern |
| 3004 |
| Switzerland |
| Dept. of Emergency Medicine, Inselspital, University Hospital Bern | Bern | 3010 | Switzerland |
| Dept. of Internal and Emergency Medicine, Buergerspital Solothurn | Solothurn | 3004 | Switzerland |
| Hautz WE, Marcin T, Hautz SC, Schauber SK, Krummrey G, Muller M, Sauter TC, Lambrigger C, Schwappach D, Nendaz M, Lindner G, Bosbach S, Griesshammer I, Schonberg P, Pluss E, Romann V, Ravioli S, Werthmuller N, Kolbener F, Exadaktylos AK, Singh H, Zwaan L. Diagnoses supported by a computerised diagnostic decision support system versus conventional diagnoses in emergency patients (DDX-BRO): a multicentre, multiple-period, double-blind, cluster-randomised, crossover superiority trial. Lancet Digit Health. 2025 Feb;7(2):e136-e144. doi: 10.1016/S2589-7500(24)00250-4. |
| 36990482 | Derived | Marcin T, Hautz SC, Singh H, Zwaan L, Schwappach D, Krummrey G, Schauber SK, Nendaz M, Exadaktylos AK, Muller M, Lambrigger C, Sauter TC, Lindner G, Bosbach S, Griesshammer I, Hautz WE. Effects of a computerised diagnostic decision support tool on diagnostic quality in emergency departments: study protocol of the DDx-BRO multicentre cluster randomised cross-over trial. BMJ Open. 2023 Mar 29;13(3):e072649. doi: 10.1136/bmjopen-2023-072649. |