Not provided
Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| EUPAS1000000910 | Other Identifier | European Medicines Agency |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
This study aims to determine if an artificial intelligence (AI) medical device can help healthcare professionals more accurately diagnose rare and complex skin conditions. Dermatological issues are common in primary care, but there is often a gap in diagnostic accuracy between general practitioners and specialists, which can lead to treatment delays for serious conditions like Generalized Pustular Psoriasis (GPP) and Hidradenitis Suppurativa (HS).
The researchers hypothesized that the AI device would enhance the diagnostic accuracy of healthcare professionals for GPP and other dermatological conditions. To test this, the study followed a prospective observational design involving 15 practitioners, including both general practitioners and dermatologists.
During the study, participants were asked to evaluate 100 clinical images. For each case, they first provided a diagnosis based on the image and patient history alone. They were then shown the AI's analysis-which included the top five suggested diagnoses and confidence levels-and asked if they would like to adjust their initial assessment.
The primary question the study sought to answer was whether the information provided by the AI device could significantly increase the number of correct diagnoses made by these professionals, particularly for rare diseases that are often difficult to identify in a standard clinical setting
This investigation is structured as a multi-reader multi-case (MRMC) study. A cohort of 15 healthcare professionals, including 11 primary care physicians and 4 dermatologists, acted as the "readers". These readers evaluated a "case" set of 100 clinical images to assess diagnostic performance both with and without the assistance of the AI device.
Study Design and Technical Methodology The research was conducted as a prospective observational and cross-sectional study. It utilized a "physician-as-their-own-control" design to measure the impact of Artificial Intelligence (AI) on diagnostic performance.
Quality Assurance and Data Management
To ensure the scientific integrity and reliability of the findings, several quality control measures were implemented:
Statistical Analysis Plan
The primary goal of the analysis was to quantify Top-1 accuracy, sensitivity, and specificity for both general practitioners and dermatologists.
Ethical and Confidentiality Framework The study adhered to UNE-EN ISO 14155:2021, the Declaration of Helsinki, and the General Data Protection Regulation (GDPR).
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Healthcare Professionals (Primary Care Physicians and Dermatologists) | This group is composed of board-certified healthcare professionals (HCPs) who serve as the "readers" in this multi-reader multi-case (MRMC) study. The cohort is uniquely characterized by its internal comparison: each participant acts as their own control.
|
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| AI-based medical device for aided diagnosis in Dermatology | Device | The intervention consists of a Computer-Aided Diagnosis (CAD) software-only medical device that utilizes computer vision algorithms to analyze digital images of skin structures. During the study, healthcare professionals use the tool as a diagnostic support system to assist in the evaluation of complex dermatological conditions. |
| Measure | Description | Time Frame |
|---|---|---|
| Diagnostic Accuracy for Generalized Pustular Psoriasis (GPP) with and without Artificial Intelligence Support. | This measure evaluates the Top-1 diagnostic accuracy of healthcare professionals (HCPs) when identifying GPP. Accuracy is calculated by comparing the clinician's diagnosis (both with and without the device's top 5 suggestions) against the confirmed reference diagnosis for each of the clinical cases. | Day 1 |
| Diagnostic Accuracy for different skin conditions with and without Artificial Intelligence Support | This measure evaluates the Top-1 diagnostic accuracy of healthcare professionals (HCPs) when identifying the corresponding skin condition. Accuracy is calculated by comparing the clinician's diagnosis (both with and without the device's top 5 suggestions) against the confirmed reference diagnosis for each of the clinical cases. | Day 1 |
| Measure | Description | Time Frame |
|---|---|---|
| Diagnostic Accuracy for Rare Dermatological Conditions with and without Artificial Intelligence Support. | This measure evaluates the Top-1 diagnostic accuracy of healthcare professionals (HCPs) when identifying rare dermatological conditions. Accuracy is calculated by comparing the clinician's diagnosis (both with and without the device's top 5 suggestions) against the confirmed reference diagnosis for each of the clinical cases. |
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
The study population consists of board-certified healthcare professionals recruited from the clinical fields of general medicine and dermatology. The participant group includes:
Participants were recruited to engage in a remote, web-based evaluation environment rather than being selected from a single physical hospital or town. The clinical images evaluated as part of the study "cases" were sourced from international public dermatology atlases and existing research databases from the sponsor, representing a diverse global patient population.
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Antonio Martorell, PhD | Hospital Universitari de Manises | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| AI Labs Group S.L. | Bilbao | Basque Country | Spain |
Not provided
| Label | URL |
|---|---|
| Study website on RWD catalogues of EMA | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| Day 1 |
| ID | Term |
|---|---|
| D011565 | Psoriasis |
| D056150 | Acute Generalized Exanthematous Pustulosis |
| D000152 | Acne Vulgaris |
| D000069316 | Acne Conglobata |
| D017492 | Keratosis, Seborrheic |
| D012628 | Dermatitis, Seborrheic |
| D010392 | Pemphigus |
| D007169 | Impetigo |
| D017497 | Hidradenitis Suppurativa |
| D014005 | Tinea |
| D035583 | Rare Diseases |
| D012871 | Skin Diseases |
| ID | Term |
|---|---|
| D017444 | Skin Diseases, Papulosquamous |
| D017437 | Skin and Connective Tissue Diseases |
| D003875 | Drug Eruptions |
| D003872 | Dermatitis |
| D006968 | Hypersensitivity, Delayed |
| D006967 | Hypersensitivity |
| D007154 | Immune System Diseases |
| D004342 | Drug Hypersensitivity |
| D064420 | Drug-Related Side Effects and Adverse Reactions |
| D064419 | Chemically-Induced Disorders |
| D017486 | Acneiform Eruptions |
| D012625 | Sebaceous Gland Diseases |
| D007642 | Keratosis |
| D017443 | Skin Diseases, Eczematous |
| D012872 | Skin Diseases, Vesiculobullous |
| D001327 | Autoimmune Diseases |
| D013207 | Staphylococcal Skin Infections |
| D013203 | Staphylococcal Infections |
| D016908 | Gram-Positive Bacterial Infections |
| D001424 | Bacterial Infections |
| D001423 | Bacterial Infections and Mycoses |
| D007239 | Infections |
| D013290 | Streptococcal Infections |
| D017192 | Skin Diseases, Bacterial |
| D012874 | Skin Diseases, Infectious |
| D013492 | Suppuration |
| D016575 | Hidradenitis |
| D013543 | Sweat Gland Diseases |
| D003881 | Dermatomycoses |
| D009181 | Mycoses |
| D020969 | Disease Attributes |
| D010335 | Pathologic Processes |
| D013568 | Pathological Conditions, Signs and Symptoms |
Not provided
Not provided