Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| DemensAI ApS (private tech partner, Denmark) | UNKNOWN |
Not provided
Not provided
Not provided
Not provided
The goal of this observational study is to learn if an artificial intelligence (AI)-based speech analysis tool can identify which patients with memory problems need specialist evaluation at a memory clinic. The main questions it aims to answer are:
Can the AI model accurately distinguish between patients who need referral to a memory clinic (those with dementia or Mild Cognitive Impairment) and patients who don't (those with normal cognition or memory problems from other causes like depression)? Which speech patterns and cognitive test features are most useful for making this distinction?
Researchers will compare speech recordings and cognitive test results from patients diagnosed with dementia or MCI to those from patients with normal cognition or non-neurodegenerative cognitive impairment to see if the AI model can reliably predict who needs specialist dementia care.
Participants will:
Complete standard cognitive tests at the memory clinic Perform structured speech tasks while being audio-recorded Receive their usual clinical evaluation and diagnosis from memory clinic specialists
The results of this study will help develop a tool that can assist doctors in making faster, more accurate decisions about which patients need specialist dementia evaluation, potentially leading to earlier diagnosis and better patient outcomes.
Background Dementia is a growing public health challenge, and early and accurate diagnosis is essential for effective care and potential future disease-modifying treatments. Current diagnostic pathways are resource-intensive and associated with long waiting times. Speech reflects cognitive functioning, and recent international studies have shown that machine learning models can detect dementia-related patterns in speech recordings with promising accuracy. This study aims to develop a speech-based deep learning model in a Danish setting, providing a non-invasive and scalable screening tool for use in primary care.
Study Design and Sampling Methods
This is an observational, cross-sectional study. Participants are recruited using two different sampling strategies corresponding to two artificial intelligence (AI) model development tracks:
Track A (Model A) - Retrospective case-control sampling:
This track addresses a focused diagnostic task: identification of Mild Cognitive Impairment (MCI). Participants are patients with a recent diagnosis from the memory clinic at Region Zealand University Hospital (ZUH). Sampling uses convenience sampling prioritizing patients who live close to the hospital, as data collection occurs during home visits. Patients with more recent diagnoses are prioritized to minimize the risk that participants have progressed to a new disease stage since diagnosis (e.g., from MCI to dementia).
Track B (Model B) - Prospective consecutive sampling:
This track uses prospective inclusion of newly referred patients to the memory clinic without pre-selection by diagnosis, reflecting a real-world clinical screening population. All eligible, consenting patients are included consecutively at their first clinic visit, before final diagnosis is established.
Model Development Following Best Practice Guidelines The study follows TRIPOD-AI (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis - Artificial Intelligence) and PROBAST-AI (Prediction model Risk Of Bias ASsessment Tool - Artificial Intelligence) guidelines for developing and validating clinical prediction models.
Key methodological features include:
Transparent model development: All preprocessing steps, feature extraction methods, model architectures, and hyperparameters will be documented Robust validation strategy: Data will be split into training, validation, and hold-out test sets for in-depth internal validation.
Minimizing bias: Participant selection, predictor measurement, outcome determination, and statistical analysis are designed to minimize bias according to PROBAST-AI domains Clinically relevant performance metrics: Sensitivity, specificity, area under the receiver operating characteristic curve (AUC-ROC), positive and negative predictive values, and calibration Interpretability: Feature importance analysis to understand which speech characteristics contribute to predictions
Data Collection Speech data is collected through structured tasks including picture description, verbal fluency tests, story recall, and spontaneous speech. Audio is recorded using standardized equipment with quality control checks. Clinical diagnoses are established by experienced clinicians at the memory clinic following international diagnostic criteria.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Cognitively Healthy Control Participants for Model A | We seek to enroll 40 age-matched cognitively healthy control participants for the training of model A. |
| |
| Patient Participants for Model A | We seek to retrospectively enroll patients from the ZUH memory clinic with a diagnosis of either Alzheimer's Disease (AD, n=50) or MCI (n=50), made within 6 months prior to enrollment. These participants will be used for the training of model A. |
| |
| Patient Participants for Model B | We will prospectively recruit newly referred patients for the memory clinic at ZUH. Enrollment happens at first patient visit. At this time, diagnosis is not yet known, but assumed present. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Mini-mental State Examination | Diagnostic Test | Participants will be recorded during the test in order til allow the AI to learn and analyze speech patterns. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Model A: Primary measure is the AUC-ROC of the model in distinguishing between MCI and AD as well as between MCI and cognitively healthy control participants. | We will measure the AUR-ROC of AI predictions compared to clinical consensus diagnosis. Metrics will be presented including uncertainty estimates. Model performance will be measured on an independent test-set consisting of patients from the model B training population. | At baseline (speech recording) |
| Measure | Description | Time Frame |
|---|---|---|
| Accuracy for dementia vs. depression | Measured by sensitivity, specificity, AUR-ROC of AI predictions compared to clinical consensus diagnosis, using baseline speech recordings from participants. Model performance will be measured after database lock at study completion. | At baseline (speech recording) |
| Sub-classification of Mild Cognitive Impairment (MCI) into progressive vs. non-progressive |
| Measure | Description | Time Frame |
|---|---|---|
| Contribution of individual speech tasks to AI model performance | Contribution of individual speech tasks will be evaluated by comparing model performance (e.g. accuracy, sensitivity, specificity, AUC-ROC) when trained and tested on subsets of speech tasks (memory tests, story recall, picture description). This will identify which tasks provide the strongest diagnostic signal. | At baseline (speech recording) |
Inclusion Criteria:
Model A (patient participants)
Model A (cognitively healthy controls)
Model B:
Exclusion Criteria:
Model A:
Patients:
Cognitively healthy controls:
Model B:
Not provided
Not provided
Not provided
Participants are recruited from patients who are followed at- or referred to the memory clinic at Zealand University Hospital. Age and gender matched healthy controls for model A are recruited from the participants' relatives.
| Name | Role | Phone | Extension | |
|---|---|---|---|---|
| Sofie J Vængebjerg, MD | Contact | +4530294621 | sova@regsj.dk | |
| Peter Høgh, MD, PhD, Assoc Prof | Contact | +45 22526698 | phh@regionsjaelland.dk |
| Name | Affiliation | Role |
|---|---|---|
| Peter Høgh, MD, PhD, Assoc Prof | Zealand University Hospital | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Zealand University Hospital | Roskilde | Region Sjælland | 4000 | Denmark |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| Background | Dargaud L, Partal A, Birn A, & Detlefsen S. N. (2023). Developing a Spontaneous Speech-based Artificial Intelligence for Alzheimer's Disease Detection. Transatlantic Telehealth Research Network (TTRN) International Scientific Conference 2023, Journal of the International Society for Telemedicine and eHealth. | ||
| 36791255 | Background | Lanzi AM, Saylor AK, Fromm D, Liu H, MacWhinney B, Cohen ML. DementiaBank: Theoretical Rationale, Protocol, and Illustrative Analyses. Am J Speech Lang Pathol. 2023 Mar 9;32(2):426-438. doi: 10.1044/2022_AJSLP-22-00281. Epub 2023 Feb 15. | |
| Background | Li J, Song K, Zheng B, Li D, Wu X, Meng H. Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detection. arXiv preprint. 2023. | ||
| Background | Luz S, Haider F, de la Fuente Garcia S, Fromm D, MacWhinney B. Detecting cognitive decline using speech only: The ADReSSo challenge. arXiv preprint 2021. |
| Label | URL |
|---|---|
| Website of collaborator, DemensAI SPs (responsible party for training and testing the AI model) | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| Addenbrooke's Cognitive Examination | Diagnostic Test | Participants will be recorded during the test in order til allow the AI to learn and analyze speech patterns. |
|
|
| Speech Task - Picture Description | Other | Participants will be asked to describe the Cookie Theft Picture from the Boston Diagnostic Aphasia Examination. The task will take 2 minutes. Participants will be recorded during the speech task in order to allow the AI to learn and analyze the speech patterns. |
|
| Speech Task - Picture Recall | Other | Participants will be asked to recall the picture shown in the previous speech task "Picture Narrative". This task will take 2 minutes. Participants will be recorded during the test in order til allow the AI to learn and analyze speech patterns. |
|
| MRI | Diagnostic Test | For healthy controls an MRI will be conducted to provide comparable imaging and as part of screening to ensure they do not meet exclusion criteria (neuroradiological findings that could affect cognitive functions). For patient participants, imaging will be performed as part of the standard diagnostic battery and results will be obtained from the electronic journal. |
|
| blood sampling | Diagnostic Test | Healthy control participants will undergo a standard blood test panel commonly used in dementia diagnostics. The panel includes complete blood counts, inflammatory markers, kidney- and liver function markers, thyroid-stimulating hormone (TSH), vitamine B12 and folate. These tests are performed to exclude underlying medical conditions that could mimic cognitive impairment. For patient participants, blood sampling will be performed as part of the standard diagnostic battery and results will be obtained from the electronic journal. |
|
| Depression screening | Diagnostic Test | Performed on healthy controls to rule out depression using either the geriatric depression scale (GDS) for patients > 65 year of age or the Major Depression Index (MDI) for patiens <65 year of age. For patient participants, depression screening will be performed as part of the standard diagnostic battery and results will be obtained from the electronic journal. |
|
| Somatic- and neurological examination | Other | Healthy controls will undergo a standard somatic and neurological examination to exclude conditions that may affect cognition. This includes basic neurological assessment and clinical evaluation of general health status. For patient participants, a somatic and neurological examination will be performed as part of the standard diagnostic battery and results will be obtained from the electronic journal |
|
| Speech Task - Picture Narrative | Other | The participant is asked to tell a brief story based on a culturally neutral picture. This task will take approximately 2 minutes. Participants will be recorded during the speech task in order to allow the AI to learn and analyze the speech patterns |
|
Measured by sensitivity, specificity, AUR-ROC of AI predictions compared to clinical consensus diagnosis, using baseline speech recordings from participants. Model performance will be measured after database lock at study completion. Progression is defined as new dementia diagnosis during study period. |
| At baseline (speech recording) and up to 12 months after enrollment (to determine progression) |
| Classification of dementia subtypes (AD, VaD, LBD, FTD) | Measured by sensitivity, specificity, AUR-ROC of AI predictions compared to clinical consensus diagnosis, using baseline speech recordings from participants. Model performance will be measured after database lock at study completion. | At baseline (speech recording) |
| Comparison with established biomarkers | Differences in diagnostic accuracy between AI predictions and state-of-the-art biomarkers for dementia diagnosis | At baseline, or at time of biomarker testing if performed after baseline |
| Feature importance analysis | Feature importance will be evaluated using interpretability analyses (e.g. permutation importance, SHAP values, and/or ablation of feature groups) to quantify the contribution of acoustic and linguistic features to the model's predictions. | At baseline (speech recording) |
| Number of tasks required for optimal accuracy | Evaluation of whether a reduced set of speech tasks provide accuracy comparable to the full test battery. | At baseline (speech recording) |
| 38957540 | Background | Luz S, Haider F, Fromm D, Lazarou I, Kompatsiaris I, Macwhinney B. An Overview of the ADReSS-M Signal Processing Grand Challenge on Multilingual Alzheimer's Dementia Recognition Through Spontaneous Speech. IEEE Open J Signal Process. 2024;5:738-749. doi: 10.1109/ojsp.2024.3378595. Epub 2024 Mar 18. |
| Background | Bex T. Comprehensive Guide to Multiclass Classification With Sklearn. Towards Data Science. 2021. |
| 8487525 | Background | Nicholas LE, Brookshire RH. A system for quantifying the informativeness and efficiency of the connected speech of adults with aphasia. J Speech Hear Res. 1993 Apr;36(2):338-50. doi: 10.1044/jshr.3602.338. |
| 8870764 | Background | Buderer NM. Statistical methodology: I. Incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996 Sep;3(9):895-900. doi: 10.1111/j.1553-2712.1996.tb03538.x. |
| 35493062 | Background | Chen J, Ye J, Tang F, Zhou J. Automatic Detection of Alzheimer's Disease Using Spontaneous Speech Only. Interspeech. 2021 Aug-Sep;2021:3830-3834. doi: 10.21437/interspeech.2021-2002. |
| 36812634 | Background | Agbavor F, Liang H. Predicting dementia from spontaneous speech using large language models. PLOS Digit Health. 2022 Dec 22;1(12):e0000168. doi: 10.1371/journal.pdig.0000168. eCollection 2022 Dec. |
| 33185605 | Background | de la Fuente Garcia S, Ritchie CW, Luz S. Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer's Disease: A Systematic Review. J Alzheimers Dis. 2020;78(4):1547-1574. doi: 10.3233/JAD-200888. |
| ID | Term |
|---|---|
| D003704 | Dementia |
| D004194 | Disease |
| D000544 | Alzheimer Disease |
| D015140 | Dementia, Vascular |
| D020961 | Lewy Body Disease |
| D057180 | Frontotemporal Dementia |
| D060825 | Cognitive Dysfunction |
| ID | Term |
|---|---|
| D001927 | Brain Diseases |
| D002493 | Central Nervous System Diseases |
| D009422 | Nervous System Diseases |
| D019965 | Neurocognitive Disorders |
| D001523 | Mental Disorders |
| D010335 | Pathologic Processes |
| D013568 | Pathological Conditions, Signs and Symptoms |
| D024801 | Tauopathies |
| D019636 | Neurodegenerative Diseases |
| D002561 | Cerebrovascular Disorders |
| D002537 | Intracranial Arteriosclerosis |
| D020765 | Intracranial Arterial Diseases |
| D056784 | Leukoencephalopathies |
| D001161 | Arteriosclerosis |
| D001157 | Arterial Occlusive Diseases |
| D014652 | Vascular Diseases |
| D002318 | Cardiovascular Diseases |
| D020734 | Parkinsonian Disorders |
| D001480 | Basal Ganglia Diseases |
| D009069 | Movement Disorders |
| D000080874 | Synucleinopathies |
| D057174 | Frontotemporal Lobar Degeneration |
| D057177 | TDP-43 Proteinopathies |
| D057165 | Proteostasis Deficiencies |
| D008659 | Metabolic Diseases |
| D009750 | Nutritional and Metabolic Diseases |
| D003072 | Cognition Disorders |
Not provided
Not provided
| ID | Term |
|---|---|
| D001800 | Blood Specimen Collection |
| D004171 | Diploidy |
| ID | Term |
|---|---|
| D013048 | Specimen Handling |
| D019411 | Clinical Laboratory Techniques |
| D019937 | Diagnostic Techniques and Procedures |
| D003933 | Diagnosis |
| D011677 | Punctures |
| D013514 | Surgical Procedures, Operative |
| D008919 | Investigative Techniques |
| D011003 | Ploidies |
| D055614 | Genetic Phenomena |
Not provided
Not provided