Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| Ontario Brain Institute | OTHER |
Not provided
Not provided
Not provided
Not provided
This community study is a mixed effectiveness-implementation trial of holly™ for delivering information about arousal levels in paediatric populations. This study will evaluate the community implementation of holly™ and gather preliminary data on its impact on quality of life. holly™ is not meant to drive clinical decisions (diagnosis, monitoring, or intervention); instead, it is an informational tool to provide caregivers and children (where appropriate) with visualizations of arousal levels throughout the day and support children's emotional wellbeing.
For this study, the goal is to have families try out holly™ at home. The main objectives are:
Exploratory Objective 1: To examine change (pre/post using holly™) in quality of life and mechanisms that may contribute to changes in quality of life (e.g., irritability, sleep, emotion regulation, anxiety, co-occurring symptoms).
Exploratory Objective 2: To gather preliminary data to explore associations between holly™ measurements and phenotypic and neurobiological characteristics to inform future trials and use cases.
holly™ is a patented and clinically validated algorithm for detecting emotional levels. Children will be given a study smartwatch with the holly™ application on it and asked to wear it for three weeks. Parents will get alerts and information about their child's emotional level on a study smartphone. Parents can use this information to help their child manage feelings as they happen. Parents can also use holly™ to review their child's emotion level history from the past day or days of use. Before and after using holly™, parents and children will be asked to fill out some questionnaires online. When families are finished with their three-week trial, they will be given a pre-paid shipping label to return the study devices to us.
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| holly device trial | Experimental | Families try out holly™ at home, where the children will be given a study smartwatch with the holly™ app on it and asked to wear it for three weeks. Parents will get alerts and information about their child's emotional level on a study smartphone. Parents can use this information to help their child manage feelings as they happen. Parents can also use holly™ to review their child's emotion level history from the past day or days of use. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| holly device trial | Device | Children will be given a study smartwatch with the holly™ app on it and asked to wear it for three weeks. Parents will get alerts and information about their child's emotional level on a study smartphone. Parents can use this information to help their child manage feelings as they happen. Parents can also use holly™ to review their child's emotion level history from the past day or days of use. Using holly, caregivers and children (where appropriate) will be provide with visualizations of arousal levels throughout the day and can be used to support children's emotional wellbeing. |
| Measure | Description | Time Frame |
|---|---|---|
| Usability - System Usability Scale (SUS) | To evaluate the usability of holly™ in community settings, the investigators will employ a summative evaluation approach through questionnaires. The primary measure will be the System Usability Scale (SUS), a 10-item parent questionnaire generating a score from 0-100 where higher is better. The criteria for success is an average score of 74 or higher on the SUS across the participants as per normative data for the SUS. Caregivers complete the measure following device usage. | Post-intervention (up to 1 year after completion of the device trial period) |
| Usability - Post-Study System Usability Questionnaire (PSSUQ) | The Post-Study System Usability Questionnaire (PSSUQ) is a 16-item questionnaire that probes overall usability, system usefulness, information quality, and interface quality with acceptable estimated reliabilities of 0.83 to 0.96. Caregivers complete the measure following device usage. PSSUQ follows a 7-point Likert Scale (+ NA option). The overall result is calculated by averaging the scores from the 7 points of the scale. It has three sub-scales: system usefulness, information quality, and interface quality. The overall score can range from 1-7. The lower the score, the better the performance and satisfaction. | Post-intervention (up to 1 year after completion of the device trial period) |
| Usability - Custom Usability Questionnaire | Children will complete a custom usability questionnaire assessing likeability and comfort of the smartwatch. The measure uses a visual Likert-type scale consisting of 3 items scored from 1 (lowest) to 3 (highest), with higher scores indicating better usability outcomes. | Post-intervention (up to 1 year after completion of the device trial period) |
| Acceptability and Adoption - Custom Parent Questionnaire | The Custom Parent Questionnaire will measure users' intention to use holly™ after completion of the study, and extent to which holly™ was integrated in the users' lives, measured as the number of settings where holly™ is used during the trial (home, school, community). Caregivers complete the questionnaire following device usage. |
Not provided
| Measure | Description | Time Frame |
|---|---|---|
| Relevance to Clinical Outcomes (Effectiveness) - Aberrant Behaviour Checklist (ABC-2) | This measure will assess changes in irritability from pre- to post-device usage using the Aberrant Behaviour Checklist (ABC-2). Participants complete the ABC-2 at enrollment (baseline) and again immediately after completing the device trial period. The ABC-2 is a validated caregiver-reported measure of problem behaviours in individuals with neurodevelopmental conditions. It uses a 4-point Likert scale to score aberrant behaviors, where 0 is "not a problem" and 3 is "severe problem". Scores are summed for each of the five subscales: irritability, social withdrawal, stereotypic behavior, hyperactivity/noncompliance, and inappropriate speech. The possible total is between 0-174 and a higher score indicates worse outcome. |
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Azadeh Kushki, PhD. | Hollanf Bloorview Kids Rehabilitation Hospital | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Holland Bloorview Kids Rehabilitation Hospital | Toronto | Ontario | M4G1R8 | Canada |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| ID | Term |
|---|---|
| D000080103 | Emotional Regulation |
| D001008 | Anxiety Disorders |
| ID | Term |
|---|---|
| D000068356 | Self-Control |
| D012919 | Social Behavior |
| D001519 | Behavior |
| D001523 | Mental Disorders |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| Post-intervention (up to 1 year after completion of the device trial period) |
| Acceptability and Adoption - Client Satisfaction Questionnaire (CSQ-8) | Acceptance, operationalized as the users' degree of satisfaction with holly™ and quantified using the Client Satisfaction Questionnaire (CSQ-8), an 8-item measure with high coefficients of internal consistency reliability (Cronbach's alpha of 0.80 or greater) and adequate validity. The instrument will be modified to include a description of the holly™ "service". Total scores range from 8 to 32, with the higher number indicating greater satisfaction. Caregivers complete the measure following device usage. | Post-intervention (up to 1 year after completion of the device trial period) |
| Acceptability and Adoption - Adapted version of the Barriers to Treatment Participation Scale | To measure appropriateness, defined as the perceived fit, relevance, and compatibility of holly™ within the users' context, the investigators will be using an adapted version of the Barriers to Treatment Participation Scale, which demonstrates good psychometric properties regarding reliability and structure (internal consistency Cronbach's alpha of 0.85 or greater) and is reasonably valid. Caregivers complete this 32-item questionnaire rating of how much they agree with statements about their expectancies of barriers to treatment participation for their child, using a 5-point Likert scale (1=totally disagree, 5= totally agree). The total score ranges from 32 - 160, with higher score indicating greater barriers (i.e., worse outcome). | Post-intervention (up to 1 year after completion of the device trial period) |
| Acceptability and Adoption - Usage logs | The investigators will measure the number of hours holly™ is worn during the three-week trial, and rate of change in usage from week 1 to week 3. This information will be recorded by hollyTM. | During intervention (3-week device trial). |
| Baseline and post-intervention (up to 1 year after completion of the device trial period). |
| Relevance to Clinical Outcomes (Effectiveness) - Children's Sleep Habit Questionnaire (CSHQ) | This measure will assess changes in sleep habits from pre- to post-device usage using the Children's Sleep Habit Questionnaire (CSHQ). Caregivers complete the CSHQ at enrollment (baseline) and again immediately after the device trial period. The CSHQ is a validated caregiver-reported measure of sleep behaviors in children, capturing domains such as bedtime resistance, sleep duration, night wakings, and daytime sleepiness. The total possible score ranges from 33-99, with higher score indicating worse outcome. For participants who previously completed the CSHQ as part of the POND study at Holland Bloorview, existing data will be retrieved with participant consent (signed Release of Information) if collected within the last two years; otherwise, the measure will be repeated. | Baseline and post-intervention (up to 1 year after completion of the device trial period). For POND study participants, baseline CSHQ collected at enrollment, or existing POND CSHQ collected within the last two years. |
| Relevance to Clinical Outcomes (Effectiveness) - Emotion Dysregulation Inventory (EDI) | This measure will assess changes in emotion regulation abilities from pre- to post-device usage using the Emotion Dysregulation Inventory (EDI). Caregivers complete the EDI at enrollment (baseline) and again immediately after the device trial period. The EDI is a validated caregiver-reported measure designed to capture reactivity and dysregulation in children with neurodevelopmental conditions. The EDI uses a 5-point scale for items of problem severity over the past 7 days, where 0 = not at all a problem and 4 = very severe problem. It is scored on two subscales: Reactivity (intense emotional reactions) and Dysphoria (sadness, low motivation). Raw scores from the 24-item Reactivity scale (min = 0 and max = 96) or 6-item Dysphoria scale (min = 0 and max = 24) can be converted to t-scores for comparison against different population norms, such as a general youth sample or a clinical sample for individuals with autism. Higher scores indicate worse outcomes. | Baseline and post-intervention (up to 1 year after completion of the device trial period). |
| Relevance to Clinical Outcomes (Effectiveness) - Pediatric Quality of Life Inventory (PedsQL) | The Pediatric Quality of Life Inventory (PedsQL) will be used to evaluate changes in health-related quality of life from baseline to post-device usage. Caregivers will complete the age-appropriate version of the PedsQL (Young Child 5-7 years, Child 8-12 years, or Teen 13+ years) at enrollment and again immediately after the device trial period. Each PedsQL form uses a 5-point response scale (0-4) that is converted to a 0-100 scale, with higher scores indicating better outcomes (i.e., better health-related quality of life). Subscale and total scores will be calculated according to standardized PedsQL scoring procedures. | Baseline and post-intervention (up to 1 year after completion of the device trial period). |
| Relevance to Clinical Outcomes (Effectiveness) - Parent Rated Anxiety Scale in ASD (PRAS-ASD) | This measure will assess changes in anxiety levels from pre- to post-device usage using the Parent Rated Anxiety Scale in ASD (PRAS-ASD). Caregivers complete the PRAS-ASD at enrollment (baseline) and again immediately after the device trial period. The PRAS-ASD is a validated caregiver-reported measure designed to capture anxiety symptoms specifically in autistic children. It is a 25-item, parent-report questionnaire where item is rated on a 0-3 scale, with a total raw score ranging from 0 to 75. Higher score indicates worse outcome. | Baseline, and post-intervention (up to 1 year after completion of the device trial period). |
| Exploration of associations with phenotypic and neuroimaging profiles - Neuroimaging data | The investigators will examine associations between phenotypic measures and neuroimaging profiles using existing structural MRI, diffusion tensor imaging, and resting-state data from the Province of Ontario Neurodevelopmental Disorders (POND) Network. With participant consent (signed Release of Information), neuroimaging data previously collected by the POND study will be retrieved when available. | At study completion, using previously collected POND neuroimaging data when available. |
| Arousal Variables: Mean Heart Rate During Device Usage | This measure will summarize average heart rate recorded by the holly device during usage period. Heart rate data will be used to examine physiological arousal patterns over the trial period, along with other arousal variables, and to characterize changes across the trial period and to explore associations with phenotypic and neuroimaging profiles. | During the intervention (3-week device trial) |
| Arousal VariablesHeart Rate Variability During Device Usage | This measure will summarize heart rate variability (HRV) obtained from the holly device during usage periods. HRV will be analyzed as an indicator of autonomic arousal, along with other arousal variables, and used to characterize changes across the trial period and to explore associations with phenotypic and neuroimaging profiles. | During intervention (3-week device trial) |
| Arousal Variable: Number of Arousal Events During Device Usage | This measure will record the count of physiological arousal events detected by the holly device during usage. Event counts will be evaluated over the trial period along with other arousal variables to characterize changes across the trial period and to explore associations with phenotypic and neuroimaging profiles. | During intervention (3-week device trial) |
| Arousal Variables: Mean Acceleration During Device Usage | This measure will summarize the average acceleration recorded by the holly device to summarize physiological arousal during device usage. Mean acceleration values, along with other arousal variables, will be used to characterize changes across the trial period and to explore associations with phenotypic and neuroimaging profiles. | During intervention (3-week device trial) |