| Primary | Depression, Anxiety, and Stress Scale (DASS) | Higher scores on subscales from this 23-item measure reflected higher depression, anxiety, stress, and suicidality. Other researchers added two suicidality items to the original 21-item measure with permission from the original authors. Each subscale score is computed by summing the subscale items, then multiplying by 2. Total possible scores for the depression, anxiety, and stress subscales range from 0-42. We categorized DASS depression, anxiety, and stress scores into severity levels coded as 0, 1, and 2: Normal (0 through 9), Mild/moderate (10 through 20), and Severe/extremely severe (21 through 42) (Psychology Foundation of Australia, 2018). The DASS suicide subscale ranged from 0-12 and not recategorized. | | Posted | | Mean | Standard Deviation | score on a scale | | baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| | | Title | Denominators | Categories |
|---|
| Baseline (depression subscale) | | | Title | Measurements |
|---|
| - OG0001.55± .68
- OG0011.68± .56
|
| | Week 4 (depression subscale) | | |
| | Group IDs | Group Description | Statistical Method | Statistical Comment | P-Value | P-Value Comment | Parameter Type | Parameter Value | Dispersion Type | Dispersion Value | Confidence Interval Sides | Confidence Interval % | CI Lower Limit | CI Upper Limit | CI Lower Limit Comment | CI Upper Limit Comment | Estimate Comment | Tested Non-Inferiority | Non-Inferiority Type | Non-Inferiority Comment | Other Analysis Description |
|---|
| We used the Generalized Linear Model to examine the between-condition change over time on study outcomes. We computed the design effects due to this nested design to determine the extent to which the intraclass correlation due to clustering and size of the cluster affected the analyses. Design effects ranged up to 1.8. Because all were under 2.0, we did not adjust analyses to account for clustering effects. | Chi-squared | GEE Type III chi squared distribution with 3 degrees of freedom was used to examine between-condition change over time from baseline. | .734 | Analyses were performed on each subscale individually. This is the p-value for the Depression subscale. | | | | | | | | | | | | |
|
| Primary | Beck Depression Inventory (BDI-II) | Higher scores on this 21-item reflect greater depressive symptoms in the past two weeks. All items are summed to a total score (possible range 0-63). We categorized BDI scores into severity levels coded as 0, 1, and 2: Minimal (raw scores 0 through 13), Mild/moderate (14 through 28), and Severe (29 through 63). | | Posted | | Mean | Standard Deviation | score on a scale | | baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Patient Health Questionnaire-9 (PHQ-9) | Higher scores on this ten-item measure reflects more severe depression. The total score (possible range 0-27) is created by summing the first nine items. We categorized PHQ severity levels coded as 0, 1, and 2 based on authors' research as minimal (0 through 4), mild/moderate (5 through 14), and moderately severe/severe (15 through 27). The recategorized scores are reported here. | | Posted | | Mean | Standard Deviation | score on a scale | | baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Behavioral Activation for Depression Scale Short Form (BADS-SF) | The Behavioral Activation for depression Scale Short Form has 9 questions each having a scale from 0 (Not at All) to 6 (Completely) with a total range of 0-54. Higher scores on this nine-item scale reflect lower engagement in avoidance and higher engagement in activation behaviors over the course of BA for depression. | | Posted | | Mean | Standard Deviation | score on a scale | | baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Mental Health Services Satisfaction Survey (MHSSS) | We created a ten-item measure in which higher scores reflected greater satisfaction with services they received. The measure had 10 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 10-50. Higher scores indicated a better outcome. | | Posted | | Mean | Standard Deviation | score on a scale | | After first study therapy session, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Working Alliance Inventory (WAI) | We modified this measure to include items from the BHS from Group Health. The resulting 12-item scale measures the therapeutic relationship with higher scores indicating stronger alliance. With 12 questions and each having a scale of 1(Never) to 7(Always) the total range was 12-84. | | Posted | | Mean | Standard Deviation | score on a scale | | 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Therapy Task Checklist (TTC) - Patient Version | We developed the TTC. The Therapy Task Checklist-Patient Version with 25 questions and each having a scale of 0 (Never/Very Rarely) to 7 (All of the Time) has a total range of 0-100. Higher scores reflected more frequent use of evidence-based therapy tasks, positive outcomes. | | Posted | | Mean | Standard Deviation | score on a scale | | 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Modified Practice Attitudes Scale (MPAS) | The Modified Practice Attitudes Scale with eight questions, each having a scale of 0 (Not at all) to 4(To a very great extent), has a total range of 0-32. Higher scores on this eight-item scale reflect more positive attitudes towards evidence-based practices. | | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Perceptions of Computer-Assisted Therapy Questionnaire (PCAT) | The Perceptions of Computer-Assisted Therapy Questionnaire has 34 questions each having a scale of 1(Strongly Disagree) to 7 Strongly Agree). Thus, the total range was 34-238. Higher scores on this 34-item scale indicate stronger agreement with the benefits of computer-assisted therapy, or a better outcome. | | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | ASA-Monitoring and Feedback Version (ASA-MF) | The ASA-Monitoring and Feedback Version (ASA-MF) measure has 18 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 18-90. Higher scores on this 18-item scale reflect positive attitudes about standardized and routine progress monitoring, or positive outcomes. | Provider participants. Sample sizes are smaller because this measure was e not used in the pilot study. | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Monitoring and Feedback Attitudes Scale (MFA) | The Monitoring and Feedback Attitudes Scale has 14 questions and each has a scale of 1(Strongly Disagree) to 5(Strongly Agree), thus the total range was 14-70. Higher scores on this 14-item measure indicate more positive attitudes about routine progress monitoring and providing feedback to patients about treatment progress, or positive outcomes. | Provider participants. Sample sizes are smaller because the measure was not used in the pilot study. | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Routine Monitoring (RM) | We created a three-item measure where the total score is found by summing the items. The first two items are yes(scored 1)/no(scored 0) questions. The last item is a count measure that can be any number greater than or equal to 0. Thus, the total score can have any integer value greater than or equal to 0, with higher scores reflecting greater use of routine progress monitoring. | Provider participants. Sample sizes are smaller because the measure was not used in the pilot study. | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Current Assessment Practice Evaluation-Revised (CAPER) | We modified the original measure into nine items. The Current Assessment Practice Evaluation-Revised has 9 questions with each having a scale of 1(None, 0%) to 5 (Nearly All, 81-100%). Thus, the total range was 9-45 and higher scores reflect greater provider use of measurement-based care or positive outcomes. | Provider participants. Sample sizes are smaller because the measure was not used in the pilot study. | Posted | | Mean | Standard Deviation | score on a scale | | Baseline, 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |
| Primary | Therapy Task Checklist (TTC) - Provider Version | The Therapy Task Checklist -Provider Version has 22 questions and each have a scale of 0(Never/Very Rarely) to 4 (All of the time) with a total range of 0-88. Higher scores reflected more frequent use of evidence-based therapy tasks, or positive outcomes. | | Posted | | Mean | Standard Deviation | score on a scale | | 4 weeks, 8 weeks, 12 weeks | | | | ID | Title | Description |
|---|
| OG000 | WILLOW | Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality. | | OG001 | Treatment-as-Usual | Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems |
| |