Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| P50MH126219 | U.S. NIH Grant/Contract | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| National Institute of Mental Health (NIMH) | NIH |
| Brown University | OTHER |
Not provided
Not provided
Not provided
Not provided
This study will visit 4 community mental health clinics in Washington state and work with clinic staff to find out if staff are regularly evaluating clinical outcomes using questionnaires (which is also called measurement-based care or MBC). The study team will partner with clinic staff to find out what makes using questionnaires difficult and then plan to improve the use of questionnaires. The study activities will include trainings, interviews, collaborative discussions, and interactive activities.
Rapid Ethnographic Assessment (REA). REA will be conducted over 2-day site visits at each clinic, following a kickoff training on the principles of MBC. This team will conduct ethnographic observations on both days, using primarily unobtrusive techniques on Day 1, documenting observations of activities (e.g., clinician documentation), interactions (e.g., client check in), and events (e.g., staff meeting) using written and audio-recorded field notes. The investigators will interview staff for responses to the "example" question (for instance, "Could you show me how you use MBC in your work and describe what you are doing?") described above. The investigators expect up to 30 interviews per clinic: 30-45 minutes for therapists, 15 minutes for staff. The investigators will synthesize learnings from observations, interviews, and surveys in a debriefing session, using notes to generate a list of unique barriers. Day 2 will be focused observations of therapists shadowed by team members to document, track, and note the duration and location of activities, guided by barriers identified in the evidence review and Day 1 learnings. The investigators will conduct semi-structured, focused interviews based on Day 1 learnings, with therapists (therapists, supervisors, psychiatrists) and staff (up to 30). Day 2 interviews will be longer (15-30 minutes), audio recorded.
Design Kits. To complement REA and collect real-time data from therapists and youth, at the end of site visits, the investigators will leave design kit materials including disposable cameras, journals, pens and prompts to use to describe using MBC by taking pictures, make diary entries, draw maps, and record images. The investigators will ask therapists (5-8 per clinic) to participate.
Barrier Prioritization. The investigators will engage 5-8 therapists and/or staff in the prioritization activity for a 2-hour facilitated group activity. The activity will occur in-person (Site Visit 2) but could be delivered virtually if needed. Barriers identified through the rapid evidence review, rapid ethnographic assessment, and design kits (50+ expected) will be prioritized using a participant-engaged method.
Causal Pathway Diagramming. For each clinic, the investigators will develop Causal Pathway Diagrams (CPDs) for the top 3 prioritized barriers. The goal is to assess how well each implementation strategy is matched to a prioritized barrier, based on its mechanism of action, and to clarify the causal chain of events that must take place to achieve MBC fidelity.
Focus Groups to Improve IMPACT methods. The investigators will engage partners in a semi-structured focus group to capture their experience engaging in all IMPACT Center methods in the 3 site visits to inform further toolkit refinement. A facilitator not previously engaged in any of the activities will conduct a 60-minute focus group to solicit reactions to all aspects of IMPACT's methods, including the steps and personnel requirements of each method, and their output (e.g., prioritized barriers; utility of the information captured in the CPDs).
AIM 2: Compare MBC fidelity post IMPACT Center methods deployment versus historical controls.
The clinician self-report measure is a simple, quick, and homegrown self-report tool based upon the Collect, Share, Act conceptualization of MBC fidelity. The creation of this survey was guided by a need for something brief and pragmatic, and no self-report measures to our knowledge are (1) brief, (2) pragmatic, and (3) assess fidelity to the three main components of MBC. The survey asks clinicians to report (1) their approximate youth caseload in the last 6 months, and the percentage of youth patients with whom they have (2) collected data at least every two sessions, (3) shared data over the treatment course, and (4) acted on these processes to change the direction of treatment. Clinicians will complete this survey over REDCap. The study team will assess the internal reliability, concurrent validity, and convergent validity of the measure once data collection ends [41]. A copy of this measure is available from the first author.
The study will will present descriptive statistics to describe MBC fidelity at each of the three time points. The study will use a repeated measures analysis of variance to analyze whether fidelity to components of MBC changed from baseline (6 months after enrollment) to 3 months after active implementation, and finally 6 months after implementation.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Measurement Based Care Implementation | Other | Four community mental health clinics located in Washington state will receive trainings on how to implement Measurement Based Care (MBC) in their clinics. We are creating implementation plans to improve therapists' use of measurement-based care. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| IMPACT Methods to Identify and Prioritize Determinants (Challenge I), Challenge and Match strategies to Prioritized Determinants (Challenge II) | Behavioral | IMPACT Center developed two methods for identifying determinants that involved providers, staff, and youth at community mental health centers in site visit 1: Rapid Ethnographic Assessment, Design Probes. Then, practice partners engage in a facilitated group activity to rate the criticality, chronicity, and ubiquity of the list of determinants in Site Visit 2. Finally, practice partners engage in a third site visit where they create Causal Pathway Diagrams that allow them to match strategies to prioritize determinants and create Implementation Plans. |
| Measure | Description | Time Frame |
|---|---|---|
| Number of Youth Clients Provided Outcome Questionnaires | Aim 2 Therapists will report on the number of clinical outcome questionnaires administered to youth clients (the total number of outcome questionnaires per client used) before and after engaging in our researcher-driven implementation process. | We will assess at 6 (pre-implementation), 9 (3 months post-implementation), and 12 (6 months post-implementation) months after enrollment. |
Not provided
Not provided
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Ruben G Martinez, PhD | Kaiser Permanente | Study Director |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| KPWHRI | Seattle | Washington | 98101 | United States |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 38017522 | Background | Martinez RG, Weiner BJ, Meza RD, Dorsey S, Palazzo LG, Matson A, Bain C, Mettert KD, Pullmann MD, Lewis CC. Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE). Implement Sci Commun. 2023 Nov 28;4(1):152. doi: 10.1186/s43058-023-00526-z. | |
| 41333394 | Derived | Martinez RG, Cramer ER, Norris LA, Matson A, Lang C, Henrikson NB, Blasi PR, Palazzo LG, Hoopes AJ, Dorsey S, Weiner BJ. Short Report: Comparison of three methods for identifying implementation determinants to measurement-based care. Res Sq [Preprint]. 2025 Nov 19:rs.3.rs-7973723. doi: 10.21203/rs.3.rs-7973723/v1. |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
For the first aim of the study (co-developing implementation plans), any member of participating community mental health center were invited to participate. After that, only therapists who served youth clients were included for the outcome data because they needed to be able to report on their use of outcome measures with youth clients. One clinic that enrolled clinic members later decided that they could not continue with the study, citing high waitlists and competing organizational priorities.
Recruitment occurred at 3 distinct time points: October-November of 2022, June of 2022, and October of 2023. All recruitment was done in community mental health clinics.
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Measurement Based Care Implementation | Four community mental health clinics located in Washington state will receive trainings on how to implement Measurement Based Care (MBC) in their clinics. We created implementation plans to improve therapists' use of measurement-based care. IMPACT Methods to Identify and Prioritize Determinants (Challenge I), Challenge and Match strategies to Prioritized Determinants (Challenge II): IMPACT Center developed two methods for identifying determinants that involved providers, staff, and youth at community mental health centers in site visit 1: Rapid Ethnographic Assessment, Design Probes. Then, practice partners engage in a facilitated group activity to rate the criticality, chronicity, and ubiquity of the list of determinants in Site Visit 2. Finally, practice partners engage in a third site visit where they create Causal Pathway Diagrams that allow them to match strategies to prioritize determinants and create Implementation Plans. For aim 2, we evaluated whether the implementation plans had any effect on therapist's use of outcome questionnaires with their youth clients. |
| Title | Milestones | Reasons Not Completed | |||||
|---|---|---|---|---|---|---|---|
| Aim 1 Activities (Ethnography) |
|
Not provided
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot | Yes | No | No | Study Protocol | Apr 4, 2024 | Jun 13, 2025 |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
|
| COMPLETED | We originally planned to enroll patients in Aim 1 but were unsuccessful in recruiting patients, so no patients are included in this sample. |
|
| NOT COMPLETED |
|
|
| Aim 2 Activities (Fidelity to MBC) |
|
|
This analysis population includes only youth-serving therapists, so it is a subset of the full sample.
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Measurement Based Care Implementation | Four community mental health clinics located in Washington state will receive trainings on how to implement Measurement Based Care (MBC) in their clinics. We co-created implementation plans to improve therapists' use of measurement-based care by (1) identifying barriers and facilitators to MBC, (2) prioritizing barriers, and (3) co-developing an implementation strategy. The primary outcome of interest was whether the co-developed implementation strategies improved clinician's use of MBC (defined as % of youth clients administered measures) with youth clients. NOTE: Patients/clients were not enrolled in outcome measurement, as the study was primarily focused on whether implementation strategies improved clinicians use of measurement-based care (i.e., clinicians were the primary unit of analysis). |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Age, Categorical | Count of Participants | Participants |
| ||||||||||||||||||
| Sex: Female, Male | Count of Participants | Participants |
| ||||||||||||||||||
| Race and Ethnicity Not Collected | Race and Ethnicity were not collected from any participant. | Count of Participants | Participants |
| |||||||||||||||||
| Region of Enrollment | Number | participants |
|
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Number of Youth Clients Provided Outcome Questionnaires | Aim 2 Therapists will report on the number of clinical outcome questionnaires administered to youth clients (the total number of outcome questionnaires per client used) before and after engaging in our researcher-driven implementation process. | Posted | Mean | Standard Deviation | number of youth clients given measures | We will assess at 6 (pre-implementation), 9 (3 months post-implementation), and 12 (6 months post-implementation) months after enrollment. |
|
|
|
|
Adverse event data was collected for the entire implementation period of the study, so 12 months per clinic.
Not provided
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Measurement Based Care Implementation | Four community mental health clinics located in Washington state will receive trainings on how to implement Measurement Based Care (MBC) in their clinics. We co-created implementation plans to improve therapists' use of measurement-based care by (1) identifying barriers and facilitators to MBC, (2) prioritizing barriers, and (3) co-developing an implementation strategy. The primary outcome of interest was whether the co-developed implementation strategies improved clinician's use of MBC (defined as % of youth clients administered measures) with youth clients. NOTE: Patients/clients were not enrolled in outcome measurement, as the study was primarily focused on whether implementation strategies improved clinicians use of measurement-based care (i.e., clinicians were the primary unit of analysis). | 0 | 76 | 0 | 76 | 0 | 76 |
Not provided
Not provided
Not provided
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Dr. Ruben Martinez | Brown University | 4014441915 | ruben_martinez@brown.edu |
| Prot_000.pdf |
| SAP | No | Yes | No | Statistical Analysis Plan | May 5, 2025 | Jun 13, 2025 | SAP_001.pdf |
| ID | Term |
|---|---|
| D000092862 | Psychological Well-Being |
| ID | Term |
|---|---|
| D010549 | Personal Satisfaction |
| D001519 | Behavior |
Not provided
Not provided
| >=65 years |
|
|