Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Parent-mediated interventions are considered best practice for treating children with autism spectrum disorder, but these interventions are underutilized in community settings. Implementation strategies like consultation can improve the implementation of these interventions, but little is known about the active ingredients of consultation. This study uses an experimental design (ABCD single-case design with multiple baselines) to identify the active ingredients of a consultation model designed to support the implementation of a parent-mediated intervention for autism spectrum disorder in a low-resourced community mental health system.
There are multiple evidence-based practices (EBPs) to treat autism spectrum disorder (ASD), yet the gap from when EBPs are developed to when they reach community settings is 17 years. EBPs are consistently underused in community settings despite their well-studied effectiveness. One such EBP for treating ASD in young children is parent-mediated intervention.
Consultation is one method of supporting implementation that involves providing clinicians with support and feedback from intervention experts. For this study, consultation on an evidence-based parent-mediated intervention, Project ImPACT, will be the focus. Understanding the active ingredients that go into consultation is important to understand how consultation works so that it can be tailored to best meet the needs of community settings. This single-case experimental design (SCED) will manipulate three potential ingredients of consultation: feedback on taped sessions, case support, and skill rehearsal.
Groups of 3-5 providers per agency will be given 2 weeks to complete a 6-hour self-directed online tutorial on Project ImPACT utilized regularly by Project ImPACT consultants. Next, each agency will be randomly assigned to baselines lasting 3-6 weeks, followed by 4 weeks of each consultation component (total of 12 weeks). All agencies will receive consultation. The order of the consultation components will be randomized using a random number generator such that each agency has an equal chance of receiving one of the predetermined permutations of phases which are labeled in alphabetical order (e.g., equally as likely to be randomized to ABCD order as ADBC order). Across each phase, providers will record one session per week with their enrolled family and submit it via a HIPAA-compliant Drop-box link. Providers will complete weekly online questionnaires on implementation outcomes, with time reserved during consultation sessions to complete them. After consultation, providers will submit a final recorded session and questionnaire 8-weeks post-consultation. Caregivers will complete a measure of social communication for their child via online questionnaire at baseline, twice during consultation, and after 8 weeks post-consultation.
The feedback phase will involve the consultant and peers responding to the 5-minute clips of recorded telehealth sessions with praise and constructive feedback. The case support phase will be a time for the consultant and peers to assist in any challenges faced; for example, this could include issues with telehealth, caregiver coaching, or family/child needs. The skill rehearsal phase will allow for consultees to practice their clinical skills via role play.
This study will have 4 aims:
Specific Aim 1: Identify the potential active ingredients of the consultation model by evaluating its effects on providers' treatment adherence and parent-mediated intervention competence. The investigators predict that the feedback component will improve adherence and competence over and above improvements from the case support and skill rehearsal components.
Specific Aim 2: Examine the relative feasibility, acceptability, and appropriateness of each consultation component using a SCED component analysis. Feasibility is the extent to which a practice can be successfully carried out within a setting. Acceptability is the extent to which a practice is agreeable and satisfactory. Appropriateness is the perceived fit or relevance of a practice to address a problem. The investigators predict that providers will perceive the case support component to be the most feasible, acceptable, and appropriate of all components.
Specific Aim 3: Examine the effects of the consultation model on case penetration and the feasibility, acceptability, and appropriateness of the EBP (Project ImPACT). The investigators predict case penetration (i.e., total number of Project ImPACT cases on a provider's caseload divided by the total number of eligible clients) and EBP feasibility, acceptability, and appropriateness to increase over time.
Exploratory Aim 4: Demonstrate associated social communication outcomes for Medicaid-enrolled children with ASD from baseline to post-consultation. Given that consultation leads to improved adherence and child outcomes and Project ImPACT results in improved child social communication outcomes, the investigators predict that our consultation model will be associated with improvements in child social communication skills.
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Baseline | No Intervention | Following completing the online tutorial, each agency will have a baseline lasting 3-6 weeks (this will be staggered by agency). | |
| Treatment (Consultation) | Experimental | Consultation will be conducted in 4-week phases that correspond to the three consultation components. The phases will occur in a randomized order. During a given phase, no components of any other phases will be provided. Feedback phase. Consultees will submit 5-minute clips of session recordings of their Project ImPACT session with their enrolled family for feedback. Oral feedback will be provided by the consultant and peers. Case support phase. The consultant will lead the group in problem-solving common barriers that providers experience with their cases. Skill rehearsal phase. The consultant will lead skill rehearsal practices in which providers role play elements of a Project ImPACT session. |
|
| Follow Up | No Intervention | During the follow-up period, consultation will not occur, and providers will continue implementing Project ImPACT with their cases. Eight weeks post-consultation, providers will submit a recorded Project ImPACT session with their enrolled family. Providers and caregivers will complete a final online questionnaire. |
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Consultee-centered administrative consultation | Other | The consultee-centered administrative consultation model expressly focuses on supporting providers to increase EBP implementation within their specific setting. |
| Measure | Description | Time Frame |
|---|---|---|
| Treatment Adherence | The Project ImPACT Coaching Fidelity Checklist is a measure of treatment adherence. It uses a 3-point scale -- Observed (1), Partially Observed (.5), and Not Observed (0). Higher scores indicate higher treatment adherence. Based on scoring guidelines for this measure, scores for each item are multiplied by an item-specific weight value. Scores for each item are then summed and divided by the total number of items scored, yielding a score ranging from 0 to 100. | 23-26 weeks |
| Parent-mediated Intervention Competence | Parent-mediated intervention competence will be assessed via Parent Empowerment and Coaching in Early Intervention (PEACE) coding which utilizes a 5-point scale to assess for competency in delivering collaborative coaching techniques used in parent-mediated interventions. The scale used is: Never (1), Rarely (2), Sometimes (3), Often (4), and Almost Always (5). The minimum value on the scale is 1 and the maximum is 5. Higher scores indicate higher parent-mediated intervention competence. | 23-26 weeks |
| Case Penetration | Case penetration will be measured weekly using the Penetrability Formula and will be expressed using provider report of the total number of Project ImPACT cases on their caseload divided by the total number of eligible clients with ASD on their Medicaid Autism Benefit caseload. This is expressed as a percentage. Higher percentage values indicate higher case penetration. | 23-26 weeks |
| Ratings of the Usability of Each Consultation Component | Clinicians reported on the usability of each consultation component weekly across the 4 weeks of each consultation condition using the Implementation Strategy Usability Scale (Lyon et al., 2021). This 10-item questionnaire uses a 5-point Likert scale to examine clinician perceptions about the complexity of using an implementation strategy. The scale is unidimensional and has no subscales. Based on scoring guidelines, a formula is used to calculate the total usability score, which ranges from 0-100. Higher scores indicate higher usability; higher scores indicate higher ratings of the participant's ability to use the strategy with ease. The formula involves the following: for each odd numbered item, subtract 1 from the Likert rating value to get the new value; for each even numbered item, subtract the Likert rating value from 5 to get a new value; then sum all new values and multiply by 2.5. |
Not provided
Not provided
Groups of 3-5 providers will be recruited from four applied behavior analysis (ABA) agencies (~20 providers in total) that contract with regional community mental health agencies to provide ABA services to Medicaid-enrolled children with autism spectrum disorder (ASD). Families on the providers' caseloads will be enrolled.
Inclusion Criteria for Providers:
• Have at least one caregiver on their caseload who would be appropriate for Project ImPACT and who agrees to enroll in the study and have their sessions recorded.
Exclusion Criteria for Providers:
Inclusion Criteria for Caregivers:
Exclusion Criteria for Caregivers:
• Under age 18
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Brooke Ingersoll | Michigan State University | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Michigan State University | East Lansing | Michigan | 48824 | United States |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Provider Treatment (Consultation) | All providers received consultation. Consultation was conducted in 4-week phases that correspond to the three consultation components: Case Support, Feedback, and Skill Rehearsal. The phases will occur in a randomized order. During a given phase, no components of any other phases were provided. Feedback phase. Consultees submitted 5-minute clips of session recordings of their Project ImPACT session with their enrolled family for feedback. Oral feedback was provided by the consultant and peers. Case support phase. The consultant led the group in problem-solving common barriers that providers experience with their cases. Skill rehearsal phase. The consultant led skill rehearsal practices in which providers role played elements of a Project ImPACT session. |
| FG001 | Family Treatment (Project ImPACT) | All families received Project ImPACT. Project ImPACT is an evidence-based manualized parent coaching program that is designed to teach caregivers strategies to support social communication development in young children with autism or social communication delays. Project ImPACT is a naturalistic developmental behavioral intervention (NDBI), which is a newer class of autism intervention that blends principles of developmental science and applied behavior analysis (Schreibman et al., 2015). Clinicians were instructed to deliver the Project ImPACT program once per week via a telehealth platform supported by their agency (e.g., Zoom, HIPAA-compliant Google Meet), for a total of 24 sessions, with a session length of 60 minutes per session. |
| Title | Milestones | Reasons Not Completed | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Overall Study |
|
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Provider Treatment (Consultation) | All providers received consultation. Consultation was conducted in 4-week phases that correspond to the three consultation components: Case Support, Feedback, and Skill Rehearsal. The phases will occur in a randomized order. During a given phase, no components of any other phases were provided. Feedback phase. Consultees submitted 5-minute clips of session recordings of their Project ImPACT session with their enrolled family for feedback. Oral feedback was provided by the consultant and peers. Case support phase. The consultant led the group in problem-solving common barriers that providers experience with their cases. Skill rehearsal phase. The consultant led skill rehearsal practices in which providers role played elements of a Project ImPACT session. |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes |
|---|---|---|---|---|---|---|---|---|---|
| Age, Continuous | Mean |
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | ||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Treatment Adherence | The Project ImPACT Coaching Fidelity Checklist is a measure of treatment adherence. It uses a 3-point scale -- Observed (1), Partially Observed (.5), and Not Observed (0). Higher scores indicate higher treatment adherence. Based on scoring guidelines for this measure, scores for each item are multiplied by an item-specific weight value. Scores for each item are then summed and divided by the total number of items scored, yielding a score ranging from 0 to 100. | This measure is only collected from the provider arm. | Posted | Mean | Standard Error | score on a scale | 23-26 weeks |
|
23-27 weeks
This was an observational study of a psychosocial intervention provided in routine behavioral health settings. No adverse events occurred during the course of the study.
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Provider Treatment (Consultation) | All providers received consultation. Consultation was conducted in 4-week phases that correspond to the three consultation components: Case Support, Feedback, and Skill Rehearsal. The phases will occur in a randomized order. During a given phase, no components of any other phases were provided. Feedback phase. Consultees submitted 5-minute clips of session recordings of their Project ImPACT session with their enrolled family for feedback. Oral feedback was provided by the consultant and peers. Case support phase. The consultant led the group in problem-solving common barriers that providers experience with their cases. Skill rehearsal phase. The consultant led skill rehearsal practices in which providers role played elements of a Project ImPACT session. |
Not provided
Not provided
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Dr. Brooke Ingersoll, Professor | Department of Psychology, Michigan State University | 517-432-8412 | ingers19@msu.edu |
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot_SAP | Yes | Yes | No | Study Protocol and Statistical Analysis Plan | Jun 17, 2024 | Jun 17, 2024 | Prot_SAP_001.pdf |
| ICF | No | No | Yes | Informed Consent Form | May 27, 2022 | Nov 3, 2022 | ICF_000.pdf |
Not provided
| ID | Term |
|---|---|
| D000067877 | Autism Spectrum Disorder |
| ID | Term |
|---|---|
| D002659 | Child Development Disorders, Pervasive |
| D065886 | Neurodevelopmental Disorders |
| D001523 | Mental Disorders |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| 23-26 weeks |
| Ratings of Perceptions of Project ImPACT | Providers completed the Perceived Characteristics of Intervention Scale (PCIS; Cook et al., 2015) weekly about their perceptions of Project ImPACT. This 18-item questionnaire includes items related to various constructs from Rogers' Diffusions of Innovation theory (Rogers, 2010). All items are rated on a 7-point Likert scale and the overall PCIS score is established by computing the mean of all items. The minimum score is 1.00 and maximum is 7.00. Higher values indicate more positive perceptions of the intervention. | 23-26 weeks |
| Child Social Communication Skills | The Autism Impact Measure has 41 items rated on a 5-point scale ranging from Never (1) to Always (5). The overall score is calculated by summing the scores on two scales (frequency and impact). Higher values indicate a higher frequency and impact of autism-related concerns child functioning. The minimum value is 82 and the maximum value is 410. | 23-26 weeks |
| BG001 | Family Treatment (Project ImPACT) | All families received Project ImPACT. Project ImPACT is an evidence-based manualized parent coaching program that is designed to teach caregivers strategies to support social communication development in young children with autism or social communication delays. Project ImPACT is a naturalistic developmental behavioral intervention (NDBI), which is a newer class of autism intervention that blends principles of developmental science and applied behavior analysis (Schreibman et al., 2015). Clinicians were instructed to deliver the Project ImPACT program once per week via a telehealth platform supported by their agency (e.g., Zoom, HIPAA-compliant Google Meet), for a total of 24 sessions, with a session length of 60 minutes per session. |
| BG002 | Total | Total of all reporting groups |
| years |
|
| Sex: Female, Male | 2 caregivers had missing data for sex. | Count of Participants | Participants |
|
| Ethnicity (NIH/OMB) | 2 caregivers had missing data for ethnicity. | Count of Participants | Participants |
|
| Race (NIH/OMB) | 2 caregivers had missing data for race. | Count of Participants | Participants |
|
| Project ImPACT Coaching Fidelity | The Project ImPACT Coaching Fidelity Checklist is a measure of treatment adherence. It uses a 3-point scale -- Observed (1), Partially Observed (.5), and Not Observed (0). Higher scores indicate higher treatment adherence. Based on scoring guidelines for this measure, scores for each item are multiplied by an item-specific weight value. Scores for each item are then summed and divided by the total number of items scored, yielding a score ranging from 0 to 100. | This measure is only for providers and refers to their fidelity to using Project ImPACT. | Mean | Full Range | units on a scale |
|
| PEACE Parent Coaching Competency Fidelity | Parent-mediated intervention competence will be assessed via Parent Empowerment and Coaching in Early Intervention (PEACE) coding which utilizes a 5-point scale to assess for competency in delivering collaborative coaching techniques used in parent-mediated interventions. The scale used is: Never (1), Rarely (2), Sometimes (3), Often (4), and Almost Always (5). The minimum value on the scale is 1 and the maximum is 5. Higher scores indicate higher parent-mediated intervention competence. | This measure is only completed for providers, as it is a measure of competency in delivering parent coaching interventions. | Mean | Full Range | units on a scale |
|
| Autism Impact Measure | The Autism Impact Measure has 41 items rated based on the sum of scores on two scales (frequency and impact) that both include a 5-point scale ranging from Never (1) to Always (5). Higher values indicate higher frequency of concerns and higher impact of concerns on child functioning. The minimum value is 82 and the maximum value is 410. | This measure was only for caregivers as it is a caregiver-report questionnaire of child skills. | Mean | Full Range | units on a scale |
|
| Units | Counts |
|---|
| Participants |
|
|
|
| Primary | Parent-mediated Intervention Competence | Parent-mediated intervention competence will be assessed via Parent Empowerment and Coaching in Early Intervention (PEACE) coding which utilizes a 5-point scale to assess for competency in delivering collaborative coaching techniques used in parent-mediated interventions. The scale used is: Never (1), Rarely (2), Sometimes (3), Often (4), and Almost Always (5). The minimum value on the scale is 1 and the maximum is 5. Higher scores indicate higher parent-mediated intervention competence. | This measure is only collected from the provider arm. | Posted | Mean | Standard Error | score on a scale | 23-26 weeks |
|
|
|
|
| Primary | Case Penetration | Case penetration will be measured weekly using the Penetrability Formula and will be expressed using provider report of the total number of Project ImPACT cases on their caseload divided by the total number of eligible clients with ASD on their Medicaid Autism Benefit caseload. This is expressed as a percentage. Higher percentage values indicate higher case penetration. | This measure is only collected from the provider arm. 288 observations (i.e., surveys) across 20 clinicians from 6 agencies were included in the models. | Posted | Mean | Standard Error | percentage of caseload | 23-26 weeks |
|
|
|
|
| Primary | Ratings of the Usability of Each Consultation Component | Clinicians reported on the usability of each consultation component weekly across the 4 weeks of each consultation condition using the Implementation Strategy Usability Scale (Lyon et al., 2021). This 10-item questionnaire uses a 5-point Likert scale to examine clinician perceptions about the complexity of using an implementation strategy. The scale is unidimensional and has no subscales. Based on scoring guidelines, a formula is used to calculate the total usability score, which ranges from 0-100. Higher scores indicate higher usability; higher scores indicate higher ratings of the participant's ability to use the strategy with ease. The formula involves the following: for each odd numbered item, subtract 1 from the Likert rating value to get the new value; for each even numbered item, subtract the Likert rating value from 5 to get a new value; then sum all new values and multiply by 2.5. | This measure is only collected from the provider arm. 20 clinicians reported on usability of each consultation component. | Posted | Mean | Standard Deviation | score on a scale | 23-26 weeks |
|
|
|
|
| Primary | Ratings of Perceptions of Project ImPACT | Providers completed the Perceived Characteristics of Intervention Scale (PCIS; Cook et al., 2015) weekly about their perceptions of Project ImPACT. This 18-item questionnaire includes items related to various constructs from Rogers' Diffusions of Innovation theory (Rogers, 2010). All items are rated on a 7-point Likert scale and the overall PCIS score is established by computing the mean of all items. The minimum score is 1.00 and maximum is 7.00. Higher values indicate more positive perceptions of the intervention. | This measure is only collected from the provider arm. 286 surveys from 18 clinicians with sufficient data. | Posted | Mean | Standard Error | score on a scale | 23-26 weeks |
|
|
|
|
| Primary | Child Social Communication Skills | The Autism Impact Measure has 41 items rated on a 5-point scale ranging from Never (1) to Always (5). The overall score is calculated by summing the scores on two scales (frequency and impact). Higher values indicate a higher frequency and impact of autism-related concerns child functioning. The minimum value is 82 and the maximum value is 410. | This measure is only collected from the caregiver arm (caregivers reporting on child skills). Models included 62 surveys across 17 children from 5 agencies. | Posted | Mean | Standard Error | score on a scale | 23-26 weeks |
|
|
|
|
| 0 |
| 20 |
| 0 |
| 20 |
| 0 |
| 20 |
| EG001 | Family Treatment (Project ImPACT) | All families received Project ImPACT. Project ImPACT is an evidence-based manualized parent coaching program that is designed to teach caregivers strategies to support social communication development in young children with autism or social communication delays. Project ImPACT is a naturalistic developmental behavioral intervention (NDBI), which is a newer class of autism intervention that blends principles of developmental science and applied behavior analysis (Schreibman et al., 2015). Clinicians were instructed to deliver the Project ImPACT program once per week via a telehealth platform supported by their agency (e.g., Zoom, HIPAA-compliant Google Meet), for a total of 24 sessions, with a session length of 60 minutes per session. | 0 | 21 | 0 | 21 | 0 | 21 |
Not provided
Not provided
| Unknown or Not Reported |
|
| Native Hawaiian or Other Pacific Islander |
|
| Black or African American |
|
| White |
|
| More than one race |
|
| Unknown or Not Reported |
|
| Title | Measurements |
|---|---|
|