Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| 1R44DA053845-01A1 | U.S. NIH Grant/Contract | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| National Institute on Drug Abuse (NIDA) | NIH |
| Public Health Management Corporation | OTHER |
Not provided
Not provided
Not provided
Not provided
The goal of this project is to develop and evaluate the technical feasibility and commercial viability of a scalable digital counselor training program for CRAFT.
This pilot project will develop an enhanced training model for CRAFT and digitize it to maximize scalability. In this project, investigators will:
Aim 1: Produce the digital counselor training prototype and coaching process, tailored to OUD - with stakeholder input.
Aim 2: Conduct a pilot study of 3 levels of digital training (Level 1 - Digital tutorial only [T]; Level 2 - Tutorial & digital training materials for self-study [TM]; Level 3 - Tutorial, digital materials, feedback and coaching [TMC]) to establish feasibility, acceptability, and examine the effects of training on CRAFT knowledge, fidelity, and treatment entry and retention.
The goal of this project is to develop and evaluate the technical feasibility and commercial merit of a scalable digital training program for Community Reinforcement and Family Training (CRAFT). The product would be tailored to prepare counselors to work with family members of treatment-resistant individuals (Identified Persons; IPs) with opioid use disorder (OUD).
We will recruit counselors working in addiction related professions who work with OUD affected populations. We will enroll 15 participants per study arm. Our primary hypothesis addresses feasibility, and our secondary hypotheses involve a Stage 1b pilot study. Therefore, according to Rounsaville and colleagues' "Stage model of behavioral research", the current study is a Stage 1b pilot trial where a sample size of 15-30 per arm is ideal. In the pilot of our CRAFT Family product,15 participants per group was adequate to assess acceptance and feasibility, attain several statistically significant differences between groups and to estimate effect and sample size for a full trial.
We will assign counselors to one of three training groups using a blocked randomization procedure to control for level of education (highschool/GED, bachelors, masters, PhD) and training and experience in CBT and applied behavior analysis (ABA) as CRAFT is a CBT based on ABA principles. We will use an additive components design consisting of: 1) digital tutorial only (T), 2) digital tutorial plus digital training materials (TM), and 3) digital tutorial, digital training materials plus feedback and coaching (TMC). This design will allow us to assess whether the digital training materials improve counselor outcomes relative to the tutorial only, but will not allow us to access their contribution, if any, to the full training product (TMC). We considered adding a group with tutorial, feedback and coaching (TC), but opted for the simpler design. We can determine the contribution of the digital training materials in a future study, if warranted.
The study will be conducted completely digitally, online. Treatment Conditions Digital Tutorial (T) All participants will continue to have access to tutorial materials throughout the study. Participants assigned to the T condition receive ONLY the tutorial. Afterwards they will be encouraged via weekly emails to continue using the resources in the online tutorial to revisit the CRAFT lessons on their own during the 10-week period between post-tutorial and the final assessment.
Digital Tutorial, with training materials (TM) Participants assigned to the TM condition will complete the tutorial and then receive access to the additional training materials. They will not receive any feedback or video-calls for coaching. They will be encouraged via weekly emails to continue to learn CRAFT on their own during the 10-week post-tutorial period by using the new resources in the online tutorial and the digital training materials Digital Tutorial, with training materials plus feedback and coaching (TMC) Systematic feedback and coaching during the 10-week post-tutorial to final assessment period will be provided to only to participants assigned to the TMC condition. Participants will be required to submit audio taped sessions with clients (up to 12 allowed), for which they will digitally receive written feedback and live video-call coaching. Participants will be encouraged to re-submit their audio taped sessions until they meet the criteria needed for certification in the CRAFT procedure or until the phase is over (whichever occurs first).
Participants will receive individual written Personal Performance Feedback on all audio taped sessions that they submit. This feedback is generated by two CRAFT certified coaches (i.e., CRAFT Trainer or CRAFT Coder) who accesses the digitally audio taped sessions via a secure server. The coach listens to the audiotape and records a session content checklist that indicates key procedures for each module. For each key component, the coach indicates whether it was addressed in the session, rates the quality of implementation for that component (1=poor to 5-excellent) and writes comments praising specific behaviors or making suggestions for further improvement. This feedback is password protected and emailed to the counselor. Every week during the intervention period TMC participants will participate in 30-min video-call Coaching Sessions.
All counselors will complete assessments pre-tutorial, post-tutorial, and at 12 weeks post-tutorial. Each assessment point will include a series of questionnaires and a role play with a standardized patient.
Assessing a) acceptability and feasibility (via surveys on training expectations, satisfaction, usefulness and usability, implementation potential, and price sensitivity); and b) knowledge and fidelity (via a knowledge test and direct observation of audiotapes counselor CRAFT sessions).
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| T - Digital Tutorial overview | Active Comparator | A digital tutorial consisting of a curriculum dashboard for review of 10(?) modules, including videos, PDFs, text and quizzes, which are to be self-administered over two weeks. Modules remain available during the 10-week post tutorial period. Participants receive weekly contact encouraging engagement in all of the materials available to them. |
|
| TM - Digital Tutorial plus training Materials | Experimental | Participants receive the digital tutorial (T) as described above plus access to 10 modules of digital training materials released weekly over the 10-week post tutorial period. |
|
| TMC - Digital Tutorial plus training Materials plus feedback and Coaching | Experimental | Participants receive the digital tutorial (T) plus the digital Training materials as described in the two arms above plus they submit audio recordings of sessions with clients and receive feedback on their application of CRAFT and coaching on how to improve. |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Behavioral: Digital Tutorial Overview | Behavioral | Self study of a digital tutorial covering an overview of CRAFT designed to be reviewed within 2 weeks. |
|
| Measure | Description | Time Frame |
|---|---|---|
| Community Reinforcement And Family Training (CRAFT) Procedure Fidelity | CRAFT performance on the mock sessions was observed by trained coders who rated performance of each CRAFT treatment entry procedure (6 items), homework procedures (2 items), overall CRAFT approach (2 items), and general clinical skill (4 items) on a 5-point scale (i.e., 1 =poor; 3 =satisfactory; 5 =excellent). A total score was calculated across all 14 items for each participant. Average scores on each procedure and in total were calculated for each participant group at baseline and at 12-week follow-up. Scores could range from 6 - 30 on treatment entry; 2 - 10 on homework and CRAFT approach; 4 - 20 on general clinical skill; and 14 - 70 on the overall total. Higher scores indicated better performance | 3 months |
| Measure | Description | Time Frame |
|---|---|---|
| Community Reinforcement and Family Training (CRAFT) Knowledge Test | Measuring the proficiency with which participants answer questions about the CRAFT approach. The 20-item CRAFT Knowledge Test was scored by calculating the number of correct answers for each individual and then averaging scores across participants within each group (T, TM, TMC). Scores could range from 0 - 20. Higher scores indicate greater knowledge. |
| Measure | Description | Time Frame |
|---|---|---|
| New Treatment Entry: Identified Patient Treatment Entry Status | Participants report whether their client's loved one has attended any treatment for their opioid use problem since the baseline assessment by answering questions regarding participation in treatment. In addition, reports of treatment entry to WTV staff were categorized as treatment entry. The outcome is the percentage of participants reporting that their client's loved one (identified patient; IP) entered new treatment |
Inclusion Criteria:
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Jane Macky, MA | We The Village, Inc. | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| We The Village, Inc. | New York | New York | 10281 | United States |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 42284931 | Derived | Macky J, Handley C, Kirby KC, Fitzpatrick B, Kishpaugh J, West C, Meyers RJ, Bearnot B, Herrera AE, Whitmarsh EH, McCarthy JM. Pilot randomized study of three digital models to train opioid use disorder counselors in community reinforcement and family training. Drug Alcohol Depend. 2026 Jun 1;285:113225. doi: 10.1016/j.drugalcdep.2026.113225. Online ahead of print. |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | T - Digital Tutorial Overview | A digital tutorial consisting of a curriculum dashboard for review of 10 modules, including videos, PDFs, text and quizzes, which are to be self-administered over two weeks. Modules remain available during the 10-week post tutorial period. Participants receive weekly contact encouraging engagement in all of the materials available to them. |
| Title | Milestones | Reasons Not Completed | |||||
|---|---|---|---|---|---|---|---|
| Overall Study |
|
Not provided
Not provided
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot | Yes | No | No | Study Protocol | Mar 22, 2023 | Nov 7, 2024 |
Not provided
Conduct a pilot study of 3 levels of digital training (Level 1 - Digital tutorial only [T]; Level 2 - Tutorial & digital training materials for self-study [TM]; Level 3 - Tutorial, digital materials, feedback and coaching [TMC]) to establish feasibility, acceptability, and examine the effects of training on CRAFT knowledge, fidelity, and treatment entry and retention.
Not provided
Not provided
The participants will know what group they are in. When data is sent to the statistician for analysis it will be coded in the groups (e.g., 123) without informing which is which. This masks (or blinds) him to the condition.
|
| Behavioral: Training Materials | Behavioral | 10 weeks post-tutorial access to additional digital training materials. |
|
|
| Behavioral: Feedback and Coaching | Behavioral | 10 weeks post-tutorial access to additional digital training materials and systematic feedback and coaching. |
|
|
| 3 months |
| Program Implementation Potential Scale | Measure Description: Mean Implementation Potential Scores (IPS) scores were computed for each dimension at each assessment point by adding ratings on a 6-point scale (1-6) within each 4 dimensions (Acceptability/Efficacy = 10 items, range 10 - 60; Implementation Commitment = 8 items, range 8 - 48; Administrative Support = 4 items, range 4 - 24; and Organizational Resources = 4 items, range 4 - 24). A single IPS score was calculated by adding all 26 items for overall perceived implementation potential of CRAFT. The total IPS score could range from 26 - 156. Higher scores indicate better implementation potential. | 3 months |
| 3 months |
| FG001 | TM - Digital Tutorial Plus Training Materials | Participants receive the digital tutorial (T) plus access to 10 modules of digital training materials released weekly over the 10-week post tutorial period. |
| FG002 | TMC - Digital Tutorial Plus Training Materials Plus Feedback and Coaching | Participants receive the digital tutorial (T) plus the digital Training materials (TM) plus they submit audio recordings of sessions with clients and receive feedback on their application of CRAFT and coaching on how to improve. |
| Mock Session |
|
| COMPLETED |
|
| NOT COMPLETED |
|
|
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | T - Digital Tutorial Overview | A digital tutorial consisting of a curriculum dashboard for review of 10 modules, including videos, PDFs, text and quizzes, which are to be self-administered over two weeks. Modules remain available during the 10-week post tutorial period. Participants receive weekly contact encouraging engagement in all of the materials available to them. |
| BG001 | TM - Digital Tutorial Plus Training Materials | Participants receive the digital tutorial (T) plus access to 10 modules of digital training materials released weekly over the 10-week post tutorial period. |
| BG002 | TMC - Digital Tutorial Plus Training Materials Plus Feedback and Coaching | Participants receive the digital tutorial (T) plus the digital Training materials (TM) plus they submit audio recordings of sessions with clients and receive feedback on their application of CRAFT and coaching on how to improve. |
| BG003 | Total | Total of all reporting groups |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Age, Continuous | Mean | Full Range | years |
| ||||||||||
| Sex: Female, Male | Count of Participants | Participants |
| |||||||||||
| Ethnicity (NIH/OMB) | Count of Participants | Participants |
| |||||||||||
| Race (NIH/OMB) | Count of Participants | Participants |
| |||||||||||
| Region of Enrollment | Number | participants |
| |||||||||||
| Community Reinforcement And Family Training (CRAFT) Procedure Fidelity | CRAFT performance on the mock sessions was observed by trained coders who rated performance of each CRAFT treatment entry procedure (6 items), homework procedures (2 items), overall CRAFT approach (2 items), and general clinical skill (4 items) on a 5-point scale (i.e., 1 =poor; 3 =satisfactory; 5 =excellent). A total score was calculated by summing across all 14 items for each participant. Average scores were calculated for each participant group at baseline and at 12-week follow-up. Scores could range from 14 - 70 on the overall total. Higher scores indicated better performance. | Mean | Full Range | Scores on a scale |
| |||||||||
| Community Reinforcement and Family Training (CRAFT) Knowledge Test | Measuring the proficiency with which participants answer questions about the CRAFT approach. The 20-item CRAFT Knowledge Test was scored by calculating the number of correct answers for each individual and then averaging scores across participants within each group (T, TM, TMC). Scores could range from 0 - 20. Higher scores indicate greater knowledge. | Mean | Full Range | Score on knowledge quiz |
| |||||||||
| Implementation potential scale (IPS) | Mean Implementation Potential Scores (IPS) scores were computed for each dimension at each assessment point by adding ratings on a 6-point scale (1-6) within each 4 dimensions (Acceptability/Efficacy = 10 items, range 10 - 60; Implementation Commitment = 8 items, range 8 - 48; Administrative Support = 4 items, range 4 - 24; and Organizational Resources = 4 items, range 4 - 24). A single IPS score was calculated by adding all 26 items for overall perceived implementation potential of CRAFT. The total IPS score could range from 26 - 156. Higher scores indicate better implementation potential. | Number analyzed is different from overall, as some participants did not complete each item of the IPS measurement and so did not produce an overall IPS score and were not analyzed. | Mean | Full Range | Scores on a scale |
|
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Community Reinforcement And Family Training (CRAFT) Procedure Fidelity | CRAFT performance on the mock sessions was observed by trained coders who rated performance of each CRAFT treatment entry procedure (6 items), homework procedures (2 items), overall CRAFT approach (2 items), and general clinical skill (4 items) on a 5-point scale (i.e., 1 =poor; 3 =satisfactory; 5 =excellent). A total score was calculated across all 14 items for each participant. Average scores on each procedure and in total were calculated for each participant group at baseline and at 12-week follow-up. Scores could range from 6 - 30 on treatment entry; 2 - 10 on homework and CRAFT approach; 4 - 20 on general clinical skill; and 14 - 70 on the overall total. Higher scores indicated better performance | Posted | Mean | Full Range | Score on a scale | 3 months |
|
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Secondary | Community Reinforcement and Family Training (CRAFT) Knowledge Test | Measuring the proficiency with which participants answer questions about the CRAFT approach. The 20-item CRAFT Knowledge Test was scored by calculating the number of correct answers for each individual and then averaging scores across participants within each group (T, TM, TMC). Scores could range from 0 - 20. Higher scores indicate greater knowledge. | Posted | Mean | Full Range | Score on knowledge quiz | 3 months |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Secondary | Program Implementation Potential Scale | Measure Description: Mean Implementation Potential Scores (IPS) scores were computed for each dimension at each assessment point by adding ratings on a 6-point scale (1-6) within each 4 dimensions (Acceptability/Efficacy = 10 items, range 10 - 60; Implementation Commitment = 8 items, range 8 - 48; Administrative Support = 4 items, range 4 - 24; and Organizational Resources = 4 items, range 4 - 24). A single IPS score was calculated by adding all 26 items for overall perceived implementation potential of CRAFT. The total IPS score could range from 26 - 156. Higher scores indicate better implementation potential. | Posted | Mean | Full Range | score on a scale | 3 months |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Other Pre-specified | New Treatment Entry: Identified Patient Treatment Entry Status | Participants report whether their client's loved one has attended any treatment for their opioid use problem since the baseline assessment by answering questions regarding participation in treatment. In addition, reports of treatment entry to WTV staff were categorized as treatment entry. The outcome is the percentage of participants reporting that their client's loved one (identified patient; IP) entered new treatment | Posted | Number | Percentage of participants | 3 months |
|
Adverse event information was monitored during the intervention, which was 12 weeks for participants from baseline to follow up.
This was a brief, minimal risk study of counselor training methods in a healthy population. Risks were: 1. Breach of confidentiality, 2. Discomfort completing measures, 3. Perceived invasion of privacy, 4. Perceived coercion to participate, 5. Disappointment in random assignment.
Staff were trained to report AEs and SAEs that were mentioned during digital interactions.
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | T - Digital Tutorial Overview | A digital tutorial consisting of a curriculum dashboard for review of 10 modules, including videos, PDFs, text and quizzes, which are to be self-administered over two weeks. Modules remain available during the 10-week post tutorial period. Participants receive weekly contact encouraging engagement in all of the materials available to them. | 0 | 15 | 0 | 15 | 0 | 15 |
| EG001 | TM - Digital Tutorial Plus Training Materials | Participants receive the digital tutorial (T) plus access to 10 modules of digital training materials released weekly over the 10-week post tutorial period. | 0 | 16 | 0 | 16 | 0 | 16 |
| EG002 | TMC - Digital Tutorial Plus Training Materials Plus Feedback and Coaching | Participants receive the digital tutorial (T) plus the digital Training materials (TM) plus they submit audio recordings of sessions with clients and receive feedback on their application of CRAFT and coaching on how to improve. Behavioral: Feedback and Coaching: 10 weeks post-tutorial access to additional digital training materials and systematic feedback and coaching. | 0 | 16 | 0 | 16 | 0 | 16 |
Not provided
Not provided
Not provided
Not provided
Not provided
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Jane Macky, PI/CEO | We The Village, Inc. | 91768344267 | jane@wethevillage.co |
| Prot_000.pdf |
| SAP | No | Yes | No | Statistical Analysis Plan | Sep 26, 2023 | Nov 11, 2024 | SAP_001.pdf |
| ICF | No | No | Yes | Informed Consent Form | Jul 22, 2023 | Nov 7, 2024 | ICF_002.pdf |
| ID | Term |
|---|---|
| D019966 | Substance-Related Disorders |
| ID | Term |
|---|---|
| D064419 | Chemically-Induced Disorders |
| D001523 | Mental Disorders |
Not provided
Not provided
|
|
|
|
|
|
|
|
| t-test, 1 sided |
| 0.00000503 |
| Non-Inferiority |
test of non-inferiority is H0: control>=treatment vs HA: control\ |
|
|
|
Participants receive the digital tutorial (T) plus the digital Training materials (TM) plus they submit audio recordings of sessions with clients and receive feedback on their application of CRAFT and coaching on how to improve. Behavioral: Feedback and Coaching: 10 weeks post-tutorial access to additional digital training materials and systematic feedback and coaching. |
|
|
|
|
|