Not provided
| ID | Type | Description | Link |
|---|---|---|---|
| R01MH110524-01 | U.S. NIH Grant/Contract | View source |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Class |
|---|---|
| National Institute of Mental Health (NIMH) | NIH |
| Thresholds Inc. | INDUSTRY |
| SIMmersion, LLC | INDUSTRY |
| University of Utah |
Not provided
Not provided
Not provided
Not provided
This is a randomized controlled trial to evaluate the community-based effectiveness of virtual reality job interview training (VR-JIT). Northwestern University is partnering with Thresholds Inc. to evaluate the effectiveness of VR-JIT at improving interviewing skills and access to employment. In addition, we will evaluate the cost effectiveness of VR-JIT and the process for implementing VR-JIT at Thresholds.
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Label | Type | Description | Intervention Names |
|---|---|---|---|
| Virtual Reality Job Interview Training | Experimental | Virtual Reality Job Interview Training |
|
| Supported Employment (Services as Usual) | Other | Supported Employment (Services as Usual) |
|
| Name | Type | Description | Arm Group Labels | Other Names |
|---|---|---|---|---|
| Virtual Reality Job Interview Training | Behavioral | Job interview training using virtual reality software created by SIMmersion, Inc, in addition to standard supported employment services. |
| Measure | Description | Time Frame |
|---|---|---|
| Employment Rates | Employment rates at 9-month follow-up visit measured with questionnaire. | 9 month Follow-Up from Randomization Date |
| Time to Employment | We evaluated the number of days between randomization and obtaining employment using a questionnaire administered over phone interviews with the subject and also verifying with Supported Employment (IPS) tracking system. | 9 month Follow-Up from Randomization Date |
| Measure | Description | Time Frame |
|---|---|---|
| Job Interview Skills | Interviewing skills will be measured using a role-play measure in which subjects act out two job interview scenarios with trained actors. Interviews will be video recorded and scored. An average of the two scenarios at baseline was used to create a single pretest score and an average of the two scenarios at posttest was used to create a single posttest score. The method of assessment is the job interview skills rating scale as measured by the Mock Interview Rating Scale. Possible scores range from 8 to 40, with higher scores indicating better interview skills. |
Not provided
Inclusion Criteria:
Over the age of 18
Diagnosis of any of the following:
fluency in English
6th grade reading level
Enrolled in Supported Employment/Individual Placement Support (IPS)
Active IPS enrollee as indicated by at least 1 contact with his/her Employment Specialist in the past 30 days.
Currently unemployed or underemployed
Planning to go on interviews within 4 weeks of registration on study.
Willing to be video recorded for certain study elements.
Must have given signed, informed consent prior to registration on study.
Exclusion Criteria:
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
| Name | Affiliation | Role |
|---|---|---|
| Matthew J Smith, PhD | Northwestern University | Principal Investigator |
| Facility | Status | City | State | ZIP | Country | Contacts |
|---|---|---|---|---|---|---|
| Thresholds Bridge South | Chicago | Illinois | 60609 | United States | ||
| Thresholds Ogden |
| PubMed Identifier | Type | Citation | Retractions |
|---|---|---|---|
| 37181877 | Derived | Smith MJ, Burke-Miller JK, Bornheimer LA, Ross B, Bell MD, McGurk SR, Mueser KT, Brown A, Prestipino J, Borghani N, Nelson K, Lieberman T, Pashka NJ, Razzano LA, Kallen MA. Psychometric properties of the mock interview rating scale for schizophrenia and other serious mental illnesses. Front Psychiatry. 2023 Apr 27;14:1150307. doi: 10.3389/fpsyt.2023.1150307. eCollection 2023. |
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Not provided
Randomized Control Trial Phase: 105 people were enrolled and signed consent forms, but 6 people dropped out of the study before randomization and were not assigned to a group. Therefore, the Randomized Control Trial Phase includes 99 people who signed consent forms and were actually randomized into the study.
Focus Group Phase: This includes both Thresholds staff focus groups as well as focus groups completed by those who received the intervention in the Randomized Control Trial Phase.
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| FG000 | Supported Employment (Services as Usual) | Supported Employment (Services as Usual) Supported Employment (Services as Usual): Standard supported employment services. |
| FG001 | Virtual Reality Job Interview Training | Virtual Reality Job Interview Training Virtual Reality Job Interview Training: Job interview training using virtual reality software created by SIMmersion, Inc, in addition to standard supported employment services. |
| FG002 | Thresholds Staff | Thresholds Staff members who consented to provide implementation data. |
| FG003 | Focus Group | Focus groups completed by Thresholds staff members and by members of the intervention group who received Virtual Reality Job Interview Training. |
| Title | Milestones | Reasons Not Completed | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Randomized Control Trial Phase |
|
| ||||||||||||||||||
| Focus Group Phase |
|
Not provided
Not provided
| ID | Title | Description |
|---|---|---|
| BG000 | Supported Employment (Services as Usual) | Supported Employment (Services as Usual) Supported Employment (Services as Usual): Standard supported employment services. |
| BG001 | Virtual Reality Job Interview Training |
| Units | Counts |
|---|---|
| Participants |
|
| Title | Description | Population Description | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Denominator Units Selected | Denominators | Classes |
|---|---|---|---|---|---|---|---|---|---|
| Age, Continuous | Data were not collected for the Thresholds Group and Focus Groups. |
| Type | Title | Description | Population Description | Reporting Status | Anticipated Posting Date | Parameter Type | Dispersion Type | Unit of Measure | Calculate Percentage | Time Frame | Units Analyzed | Denominator Units Selected | Arm/Group Information | Denominators | Classes | Analyses | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Primary | Employment Rates | Employment rates at 9-month follow-up visit measured with questionnaire. | Posted | Count of Participants | Participants | 9 month Follow-Up from Randomization Date |
|
Adverse event data was collected through study completion, an average of 12 months.
Not provided
Not provided
| ID | Title | Description | Deaths (Affected) | Deaths (At Risk) | Serious Events (Affected) | Serious Events (At Risk) | Other Events (Affected) | Other Events (At Risk) |
|---|---|---|---|---|---|---|---|---|
| EG000 | Supported Employment (Services as Usual) | Supported Employment (Services as Usual) Supported Employment (Services as Usual): Standard supported employment services. |
Not provided
Not provided
Employment specialists implemented VR-JIT at a central computer lab, which was changed to research staff at local neighborhood sites. Research staff stepped in to avoid delays. Recruitment challenges necessitated reducing targeted enrollment from 160 to 133 participants and from a 1:1 randomization scheme to 3:2 randomization . We initially planned to include only participants who were within 2 weeks of their enrollment in IPS. However, we expanded to all clients currently receiving IPS.
| Title | Organization | Phone | Extension | |
|---|---|---|---|---|
| Brittany Ross | University of Michigan | (734) 764-2368 | rossbrit@umich.edu |
Not provided
| Type | Includes Protocol | Includes SAP | Includes ICF | Document Label | Document Date | Document Uploaded Date | Document File Name |
|---|---|---|---|---|---|---|---|
| Prot_SAP | Yes | Yes | No | Study Protocol and Statistical Analysis Plan | Feb 7, 2019 | Jun 23, 2022 | Prot_SAP_000.pdf |
| ICF | No | No | Yes | Informed Consent Form: RCT Consent Form | Dec 12, 2018 | Jun 23, 2022 | ICF_001.pdf |
| ICF | No | No | Yes | Informed Consent Form: Staff Consent Form | Dec 12, 2018 | Jun 23, 2022 | ICF_002.pdf |
| ICF | No | No | Yes | Informed Consent Form: Focus Group Consent Form | Dec 12, 2018 | Jun 23, 2022 | ICF_003.pdf |
Not provided
| ID | Term |
|---|---|
| D012559 | Schizophrenia |
| D011618 | Psychotic Disorders |
| D001714 | Bipolar Disorder |
| D003866 | Depressive Disorder |
| ID | Term |
|---|---|
| D019967 | Schizophrenia Spectrum and Other Psychotic Disorders |
| D001523 | Mental Disorders |
| D000068105 | Bipolar and Related Disorders |
| D019964 | Mood Disorders |
Not provided
Not provided
| ID | Term |
|---|---|
| D016832 | Employment, Supported |
| ID | Term |
|---|---|
| D004651 | Employment |
| D012959 | Socioeconomic Factors |
| D011154 | Population Characteristics |
| D012050 | Rehabilitation, Vocational |
Not provided
Not provided
| OTHER |
Not provided
Not provided
Not provided
Some, but not all, outcomes require masking for the assessor.
| Supported Employment (Services as Usual) | Other | Standard supported employment services. |
|
| Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
| Interview Self-Confidence | Self-reported interview self-confidence. Participants self-reported their confidence in interview skills at pretest and posttest by using a nine-item survey, with items rated on a 7-point scale (1, extremely unskilled, to 7, extremely skilled); total scores were computed across all items. The minimum score is 9 and the maximum score would be 63. Higher scores indicate higher self-confidence in interview skills. | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
| Interview Anxiety | Self-reported measure of interviewing anxiety completed at pretest and posttest. Participants rated their interview anxiety with an adapted version of the 34-item Personal Report of Public Speaking Apprehension (PRSPA); the phrase "publics peaking" was replaced with "job interviewing." Items were coded from 1, strongly disagree, to 5, strongly agree. Total scores were computed by using the PRSPA's validated two-step total score procedure with the minimum score being 34 and maximum score being 170. Higher scores indicate higher interview anxiety. | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
| Social Competence | Measured by Social Skills Performance Assessment (SSPA). Roleplay performance: The SSPA includes two brief (3-minute) roleplays in which participants engage in a conversation with an unknown confederate who plays the role of a new neighbor(NN) or a landlord (LL). The NN and LL role plays were video recorded at the pre- and posttest visits and were blindly rated by use of an anchoring system. The NN roleplay was scored on eight items via a 5-point scale (e.g., 5,very interested, to 1, very disinterested), and the LL roleplay was scored on nine items via a 5-point scale (e.g., 5,very focused, to 1, very unfocused). The two role-play scores were combined to create one total pretest score and one total posttest score. Sum scores could have a minimum of 17 and maximum of 85. Higher scores indicated better skills. | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
| Psychological Distress - Brief Psychiatric Rating Scale | The Brief Psychiatric Rating Scale (BPRS) consists of 18 items and uses a seven-item Likert scale with 1 = "not present", and 7 = "extremely severe". Sum scores can range from 18 to 126. Higher scores indicate more symptoms. | Pretest (Baseline) and 6 Month Follow Up from Randomization Date |
| Chicago |
| Illinois |
| 60613 |
| United States |
| Thresholds Bridge Southwest | Chicago | Illinois | 60632 | United States |
| Thresholds Bridge West | Chicago | Illinois | 60644 | United States |
| COVID Quarantine |
|
| Participant was in another concurrent study |
|
| Lost to Follow-up |
|
| COMPLETED |
|
| NOT COMPLETED |
|
Virtual Reality Job Interview Training
Virtual Reality Job Interview Training: Job interview training using virtual reality software created by SIMmersion, Inc, in addition to standard supported employment services.
| BG002 | Thresholds Staff | Only sex, ethnicity, and race were collected for the Thresholds Staff group. Not other baseline data was collected for Thresholds Staff. |
| BG003 | Focus Groups | Baseline data were not collected for the Focus Groups. |
| BG004 | Total | Total of all reporting groups |
| Mean |
| Standard Deviation |
| years |
|
| Sex: Female, Male | Thresholds Staff: n=2 participants elected not to respond to the sex question. Focus Groups: Baseline data not collected for this group. | Count of Participants | Participants |
|
| Ethnicity (NIH/OMB) | Data were not collected for the Focus Groups. | Count of Participants | Participants |
|
| Race/Ethnicity, Customized | Threshold Staff: n=4 participants elected not to respond to the race question. Data were not collected for the Focus Groups. | Count of Participants | Participants |
|
| Region of Enrollment | Region of enrollment for Randomized Control Trial Phase only. | Region of enrollment for Randomized Control Trial Phase only. | Number | participants |
|
| Region of Enrollment | Region of enrollment for Focus Groups Phase only. | Region of Enrollment for Focus Group Phase only. | Number | participants |
|
| Years of Education | The following did not answer the question regarding the years of education completed: n=1 for Virtual Reality Job Interview Training group and n=2 for Supported Employment (Services as Usual). Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | years |
|
| Primary Psychiatric Diagnosis | Data were not collected for the Thresholds Group and Focus Groups. | Count of Participants | Participants |
|
| Brief Psychiatric Rating Scale | The Brief Psychiatric Rating Scale (BPRS) consists of 18 items and uses a seven-item Likert scale with 1 = "not present", and 7 = "extremely severe". Sum scores can range from 18 to 126. A higher mean score represents more/severe behavioral health symptoms. | Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | units on a scale |
|
| Community Functioning | As measured by the Specific Levels of Functioning scale. Possible scores range from 30 to 150, with higher scores indicating better functioning. | For the Supported Employment (services as usual) group, n=2 has missing data and did not complete the assessment. Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | units on a scale |
|
| Employment History: Had competitive employment in past 2 years | Data were not collected for the Thresholds Group and Focus Groups. | Count of Participants | Participants |
|
| Employment History: Ever employed full-time | Data were not collected for the Thresholds Group and Focus Groups. | Count of Participants | Participants |
|
| Employment History: Ever employed part-time | Data were not collected for the Thresholds Group and Focus Groups. | Count of Participants | Participants |
|
| Days in IPS at Baseline | The number of days a participant has been involved with Supported Employment (IPS) at baseline timepoint. | Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | days |
|
| Substance Use | Substance Use was measured with the Alcohol Use Disorders Identification Test (AUDIT), the range of possible scores is from 0 to 40, where 0 indicates no problems with alcohol, and higher scores indicate more problems with alcohol. DAST-10 was also used to assess substance use; this is a 10 item scale with yes and no questions. A higher score indicates an increased degree of problems related to drug abuse. Scores can range 0 to 10. | Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | units on a scale |
|
| Cognitive ability | Cognitive ability was measured with the MATRICS Consensus Cognitive Battery (MCCB). This battery generates T scores for the following domains: processing speed, attention-vigilance, verbal working memory, verbal learning, visual learning, and reasoning/problem solving. Mean scores were created across these six domains to create a total mean score for overall neurocognition. The MCCB also includes a separate T score for social cognition based on the Mayer-Salovey-Caruso Emotional Intelligence Test. Higher scores represent better cognitive ability. (normative mean = 50; standard deviation = 10) | Data were not collected for the Thresholds Group and Focus Groups. | Mean | Standard Deviation | T-score |
|
|
|
|
| Primary | Time to Employment | We evaluated the number of days between randomization and obtaining employment using a questionnaire administered over phone interviews with the subject and also verifying with Supported Employment (IPS) tracking system. | Time to employment was only reported for those participants who provided that data and who were employed. Not everyone was employed so they would not have a date or a "time to employment" within the analysis. Therefore, this analysis only reports on the 36 people who did get jobs. | Posted | Mean | Standard Deviation | days | 9 month Follow-Up from Randomization Date |
|
|
|
|
| Secondary | Job Interview Skills | Interviewing skills will be measured using a role-play measure in which subjects act out two job interview scenarios with trained actors. Interviews will be video recorded and scored. An average of the two scenarios at baseline was used to create a single pretest score and an average of the two scenarios at posttest was used to create a single posttest score. The method of assessment is the job interview skills rating scale as measured by the Mock Interview Rating Scale. Possible scores range from 8 to 40, with higher scores indicating better interview skills. | Posted | Mean | Standard Error | score on a scale | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
|
|
|
|
| Secondary | Interview Self-Confidence | Self-reported interview self-confidence. Participants self-reported their confidence in interview skills at pretest and posttest by using a nine-item survey, with items rated on a 7-point scale (1, extremely unskilled, to 7, extremely skilled); total scores were computed across all items. The minimum score is 9 and the maximum score would be 63. Higher scores indicate higher self-confidence in interview skills. | Posted | Mean | Standard Error | score on a scale | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
|
|
|
|
| Secondary | Interview Anxiety | Self-reported measure of interviewing anxiety completed at pretest and posttest. Participants rated their interview anxiety with an adapted version of the 34-item Personal Report of Public Speaking Apprehension (PRSPA); the phrase "publics peaking" was replaced with "job interviewing." Items were coded from 1, strongly disagree, to 5, strongly agree. Total scores were computed by using the PRSPA's validated two-step total score procedure with the minimum score being 34 and maximum score being 170. Higher scores indicate higher interview anxiety. | Posted | Mean | Standard Error | score on a scale | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
|
|
|
|
| Secondary | Social Competence | Measured by Social Skills Performance Assessment (SSPA). Roleplay performance: The SSPA includes two brief (3-minute) roleplays in which participants engage in a conversation with an unknown confederate who plays the role of a new neighbor(NN) or a landlord (LL). The NN and LL role plays were video recorded at the pre- and posttest visits and were blindly rated by use of an anchoring system. The NN roleplay was scored on eight items via a 5-point scale (e.g., 5,very interested, to 1, very disinterested), and the LL roleplay was scored on nine items via a 5-point scale (e.g., 5,very focused, to 1, very unfocused). The two role-play scores were combined to create one total pretest score and one total posttest score. Sum scores could have a minimum of 17 and maximum of 85. Higher scores indicated better skills. | 96 participants (37 Supported Employment and 59 Virtual Reality Job Interview Training) completed the pretest Social Skills Performance Assessment (SSPA) at baseline. We are missing data on 3 participants due to technical difficulties (no video recording to score) or participants refusing to complete. The total number dropped to 67 participants (27 Supported Employment and 40 Virtual Reality Job Interview Training) at posttest due to participant drop out or non completion of the posttest visit. | Posted | Mean | Standard Deviation | score on a scale | Pretest (Baseline) and Posttest (approximately 3 months after Baseline) |
|
|
|
|
| Secondary | Psychological Distress - Brief Psychiatric Rating Scale | The Brief Psychiatric Rating Scale (BPRS) consists of 18 items and uses a seven-item Likert scale with 1 = "not present", and 7 = "extremely severe". Sum scores can range from 18 to 126. Higher scores indicate more symptoms. | For the outcome measure table, 99 participants (38 Supported Employment and 61 Virtual Reality Job Interview Training) completed the pretest Brief Psychiatric (BPRS) at baseline. The total number dropped to 58 participants (25 Supported Employment and 33 Virtual Reality Job Interview Training) at posttest due to participant drop out or non completion of the 6 Month Follow Up visit. | Posted | Mean | Standard Deviation | score on a scale | Pretest (Baseline) and 6 Month Follow Up from Randomization Date |
|
|
|
| 0 |
| 38 |
| 0 |
| 38 |
| 0 |
| 38 |
| EG001 | Virtual Reality Job Interview Training | Virtual Reality Job Interview Training Virtual Reality Job Interview Training: Job interview training using virtual reality software created by SIMmersion, Inc, in addition to standard supported employment services. | 0 | 59 | 0 | 59 | 0 | 59 |
Not provided
Not provided
| D012046 |
| Rehabilitation |
| D006296 | Health Services |
| D005159 | Health Care Facilities Workforce and Services |
| Male |
|
| Not Hispanic or Latino |
|
| Unknown or Not Reported |
|
|
|
|
|
|
|
|
|
|
|
| Posttest |
|
|
| 6 Month BPRS Total |
|
|