Developing and Testing a Social Network Data Capture Tool... | NCT06659003

ID	Type	Description	Link
R34DA052216	U.S. NIH Grant/Contract		View source

Status Module

Name	Class
National Institute on Drug Abuse (NIDA)	NIH

Description Module

Detailed Description

This study conducted a preliminary pilot implementation which integrated our existing social network software - Network Canvas - into Chicago Partner Services in order to understand the feasibility and acceptability of this integration, and to gather preliminary evidence of potential efficacy in improving Partner Services metrics. Specifically, the satisfaction of clients, of DIS, and of public health officials will be assessed. Furthermore, we will track implementation quality and sustainability. Finally, preliminary evidence of efficacy will be captured through a pre-/post-test historical control design evaluating the data quality, the proportion of partners notified, and the timeliness of interviewing, testing and linkage to care.

PRIMARY OUTCOMES Feasibility: We will assessed the feasibility of our initial implementation of Network Canvas. We define feasibility here as satisfaction with and usability of all major areas of our initial reconfiguration of Network Canvas for Howard Brown. For example, we will measured the satisfaction with and usability of our touchscreen interfaces, our procedures for deployment and data management, and important logistical supports such as our training materials, the support provided by our team, and our procedures for evaluation. Data came from KIIs where stakeholders at multiple levels within Howard Brown and CDPH responded to open-ended questions about implementation, usability, and ease of use, as well as complete a modified form of the User Satisfaction and Usability Measure to assess their perspective on the feasibility of Network Canvas. We will further assess feasibility by monitoring program data on uptake.

Acceptability: Our first measure of acceptability will be Fidelity. We will assess the fidelity or quality of implementation of our initial implementation of Network Canvas. We define fidelity here as adherence to interview protocols, deployment protocols, and data workflow protocols. Data will come from a mixture of staff self-ratings of adherence during KIIs and periodic supervision meetings, and researcher ratings of adherence by our staff. The assessment of implementation quality is not just an important outcome in year 3 for us to demonstrate acceptability; it will also serves as a feedback loop to ensure high quality implementation. Further, by beginning assessment in year 2, our team will have the opportunity to adjust and improve our strategy for implementation as well. For example, we may find it necessary to refine our training materials, or the design of our software, or our strategy for coaching and supervision.

Our second measure of acceptability will be Sustainability - or the extent to which our program is able to persist and what ongoing supports would be necessary from our team. Like fidelity, early conversations about sustainability will serve as a feedback loop that will allow our team to first identify the important drivers of implementation in Chicago and other health departments, and then shape our initial design to be sustainable. Conversations about sustainability will occur as early as year 1. Sustainability will primarily be assessed via KIIs with individuals in leadership positions. For those outside of Chicago, we will share Chicago implementation protocols to understand how sustainability may differ across the country.

SECONDARY OUTCOME Preliminary Evidence of Efficacy: To provide us with preliminary evidence of the efficacy of Network Canvas on Partner Service Program outcomes, we will work closely with Howard Brown and CDPH to analyze anonymized administrative data. While we anticipate that our requested metrics will be largely standard for CDPH's analysts, as the majority are tracked for yearly reporting to the Centers for Disease Control and Prevention (CDC), our team may need to run analyses ourselves. If that occurs, as data received by our team will be completely stripped of identifiers, this work will not be considered human subjects research. All analyses of efficacy will utilize a pre-/post-test measurement - specifically a historical control design - where we will compare program data obtained in the years prior (excluding 2020 due to COVID-19) to program data obtained during the one-year period during full implementation. We have chosen a number of metrics based primarily on the CDC's 18-1802 Evaluation and Performance Measurement Plan for Partner Services, as well as two other important studies which contributed to defining important process and outcome measures of Partner Services (Bernstein 2014 & Marcus 2009). These HIV and program metrics span data quality, the proportion of partners that are notified, and timeliness.

Design Module

Interventional Study Design

Biospecimen

No data available

No data is available for this block.

Arms/Interventions Module

Arm Groups

Label	Type	Description	Intervention Names
Pilot Implementation		In order to understand feasibility and acceptability of the pilot implementation, we had key informants complete structured assessments - the majority of these key informants were Partner Services Staff Members (DIS or DIS Managers) from Chicago who reported on their experiences of the initial installation and pilot activities and the feasibility and acceptability of Network Canvas. Key informants also included directors of STD/HIV Prevention Programs, Informational Technology Staff responsible for deploying and maintaining the technical systems which support or are connected to Partner Services, and local Chicago Public Health Surveillance Staff Members. To evaluate our secondary outcome (Preliminary Efficacy), we worked with Howard Brown and CDPH to obtain anonymized program-level administrative metrics. As data received by our team was completely stripped of identifiers, this work was considered 'exempt' human subjects research.	Other: Pilot Implementation of Network Canvas into HBH Partner Services

Interventions

Name	Type	Description	Arm Group Labels	Other Names
Pilot Implementation of Network Canvas into HBH Partner Services	Other	Our team deployed our network data capture software - Network Canvas - into Partner Services at HBH to examine feasibility and acceptability and to provide initial evidence of efficacy (examining impacts on data quality, number of partners notified, and timeliness). Further, our team worked closely with HBH on developing implementation strategies, a Network Canvas interview protocol, evaluation measures, and training materials for their staff. Finally, we provided the HBH team technical support, and regular coaching, supervision, and evaluation.

Outcomes Module

Primary Outcomes

Measure	Description	Time Frame
Feasibility	We will assess the feasibility of our initial implementation of Network Canvas. We define feasibility here as satisfaction with and usability of all major areas of our initial reconfiguration of Network Canvas for CDPH. For example, we will measure the satisfaction with and usability of our touchscreen interfaces, our procedures for deployment and data management, and important logistical supports such as our training materials, the support provided by our team, and our procedures for evaluation. Data will come from KIIs where stakeholders at multiple levels will respond to open-ended questions about implementation, usability, and ease of use, as well as complete a modified form of the User Satisfaction and Usability Measure to assess their perspective on the feasibility of Network Canvas.	12 months
Acceptability	Our first measure of acceptability will be Fidelity. We will assess the fidelity or quality of implementation of our initial implementation of Network Canvas. We define fidelity here as adherence to interview protocols, deployment protocols, and data workflow protocols. Data will come from a mixture of staff self-ratings of adherence and periodic supervision meetings, and researcher ratings of adherence by our staff. The assessment of implementation quality serves as a feedback loop to ensure high quality implementation, so our team has the opportunity to adjust and improve our strategy for implementation. Our second measure of acceptability will be Sustainability - or the extent to which our program is able to persist and what ongoing supports would be necessary from our team.	12 months

Secondary Outcomes

Measure	Description	Time Frame
Preliminary Evidence of Efficacy	To provide us with preliminary evidence of the efficacy of Network Canvas on Partner Service Program outcomes, we worked closely with Howard Brown and CDPH to obtain anonymized administrative data. These metrics are largely standard for CDPH's analysts, as the majority are tracked for yearly reporting to the Centers for Disease Control and Prevention (CDC). All obtained data will be completely stripped of identifiers, therefore this work will be considered exempt. All analyses of efficacy will utilize a pre-/post-test measurement - specifically a historical control design - where we will compare program data obtained in the years prior 2019 - 2022 (excluding 2020 due to COVID-19) to program data obtained during the one-year period of implementation. Specific program metrics include data quality, number of partners notified, and timeliness.

Eligibility Module