Testing the Implementation of a Toolbox to Optimize Data Collection and Data Quality of the National Medical Quality Indicators in Long-term Care Facilities: A Pilot Study. (NIP-Q-UPGRADE Subaim 1.8)

Testing the Implementation of a Toolbox to Optimize Data Collection and Data Quality of the National Medical Quality Indicators in Long-term Care Facilities: A Pilot Study Within the National Implementation Programme NIP-Q-UPGRADE

Since 2019, long-term care facilities in Switzerland are obliged by the Federal Insurance Law (KVG, Art. 59a) to report data for the calculation and public reporting of medical quality indicators (MQI). By 2024, this is done in four clinical domains: polypharmacy, pain, malnutrition and the use of physical restraints. This data is used for both monitoring quality of care on a national level and for internal quality of care development. To be valid and reliable, MQI data needs to be collected according to specified measurement instructions. An ethnographic study conducted within the NIP-Q-UPGRADE identified numerous challenges, which can lead to poor data quality.

The overall aim of this pilot study is to test the implementation of a data quality development toolkit concerning the MQI.

The toolkit uses a train-the-trainer strategy. The research team will prepare external training providers to train delegated staff from the long-term care facilities (further called champions), who will then train and support their co-workers to collect reliable MQI data. The research team developed training and support materials and organized an e-mail contact centre for MQI related questions for the participating facilities.

Implementation outcomes will be assessed at two levels: long-term care facilities and the external training providers.

Objectives at the external training provider level:

1. To determine the acceptability and feasibility of the training and support materials.
2. To determine the fidelity to the training and adaptations made when implementing it.
3. To identify the barriers and facilitators for the implementation of the training.
4. To measure the costs associated with delivering the training.

Objectives at the long-term care facility level:

1. To determine the acceptability and the feasibility of the data quality development toolkit components.
2. To determine the fidelity to toolkit components and adaptations made when implementing it.
3. To identify the barriers and facilitators for the implementation of the toolkit.
4. To measure the costs associated with implementing the toolkit.

A one-group experimental study will be performed including a multiple methods evaluation.

Participants will be recruited at two levels:

• the provider responsible for delivering the training to the champions from the long-term care facilities,
• long-term care facilities who will implement the data quality development toolkit and select the champions to be sent to the training.

The external training provider is a company with experience in training staff of long-term care facilities in performing needs assessment with residents and in understanding and using the current MQI. The company will nominate employees to be instructed by the research team (December 2024) on how to conduct the developed training for facility champions. They will take up the organization and conduct of the trainings in three languages all regions of Switzerland. The research team will inform the training participants about the study and the data collection.

At facility level, five to ten long-term care facilities per Swiss language region (German, French and Italian speaking) will be recruited between November and December 2024 to implement the data quality development toolkit (i.e., a max. of 30 facilities in total over all language regions). At least one person per facility will be trained between January and March 2025 to act as a champion in the data quality development toolkit and perform tasks such as training of fellow staff and data quality monitoring (1 full day training onsite, two online trainings of 4h, resp. 2h with 2-4 weeks in-between). Trainings will be language-specific.

Individual study participants will be persons involved in delivering and coordinating champion trainings. In long-term care facilities we aim to collect data from the champions, the direct care staff at different educational levels, management staff and staff responsible for quality in the facilities. All individual participants will be asked to consent for data collection.

Data will be collected between November 2024 and June 2025:

At the training provider level

Quantitative data:

Activity logs: The costs of organizing and delivering the trainings will be assessed by using activity logbooks filled in continuously by the staff organizing and conducting the training (November to March 2025)

Qualitative data:

Interviews or group discussion: Acceptability, feasibility, fidelity, and adaptations to the toolkit, and barriers and facilitators to the implementation of the champion training will be assessed through interviews or group discussions with the involved staff after each of the three training session (January to March 2025, in total 9 interviews or group discussions, 3 per language region).

At the long-term care facility level

Quantitative data:

Online survey: Acceptability, feasibility and fidelity will be assessed via online surveys of involved staff at different levels (e.g., nurses, nurse assistants, management, champions) in March 2025. The surveys will also ask for background information on the facilities and participants.

Survey data will be collected in a secure online electronic data collection platform (REDCap).

Activity logbooks: Costs associated with the implementation will be assessed by using activity logbooks filled in by the champions and management.

Qualitative data:

Focus groups: Acceptability, feasibility, fidelity, and adaptations to the toolkit, and barriers and facilitators to implementation will be assessed through focus group per language region per staff group coming from different facilities:

1. 1-2 focus groups with management staff and staff responsible for quality (March 2025, total over all language regions 3-6 focus groups).
2. 1-2 focus groups with champions (March 2025 and June 2025, over all language regions 3-6 focus groups per time point, 6-12 in total)
3. 1-2 focus groups with nurses and care staff exposed to the toolkit (March 2025, total over all language regions 3-6 focus groups)

Inclusion criteria:

1. External training providers:

   1. willing to implement trainings as designed by the research team and to all interested long-term care facilities
   2. have capacity to provide the trainers and infrastructure for the trainings - agree to non-commercial use of training materials

2. Trainer:

   1. with competence in training staff of long-term care facilities
   2. with knowledge on data collection of the current MQIs

3. Long-term care facilities:

   1. with a cantonal recognition as a residential long-term care facility
   2. willing to implement the toolkit
   3. which can nominate at least one champion

4. Champions:

   1. Long-term care facility employees motivated to take up the role
   2. having sufficient knowledge of the residents, infrastructure and processes in the facility (e.g., resident care, needs assessment instrument, electronic health records)
   3. Ideally with experience in leadership, staff training, MQI data collection and quality monitoring, e.g., nurse, nurse expert, quality manager, needs assessment instrument manager

5. Management and staff responsible for quality:

   1. any level of management staff and staff responsible for quality in long-term care facility e.g., director of nursing, team leader, quality manager
   2. directly involved in supporting the implementation of the toolkit or exposed to its content

6. Nursing and care staff:

   1. Any level of nursing or care staff e.g., registered nurses, licensed practical nurses, nurse aids involved in collecting data for MQI
   2. exposed to the content of the toolkit (i.e., internal trainings, feedback, support materials), e.g., registered nurses, licensed practical nurses, nurse aids

Exclusion criteria:

1. long-term care facilities that are participants of the study "Data Quality and National Quality Indicators in Long-term Care Facilities: a Validation Study and Evaluation Study"