A Pilot Randomised Controlled Trial of 'The Shadow of Tallystick Valley' for Children and Young People Experiencing Family Substance Use
A Pilot Randomised Controlled Trial of 'The Shadow of Tallystick Valley' for Children and Young People Experiencing Family Substance Use
The study is investigating the feasibility and acceptability of the story-based intervention, The Shadows of Tallystick Valley, aimed at improving the psychological wellbeing and resilience of children and young people who are affected by familial substance use. A secondary aim of the study is to identify whether there is a 'signal of efficacy'. The early intervention is a story and activity book designed and developed by Book of Beasties, in collaboration with the charity Change Grow Live (CGL), who work directly with children and young people experiencing familial substance use. The intervention is used by s at CGL with children and young people engaged with the service. In the present study, we aim to evaluate the story-based intervention within a pilot randomised controlled trial. Participants will be randomised to either receive the intervention or to join a waitlist for the same intervention. The effects of the story-based intervention will be assessed using pre and post psychological well-being and resilience measures, including KidCOPE, the Stirling Children's Wellbeing Scale and the Child and Youth Resilience Measure. The primary outcome measures are concerned with overall psychological wellbeing.
The aims of this pilot trial are as follows:
To determine whether a full trial is justified; To determine the feasibility and acceptability of the story-based intervention in improving psychological wellbeing and emotional literacy in children and young people experiencing familial substance use; To establish the effect size on the co-primary outcomes for a sample size calculation for a definitive trial.
To establish the feasibility of the intervention, we will collect data on the primary outcome for at least 80% of the recruitment target, and have an attrition rate that does not exceed 40%. A definitive trial will be justified if we are able to successfully recruit and retain participants in the trial, and if both the trial procedures and intervention are deemed to be acceptable to participants. Although the primary aim of pilot RCTs is to answer questions related to feasibility, an important secondary aim is to determine whether there is a signal of efficacy so as to inform the decision to progress to a definitive trial (Beets et al., 2021). The between-group effects will determine whether there is a signal of efficacy in favour of the Shadow of Tallystick Valley intervention and further support the need for a definitive randomised controlled trial (RCT). A signal of efficacy will be considered to be found if the between-group effect size on the co-primary outcomes is in favour of the intervention. Where these conditions are met, this study will therein provide the parameters needed to estimate the sample size for a definitive RCT. We will assess whether the study design is acceptable to participants using recruitment and retention rates (i.e., study and intervention uptake and dropout rates) and qualitative interviews with participants.
The intervention will be offered to children and young people already connected with CGL. Children and young people are referred to the service via a referral from an adult known to them. This can include (but is not limited to) family members, social workers, teachers, school staff, substances, or other youth worker professionals.
Recruitment methods:
Study advert and information pack will be shared by staff across the service with all children and young people who meet the inclusion criteria. If the child or young person wants to proceed, both they and their parent or caregiver must provide either written or verbal consent. Consent will be collected by the assigned support worker at Change Grow Live.
If in the instance a participant withdraws their consent, they will have two weeks after the intervention has been delivered to do so and relevant data will be removed and destroyed. Beyond the two week mark, the data will be written up. If a parent/ caregiver withdraws their consent, CGL would discuss the parents' concerns with them in the hope they can resolve them. If parents/caregiver consent is still withdrawn and the child is under 13, the participant will no longer be involved in the study and relevant data will be destroyed. If in the instance the parent/caregiver withdraws consent for a young person who is over 13 years of age and Gillick Competent, the young person will be able to continue in the study. This is inline with CGL's policy and procedures. If in the instance the parent / caregiver withdraws consent for a child below the age of 13 years, the child or young person will be withdrawn from the study.
The target sample size is based on guidelines by Whitehead et al. (2015) for a pilot trial prior to a main trial with 90% power and two-sided 5% significance expecting a small to medium effect size. We plan to recruit 25 participants per arm (50 in total).
Experimental Design
The present study is a single-blind external pilot randomised controlled trial with two parallel arms including optional qualitative feedback. Support Workers will children and young people (aged between 7 and 18 years). Interested participants will be given a participant information sheet. After reading the PIS, if potential participants are interested in participating in the trial, they will complete an eligibility assessment to determine whether they meet the inclusion/exclusion criteria. If the participant meets the eligibility criteria, they will be invited to complete a consent form. Prospective participants will not be able to progress in the trial without completing the consent statement.
Once participants have provided consent and consent has been given from parent/carer, participants will be allocated a unique ID code and asked to complete the baseline (T0) assessment. A file linking the participants' contact information with the unique IDs will be stored securely in a password-protected file in a OneDrive folder held on the University of Surrey's system. The PI will have the password for this file and give access to this to other members of the research team as needed. The password will not be shared outside of the research team. The T0 assessment can be completed either online or in person. There will be video instructions on how to complete the questionnaires for children and young people to then complete them independently. These videos will be produced after ethical approval so that the information conveyed is in line with the approved protocol and study materials. After the T0 assessment has been completed, participants will be randomly allocated to either receive the immediate intervention arm or a wait-list control group. The outcome of this randomisation will be emailed to the PI and will be logged in the secure, password protected file. The randomisation will be conducted using the simple randomisation function available from Sealed Envelope. Participants will not know which arm they have been allocated to. The support workers will deliver the intervention with the children and young people allocated to the control group of the study. They will have received at least one full day of training designed and delivered by CGL's National Hidden Head Lead. Participants will be contacted 18 weeks post-randomisation to complete the T1 assessment. The T1 assessment can be completed in person or online depending on participants preference. The T1 assessment will replicate the T0 assessment. After completing the T1 assessment, participants will be presented with an end of trial debrief statement.
Data Collection The trial will utilise a mixed methods approach, collecting both quantitative and qualitative data. The quantitative data will be collected at T0 and T1. The qualitative data will be collected from the intervention group in the form of written feedback form or an audio recording after the T1 assessment. Data collection should not involve contact with adults outside of CGL but must have independence to allow for adequate blinding. The data can be collected either online via Qualtrics or in hard copy. There is the potential to have video instructions on how to complete the questionnaires for children and young people to then complete them independently.
The main trial data will be entered into SPSS by the principal investigator. The items will be coded and scored in line with the original questionnaire protocols. A random selection of 20% of the data will be checked against the source (i.e. hard copies of questionnaires) to ensure data quality.
The Principal Investigator will act as the data custodian. The data will be owned by the lead organisation, the University of Surrey.
Data analysis All of the variables will be summarised using descriptive statistics by arm at each time point. We will calculate Cohen's d between-group effect sizes with 95% confidence intervals, comparing the T1 scores of the intervention versus control arms, adjusting effects for the baseline scores using an ANCOVA. The level of missing data for all outcome measures will be reported. As the present study is a pilot trial, we will not be testing any hypotheses and are instead testing evidence for a signal of efficacy in the desired direction.
The research process data will be used to understand the rates of recruitment and retention at all stages of the study. We will report the number of participants who completed and dropped out at each stage of the trial in the form of a CONSORT diagram. The quantitative adherence data will be the number of sessions completed with a child or young person and used to understand the degree of engagement with the intervention amongst participants. We will report the responses using descriptive statistics and describe any patterns that can be observed.
All of the data collected over the course of the study will be collected, stored and maintained in line with the General Data Protection Regulation (GDPR) (Information Commissioner's Office, 2018) . Any hard copies will be scanned so as to become electronic documents. The hard copies will be destroyed. Electronic documents/data will all be stored within a University of Surrey OneDrive folder and protected with a password, accessed only by the research team. The PI will have all of the passwords and share these with members of the research team as needed. No one outside of the research team will have access to the passwords. The PI will assume responsibility for ensuring adherence to the data security protocol.
Data will be retained in accordance with the General Data Protection Regulation (GDPR) (Information Commissioner's Office, 2018) and (Medical Research Council, 2012) policies on data storage and archiving. Once the data analysis has been finalised, all anonymised data will be archived at the University of Surrey for up to 10 years. The anonymised data will be retained indefinitely by the PI.
Ethical considerations Consent to take part in this study will be informed. All participants and parents/carers of participants will be given the Participant Information Sheet (PIS) and will not be limited in terms of the amount of time they want to read through it. All participants will be told within the PIS and the consent forms that they can withdraw from the research study at any point. Participants will be asked to sign an item on the consent form that confirms that they are aware of their right to withdraw, and that they are not obligated to provide a reason for leaving the study.
All of the data collected within the research study will be treated as confidential. Identifiable data will not be shared outside of the research team. The study will comply with the General Data Protection Regulation (GDPR) and Data Protection Act 2018, which require data to be de-identified as soon as it is practical to do so. Participants will be identified on all documents (both hard copy and electronic) containing research data using a unique participant ID code. All documents will be stored securely and only accessible by the research team. The research team will safeguard the privacy of participants' data.
Participants will be informed within the PIS and consent form that anything they share over the course of the study will be treated as confidential, except for where this information puts themselves or other people at risk. Where confidentiality needs to be broken for safeguarding reasons, the information will only be shared with persons who have a responsibility to monitor and minimise this risk (e.g. s, personal tutors, university counselling team, local safeguarding authorities, mental health services). Participants will be asked to sign an item on the consent form that confirms that they understand our confidentiality policy.
Participants will be reimbursed for their time and effort at a rate of £5 for pre and £5 for post questionnaires completed (£10 in total) in the form of vouchers.
Inclusion Criteria:
Exclusion Criteria:
i.smith@surrey.ac.uk07442256086