key: cord-0819976-fw30mh2g
authors: Logeman, Charlotte; Taddio, Anna; McMurtry, C. Meghan; Bucci, Lucie; MacDonald, Noni; Chalmers, Garth; Gudzak, Victoria; Shah, Vibhuti; Coldham, Joanne; Little, Cheri; Samborn, Tracy; Dribnenki, Cindy; Snider, Joanne
title: Student Feedback to Tailor the CARD™ System for Improving the Immunization Experience at School
date: 2020-09-04
journal: Children (Basel)
DOI: 10.3390/children7090126
sha: a4b54994f960623174d2799b1d3d68a184f3e575
doc_id: 819976
cord_uid: fw30mh2g

Increasing the comfort of vaccine delivery at school is needed to improve the immunization experience for students. We created the CARD™ (C—Comfort, A—Ask, R—Relax and D—Distract) system to address this clinical care gap. Originally designed for grade 7 students, this study examined the perceptions of grade 9 students of CARD™. Grade 9 students who had experience with school-based immunizations, either as recipients or onlookers (n = 7; 100% females 14 years old) participated. Students answered pre–post surveys, reviewed CARD™ educational materials and participated in a semi-structured focus group discussion. The Consolidated Framework for Implementation Research (CFIR) was used as the framework for analysis of qualitative data. Participants reported positive perceptions of CARD™ educational materials and that CARD™ could fit into the school immunization process. CARD™ improved knowledge about effective coping interventions and was recommended for education of both nurses and students. The results provide preliminary evidence that CARD™ is acceptable and appropriate for implementation in grade 9 school-based immunizations.

School-based (mass) immunizations are an efficient method of delivering vaccines to a large number of children. However, this approach is commonly associated with negative experiences in students related to associated fear, pain and fainting [1] . Negative experiences with immunization can lead to the development of needle fears [2] [3] [4] . In addition, they can contribute to immunization non-compliance and other health care-avoidance behaviours [4] .

Seven female grade 9 students (age, 14 years) from a large independent school in Toronto participated in this study on 19 February 2019. The students had prior experience either as recipients (n = 6) or observers (n = 1) of school immunizations.

The parents and students of the entire grade 9 cohort (including male, female and non-binary) were invited to participate by a school administrator; the maximum number of participants allowed was 12. CARD™ had not been previously used at their school. This study was conducted in accordance with the declaration of Helsinki, and the protocol was approved by the research ethics board of the University of Toronto (#36893). Students were given a consent package to review with their guardians. All participants and their guardians signed the consent form before participation. This study was conducted at the school after school hours.

We used similar procedures and instruments as in our prior studies [12] [13] [14] [15] [16] [17] . First, students independently completed attitude surveys about immunization pain and fear and acceptance of immunizations. Then they completed a knowledge test about effective coping strategies during immunization. The knowledge test consisted of 10 dichotomous (yes/no) questions about the effectiveness of various strategies to reduce pain, fear and fainting during immunization. Students were asked to report whether they thought any of the ways described can help to make needles more comfortable, either by making the needle poke hurt less or by making it less scary. This could be for them or someone else. The number of correct answers was summed for a total score out of 10. Included questions were derived from the CPG [12] . The attitudes surveys used Likert scales to assess level of agreement with different statements about immunization pain and fear and acceptance of immunizations. In addition, students reported on their level of fear of immunization needles on a scale of 0 (no fear) to 10 (worst possible fear).

Students then participated in a focus group discussion that lasted approximately 1 h. The discussion was facilitated by a trained team member (AT) using a semi-structured interview guide. Students were asked about their experiences with school immunizations. Then they were shown key educational materials from the CARD™ system developed specifically for education and preparation of students, including 2 videos and 1 pamphlet. Of note, these materials were used during education of students in our prior work [12] [13] [14] [15] [16] . The first video (https://youtu.be/z57vTpb19wQ) reviews immunization-what it is, why it is needed, and what will happen. The second video (https://youtu.be/c41HvgEKQSk) reviews the CARD™ mnemonic (C-Comfort, A-Ask, R-Relax, and D-Distract) and includes vignettes of students undergoing immunization using the strategies based on the mnemonic. The pamphlet (included in reference Taddio et al. [12] ) is a companion to the second (i.e., CARD™) video whereby students can record their preferred coping strategies for immunization. This pamphlet includes examples of coping strategies in each of the letter categories from which the students can choose. Students were asked to fill out the pamphlet with their own preferences for coping strategies for upcoming immunizations. Participants then provided feedback about these materials, including suggestions for changes. Students provided written feedback using a standardized survey that included statements about understandability and quantity of included information that they rated using Likert scales. After this, students repeated the attitude and knowledge surveys. Finally, participants completed a demographic survey that inquired about gender, age, and whether the student had experience with school-based immunizations.

The focus group discussion was audiotaped and transcribed verbatim. The transcript was entered into NVivo (Version 10) for analysis and coded line-by-line using directed content analysis [18] using CFIR as the guiding framework. CFIR provides a menu of constructs that have been associated with effective implementation of complex interventions [11] . It provides a practical guide to assessing potential barriers and facilitators to CARD™ implementation based on theoretically-based constructs. For the purposes of coding, the inner and outer setting were collapsed into one domain called 'setting' in order to simplify the presentation. The transcripts were individually reviewed by three team members (CL, AT, VS). Coding was performed by all members and disagreements were resolved by consensus. In addition, triangulation of the different sources of data (qualitative and quantitative) was conducted. Together, these methods provided assurance for the credibility of the results. Quantitative data were analyzed using descriptive statistics (e.g., median, range). Pre-and post-attitudes survey responses, fear scores, and knowledge test scores were compared using the Wilcoxon Signed Rank test. This non-parametric statistic was selected because of the small sample size. The statistical program SPSS (version 24) was used to analyze the data. A P-value of <0.05 was considered significant.

The data fit into two domains of CFIR: (1) intervention characteristics and (2) setting. They are described in the following section. Examples of quotes are provided in Table 1 .

Design Quality and Packaging (How the Intervention is Bundled, Presented and Assembled) Students reported liking the educational resources. One student suggested making the videos shorter if they were going to be used at the time of immunization (rather than ahead of time). Students reported that they learned about immunization coping strategies from the CARD™ educational materials and about being able to use their preferred coping strategies.

Adaptability (Degree to Which an Intervention Can Be Adapted, Tailored, Refined or Reinvented to Meet Local Needs) Students commented on the ability for the CARD™ system to be tailored to meet the needs of different students because of different preferences and that this should be stressed.

Relative Advantage (Perception of the Advantage of Implementing the Intervention versus an Alternative Solution)

Students identified ways that their immunization experience could be better with CARD™, including reducing anxiety and fear. Speaking openly about fear and normalizing fear were believed to be helpful. I feel like integrating this type of, like, language that normalises coping techniques, instead of like just being like -Are you scared?would definitely help with people; not only feeling okay with being scared . . . so like they're not trying to cover up anything but also in . . . just in general, I feel like when you know that people aren't judging you for being scared, you get like, more comfortable. (Student 2) Setting Culture It just kind of seems like, whenever I've gotten them administered to me, they just kind of want to finish. It's not about making it better for you, it's about making it better for them and more convenient for them to get over their job. And I don't think that's right. It's almost like whenever I ask a question towards, specifically vaccines, they seem annoyed. Like, they shouldn't be annoyed if I'm going to be asking you why I'm going to get this or what it's going to do to me. (Student 3)

I feel like its one thing to be informed about the information but also another side, to also educate the nurse on what they're supposed to say. Like there should be a designated script: How do you feel? Standard questions that they should be asking each and every person that they vaccinated, right? So, I think its not just a part of us to be aware of what's happening. Its a part of them to just know what is going to happen . . . what to do. Because its their responsibility. (Student 3)

Yea, the teachers were, I think, just mostly supervising but if anyone like, did need a little bit of help, they did come in and ask them if they were okay. (Student 3)

One time, I was like, given the vaccine by someone who was like, very nice and gave me a stress ball and was like: Don't worry, just focus on doing that and just like, it'll be over soon . . . He was very nice and very attentive to how I was feeling. I remember the following year someone was giving me the vaccine and I was so nervous. I kind of used a little humour to kind of, laugh it off, and they didn't really seem to care if I was like, anxious or not . . . I was obviously pretty anxious. I just think its really important.

Like my experience was much better when it was someone who was obviously engaged in trying to help you. (Student 4) And so, I think that's really important to just let students know, like beforehand, that they're going to get a vaccination. To prepare for that. Because I also know that there was a situation, for a lot of girls, um, their sleeves weren't rolled upwouldn't roll up the whole way. So, its kind of uncomfortable and they had to go to a different room and get some privacy, so they could take their whole shirt off. And I could only imagine how uncomfortable that would be. So I think that's also really important. (Student 6)

There was this girl who was like, really anxious about getting a vaccination to the point that I'm pretty sure she had a panic attack [on the day]. And it was only at that point that they offered the numbing patch to her, which she did get. She could not have it. Like, she was freaking out. Um, and so they were like: Okay, well like, what are you scared about? And she was like: I'm just really scared about the pain. I'm freaking out. And they were like: Okay we have a numbing patch -do you want that? And so, they did that, but like only after she had been having like, like having really severe anxiety. So, I feel like it should be introduced as an option like, perhaps on the form -so people know at least -because I hadn't known about it until she told me about it. (Student 2)

They were making sure that like, everything was okay. Like, I didn't really, I don't think I showed any signs of being like, really anxious or stressed. They were just checking in and, um, said: If you're dizzy, let us know, like if you feel off, just come up to one of us and we'll take care of it. (Student 6) I was very anxious. When I went there, the man giving me the needle, he gave me a stress ball to hold with like, one hand, and he put the needle in the other one. (Student 4)

Students reported that the nurses influenced their immunization experiences. Some students expressed that nurses did not use a student-centred approach when vaccinating students at school. They mentioned that nurses may require additional training regarding how to interact with students, including asking them about how they were feeling. Teachers were reported as having a secondary role in the immunization process.

Patient Needs and Resources (the Extent to Which Patient Needs, As Well As Barriers and Facilitators to Meet Those Needs, are Accurately Known and Prioritized by the Intervention Implementers) Students mentioned that nurses were inconsistent in their approach when interacting with students: some were attentive to their needs and coached them while others did not. Some students mentioned that CARD™ would address some of the gaps in the immunization preparation process, such as education by nurses about how to cope. Students also reported that their preferred coping strategies were not previously accommodated, such as being immunized in private. Usual practice included being immunized in the gymnasium in front of peers; not all students were comfortable with this method.

Some students reported that the current approach to immunizations should be changed. Students should be educated about vaccinations and ways to cope. Students should also be given reminders so that they dress in a manner that allows easy access to the upper arm for injections. Some students questioned why interventions were not offered proactively to make immunization a better experience.

Students reported that CARD™ interventions could fit into usual immunization interactions with nurses. For instance, nurses used verbal distraction and external distraction objects (e.g., stress balls).

Students' attitudes and fear scores are displayed in Table 2 . There were no significant changes from baseline to after review of the educational material (p > 0.05). Responses to the knowledge test are displayed in Table 3 . Median total knowledge score after review of the educational materials was higher than at baseline: 8.5 (range, 5-10) vs. 6 (range, 4-8); p = 0.041. All seven students reported that they understood most or all of the information in both videos and the pamphlet and that the amount of information presented was just right. Table 2 . Student attitudes about immunization and pain and fear before and after review of educational materials (n = 7) *. Table 3 . Student knowledge scores before and after review of educational materials (n = 6) * † .

Scary. The Correct Response Is 'Yes' for All Statements.

Have someone with you like a parent or friend 5 (83) 5 (83)

Have privacy so people cannot see each other getting the needle 3 (50) 6 (100)

Use medication to numb the skin so you don't feel the needle 5 (83) 5 (83)

Distract yourself so you are paying attention to something else 4 (67) 6 (100)

Relax by taking deep belly breaths to help you stay calm 3 (50) 3 (50)

Ask questions so you know what will happen 3 (50) 6 (100)

Relax the arm getting the needle so that it is jiggly like spaghetti 3 (50) 4 (67)

Sit down in a comfortable position 6 (100) 6 (100)

Look away from the needle 3 (50) 4 (67)

Make your legs and tummy muscles tight (or tense) so you don't feel dizzy 2 (33) 3 (50) * N = 1 missing; † Wilcoxon Signed Rank Test: median total knowledge score after review of educational materials was higher than at baseline: 8.5 (range, 5-10) vs. 6 (range, 4-8); p = 0.041.

This small study examined the perspectives of grade 9 female students about the CARD™ system as a framework for delivering immunizations at school in order to inform future implementation of CARD™ during grade 9 mass immunizations. Specific educational materials directed to students were reviewed, including two videos and one companion pamphlet. Overall, the results demonstrated that students held positive attitudes about CARD™. Students learned about evidence-based coping strategies and reported that CARD™ filled an important clinical care gap related to addressing pain and fear during immunization. They encouraged education of students as well as adults involved in the immunization delivery process, particularly nurses, to ensure that they are versed in CARD™ and can adequately support students. Students recommended the integration of CARD™ into usual practices.

These results are consistent with prior studies conducted by our team with children [13] [14] [15] [16] . In these studies, grade 6-8 student participants reported that all students should be educated about CARD™ as well as adults. This would help create a more supportive and positive environment during immunization. Further, prior studies across these grade levels demonstrated an increase in student knowledge about effective coping interventions after reviewing CARD™ educational material. Finally, in a controlled clinical trial including grade 7 students undergoing school-based immunizations, CARD™ reduced fear and dizziness (precursor of fainting) during vaccine injections [16] . It is important to note that in work leading up to the creation of CARD™ carried out by our team, children stressed the importance of being prepared ahead of time and being able to choose coping interventions [19] . In creating CARD™, students were involved in all phases, informing the content and delivery method for the included information [13] [14] [15] [16] . This likely contributed to the positive effects observed with its use when implemented during grade 7 immunizations [16] .

Students in the present study highlighted the influence of a nurse's qualities on their experience with immunization. Separately, in another study of the factors affecting the decision to seek health care, qualities of a health care professional were deemed important for engagement of adolescents, including honesty, respectfulness, empathy, competency, and fair treatment [20] . Through the implementation of CARD™, nurses build on these qualities and align their activities with currently espoused models of care delivery such as person-centred care [21] . In fact, feedback obtained from children across studies on this topic are consistent with a person-centred care approach.

There are some limitations worthy of discussion. The primary one relates to the small sample size, which not only limited our ability to detect statistically significant differences in some quantitative outcomes, but also limited our ability to ensure that a wide range of opinions about CARD™ were included. Sampling was limited to one independent school and participants included female students only (i.e., no male students agreed to participate). It is possible that students in other schools (and regions) as well as male students may have different perceptions. Given that female students report more pain and fear, this may have led to more positive attitudes overall [22] . Second, the focus group may have been biased by social interaction. Outspoken group members may have heavily influenced others. Third, the way in which CARD™ was introduced and taught to the students in this study differs from how it is intended to be implemented in the real world-focus group interview vs. large classroom lesson. Our study is unable to determine perceptions of students to different approaches to education delivery and other aspects of program delivery, including the timing of education relative to the day of immunization and the influence of peers, teachers, public health nurses or parents [23] [24] [25] [26] . Studies are currently underway to examine the influence of such factors on implementation outcomes.

There are several strengths of this study. Firstly, we involved the primary clients for school-based immunizations-students-in helping to inform implementation of CARD™. This approach is aligned with user-centred approaches to research [27] . Despite the limited number of participants, individuals were included that reported varying levels of fears (ranging from 0 to 9 on a 0 to 10 scale), and both positive and negative experiences with school-based immunizations. This suggests that individuals with a diversity of perspectives on the topic were included. In addition, we involved multiple coders in the analysis, and found consistent results across qualitative and quantitative data sources, improving the credibility of the results [28] .

In summary, this study provides the first evidence of the acceptability of CARD™ in grade 9 students. The results confirm that CARD™ is acceptable to grade 9 students and no specific changes were made as a result of this study. Together with the results of a subsequent study documenting the feasibility of CARD™ [29] , a large cluster trial has begun examining the effectiveness and fidelity of implementation in schools in Calgary, Canada. CARD™ systematically incorporates evidence-based interventions in school immunization program planning and delivery activities that include educating and preparing students about immunizations and coping strategies ahead of time. Students are actively engaged and learn skills they can use to manage how they feel during immunization. Educating and preparing students can lead to more positive experiences and attitudes about immunization and greater engagement in health care decision making in the future. Individuals involved in school immunizations, including parents, teachers, and nurses, can use the results from this study to reflect on their own practices related to immunizations and determine whether changes are warranted. Importantly, frameworks for vaccine delivery that are person centred such as CARD™ have the potential to promote immunization uptake across immunization settings. Given that the threat of life-threatening infectious diseases is always present, as evidenced by the current pandemic, this work is particularly relevant as, when a COVID-19 vaccine becomes available, efforts need to be made to ensure that pain and fear are not barriers to its acceptance. No. 924835 for CARD. L.B. reports that Immunize Canada received grants from Pfizer Canada, Merck Canada, GSK Canada, Seqirus Canada and Sanofi Pasteur outside the submitted work. There are no other disclosures.

Managing immunization stress-related response: A contributor to sustaining trust in vaccines

Survey of the prevalence of immunization non-compliance due to needle fears in children and adults

Fear of needles: Nature and prevalence in general practice

Far from "just a poke": Common painful needle procedures and the development of needle fear

Ten Threats to Global Health in 2019

Adolescent vaccine hesitancy in relation to needle pain and fear: A systematic review

Reducing pain during vaccine injections: Clinical practice guideline

Benchmarking public health pain management practices during school immunizations

Providing children with information about forthcoming medical procedures: A review and synthesis

Lost in knowledge translation: Time for a map?

Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science

Overview of a Knowledge Translation (KT) Project to improve the vaccination experience at school: The CARD™ System

Piloting The CARD™ System for education of students about vaccination: Does it improve the vaccination experience at school? Paediatr. Child Health

Involving stakeholders in informing the development of a Knowledge Translation (KT) intervention to improve the vaccination experience at school. Paediatr. Child Health

Stakeholder feedback on The CARD™ System to improve the vaccination experience at school. Paediatr. Child Health

The CARD™ System for improving the vaccination experience at school: Results of a small-scale implementation project on student symptoms

The CARD™ System for improving the vaccination experience at school: Results of a small-scale implementation project on program delivery

Three approaches to qualitative content analysis

From the mouth of babes: Getting vaccinated doesn't have to hurt. Can

Factors affecting the decision to seek health care: The voice of adolescents

Person-centred care: An overview of reviews

Sex differences in pain: A brief review of clinical and experimental findings

Focusing on flu: Adolescents' perspectives on school-located immunization programs for influenza vaccine

School-located influenza immunization programs: Factors important to parents and students

Parent and adolescent perspectives about adolescent vaccine delivery: Practical considerations for vaccine communication

Barriers to and facilitators of child influenza vaccine-Perspectives from parents, teens, marketing and healthcare professionals

User-centered design for psychosocial intervention development and implementation

Mixing qualitative and quantitative methods: Triangulation in action

Feasibility of CARD™ for School-Based Immunizations

The authors wish to thank the individuals who participated in this study.

The funders had no role in the design of this study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. A.T. reports Section 9 Trademark