key: cord-0782672-cljqpkyp authors: Chyderiotis, Sandra; Sicsic, Jonathan; Thilly, Nathalie; Mueller, Judith E. title: Vaccine eagerness: A new framework to analyse preferences in single profile discrete choice experiments. Application to HPV vaccination decisions among French adolescents date: 2022-03-02 journal: SSM Popul Health DOI: 10.1016/j.ssmph.2022.101058 sha: 7ec6bb39e8d1a9bfd1757073033724c60e60db97 doc_id: 782672 cord_uid: cljqpkyp BACKGROUND: We previously conducted a single-profile discrete choice experiment to elicit preferences of adolescents around HPV vaccine communication, finding that only half of participants made variable choices (non-uniform respondents) from which preferences were elicited. In this paper we provide a framework to evaluate post-choice certainty information to elicit preferences even among respondents who uniformly accepted (serial demanders) or refused (serial non-demanders) hypothetical vaccination scenarios. METHODS: During an in-class online questionnaire among 1458 French adolescents aged 13–15 years old, we collected certainty levels (0–10) after decisions on nine hypothetical scenarios, including four vaccination attributes: information on vaccine-preventable disease type, on vaccine safety, on potential for indirect protection and on vaccine coverage. We developed a vaccine eagerness scale (ranging from −10 to 10), by combining information on the binary decision (accept vs. refuse the hypothetical vaccine) and the decision certainty level. We used random effects linear regressions to evaluate attributes’ impact on vaccine eagerness. Sensitivity analyses were performed taking into account low response quality, assessed as invariant certainty and low response time. RESULTS: Attributes’ impact on decision certainty were similar between serial demanders (N = 659) and non-uniform respondents (N = 711): mentioning a positive benefit-risk balance significantly decreased certainty to accept (coefficient −0.93), while information on 80% coverage in other countries (+0.33) and potential for disease elimination (+0.09) increased it. Among serial non-demanders, significant attribute impacts were observed only after exclusion of low-quality responses (N = 31): a potential for disease elimination (coefficient: +0.24) and 80% coverage in other countries (+0.42) significantly increased certainty of refusing vaccination. Combining decision and certainty into a vaccine eagerness indicator allowed analysing preferences in the full sample, including “hesitant” respondents, who were sensitive to the content of the vaccination profile. CONCLUSION: Choice certainty informs on respondents’ preferences in single-profile discrete-choice experiments, in particular among those with uniform responses. The World Health Organisation (WHO) recommends using the principles of social marketing to improve communication on vaccination promotion (Nowak et al., 2015) . In this perspective, current research analyses how to measure preferences around vaccination in specific groups, notably using tailored communication (Dempsey & Zimet, 2015) . HPV vaccination uptake among adolescents remains low in many countries, including in France where complete vaccine coverage (VC) at 16 years reached 32.7% among girls in 2020 (Santé Publique France, 2021) and is one of the lowest in Europe (Nguyen-Huu et al., 2020) . As a comparison, the US VC was 68.5% among girls (same age, same year) (Pingali et al., 2021) . HPV vaccines are mainly accessible through general practitioners in France for adolescents aged 11-14 years while other European countries that have introduced school-based vaccination programmes usually have higher VC (Nguyen-Huu et al., 2020) . Factors associated with HPV vaccine uptake have mostly been investigated among parents and healthcare providers and can be classified into environmental (policies, access, lack of recommendation) and individual factors (lack of knowledge, fear of serious side effects, fear of new vaccines, mistrust etc.) (Karafillakis et al., 2019) . Few articles have focused on the adolescent' perspective although adolescents' involvement in the vaccine decision-making process could reinforce their vaccine confidence (Cadeddu et al., 2021) . Communication contents need then to be tailored for adolescents. To better understand which arguments could best motivate HPV vaccine acceptance among adolescents, we designed a single-profile discrete choice experiment with opt-out and a certainty scale. In a previous paper, we analysed the impact of four choice attributes (type of vaccine-preventable disease, vaccine safety, potential for indirect protection and vaccine coverage) on the theoretical vaccine acceptance of French adolescents (Chyderiotis et al., 2021) . Attributes and attribute levels were chosen in line with the current literature on factors influencing vaccine intentions. During the experiment, adolescents had to choose whether, for a series of 9 scenarios, they would accept or refuse a proposed vaccination. These 9 scenarios differed by the combinations of presented attribute levels. Among the half of participants that made variable decisionsi.e., who at times accepted or refused the vaccination profile -we estimated that social conformism statements (i.e. high vaccine coverage in neighbouring countries) strongly increased vaccine acceptance, while some statements on safetyalbeit meant to be reassuring -were demotivating. However, about half of adolescents made uniform decisions, always accepting or refusing vaccination, which did not allow inferring preferences (i.e., marginal sensitivities) for each attribute's level. Discrete choice experiments (DCEs) are grounded in standard economic theory (i.e., random utility maximization (McFadden, 1973) ), and allow analysing trade-offs as well as forecasting demand for hypothetical services (Hanemann, 1984) . In standard DCE, respondents are asked to repeatedly choose their preferred option among several alternatives (including opt-out options) described by different characteristics or attributes. Econometric modelling of responses based on multinomial (conditional) logit models allows eliciting preferences and assigning weights of importance to the various characteristics of the alternatives being valued. In single-profile DCEs, participants are asked whether they would accept or refuse a presented hypothetical scenario. This procedure may be more realistic in the case of preventative decisions. Indeed, for vaccination decisions, people are used to choosing whether to get vaccinated, rather than choosing the "best" vaccine among several alternatives. Besides, this type of design allows incorporating inter-individual or contextual factors, such as peer behaviour, thus allowing to analyse social preferences (Godinot et al., 2021) . The answers to single profile DCE tasks are analysed using binary (conditional) logit models. A disadvantage of single profile DCEs compared to other choice formats or conjoint analyses is that there is often less information gathered from choices, which are binary by nature. In single-profile DCEs, some respondents always make the same choice (accept or refuse) across scenarios, which leads to unidentified preferences for those respondents (so-called "uniform respondents"). Respondents who are certain of their choices are assumed to be more consistent in their choices. Post-choice certainty scales have often been used in the literature to reduce the hypothetical bias, i.e. the gap between the stated (hypothetical) choices and (unobserved) real-life behaviour (Brouwer et al., 2010; Loomis, 2011; Lundhede et al., 2009) . Recent research also showed that choice certainty variability may contain important information to identify more engaged and more thoughtful respondents. In particular, researchers have found that higher choice certainty variability was associated with higher response times, choice consistency, and internal validity of responses (Regier et al., 2019) . In this paper, we argue that, in addition to these quality considerations, analyses of choice certainty can reveal preferences of "uniform respondents" in single profile DCEs. We also propose a new concept for DCEs on vaccination, "vaccine eagerness", which combines information of decision and choice certainty to provide additional (and more subtle) information on preferences for the entire sample. The contribution of this paper to the literature is threefold. First, we analyse the determinants of serial demanding or serial non-demanding behaviours, whose choices (and preferences) are not used to inform optimal vaccination strategies in standard DCE models. Second, we show how to evaluate preferences of uniform respondents based on choice certainty responses, and how to interpret the results. Third, we develop a vaccine eagerness scale combining information on decision and choice certainty to reveal preferences among the full sample, including uniform and non-uniform respondents. Data were collected from January 31st to March 13th 2020 in five middle schools located in three French regions (Grand Est, Pays de la Loire, and Auvergne-Rhône-Alpes, schools' characteristics available in Appendix Table A5 ). The study population comprise adolescents (girls and boys) enrolled in their last two years of middle school (4e and 3e, typically aged 13-15 years, corresponding to grades 8 and 9 in the US educational system). Participants from five private or public schools completed a self-administered and internet-based questionnaire during class and could refuse or stop their participation at any time. Middle schools were randomly selected and contacted for voluntary participation in regions without previous or ongoing school vaccine campaigns. Data collection was stopped with school closure in March 2020 (following first wave of COVID-19 pandemic) but enough data had been collected at that time in those five schools. The survey was completely anonymous at all stages, and no information on the health of respondents was collected. A good level of information on HPV or vaccines was not necessary to answer the DCE section. Some basic knowledge on viruses were included before the choice tasks, so that every respondent had the same level of information. The 15-min questionnaire included questions on participants' characteristics and opinions on vaccination as well as the DCE tool. The following individual characteristics were collected: age, gender, school, presence of a foreign language spoken at home, education level of the parents in three categories, being in favour of vaccination in general (recoded in "agree or strongly agree" vs "disagree or do not know"), vaccination attitudes (perceived utility of vaccination, protection of others through vaccination, fear of needles, fear of substances in vaccines, perceived ease of finding trustworthy information on vaccination, recoded in "disagree/agree/I don't know") and self-reported vaccination status with five vaccines: DTaP-IPV (Tetanus, Diphtheria, Pertussis, Polio), MMR (Measles, Mumps and Rubella), Meningococcal C, HPV, and Hepatitis B. The latter was coded as a score, using the sum of answers (Yes = 3/No = 1/I do not know = 2). The score ranged from 5 (minimum) to 15 (maximum). The score was recoded in three categories: mostly "no" from 5 to 8, mostly "I don't know" from 9 to 12, and mostly "yes" from 13 to 15. Four attributes were selected after a literature review and interviews of experts (Table 1) : 1) the disease against which the vaccine protects (three levels: respiratory disease, cancer in 20 years, genital warts), 2) vaccine safety statements (four levels: no serious side effects (SSE), absence of scientifically confirmed SSE, no increase in risk of SSE in countries with high vaccine coverage (VC), presence of a rare SSE but greater benefit), 3) potential for indirect protection (three levels: the vaccine protects only you, avoids transmission to other people, or helps making the disease disappear), and 4) mention of VC among peers (four levels: not enough adolescents registered for vaccination, already one third, most adolescents, or 80% of teens vaccinated in neighbouring countries). Attributes and levels are further described in Table 1 . Participants were asked to imagine the following hypothetical situation: a vaccination campaign, during which free vaccination would be offered by a physician during an individual consultation, will be organised at school in two weeks. Adolescents' parents have already been informed and asked for consent. Based on a variable set of information provided by the school nurse, participants need to decide whether they would register to get vaccinated during the campaign. They were then asked, after each choice task, to indicate their level of certainty about the choice, on a scale from zero (not at all certain) to ten (absolutely certain). The choice task was designed as a single-profile DCE format with an opt-out. In total, 36 scenarios were used and split in four randomly assigned blocks, leaving nine scenarios per participant. More details on the study design and DCE tool are available in (Chyderiotis et al., 2021) . This survey was conducted as part of a large interventional research project called PrevHPV, which will evaluate the impact of several interventions, including school-based interventions on HPV vaccine coverage. Among the full sample of 1458 participating adolescents, 711 (49%) made non-uniform decisions, i.e., at least one acceptance and one refusal across scenarios (non-uniform sample), with a mean acceptance of 72%. Participants making uniform decisions for all nine scenarios (e.g., always accepting or always refusing vaccination, uniform sample) represented 51% of the full sample (n = 747, Fig. 1 ). Participants who always accepted hypothetical vaccination are subsequently labelled "serial demanders" (n = 659) and those who always refused it, "serial non-demanders" (n = 88). Because all questions were mandatory, missing data were extremely rare, due to respondents who stopped the questionnaire before the end. We hypothesised that uniform respondents (serial demanders on one hand and serial non-demanders on the other) and non-uniform respondents could differ in terms of sociodemographic and vaccine attitude characteristics, which we tested using Pearson's Chi-squared tests. Then, we estimated a multinomial logistic regression (serial demanders and serial non-demanders vs. non-uniform respondents) to estimate adjusted effect sizes of the individual characteristics, including an interaction term between education level of parents and language spoken at home (being a proxy for foreign nationality, as ethnicity information can not be assessed according to French law). We estimated Table 1 Attributes and levels of the discrete choice experiment. Levels (labels) Levels (short definition) The vaccine can protect against a disease with high fever and breathlessness. Cancer The vaccine can protect against a cancer, which could occur 20 years from now. The vaccine can protect against genital warts. No side effect The vaccine does not cause serious side effects. The vaccine's safety has been monitored for more than 10 years worldwide. No serious side effect has been scientifically confirmed. In countries where most adolescents are vaccinated, the risk of a serious side effect that could be due to vaccination has not increased. The vaccine can only on rare occasions cause a serious side effect, but the benefits from vaccination are much greater than its risk. The vaccine protects only you. Protects others By getting vaccinated, you can avoid transmitting the infection to other persons. Elimination By vaccinating most young people of your age, one can make the disease disappear from the population. Not enough Not enough adolescents of your school have registered to get vaccinated. Already one third Already one-third of adolescents of your school has registered to get vaccinated. Most adolescents of your school have registered to get vaccinated (80%). In some countries like England and Portugal, more than 80% of adolescents are vaccinated. clustered standard errors to account for potential unobserved contextual factors in the five middle schools -creating correlations between errors for each school -("school effect"). In single-profile DCEs, uniform respondents do not reveal information about their underlying preferences, and do not contribute to the likelihood of the model. We hypothesised that choice certainty does provide some information on preferences (i.e., attributes' weights in the indirect utility function) and to some extent, allow respondents more amplitude for expressing their preferences than binary choices. Choice certainty scales take into account the level of uncertainty around a hypothetical decision, and may better represent real-life decisions. Using random effects linear regression models with clustered standard errors accounting for school level effects, we evaluated the effect of attributes on the choice certainty (dependent variable) among uniform respondents, distinguishing serial demanders and non-demanders. In line Table 2 Determinants of being a serial non-demander or a serial demander compared to non-uniform respondents. Non-representative sample of 1458 adolescents in France, January-March 2020. Notes: Estimates obtained from a full multivariate multinomial logistic regression. *: p-value<0.05; **: p-value<0.01; ***: p-value<0.001. For the overall stated vaccine status: mostly no corresponds to a score from 5 to 8, mostly "I don't know" from 9 to 12, and mostly "yes" from 13 to 15. with standard assumptions in the literature (Loomis, 2011; Lundhede et al., 2009; Ready et al., 2010) , we assumed that higher choice certainty was associated with higher likelihood to make the same decision in a real-life situation, independently of the choice made ("accept" / "not accept" vaccination). In order to analyse the attributes' impact on choice certainty in the full sample (including certainty to refuse), we created a variable applicable to each respondent independently of the decision pattern. The certainty level was transformed into a "vaccine eagerness" scale by reverse coding certainty of refusal (eagerness = − 10 to 0) and positive values for certainty of acceptation (eagerness = 0 to +10). Thus, − 10 represented a strong and certain refusal of vaccination, +10 represented a strong and certain acceptance, and 0 a high level of hesitancy or uncertainty. We evaluated the effect of attributes on vaccine eagerness using random effects linear regressions and clustered standard errors to take into account the school effect. Random effect allowed accounting for between individual unobserved heterogeneity in vaccine eagerness. We hypothesised that the response quality of participants in the uniform sample could have been lower compared to the non-uniform sample (e.g., due to higher prevalence of no-brainers). We thus evaluated response quality based on two indicators: invariant certainty level across all scenarios and survey completion time. The invariant certainty level across all scenarios was obtained by recoding the mean absolute deviation from the mean certainty into three categories to classify the intra-individual variability in certainty for each participant: invariant certainty (always provide the same number for all ten scenarios), variability inferior or equal to the median, variability superior to the median (Regier et al., 2019) . The survey completion time was available for 1420 of 1458 respondents and was on average 13 min (min: 2; max: 31 min). Short response time was defined as below the 20th percentile (9.38 min in our survey) (Zhang et al., 2014) . We conducted sensitivity analyses for the attributes' impacts on 1) certainty among serial non-demanders 2) certainty among serial demanders (Appendix Table A .3) vaccine eagerness in the full sample (Appendix Table A .4), by excluding suspected low-quality responses from the sample. In analyses A, we excluded participants with invariant certainty (n = 118 excluded), in analyses B, those with short response time (n = 284), in analyses C, those with both characteristics (n = 55) and in analyses D, those with one or both characteristics (n = 347) (Appendix Table A .1). This study is part of the PrevHPV study, conducted under the responsibility of Inserm. It was granted approval by Evaluation Committee of Inserm, the Institutional Review Board (IRB00003888, IORG0003254, FWA00005831) on 10 December 2019. All study participants gave their oral, informed, non opposition to participation, in line with French legal guidelines. Our sample was comprised of 1,458 respondents, including 53.5% of girls, with a mean age of 13.8 years old. Half of the respondents declared at least one of their parents had a high school diploma, while 30.1% declared not knowing. A quarter declared speaking (also) another language than French with their parents. They were 76.5% in favour of vaccination in general, with 13.9% had no opinion and 7.8% were disagreeing. Serial non-demanders showed more frequently the following characteristics: having an unfavourable opinion (or no opinion) about vaccination in general (72.7% vs 28.0% among non-uniform respondents, p < 0.001), declaring they had not received childhood vaccines (18.2% vs 5.4%, p < 0.001) and not agreeing with the statements "it is useful to get vaccinated" (p < 0.001), "getting vaccinated can protect others" (p < 0.001) and "vaccination scares me because of the needle" (p < 0.05). Serial non-demanders declared more frequently not knowing whether it is easy to get trustworthy information on vaccination (44.6 vs 29.5%, p < 0.001), being unaware of their parent's education level (53.4 vs 30.2%, p < 0.001) and speaking another language than French with their parents (39.8 vs 27.4%, p < 0.05) (Appendix Table A .2). Those in favour of vaccination in general were overrepresented among serial demanders (87.9 vs 72.0% among non-uniform respondents, p < 0.001), as were those agreeing with the statements "it is useful to get vaccinated" (p < 0.001) and "getting vaccinated can protect others" (p < 0.01). Serial demanders were also more likely to find it easy to get trustworthy information on vaccination (59.8 vs 47.3%, p < 0.001) and to not speak another language at home (19.9 vs 27.4%, p < 0.01) (Appendix Table A .2). Notes: n: number of respondents; Q1 = first quartile, Q2 = second quartile, Q3 = third quartile.* P-value test vs non-uniform <0.01. Respondents, including those with unvaried certainty, can have low (0-5), medium (6-8) or high (9-10) mean certainty. In multivariate analyses adjusting for the school effect, serial nondemanders compared to non-uniform respondents were less likely to have a favourable opinion on vaccination in general (OR: 0.19 [0.13; 0.27]) ( Table 2) . Serial demanders compared to non-uniform respondents were more likely to be boys (1.19 [1.07; 1.32]) and in favour of vaccination in general (2.11 [1.51; 2.97]). They were more likely to state that they were vaccinated against childhood diseases and that it is easy to find information on vaccination. The mean certainty was 7.6 across all scenarios among the full sample, with a mean certainty of 7.2 (standard deviation (sd): 2.3) in the non-uniform sample and 8.0 (sd: 2.0) in the uniform sample (Table 3) . Respondents with constant certainty were more prevalent in the uniform sample, especially among serial non-demanders (44.3% vs. 2.7% among non-uniforms). Adolescents with a low mean certainty (mean certainty ≤5) were more prevalent among serial non-demanders (21.6% vs. 8.3%), while less prevalent among serial demanders (4% vs. 8.3%). Finally, uniform respondents were more likely to have a high mean certainty (≥9) compared to non-uniform respondents (31.2% vs. 10.7%), and the differences were not significantly different among serial demanders and non-demanders (30.2% vs 38.6%). To summarize, uniform respondents tended to be more certain of their choices and have lower choice certainty variability on average. Figure A. 1 of the Appendix shows certainty distribution among serial non-demanders, serial demanders and non-uniforms. Non-uniform sample: adolescents with varied decisions across the choice tasks. Uniform sample: adolescents who always made the same decision across the choice tasks. Parsimonious model obtained after adding significant individual characteristic variables at p < 0.02 then using a backward stepwise approach at p < 0.05. *: p-value<0.05; **: p-value<0.01; ***: p-value<0.001. Among serial non-demanders, none of the attributes had significant effect on the certainty of refusal (Table 4) . Among serial demanders, the safety levels "Other countries" and "Benefit/risk" significantly decreased the certainty of acceptance, while all coverage levels increased it. The "Cancer" level and all "Indirect protection" levels had no significant effect on choice certainty. In the full sample (n = 1458), vaccine eagerness was increased by all Coverage levels and Indirect Protection levels, as well as the "Cancer" level of the disease attribute (Table 5 ). The "Genital warts" level had no impact on vaccine eagerness compared to a febrile respiratory disease. Safety levels "Safety other countries" and "Benefit/risk" significantly and substantially decreased eagerness compared to the reference ("No side effect"), while the "Scientific surveillance" level had a minor impact. Some individual characteristics had significant impact on vaccine eagerness: being in favour of vaccination and finding vaccination useful were associated with higher levels of vaccine eagerness, while speaking another language at home and not knowing the education level of parents were associated with lower levels. Variability existed in between schools (Table 5) . In the full sample, 118 respondents (8.1%) always indicated the same choice certainty level for all scenarios (constant certainty). This percentage was 2.7% among non-uniform respondents, 9.1% among serial demanders and 44.3% among serial non-demanders (Table 6 ). This could be the sign of lower data quality in this latter group (Regier et al., 2019) . Fast respondents (completion time <20th percentile, 9.38 min) were more prevalent among serial non-demanders (47.0%, compared to 18.6% among non-uniforms and 18.0% among serial demanders). There were 55 participants combining low certainty variation and short completion time, 21 in the serial non-demanders sample, 25 in the serial demanders, and 9 in the Non-uniform sample. After exclusion of participants with short response time (analysis B), the effects of levels "Scientific surveillance" (0.11, [0.05,0.17]), "Elimination" (0.17, [0.12,0.21]) and "Other countries 80%" (0.26 [0.12,0.39]) significantly increased the certainty of refusal among serial non-demanders (Table 7) . These effects were even more pronounced when participants with any sign of low response quality were excluded (analysis D), with coefficients of 0.18 (non-significant), 0.24 and 0.42, respectively, for "Scientific surveillance", "Elimination" and "Other countries 80%". Sensitivity analyses on certainty in the serial demanders sample and on vaccine eagerness in the full sample showed similar results compared to the main analyses (Appendix Table A.3 and Table A .4). Table 7 Sensitivity analyses of the effect of attributes on certainty of refusal (0-10) among serial non-demanders, January-March 2020. A: excluding participants with invariant certainty; B: excluding participants with low response time; C: excluding participants with both invariant certainty and low response time; D: excluding participants with at least one characteristic. *: p-value<0.05; **: p-value<0.01; ***: p-value<0.001. In this secondary analysis of a single-profile discrete choice experiment with an opt-out, we found that using a certainty scale could provide valuable information on adolescent respondents always choosing the same option (in this case, acceptance or refusal of theoretical vaccination). Adding the choice certainty scale to the single-profile DCE allowed analysing the impact of the attributes on underlying preferences in an innovative way. In particular, it allowed describing sensitivities to particular communication contents even among serial (non) demanders, whose preferences remain unidentified in standard discrete choice models. Serial non-demanders represented a small part of our sample (6%) and were less likely to be in favour of vaccination in general. They were also more likely to speak another language at home and be unaware of their parents' education level, which could potentially indicate a lower comprehension of the study or be a proxy for lower socioeconomic status. In analyses including all serial non-demanders, no attribute significantly impacted their certainty of refusal. By contrast, the sample restricted to serial non-demanders with good response quality -probably representing participants with truly high vaccine hesitancy (and excluding no-brainers) -revealed a particular pattern of preferences: communication on the potential to eliminate the disease through vaccination and on high vaccine coverage in neighbouring countries significantly increased the certainty of refusal. Because of the small sample size, we can only hypothesise on interpretation of these results. A first hypothesis is that this group with high vaccine hesitancy refuses any positive communication, in particular one appealing to social conformism or collective responsibility around vaccination. Statements motivating vaccine acceptance in most adolescents could have the opposite effect on this small group. More research is needed to test this hypothesis and see if it could be linked to mistrust towards institutions, which has been linked to vaccine hesitancy (Karafillakis et al., 2016) . Our framework of vaccine eagerness will be useful to explore preferences specifically among highly hesitant persons by replicating in other studies using larger sample size. We can also hypothesise that these three attribute levels were not well understood by the subgroup, and could even have been seen as unrealistic for some adolescents with low vaccine knowledge. Another explanation could be that some adolescents simply did not engage with the experiment due to lack of interest, opposition or other personality traits, despite good quality indicators. Few DCEs have surveyed adolescents about their preferences on vaccination (de Bekker-Grob et al., 2010; Hofman et al., 2014; Lavelle et al., 2019; Marshall et al., 2016; Wang et al., 2017) , and to our knowledge, none has investigated uniform respondents or serial non-demanders. It is unclear if adolescents have firm and long-lasting opinions on vaccination, or if they endorse anti-or pro-vaccine views outside of their parents' beliefs. Qualitative studies following DCEs could help better understand adolescents' motivations toward vaccination, especially for serial non-demanders, which may help tailor immunization communication in specific subgroups. Results using the vaccine eagerness scale in the full sample were consistent with previous findings among participants with non-uniform decisions (Chyderiotis et al., 2021) : the safety attribute level referring to a positive benefit-risk balance decreased vaccine eagerness while levels referring to social conformism increased it. These results suggest that the vaccine eagerness scale could be used in DCEs to explore vaccine hesitancy and interventions to modify it. Although this study has been conducted before March 2020 and the Covid-19 pandemic, we believe that our results could be used to optimize communication on various vaccines, including Covid-19 vaccines, in particular among adolescents. In practice, we recommend pretesting communication contents highlighting high vaccine coverage figures in neighbouring countries and using safety statements based on ongoing scientific consensus worldwide, while avoiding references to a benefitrisk balance if appropriate. For HPV, we recommend insisting on the protection against cancers and mentioning the possibility to eliminate HPV-induced outcomes. This study has some limitations. First, this experiment was not conducted in a representative sample of French adolescents enrolled in middle schools. Although the sample size was sufficient, our results might not be generalizable to the entire population of French adolescents. Generalisation to adolescents in other countries must be done carefully, taking into account cultural differences in terms of vaccine preferences between countries and continents. We do not have information on parental opinions on vaccination and how it could have impacted adolescents' responses to the survey. The small sample size of serial non-demanders limited the power of specific studies on this group. Finally, our vaccine eagerness scale is based on the certainty level of the decision and not the decision itself. The eagerness scale could thus be less accurate than the decision in predicting real life for people with nonuniform decisions. However, attribute levels had similar impact on certainty levels as on theoretical decisions, which reinforces our previous conclusions. Single-profile DCEs are particularly adapted to preferences around vaccine acceptance, but may be limited by a high percentage of uniform respondents (serial demanders or serial non-demanders). Our results advocate for the use of choice certainty scales specifically in singleprofile DCEs, to better estimate the preferences of respondents in vaccine acceptance. Besides, such scales can be used as a quality criterion to exclude individuals which do not vary in their certainty level. Our results also suggest that despite a high prevalence of uniform responders, our previous findings on vaccination promotion among French adolescents are robust and could be used in communication campaigns targeting this group, with only a very small subgroup of adolescents who could be negatively impacted by some of the optimised communication content. This study is part of the PrevHPV study, conducted under the responsibility of Inserm. It was granted approval by Evaluation Committee of Inserm, the Institutional Review Board (IRB00003888, IORG0003254, FWA00005831) on 10 December 2019. All study participants gave their oral, informed, non opposition to participation, in line with French legal guidelines. JM, JS and SC designed the study. SC and NT organised the data collection, with the help of the members of the PrevHPV consortium (principal investigator: NT). JM and JS conceived the original idea of the manuscript. SC conducted the analyses and wrote the manuscript under JM and JS's supervision. All the authors contributed to the data interpretation. All the authors revised and approved the final version of the manuscript. This study is part of the PrevHPV study, which is conducted with the support of Institut de Recherche en Santé Publique (IReSP) and Institut national de la santé et de la recherche médicale (INSERM), with financial support from ITMO Cancer AVIESAN (Alliance Nationale pour les Sciences de la Vie et de la Santé/National Alliance for Life Sciences & Health) within the framework of the Cancer Plan 2014-2019. The funding sources had no involvement in the study design, the collection, analysis and interpretation of data; in the writing and in the decision to submit the article for publication. All authors declare having no conflict of interest. We thank the middle schools who accepted administering the questionnaire during class time as well as all the participating adolescents. We thank the PrevHPV Consortium 1 , and in particular Aurélie Gauchet, Marion Branchereau, Sébastien Bruel, and Amandine Gagneux Brunon for previous comments on the manuscript. NU: non-uniform sample; U: uniform sample; SND: serial non-demanders; SD: serial demanders; *: p-value compared to NU < 0.05; **: p-value compared to NU < 0.01; ***: p-value compared to NU < 0.001. For the overall stated vaccine status: mostly "no" corresponds to a score from 5 to 8, mostly "I don't know" from 9 to 12, and mostly "yes" from 13 to 15. A: excluding participants with invariant certainty; B: excluding participants with low response time; C: excluding participants with both invariant certainty and low response time; D: excluding participants with at least one characteristic. *: p-value<0.05; **: p-value<0.01; ***: p-value<0.001. A: excluding participants with invariant certainty; B: excluding participants with low response time; C: excluding participants with both invariant certainty and low response time; D: excluding participants with at least one characteristic. *: p-value<0.05; **: p-value<0.01; ***: p-value<0 Choice certainty and consistency in repeated choice experiments Understanding the determinants of vaccine hesitancy and vaccine confidence among adolescents: A systematic review Optimising HPV vaccination communication to adolescents: A discrete choice experiment Interventions to improve adolescent vaccination: What may work and what still needs to Be tested Please update the date by replacing 2021 by 29 Quantifying preferences around vaccination against frequent, mild disease with risk for vulnerable persons: A discrete choice experiment among French hospital health care workers Welfare evaluations in contingent valuation experiments with discrete responses Have preferences of girls changed almost 3 years after the much debated start of the HPV vaccination program in The Netherlands? A discrete choice experiment Vaccine hesitancy among healthcare workers in Europe: A qualitative study HPV vaccination in a context of public mistrust and uncertainty: A systematic literature review of determinants of HPV vaccine hesitancy in Europe Use of a choice survey to identify adult, adolescent and parent preferences for vaccination in the United States What's to know about hypothetical bias in stated preference valuation studies Handling respondent uncertainty in Choice Experiments: Evaluating recoding approaches against explicit modelling of uncertainty Adolescent, parent and societal preferences and willingness to pay for meningococcal B vaccine: A discrete choice experiment Conditional logit analysis of qualitative choice behavior Human papillomavirus vaccination coverage, policies, and practical implementation across Europe Addressing vaccine hesitancy: The potential value of commercial and social marketing principles and practices National, regional, state, and selected local area vaccination coverage among adolescents aged 13-17 Years -United States Using respondent uncertainty to mitigate hypothetical bias in a stated choice experiment Choice certainty and deliberative thinking in discrete choice experiments. A theoretical and empirical investigation Adolescent values for immunisation programs in Australia: A discrete choice experiment Speeding in Web Surveys: The tendency to answer very fast and its association with straightlining *REP or "Réseaux d'éducation prioritaires" means schools located in deprived areas can beneficiate from a specific educational program aiming at reducing social and territorial inequalities.