key: cord-0802675-r4i2gtv8 authors: Agley, Jon title: Assessing changes in US public trust in science amid the Covid-19 pandemic date: 2020-05-13 journal: Public Health DOI: 10.1016/j.puhe.2020.05.004 sha: b1e96edb1d8d74753af6218c18b1c9a2d8ebfdb6 doc_id: 802675 cord_uid: r4i2gtv8 Abstract Introduction The emergence of the Covid-19 and subsequent pandemic has led to the most substantive large-scale, open, and public social discussion of epidemiology and science in recent history. In the United States, extensive debate has ensued as to the risk posed by the disease, whether the health system is prepared to manage a high volume of critical cases, whether any number of public health responses are necessary and appropriate, and the appropriate ways to prevent, manage, and treat the pandemic. We hypothesized that the interplay between scientists, policymakers, and the public in an open forum was associated with increased overall public trust in science and scientists, but that this was moderated by political orientation and/or religious commitment. In the context of a public health emergency, it is important to understand the degree to which science and scientists are trusted to produce information that can provide reassurance and also can explain the details of a highly complex event like a viral pandemic while providing actionable recommendations. Methods Data were obtained on March 17-18, 2020, from a sample of 242 US-based Amazon Mechanical Turk users. Respondents completed a 49-question survey consisting of key socidemographic variables, political affiliation, religious commitment, and two iterations of the Trust in Science and Scientist Inventory (one for March 2020, and one for December 2019 using retrospective recall). Changes in mean level of trust and interaction with political affiliation and/or religious commitment were assessed using mixed ANOVA via the general linear model. Results On a scale from 1 (low trust) to 5 (high trust), the mean level of trust in science and scientists was static; 3.82 in December 2019, and 3.81 in March 2020. Conservative political orientation and high religious commitment were associated with significantly less overall trust in science; the interaction effect suggested that liberal trust in science decreased slightly from December 2019 to March 2020, while conservative trust increased slightly. Discussion Counter to our expectations, the overall level of trust in science remained static after the first several months of Covid-19 in the United States, though there is some evidence that political orientation was associated with magnitude and directionality of change in trust. Continued examination of these trends is important for understanding public response to epidemiologic recommendations. Since the emergence of Covid-19, we have observed a rapid, public back-and-forth exchange between scientific research, policy, and social media that is largely unprecedented. On January 20, 2020, the first confirmed case of the novel coronavirus, Covid-19, was reported in the United States (US). 1 Much early communal discussion analyzed the epidemiologic risks posed by the disease within the US, though the preponderance of data remained sourced from international cases. A pre-print scoping review/meta-analysis of 61 studies from January 1, 2019 to February 24, 2020 reported that 13.9% of Covid-19 cases were severe and 4.7% were critical, with an overall case fatality rate (CFR) of 1.1%. 2 The US CFR on the COVID-19 Dashboard at Johns Hopkins University as of April 24 th indicated a 5.7% CFR, though only 4,692,797 total tests had been conducted. 3 Without access to true data (e.g., complete information or data via random sample), debate continued as to the actual severity and CFR. 4 Reasonable and serious concerns were raised that the US healthcare system is under-resourced and understaffed to manage a high volume of Covid-19 cases, which has led to efforts at and calls for selfmonitoring, quarantine, capacity-building and other methods to "flatten the curve." 5 Nonpharmaceutical, behavioral and policy responses to Covid-19 were expected to be a primary mechanism by which the basic reproduction number, R 0 , could be reduced below 1.0. 6 In the time between initial submission and revision of this study, additional public debate has also illustrated tension between differing perspectives and advice on perceptions, treatment, and management of the pandemic, such as continued comparisons between Covid-19 and influenza, 7 the proposed use of hydroxychloroquine to treat Covid-19, 8 and implementation of and compliance with social distancing measures. 9 The Covid-19 pandemic has produced a large-scale, open, and public epidemiologic investigation and discussion, with contributions from scientists, journalists, clinicians, politicians, and laypeople often shared contemporaneously. [10] [11] Because of the way in which the scientific process, such as making conclusions based on complex epidemiological modeling, has been conducted rapidly and discussed in open forums, public perception of the scientific enterprise may have been altered in some way in the past several months. In observing this display of science in action, I hypothesized that the interplay between scientists, policymakers, and the public in an open forum increased overall public trust in science and scientists, but that this was moderated by political orientation and/or religious commitment. In referring to "science and scientists" I did not mean the institutional or governmental implementation of policy based on scientific research, but rather trust in scientists qua scientists, and in the scientific methodology. 12 This was somewhat different from much (though not all) of the prior literature on trust as it relates to science, such as the fairly extensive body of work on vaccine hesitancy, 13 as the focus of this hypothesis was not on a specific set of evidence but rather on the people and processes involved in generating evidence. In this case, for example, I was not concerned with measuring whether individuals believed that Covid-19 was like influenza, but rather whether there was any preliminary evidence that the pandemic shifted how people thought about science itself. In doing so, I was guided by the work of Nadelson et al. (2014), 12 who conceptualized trust as a complex and multifaceted belief, weighted by epistemology (e.g., "how our degrees of confidence are rationally constrained by our evidence"). 14 Their instrument measured trust using Likert-type scales capturing a wide variety of components of trust, such as "When scientists change their mind about a scientific idea it diminishes my trust in their work" and "Scientists will protect each other even when they are wrong." 12 The way that individuals respond to recommendations or advice regarding public health appears to rely on a variety of factors, among which trust in multiple entities, including government, community, and scientists, appears to play a role. 9, 12 Any such shift in trust is therefore important to understand. Jones (2020) describes prior work explaining epidemics as social dramas involving citizens that include "desire for self-reassurance" followed by "reluctant acknowledgement" and then a demand for explanations. 15 In this context, too, it is important to understand the degree to which science and scientists are trusted to produce information that can provide reassurance and also can explain the details of a highly complex event like a viral pandemic. We therefore conducted a pilot survey to investigate changes in trust of science and scientists among US adults ages 18+ two months after the first Covid-19 case was identified in the United States. Data were obtained on March 17-18, 2020, from a sample of 242 US-based Amazon Mechanical Turk (mTurk) users. Respondents completed a 49-question survey consisting of key socidemographic variables (age, race, ethnicity, education level), political affiliation (1:Liberal to 10:Conservative), religious commitment (1:Low to 10:High), and two iterations of the Trust in Science and Scientist Inventory, 12 a 21-question validated scale. One set of questions was worded for the present, and the other asked for recall of attitudes (retrospective pretest 16 ) from December 2019. To avoid biasing responses, no content in the survey or invitation to participate specifically mentioned Covid-19. "Trust" was used as the dependent variable and was computed for each time point (December 2019 and March 2020) by managing reverse coded items and then calculating the sum of all responses divided by 21 to form an average value between 1 (Low Trust) and 5 (High Trust). Analyses were repeated-measures 2x2 ANOVAs using GLM; because this was a hypothesis-generated study, it was powered to examine the interaction, separately, between religious commitment/political affiliation (each dummy coded) and mean trust in science/scientists, assuming a small within-between interaction effect (f=0.1; α=0.025; 1-β=0.8), yielding the suggested sample of 242. The study alpha was set at .05 but was adjusted downward for the power analysis to control for noise because of the potential for some mTurk respondents to provide careless or random data. 17 Sociodemographic data were provided in descriptive format for a transparent view of the sample, but were not hypothesized to influence levels of trust, so analyses were not conducted. However, a full, unaltered dataset is available alongside this study should other researchers wish to explore the data. Data collection was Exempt (BLINDED IRB #BLINDED). Characteristics of the sample are provided in Table 1 . Mean trust was computed from low (1) to high (5); overall trust in science/scientists was 3.81 in mid-March 2020, and 3.82 for December 2019. Religious commitment was dichotomized (Low: 1-5, High: 6-10). A score >5 was associated with lower overall trust in science/scientists (F=51.47, p<.001, η 2 part =.177), and the interaction effect Religion*Time was very small and nonsignificant (F=1.94, p=.165, η 2 part =.008). Conservative political orientation was dichotomized (Liberal: 1-5, Conservative: 6-10). A score >5 was associated with lower trust in science/scientists (F=62.86, p<.001, η 2 part =.208). The interaction effect Politics*Time was small (F=4.29, p=.039, η 2 part =.018) (see Table 2 ). There was no overall change in trust from December 2019 to March 2020, but the interaction effects and marginal means suggest that conservative trust in science increased slightly, and liberal trust in science decreased slightly (see Table 2 ). Counter to my hypothesis, the overall level of trust in science remained static between March 2020 and December 2019, though conservatives reported slight increases in trust, and liberals reported slight decreases in trust. This interaction effect was small and should be reexamined by future studies to verify whether similar effects continue to be observed, which would potentially indicate a differential response to Covid-19 in terms of trust. Although not the focus of this study, data also indicated substantive differences between liberal and conservative respondents, as well as respondents with low and high levels of religious commitment, in terms of overall trust in science and scientists. These latter findings were consistent with correlations observed in the validation study for the instrument used to measure trust. 12 Research conducted by Gadarian et al. (2020) identified self-placed political ideology as the "most consistent factor that differentiates' Americans health behaviors" in the context of Covid-19. 18 Thus, in addition to continued research on changes, if any, brought about by the Covid-19 pandemic, it seems that additional investigation into the directionality of influence of political orientation on trust in science/scientists, and vice versa, might be also valuable, especially in cases where health-related advice from scientists and non-scientific entities differs, and individuals are determining whose advice to follow, and in what way. These findings are not statistically representative of the US and are subject to standard self-report mTurk survey limitations, including limited generalizability and potentially random (e.g. rushed) responses. At the same time, the design also allowed for a complete absence of missingness and for a rapid response to an ongoing public health event. The measure of trust has been validated and was reliable for this sample, but the extent to which change in trust could be observed over several months is unclear, though this was, to some degree, an impetus for the present study. Importantly, as with all preliminary findings, the results should be replicated, and the research concepts expanded, before conclusions are drawn. First case of 2019 novel coronavirus in the United States Novel coronavirus (Covid-19) infection in humans: A scoping review and meta-analysis An interactive web-based dashboard to track COVID-19 in real time A fiasco in the making? As the coronavirus pandemic takes hold, we are making decisions without reliable data Flattening the coronavirus curve is not enough Covid-19 -Navigating the uncharted Coronavirus disease 2019 vs. the flu Excitement around hydroxychloroquine for treating COVID-19 causes challenges for rheumatology Who do you trust? The consequences of partisanship and trust in government for public responsiveness to COVID-19 Covid-19: How to be careful with trust and expertise on social media Covid-19: A digital epidemic I just don't trust them: The development and validation of an assessment instrument to measure trust in science and scientists Vaccine trust and the limits of information The Stanford Encyclopedia of Philosophy History in a crisis -Lessons for Covid-19 The retrospective pretest-posttest design redux: On its validity as an alternative to traditional pretest-posttest measurement Mechanical Turk data collection in addiction research: Utility, concerns and best practices health behavior, and policy attitudes in the early stages of the COVID-19 pandemic Funding/Support: This study was unfunded.Additional Contributions: Thank you to BLINDED for her statistical review and advice.