key: cord-0771104-8zimg12b
authors: Al-Zaman, Md. Sayeed
title: An exploratory study of social media users’ engagement with COVID-19 vaccine-related content
date: 2021-06-23
journal: F1000Res
DOI: 10.12688/f1000research.51210.3
sha: aba44ec4f7ca010345b3bb056d3cd05b96c3ffdc
doc_id: 771104
cord_uid: 8zimg12b

Background: Facebook, as the world’s most popular social media platform, has been playing various important roles throughout the COVID-19 pandemic, allowing users to produce and share health-related information that both eases and complicates public health communication. However, the characteristics of vaccine-related Facebook content and users’ reaction to the vaccine issue has been an unexplored area to date. Methods: To fill the previous knowledge-gap, this exploratory study wants to understand the communication climate of Facebook on the COVID-19 vaccine issue, including the nature of dominant content and users’ engagement patterns with them. Therefore, the study analyzes the 10,000 most popular Facebook posts with the highest interactions on the vaccine issue. Results: The results show that Facebook users prioritize more vaccine-related news links (71.22%) over other content. The declining interactions on the issue suggests that interaction growth mainly depends on positive news on the vaccine. Finally, users’ reaction to the vaccine issue is dominantly positive, though they may show a highly negative attitude toward vaccine misinformation. Conclusions: A few limitations and strengths of this study are discussed along with values and implications. This study for the first time analyzes Bangla language-based Facebook content related to the COVID-19 vaccine issue, which is largely overlooked in global academic research.

This exploratory study seeks to understand the characteristics of coronavirus disease 2019 (COVID-19) vaccine-related social media content and how users engage with them. COVID-19 has already claimed 1.76 million lives worldwide, making the public health condition critical. Meanwhile, lockdown and social distancing interrupt face-to-face human communication (Limaye et al., 2020) . Such a situation lets social media bridge the communication gap by delivering necessary information (Goel & Gupta, 2020; González-Padilla & Tortolero-Blanco, 2020) . Researchers categorized COVID-19 online information into 11 types: valid information, comforting information, perplexing information, misinformation, disinformation, shocking information, contradictory information, doubtful information, progressive information, postponed information, and confidential information (Ashrafi-Rizi & Kazempour, 2020) . Two broader categories may represent all of them: useful information that helps public health communication, and faulty information that interrupts public health communication. For example, social media was responsible for fake COVID-19 prescriptions and medications that claimed many human lives (Islam et al., 2020) . On the contrary, infographics containing COVID-19 health information delivered through Twitter and WeChat helped rapid COVID-19 knowledge dissemination (Chan et al., 2020) . Similarly, on the one hand, social media helps to run positive and effective virtual campaigns for the COVID-19 vaccine around the world, and, on the other hand, vaccine opposition and misinformation obstruct the vaccination process (Bonnevie et al., 2021) . A report says 31 million Facebook users follow anti-vaccine groups with 17 million YouTube users subscribing to similar accounts (Burki, 2020) . Therefore, it is imperative to understand social media users' sentiments regarding the COVID-19 vaccine, and the nature of vaccine-related content that dominates social media platforms.

Previous studies from both the public health and communication domain dealt with different aspects of the COVID-19 vaccine, such as vaccine hesitancy (Bonnevie et al., 2021; Jamison et al., 2020; Puri et al., 2020) , vaccine misinformation (Jamison et al., 2020; Loomba et al., 2020) , media, and the COVID-19 vaccine (Olijo, 2020) . However, no attention has been paid to social media users' engagement with the COVID-19 vaccine issue. The present research attempts to fill this gap.

This research attempts to understand the communication climate of Facebook surrounding the COVID-19 vaccine issue, the nature of dominant content and users' engagement patterns with them.

Facebook is the most popular social media platform in Bangladesh (94.46%), compared to YouTube (3.31%) and Twitter (0.3%), so we selected it as the source of data for this study. We collected the data from Facebook pages using CrowdTangle, a public insights tool owned and operated by Facebook. It can access public pages and groups to collect various types of data. However, we excluded group data in this research because Facebook groups and pages are different in terms of users' interaction patterns, participation rates, and security issues. To collect the data from relevant Facebook posts, we conducted a keyword search. A large share of the users in Bangladesh use Facebook in the Bangla language. For that reason, we determined the following Bangla keywords in the Bangla alphabet: "corona vaccine," "coronar vaccine," "corona tika," "coronar tika," "corona oshudh," "coronar oshudh," "corona protishedhok," and "coronar protishedhok." All search terms can be translated as corona vaccine or vaccine of the corona.

We set the timeline from 8 March to 2 December 2020. The first case of coronavirus in Bangladesh was identified on 8 March 2020. As Facebook is an interactive platform, so we collected the data on 17 December 2020 (15 days after the end date of the data collection period) after stabilizing the threads. The search result produced 37,460 Facebook posts relevant to the topic. Of them, we selected the top 10,000 posts for the final analysis based on their total interactions, which was 26.70% of the total search results: These posts were from 1,087 different Facebook pages, on average 9.20 posts from each page. We categorized the content into six types: link, live video, native video, photo, status, and YouTube video. In Facebook, each of the mentioned content can usually have the following definitions and modes: a link and a photo can be shared with or without any text; live video can be completed or scheduled; native video is video that is uploaded directly to Facebook; a status is mainly text-based, often contains other elements, such as tags; YouTube videos are often embedded/shared on Facebook. We measured the users' engagement based on nine interaction parameters, including six M=5.40, SD=51.67) . In this study, we followed a bivariate statistical analysis and a simple time-series analysis with one-day intervals. The numbers and percentages are presented in tables, time-series data are presented in graphs.

In February 2016, Facebook introduced five basic reactions: love, sad, wow, haha, and angry, alongside like or thumbs-up. These reactions were influenced by the six universal reactions: fear, anger, joy, sadness, disgust, and surprise (Gu et al., 2019) , proposed by Ekman (1992) based on human facial expressions

Like the previous version, this version also includes some minor changes in the method section. (Keltner et al., 2019) . However, studies found that disgust and anger, and fear and surprise share similar characteristics, meaning the four following emotions should be considered as the actual basic emotions: anger, joy, sadness, and surprise (Jack et al., 2014) . Unlike basic emotions, Facebook reactions represent more varied and often contradictory expressions: like or thumbs-up usually expresses likeness, agreement, happiness, approval, and acceptance; love expresses positivity, affection, empathy, support, kindness, and liking something with feeling; sad expresses empathy, grief, tragedy, and support; haha expresses laughter, fun, mockery, and often rejection; wow expresses muted disdain, surprise, immediate shock, and skepticism; and angry expresses denial, aggressiveness, strong and overt disdain, and dislike (Al-Rawi, 2020).

In contrast to the idea of basic emotions, the circumplex model of affect proposes that human emotion is more complex and diverse than the basic emotion theory explains (Russell, 1980) . At least 28 interconnected emotional states of humans can be defined with two variables: emotional valence or sentiment and emotional arousal or intensity (Citron et al., 2014; Freeman et al., 2020; Yang & Chen, 2012) . This two-dimensional model of human emotions defines emotional valence as positive and negative and emotional arousal as high and low (Preoţiuc-Pietro et al., 2016) . In this study, we tried to position Facebook reactions within this paradigm but with little modification. For valence, we defined like, love, wow, and care as positive, and angry, sad, and haha reactions as negative valence (Giuntini et al., 2019) . As the number of Facebook emotions is limited, unlike the circumplex model that has 28 distinct but relative emotions, we defined the seven reactions as follows: love, care, angry, and wow as high arousal, and like and sad as low arousal. That means positive high includes love, care, and haha; positive low includes like; negative high includes angry and wow; negative low includes sad. Although like, according to its defined meanings, belong to the lower arousal dimension, its degree is moderate, which is closer to the high arousal dimension (see Russell, 1980) . Again, Al-Rawi (2020) defined wow as positive, we defined it as negative based on the findings of Jack et al. (2014) (i.e., fear and surprise are the same, and wow expresses surprise or shock, which is negative). It is important to note that expressions through these reactions vary widely, and a reaction may express contradictory emotions: haha both expresses joy and refutation. It makes this reaction's position in the paradigm uncertain: it can be positive high and negative high. For such ambiguous nature, previous studies excluded haha from their interpretations (e.g., Al-Rawi, 2020).

Of the six content types, link (n=8,614; 86.14%) was dominant, followed by photos (n=491; 4.91%) and native videos (n=466; 4.66%); YouTube video (n=52; 0.52%) was on the bottom of the list (Table 1 ). During the time span, links were shared the most in July (n=1,696; 19.69%), followed by August (n=1,331; 15.45%); photos were shared the most in July (n=147; 29.94%) as well, followed by October (n=72; 14.66%). July (20.73%) had the highest percentage of content, followed by August (15.28%) and April (14.33%). Figure 1 shows that the percentage of the links content type was dropping gradually with a few fluctuations. On the other hand, the percentages of live video and status were slowly increasing with a few drops. However, except for the line of links, other lines do not show any significant changes.

All posts generated 17,144,403 interactions during the time span. The numbers of interactions were higher in the first half of the period, roughly from April to July 2020 ( Figure 2 ). The interactions reached to the highest on 17 April 2020 (n=201,834), with a few more surges on 27 April (n=135,941), 9 May (n=176,936), 22 June (n=131,564), and 2 July (n=169,524). The average interactions dropped in the following months, and again increased slightly in the mid-October 2020 and late-November 2020. However, except 17 October (n=116,743) and 21 November (n=100,619), the interactions were dropping gradually after July 2020 till December 2020.

Of all content types, links (71.22%) received the highest interactions, followed by native videos (16.52%), while YouTube videos (0.54%) received the lowest interactions. In all content types, like as a reaction had the highest percentages: in all except status, the second-highest was love; in status (11.16%), the second-highest was haha (Table 2) . A comparison of interaction percentages among the content types shows that YouTube video (4.16% and 1.35%) received relatively higher percentages of comments and care in its interaction types, followed by native videos (4.05%); native videos (19%) were shared more often, followed by live video (8.33%). Of the six reactions, links received relatively higher percentages of likes (84.14%); photos received higher percentages of love (16.80%); statuses received higher percentages of wow (0.65%), haha (11.16%), and sad (5.58%).

Of the total interactions during the period, 1.92% (n=328,976) were comments and 8.47% (n=1,451,726) were shares (Table 3) . Of the six reactions, likes were the highest (80.32%), followed by love (4.37%) and haha (3.08%); angry (0.21%) had the lowest share. Within all interaction types, link had the Facebook users mostly consume news items related to the COVID-19 vaccine. However, the decline of links suggests that users are increasingly becoming less interested in vaccinerelated news. Kleis Nielsen et al. (2020) also found a similar tendency that using Facebook for COVID-19 news and information is declining: from 10 April to 24 June 2020, the percentage declined from 24 to 12. Unlike the present study, however, the previous study considered all COVID-19 issues instead of only the vaccine issue and produced a similar result.

The interactions were higher during the first half of the period but decreased with time. Interactions surge mainly due to vaccine-related news irrespective of its valence (i.e. positive and negative). However, it seems positive news helps interactions to grow more than negative news. For example, two crucial vaccine-related positive news items from mainstream media influenced the interaction to reach its highest on 17 April: "The University of Oxford declared that the vaccine for COVID-19 would come in September," and "The trial of COVID-19 vaccine would begin from the next week" (e.g. Daily Jugantor). The interaction reached its second-highest on 27 April due to a few more positive news events: "Corona vaccine production will start from May this year," and "India's Serum Institute will start producing COVID-19 vaccine soon" (e.g. Bangla Tribune, DW). Nevertheless, no significant positive follow-ups occurred in the consecutive months, so the interaction lines remained steady most of the time. Another surge on 17 October was for positive news articles: "Russia produced the first COVID-19 vaccine in the world," and "Bangladesh's Globe Biotech claimed the invention of COVID-19 vaccine" (e.g. BBC News, Prothom Alo).

Like and love are the two leading reactions, meaning the valence of users' reaction to vaccine-related content is positive and, to some extent, highly intense. On the other hand, the lowest instances of the angry reaction indicate users' minimal negative emotion toward the issue. Both tendencies indicate a positive valence with from moderate to high arousal, suggesting Facebook users' optimistic attitude toward the COVID-19 vaccine. But note that users' sentiments can be different for different content types: link has more positive valence, whereas status has comparatively more negative valence. However, news links often produce discontent among users, perhaps due to presenting unsatisfactory and undesired information, such as the cancellation and failure of vaccine, and demystified fake news. In practice, the COVID-19 vaccine produced uncertainties among the public around the world, often allowing many to produce vaccine-related misinformation and fake prescriptions (Limaye et al., 2020) . Also, during the pandemic period, COVID-19 misinformation is highly prevalent in social media platforms like Facebook (Al-Zaman et al., 2020; Islam et al., 2020) .

Another finding shows that links about the vaccine generate more interactions than others. More specifically, links are shared more and generate more comments compared to the other content types. Previous studies revealed that the primary reason for Facebook users' news link-sharing behavior is to share important news with others that might be helpful (Baek et al., 2011) . It allows easier dissemination of news and sociality, the attachment to other users. In this regard, the present study expands on the previous knowledge, adding that users not only share links containing important information but also links allow more users to engage in discussion.

This study has a few limitations. First, Facebook only introduced the care reaction in April 2020. It means interaction data before April could not include care responses, which may have impacts on the overall percentages. Second, Bangla is a complex language: diverse expressions and spellings of words can indicate the same thing. Therefore, though we searched for a single topic, our search terms were not likely to incorporate all posts. More search terms, such as "COVID-19 vaccine" and "COVID-19 medicine" could yield more search results that could have led to different findings. Third, although this study explored the content types, it failed to explain what these contents contain: vaccine news, instructions, or something else? Further research should explore what types of vaccine-related information Facebook users really consume. Fourth, previous studies found that, though links most likely contain additional text or status, they often contain photos as well (Baresch et al., 2011) , often making the three content types (i.e. link, photo, and status) difficult to categorize separately. The data for this study were automated and collected using CrowdTangle, which left room for doubt regarding this issue. Finally, sentiment analysis based on only Facebook reactions and excluding textual analysis may not be representative, and, to some extent, could produce unreliable results. For example, the like reaction could be a result of the absence of any particular emotion (Giuntini et al., 2019).

Apart from these limitations, this study has strengths in a few areas. First, Bangla language-based Facebook content is largely overlooked in academic research, perhaps due to the absence of research interest or research efficiency among researchers. The present study filled this gap a little. Second, how Facebook users react to the issue of the COVID-19 vaccine is still an unexplored but necessary area of research. In this regard, the novel findings of this macro study may help psychology and communication researchers to understand the diverse reactions and emotional positions of Bangladeshi Facebook users on the COVID-19 vaccine issue. Third, this study provides new perspectives to rethink social media users' views toward the COVID-19 vaccine. While previous studies emphasized vaccine hesitancy, negatively portrayed social media users' sentiments toward the COVID-19 vaccine, and found that vaccine opposition was rising among social media users, the present study showed that social media users are more positive toward the vaccine issue, which the past studies could barely identify (Bonnevie et al., 2021; Puri et al., 2020) . Finally, this research dealt with a larger dataset than the previous studies on the COVID-19 vaccine (Jamison et al., 2020; Rovetta & Bhagavathula, 2020) , which makes the results more reliable. This is an exploratory study that may not provide conclusive findings in some cases. Therefore, further research is required to provide more insights in this regard. 

Is the study design appropriate and is the work technically sound? Yes

Are all the source data underlying the results available to ensure full reproducibility? Yes

Regarding the analysis, we do not think the method needs further clarification because it clearly mentions the two techniques we devised in this study. Bivariate analysis is simply the cross-tabulation between two variables and time series analysis is the distribution of a variable throughout a specific period. Detailing such a primarylevel explanation would make the section verbose.

Since all tables are cross-tabulations produced by bivariate analysis, it would not require mentioning the table number in the method section. Rather, we clearly mention the number in the result section while interpreting our data.

F1000 Research is a medicine-related journal, and such journals unlike the social sciences and humanities journals emphasize results over literature review. Research papers in similar journals should be as succinct as possible, though we provide the reviews of necessary studies for both the background and conceptual framework. Also, the guideline of the journal clearly states that the four required sections should be: Introduction, Methods, Result, Conclusions/Discussion. Therefore, we decided not to include a dedicated Literature Review section for a detailed literature review. Lastly, since this is an exploratory study, it is obvious that not many studies have not been conducted in this area so far.

One "I" was remained in the manuscript mistakenly and we have replaced it with "we." Thanks for the suggestion. As mentioned in our previous response to the reviewer's comments, using "we" in scholarly manuscripts is standard practice.

We have now addressed the reviewer's concerns properly and make the necessary changes (see Track Change) in the manuscript.

inability to forecast very concise practical and policy-related significance could be difficult for this study. A one-sentence clarification regarding the data analysis has now been added to the methodology.

The use of "I" is now replaced with "we", which is an ideal practice in the scholarly arena.

3.

Publisher Full Text Al-Zaman MS: An exploratory study of social media users' engagement with COVID-19 vaccine-related contents

Quantifying the rise of vaccine opposition on Twitter during the COVID-19 pandemic

Social media for rapid knowledge dissemination: early experience from the COVID-19 pandemic

Emotional valence and arousal affect reading in an interactive way: Neuroimaging evidence for an approach-withdrawal framework

see point 1. Also, we defined CrowdTangle as "a public insights tool owned and operated by Facebook" in the manuscript, which is an ideal and referred description of this tool. For more

However, a specific percentage is absent regarding the statement, and measurement of the entire Facebook users is not possible as well. For that reason, we had to rely on our general observations

Thanks to the author for this interesting manuscript.The focus on Bangla language and Bangladesh. It can be good to add a discussion about the similarities and the differences between the results disclosed herein and other in other countries/areas around the globe. Moreover for the not social media users/specialist it will be good to shortly explain the difference between Facebook, Youtube, Twitter... before explaining why the author choose Facebook ("Data source & search strategy").

Are all the source data underlying the results available to ensure full reproducibility? No Are the conclusions drawn adequately supported by the results? Yes This is an open access peer review report distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Department of Visual Communication, PSG College of Arts and Science, Coimbatore, Tamil Nadu, 641 014, IndiaThe researchers have given necessary clarification.

Are all the source data underlying the results available to ensure full reproducibility? Yes I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Thanks to the reviewer for further comments on our manuscript. Followings are our responses:We did not measure the popularity levels of the social media platforms. Rather, we provided a source from where we borrowed the statistics. Please see the link attached to "the most popular social media platform in Bangladesh" in the manuscript. As per the policy of F1000 Research, all web citations should be included as links.The Researcher/s have used time frame analysis but not mentioned which type of approach they have adopted.The researcher used 1st person in some places as 'I' and it should be changed as 3rd person eg: "the researcher/ researchers".

Are all the source data underlying the results available to ensure full reproducibility? Yes

Competing Interests: No competing interests were disclosed.Reviewer Expertise: New Media Studies, Developmental Communication are my strong areas of research.

Author Response 10 Jun 2021

Many thanks to the reviewer for such valuable comments on this manuscript. The following changes have been made using Track Change according to the suggestions:Thanks for pointing out the apparent limitation regarding the result interpretation. However, a glimpse of the intellectual implication of the results has already been included at the end of the conclusion (please, see from "Apart from these limitations, this study has strengths in a few areas…" to "Finally, this research dealt with a larger dataset than the previous studies on the . Also, the last sentence would inform the readers that this is an exploratory study, and such studies might have limitations from different aspects (e.g., reaching some certain and concrete conclusions), but it can guide future studies in this area. From this perspective, the 1.

No competing interests were disclosed.The benefits of publishing with F1000Research:Your article is published within days, with no editorial bias • You can publish traditional articles, null/negative results, case reports, data notes and more • The peer review process is transparent and collaborative • Your article is indexed in PubMed after passing peer review • Dedicated customer support at every stage • For pre-submission enquiries, contact research@f1000.com