key: cord-0797302-9tekihpq authors: Hatmal, Ma’mon M.; Al-Hatamleh, Mohammad A. I.; Olaimat, Amin N.; Hatmal, Malik; Alhaj-Qasem, Dina M.; Olaimat, Tamadur M.; Mohamud, Rohimah title: Side Effects and Perceptions Following COVID-19 Vaccination in Jordan: A Randomized, Cross-Sectional Study Implementing Machine Learning for Predicting Severity of Side Effects date: 2021-05-26 journal: Vaccines (Basel) DOI: 10.3390/vaccines9060556 sha: 2e57ab0308770d7ca98da23d278c573184619735 doc_id: 797302 cord_uid: 9tekihpq Background: Since the coronavirus disease 2019 (COVID-19) was declared a pandemic, there was no doubt that vaccination is the ideal protocol to tackle it. Within a year, a few COVID-19 vaccines have been developed and authorized. This unparalleled initiative in developing vaccines created many uncertainties looming around the efficacy and safety of these vaccines. This study aimed to assess the side effects and perceptions following COVID-19 vaccination in Jordan. Methods: A cross-sectional study was conducted by distributing an online survey targeted toward Jordan inhabitants who received any COVID-19 vaccines. Data were statistically analyzed and certain machine learning (ML) tools, including multilayer perceptron (MLP), eXtreme gradient boosting (XGBoost), random forest (RF), and K-star were used to predict the severity of side effects. Results: A total of 2213 participants were involved in the study after receiving Sinopharm, AstraZeneca, Pfizer-BioNTech, and other vaccines (38.2%, 31%, 27.3%, and 3.5%, respectively). Generally, most of the post-vaccination side effects were common and non-life-threatening (e.g., fatigue, chills, dizziness, fever, headache, joint pain, and myalgia). Only 10% of participants suffered from severe side effects; while 39% and 21% of participants had moderate and mild side effects, respectively. Despite the substantial variations between these vaccines in the presence and severity of side effects, the statistical analysis indicated that these vaccines might provide the same protection against COVID-19 infection. Finally, around 52.9% of participants suffered before vaccination from vaccine hesitancy and anxiety; while after vaccination, 95.5% of participants have advised others to get vaccinated, 80% felt more reassured, and 67% believed that COVID-19 vaccines are safe in the long term. Furthermore, based on the type of vaccine, demographic data, and side effects, the RF, XGBoost, and MLP gave both high accuracies (0.80, 0.79, and 0.70, respectively) and Cohen’s kappa values (0.71, 0.70, and 0.56, respectively). Conclusions: The present study confirmed that the authorized COVID-19 vaccines are safe and getting vaccinated makes people more reassured. Most of the post-vaccination side effects are mild to moderate, which are signs that body’s immune system is building protection. ML can also be used to predict the severity of side effects based on the input data; predicted severe cases may require more medical attention or even hospitalization. The severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) emerged in China in late December 2019, causing coronavirus disease 2019 . The virus has rapidly spread across the world, resulting in a worldwide pandemic that has lasted through this moment [1] . Although many therapeutic compounds and drugs have been suggested and repurposed in the fight against COVID-19, they remained as supportive treatment options [2, 3] . The process of administering a vaccine to allow the immune system to create protection against an infection is known as vaccination. Vaccines aid in the prevention of illness from incurable conditions by stimulating the body's adaptive immunity [4] . The only way for resuming normal life and rescuing global economies remains the invention of a vaccine. Therefore, health agencies, university researchers, and medical companies have sparked a race to create and produce effective vaccines [5, 6] . Vaccines for COVID-19 are being produced at a rate never seen before. With this unparalleled initiative comes post-marketing safety monitoring and vaccine safety problems [7] . As of 19 April 2021, according to the Milken Institute's COVID-19 treatment and vaccine tracker, there are 252 COVID-19 vaccine candidates around the world under different vaccine platforms and stages of development [8] . A total of 82 vaccines were under the category of protein subunit, 32 were RNA-based, 30 non-replicating viral vector, 23 replicating viral vector, 22 virus-like particle, 20 inactivated virus, 4 live-attenuated virus, 2 replicating bacterial vector, and 16 unknown. However, only four COVID-19 vaccines were authorized in all countries of the world: BNT162 (Pfizer-BioNTech), mRNA 1273 (Moderna), ChAdOx1 (AstraZeneca), and Ad26.COV2-S (Johnson & Johnson). Other vaccines such as Sputnik V (Gamaleya), BBIBP-CorV (Sinopharm), CoronaVac (Sinovac), and COVAXIN (Bharat Biotech) have also finished phase III clinical trials and have currently been authorized for emergency use in many countries [8] . In Jordan, a country with a population of around 10 million, 685,000 COVID-19 cases with 8200 deaths were reported by 17 April 2021 [9] . The current situation in Jordan is considered worse than the first wave, as the country is suffering from the second wave of COVID-19, which is mainly attributed to the faster transmission of the UK coronavirus variant (known as B.1.1.7). Thus, the government announced stricter measures to combat the outbreak [10] . On the other hand, on 23 December 2020 the Ministry of Health in Jordan has launched the national vaccination campaign and invited everyone who lives in Jordan to register for free vaccination against COVID-19. Till this moment, the number of fully vaccinated people in Jordan is~122,000 (~1.2%), and the total number of doses given is 665,000 (Jordanian Ministry of Health, 2021). The rapid development of COVID-19 vaccines, due to the urgency of the pandemic, in addition to technological advances and existing vaccine candidates [11] , has contributed to the emergence of many rumors. Vaccine rumors are well-persistent during the postvaccination period. Rumors that COVID-19 vaccines are linked to various post-vaccination adverse effects (such as infertility) continue to circulate and be debated on various social media sites [12] . Jordanians' ability to participate in a COVID-19 vaccination has been investigated in previous studies. According to the findings, a low percentage of participants (36.1%) expressed interest in participating in vaccine clinical trials [13] . Another study also found that COVID-19 misinformation and conspiracy beliefs have a negative impact on vaccine hesitancy among Jordanians [14] . This may be a major impediment to the pandemic's good management. Vaccine hesitancy was linked to a dependence on social media as the primary source of knowledge about COVID-19 vaccines [14] . Therefore, since different vaccines are being used in Jordan's national vaccination campaign, there is a significant need to assess side effects and perceptions after vaccination in order to tackle vaccine hesitancy and rumors. This study aimed to look at the side effects that people have identified after receiving various COVID-19 vaccines in Jordan, as well as their impressions. To accomplish that, an online survey was developed and the recorded data was statistically analyzed. Furthermore, Vaccines 2021, 9, 556 3 of 23 machine learning (ML) tools were utilized to build predictive models that involve the implementation of statistical means for learning and predicting outputs like the severity of post-vaccination side effects based on other participants' responses, demographic and medical data. A randomized, cross-sectional study was performed from 9 to 15 April 2021 among Jordan inhabitants who received COVID-19 vaccines, regardless of their nationalities, ethnicities, occupations, and places of residence. Adults (18 years and older) were asked to take part in a self-administered online survey (created with Google Forms) that was circulated via social media platforms (i.e., Facebook, Instagram, and WhatsApp). Potential participants were directed to a page that included a thorough description of the study's purpose before being asked to agree to a mandatory electronic informed consent form that included statements about voluntary participation and anonymity. This study was approved by The Hashemite University's Institutional Review Board (IRB), approval code: 3/10/2020/2021, and the World Medical Association Declaration of Helsinki guidance was followed. The study's survey tool (Supplementary Material) was developed after an extensive literature search that included Medline/PubMed, Google Scholar, and other databases. As a result, a wide spectrum of potential post-vaccination side effects was identified and covered in this survey. Several questions were also added to record participants' demographic data and to assess their general health status before getting vaccinated, as well as their pre-and post-vaccination perceptions about COVID-19 vaccines. The survey tool was written in English, and it was validated by a panel of experts who provided feedback on the different items of the survey, which were then updated based on their suggestions. The survey was translated into Arabic, the official language in Jordan, before testing and distributing. To test the clarity and comprehensibility of survey content, a pilot study was conducted by including 38 respondents who were excluded from the formal evaluation, and further amendments were carried out based on their comments. The Cronbach's alpha test of internal consistency was used to assess the reliability of the survey tool. In this study, the test suggested that the survey tool was reliable overall and Cronbach's alpha was equal to 0.76, which is above 0.70 as a general cut-off limit. The survey tool's final edition had four sections. The first section included sociodemographic information and the medical records of participants. The second section looked at the COVID-19 post-vaccination side effects among participants. The third section included several concerns regarding their perceptions, interests, and sources of knowledge about various COVID-19 vaccines. The survey's final section assessed the signs that lead to hospitalization or medical visits. The representative sample size was derived from the online Raosoft sample size calculator (Raosoft Inc., Seattle, WA, USA). It was calculated based on a 50% response rate, a 99% confidence interval, and a 5% margin of error with a total 550,000 vaccinated population in Jordan at the end of the study period, as of 15 April 2021 (according to the Ministry of Health, Amman, Jordan). The representative sample size required was 663. In the present study, 2237 respondents participated which represents more than 3-fold of that required sample, which means a convenience sample was used as the sampling tool. Data were analyzed using the Statistical Package for the Social Sciences (SPSS) version 22.0 (SPSS) (IBM Corporation, Armonk, NY, USA), and vassarstats.net online tools were Vaccines 2021, 9, 556 4 of 23 used for performing the chi-square test. For continuous and categorical variables, the means, standard deviations (SD), and percentages were reported, respectively. For the aim of predicting the severity of the side effects after receiving different COVID-19 vaccines, several orthogonal ML tools were used: multilayer perceptron (MLP) (Logistic function), eXtreme gradient boosting (XGBoost), random forest (RF), and K-star (K*). These tools were built using version 4.1.3 of KNIME Analytics Platform (KNIME AG, Zurich, Switzerland). Data was used as 5-fold cross-validation. The input features were based on participants' responses to all survey's questions, except questions 10, 11, 12, 16, 17, 18, 20, and 21 (Supplementary Material) ; these omitted questions were about self-beliefs and emotions, and thus they were excluded to prevent bias in the prediction process. The output was the severity of the post-vaccination side effects (i.e., no, mild, moderate, and severe side effects). RF is a multipurpose ML strategy for classification [15] [16] [17] . RF is based on an ensemble of decision trees (DTs). Each tree predicts a classification independently and "votes" for the related class, and most of the votes decide the overall RF predictions [18] . RF learner node within KNIME Analytics Platform was implemented with the following settings: splitting criterion is the information gain ratio, which normalizes the standard information gain by the split entropy to overcome any unfair preference for nominal splits with many child nodes, while the number of trees is 100. No limitations were imposed on the number of levels or minimum node size. The accuracy was calculated using out-of-bag internal validation. XGBoost relies on the ensemble of weak DT-type models to create boosted, DT-type models. This system includes a novel tree learning algorithm, a theoretically justified weighted quantile sketch procedure with parallel, and distributed computing [18] [19] [20] . We implemented the XGBoost learner node within KNIME Analytics Platform with the following settings: tree booster was implemented with depth wise grow policy, boosting rounds = 100, Eta = 0.3, Gamma = 0, maximum depth = 6, minimum child weight = 1, maximum delta step = 0, subsampling rate = 1, column sampling rate by tree = 1, column sampling rate by level = 1, lambda = 1, Alpha = 0, sketch epsilon = 0.03, scaled position weight = 1, maximum number of bins = 256, sample type (uniform), normalize type (tree), and dropout rate = 0. It is an implementation of the RProp algorithm for multilayer feed forward networks [21] . MLP has the capacity to learn nonlinear models in real-time. MLP can have one or more nonlinear hidden layers between the input and output layers. For each hidden layer, different numbers of hidden neurons can be assigned. Each hidden neuron gives a weighted linear summation for the values from the previous layer, and the nonlinear activation function is followed. The output values were reported after the output layer transforms the values from the last hidden layer. We implemented MLP learner node within KNIME Analytics Platform with the following optimized parameters: maximum number of iterations = 100, number of hidden layers = 3, and number of hidden neurons per layer = 100. The K* is an instance-based classifier. The class of a test instance is based upon the class of those training instances similar to, as determined by some similarity function. It differs from other instance-based learners by using an entropy-based distance function [22] . The default settings were used: average column entropy curve is used for missing mode, and manual blend setting is 20%. ML models were evaluated by calculating their accuracies (Equation (1)) and Cohen's kappa (κ) values (Equation (2)) [23] against the testing sets. where TP is the true positive (correctly classified predictions), TN is true negative (truly classified predictions), and N is the total number of evaluated cases. where P 0 is the relative observed agreement among raters (i.e., accuracy), and P e is the hypothetical probability of chance agreement. This was carried out by using the observed data to calculate the probabilities of each observer randomly seeing each category. If the raters are in complete agreement then Cohen's κ = 1. If there is no agreement among the raters other than what would be expected by chance (as given by P e ), Cohen's κ = 0. Negative Cohen's κ value implies the agreement is worse than random [24] . In 5-fold cross-validation, the process was repeated until all training data points were removed from the training list and predicted at least once. The accuracy was calculated based on comparing classification results with actual reported severities. The responses of 2213 participants (869 males and 1344 females) were included in the analyses, while twenty-four participants provided inconsistent or incomplete responses (i.e., important items such as informed consent, age, vaccine type, and number of doses were missed), and therefore, they have been excluded. Around one-third of the participants were healthcare workers, and 86% of them were completed their university education (diploma, bachelor or postgraduate studies). Participants were from different age categories and places of residence (Table 1) . After medical and scientific websites (28%), around 14% of participants showed that Jordan's public media channels are the second source for COVID-19 vaccine-related information, followed by social media platforms (11%) ( Table 2 ). Based on their personal knowledge and beliefs about COVID-19 vaccines, most of the participants (54%) expressed that they would prefer to get Pfizer-BioNTech vaccine if they can choose before vaccination, 20% had no preferred vaccine, and 16% of them preferred the Sinopharm vaccine ( Figure 1 ). After medical and scientific websites (28%), around 14% of participants showed tha Jordan's public media channels are the second source for COVID-19 vaccine-related in formation, followed by social media platforms (11%) ( Table 2 ). Based on their persona knowledge and beliefs about COVID-19 vaccines, most of the participants (54%) ex pressed that they would prefer to get Pfizer-BioNTech vaccine if they can choose befor vaccination, 20% had no preferred vaccine, and 16% of them preferred the Sinopharm vaccine ( Figure 1 ). Furthermore, more than half of participants reported that they were initially scared from the side effects of COVID-19 vaccines. About 32% of the participants are suffering from chronic diseases, 18% were previously infected with COVID-19, 38% are smokers, and less than 7% have food and drug allergies ( Figure 2 ). Furthermore, more than half of participants reported that they were initially scared from the side effects of COVID-19 vaccines. About 32% of the participants are suffering from chronic diseases, 18% were previously infected with COVID-19, 38% are smokers, and less than 7% have food and drug allergies ( Figure 2 ). Most of the participants received Sinopharm, AstraZeneca, and Pfizer-BioNTech vaccines, 38.2%, 31%, and 27.34%, respectively, while the rest received other types including Sputnik V, Moderna, Covaxin, and Johnson & Johnson vaccines. However, in terms of full vaccination (i.e., received two doses), participants who received Pfizer-BioNTech vaccine were the majority, compared to their peers who received Sinopharm and AstraZeneca vaccines, respectively (Table 3) . Only 5% of the study's participants reported that they had been infected with COVID-19 after receiving a vaccine. After getting vaccinated, most of the participants felt more reassured (80%) and have advised others to get vaccinated too (95%). Most participants (95%) also believed that keeping prevention measures is still necessary after vaccination, while 67% and 64% of them believed that COVID-19 vaccines are safe for the long term and that they began to monitor their vital signs more frequently after getting vaccinated, respectively ( Figure 3 ). Most of the participants received Sinopharm, AstraZeneca, and Pfizer-BioNTech vaccines, 38.2%, 31%, and 27.34%, respectively, while the rest received other types including Sputnik V, Moderna, Covaxin, and Johnson & Johnson vaccines. However, in terms of full vaccination (i.e., received two doses), participants who received Pfizer-BioNTech vaccine were the majority, compared to their peers who received Sinopharm and AstraZeneca vaccines, respectively (Table 3) . Only 5% of the study's participants reported that they had been infected with COVID-19 after receiving a vaccine. After getting vaccinated, most of the participants felt more reassured (80%) and have advised others to get vaccinated too (95%). Most participants (95%) also believed that keeping prevention measures is still necessary after vaccination, while 67% and 64% of them believed that COVID-19 vaccines are safe for the long term and that they began to monitor their vital signs more frequently after getting vaccinated, respectively ( Figure 3 ). In the present study, out of all participants (2213), 1558 (70%) reported post-vaccination side effects; of them, the majority reported mild (39%) to moderate (21%) side effects. Only 10% suffered from severe side effects ( Figure 4) . Obviously, the severity of side effects among participants differed based on the type of COVID-19 vaccine. Most of the participants who reported high percentages of moderate to severe side effects (in descending order) were received AstraZeneca, Pfizer-BioNTech, and Sinopharm vaccines, and vice versa for those who recorded no to mild side effects ( Figure 5 ). In the present study, out of all participants (2213), 1558 (70%) reported post-vaccination side effects; of them, the majority reported mild (39%) to moderate (21%) side effects. Only 10% suffered from severe side effects ( Figure 4) . Obviously, the severity of side effects among participants differed based on the type of COVID-19 vaccine. Most of the participants who reported high percentages of moderate to severe side effects (in descending order) were received AstraZeneca, Pfizer-BioNTech, and Sinopharm vaccines, and vice versa for those who recorded no to mild side effects ( Figure 5 ). On the other hand, despite the types of COVID-19 vaccine, the chi-square (χ 2 ) test has shown significant associations between both the presence and number of post-vaccination side effects and the number of received doses (p = 0.01 and 0.00, respectively). The presence of side effects was significantly higher at the first dose of COVID-19 vaccines. Furthermore, the number of participants who reported ≥7 different side effects was also higher after the first dose of vaccine. The χ 2 test also showed that the possibility of infection with COVID-19 after vaccination and the feeling of reassured were both significantly associated with the number of vaccine doses (p = 0.00) ( Table 4) . In the present study, out of all participants (2213), 1558 (70%) reported post-vaccination side effects; of them, the majority reported mild (39%) to moderate (21%) side effects. Only 10% suffered from severe side effects ( Figure 4) . Obviously, the severity of side effects among participants differed based on the type of COVID-19 vaccine. Most of the participants who reported high percentages of moderate to severe side effects (in descending order) were received AstraZeneca, Pfizer-BioNTech, and Sinopharm vaccines, and vice versa for those who recorded no to mild side effects ( Figure 5 ). On the other hand, despite the types of COVID-19 vaccine, the chi-square (χ 2 ) test has shown significant associations between both the presence and number of post-vaccination side effects and the number of received doses (p = 0.01 and 0.00, respectively). The presence of side effects was significantly higher at the first dose of COVID-19 vaccines. Furthermore, the number of participants who reported ≥ 7 different side effects was also higher after the first dose of vaccine. The χ 2 test also showed that the possibility of infection with COVID-19 after vaccination and the feeling of reassured were both significantly associated with the number of vaccine doses (p = 0.00) ( Table 4 ). A wide spectrum of potential post-vaccination side effects has been assessed among participants in the present study. Figure 6 represents the frequencies of all these side effects, regardless of the type of received COVID-19 vaccine. The most common side effects were fatigue/tiredness (58.20%), injection site pain and swelling (53.45%), headache (46.99%), sleepiness and laziness (45.36%), chills (43.87%), myalgia (42.34%), joints pain (41.48%), and fever (37.37%), respectively. Other side effects were less common among vaccinated participants ( Figure 6) . A wide spectrum of potential post-vaccination side effects has been assessed among participants in the present study. Figure 6 represents the frequencies of all these side effects, regardless of the type of received COVID-19 vaccine. The most common side effects were fatigue/tiredness (58.20%), injection site pain and swelling (53.45%), headache (46.99%), sleepiness and laziness (45.36%), chills (43.87%), myalgia (42.34%), joints pain (41.48%), and fever (37.37%), respectively. Other side effects were less common among vaccinated participants ( Figure 6 ). Regarding the time required for post-vaccination side effects to begin, participants' responses showed that side effects mostly appeared within 9-12 h of vaccine injection (35%). Around 26% of participants reported that side effects started after 5-8 h, while 15% within up to 4 h ( Figure 7) . Furthermore, more than half of them (56%) stated that these side effects lasted for one to three days, and 30% for less than one day (Figure 8 ). To relieve post-vaccination side effects, most of the participants (66%) took painkillers with staying at home, without the need for hospitalization, or even to consult a doctor, while 31% of them took only a rest at home without any medication ( Figure 9 ). Regarding the time required for post-vaccination side effects to begin, participants' responses showed that side effects mostly appeared within 9-12 h of vaccine injection (35%). Around 26% of participants reported that side effects started after 5-8 h, while 15% within up to 4 h ( Figure 7) . Furthermore, more than half of them (56%) stated that these side effects lasted for one to three days, and 30% for less than one day (Figure 8 ). To relieve post-vaccination side effects, most of the participants (66%) took painkillers with staying at home, without the need for hospitalization, or even to consult a doctor, while 31% of them took only a rest at home without any medication ( Figure 9 ). To address the potential association of post-vaccination side effects with the number of received COVID-19 vaccine doses, the chi-square test (Yate's corrected) was used ( Table 5 ). The test showed significant associations between the number of doses and the possibility of infection with COVID-19 after vaccination (p = 0.00) and a few side effects including nausea (p = 0.04), chills (p = 0.05), sleepiness and laziness (p = 0.00), cold/numbness and tingling in limbs (p = 0.00), dizziness (p = 0.02), and abnormal blood pressure (p = 0.05). To address the potential association of post-vaccination side effects with the number of received COVID-19 vaccine doses, the chi-square test (Yate's corrected) was used ( Table 5 ). The test showed significant associations between the number of doses and the possibility of infection with COVID-19 after vaccination (p = 0.00) and a few side effects including nausea (p = 0.04), chills (p = 0.05), sleepiness and laziness (p = 0.00), cold/numbness and tingling in limbs (p = 0.00), dizziness (p = 0.02), and abnormal blood pressure (p = 0.05). To address the potential association of post-vaccination side effects with the number of received COVID-19 vaccine doses, the chi-square test (Yate's corrected) was used ( Table 5 ). The test showed significant associations between the number of doses and the possibility of infection with COVID-19 after vaccination (p = 0.00) and a few side effects including nausea (p = 0.04), chills (p = 0.05), sleepiness and laziness (p = 0.00), cold/numbness and tingling in limbs (p = 0.00), dizziness (p = 0.02), and abnormal blood pressure (p = 0.05). The chi-square test (Yate's corrected) was also used to assess the potential association of post-vaccination side effects with the different types of COVID-19 vaccine ( Table 6 ). The results showed significant associations between types of vaccine and several side effects including injection site pain and swelling (p = 0.00), sleepiness and laziness (p = 0.00), chills (p = 0.02), clogged or runny nose (p = 0.02), and sore or dry throat (p = 0.02). The severity and number of side effects were also significantly associated with types of vaccine (p = 0.00). For prediction using different ML tools, a confusion matrix was built as indicated in Table 7; Table 8 shows the accuracy, Cohen's κ, true positive rate (TPR), and true negative rate (TNR) to predict the severity of side effects after receiving different COVID-19 vaccines using different ML tools based on demographic data and other participants responses. In the present study, females (60%) participated more than males. The highest number of people who participated were in the 30-49 years of age category. The most common chronic diseases among the participants were obesity (n = 134), joint inflammations (n = 79), respiratory diseases (n = 67), autoimmune diseases (n = 40), thyroid disorders (n = 40), dyslipidemia (n = 15), cancers (n = 12), and osteoporosis (n = 3). Different COVID-19 vaccines have been used among participants. As shown in Figure 10A , the main vaccines received by the participants were Sinopharm, Pfizer-BioNTech, and AstraZeneca, respectively. Obviously, the most abundant severe side effects were reported by those who received the AstraZeneca vaccine, while "no symptoms" are mostly reported by those who received Sinopharm vaccine, as shown in Figure 10B Not surprisingly, around one-third (n = 726, 32.7%) of the participants were healthcare workers. Before vaccine availability, several studies had assessed the acceptance of COVID-19 vaccines among healthcare workers. A study from the United States involved 3479 healthcare workers and showed that only 8% of them were planning to refuse COVID-19 vaccination, suggesting the potential for high uptake [25] . Another study from the Asia-Pacific region showed that around 95% of 1720 healthcare workers were willing to vaccinate against COVID-19 [26] . Therefore, a number of early studies have recruited healthcare workers to assess the potential side effects following COVID-19 vaccination [27] [28] [29] [30] . Similar to findings of studies recently published (Table 9) , despite the received COVID-19 vaccine, the most common post-vaccination side effects were fatigue, injection site pain and swelling, headache, sleepiness and laziness, chills, myalgia, joint pain, and fever. However, most of these studies have assessed mainly the post-vaccination side effects of the Pfizer-BioNTech and Moderna vaccines [27] [28] [29] 31, 32] , while only two studies have focused on the AstraZeneca vaccine [30, 33] . Not surprisingly, around one-third (n = 726, 32.7%) of the participants were healthcare workers. Before vaccine availability, several studies had assessed the acceptance of COVID-19 vaccines among healthcare workers. A study from the United States involved 3479 healthcare workers and showed that only 8% of them were planning to refuse COVID-19 vaccination, suggesting the potential for high uptake [25] . Another study from the Asia-Pacific region showed that around 95% of 1720 healthcare workers were willing to vaccinate against COVID-19 [26] . Therefore, a number of early studies have recruited healthcare workers to assess the potential side effects following COVID-19 vaccination [27] [28] [29] [30] . Similar to findings of studies recently published (Table 9) , despite the received COVID-19 vaccine, the most common post-vaccination side effects were fatigue, injection site pain and swelling, headache, sleepiness and laziness, chills, myalgia, joint pain, and fever. However, most of these studies have assessed mainly the post-vaccination side effects of the Pfizer-BioNTech and Moderna vaccines [27] [28] [29] 31, 32] , while only two studies have focused on the AstraZeneca vaccine [30, 33] . There was a significant association between the number of doses of COVID-19 vaccines and the number of the resulting side effects (p = 0.00); the side effects tend to be more noticeable after the first dose. However, according to the Centers for Disease Control and Prevention (CDC), side effects after the second dose may be more intense [34] . In fact, due to the urgency of this issue, most of the participants in the previous studies that assessed the post-vaccination side effects had only received the first dose of their COVID-19 vaccines. Therefore, further studies with a greater number of participants who received the second dose are still required in order to confirm this point. Furthermore, the propensity for infection with COVID-19 significantly decreased among participants who received the second dose of the vaccine (p = 0.00), implying the value of obtaining the full vaccination. Except for nausea, chills, sleepiness and laziness, cold/numbness and tingling in limbs, dizziness, and abnormal blood pressure, the majority of side effects showed no significant association with the number of doses (Table 5) . Although all COVID-19 vaccines cause similar post-vaccination side effects, both the severity and number of these side effects were significantly associated with vaccine type (p = 0.00); AstraZeneca > Pfizer-BioNTech > Sinopharm. The frequencies of some side effects were also significantly associated with vaccine type. The following are the side effects that are significantly associated with types of vaccines (in descending, and with p-value): injection site pain and swelling (Pfizer-BioNTech > AstraZeneca > Sinopharm, p = 0.00); chills (AstraZeneca > Pfizer-BioNTech > Sinopharm, p = 0.02); sore or dry throat, clogged nose, and runny nose (Sinopharm > AstraZeneca > Pfizer-BioNTech, p = 0.02); sleepiness and laziness (AstraZeneca > Sinopharm > Pfizer-BioNTech, p = 0.00). Overall, these differences may be attributed to the nature of each vaccine and their mechanisms of action. There are several platforms for viral vaccines development, including live attenuated, inactivated, DNA-based, RNA-based, protein-based, and viral vector-based. Vaccines being developed by each of these strategies have various advantages and disadvantages associated with their efficacy, safety, immunogenicity, and ease of use [35] . In fact, As-traZeneca vaccine consists of ChAdOx1 (replication-deficient simian adenovirus vector) containing the full-length structural SARS-CoV-2 spike (S) protein, with a leader sequence (DNA) fused to a tissue-type plasminogen activator [36] . The S protein plays a crucial role in penetrating host cells and initiating infection of all SARS viruses, and thus it is a major target in the development of vaccines and therapeutics which help in modulating the host response to COVID-19 [1] . The AstraZeneca vaccine expresses a codon-optimized coding sequence for the S protein in the human body, which results in building immunity against SARS-CoV-2 [36] . The Pfizer-BioNTech vaccine is nucleoside-modified mRNAs, formulated in lipid nanoparticles, encoding the S protein of SARS-CoV-2, modified by two proline mutations to lock it in the prefusion conformation [37] . Despite the fact that RNA is a relatively unstable molecule, novel vaccine designs have been developed to improve its stability and protein translation performance, which has resulted in an improved immune response with a high level of neutralizing antibodies [38] . While both AstraZeneca and Pfizer-BioNTech vaccines are developed using nextgeneration platforms (i.e., DNA-and RNA-based viral vectors), Sinopharm vaccine has been developed using a conventional technology (i.e., inactivated virus). To inactivate virus production, β-propionolactone was thoroughly mixed with the harvested viral solution, while the manufactured vaccine contains total protein with aluminum hydroxide adjuvant [39] . Although DNA vaccines are easy to produce and store with an excellent stability and a limited toxicity [38] , the concerns about their safety and immunogenicity still require further investigation. In the rhesus macaque model studies, 5 of 6 lung lobes in the vaccinated group with AstraZeneca vaccine showed a detectable viral load, while after using Sinopharm vaccine there was no detectable viral load [40, 41] . However, these studies showed that both AstraZeneca and Sinopharm vaccines conferred effective protection and prevented viral interstitial pneumonia. In the present study, most of the participants who visited a doctor or have been admitted to a hospital (n = 57) suffered from non-serious side effects. However, a total of six vaccinated participants were diagnosed with thrombocytopenia, of whom two were also diagnosed with thrombosis (blood clots) within the first 24 h of getting vaccinated with the second dose of either Pfizer-BioNTech or AstraZeneca vaccine (Table 10 ). After several reports from different countries across Europe [42] , the rare risk of thrombocytopenia and unusual blood clots associated with the AstraZeneca vaccine was confirmed by the European Medicines Agency (EMA) [43] . Recently, concerns started to emerge about the same risks among a few people vaccinated with Pfizer-BioNTech vaccine. A report from Italy shows that a 66-year-old woman has been diagnosed with deep vein thrombosis, despite all blood tests (including platelet count and clotting-related tests) being normal [44] . However, the benefits of these vaccines extremely outweigh their risks, especially knowing the risk of mortality resulting from COVID-19 and that it could cause a greater risk of thrombocytopenia and unusual blood clots [45, 46] . Researchers are still searching for possible links between these unusual risks and COVID-19 vaccines. However, previous studies have reported that thrombocytopenia is commonly reported following injection with adenoviral gene transfer vectors [47] . A study showed that the von Willebrand Factor (VWF) and P-selectin are critically involved in a complex platelet-leukocyte-endothelial interplay, resulting in platelet activation and accelerated platelet clearance following adenovirus administration [48] . This probably explains the risk of thrombocytopenia and blood clots associated with adenovirus-based vaccines (i.e., AstraZeneca and Pfizer-BioNTech vaccines). However, it is important to avoid any mistaken identification of other causes as post-vaccination side effects. Therefore, for patients who develop serious symptoms after vaccination, it is necessary to study their health history and full clinical profile to confirm whether these are vaccination-related side effects or not. Moreover, Pfizer-BioNTech vaccine was the third most commonly received by participants (38.2% Sinopharm, 31% AstraZeneca, 27.34% Pfizer-BioNTech, and 3.46% other vaccines). It was the first vaccine received by participants who are fully vaccinated (61% of 431), and it was the most preferred (54%) vaccine for participants before vaccination. This is probably because it was the first authorized vaccine globally [49] , and thus it is one of the most administrated COVID-19 vaccines globally. The reason for this preference could also be attributed to the huge number of online available resources (i.e., studies, web pages, articles, etc.) that recommended its safety and efficacy. Meanwhile, in the present study, the main sources of information about COVID-19 vaccines among participants were medical and scientific websites ( Table 2) . Despite the insignificant association between COVID-19 vaccines in the ratio of vaccinated participants who infected with COVID-19 following vaccination (Table 6 ), it was clear that Sinopharm vaccine has the lowest ratio (33/845), followed by AstraZeneca and Pfizer-BioNTech vaccines (39/686 and 39/605, respectably). However, a recent study by Amit et al. [50] showed that the ratio of vaccinated people infected with COVID-19 after receiving the first dose of Pfizer-BioNTech vaccine to the total number of study's participants is 22/4081, while in the present study it is 24/342 after the first dose only. This variation in ratios could be due to the fact that Amit et al.'s study [50] involved only healthcare workers; this category of the population is supposed to be well-educated and has a further strict adherence in following prevention measures to avoid COVID-19 infection [51] . In Amit's study [50] , individuals infected with COVID-19 were also tested in the early post-vaccination period (1-10 days), while there was no time limit in the present study. Despite the fact that the preventive efficacy of COVID-19 vaccines is debated in clinical trials, the knowledge about what happens following vaccination in the real world is still modest, especially among the general population. Thus, knowing what to expect after vaccination will help with public education, dispelling myths, and lowering the apprehension about COVID-19 vaccines [30] . Fear and suspicion, as well as a lack of information about clinical trials, have all been identified as factors that may lead to hesitancy in receiving the COVID-19 vaccines. In addition, the COVID-19 epidemiological situation in the country could also influence vaccine use [13] . In the present study, most of the participants were scared of the COVID-19 vaccine before receiving it (53%). However, the overall picture dramatically changed after vaccination; most of the participants felt more reassured and have advised others to get vaccinated (80%). Having this in mind, if a country conducts its own independent studies, by its local researchers, on the safety of COVID-19 vaccines, it seems that the public confidence in the vaccines' safety increased, which accelerates the vaccination process against COVID-19. Therefore, amid the modest participation in Jordan's national vaccination campaign, the findings of this study could be of interest to the Ministry of Health as they can be utilized during its guided efforts to raise awareness of the safety, effectiveness, and benefits of COVID-19 vaccination. These findings refute the rumors and conspiracy beliefs about the post-vaccination side effects of COVID-19 vaccines, which have a negative impact on vaccine hesitancy among Jordanians [14] . On the other side, several ML learners were evaluated, namely, XGBoost, RF, MLP, and K*. Age, gender, and participants' responses to different questions (Table 8) were used as input descriptors. Clearly from Table 8 , learners achieved different accuracies; which prompted us to use Cohen's κ as additional success criteria of the resulting ML models. Cohen's κ is a more robust measure than accuracy, as it takes into account the possibility of prediction by chance [52] . Fleiss's [53] equally arbitrary guidelines characterize Cohen's κ over 0.75 as excellent, 0.40 to 0.75 as fair to good, and below 0.40 as poor. RF and XGboost yielded good accuracy and Cohen's κ values. MLP showed less accuracy and Cohen's κ values, while in our case K* was the least accurate ML tool and the one with the least Cohen's κ value. K* can handle noisy data and it requires less time to train the data. However, its performance becomes better with large datasets [54] . Such tools can be implemented in the future for larger databases that include an extensive number of participants and input features, which could efficiently determine people with severe adverse effects who might need hospital admission or medical monitoring. In large databases, feature selection and weighting tools (i.e., genetic algorithms and stepwise forward and reverse methods) can be implemented to select the most relevant predicting subsets of input features. It is known that some patients with serious life-threatening side effects can conceal their symptoms in order to prevent hospitalization, which may last many days in some cases [55] . Access to these cases may be difficult, particularly during pandemics where a large number of people are infected. ML, on the other hand, is designed to assist in such circumstances by predicting people who may experience serious life-threatening adverse effects based on the type of vaccine, demographic data, and simplified recorded symptoms. These expected cases may necessitate immediate hospitalization and additional medical care. Furthermore, ML may assist in identifying avoidable hospital admissions, reducing the pressure on hospitals. Moreover, future studies should address the expected background disease events that may be temporarily associated with, but not caused by, COVID-19 vaccination during mass immunization. For example, a study found that the expected incidences of selected coincident background events after the mass immunization against H1N1 influenza in China were as following: 7.71 cases of Guillain-Barré syndrome would be expected to occur within six weeks (from a cohort of 10 million individuals), 126.58 cases of sudden adult death syndrome would be expected to occur within one day of vaccination (from 1 million migrant workers), 1381 cases of preterm labors would be expected to occur within one day after the vaccination (from a cohort of 1 million vaccinated pregnant women with a stillbirth of 196-258 days) [56] . Another study showed that, if a cohort of 10 million people were to be vaccinated against H1N1 influenza in China, 11.5, 80.2, and 481.5 cases of sudden cardiac death would be expected to occur as coincident temporal associations with vaccination, within 1 day, 1 week, and 6 weeks after immunization, respectively [57] . The findings of such studies may help health authorities to assess the safety of COVID-19 vaccines and the effectiveness of mass immunization, and could improve future vaccine education and use. The results of the current study may provide an important baseline for increasing the awareness of the general community about COVID-19 vaccines. These findings suggest that health authorities and government should develop and plan appropriate educational strategies to increase the community knowledge and importance of vaccines in eradicating the viral infections which may reduce the vaccine hesitancy due to the lack of knowledge, false religious beliefs, or anti-vaccine misinformation. These results may also increase the public confidence in the safety of COVID-19 vaccines, which accelerate the process of vaccination in Jordan by disproving the rumors and conspiracy beliefs about the postvaccination side effects of COVID-19 vaccines. To the best of our knowledge, this is the first comparative study of Sinopharm, Pfizer-BioNTech, and AstraZeneca vaccines based on the post-vaccination side effects. Since the most common side effects were non-life-threatening, the findings of this study can help in making people more reassured, and thus tackling vaccine hesitancy and conspiracy beliefs. On the other hand, the successful incorporation of ML tools to predict the severity of post-vaccination side effects is a promising approach that can be utilized to predict more about patients' health based on large medical databases and move towards better healthcare services. This study involved a relatively large sample size and it was 3-fold of the calculated sample size that is required to conflict internal valid study and representative results. However, this study has some limitations such as the use of a self-reported online survey, which may present information bias as a result of side effects bias exposure or misclassification. In addition, the diversity of the sample (based on place of residence) in the current study might be reported due to participation of people who have an internet connection, and the sample was not equally distributed across gender or profession which requires caution in generalizing the findings of this study. In the current study, the side effects of three types of vaccines were compared in the general population; however, other types of vaccines were not yet used in Jordan. Therefore, further study could be required for investigation of side effects of all authorized vaccines. Participants who received each of the three most common vaccines in Jordan may differ by their age since the first used vaccine was Sinopharm vaccine which was given with high priority to elderly and clinically vulnerable people. Since there is a shortage in vaccines, a low percentage of participants were fully vaccinated, particularly those who received AstraZeneca vaccine where its second dose is administered at 12 weeks following the first dose; therefore, only a few participants had received the two doses of AstraZeneca vaccine at the conducting time of this study. Despite significant differences in the existence and severity of side effects between these vaccinations, the current study concluded that the approved COVID-19 vaccines are safe, and that getting vaccinated helps people feel more secure. The majority of postvaccination side effects are mild to moderate, indicating that the body's immune system is strengthening its defenses. Furthermore, machine learning tools were used to predict the severity of side effects, and it showed that RF, XGBoost, and MLP provided high prediction accuracies of the severity of side effects based on the input data. Predicted extreme cases may require additional medical treatment or even hospitalization. Informed Consent Statement: Informed consent was obtained from all subjects involved in the study. Data Availability Statement: All data generated are contained in the present manuscript. Comprehensive Structural and Molecular Comparison of Spike Proteins of SARS-CoV-2 COVID-19 infection and nanomedicine applications for development of vaccines and therapeutics: An overview and future perspectives based on polymersomes Antiviral and Immunomodulatory Effects of Phytochemicals from Honey against COVID-19: Potential Mechanisms of Action and Future Directions Awareness of the side effects of vaccination among general public COVID-19 Vaccine: Critical Questions with Complicated Answers COVID-19 Vaccine Frontrunners and Their Nanotechnology Design Assessing the Safety of COVID-19 Vaccines: A Primer Milken Institute's COVID-19 Treatment and Vaccine Tracker COVID-19 Statistical Report Jordan Reports Highest Daily Tally of COVID-19 Cases The Lightning-Fast Quest for COVID Vaccines-And What It Means for Other Diseases Episode #24-Vaccine Myths vs Public Willingness to Participate in COVID-19 Vaccine Clinical Trials: A Study from Jordan High Rates of COVID-19 Vaccine Hesitancy and Its Association with Conspiracy Beliefs: A Study in Jordan and Kuwait among Other Arab Countries Predicting and understanding the response to short-term intensive insulin therapy in people with early type 2 diabetes Cross-omics analysis revealed gut microbiome-related metabolic pathways underlying atherosclerosis development after antibiotics treatment Unsupervised Spectral-Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification Computational Intelligence in Smart Grid Environment A Novel Image Classification Method with CNN-XGBoost Model Bioactive Molecule Prediction Using Extreme Gradient Boosting A direct adaptive method for faster backpropagation learning: The RPROP algorithm Intelligence System for Diagnosis Level of Coronary Heart Disease with K-Star Algorithm Artificial Neural Networks Model for Predicting Type 2 Diabetes Mellitus Based on VDR Gene FokI Polymorphism, Lipid Profile and Demographic Data Interrater reliability: The kappa statistic COVID-19 Vaccine Acceptance among Health Care Workers in the United States An Asia-Pacific study on healthcare workers' perceptions of, and willingness to receive, the COVID-19 vaccination Prevalence of COVID-19 Vaccine Side Effects among Healthcare Workers in the Czech Republic Adverse effects of COVID-19 mRNA-1273 vaccine: A randomized, cross-sectional study on healthcare workers with detailed self-reported symptoms Side effects of BNT162b2 mRNA COVID-19 vaccine: A randomized, cross-sectional study with detailed self-reported symptoms from healthcare workers Survey of symptoms following COVID-19 vaccination in India. medRxiv 2021 Minor to Moderate Side Effects of Pfizer-BioNTech COVID-19 Vaccine Among Saudi Residents: A Retrospective Cross-Sectional Study Reactogenicity Following Receipt of mRNA-Based COVID-19 Vaccines Vaccine side-effects and SARS-CoV-2 infection after vaccination in users of the COVID Symptom Study app in the UK: A prospective observational study Possible Side Effects After Getting a COVID-19 Vaccine COVID-19 vaccines: Rapid development, implications, challenges and future prospects Safety and immunogenicity of the ChAdOx1 nCoV-19 vaccine against SARS-CoV-2: A preliminary report of a phase 1/2, single-blind, randomised controlled trial Safety and Immunogenicity of Two RNA-Based Covid-19 Vaccine Candidates DNA vaccines against COVID-19: Perspectives and challenges Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBIBP-CorV: A randomised, double-blind, placebo-controlled, phase 1/2 trial ChAdOx1 nCoV-19 vaccine prevents SARS-CoV-2 pneumonia in rhesus macaques Development of an Inactivated Vaccine Candidate, BBIBP-CorV, with Potent Protection against SARS-CoV-2 Covid-19: European countries suspend use of Oxford-AstraZeneca vaccine after reports of blood clots AstraZeneca's COVID-19 Vaccine: EMA Finds Possible Link to Very Rare Cases of Unusual Blood Clots with Low Blood Platelets Deep vein thrombosis (DVT) occurring shortly after the second dose of mRNA SARS-CoV-2 vaccine Immune Thrombocytopenia Secondary to COVID-19: A Systematic Review. SN Compr The Impact of COVID-19 Disease on Platelets and Coagulation Adenovirus vectors for gene therapy, vaccination and cancer gene therapy Adenovirus-induced thrombocytopenia: The role of von Willebrand factor and P-selectin in mediating accelerated platelet clearance WHO Issues Its First Emergency Use Validation for a COVID-19 Vaccine and Emphasizes Need for Equitable Global Access Early rate reductions of SARS-CoV-2 infection and COVID-19 in BNT162b2 vaccine recipients Awareness and Preparedness of COVID-19 Outbreak Among Healthcare Workers and Other Residents of South-West Saudi Arabia: A Cross-Sectional Survey. Front. Public Health The measurement of observer agreement for categorical data Statistical Methods for Rates and Proportions Intrusion detection system based on K-star classifier and feature set reduction Predicting and preventing avoidable hospital admissions: A review The expected number of background disease events during mass immunization in China Awareness of the background rate of sudden cardiac death during mass immunization with pandemic H1N1 influenza vaccines increases the intended vaccination rate The authors declare no conflict of interest.