As of June 2022, there have been more than 500 million confirmed cases of COVID-19 worldwide and more than 86million cases in the United States alone (John Hopkins University, 2020). Vaccines can combat the spread and harm of COVID-19 (CDC, 2021). However, anti-vaccination attitudes (Martin & Petrie, 2017) may thwart public health efforts by limiting vaccine intention and uptake (Hopkins & Wood, 2013; McCoy, 2020; Ogueji & Okoloba, 2022). Anti-vaccination sentiment is not new. For example, these attitudes were evident with the small pox program, and openly displayed with diphtheria, tetanus, and pertussis (DTP) and human papillomavirus (HPV) vaccines. More recent and notorious, the measles, mumps, and rubella (MMR) vaccine was falsely believed to cause autism leading to significantly lower uptake (for a review/history of vaccine hesitancy and anti-vaccination sentiment, see Dubé et al., 2021). The COVID-19 pandemic has only heightened awareness of the multifaceted factors that predict vaccination intention and uptake. For example, even prior to the COVID-19 pandemic, the World Health Organization identified the reluctance to receive recommended vaccines as one of the top 10 threats to global health (WHO, 2019).

Despite public health officials’ recognition of the harm posed by these attitudes (e.g., WHO, 2019), discussions about these attitudes in the public domain as they relate to COVID-19 lack specificity and nuance. It appears from public discourse that these attitudes are indistinguishable and uniformly growing alongside the COVID-19 pandemic (e.g., Bertin et al., 2020; Palamenghi et al., 2020). However, that assumption may not be true. Martin and Petrie (2017) identified four key types of anti-vaccination attitudes: mistrusting the benefits of vaccination, worrying about unforeseen side effects, having concerns about pharmaceutical companies profiteering, and preferring natural immunity. According to functional theories of attitudes (Katz, 1960; Shavitt, 1989), attitudes perform practical functions for the individual; for instance, they help people organize and structure the external world and lead them to strive for consistency in their decisions. Thus, anti-vaccination attitudes are related to vaccine intentions (Kahn et al., 2003; Paul et al., 2021), and vaccine intentions are strongly related to vaccine uptake (i.e., theory of planned behavior, Ajzen, 1991; Patel et al., 2012; Wang et al., 2022). Moreover, vaccine attitudes vary with beliefs in conspiracy theories, political orientation, and psychological malleability (Featherstone et al., 2019; Huynh & Senger, 2021; Martinez-Berman et al., 2020).

Additionally, some demographic factors have been identified as predictors of vaccine intention and uptake that should be considered in analyses examining anti-vaccination attitudes. Prior research has demonstrated that vaccination uptake is lower in women than in men and increases with age (Rodríguez-Rieiro et al., 2011; Setbon & Raude, 2010). Relatedly, older people are disproportionately affected by COVID-19 (CDC, 2021). Additionally, education and subjective socioeconomic status have been found to be significant predictors of influenza vaccine uptake (Maurer, 2016; Quin et al., 2017). Of course, in relation to COVID-19, race/ethnicity is critical to consider because communities of color have been disproportionately affected by COVID-19; for example, Black and Latinx Americans disproportionately account for both diagnoses and deaths (Millett et al., 2020).

The current paper aimed to provide a report of specific anti-vaccination attitudes in the U.S. before and during COVID-19 (July 2019 - October 2020). It tested whether assumptions about uniformed increases in anti-vaccination attitudes related to the occurrence and persistence of COVID-19 are valid. To that end, the author tested the following hypotheses, with the default assumption that all four types of anti-vaccination attitudes would behave similarly:

FormalPara Hypothesis 1

Anti-vaccination attitudes were higher during the COVID-19 pandemic than they were prior to the onset of COVID-19.

FormalPara Hypothesis 2

Anti-vaccination attitudes steadily increased as the pandemic progressed.

Method

Participants

The data in this study came from seven different collections from July 2019 to October 2020. This paper employs secondary analyses on these data, which were collected from 2,383 unique participants. The original purpose for the data collection varies by data collection and includes investigations into anti-vaccination attitudes and the seasonal flu, celebrity admiration, intellectual humility, openness to persuasive messages, intentions to vaccinate against COVID-19, and mask use during the COVID-19 pandemic. A total of 2,555 participants participated in the data collection, but 172 (6.73%) were excluded from the data analyses because they did not provide responses to the VAX Scale. A summary of participant demographics are presented in Table 1. Table 2 provides more information about the rate of deletion and purpose of each data collection effort.

Table 1 Summary of Participant Demographics and Study Measures Across Data Collection Dates
Table 2 Additional details about each data collection effort

All participants were recruited through Amazon Mechanical Turk (MTurk), a popular online crowdsourcing website used in the social sciences where people complete various surveys/tasks in exchange for a fee. MTurk participants tend to be more representative of the U.S. population than other samples of convenience even during the COVID-19 pandemic (Moss et al., 2020) and they tend to provide quality data on critical topics (Mellis & Bickel, 2020). Participants elected to participate in the study by clicking on a link that was posted on MTurk. It is not possible to know number of people who saw the link but did not click on it, thus it is not possible to provide a response rate, in terms of people who were recruited compared to people who responded to the survey. Information about participant compensation is provided in Table 2 for each data collection.

Procedures

All participants clicked on a link through the MTurk network that led them to a survey. Although the surveys differed in content based on their original data collection purpose, all of the surveys had the same flow. The first page of the survey presented information about the study and asked participants to indicate their consent prior to advancing to the study measures. Following this consent page, participants completed the main study measures, including the VAX Scale. Then, participants proceeded to provide demographic information. After that, participants read a debriefing statement and viewed contact information of the primary investigator. Finally, participants proceeded to collect a code, which would allow them to claim their fee for completing the study. All data collection efforts were approved by the author’s Institutional Review Board.

Measures

Anti-vaccination attitudes were assessed using the Vaccine Attitudes Examination (VAX) Scale (Martin & Petrie, 2017). The original scale was developed and validated using two diverse samples of community-living adults and college students (N = 409) and community-living adults (N = 92) in the U.SA. An independent replication using UK adults showed that the scale demonstrated good internal consistency, convergent and construct validity (Wood et al., 2019). At the time of writing, the scale had been cited by 140 different publications according to Google Scholar and had been translated into several languages (e.g., Romanian, Huza, 2020; Turkish, Yildiz et al., 2021; Italian,Bruno et al., 2022). The VAX Scale has four subscales, with three items for each. The subscale is listed with a sample item in parentheses and corresponding reliability score: (1) Mistrust of Vaccine Benefit (“I feel safe after being vaccinated.” [R]), α = 0.88; (2) Worries about Unforeseen Future Effects (“I worry about the unknown effects of vaccines in the future.”), α = 0.87; (3) Concerns about Commercial Profiteering (“Vaccines make a lot of money for pharmaceutical companies, but do not do much for regular people.”), α = 0.87; and (4) Preference for Natural Immunity (“Natural immunity lasts longer than a vaccination.”), α = 0.92. Participants indicated their (dis)agreement with the 12 statements using a six-point Likert-like scale (1) = strongly disagree and (6) = strongly agree. Higher scores indicate stronger anti-vaccination attitudes. In addition to the VAX Scale, participants provided information about their age, sex, and race/ethnicity. Means and standard deviations of the VAX scale and demographic information are listed in Table 1.

Data Analysis

Analyses were conducted using IBM SPSS Statistics 27. For all analyses, participants who had missing data were excluded from the analyses (i.e., in SPSS, case-by-case for t-tests; listwise for regression). Missing data were not replaced/inputted in anyway.

To test Hypothesis 1, participants from the three time points prior to COVID-19 were combined into one group (Group A) and participants from the four time points during COVID-19 were combined into another group (Group B). Then, the means of each of the four anti-vaccination attitudes, which were derived from averaging participants’ responses to each sub-scale of the VAX Scale (see above), were compared between Group A and Group B via independent samples t-tests. Additionally, the potential effect of participant characteristics (i.e., sex, education, social economic status, age, race/ethnicity) were examined by conducting multiple regression analyses with each anti-vaccination attitude as the outcome, and date of data collection (before vs. during the pandemic) and participant characteristics as predictor variables. To test Hypothesis 2, linear contrast weights (Rosenthal & Rosnow, 1985) were assigned to the four time points during COVID-19. This approach examined the trend in mean scores of each anti-vaccination attitude across the four time points. Thus, the analyses combined Likert categories on the VAX scale by averaging the numeric responses. The alpha for all significance tests were set at 0.05.

Prior to conducting the analyses, assumptions for t-tests were examined. First, data belonged to unique participants, which meets the independence of observations assumption. Secondly, a check for outliers was conducted by checking the z-scores to ensure that no score was larger than 3.29 (absolute value). Third, a test of the normality assumption was conducted by examining the skewness of and kurtosis of anti-vaccination scores. Skewness scores for unforeseen side effects, commercial profiteering, and preference for natural immunity were under 1 (-0.30, 0.02, − 0.09, respectively). However, skewness for mistrust of vaccine benefits was 1.25, which was higher than the typical benchmark of 1. In terms of kurtosis, mistrust of vaccine benefits, commercial profiteering, and preference for natural immunity were all above 1 (absolute value; 1.79, -1.34, -1.25, respectively). Kurtosis for unforeseen side effects was − 0.89. Despite the violations of this normality assumption given the skewness and kurtosis scores, independent samples t-test and linear regression are robust enough to handle these violations given the large sample size in our study (see Lumley et al., 2002 for a demonstration). Because of the t-test’s robustness against the violation of this assumption, we proceeded with its use. We elected not to transform the data because transformations can lead to non-intuitive interpretations of the outcome. To address the homogeneity of variances assumption, we relied on SPSS’s report of Levene’s Test of Equality of Variances and reported the adjusted values when this assumption was violated. Moreover, assumptions for multiple regression were tested prior to conducting the analyses. We tested to see whether multicollinearity was an issue among the predictors. The highest variance inflation factor (VIF) value was 1.15, which is lower than the conservative benchmark of 5 (Tabachnick & Fidell, 2007), suggesting that multicollinearity was not an issue. Additionally, P-P plots and residual scatter plots supported linearity and homoscedasticity assumptions. The range for Cook’s Distance scores (0 − 0.01) indicated that there were no outliers.

Results

To test Hypothesis 1, independent samples t-tests were used to compare anti-vaccination attitudes prior to (n = 840) and during COVID-19 (n = 1,543). The analyses revealed that worries about unforeseen future effects were higher during COVID-19 (M = 4.00, SD = 1.26) than prior to COVID-19 (M = 3.16, SD = 1.47), t(2,381) = 15.00, p < .0001, d = 0.61. Additionally, concerns about commercial profiteering were higher during COVID-19 (M = 3.69, SD = 1.50) than prior to COVID-19 (M = 2.66, SD = 1.45), t(2,381) = 16.25, p < .0001, d = 0.70. Similarly, preference for natural immunity was higher during COVID-19 (M = 3.82, SD = 1.44) than prior to COVID-19 (M = 2.77, SD = 1.43), t(2,381) = 16.86, p < .0001, d = 0.73. However, mistrust of vaccine benefit was lower during COVID-19 (M = 2.36, SD = 0.99) than prior to COVID-19 (M = 2.65, SD = 1.15), t(2,381) = -6.40, p < .0001, d = 0.27. In addition, multiple regression analyses revealed that these differences were present even when accounting for the potential effects of participant demographics (i.e., sex, education, socioeconomic status, age, and race/ethnicity). See Table 3 for a summary of the multiple regression analyses.

Table 3 Participant Characteristics as Predictors of Anti-Vaccination Attitudes

To test Hypothesis 2, contrast weights were assigned (-3, -1, 1, 3) to test for a linear trend in the four time points in which data were collected during COVID-19. The analyses revealed that three anti-vaccination attitudes have increased: worries about unforeseen future effects t(1539) = 11.18, p < .0001, η2p = 0.08; concerns about commercial profiteering t(1539) = 11.56, p < .0001, η2p = 0.08; and preference for natural immunity, t(1539) = 11.97, p < .0001, η2p = 0.09. However, mistrust in vaccine benefits during COVID-19 remained stable, t(1539) = -1.66, p = .10, η2p = 0.002. That is, scores for mistrust in vaccine benefits did not statistically fluctuate the during-COVID-19 time points assessed. All means and standard deviations for each data collection time are presented in Table 1. See Fig. 1 for a visual summary of the examined trends.

Fig. 1
figure 1

Anti-vaccination attitudes across time. Mistrust of vaccine benefit is relatively stable over time. Worries about unforeseen future effects, concerns about commercial profiteering, and preference for natural immunity have increased during months when COVID-19 was active

Discussion

Hypothesis 1, which stated that anti-vaccination attitudes were higher during the COVID-19 pandemic than they were prior to it, was supported by three types of anti-vaccination attitudes. Worries about unforeseen future effects, concerns about commercial profiteering, and preference for natural immunity were higher during the COVID-19 pandemic than they were prior to it. However, mistrust of vaccine benefit was lower during the COVID-19pandemic than prior to it. Finally, Hypothesis 2, which stated that anti-vaccination attitudes have increased alongside the persistence of the COVID-19 pandemic, was confirmed for three types of anti-vaccination attitudes. Worries about unforeseen future effects, concerns about commercial profiteering, and preference for natural immunity increased with the persistence of COVID-19. However, mistrust of vaccine benefit has remained statistically unchanged during the persistence of the COVID-19 pandemic. Hypothesis 2 is different from Hypothesis 1 in that Hypothesis 2 only considers anti-vaccination attitudes after the onset of COVID-19.Whereas Hypothesis 1 compares anti-vaccination attitudes people had prior to COVID-19 with anti-vaccination attitudes people had during COVID-19,Hypothesis 2 examined whether people’s anti-vaccination attitudes increased from after when COVID-19 began to three time points after that. Thus, results regarding Hypothesis 2 demonstrate that once COVID-19 began, worries about unforeseen future effects, concerns about commercial profiteering, and preference for natural immunity increased, while mistrust of vaccine benefit remained statistically steady.

Taken together, the evidence suggests that many anti-vaccination attitudes have increased alongside the occurrence and persistence of COVID-19. However, not all anti-vaccination attitudes have worsened at the same rate. The data indicate that mistrust of vaccine benefits decreased following the onset of the pandemic (Hypothesis 1), and has not worsened at the same rate as the other three types of anti-vaccination attitudes (Hypothesis 2). This trend signals potentially more trust in vaccines’ benefits (or at least not a declining mistrust of benefits) generally. Theoretically, these findings support the need to discuss the precarious rise in anti-vaccination attitudes with more specificity. It is incomplete to say that anti-vaccination attitudes are uniformly worsening. While most are indeed worsening, one (and potentially more) is not worsening or worsening at the same rate as the others. This nuanced approach enables the potential pursuit of intervention programs to decrease anti-vaccination attitudes and vaccine hesitancy to be more precise and effective.

Practically, these findings are critical to consider for health communication and public health messaging during the distribution of vaccines. Although it might be intuitive to emphasize the vaccines’ effectiveness to increase vaccine uptake, the data suggest that the public’s trust in vaccines’ effectiveness is not the main concern. Thus, public health efforts to increase uptake of the vaccines should also focus on dispelling worries about potential side effects from the vaccine, tempering concerns about the financial benefits to pharmaceutical companies, and rebuffing the overreliance on natural immunity.

Limitations and future directions

There are important limitations to consider when interpreting these results. First, these data report anti-vaccination attitudes that overlap with the existence and persistence of COVID-19. These data cannot explicitly determine whether COVID-19 caused these shifts in anti-vaccination attitudes. Moreover, the final composition of demographics indicated that most of the data came from white, male participants. Future studies can address this issue by stratifying their recruitment efforts. This issue may be especially important because COVID-19 disproportionately affects poorer communities and communities of color (Baquero et al., 2020; Chatters et al., 2020; Kim & Bostwick, 2020; Millet et al., 2020).

Furthermore, anti-vaccination attitudes are complex and related to a host of psychosocial and cultural issues (e.g., intellectual humility, Senger & Huynh, 2020; celebrity worship, Martinez-Berman et al., 2020; political orientation and trust in physicians, Huynh et al., 2021; health literacy, Turhan et al., 2021). In particular, political orientation has emerged as a strong predictor of COVID-related health behaviors. For example, researchers found that political orientation was the most consistent predictor of intentions to vaccinate for COVID-19 among factors such as sex, age, race, education, socioeconomic status, prior flu shot uptake, subjective health, beliefs about susceptibility, and subjective norms surround COVID-19 vaccinations (Huynh et al., 2021). Unfortunately, the current study failed to account for this important factor because a measure of this construct was not included in early surveys. Thus, future research should address these complex relationships alongside changing anti-vaccination attitudes related to COVID-19 (e.g., Eaton & Kalichman, 2020).

Moreover, it is important to note that the literature links vaccination attitudes to vaccine intentions (Kahn et al., 2003; Paul et al., 2021), and vaccine intentions predict vaccine uptake (Patel et al., 2012; Wang et al., 2022). However, a direct link between vaccine attitudes and vaccine uptake has not been clearly demonstrated in the literature (Brewer, 2021). Therefore, although anti-vaccination attitudes are important to study in their relation to vaccine intentions, further research (e.g.,experiments, longitudinal designs) is necessary to provide a direct link between vaccine attitudes and uptake. Thus, although the study makes an important contribution in terms of knowledge about varied anti-vaccination attitudes related to COVID-19, the results should be interpreted judiciously given the study’s limitations.