Next Article in Journal
Country-Level Relationships of the Human Intake of N and P, Animal and Vegetable Food, and Alcoholic Beverages with Cancer and Life Expectancy
Next Article in Special Issue
Doctors’ Mental Health in the Midst of COVID-19 Pandemic: The Roles of Work Demands and Recovery Experiences
Previous Article in Journal
The Beneficial Effects of Short-Term Exposure to Scuba Diving on Human Mental Health
Previous Article in Special Issue
Unemployment and Psychological Distress among Young People during the COVID-19 Pandemic: Psychological Resources and Risk Factors
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 17
Issue 19
10.3390/ijerph17197241
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Emotional and Behavioral Consequences of the COVID-19 Pandemic: The Role of Health Anxiety, Intolerance of Uncertainty, and Distress (In)Tolerance

by
Karoline S. Sauer
*,
Stefanie M. Jungmann
and
Michael Witthöft
Department of Clinical Psychology, Psychotherapy, and Experimental Psychopathology, Johannes Gutenberg-University of Mainz, Wallstraße 3, 55122 Mainz, Germany
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(19), 7241; https://doi.org/10.3390/ijerph17197241
Submission received: 4 September 2020 / Revised: 27 September 2020 / Accepted: 28 September 2020 / Published: 3 October 2020
(This article belongs to the Special Issue Mental Health in the Time of COVID-19)
Browse Figures
Versions Notes

Abstract

:
The COVID-19 pandemic represents a worldwide threat to mental health. To optimize the allocation of health care resources, research on specific vulnerability factors, such as health anxiety, intolerance of uncertainty, and distress (in)tolerance, and particularly their effect on the time course of SARS-CoV-2 related anxiety appears crucial for supporting high risk groups suffering from elevated mental distress during the pandemic. N = 887 participants (78.4% female; Mage = 38.15, SD = 17.04) completed an online survey in Germany (April to mid-May 2020), comprising measures of SARS-CoV-2 related anxiety, health anxiety, safety and preventive behavior, intolerance of uncertainty, and distress intolerance. Higher levels of health anxiety pre and during COVID-19 were associated with an initially intensified increase (b = 1.10, p < 0.001), but later on a more rapid dampening (b = −0.18, p < 0.001) of SARS-CoV-2 related anxiety. SARS-CoV-2 related preventive behavior was intensified by both pre (b = 0.06, p = 0.01) and during (b = 0.15, p < 0.001) COVID-19 health anxiety, while reassurance behavior only was associated with health anxiety during COVID-19 (b = 0.14, p < 0.001). Distress intolerance and intolerance of uncertainty did not moderate the relationship between health anxiety and SARS-CoV-2 related anxiety and behavior. The results suggest detrimental effects of health anxiety on the emotional and behavioral response to virus outbreaks.

1. Introduction

Several studies on the outbreak of the COVID-19 pandemic (SARS-CoV-2) showed the considerable psychological impact of the pandemic. They found that up to 28% of respondents in China suffer from symptoms of anxiety and up to 37% from depressive symptoms during the COVID-19 pandemic [1,2], which is consistent with findings from European countries (e.g., Italy [3], Spain [4]) and from previous epidemics/pandemics [5,6,7] (for an overview of the mental health impact of the COVID-19 pandemic see [8]).
Health anxiety, the anxiety of having or getting a severe (and potentially life-threatening) disease, which is conceptualized as a dimensional construct [9], could be a risk factor, influencing emotional and behavioral responses to pandemics. The predominant cognitive-behavioral model of hypochondriasis [10] proposes that dysfunctional schemata on health and illness triggered by acute stressors can lead via negative automatic thoughts and via cognitive biases in attention, memory, and interpretation of ambiguous health-related internal, and external information, and evaluation of health threat (combined-cognitive-bias hypothesis for health anxiety; [11]) to a (mis-) interpretation of potentially harmless body sensations as severe and as a sign of a life-threatening disease (=somatosensory amplification; [12]). The COVID-19 pandemic could be seen as an acute stressor with the potential to activate these beliefs and schemata and to promote the attribution of body sensations to a virus infection [13]. It can, thereby, trigger anxiety, health anxiety, and specific fears of COVID-19 [14].
Consistently, individuals with increased pre-existing health anxiety before virus outbreaks could be prone to this “vicious circle”, and to a heightened virus anxiety in the context of epidemics/pandemics [14]. The results from the COVID-19 pandemic, so far, confirmed the impact of health anxiety on the emotional responding towards the pandemic. Health anxiety and illness attitudes were associated with virus anxiety, concerns about SARS-CoV-2, COVID-19 related stress, depressive symptoms, (generalized) anxiety, death anxiety and the likelihood of self-isolation [13,15,16,17,18]. While, the latter mentioned studies did not specifically differentiate between health anxiety emerged due to COVID-19 and health anxiety existing “before” COVID-19, Taylor et al. [19,20] were the first to ask for “premorbid” health anxiety and found a significant correlation with COVID-19-related distress.
As (pre-existing) health anxiety could trigger virus-related concerns, it could also promote behavioral changes [14]. Two types of behavior are usually related to health anxiety [21]: Avoidance (e.g., body sensations, information on diseases, places/situations) and reassurance behavior (e.g., reassurance from doctors, Internet research). In the context of the COVID-19 pandemic, both behaviors could have detrimental effects: Reassurance via, e.g., overstressing the health care system and avoidance via, e.g., not obtaining the relevant information on virus spreading and protection [14]. In addition, both include negative reinforcement (e.g., short-term reduction of anxiety), which, maintains anxiety over the long-term. Highly health-anxious individuals may also be susceptible to maladaptive virus-specific preventive behaviors, such as extreme hoarding (e.g., of hygienic material) [14]. Studies on behavior during earlier epidemics/pandemics and the current COVID-19 pandemic mainly demonstrated that anxiety, worry, perceived virus threat and risks are predictors in applying recommended measures (e.g., hygienic measures and avoidance of crowded places), pursuing ineffective behavior in order to protect oneself (e.g., keeping the room temperature higher), and taking a vaccination into consideration [22,23,24,25,26,27]. With regard to hypochondriacal safety behavior, a link between COVID-19 related reassurance behavior (e.g., Internet research [incl. Internet research in the context of cyberchondria], body checking, seeking reassurance from doctors) and health anxiety was found [13,20,28]. Avoiding of SARS-CoV-2 related information by, e.g., not speaking or getting oneself informed about SARS-CoV-2, which is also typical for people with heightened health anxiety, has not been investigated in the context of the COVID-19 pandemic yet.
Intolerance of uncertainty and distress (in)tolerance are two further factors, possibly related to health anxiety and influencing responses to epidemics/pandemics. Intolerance of uncertainty is defined as the “individual’s dispositional incapacity to endure the aversive response triggered by the perceived absence of salient, key, or sufficient information, and sustained by the associated perception of uncertainty” [29] (p. 31). Concerning health anxiety, intolerance of uncertainty may have an impact on the level of dysfunctional schemata (e.g., schemata regarding the tolerance of uncertainty), on the (mis)interpretation of physical sensations via an enhanced arousal [30] and an interpretation bias [31], and on the use of safety and avoidance behavior to reduce insecurity and anxiety [32,33]. Some studies, indeed, have demonstrated an association between intolerance of uncertainty and health anxiety [34,35,36,37]. In relation to epidemics/pandemics, people with higher intolerance of uncertainty rated the H1N1 pandemic as more threatening, and their self-control and the control of others as lower, all together predicting virus anxiety [38,39]. In the context of the COVID-19 pandemic, results also indicate associations between intolerance of uncertainty and mental well-being [40], COVID-19 related distress [19], and depressive, generalized anxiety, and health anxiety symptoms [41,42].
Distress tolerance is defined as the ability to withstand aversive emotional states [43]. People with low distress tolerance rate distress as unendurable and highly aversive, and their own abilities to cope with negative psychological states aslowered [43]. They attempt to avoid aversive emotional states or feel “absorbed by the presence of distressing emotions” [43] (p. 84). Distress (in)tolerance is associated with psychopathology of many mental disorders (e.g., anxiety disorders [44]), and is linked with the use of avoidance behavior [32,45]. Fergus et al. [46] observed an association of intolerance of negative emotions (in combination with intolerance of uncertainty and intolerance of physical discomfort) with health anxiety. In the context of the COVID-19 pandemic, lower levels of distress tolerance were associated with a higher risk for clinically relevant levels of depression, anxiety, and symptoms of PTSD [47].
Some studies so far have revealed effects of health anxiety, distress (in)tolerance, and intolerance of uncertainty on virus-related anxiety and behavior in the context of the COVID-19 pandemic. These studies mostly lack a distinction between health anxiety before, and after virus outbreaks. In relation to hypochondriacal safety behavior, which is often used by high health anxious individuals, only reassurance behavior and its predictors have been investigated, whereas, to our knowledge, there are no studies on hypochondriacal avoidance behavior.
The present study aimed to overcome these limitations and to examine the specificity of effects of health anxiety, distress intolerance and intolerance of uncertainty by comparing anxiety and behavior in relation to SARS-CoV-2 and in relation to other severe diseases (e.g., cancer) or viruses. (1) We hypothesized that pre-existing health anxiety and health anxiety during the pandemic affect the course of: (a) SARS-CoV-2 related anxiety, and (b) SARS-CoV-2-related behavior (increasing levels of health anxiety both pre and during the pandemic intensify anxiety and behavior). (2) The association between health anxiety and SARS-CoV-2 related anxiety (a) and behavior (b) is assumed to be further intensified by increasing levels of intolerance of uncertainty and distress intolerance. (3) The effect of health anxiety on SARS-CoV-2 related anxiety (a) and behavior (b) should be especially seen in comparison with anxiety in relation to other severe diseases/viruses.

2. Materials and Methods

2.1. Participants and Procedure

Participants in the online survey (N = 887) were recruited via social media (e.g., Twitter), university mailing lists, and press releases (print, online). A minimum age of 18 years and an informed consent were required as eligibility criteria. As an expense allowance, participants could take part in a lottery of gift vouchers or receive a course credit (psychology students). The online survey was clicked N = 2009 and started N = 1081 times. Most dropouts (N = 106) were registered on the first pages of the survey. From the N = 887 participants, 78.4% were female, 21.2% male, and 0.5% diverse. The mean age was M = 38.15 years (SD = 17.04; range: 18–85 years). Regarding formal education, 1.8% had completed primary school or had a basic school leaving qualification, 8.9% a secondary school certificate, 4.7% an advanced technical college certificate, 34.8% a higher education entrance qualification and 49.6% a university degree. Regarding current profession, 0.1% were school students, 1.1% in professional training, 42.2% college students (of whom 67.9% psychology), 30.4% employees, 4.5% civil servants, 6.1% self-employees, 1.1% job-seekers, 10.3% pensioners, 1.1% housewives or househusbands, 1.1% in parental leave and 2.4% reported to pursue another profession (e.g., voluntary social year). 26.4% of the study participants were reported to have a physical disease, 3.9% to take an immunosuppressive medication, and 15.2% to suffer from a mental disorder. 0.5% stated that they have been infected with SARS-CoV-2 and 9.7% or 34.4% reported that someone from their closer surrounding (family/friends) or wider environment (circle of acquaintances, residents in the home town) was infected with SARS-CoV-2. 0.9% of all participants stated that they are in voluntary or enforced quarantine.
Recruitment took place between the 20th of April and 15th of May 2020 (25 days). On the 20th of April, Germany had N = 141,672 registered cumulated SARS-CoV-2 infections and N = 1,775 newly reported SARS-CoV-2 infections on that day [48]. On the 15th of May, Germany had N = 173,152 registered cumulated SARS-CoV-2 infections and N = 913 newly reported SARS-CoV-2 infections on that day [49]. During recruitment, previously set government restrictions on contacts and opening of public places/stores were gradually eased (e.g., since 20th of March 2020: Reopening of certain shops; since the 6th of May 2020: Permission of one contact beyond the same household).
The study protocol was approved by the local ethics committee of the Department of Psychology of Johannes Gutenberg-University of Mainz (2020-JGU-psychEK-S007).

2.2. Measures

Health anxiety was measured with the Short Health Anxiety Inventory (SHAI; [50]) consisting of 18 multiple-choice items (four choices for each item; coding 0 to 3). The items can be aggregated to two factors: “health anxiety” (14 items) and “negative consequences of illness” (4 items). In the present study, the validated German version of the SHAI [51] was adapted to assess health anxiety before, and during the outbreak of the COVID-19 pandemic (e.g., “Prior to/since the onset of the COVID-19 pandemic [in Germany before/after the end of January]: I didn’t/don’t worry (0), occasionally worried/worry (1), spent/spend much of my time worrying (2), spent/spend most of my time worrying (3) about my health.”). Internal consistencies in the present study were α = 0.89 (pre COVID-19) and α = 0.92 (during COVID-19) for the total scale, α = 0.89 (pre COVID-19) and α = 0.92 (during COVID-19) for the subscale “health anxiety” and α = 0.67 (pre COVID-19) and α = 0.71 (during COVID-19) for the subscale “negative consequences of illness”.
The German Questionnaire for assessing hypochondriacal safety behavior (QSBH; [52]) assesses hypochondriacal safety behavior and consists of 16 items rated on a 5-point Likert scale from 0 (“never”) to 4 (“very often”) with two subscales (reassurance and avoidance behavior, each 8 items). A sum score is calculated for both subscales. The QSBH has demonstrated good to excellent internal consistency, and satisfactory convergent and discriminant validity [52]. For the present study, the QSBH was adapted to measure hypochondriacal safety behavior prior (e.g., “Prior to the onset of the COVID-19 pandemic: Did you check the Internet on symptoms and potential diseases?”) and during the COVID-19 pandemic in relation to SARS-CoV-2 (incl. COVID-19) and in relation to other severe diseases (not COVID-19; e.g., cancer) (e.g., “Since the onset of the COVID-19 pandemic: Do you check the Internet on symptoms of a coronavirus infection and potential secondary diseases [e.g., COVID-19]/on symptoms or other severe diseases [not COVID-19; e.g., cancer]?”). Five questions of the QSBH were difficult to adapt to assess behavior in relation to SARS-CoV-2 (e.g., “Do you check your birthmarks on abnormalities?”); these questions were only presented once at the time point “since the COVID-19 pandemic”. Additional questions, specific to preventive behavior in pandemics, were added at both time points (pre and during COVID-19) with regard to SARS-CoV-2 and other viruses: (1) Buy toiletries, e.g., disinfectants, (2) wash your hands, (3) buy and/or use respiratory masks, (4) avoid places where you can get infected. In the present study, the internal consistencies were αreassurance = 0.74 and αavoidance = 0.84 pre COVID-19, αreassurance = 0.78 and αavoidance = 0.89 during COVID-19 regarding other severe diseases, and αreassurance = 0.78 and αavoidance = 0.86 during COVID-19 regarding SARS-CoV-2. Internal consistencies of the items to assess preventive behavior were α = 0.74 both pre and during COVID-19 and in relation to SARS-CoV-2 and in relation to other viruses.
To measure intolerance of uncertainty, the short German version [53] of the 27-item Intolerance of Uncertainty Scale (IUS; [54,55]), which consists of 18 items measuring three aspects of intolerance of uncertainty (“reduced ability to act due to IU”, “burden due to IU”, and “vigilance due to IU”) on a 5-point Likert scale (1 = “not at all characteristic of me”, 5 = “entirely characteristic of me”), was applied. A total score — in addition to subscale scores — can be computed by summing up all items. The German IU-18 has demonstrated good internal consistency and satisfying retest reliability and validity in a non-clinical sample [53]. The internal consistencies in the present study were αtotal scale = 0.94, αvigilance = 0.85, αburden = 0.87, and αreduced ability = 0.88.
The Distress Intolerance Scale [56], a 10-item questionnaire on a 5-point Likert Scale from 1 (“I don’t agree at all.”) to 5 (“I totally agree.”), measures the “perceived inability to tolerate negative somatic and emotional states” [56] (p. 641). It was developed based on a confirmatory factor analysis of the Anxiety Sensitivity Index (ASI; [57]), the Frustration Discomfort Scale (FDS; [58]), the Discomfort Intolerance Scale (DIS; [59]), and the Distress Tolerance Scale (DTS; [43]). A first analysis of the reliability and validity of the German version of the Distress Intolerance Scale [60] suggested a satisfying internal consistency and convergent validity. The internal consistency in the present study was α = 0.93.
As in a previous study on coronavirus anxiety [13], participants were additionally asked to (retrospectively) rate their anxiety (0 = “no anxiety” to 100 = “very intense anxiety”), in relation to SARS-CoV-2 and additionally in relation to other severe diseases at four time points (December 2019 [first reports of coronavirus infections in China], January 2020 [first reports of coronavirus infections in Germany], March 2020 [increasing restriction of contacts in Germany], and past week). Furthermore, a question on people’s most feared disease (“Which disease/infection do you fear most to have and/or to get at present times?”) with single selection (coronavirus infection [incl. COVID-19], cancer, cardiovascular diseases, injuries/poisoning, other infections [not SARS-CoV-2], respiratory diseases, neurological diseases, mental disorders), free description or “no disease” option was administered.

2.3. Statistical Analyses

Dependent (paired) sample t-tests, including bootstrap method with BCa adjustment and 5000 reiterations, were calculated to test for a change of health anxiety pre to during COVID-19 and to compare behavior in relation to SARS-CoV-2 and to other severe diseases.
Multilevel growth models with maximum likelihood estimation (MLE) were used to investigate the course of SARS-CoV-2 related anxiety and the effects of health anxiety, intolerance of uncertainty, and distress intolerance on the growth of anxiety. According to Singer and Willett [61], modeling was carried out in three stages: (1) Calculating the unconditional means model, (2) fitting unconditional growth models, and (3) calculating conditional growth models by adding health anxiety on level 1 and intolerance of uncertainty and distress intolerance on level 2 (all grand mean centered). The points of measurement were recoded so that the spacing was constant (December 2019 = 0). Decisions on selecting trajectories, including random effects of polynomials and influencing variables and choosing covariance structure, were taken on the basis of the overall fit of the multilevel model by comparing the Akaike’s Information Criterion (AIC) and the Schwarz’s Bayesian Criterion (BIC) of different models. In the results section only the best-fitting unconditional and conditional models are presented.
A repeated measures analysis of covariance (rmANCOVA) with two within-subject factors (1: disease/infection type [SARS-CoV-2 versus other severe diseases]; 2: time [December 2019, January 2020, March 2020, past week]) and centered health anxiety pre COVID-19 as a covariate was calculated to compare the effect of pre-existing health anxiety on anxiety related to SARS-CoV-2 and to other severe diseases (Greenhouse-Geisser adjustment for violations of sphericity).
(Moderator) hypotheses of health anxiety, distress intolerance, and intolerance of uncertainty on behavior during COVID-19 were analyzed with the PROCESS macro in SPSS [62], using bootstrap method with BCa adjustment, 5000 reiterations, and the heteroskedasticity-consistent standard error estimator HC4. Multicollinearity was assessed via calculating tolerance values with values smaller than 0.40 being considered as a sign of multicollinearity. Due to multicollinearity issues regarding health anxiety pre and during COVID-19, separate moderator analyses on reassurance, avoidance, and preventive behavior in relation to SARS-CoV-2 and to other severe diseases/viruses were calculated for health anxiety pre and during COVID-19 (corresponding behavior pre COVID-19 was included as a covariate).
Due to multiple testing and in order to avoid an inflated Type I error, the alpha level was set at p = 0.01 for all tests.

3. Results

3.1. Course of Health Anxiety and SARS-CoV-2 Related Anxiety

Table 1 shows the statistics of all measured variables. Supplementary Table S1 provides additional correlational analyses of anxiety, health anxiety, behavior, and sociodemographic and other variables (e.g., pre-existing mental disorder) (We investigated the effects of the variables age, sex, education, pre-existing physical disease, and mental disorder on the outcomes by including the variables as covariates and/or performing subgroup analyses with sex [female and male] and age [“young”: 18-29, “middle”: 30-59, “old”: ≥ 60 years]. All previously reported results remained stable, except for the comparison of behavior in relation to SARS-CoV-2 and to other diseases/viruses [3.2; subgroup analyses are reported].). Health anxiety significantly increased (difference BCa 99% CI [2.73, 3.62]) since the outbreak of the COVID-19 pandemic (t(886) = |18.64|, p < 0.001, d = 0.39), which was also shown on both subscales (“health anxiety”: Mpre = 11.08, SDpre = 5.97; Mduring = 13.88, SDduring = 7.04; difference BCa 99% CI [2.42, 3.19]; t(886) = |19.11|, p < 0.001, d = 0.42; “negative consequences of illness”: Mpre = 2.92, SDpre = 1.97; Mduring = 3.29, SDduring = 2.18; difference BCa 99% CI [0.27, 0.47]; t(886) = |9.57|, p < 0.001, d = 0.18).
An unconditional growth model with a linear and quadratic slope was found to be the most parsimonious to model the development of SARS-CoV-2 related anxiety during the COVID-19 pandemic. The model revealed a significant intercept (b0 = 2.08, SE = 0.58, p < 0.001), positive linear slope parameter (b1 = 18.97, SE = 0.92, p < 0.001), and negative quadratic slope parameter (b2 = −3.05, SE = 0.31, p < 0.001). A significant linear increase of SARS-CoV-2 related anxiety until the last assessed time point (past week) was observed. This trend levels off over time, which is shown by a negative quadratic slope (Figure 1). There was a significant variance in the intercept, linear and quadratic slope across all participants (b = 7.28, SE = 0.49, p < 0.001), indicating variation in the initial level of SARS-CoV-2 related anxiety in December 2019 and in the linear and quadratic growth of anxiety between participants.

3.2. Comparison of Behavior in Relation to SARS-CoV-2 and to Other Diseases/Viruses

As some sex and age differences regarding the comparison of SARS-CoV-2 related behavior with behavior in relation to other diseases/viruses were found, results are reported separately for women and men (diverse excluded due to the low frequency) and age groups (“young”: 18–29, “middle”: 30–59, “old”: ≥60 years). As shown in Table 2, women reported more reassurance, avoidance, and preventive behavior in relation to SARS-CoV-2 than to other diseases/viruses, while men only reported more SARS-CoV-2 related reassurance and preventive behavior (no significant difference regarding avoidance behavior). More preventive and reassurance behavior in relation to SARS-CoV-2 (compared with behavior in relation to other diseases/viruses) was observed in all age groups. Divergent results were observed regarding hypochondriacal avoidance behavior (more SARS-CoV-2 related avoidance behavior in “young” and less in “old”; inconclusive regarding direction for “middle”).

3.3. Prediction of SARS-CoV-2 Related Anxiety during the COVID-19 Pandemic

In the conditional growth model of SARS-CoV-2 related anxiety, a significant positive fixed interaction effect of health anxiety (b4 = 1.10, SE = 0.14, p < 0.001) with the positive linear slope and a significant negative fixed interaction effect of health anxiety with the negative quadratic slope (b5 = −0.18, SE = 0.04, p < 0.001) were shown. SARS-CoV-2 related anxiety intensified with increasing levels of health anxiety over the course of the pandemic. Increasing levels of health anxiety were furthermore associated with an intensified dampening of the increase over time (interaction with the negative quadratic slope). No significant fixed and interaction effects (with health anxiety) of intolerance of uncertainty and distress intolerance on SARS-CoV-2 related anxiety were found (Table 3).

3.4. Comparison of the Effect of Pre-Existing Health Anxiety on Anxiety in Relation to SARS-CoV-2 and to Other Severe Diseases

The repeated measures ANCOVA with two within-subject factors and centered health anxiety pre COVID-19 as a covariate revealed small to medium interaction effects time × health anxiety pre COVID-19 (F(2.29, 2024.70) = 34.65, p < 0.001, ηp2 = 0.04), health anxiety pre COVID-19 × disease/infection type (F(1, 885) = 53.65, p < 0.001, ηp2 = 0.06), and time × health anxiety pre COVID-19 × disease/infection type (F(2.27, 2012.40) = 44.05, p < 0.001, ηp2 = 0.05). Figure 2 depicts anxiety in relation to SARS-CoV-2 and in relation to other severe diseases as a function of health anxiety pre COVID-19. The effect of health anxiety pre COVID-19 on anxiety related to other severe diseases seemed to be relatively constant over time, whereas the regression line of health anxiety pre on SARS-CoV-2 related anxiety got steeper until March 2020 and flattened after March 2020.

3.5. Prediction of SARS-CoV-2 Related Behavior in the Context of the COVID-19 Pandemic and Comparison with Behavior in Relation to Other Severe Diseases/Viruses

Table 4 and Table 5 show the moderator analyses on reassurance, avoidance and preventive behavior with regard to SARS-CoV-2 and to other severe diseases/viruses. There was only a significant positive effect of health anxiety pre COVID-19 on SARS-CoV-2 related preventive behavior (b = 0.06, 99% CI [0.01, 0.11], p = 0.005), but no effects on both reassurance and avoidance behavior (both in relation to SARS-CoV-2 and other diseases), and on preventive behavior in relation to other viruses. Health anxiety during COVID-19, on the contrary, significantly positively predicted reassurance (bSARS-CoV-2 = 0.14, 99% CI [0.10, 0.19], p < 0.001; bdiseases = 0.06, 99% CI [0.03, 0.09], p < 0.001) and preventive behavior (bSARS-CoV-2 = 0.15, 99% CI [0.11, 0.20], p < 0.001; bviruses = 0.05, 99% CI [0.01, 0.09], p = 0.002). Concerning avoidance behavior, there was only a marginally significant, but inconclusive effect of health anxiety during COVID-19 on avoidance behavior in relation to other diseases (b = 0.03, 99% CI [−0.01, 0.06], p = 0.08).
Besides a marginally significant and inconclusive interaction effect health anxiety pre COVID-19 × intolerance of uncertainty (b = 0.003, 99% CI [−0.001, 0.01], p = 0.09) based on a non-significant predictor (p = 0.96), none of the assumed moderator effects of distress intolerance and intolerance of uncertainty proved to be significant. Conditional positive effects of distress intolerance on avoidance behavior in all moderator analyses (bSARS-CoV-2 = 0.07, 99% CI [0.02, 0.12], p = 0.001; bdiseases, HA pre = 0.04, 99% CI [0.002, 0.08], p = 0.01; bdiseases, HA during = 0.03, 99% CI [0.002, 0.07], p = 0.01) and inconsistent effects of distress intolerance on reassurance behavior in the moderator analyses with health anxiety pre COVID-19 (bSARS-CoV-2 = 0.04, 99% CI [−0.01, 0.08], p = 0.03; bdiseases = 0.03, 99% CI [0.01, 0.06], p = 0.003) and partly with health anxiety during COVID-19 (bdiseases = 0.02, 99% CI [−0.004, 0.05], p = 0.04) could be observed. Regarding intolerance of uncertainty, we only found a marginally significant and inconsistent conditional effect on reassurance behavior in relation to other severe diseases (moderator analysis with health anxiety during COVID-19: b = −0.01, 99% CI [−0.03, 0.005], p = 0.07). In all moderator analyses, pre COVID-19 behavior proofed to be a significant positive predictor of during COVID-19 behavior (especially in relation to other diseases/viruses).

4. Discussion

The present study investigated the course of SARS-CoV-2-related anxiety and behaviors, and the contributing effects of health anxiety, distress (in)tolerance, and intolerance of uncertainty in the context of the COVID-19 pandemic in Germany.
While health anxiety intensified during the COVID-19 pandemic as expected, SARS-CoV-2 related anxiety increased but — contrary to our assumptions — leveled off over the course of the COVID-19 pandemic (especially in April and May 2020). This result can be explained by the timing of the survey. Germany went through the beginning and “first peak” of the COVID-19 pandemic (with regard to daily reported infections) in January and March 2020, leading to several measures to reduce virus spreading. In April and May 2020, the rate of infection has decreased considerably (e.g., seven-day-reproduction rate R = 1.99 [15th of March 2020] vs. R = 0.84 [20th of April 2020] vs. R = 0.91 [15th of May 2020]; [63]) and some government restrictions have been loosened. A changed “climate” regarding the COVID-19 pandemic, more security/knowledge about the pandemic or a “habituation-like effect” to virus threat could have changed risk assessment regarding SARS-CoV-2 and led to a dampening of anxiety after March 2020. The results from previous epidemics/pandemics confirmed that responses to virus outbreaks are variable and can decrease over the course of epidemics/pandemics [64,65].
People seemed to follow recommendations from German officialities on preventive behavior and more frequently used it in order to protect themselves against SARS-CoV-2 than any other infection, which was seen in all age groups and both sexes. Hygienic measures (e.g., washing hands) were, as in previous studies (e.g., [66]), most frequently reported. In relation to hypochondriacal safety behavior, the results on the subgroup level were less conclusive, but still indicated a continuously high need for information on SARS-CoV-2 in the investigated sample.
Previous studies have highlighted health anxiety as a potential risk factor for heightened virus anxiety [13,15,16,17,18,19,20], but partly lacked a differentiation between health anxiety pre and during COVID-19. In the present study, we confirmed the role of health anxiety in SARS-CoV-2 related anxiety and additionally showed that both pre-existing (pre) (retrospectively assessed) and emerging (during) health anxiety intensified the linear increase of SARS-CoV-2 related anxiety during the COVID-19 pandemic. We furthermore found that health anxiety was also significantly associated with the negative quadratic slope of SARS-CoV-2 related anxiety, this time indicating a stronger and/or faster dampening of the increase of SARS-CoV-2 related anxiety over the course of the COVID-19 pandemic with increasing levels of health anxiety. The first finding is consistent with our assumptions and the results of previous studies (e.g., [13]); the latter finding, on the contrary, is unexpected, as one could assume that the dampening of SARS-CoV-2 related anxiety should not be intensified or fastened but rather diminished or slowed down with increasing levels of health anxiety. One interpretation of this finding could be that people with heightened health anxiety are still most concerned about the disease they feared most pre COVID-19 (e.g., cancer, cardiovascular diseases), and therefore, rapidly switched the subject of their health worries back to the pre COVID-19 most feared disease, when SARS-CoV-2 was not that present in the public eye anymore (April/May 2020). However, when virus anxiety was quite “virulent” in the general population (March 2020; “first peak” phase), the pandemic seemed to trigger specific schemata and automatic thoughts on health/illness in high health anxious people and led to an intensification of SARS-CoV-2 related anxiety. These interpretations are further underpinned by the finding, that SARS-CoV-2 related anxiety was especially strongly associated with pre COVID-19 health anxiety in the “first peak” (March 2020) and the “later” (April/May 2020) phase of the COVID-19 pandemic, whereas anxiety in relation to other severe diseases (e.g., cancer) was quite constantly affected by pre-existing health anxiety over the course of the COVID-19 pandemic. Another indication for the assumption of a “switching” of health worries (from SARS-CoV-2 to other severe diseases) in high health anxious people could be seen in the finding, that at the time of assessment (April/May 2020) almost an equal amount of people (about 30%) feared most an infection with SARS-CoV-2 and any other disease/infection. SARS-CoV-2 (incl. COVID-19), therefore, was not the predominant feared disease in all assessed people. Nevertheless, the findings still indicate the need to support possible risk groups (e.g., high health anxious individuals) during epidemics/pandemics. It furthermore underlines the relevance of conducting more research on long-term effects and coping of vulnerable groups in epidemics/pandemics, and even after the subsiding of epidemics/pandemics.
With regard to the role of health anxiety in SARS-CoV-2 related behavior, we found that health anxiety during COVID-19 intensified SARS-CoV-2 related reassurance and preventive behavior as expected, while no significant effect on SARS-CoV-2 related avoidance behavior was observed. This pattern was also observed with regard to other diseases/viruses; however, the effects of emerging health anxiety on reassurance and preventive behavior seemed to be more intensive for SARS-CoV-2 than for other diseases/viruses. These results are consistent with previously shown associations between health anxiety and COVID-19 related reassurance [13,20,28] and preventive behavior [15,22,23].
Contrary to our assumptions, we only found an increasing effect of pre-existing health anxiety (pre COVID-19 health anxiety) on SARS-CoV-2 related preventive behavior, but no associations between pre-existing health anxiety and SARS-CoV-2 related avoidance and reassurance behavior. The “non-significance” concerning avoidance behavior could be again interpreted as a sign of a high need for information regarding SARS-CoV-2 (possibly also due to the perceived novelty of the virus/pandemic situation) in “all levels” of pre-existing health anxiety. The latter result regarding reassurance behavior, on the contrary, is inconsistent with the previous shown medium correlation between SARS-CoV-2 related reassurance seeking behavior (e.g., body-checking, doctor visits) and pre COVID-19 health anxiety [20]. It could indicate, that emerging health worries are more relevant for the wish to seek reassurance regarding SARS-CoV-2 than the intensity of pre-existing health anxiety. Furthermore, one could interpret that reassurance (and avoidance) in the context of the COVID-19 pandemic (and possibly also other epidemics/pandemics) is less specific for people with “previously” heightened high health anxiety, but can be seen in many people with “newly” triggered/intensified health worries.
Still, most predictive of behavior since the outbreak of the COVID-19 was pre COVID-19 behavior. Behavior seems to stay relatively constant over time. There is a lack of comparable studies to confirm this, but hypochondriasis, which is characterized by reassurance and avoidance behavior, is known to be temporally quite stable [67]. Consistently, it is not surprising that more frequent previous behavior especially led to a stronger increase in behavior in relation to other diseases/viruses during COVID-19, and seemed to affect SARS-CoV-2 related behavior to a lesser extent. In line with this finding, only a small part of variance of SARS-CoV-2 related behavior (in contrast to behavior in relation to other diseases/viruses) could be explained by the included variables (health anxiety, distress intolerance, intolerance of uncertainty), which suggests the importance of other vulnerability factors not investigated in the present study.
Contrary to our hypotheses, no “interpretable” moderating effect of distress intolerance and intolerance of uncertainty on the association between health anxiety (pre and during COVID-19) and SARS-CoV-2 related anxiety and behavior was shown. In relation to conditional effects, an intensifying effect of distress intolerance on SARS-CoV-2 related avoidance behavior was found, which is consistent with other results on the association of avoidance behavior and distress (in)tolerance [32,45]. Although we observed conditional (marginally) significant effects of distress intolerance and intolerance of uncertainty on reassurance behavior (for intolerance of uncertainty only an association with reassurance behavior in relation to other diseases was shown), the direction of these effects was partly inconclusive which complicates interpretation. Either way, the previously indicated crucial role of distress intolerance and intolerance of uncertainty in the emotional and behavioral response to the COVID-19 pandemic could not be confirmed in the present study. As the conceptualization of distress (in)tolerance as distinctive from other constructs still remains inconclusive [68,69], distress could therefore be defined as a broader construct also comprising uncertainty as a possible cause of distress. This could lead to a strong interrelation of both constructs and could have reduced separate predictive value in the present study.
In summary, the present study emphasizes the need to support people with vulnerability factors, such as heightened health anxiety, in epidemics/pandemics, as they seem to be prone to heightened distress and intensified behavioral responses to epidemics/pandemics. It underlines the importance of conducting longitudinal studies to enable conclusions on the long-time development of mental health during the course of epidemics/pandemics and emphasizes the need for research on behavior in epidemics/pandemics. Although, detrimental effects of health anxiety (both pre-existing and emerging) on behavior in the context of the COVID-19 pandemic could be seen, these effects were less consistent and conclusive than expected, indicating differential behavioral responses to the COVID-19 pandemic.
Some limitations should be addressed. First, the survey sample cannot be considered as representative of the German general population as it differs in age (younger), sex (high proportion of female people), education (higher), and profession (higher). Especially the high proportion of college students (about 40%) and the high proportion of people with female sex (about 80%) could skew the results (e.g., intensify mental distress). Second, some outcomes (anxiety, health anxiety, and behavior) were retrospectively assessed, which makes the results vulnerable to a recall bias. Furthermore, they were adapted (SHAI, QSBH) to allow a separate assessment of different time points and/or contents. This could have reduced the quality of the outcome measures. However, internal consistency of the adapted measures was still satisfying. The adding of items to assess preventive behavior and the use of a non-validated measure of anxiety could limit comparability and generalization of the corresponding results. Future studies should incorporate newly published instruments to assess SARS-CoV-2 related anxiety (e.g., COVID stress scales; [20]). Measures assessing specific behavior in pandemics/epidemics and differentiating regarding (dys)functionality of behavior should be developed. The present study lacks a differentiation regarding adaptivity and functionality of behavior.

5. Conclusions

Overall, the present study indicates that pre-existing health anxiety and health worries, which emerge during epidemics/pandemics influence the affective and behavioral responses to virus outbreaks. Increasing levels of health anxiety pre and during COVID-19 were associated with a stronger increase and—at the same time—a stronger/faster dampening of SARS-CoV-2 related anxiety (in the “later” phase [April/May 2020]) over the course of the COVID-19 pandemic in Germany. The effect of pre-existing health worries was especially strong in the investigated “first peak” (March 2020) and “later” (April to May 2020) phase of the COVID-19 pandemic, while anxiety with regard to other severe diseases (e.g., cancer) was quite constantly affected by pre-existing health anxiety. Health anxiety during COVID-19 was associated with an increase of hypochondriacal reassurance and preventive behavior, whereas pre-existing health anxiety only intensified preventive behavior specifically related to SARS-CoV-2. Intolerance of uncertainty and distress intolerance did not moderate the association between pre-existing health anxiety and SARS-CoV-2 related anxiety or behavior. Nevertheless, an increasing effect of distress intolerance on avoidance behavior was shown. The study implies that more research on behavioral responses to virus outbreaks as well as more longitudinal studies investigating the course of emotional and behavioral responses during epidemics/pandemics are needed. The results furthermore highlight a potential risk group (with heightened health anxiety) in need for more support during epidemics/pandemics. Providers in the healthcare system should be sensitive to the mental health burden of this risk group and should ensure easy access to qualified information and support measures, which at best should be individually adapted and gradually made available on the basis of COVID-19 related stress (e.g., from Internet information to low-threshold counseling and psychotherapy). In particular, a transparent information policy which keeps the balance between pointing out risks, promoting functional behavior, and avoiding sensational reporting styles appears crucial. Different wide-scope supportive approaches, like tele counselling, appear promising, but still lack a rigorous empirical evaluation.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/17/19/7241/s1, Table S1: Results of the correlational analyses on age (1), sex (2), education (3), profession (4; students vs. others), physical disease (6), immunosuppressive medication (7), mental disorder (8), health anxiety (SHAI) pre (9) and during COVID-19 (10), reassurance, avoidance and preventive behavior during COVID-19 (11–16), and anxiety in relation to SARS-CoV-2 (17–20) and to other diseases (21–23).

Author Contributions

Conceptualization, K.S.S., S.M.J., and M.W.; methodology, K.S.S., S.M.J., and M.W.; formal analysis, K.S.S.; investigation, K.S.S.; data curation, K.S.S.; writing—original draft preparation, K.S.S.; writing—review and editing, S.M.J. and M.W.; supervision, M.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, C.; Pan, R.; Wan, X.; Tan, Y.; Xu, L.; Ho, C.S.; Ho, R.C. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int. J. Environ. Res. Public Health 2020, 17, 1729. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Ahmed, M.Z.; Ahmed, O.; Aibao, Z.; Hanbin, S.; Siyu, L.; Ahmad, A. Epidemic of COVID-19 in China and associated Psychological Problems. Asian J. Psychiatr. 2020, 51, 102092. [Google Scholar] [CrossRef] [PubMed]
  3. Mazza, C.; Ricci, E.; Biondi, S.; Colasanti, M.; Ferracuti, S.; Napoli, C.; Roma, P. A Nationwide Survey of Psychological Distress among Italian People during the COVID-19 Pandemic: Immediate Psychological Responses and Associated Factors. Int. J. Environ. Res. Public Health 2020, 17, 3165. [Google Scholar] [CrossRef] [PubMed]
  4. González-Sanguino, C.; Ausín, B.; ÁngelCastellanos, M.; Saiz, J.; López-Gómez, A.; Ugidos, C.; Muñoz, M. Mental Health Consequences during the Initial Stage of the 2020 Coronavirus Pandemic (COVID-19) in Spain. Brain Behav. Immun. 2020. [Google Scholar] [CrossRef]
  5. Cénat, J.M.; Felix, N.; Blais-Rochette, C.; Rousseau, C.; Bukaka, J.; Derivois, D.; Noorishad, P.-G.; Birangui, J.-P. Prevalence of mental health problems in populations affected by the Ebola virus disease: A systematic review and meta-analysis. Psychiatry Res. 2020, 289, 113033. [Google Scholar] [CrossRef]
  6. Jones, J.H.; Salathé, M. Early assessment of anxiety and behavioral response to novel swine-origin influenza A(H1N1). PLoS ONE 2009, 4, e8032. [Google Scholar] [CrossRef]
  7. Goodwin, R.; Gaines, S.O.; Myers, L.; Neto, F. Initial psychological responses to swine flu. Int. J. Behav. Med. 2011, 18, 88–92. [Google Scholar] [CrossRef]
  8. Xiong, J.; Lipsitz, O.; Nasri, F.; Lui, L.M.W.; Gill, H.; Phan, L.; Chen-Li, D.; Iacobucci, M.; Ho, R.; Majeed, A.; et al. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. J. Affect. Disord. 2020, 277, 55–64. [Google Scholar] [CrossRef]
  9. Ferguson, E. A taxometric analysis of health anxiety. Psychol. Med. 2009, 39, 277–285. [Google Scholar] [CrossRef]
  10. Warwick, H.M.; Salkovskis, P.M. Hypochondriasis. Behav. Res. Ther. 1990, 28, 105–117. [Google Scholar] [CrossRef]
  11. Witthöft, M.; Kerstner, T.; Ofer, J.; Mier, D.; Rist, F.; Diener, C.; Bailer, J. Cognitive Biases in Pathological Health Anxiety. Clin. Psychol. Sci. 2016, 4, 464–479. [Google Scholar] [CrossRef] [Green Version]
  12. Barsky, A.J.; Wyshak, G. Hypochondriasis and somatosensory amplification. Br. J. Psychiatry 1990, 157, 404–409. [Google Scholar] [CrossRef] [PubMed]
  13. Jungmann, S.M.; Witthöft, M. Health anxiety, cyberchondria, and coping in the current COVID-19 pandemic: Which factors are related to coronavirus anxiety? J. Anxiety Disord. 2020, 73, 102239. [Google Scholar] [CrossRef] [PubMed]
  14. Asmundson, G.J.G.; Taylor, S. How health anxiety influences responses to viral outbreaks like COVID-19: What all decision-makers, health authorities, and health care professionals need to know. J. Anxiety Disord. 2020, 71, 102211. [Google Scholar] [CrossRef]
  15. Bacon, A.M.; Corr, P.J. Coronavirus (COVID-19) in the United Kingdom: A personality-based perspective on concerns and intention to self-isolate. Br. J. Health Psychol. 2020. [Google Scholar] [CrossRef]
  16. Mertens, G.; Gerritsen, L.; Duijndam, S.; Salemink, E.; Engelhard, I.M. Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. J. Anxiety Disord. 2020, 74, 102258. [Google Scholar] [CrossRef]
  17. Gallagher, M.W.; Zvolensky, M.J.; Long, L.J.; Rogers, A.H.; Garey, L. The Impact of Covid-19 Experiences and Associated Stress on Anxiety, Depression, and Functional Impairment in American Adults. Cognit. Ther. Res. 2020, 1–9. [Google Scholar] [CrossRef]
  18. Lee, S.A.; Jobe, M.C.; Mathis, A.A.; Gibbons, J.A. Incremental validity of coronaphobia: Coronavirus anxiety explains depression, generalized anxiety, and death anxiety. J. Anxiety Disord. 2020, 74, 102268. [Google Scholar] [CrossRef]
  19. Taylor, S.; Landry, C.A.; Paluszek, M.M.; Fergus, T.A.; McKay, D.; Asmundson, G.J.G. COVID stress syndrome: Concept, structure, and correlates. Depress. Anxiety 2020. [Google Scholar] [CrossRef]
  20. Taylor, S.; Landry, C.A.; Paluszek, M.M.; Fergus, T.A.; McKay, D.; Asmundson, G.J.G. Development and initial validation of the COVID Stress Scales. J. Anxiety Disord. 2020, 72, 102232. [Google Scholar] [CrossRef]
  21. Newby, J.M.; Hobbs, M.J.; Mahoney, A.E.J.; Wong, S.K.; Andrews, G. DSM-5 illness anxiety disorder and somatic symptom disorder: Comorbidity, correlates, and overlap with DSM-IV hypochondriasis. J. Psychosom. Res. 2017, 101, 31–37. [Google Scholar] [CrossRef] [PubMed]
  22. Taylor, S.; Landry, C.A.; Paluszek, M.M.; Asmundson, G.J.G. Reactions to COVID-19: Differential Predictors of Distress, Avoidance, and Disregard for Social Distancing. J. Affect. Disord. 2020. [Google Scholar] [CrossRef] [PubMed]
  23. Seale, H.; Heywood, A.E.; Leask, J.; Sheel, M.; Thomas, S.; Durrheim, D.N.; Bolsewicz, K.; Kaur, R. COVID-19 is rapidly changing: Examining public perceptions and behaviors in response to this evolving pandemic. PLoS ONE 2020, 15. [Google Scholar] [CrossRef] [PubMed]
  24. Bish, A.; Michie, S. Demographic and attitudinal determinants of protective behaviours during a pandemic: A review. Br. J. Health Psychol. 2010, 15, 797–824. [Google Scholar] [CrossRef] [PubMed]
  25. Scherr, C.L.; Jensen, J.D.; Christy, K. Dispositional pandemic worry and the health belief model: Promoting vaccination during pandemic events. J. Public Health (Oxf.) 2017, 39, e242–e250. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Gaygisiz, U.; Gaygisiz, E.; Ozkan, T.; Lajunen, T. Individual differences in behavioral reactions to H1N1 during a later stage of the epidemic. J. Infect. Public Health 2012, 5, 9–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Liao, Q.; Cowling, B.J.; Lam, W.W.T.; Ng, D.M.W.; Fielding, R. Anxiety, worry and cognitive risk estimate in relation to protective behaviors during the 2009 influenza A/H1N1 pandemic in Hong Kong: Ten cross-sectional surveys. BMC Infect. Dis. 2014, 14, 169. [Google Scholar] [CrossRef] [Green Version]
  28. Lee, S.A.; Crunk, E.A. Fear and Psychopathology During the COVID-19 Crisis: Neuroticism, Hypochondriasis, Reassurance-Seeking, and Coronaphobia as Fear Factors. Omega (Westport) 2020, 30222820949350. [Google Scholar] [CrossRef]
  29. Carleton, R.N. Into the unknown: A review and synthesis of contemporary models involving uncertainty. J. Anxiety Disord. 2016, 39, 30–43. [Google Scholar] [CrossRef] [Green Version]
  30. Greco, V.; Roger, D. Uncertainty, stress, and health. Pers. Individ. Dif. 2003, 34, 1057–1068. [Google Scholar] [CrossRef]
  31. Dugas, M.J.; Hedayati, M.; Karavidas, A.; Buhr, K.; Francis, K.; Phillips, N.A. Intolerance of Uncertainty and Information Processing: Evidence of Biased Recall and Interpretations. Cogn. Ther. Res. 2005, 29, 57–70. [Google Scholar] [CrossRef]
  32. San Martín, C.; Jacobs, B.; Vervliet, B. Further characterization of relief dynamics in the conditioning and generalization of avoidance: Effects of distress tolerance and intolerance of uncertainty. Behav. Res. Ther. 2020, 124, 103526. [Google Scholar] [CrossRef] [PubMed]
  33. Rosen, N.O.; Knäuper, B. A little uncertainty goes a long way: State and trait differences in uncertainty interact to increase information seeking but also increase worry. Health Commun. 2009, 24, 228–238. [Google Scholar] [CrossRef] [PubMed]
  34. Fergus, T.A.; Bardeen, J.R. Anxiety sensitivity and intolerance of uncertainty: Evidence of incremental specificity in relation to health anxiety. Pers. Individ. Dif. 2013, 55, 640–644. [Google Scholar] [CrossRef]
  35. Fetzner, M.G.; Asmundson, G.J.G.; Carey, C.; Thibodeau, M.A.; Brandt, C.; Zvolensky, M.J.; Carleton, R.N. How do elements of a reduced capacity to withstand uncertainty relate to the severity of health anxiety? Cogn. Behav. Ther. 2014, 43, 262–274. [Google Scholar] [CrossRef]
  36. Deacon, B.; Abramowitz, J.S. Is Hypochondriasis Related to Obsessive-Compulsive Disorder, Panic Disorder, or Both? An Empirical Evaluation. J. Cogn. Psychother. 2008, 22, 115–127. [Google Scholar] [CrossRef]
  37. Abramowitz, J.S.; Deacon, B.J.; Valentiner, D.P. The Short Health Anxiety Inventory: Psychometric Properties and Construct Validity in a Non-clinical Sample. Cognit. Ther. Res. 2007, 31, 871–883. [Google Scholar] [CrossRef]
  38. Taha, S.; Matheson, K.; Anisman, H. H1N1 was not all that scary: Uncertainty and stressor appraisals predict anxiety related to a coming viral threat. Stress Health 2014, 30, 149–157. [Google Scholar] [CrossRef]
  39. Taha, S.; Matheson, K.; Cronin, T.; Anisman, H. Intolerance of uncertainty, appraisals, coping, and anxiety: The case of the 2009 H1N1 pandemic. Br. J. Health Psychol. 2014, 19, 592–605. [Google Scholar] [CrossRef]
  40. Satici, B.; Saricali, M.; Satici, S.A.; Griffiths, M.D. Intolerance of Uncertainty and Mental Wellbeing: Serial Mediation by Rumination and Fear of COVID-19. Int. J. Ment. Health Addict. 2020, 1–12. [Google Scholar] [CrossRef]
  41. Tull, M.T.; Barbano, A.C.; Scamaldo, K.M.; Richmond, J.R.; Edmonds, K.A.; Rose, J.P.; Gratz, K.L. The prospective influence of COVID-19 affective risk assessments and intolerance of uncertainty on later dimensions of health anxiety. J. Anxiety Disord. 2020, 75, 102290. [Google Scholar] [CrossRef] [PubMed]
  42. Rettie, H.; Daniels, J. Coping and tolerance of uncertainty: Predictors and mediators of mental health during the COVID-19 pandemic. Am. Psychol. 2020. [Google Scholar] [CrossRef] [PubMed]
  43. Simons, J.S.; Gaher, R.M. The Distress Tolerance Scale: Development and Validation of a Self-Report Measure. Motiv. Emot. 2005, 29, 83–102. [Google Scholar] [CrossRef]
  44. Keough, M.E.; Riccardi, C.J.; Timpano, K.R.; Mitchell, M.A.; Schmidt, N.B. Anxiety symptomatology: The association with distress tolerance and anxiety sensitivity. Behav. Ther. 2010, 41, 567–574. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Hunt, C.; Cooper, S.E.; Hartnell, M.P.; Lissek, S. Distraction/Suppression and Distress Endurance diminish the extent to which generalized conditioned fear is associated with maladaptive behavioral avoidance. Behav. Res. Ther. 2017, 96, 90–105. [Google Scholar] [CrossRef]
  46. Fergus, T.A.; Bardeen, J.R.; Orcutt, H.K. Examining the Specific Facets of Distress Tolerance That Are Relevant to Health Anxiety. J. Cogn. Psychother. 2015, 29, 32–44. [Google Scholar] [CrossRef]
  47. Liu, C.H.; Zhang, E.; Wong, G.T.F.; Hyun, S.; Hahm, H.C. Factors associated with depression, anxiety, and PTSD symptomatology during the COVID-19 pandemic: Clinical implications for U.S. young adult mental health. Psychiatry Res. 2020, 290, 113172. [Google Scholar] [CrossRef]
  48. Robert Koch Institut. Daily Status Report of the RKI on the Coronavirus-Disease-2019 (COVID-19) 20.04.2020—Updated Status for Germany. Available online: https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/Situationsberichte/2020-04-20-de.pdf?__blob=publicationFile (accessed on 2 October 2020).
  49. Robert Koch Institut. Daily Status Report of the RKI on the Coronavirus-Disease-2019 (COVID-19) 15.05.2020—Updated Stand. Available online: https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/Situationsberichte/2020-05-15-de.pdf?__blob=publicationFile (accessed on 2 October 2020).
  50. Salkovskis, P.M.; Rimes, K.A.; Warwick, H.M.C.; Clark, D.M. The Health Anxiety Inventory: Development and validation of scales for the measurement of health anxiety and hypochondriasis. Psychol. Med. 2002, 32, 843–853. [Google Scholar] [CrossRef]
  51. Bailer, J.; Rist, F.; Müller, T.; Mier, D.; Diener, C.; Ofer, J.; Fenske, S.; Witthöft, M. Erfassung von Krankheitsangst mit dem Short Health Anxiety Inventory. Verhaltenstherapie Verhaltensmedizin 2013, 34, 378–398. [Google Scholar]
  52. Weck, F.; Brehm, U.; Schermelleh-Engel, K. Entwicklung und Validierung eines Fragebogens zur Erfassung von hypochondrischem Sicherheitsverhalten. Zeitschrift für Klinische Psychologie und Psychotherapie 2012, 41, 271–281. [Google Scholar] [CrossRef]
  53. Gerlach, A.L.; Andor, T.; Patzelt, J. Die Bedeutung von Unsicherheitsintoleranz für die Generalisierte Angststörung Modellüberlegungen und Entwicklung einer deutschen Version der Unsicherheitsintoleranz-Skala. Zeitschrift für Klinische Psychologie und Psychotherapie 2008, 37, 190–199. [Google Scholar] [CrossRef]
  54. Buhr, K.; Dugas, M.J. The intolerance of uncertainty scale: Psychometric properties of the English version. Behav. Res. Ther. 2002, 40, 931–945. [Google Scholar] [CrossRef]
  55. Freeston, M.H.; Rheaume, J.; Letarte, H.; Dugas, M.J.; Ladouceur, R. Why do people worry? Pers. Individ. Dif. 1994, 17, 791–802. [Google Scholar] [CrossRef]
  56. McHugh, R.K.; Otto, M.W. Refining the measurement of distress intolerance. Behav. Ther. 2012, 43, 641–651. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Reiss, S.; Peterson, R.A.; Gursky, D.M.; McNally, R.J. Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav. Res. Ther. 1986, 24, 1–8. [Google Scholar] [CrossRef]
  58. Harrington, N. The Frustration Discomfort Scale: Development and psychometric properties. Clin. Psychol. Psychother. 2005, 12, 374–387. [Google Scholar] [CrossRef]
  59. Schmidt, N.B.; Richey, J.A.; Fitzpatrick, K.K. Discomfort intolerance: Development of a construct and measure relevant to panic disorder. J. Anxiety Disord. 2006, 20, 263–280. [Google Scholar] [CrossRef]
  60. Otto, J.; Linden, M. Die deutsche Übersetzung der Distress-Intoleranz-Skala. Verhaltenstherapie 2019, 29, 108–112. [Google Scholar] [CrossRef]
  61. Singer, J.D.; Willett, J.B. Applied Longitudinal Data Analysis: Modeling Change and Event Occurence; Oxford University Press: New York, NY, USA, 2003. [Google Scholar]
  62. Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach; Guilford Press: New York, NY, USA, 2017. [Google Scholar]
  63. Robert Koch Institut. Nowcasting und R-Schätzung: Schätzung der aktuellen Entwicklung der SARS-CoV-2-Epidemie in Deutschland. Available online: https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/Projekte_RKI/Nowcasting.html (accessed on 2 October 2020).
  64. Liao, Q.; Wu, P.; Wing Tak Lam, W.; Cowling, B.J.; Fielding, R. Trajectories of public psycho-behavioural responses relating to influenza A(H7N9) over the winter of 2014-15 in Hong Kong. Psychol. Health 2019, 34, 162–180. [Google Scholar] [CrossRef]
  65. Cheng, C.; Cheung, M.W.L. Psychological responses to outbreak of severe acute respiratory syndrome: A prospective, multiple time-point study. J. Pers. 2005, 73, 261–285. [Google Scholar] [CrossRef]
  66. Balkhi, F.; Nasir, A.; Zehra, A.; Riaz, R. Psychological and Behavioral Response to the Coronavirus (COVID-19) Pandemic. Cureus 2020, 12, e7923. [Google Scholar] [CrossRef] [PubMed]
  67. Creed, F.; Barsky, A. A systematic review of the epidemiology of somatisation disorder and hypochondriasis. J. Psychosom. Res. 2004, 56, 391–408. [Google Scholar] [CrossRef]
  68. Mitchell, M.A.; Riccardi, C.J.; Keough, M.E.; Timpano, K.R.; Schmidt, N.B. Understanding the associations among anxiety sensitivity, distress tolerance, and discomfort intolerance: A comparison of three models. J. Anxiety Disord. 2013, 27, 147–154. [Google Scholar] [CrossRef] [PubMed]
  69. Bernstein, A.; Zvolensky, M.J.; Vujanovic, A.A.; Moos, R. Integrating anxiety sensitivity, distress tolerance, and discomfort intolerance: A hierarchical model of affect sensitivity and tolerance. Behav. Ther. 2009, 40, 291–301. [Google Scholar] [CrossRef]
Ijerph 17 07241 g001 550
Figure 1. Course of anxiety in relation to SARS-CoV-2 (including COVID-19) on individual level during the COVID-19 pandemic (December 2019, January 2020 and March 2020 retrospectively assessed) (fitted trajectory of sample development added).
Figure 1. Course of anxiety in relation to SARS-CoV-2 (including COVID-19) on individual level during the COVID-19 pandemic (December 2019, January 2020 and March 2020 retrospectively assessed) (fitted trajectory of sample development added).
Ijerph 17 07241 g001
Ijerph 17 07241 g002 550
Figure 2. Anxiety in relation to SARS-CoV-2 (including COVID-19) (left) and in relation to other severe diseases (not COVID-19; e.g., cancer) (right) as a function of health anxiety (SHAI) pre COVID-19 over the course of the COVID-19 pandemic (December [Dec] 2019, January [Jan] 2020, and March [Mar] 2020, retrospectively assessed).
Figure 2. Anxiety in relation to SARS-CoV-2 (including COVID-19) (left) and in relation to other severe diseases (not COVID-19; e.g., cancer) (right) as a function of health anxiety (SHAI) pre COVID-19 over the course of the COVID-19 pandemic (December [Dec] 2019, January [Jan] 2020, and March [Mar] 2020, retrospectively assessed).
Ijerph 17 07241 g002
Table
Table 1. Descriptive statistics of applied questionnaires and ratings.
Table 1. Descriptive statistics of applied questionnaires and ratings.
MSDN%
Anxiety related to SARS-CoV-2 (0–100)
December 2019 a4.4411.97
January 2020 a10.9319.37
March 2020 a34.9027.97
past week29.2025.37
Anxiety related to other severe diseases (0–100)
December 2019 a12.2118.86
January 2020 a13.1920.16
March 2020 a13.2419.70
past week13.2219.81
Health anxiety (SHAI) pre COVID-19 b
total (0–54)14.007.13
subscale “health anxiety” (0–42)11.085.97
subscale “negative consequences of illness” (0–12)2.921.97
Health anxiety (SHAI) during COVID-19
total (0–54)17.168.45
subscale “health anxiety” (0–42)13.887.04
subscale “negative consequences of illness” (0–12)3.292.18
Hypochondriacal safety behavior (QSBH) pre COVID-19 c
subscale “reassurance” (original version) (0–32)9.884.92
subscale “avoidance” (original version) (0–32)11.266.77
subscale “reassurance” (shortened version) (0–20)6.333.39
subscale “avoidance” (shortened version) (0–20)4.564.29
Hypochondriacal safety behavior (QSBH) during COVID-19
subscale “reassurance”—SARS-CoV-2 (0–20)6.533.75
subscale “reassurance”—other severe diseases (0–20)5.903.53
subscale “avoidance”—SARS-CoV-2 (0–20)4.364.20
subscale “avoidance”—other severe diseases (0–20)4.174.49
Preventive behavior pre COVID-19 d
total (0–16)4.703.12
Buying or using toiletries (e.g., disinfectants)1.211.08
Washing hands2.331.10
Buying or using respiratory masks0.300.85
Avoiding places0.851.11
Preventive behavior during COVID-19
total—SARS-CoV-2 (0–16)10.753.50
total—other infections (0–16)5.243.45
Buying or using toiletries (e.g., disinfectants)—SARS-CoV-22.261.23
Buying or using toiletries (e.g., disinfectants)—other infections1.361.21
Washing hands—SARS-CoV-23.350.84
Washing hands—other infections2.351.19
Buying or using respiratory masks—SARS-CoV-22.481.29
Buying or using respiratory masks—other infections0.410.92
Avoiding places—SARS-CoV-22.661.25
Avoiding places—other infections1.111.25
Most feared disease at the moment
Infection with SARS-CoV-2 (incl. COVID-19) 29232.90
Cancer 10712.10
Mental disorders 9310.50
Cardiovascular diseases 637.10
Respiratory diseases 151.70
Neurological diseases 141.60
Injuries/poisoning 70.80
Other infections 30.30
Others 222.50
No disease 27130.60
Intolerance of uncertainty (IU-18)
total (18–90)47.3914.82
subscale “reduced ability to act due to IU” (6–30)14.135.71
subscale “burden due to IU” (6–30)16.645.61
subscale “vigilance due to IU” (6–30)16.625.37
Distress intolerance (Distress intolerance scale)
total (10–50)24.639.34
SHAI = Short Health Anxiety Inventory. QSBH = Questionnaire for assessing safety behavior in patients with hypochondriasis. IU-18 = Intolerance of Uncertainty Scale—short version. a Anxiety related to SARS-CoV-2 and other severe diseases in December 2019, January 2020 and March 2020 were retrospectively assessed. b Health anxiety (SHAI) pre COVID-19 was retrospectively assessed. c Hypochondriacal safety behavior (QSBH) pre COVID-19 was retrospectively assessed. The shortened version only consists of items which could be assessed at the second time point (during COVID-19). d Preventive behavior pre COVID-19 was retrospectively assessed.
Table
Table 2. Results of the dependent (paired) sample t-tests of reassurance, avoidance, and preventive behavior in relation to SARS-CoV-2 and in relation to other diseases in the subgroups female and male, and the age subgroups “young” (18–29), “middle” (30–59), and “old” (≥60 years).
Table 2. Results of the dependent (paired) sample t-tests of reassurance, avoidance, and preventive behavior in relation to SARS-CoV-2 and in relation to other diseases in the subgroups female and male, and the age subgroups “young” (18–29), “middle” (30–59), and “old” (≥60 years).
Reassurance BehaviorAvoidance BehaviorPreventive Behavior
SARS-CoV-2Other Diseases SARS-CoV-2Other Diseases SARS-CoV-2Other Viruses
MSDMSDBCa 99% CI|t|dfpdMSDMSDBCa 99% CI|t|dfpdMSDMSDBCa 99% CI|t|dfpd
Female6.633.756.003.52[0.33, 0.91]5.56694<0.0010.174.454.214.104.38[0.03, 0.67]2.766940.010.0815.033.299.363.42[5.33, 6.01]42.20694<0.0011.69
Male6.223.755.533.54[0.06, 1.35]2.991870.0030.193.964.124.434.87[−1.02, 0.24]1.681870.100.1013.774.038.863.51[4.18, 5.60]18.33187<0.0011.29
Young6.153.575.533.48[0.23, 1.01]4.09404<0.0010.184.284.213.073.88[0.76, 1.66]6.91404<0.0010.3014.633.338.983.49[5.20, 6.10]33.55404<0.0011.66
Middle6.913.916.243.64[0.22, 1.11]4.03344<0.0010.184.594.444.994.95[−0.85, 0.08]2.223440.030.0814.643.759.543.56[4.59, 5.61]24.79344<0.0011.40
Old6.723.786.113.29[0.01, 1.26]2.521360.010.173.993.455.344.22[−2.01, −0.72]5.48136<0.0010.3415.363.319.282.93[5.31, 6.82]20.87136<0.0011.94
Table
Table 3. Results of the conditional (including time-varying health anxiety [SHAI] and time-invariant intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale]) growth model of SARS-CoV-2 related anxiety.
Table 3. Results of the conditional (including time-varying health anxiety [SHAI] and time-invariant intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale]) growth model of SARS-CoV-2 related anxiety.
ParameterEstimateSEp
Fixed effects
Initial levelb01.930.620.002
Time ab118.330.91<0.001
Time 2 ab2−2.960.29<0.001
Health anxiety bb3−0.070.090.46
Health anxiety b × Time ab41.100.14<0.001
Health anxiety b × Time2 ab5−0.180.04<0.001
Intolerance of uncertaintyb6−0.010.060.83
Intolerance of uncertainty × Time ab70.020.090.85
Intolerance of uncertainty × Time2 ab80.010.030.68
Distress intoleranceb90.040.090.64
Distress intolerance × Time ab10−0.060.140.68
Distress intolerance × Time 2 ab110.010.040.77
Random effects
Variance initial levelb0i38.609.65<0.001
Variance quadratic slope (Time 2 a)b1i1.510.39<0.001
Covariance initial level−quadratic slope (Time 2 a) 7.58
Goodness-of-fit
Akaike information criterionAIC30,988.22
Bayesian information criterionBIC31,087.01
SHAI = Short Health Anxiety Inventory. IU-18 = Intolerance of Uncertainty Scale—short version. An autoregressive covariance structure with heterogeneous variances was selected. a Time is coded 0–1-2–3, Time2 represents the quadratic slope of Time; all time points were retrospectively measured. b Health anxiety was included as a time-varying covariate with two points of measurement (pre COVID-19 = until January 2020; during COVID-19 = since January 2020). Equation for the conditional growth model: Yti = b0 + b1(TIMEti) + b2(TIMEti × TIMEti) + b3(HA(healthanxiety)ti − HAgmean) + b4(HAti − HAgmean)(TIMEti) + b5(HAti − HAgmean)(TIMEti × TIMEti) + b6(IUSi − IUSgmean) + b7(IUSi − IUSgmean)(TIMEti) + b8(IUSi − IUSgmean)(TIMEti × TIMEti) + b9(DIi − DIgmean) + b10(DIi − DIgmean)(TIMEti) + b11(DIi − DIgmean)(TIMti × TIMEti) + b0i + b1i (TIMEti × TIMEti) + εti.
Table
Table 4. Results of the moderator analyses on behavior during COVID-19 with health anxiety (SHAI) pre COVID-19 (retrospectively assessed) as predictor and intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale] as moderators.
Table 4. Results of the moderator analyses on behavior during COVID-19 with health anxiety (SHAI) pre COVID-19 (retrospectively assessed) as predictor and intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale] as moderators.
Reassurance BehaviorAvoidance BehaviorPreventive Behavior
SARS-CoV-2Other DiseasesSARS-CoV-2Other DiseasesSARS-CoV-2Other Diseases
b99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]p
HA pre−0.001 −0.050.050.960.004−0.030.040.800.004−0.050.060.850.02−0.020.060.240.060.010.110.0050.02−0.020.050.30
DI a0.04−0.010.080.030.030.010.060.0030.070.020.120.0010.040.0020.080.010.02−0.030.060.310.03−0.010.060.11
IU b0.01−0.010.040.23−0.004−0.020.010.550.004−0.030.040.74−0.005−0.030.020.550.02−0.010.040.120.01−0.020.030.36
HA pre x DI a−0.003−0.010.0040.32−0.001−0.010.0040.610.001−0.010.010.76<0.001−0.0050.0040.98−0.004−0.010.0020.110.001−0.010.010.80
HA pre x IU b0.003−0.0010.010.090.001−0.0010.0040.18−0.002−0.010.0030.29<0.001−0.0030.0030.890.001−0.0030.0040.74<0.001-0.0040.0030.79
Behavior pre c0.590.490.69<0.0010.820.750.89<0.0010.500.420.59<0.0010.880.820.93<0.0010.400.320.49<0.0010.720.630.81<0.001
R20.35 0.68 0.34 0.76 0.18 0.46
SHAI = Short Health Anxiety Inventory. IU-18 = Intolerance of Uncertainty Scale—short version. a Distress intolerance (measured with the Distress intolerance scale). b Intolerance of Uncertainty (measured with the IU-18). c Corresponding behavior pre COVID-19 (retrospectively assessed).
Table
Table 5. Results of the moderator analyses on behavior during COVID-19 with health anxiety (SHAI) during COVID-19 as predictor and intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale] as moderators.
Table 5. Results of the moderator analyses on behavior during COVID-19 with health anxiety (SHAI) during COVID-19 as predictor and intolerance of uncertainty [IU-18] and distress intolerance [Distress intolerance scale] as moderators.
Reassurance BehaviorAvoidance BehaviorPreventive Behavior
SARS-CoV-2Other DiseasesSARS-CoV-2Other DiseasesSARS-CoV-2Other Diseases
b99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]pb99% CI [LL, UL]p
HA during0.140.100.19<0.0010.060.030.09<0.0010.002−0.050.050.940.03−0.010.060.080.150.110.20<0.0010.050.010.090.002
DI a0.003−0.030.040.810.02−0.0040.050.040.070.020.120.0010.030.0020.070.01−0.01-0.050.040.650.01−0.020.050.30
IU b−0.01−0.040.010.28-0.01−0.030.0050.070.004−0.030.040.79−0.01−0.030.010.41−0.004-0.030.020.690.001−0.020.030.88
HA during x DI a0.001−0.0040.010.720.001−0.0040.0050.660.001−0.010.010.700.001−0.0040.010.51−0.002-0.010.0030.430.002−0.0040.010.51
HA during x IU b0.001−0.0030.0040.650.001−0.0020.0030.63−0.001−0.0050.0030.63<0.001−0.0030.0030.96−0.001-0.0050.0020.30−0.001−0.0040.0030.61
Behavior pre c0.470.370.57<0.0010.770.700.85<0.0010.500.420.59<0.0010.870.810.93<0.0010.360.280.45<0.0010.700.620.79<0.001
R20.42 0.70 0.34 0.76 0.25 0.47
SHAI = Short Health Anxiety Inventory. IU-18 = Intolerance of Uncertainty Scale—short version. a Distress intolerance (measured with the Distress intolerance scale). b Intolerance of Uncertainty (measured with the IU-18). c Corresponding behavior pre COVID-19 (retrospectively assessed).

Share and Cite

MDPI and ACS Style

Sauer, K.S.; Jungmann, S.M.; Witthöft, M. Emotional and Behavioral Consequences of the COVID-19 Pandemic: The Role of Health Anxiety, Intolerance of Uncertainty, and Distress (In)Tolerance. Int. J. Environ. Res. Public Health 2020, 17, 7241. https://doi.org/10.3390/ijerph17197241

AMA Style

Sauer KS, Jungmann SM, Witthöft M. Emotional and Behavioral Consequences of the COVID-19 Pandemic: The Role of Health Anxiety, Intolerance of Uncertainty, and Distress (In)Tolerance. International Journal of Environmental Research and Public Health. 2020; 17(19):7241. https://doi.org/10.3390/ijerph17197241

Chicago/Turabian Style

Sauer, Karoline S., Stefanie M. Jungmann, and Michael Witthöft. 2020. "Emotional and Behavioral Consequences of the COVID-19 Pandemic: The Role of Health Anxiety, Intolerance of Uncertainty, and Distress (In)Tolerance" International Journal of Environmental Research and Public Health 17, no. 19: 7241. https://doi.org/10.3390/ijerph17197241

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop