20-08-2020 | Original Paper | Uitgave 11/2020 Open Access
Psychometric Evaluation of the Mental Health Continuum-Short Form (MHC-SF) for Dutch Adolescents
- Tijdschrift:
- Journal of Child and Family Studies > Uitgave 11/2020
Belangrijke opmerkingen
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Adolescence is a phase of profound development that involves the transition from childhood to young adulthood. This period is accompanied by various extensive changes in the physical, cognitive, emotional, and social domains (Sisk and Zehr
2005). Adolescence involves the sexual maturation and the physical development of the body, as well as a consolidation of the adolescent’s identity and understanding of the self in relation to the social world (Coleman and Hendry
1990). The focus of social interactions changes and gradually shifts from the family to peers (Brown
2004; Keyes
1998). Parental influence and support decrease, whereas the influence of friends increases (Furman and Buhrmester
1992). While adolescents need to deal with these rapid developmental challenges, they experience an increase in emotional reactivity and negative emotions (Colten and Gore
1991; Hampel and Petermann
2006; Larson and Ham
1993; Nelson et al.
2005) and a decrease in emotional stability (Zimmermann and Iwanski
2014). Successfully meeting these developmental challenges can have a significant and long-lasting impact on adolescents’ mental health (McGorry and van Os
2013). Therefore, educational and psychological organizations should foster protective factors that facilitate and teach adolescents how to deal with challenges that occur in this period, so that they can grow up to be resilient adults (McGorry et al.
2007; Waters
2011). Research has shown that well-being is a protective factor that can contribute to the adolescent’s resilience and enables adolescents to deal with everyday stressors and associated negative emotions (Ahern et al.
2006).
Current conceptualizations of well-being (e.g., Keyes
2002,
2005) view well-being as more than the absence of illness. The two-continua model (Keyes
2002,
2005), that can also be applied to adolescents (Greenspoon and Saklofske
2001; Keyes
2006), states that mental illness and mental health represent related but distinct dimensions. The absence of mental illness is neither necessary nor sufficient to ensure well-being. Well-being is best reflected by two longstanding traditions (Ahern et al.
2006): the hedonic tradition and the eudaimonic tradition (Keyes
1998; Waterman
1993). The hedonic tradition entails the affective aspect of well-being which is reflected by emotional well-being (EWB) (Diener et al.
1999; Keyes
2009). According to this tradition, well-being is manifested in three components: life satisfaction; the presence of positive emotions; and the absence of negative emotions (Diener et al.
1999; Keyes
2009). The eudaimonic tradition considers optimal psychological functioning both on a personal and social level, conceptualized as, respectively, psychological well-being (PWB) and social-well-being (SWB) (Keyes
2002). The concept of PWB reflects different facets (self-acceptance, personal growth, purpose in life, positive relationships with others, autonomy, and environmental mastery) and focuses on the extent to which persons can realize their potential (Keyes
1998).
PWB correlates with measures of individual functioning (e.g., self-esteem) and the quality of social relationships (Lamers et al.
2011). Good social relationships are considered as a necessary component of PWB (Keyes
1998). SWB additionally, reflects facets of optimal functioning in community life (social integration, social contribution, social coherence, social actualization, and social acceptance) and focuses on the extent to which individuals feel accepted by their communities and can acknowledge their contribution to society (Keyes
1998; Waterman
1993). SWB covers wider social relationships than solely close friends and family relationships (Keyes
1998) and correlates with measurements of involvement in society (Lamers et al.
2011). The important role of well-being as a resilience factor in adolescence underscores the need to examine it more closely. Whereas global life satisfaction and EWB have been shown to decline with the onset and progression of adolescence (Gloldbeck et al.
2007; Gonzalez-Carrasco et al.
2017; Hong Chui and Wong
2016; Liu et al.
2015; Uusitalo-Malmivaara
2014), it remains unclear whether this decline can also be found for PWB and SWB. Moreover, only a few studies (Guo et al.
2015; Lim
2014) have comprehensively assessed adolescents’ well-being across the emotional, psychological, and social domains.
The Mental Health Continuum-Short Form (MHC-SF; Keyes and Grzywacz
2005) was specifically developed to measure EWB, PWB, and SWB. This self-report questionnaire, consisting of 14 items, has been investigated and has shown good internal consistency and convergent validity as well as confirming the two-continua model of mental health and illness (Keyes
2002,
2005) in adult samples from the Netherlands, South Africa, Italy and the U.S. (Keyes et al.
2008; Lamers et al.
2011; Petrillo et al.
2015; Salama-Younes and Ismaïl
2011) as well as in adolescent samples from Asian countries (Guo et al.
2015; Lim
2014). However, for Dutch-speaking adolescents, a reliable and valid instrument to assess well-being in adolescence is still lacking. As the field of practice focuses increasingly on well-being among adolescents, an instrument adapted to this age group is needed to validly and reliably capture variance in well-being (Keyes
2002,
2005).
In order to construct and evaluate such an instrument, this study aimed to adapt the MHC-SF to adolescents, to investigate the factor structure of the adapted MHC-SF (hereafter referred to as MHC-SF-A), and to analyze its psychometric properties. In addition, this study aimed to confirm the two-continua model in a sample of Dutch adolescents. In accordance with previous studies, firstly, it is expected to confirm the three-factor structure of EWB, PWB, and SWB (Guo et al.
2015; Keyes
2002,
2005; Lim
2014). Furthermore, considering earlier findings in adult and adolescent samples, it is hypothesized that the three subscales of the MHC-SF-A have high internal reliability, moderate reliability over time and larger test–retest reliability for the direct paths (e.g., EWB at baseline predicting EWB at follow-up) than for the cross-over paths (e.g., EWB at baseline predicting SWB at follow-up) (Guo et al.
2015; Lamers et al.
2011; Lim
2014). Secondly, it is hypothesized that the present study confirms the convergent validity of the MHC-SF-A, correlating the three subscales EWB, PWB, and SWB with corresponding measures. It is expected that EWB correlates with aspects of EWB, such as measures of positive emotions and negative emotions; PWB correlates with measurements of individual functioning (e.g., self-esteem) and positive relationships with parents and peers and SWB correlates with measurements of involvement in society, such as belonging to groups and being involved in school activities, that represent opportunities for adolescents to explore different identities and social roles and enhance their levels of sense of community and SWB (Salama-Younes and Ismaïl
2011). Lastly, it is expected that SWB correlates with adolescents’ school experiences. Thirdly, it is hypothesized that the two-continua model is confirmed in a sample of Dutch adolescents: demonstrating that mental health and mental illness are two related, but distinct, latent factors with low to moderate negative correlations.
Method
Participants
At baseline, 459 Dutch adolescents (178 boys and 281 girls) between the ages of 11 and 18 years participated. At follow-up, 283 participants (61.7%; hereafter referred to as completers) of the initial sample completed the survey (
M
age = 14.34
SD
age = 1.97,
range
age = 11–18). There were 108 boys and 175 girls at follow-up. Compared to participants who only completed the baseline survey (hereafter referred to as dropouts), the completers had significantly higher education levels, were significantly younger and reported a significantly higher score on the three scales of the MHC-SF-A (Table
1). No significant differences were observed in the cultural background between dropouts and completers.
Table 1
Sample characteristics of dropouts/completers and the difference between the two samples
|
Dropouts
(
n = 176)
|
Completers
(
n = 283)
|
Completers versus dropouts
|
|
|---|---|---|---|
|
Age M (SD)
|
15.32 (1.87)
|
14.34 (1.97)
|
t (457) = −5.26*
|
|
Gender
|
|||
|
Boys (%)
|
39.4
|
38.2
|
χ
2 (1) = 0.143
|
|
Girls (%)
|
60.6
|
61.8
|
|
|
Country of birth
|
|||
|
Born in the Netherlands (%)
|
92.8
|
95.4
|
χ
2 (1) = 1.197
|
|
Born abroad (%)
|
7.2
|
4.6
|
|
|
Living-situation
|
|||
|
Living with both parents (%)
|
72.9
|
77.4
|
χ
2 (1) = 0.271
|
|
Other (%)
|
27.1
|
22.6
|
|
|
Level of education
|
|||
|
High
a (%)
|
39.8
|
54.1
|
χ
2 (1) = 10.327*
|
|
Low
b (%)
|
60.2
|
45.9
|
|
|
Well-being
|
|||
|
EWB M (SD)
|
3.55 (0.98)
|
3.87 (0.85)
|
t (326) = 3.48*
|
|
PWB M (SD)
|
3.38 (0.95)
|
3.63 (0.84)
|
t (330) = 2.86*
|
|
SWB M (SD)
|
2.87 (0.95)
|
3.11 (0.85)
|
t (330) = 2.73*
|
Procedure
The present study was approved by the local research ethics committee of the Open University and was carried out in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki) for medical research involving humans (World Medical Association
2013). Data was collected through convenience sampling. Dutch adolescents, primarily recruited, by undergraduate psychology students, through six secondary schools spread over the Netherlands were asked to complete an online questionnaire at baseline (MHC-SF-A, Kidscreen-52, The Strengths and Difficulties Questionnaire, self-worth scale of the Harter’s Social Perception Profile for Children and the FEEL-KJ) and at a 4-week follow-up (MHC-SF-A). Prior to participation, informed consent was obtained from all adolescent participants. For adolescent participants younger than 16 years old, informed consent was additionally obtained from their parents. In the informed consent, ethical and privacy issues were covered. Confidentiality, as well as anonymity, was ensured. Inclusion criteria were: Dutch-speaking and between the ages of 11 and 18 years old.
Measures
Mental Health Continuum-Short Form for Adolescents (MHC-SF-A)
The MHC-SF (Keyes et al.
2008) is a self-report questionnaire, measuring the emotional, psychological, and social components of well-being. The MHC-SF was translated and validated into Dutch for an adult target group by Lamers et al. (
2011). This questionnaire consists of 14 items representing various feelings of well-being. EWB was calculated by the sum score of items (1,2,3). SWB was calculated by the sum score of items (4–8). The PWB was calculated by the sum score of items (9–14). Respondents rated the frequency of every feeling in the past month on a 6-point Likert scale. An example of an item of the EWB-scale is: “During the past month, how often did you feel happy”. An example of an item of the PWB-scale is: “…you had warm and trusting relationships with others”. An example of an item of the SWB-scale is: “…you belonged to a community (like a social group, or your neighborhood)”. Internal reliability of this adult version is high (Cronbach’s
α of 0.74 to 0.89) and the test–retest reliability of the questionnaire varies from 0.49 to 0.65 (Lamers et al.
2011). The Dutch adult version of the MHC-SF (Lamers et al.
2011), was adapted by a psychologist to a target group of Dutch adolescents. Three 12-year-old adolescents were asked to evaluate all items of the Dutch adult version. The questionnaire items were revised upon reviewing the results of this preliminary pilot test. The items written in the courtesy form were replaced by the same items in the familiar form. Incomprehensible and difficult words in the items were adapted accordingly, resulting in the Mental Health Continuum-Short form for Adolescents (MHC-SF-A).The psychometric properties of the MHC-SF-A are discussed in the results section.
Kidscreen-52
Kidscreen-52 (Ravens-Sieberer et al.
2008) is a self-report questionnaire for preadolescents and adolescents aged 8–18 years old, measuring ten different dimensions of their perceptions of their health and well-being. The questionnaire consists of 52 items measuring 10 dimensions: physical well-being, psychological well-being, moods and emotions, self-perception, autonomy, relations with parents and home life, social support and peers, school environment, social acceptance, and financial resources. In this study the adolescent version was used. The items used a 5-point Likert scale to assess either the frequency of an attitude (never-seldom-sometimes-often-always) or certain behaviors/feelings. The total score for a scale was calculated using the sum score of the items belonging to that scale. An example of an item is: “Remember the past week. Have you had fun?”. The test–retest reliability of the questionnaire varies between 0.56 to 0.77. Cronbach’s
α (internal consistency) ranges from 0.76 to 0.89 (Ravens-Sieberer et al.
2008).
Global Self-worth
Global self-worth was assessed with a subscale of the Dutch version of the Harter’s Social Perception Profile for Children (SPPC) (Treffers et al.
2002). This subscale consists of five items. Two complementary propositions (negative versus positive) were offered simultaneously for each item. Each statement describes a group of young people (for example: “Some young people are quite satisfied with themselves” versus “Other young people feel that they are not so satisfied with themselves”). First, the respondents chose the group which they fit the best. Afterwards, they indicated whether the description was somewhat true or very true. Each item received a score between one and four. The score on self-worth was determined by the sum score of the five items. The value of Cronbach’s
α of the SPPC is greater than 0.70 for all scales, indicating an acceptable internal consistency (Treffers et al.
2002). A Dutch study has provided evidence for a high test–retest reliability (Pearson correlations of 0.67 to 0.87) and a good validity (Treffers et al.
2002).
The Strengths and Difficulties Questionnaire (SDQ)
SDQ (Muris et al.
2003) is a brief screening measure to identify the behavioral and emotional problems of adolescents. In this study the Dutch self-report version (Muris et al.
2003) was used. SDQ consists of 25 items measuring five scales, with four scales focusing on difficulties relating to behavior, emotional functioning, hyperactivity/inattention, interaction with peers, and one scale focusing on the strength of prosocial behavior. Each subscale consists of five items. There are three response categories (not true = 0, a little true = 1, certainly true = 2) resulting in a maximum score of 10 for each of the subscales, which are indicative of the magnitude of the problems on each domain. A total difficulty score was obtained by making the sum of all items of the four scales focusing on difficulties. This score indicates to what extent the adolescent suffers from socio-emotional problems. For each subscale, with the exception of prosocial behavior, higher scores reflect more problems. The internal consistency is acceptable for both the total score (Cronbach’s
α of 0.70) and for the subscales (Cronbach’s
α between 0.60 and 0.65) (Muris et al.
2003). Research has found a satisfactory test–retest reliability of the various scales. All subscales, except prosocial behavior (0.59), have correlation coefficients of 0.70 or more (Muris et al.
2003). An example of an item is: “I worry a lot”.
Adaptive and Maladaptive Emotion Regulation Strategies
The Dutch version of the FEEL-KJ (Cracco et al.
2015) is a 90-item self-report questionnaire to assess 15 emotion regulation strategies of adolescents in response to anxiety, sadness, and anger. For each of the emotions, an emotion regulation strategy is measured by two items. The emotion regulation strategies are subdivided into three categories: adaptive strategies (acceptance, problem-oriented action, cognitive problem solving, distraction, neglect, revaluation, and put into good humor), maladaptive strategies (giving up, aggressive action, withdrawal, self-devaluation, and perseveration) and external regulatory strategies. The items were scored on the basis of a five-point scale (from 1 = almost never to 5 = almost always). The total score for the adaptive and maladaptive strategies were calculated using the sum score of the items belonging to that secondary scale. An example of an item is “When I am sad, I think back to cheerful things”. The scales of the FEEL-KJ are reliable with a Cronbach’s
α of 0.87 (adaptive strategies) and 0.76 (maladaptive strategies) (Cracco et al.
2015). The internal consistency and conceptual validity are good (Cracco et al.
2015).
Data Analysis
The data was analyzed using SPSS 25.0 and R 3.4.3 (R Core Team
2019). Descriptive statistics of frequencies, means, and standard deviations were calculated for all subscales. To confirm the three-factor model as proposed by Keyes (
2002,
2005), confirmatory factor analyses (CFA), using the MHC-SF-A subscales at baseline, were performed. Three conceptional models were evaluated: a single-factor model with a unique measure of mental health, a two-factor model with one factor representing EWB and one factor representing PWB and SWB and a three-factor model (EWB, PWB, SWB) based on the hypothesis of this study. Maximum likelihood was used as estimation method. To assess the goodness of fit, the chi-square (
χ
2), comparative-fit-index (CFI), Tucker-Lewis index (TLI) and standardized root-mean-square residual (SRMR), Root Mean Square Error of Approximation (RMSEA), Akaike’s information criterion (AIC) and Bayesian information criterion (BIC) were calculated. CFI and TLI values above 0.90 (Kline
1998; Tabachnick and Fidell
2001),
χ
2/
df below 5 (Arbuckle
2016), RMSEA between 0.05 and 0.1 (Arbuckle
2016) and SRMR values below 0.09 (Hu and Bentler
1999) were considered to indicate an adequately parameterized model. The structure with the lowest AIC and BIC value would indicate a better fit (Akaike
1974; Stone
1979). Internal consistency was determined by Cronbach’s alpha coefficients. Values above 0.70 were considered as acceptable, and values above 0.80 as high (Kline
1998; Nunnally and Berstein
1995). The stability of the three subscales was examined by performing a regression analysis. For each subscale, a regression analysis with that subscale at follow-up as dependent variable and the three subscales at baseline as independent variables was performed. Only for this analysis, the sample was restricted to the completers (
N = 283).
Using baseline data, bivariate and partial correlations of the subscales of the MHC-SF-A with correspondent validation measures of well-being and psychopathology were performed to test for convergent validity. The partial correlations were controlled for the other MHC-SF-A subscales. Correlations around 0.20 were considered to be low, and around 0.50 to be moderately high (Nunnally and Berstein
1995).
In addition, in order to obtain evidence for the two-continua model, an exploratory and a confirmatory analysis were performed using the MHC-SF-A and SDQ subscales at baseline. To assess the sampling adequacy, a Kaiser-Meyer-Olkin (KMO) measure was conducted. A KMO measure was considered good when the value was between 0.7 and 0.8, and excellent when between 0.8 and 0.9 (Hutcheson and Sofroniou
1999). First, an exploratory factor analysis (EFA) at baseline was performed to reveal the number of factors with an eigenvalue greater than 1. Afterwards, to confirm the two-continua model, a confirmatory factor analyses (CFA) using maximum-likelihood estimation was performed. Two conceptual models were evaluated: a single-factor model with a unique measure of mental health where the absence of mental illness equaled the presence of mental health, and the two-continua model. To assess the goodness of fit, the chi-square (
χ
2), comparative-fit index (CFI) and standardized root-mean-square residual (SRMR), Root Mean Square Error of Approximation (RMSEA), Akaike’s information criterion (AIC) and Bayesian information criterion (BIC) were calculated. In all analyses, a significance level of 0.01 was applied, because of a large sample size.
Results
Table
2 and Table
3 summarize the descriptive statistics of the main study variables.
Table 2
Mean, SD of the main study variables of the sample at baseline (
n = 459)
|
M
|
SD
|
|
|---|---|---|
|
EWB of MHC-SF-A
|
3.75
|
0.91
|
|
PWB of MHC-SF-A
|
3.54
|
0.89
|
|
SWB of MHC-SF-A
|
3.02
|
0.89
|
|
Total well-being of MHC-SF-A
|
3.40
|
0.80
|
|
“Feelings” of Kidscreen-52
|
23.93
|
4.37
|
|
“Self-esteem” of SPPC
|
2.71
|
0.76
|
|
“School environment” of kidscreen-52
|
21.97
|
4.27
|
|
“Social Support and Peers” of kidscreen-52
|
23.78
|
3.94
|
|
“Parent relations” of kidscreen-52
|
25.85
|
3.96
|
|
Total score of SDQ
|
10.92
|
5.54
|
Table 3
Correlations between the main validation measures of the sample at baseline (
n = 459)
|
1
|
2
|
3
|
4
|
5
|
6
|
|
|---|---|---|---|---|---|---|
|
1. “Feelings” of Kidscreen-52
|
1
|
|||||
|
2. “Self-esteem” of SPPC
|
0.473*
|
1
|
||||
|
3. “School environment” of kidscreen-52
|
0.605*
|
0.329*
|
1
|
|||
|
4. “Social Support and Peers” of kidscreen-52
|
0.542*
|
0.260*
|
0.404*
|
1
|
||
|
5. “Parent relations” of kidscreen-52
|
0.583*
|
0.329*
|
0.488*
|
0.435*
|
1
|
|
|
6. Total score of SDQ
|
−0.566*
|
−0.373*
|
−0.525*
|
−0.328*
|
−0.440*
|
1
|
Structural Validity
Table
4 shows that the three-factor structure as proposed by Keyes (
2002,
2005) fitted the data better than the one-factor and the two-factor models. The three-factor structure had the lowest AIC and BIC values, the highest CFI and TLI values and was the only structure with a CFI above 0.9. None of the models indicated a poor fit for SRMR and
χ
2. Table
5 displays the standardized factor loadings for the three-factor model. In order to analyze internal consistency of the MHC-SF-A, the correlation between the score of the items and the corresponding scale were calculated. The factor loadings exceeded the minimum acceptable value of 0.30 (Nunnally and Bernstein
1995). The three factors EWB, PWB and SWB were interrelated. The highest correlation was between EWB and PWB with a magnitude of 0.872 The lowest correlation was between EWB and SWB of 0.745. The total variance explained by the factors (EWB, PWB, and SWB) is 59.17%
Table 4
CFA models of the latent structure of the MHC-SF-A
|
One-factor model
|
Two-factor model
|
Three-factor model
|
|
|---|---|---|---|
|
χ
2 (df)
|
434.28 (77)*
|
364.38 (76)*
|
322.93 (74)*
|
|
CFI
|
0.860
|
0.887
|
0.903
|
|
TLI
|
0.835
|
0.865
|
0.880
|
|
RMSEA
|
0.101
|
0.091
|
0.086
|
|
SRMR
|
0.065
|
0.060
|
0.061
|
|
AIC
|
18508
|
18441
|
18402
|
|
BIC
|
18623
|
18560
|
18530
|
Table 5
Standardized factor loadings for the three-factor model of MHC-SF-A
|
Theoretical dimension
|
EWB
|
PWB
|
SWB
|
|---|---|---|---|
|
Emotional well-being
|
1
|
0.872
|
0.745
|
|
01. Happiness
|
0.829
|
||
|
02. Interest
|
0.813
|
||
|
03. Life satisfaction
|
0.750
|
||
|
Psychological well-being
|
0.872
|
1
|
0.829
|
|
09. Self-acceptance
|
0.729
|
||
|
10. Mastery
|
0.595
|
||
|
11. Positive relations
|
0.652
|
||
|
12. Personal growth
|
0.475
|
||
|
13. Autonomy
|
0.619
|
||
|
14. Purpose in life
|
0.791
|
||
|
Social well-being
|
0.745
|
0.829
|
1
|
|
04. Soc. contribution
|
0.559
|
||
|
05. Soc. integration
|
0.427
|
||
|
06. Soc. actualization
|
0.656
|
||
|
07. Soc. acceptance
|
0.667
|
||
|
08. Soc. coherence
|
0.584
|
Reliability
The subscales of the MHC-SF-A yielded a high internal consistency. The EWB subscale had the highest internal consistency (
α = 0.84), the SWB subscale had the lowest (
α = 0.70). This is in line with our expectations.
The results of the crossover path analysis showed that each subscale consistently predicted the same subscale at follow-up (Table
6). The prospective association for PWB was largest, having a magnitude of 0.530. EWB had the lowest, having a magnitude of 0.445. The regression coefficients associated with direct paths (e.g., EWB at baseline predicting EWB at follow-up) were significant and moderate, suggesting that the MHC-SF-A is sufficiently stable over time, but also sensitive enough to change. Focusing on the cross-over paths (e.g., EWB at baseline predicting SWB at follow-up), each subscale was also positively related with the other two subscales at follow-up. For example, SWB predicted also EWB and PWB but with low magnitudes between 0.148 and 0.226. Comparing to the direct paths, cross-over paths had lower regression coefficients. These results are in conformity with the expectations of this study.
Table 6
Regression analysis of the MHC-SF-A subscales as predictors of MHC-SF-A at follow-up
|
Dependent variable
|
Predictor
|
B
|
|---|---|---|
|
EWB
|
EWB
|
0.445*
|
|
PWB
|
0.387*
|
|
|
SWB
|
0.003
|
|
|
PWB
|
EWB
|
0.267*
|
|
PWB
|
0.530*
|
|
|
SWB
|
0.058
|
|
|
SWB
|
EWB
|
0.148*
|
|
PWB
|
0.226*
|
|
|
SWB
|
0.472*
|
Convergent Validity
Table
7 shows the bivariate and partial correlations of the MHC-SF-A subscales with the validation measures. All bivariate correlations were statistically significant. Only significant partial correlations are mentioned. All significant partial correlations were low with a range between 0.119 and 0.399. Measures that focus on aspects of EWB, such as positive and negative emotions, showed the strongest partial correlations with the subscale EWB and also significant partial correlations with PWB. Measurements of individual functioning (e.g., self-esteem) and adolescents’ perceptions of the nature of their relationships with parents and peers showed the strongest significant partial and bivariate correlations with PWB. The subscale “school environment” showed a significant partial and bivariate correlation with the three subscales. These results are in conformity with the expectations of this study.
Table 7
MHC-SF-A
|
EWB
|
PWB
|
SWB
|
Total MHC-SF-A
|
|
|---|---|---|---|---|
|
“Feelings” of Kidscreen-52
|
0.679
*/0.399*
|
0.643/
0.281*
|
0.503*
|
0.676*
|
|
“Moods” of Kidscreen-52
|
−0.575*
/−0.337*
|
−0.547
*/−0.262*
|
−0.362*
|
−0.548*
|
|
“Self-esteem” of SPPC
|
0.305*
|
0.326*/
0.281*
|
0.220*
|
0.320*
|
|
“School environment” of kidscreen-52
|
0.486*/
0.175*
|
0.502*/
0.187*
|
0.450*/
0.128*
|
0.540*
|
|
“Social Support and Peers” of kidscreen-52
|
0.400*/
0.111*
|
0.455*
/0.218*
|
0.351*
|
0.457*
|
|
“Parent relations” of kidscreen-52
|
0.418*/
0.119*
|
0.487*/
0.296*
|
0.314*
|
0.462*
|
|
Total score of SDQ
|
−0.503*/
−0.201
|
−0.540*
/−0.268*
|
−0.397*
|
−0.542*
|
|
Maladaptive emotion regulation strategies of FEEL-KJ
|
−0.360*
|
−0.452
*/−0.294*
|
−0.279*
|
−0.417*
|
|
Adaptive emotion regulation strategies of FEEL-KJ
|
0.285*
|
0.348*/
0.136*
|
0.340*/
0.139*
|
0.374*
|
Discriminant Validity: Two-Continua Model
The EFA testing the two-continua model revealed two factors with an eigenvalue greater than 1. The KMO index was 0.756, indicating that the correlation matrix was adequate. These two factors explained 65.89% of the variance. Table
8 shows the factor loading of the subscales of the MHC-SF-A and the SDQ with the two factors mental health and mental illness. All subscales had the highest loading on the intended factor. Well-being and mental illness had a negative correlation of −0.29. Consecutively, a CFA was performed. Table
9 shows that the two-continua model was the model with the best fit. The two-continua model had the lowest AIC and BIC values, the highest CFI and TLI and a SRMR value below 0.9.
Table 8
MHC-SF-A and SDQ: Standardized factor loadings from EFA with two-factor oblimin rotation
|
Dependent variable
|
Mental health
|
Mental illness
|
|---|---|---|
|
MHC-SF-A
|
||
|
Emotional well-being
|
0.858
|
−0.282
|
|
Psychological well-being
|
0.897
|
−0.168
|
|
Social well-being
|
0.859
|
−0.292
|
|
SDQ
|
||
|
Conduct problems
|
−0.039
|
0.860
|
|
Hyperactivity/inattention
|
−0.354
|
0.682
|
|
Peer relationship problems
|
−0.455
|
0.534
|
Table 9
CFA models of the latent structure of the MHC-SF-A and the SDQ
|
One-factor
|
Two-continua model
|
|
|---|---|---|
|
χ
2 (df)
|
78.316 (9)*
|
54.470 (8)*
|
|
CFI
|
0.913
|
0.942
|
|
TLI
|
0.856
|
0.891
|
|
RMSEA
|
0.131
|
0.114
|
|
SRMR
|
0.079
|
0.066
|
|
AIC
|
8208
|
8187
|
|
BIC
|
8258
|
8240
|
Discussion
The present study investigated the factor structure, evaluated the psychometric properties of the MHC-SF-A and tested for the presence of two-continua of mental health, in a sample of Dutch adolescents between the ages of 11 and 18 years old. Evidence of construct validity was found for a three-factor structure as proposed by Keyes (
2002,
2005). The data confirmed the theoretically based classification of the 14 items of the MHC-SF-A in the three subscales: EWB, PWB, and SWB. In previous studies, the same structure has been found in adult samples from the Netherlands, South Africa, Italy and the USA (Keyes et al.
2008; Lamers et al.
2011; Salama-Younes, and Ismaïl
2011; Petrillo et al.
2015) and adolescent samples from different Asian countries (Lim
2014; Guo et al.
2015). Based on these findings and the measurement invariance of the MHC-SF across cultural groups (Joshanloo et al.
2013), it can be expected that the MHC-SF could not only be used worldwide in adult samples but also in adolescent samples to measure well-being, which would enable comparisons of well-being between different cultures and different ages. Moreover, the instrument comprehensively measures well-being across emotional, psychological, and social domains. In accordance to other studies, the EWB, PWB, and SWB subscales were highly interrelated. This suggests that interventions that foster one dimension (e.g., EWB), may indirectly also foster the other two dimensions.
In addition to its structure, this study evaluated further psychometric properties of the MHC-SF-A. The internal consistencies of the subscales EWB, PWB were high, and for SWB adequate. The lower, but still acceptable, internal consistency of SWB was also found in other studies (Keyes et al.
2008; Lamers et al.
2011; Salama-Younes and Ismaïl
2011; Petrillo et al.
2015). Compared to the items of EWB and PWB, the items of SWB rely more on an individual’s own perceptions of abstract concepts (e.g., society), which makes measuring SWB more challenging. In addition, the evaluation of the test–retest reliability suggests that the MHC-SF-A is sufficiently stable over time, but also sensitive to changes. The present study also demonstrates convergent validity of the MHC-SF-A. Measures of individual functioning such as self-esteem, showed a small partial correlation with PWB. These findings are in line with previous research (Lamers et al.
2011). The low correlation might be explained by the fact that self-acceptance, an aspect of PWB, which places emphasis on acceptance of the self and of one’s past life (Ryff
1989), is not entirely representative of self-esteem which focuses on a positive self-judgement (Rosenberg
1965). Also all significant partial correlations were low. This might be due to the fact that the validation measures are only representative for an aspect of the subscales of the MHC-SF-A. In summary, the evaluation of the psychometric properties of the MHC-SF-A indicates that this measuring instrument is a reliable and valid instrument to measure well-being among Dutch adolescents.
Looking more closely at the correlations of the three subscales EWB, PWB and SWB and the other measures (i.e., positive emotions), a number of findings stood out. Measures such as positive emotions, an aspect of EWB, were not only associated with EWB but also with PWB. This finding is in line with previous research (Morrish et al.
2018). Positive emotions are important in building psychological, social and physical resources and can broaden the thought and action repertoire and promote social connections with others (Fredrickson
2001; Morrish et al.
2018). For each MHC-SF-A subscale, correlations were consistently highest with the validation measure positive emotions, suggesting that interventions aimed at fostering well-being may consider positive emotions as the primary intervention target.
Besides positive emotions, school environment appears to play an important role in adolescents’ psychological life. The subscale “School environment” of the kidscreen-52 was associated with all three MHC-SF-A subscales. The way adolescents evaluate and experience their school life, has been shown to affect their EWB (Morrish et al.
2018). The subscale “School environment” partly measures feelings about school and therefore also matches EWB, which is about feelings in general. High adolescents’ school-related EWB has several benefits such as increased academic functioning, increased self-efficacy and better school behavior (Aldao et al.
2010). Also, being involved in school activities offers opportunities for adolescents to explore social roles and thus enhance SWB (Salama-Younes, and Ismaïl
2011). This might explain why the subscale School environment is additionally associated with PWB and with SWB. In summary, the way an adolescent experiences their school life has a strong influence on the adolescent’s well-being. This underlines the importance of school-related well-being and the role that schools can play in the adolescent’s global well-being. Interventions targeting well-being have the potential of reaching a large group of adolescents varying in background and socio-economic status in a cost-effective way. Schools can be seen as settings to promote well-being, a notion supported by the observation that measures of school environment correlate more strongly with all the well-being subscales of the MHC-SF-A than measures of social relationships.
Two main domains of social relationships that have been investigated in this study are parent–adolescent relationships and relationships with peers. Peer relationships play a role in the development of social skills that are necessary for personal growth and social adjustment (Greca, and Lopez
1998). This might explain why the subscale “Social Support and Peers” of the kidscreen-52 is associated with PWB. Besides relationships with peers, the quality of the parent–adolescent relationship has been measured. Although during adolescence the focus of adolescents’ relationships gradually shifts from the family to peers (Brown
2004), the quality of the parent–adolescent relationship remains an important determinant of self-esteem (Arbona, and Power
2003). This might explain why the nature of the relationship with parents is associated with PWB. Apart from associations with PWB, the quality of parent relationships and relationships with peers were also linked to EWB. Positive emotions, an aspect of EWB, promote social connections with others in general (Morrish et al.
2018). Comparing to non-family factors, family factors are more important in explaining the variations in adolescents’ life satisfaction and thus also in EWB (Gray et al.
2013).
Generally, a crucial skill for building and maintaining positive relationships is having adaptive emotion regulation strategies (Morrish et al.
2018). These strategies are associated with greater peer acceptance and bolster social competence (Morrish et al.
2018). This might explain the correlation of adaptive emotion regulation strategies with PWB and SWB. In contrast to adaptive emotion regulation strategies, maladaptive emotion regulation strategies only have partial correlation with PWB. Adolescents with low self-regulation, evoke negative social interaction which in turn can contribute to the development of psychopathology (Morrish et al.
2018). Various studies have confirmed the two-continua model in non-clinical populations. Evidence of the two-continua model was found in adult samples from the Netherlands, South Africa, Italy and the U.S. (Keyes et al.
2008; Lamers et al.
2011; Petrillo et al.
2015) and in U.S. adolescent samples (Keyes
2006; Greenspoon and Saklofske
2001).
The present study also confirmed the two-continua model in a Dutch adolescent sample. Well-being and mental illness are distinct indicators and have a moderately high negative correlation. This has implications for mental health interventions and treatment. The absence of psychopathology does not necessarily imply well-being. Psychological interventions for promoting well-being are useful and have an additional value to approaches that focus on treatment of mental problems. Interventions aimed at adolescents that solely focus on mental illness will not necessarily result in mentally healthier adolescents. Additionally, as well-being and mental illness are considered as continua of mental health, both measures of well-being and mental illness are needed to accurately predict therapy outcomes (de Cates et al.
2015; Thornicroft and Slade
2014). Nevertheless, it remains unclear whether the two-continua model will be confirmed in clinical populations. In clinical populations, well-being and mental illness are much more strongly entwined than in general populations (Erp Taalman and Hutschemaekers
2018).
The study has several strengths. A large research sample was recruited through secondary schools and covered different regions of the Netherlands. On top of that, the adolescents completed a large online questionnaire at baseline and at a 4-week follow-up. By doing so, the research could show prospective associations with well-being and other measurements of individual functioning (e.g., self-esteem). Nevertheless, the limitations of this study should be noted. First, to evaluate the psychometric properties of the MHC-SF-A self-report measures were the only form of assessment. In order to minimize the response biases, it would be useful to utilize a multi-modal approach in future research, e.g., to use observations or interviews in conjunction with self-report measures (Paulhus, and Vazire
2007). Secondly, the assessment of convergent validity of SWB is the weaker part of the study. Validated scales measuring SWB in Dutch adolescents are not yet available. The third limitation concerns the generalizability of the results. The sample of Dutch adolescents was obtained by means of convenience sampling. Although efforts were made to collect a representative sample, boys were relatively underrepresented in our study (38.2% vs. 50% at the population level, CBS
2020). However, compared to the Dutch population (CBS
2020), the sample was representative in terms of educational level and migration background. This study possibly involved an oversampling of mentally healthy adolescents. Future studies should address whether these effects hold for adolescents who score high on psychopathology.
Conclusion
The data supported the use of MHC-SF-A in a sample of Dutch adolescents. The MHC-SF-A is a reliable and valid instrument to measure well-being among Dutch adolescents. In line with findings in other populations, mental illness and well-being also represent two related but distinct continua of mental health in Dutch adolescents. Therefore, mental health programs for adolescents should focus both on maintaining or promoting well-being in addition to the prevention of mental illness. Measures of well-being, like the MHC-SF-A, and mental illness are needed to accurately predict therapy or intervention outcomes in adolescent populations. Our findings suggest that promoting positive emotions, creating a supportive and loving parent–adolescent relationship, and a supportive school environment will ultimately contribute to adolescents’ mental health.
Compliance with Ethical Standards
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee (include name of committee + reference number) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
At the start of the study, informed consents were obtained from adolescent participants and the parents of the adolescent participants up under 16 years old. In the informed consent, ethical and privacy issues were covered. Confidentiality as well as anonymity was ensured.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit
http://creativecommons.org/licenses/by/4.0/.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.