https://orcid.org/0000-0001-9954-2480
Figures
Abstract
Introduction
Technologies provide a brilliant opportunity to promote social-emotional competences, well-being and adjustment in adolescence. Game-based programmes and serious games are digital tools that pursue an educational goal in an attractive environment for adolescents. The purpose of this study was therefore to determine the effectiveness of emoTIC, a game-based social-emotional programme designed according to Mayer, Caruso, and Salovey’s model of emotional intelligence.
Materials and methods
The participants were 119 adolescents between 11 and 15 years, randomly assigned to the experimental group and the control group. The adolescents completed questionnaires to assess their emotional intelligence, self-esteem, affect balance, difficulties, prosocial behaviour, depression, anxiety and stress.
Results
The MANCOVA results showed that adolescents who completed the game-based programme had improved self-esteem, affect balance, emotional symptoms, behavioural problems, and hyperactivity (Wilks’ λ = .77; F = 2.10; p = .035). Hierarchical multiple regression indicated that adolescents in the experimental group had a greater change in self-esteem and affect balance (positive β), while their emotional problems and hyperactivity decreased (negative β). Anxiety moderated the influence of the intervention on self-esteem (b = .04; t = -2.55; p ≤ .05; LLCI = -0.43, ULCI = -0.05). Adolescents with low or medium anxiety improved their self-esteem with the intervention, while those with high anxiety did not develop it.
Citation: de la Barrera U, Mónaco E, Postigo-Zegarra S, Gil-Gómez J-A, Montoya-Castilla I (2021) EmoTIC: Impact of a game-based social-emotional programme on adolescents. PLoS ONE 16(4): e0250384. https://doi.org/10.1371/journal.pone.0250384
Editor: Eduardo Fonseca-Pedrero, University of La Rioja, SPAIN
Received: December 9, 2020; Accepted: April 6, 2021; Published: April 16, 2021
Copyright: © 2021 de la Barrera et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: Funding. The research was supported by grants from the Spanish Ministry of Science, Innovation and Universities (PSI2017-84005-R), the State Agency of Research and the European Regional Development Fund (FEDER) from the European Union; as well as a research fellowship granted by the Regional Government of Valencia and the European Social Fund (ACIF/2018/033). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Game-based learning and serious games for adolescents
The last two decades have seen the rapid ascent of computing technology to change health behaviour and well-being [1]. As today’s adolescents are strongly attracted to and familiar with the use of technologies, these are a brilliant opportunity to promote learning and well-being in this stage of development [2]. In addition to technologies, gamification to turn intervention programmes into digital games is considered a good way to intrinsically motivate adolescents to engage with their use [3]. Games are systems purpose-built for motivation through their capacity for enjoyment [4] as positive emotions may facilitate learning and contribute to academic achievement [5]. Digital game-based learning refers to using the entertaining power of digital games for an educational purpose, using a balance between learning and gaming elements [6]. Serious games are digital tools to facilitate skills or knowledge acquisition in an entertaining environment, and integrate both pedagogical theories and the motivational principles of game design in pursuit of an educational goal [7–10].
Emotional intelligence, self-esteem and social-emotional intervention programmes in adolescents
Adolescence is a complex stage of the life development with numerous emotional, social and physical changes that may have a negative impact on health [11]. Mood disorders such as depression or anxiety have a high risk of emerging and developing during this stage [12, 13]. Promoting strengths during adolescence is critical because adolescence is a sensitive period of brain development [14]. Emotional intelligence and self-esteem are two of the most important strengths studied in the social-emotional sphere. Emotional intelligence is conceptualised as a set of skills related to the perception, expression, and regulation of one’s own or others’ emotions as well as the use of those skills to achieve goals in life [15]. Self-esteem is considered as a favourable or unfavourable attitude that people have about themselves. During adolescence, both are positively associated with subjective well-being [16]. Concretely, individuals who perceive, know, and manage their emotions might deal better with emotional issues, and experience greater well-being [17]. Likewise, adolescents are particularly sensitive to the appearance of symptoms of emotional instability [18] and emotional competences and self-esteem are inversely related to emotional symptoms, behavioural problems, and peer conflicts [19, 20]. Specifically, adolescents who pay more attention to their emotional states combined with low emotional regulation and unfavourable attitude about themselves, experience more emotional symptoms. In the same way, adolescents with a poor emotional regulation and unfavourable attitude about themselves present more behavioural problems [16]. Education in social-emotional competences can therefore prevent the development of emotional and behavioural problems in adolescence [21, 22].
Social-emotional education is considered as important as the contents of the academic curriculum and school environments seem to be the most appropriate contexts in which to develop it [23]. Numerous programmes to improve social-emotional skills have been carried out in high schools with positive results [24–26]. Systematic reviews demonstrated the effectiveness of these programmes, most notably for improving emotional intelligence [27]. These programmes also have indirect positive consequences for the well-being and the peer relationships of their users [20, 28]. Although the benefits of intervention programmes in emotional education are evident, motivating adolescents through participation is a crucial challenge and games can be an effective educational tool to this purpose [29].
Serious games and game-based social-emotional intervention programmes for adolescents
The existing literature has shown the effectiveness of digital game-based learning [30, 31]. Educational programmes for adolescents have been carried out using technologies to reduce school violence [32], prevent suicide [33], and encourage non-sexist attitudes [34], among other variables. The development of emotional intelligence carried out using technologies could be more attractive and useful for adolescents, and their commitment to the programme would increase [35, 36]. However, there is a gap of interventions that combine technologies and gamification to enhance adolescent social-emotional learning.
Few studies have evaluated the effectiveness of programmes to develop social-emotional competences in adolescents implemented using technologies. In the USA, Kahn et al. [37] designed the virtual game RAGE-control in order to improve emotional control for patients of the inpatient psychiatric service at Boston Children’s Hospital. The aim was to teach children and adolescents aged between 9 and 17 years to focus their attention and control their physiological arousal using relaxation and biofeedback techniques. In Thailand, Iaosanurak et al. [36] tested an intervention with elementary school-aged children to promote social-emotional learning based on technology. The intervention was effective in increasing emotional self-control. In Romania, David et al. [38] designed the online video game REThink, applied to coaching emotional understanding in adolescents aged between 10 and 16 years old. Their study aimed to evaluate the effectiveness of Feeling Better, a mini video which was game part of REThink, to teach children and adolescents to distinguish between functional and dysfunctional emotions. The participants’ ability to correctly identify and collect functional emotions increased after three trials of playing. In Spain, Cejudo et al. [39] developed the video game Spock, which provides training in emotional intelligence in adolescents aged 17 and 18 years old. The video game was effective in increasing emotional intelligence, adaptive skills and personal adjustment, and in reducing behavioural symptoms and externalizing problems. Another programme which has recently promoted social-emotional using Immersive Virtual Reality as a didactical tool was developed by Herrero and Lorenzo [40]. The results show a positive impact on the competences in children and adolescents from 8 to 15 years with autism spectrum disorders (ASD).
Although these social-emotional programmes showed their efficacy, there are several limitations. Some studies focused on non-healthy adolescents with mental disorders [37, 40], others included only older adolescents or young adults [39, 41], while others lacked a control group [36, 38] or evaluated the effectiveness of only one part of the intervention programme [38]. Likewise, none of the studies mentioned above discussed possible moderators of programmes’ effectiveness, such as demographic variables [42].
The current study
These previous studies therefore reveal the need to develop social-emotional programmes involving technologies and test their effectiveness with healthy children and adolescents in the school context. As a result, the aim of the present study was to analyse the effectiveness of emoTIC, a game-based social-emotional programme for adolescents. The hypotheses were: (1) the programme will develop emotional intelligence and self-esteem; (2) the programme will have a positive effect on affect balance, emotional symptoms, behavioural problems, peer relationship problems, hyperactivity, and prosocial behaviour; (3) the demographic factors (gender and age) and affective symptoms (depression, anxiety, and stress) will moderate the effectiveness of the programme.
Materials and methods
Participants
Initially, the participants were 356 adolescents of which 70 were eliminated due to exclusion criteria (Fig 1). The adolescents were randomized to an intervention group (n = 119) and a waiting list group (n = 167). Randomization was performed two weeks before the intervention programme commenced by a simple coin flip carried out by an external member of the research team. A total of 119 adolescents started the programme and 34 of them completed at least 3 sessions and post-test, while 167 did not received the intervention and 85 of them completed post-test. Finally, the participants were 119 adolescents aged between 11 and 15 years (M = 12.57 years; SD = 0.67; 42.9% girls). The adolescents were students from public and private high schools in Madrid (Spain). Approximately, 94% were of Spanish nationality and 6% were from other countries (Peru, Venezuela, Romania, and Equatorial Guinea), who had lived in Spain for between 2 and 12 years (M = 7.43; SD = 4.50). As regards their families, 94.1% reported that their nuclear family was composed of a mother and father, while 5.9% had a single-parent family. Adolescents born in other countries do not differ in emotional, social, personal, and family variables from adolescents born in Spain (p > .05; d < 0.45). As regards sexual orientation, 90.80% of adolescents were heterosexual, 0.80% were homosexual, 2.50% were bisexual and 5.90% were not sure about her or his sexual orientation. The inclusion criteria were to be enrolled in the first or second year of compulsory secondary education at a Spanish school, to have a mobile device, and to have informed consent signed by the parents. The exclusion criteria were being under 11 years old or over 16 years old and not complete at least 80% of the pre-test.
Instruments
Sociodemographic variables.
Gender, age, nationality, years in Spain, family type, and sexual orientation of the participants were assessed using ad hoc questions.
Emotional intelligence.
Emotional intelligence is operationalised through emotional attention, emotional clarity, and emotional regulation. Emotional attention is the ability to feel and express feelings properly, emotional clarity is the ability to understand the own emotional states, and emotional repair is the capability to regulate emotional states properly. The Spanish version of the Trait Meta-Mood Scale-24 (TMMS-24) [43] validated in Spanish adolescents by Pedrosa et al. [44] was used. The instrument consists of 24 items, and the adolescents answer using a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). The scale is divided into three factors: attention (e.g., “I often think about my feelings”), clarity (e.g., “I almost always know exactly how I am feeling”), and repair (e.g., “If I find myself getting mad, I try to calm myself down”). The psychometric properties of the instrument were adequate in previous studies conducted with Spanish adolescents (α = .83 in the three dimensions) [45], as well as in this study (α between .81 and .83).
Self-esteem.
From the one-dimensional perspective, self-esteem is considered a favourable or unfavourable attitude that adolescents have about themselves. The Rosenberg Self-esteem Scale (RSE) [46] was used. This instrument consists of 10 items (e.g., “I take a positive attitude toward myself”), scored on a 4-point Likert scale (1 = strongly disagree, 4 = strongly agree). Previous studies with Spanish adolescents showed adequate psychometric properties of the instrument (α = .87) [47]. The reliability index in our sample was adequate (α = .82).
Affect balance.
The affective balance is the affective dimension of subjective well-being and it is operationalised through positive and negative affect experimented during the last month. It is the result of subtracting negative feelings score from the positive feelings score. The Scale of Positive and Negative Experiences (SPANE) [48] validated in Spanish adolescents [49] was used. The instrument is composed of 12 items with a 5-point Likert scale (1 = very rarely or never, 5 = very often or always), and the adolescents report how often they have experienced positive and negative affect during the last month. The scale is distributed into two factors: positive feelings (e.g., pleasant, joyful or good feelings) and negative feelings (e.g., unpleasant, afraid or bad feelings). The psychometric properties of the instrument were adequate in previous studies conducted with Spanish adolescents [50], as well as in this study (α between .81 and .87).
Emotional, behavioural and peer difficulties and prosocial behaviour.
Emotional symptoms include having many worries, unhappiness, and many fears. Conduct problems include having hot tempers, fighting with other children, and lying. Peer problems include tends to play alone, bullied by others, and getting on better with adults than with other children. Hyperactivity includes being overactive, constantly fidgeting and easily distracted. Prosocial behaviour includes sharing with others, helping if someone is hurt or upset, and being kind with to younger children. The Strengths and Difficulties Questionnaire (SDQ) [51] validated in Spanish adolescents [52] was used to evaluate different emotional and behavioural problems and prosocial capacities related to mental health in adolescents. The scale is composed of 25 items, and the response format is a 3-point Likert scale (0 = not true, 2 = certainly true). The instrument is distributed in five subscales: (1) emotional symptoms (e.g., “I have many fears, I am easily scared”); (2) Conduct problems (e.g., “I take things that are not mine from home, school or elsewhere”); (3) Peer problems (e.g., “I am usually on my own. I generally play alone or keep to myself”); (4) Hyperactivity (e.g., “I am restless, I cannot stay still for long”); and (5) Prosocial behaviour (e.g. “I usually share with others (food, games, pens, etc.)”). The psychometric properties in previous studies conducted with Spanish adolescents were adequate (α between .72 and .87) [47], and studies suggest that the instrument may be an adequate tool for the screening of emotional and behavioural difficulties during adolescence [52]. The reliability index in the present study was sufficient (α between .50 and .68).
Depression, anxiety, and stress.
Depression includes dysphoria, hopelessness, devaluation of life, self-deprecation, lack of interest, anhedonia, and inertia. Anxiety assesses autonomic arousal, skeletal muscle effects, situational anxiety, and subjective experience of anxious affect. Stress assesses difficulty relaxing, nervous arousal, and being easily upset, irritable and impatient. The Depression, Anxiety, and Stress Scales (DASS-21) [53] Spanish adaptation [54] was used to assess the affective symptoms during the previous week. The scale is composed of 21 items with a 4-point Likert scale (0 = never, 3 = almost always). The instrument evaluates three subscales: depression (e.g., “I was unable to become enthusiastic about anything”), anxiety (e.g., “I felt scared without any good reason”), and stress (e.g. “I found it difficult to relax”). Previous studies indicated adequate psychometric properties in Spanish samples (α between .73 and .81) [55], as well as in the present study (α between .73 and .80).
Intervention programme
The game-based programme called emoTIC focuses on developing social-emotional competences in adolescents (Tables 1 and 2). Studies suggest that positive emotions may facilitate learning and contribute to academic achievement [5]. For that reason, the programme was designed as a space adventure, and the adolescents had to rebuild a spaceship to return to Earth. The digital application could be used on a smartphone or tablet, and is available for iOS and Android. EmoTIC is based on the ability model of emotional intelligence developed by Mayer and Salovey [56, 57]. According to the model, emotional intelligence is explained by four hierarchical components: (1) perception, evaluation, and expression of emotion; (2) emotion as a thought facilitator; (3) understanding emotions; and (4) management of emotions. In addition to emotional intelligence, self-esteem, group cohesion, and positive classroom climate were enhanced across the board. The programme consists of four classroom group sessions and twelve individual home activities. Each of the classroom group sessions followed the same structure. First, each adolescent performed an emotional self-examination to detect how he or she was feeling and shared it with the group. Second, a group dynamic was carried out according to the topic of the session (Table 2), followed by a discussion and group reflection. Finally, a summary of the session was made by the teacher. As regards individual home activities, adolescents completed three activities per area. Of the three activities, the first one was dedicated to the acquisition of basic concepts, the second one focused on the improvement of self-knowledge, and the last one tested their skills. A previous mixed model study (qualitative and quantitative) showed that adolescents who used emoTIC, perceived to have improved their emotional competences, social skills, and personal strengths [58].
Procedure
The study was approved by the Ethics Commission of the University of Valencia (H152865096049), and we followed the standards of the Declaration of Helsinki to collect the data. Convenience sampling method was used to recruit participants. First, the principal investigator contacted the school principals and explained the objectives of the research. The parents who agreed to have their children participate signed the informed consent. The adolescents were randomized to an experimental group and a control group. The teachers completed a training course to learn about using emoTIC and implemented the intervention programme in their tutorial classes. The experimental group and the control group were initially evaluated. First, socio-demographic data were collected and each student provided a random participation code. To avoid fatigue and the development of negative feelings, questionnaires assessing negative variables (e.g., depression, anxiety and stress symptoms) were alternated with those assessing positive variables (e.g., life satisfaction). The duration of the assessment of adolescents did not exceed 50 minutes. The experimental group then carried out the programme during four weeks, while the control group continued with the usual tutorial classes. The intervention programme was conducted using a smartphone or tablet. After the implementation of the programme, both groups were evaluated again.
Data analysis
First, the effectiveness of the programme was analysed by a multivariate analysis of variance (MANOVA) and a multivariate analysis of covariance (MANCOVA) using SPSS version 23. The MANOVA was performed to identify possible differences at T1 between the control group and the experimental group. The MANCOVA was performed in order to identify changes at T2, controlling for T1 scores (covariable). Power analysis were performed using G*Power 3.1.9.7. [59]. Second, multiple hierarchical regression analyses were carried out to examine the impact of the intervention programme. The dependent variables were the change in emotional intelligence, self-esteem, affect balance, difficulties, and prosocial behaviour between T1 and T2. In the first step, the T1 score (control variable) was introduced in the model. The independent variable entered in the second step was the experimental condition (0 = control group; 1 = experimental group). Third, the reliable change index (RCI) was calculated. The RCI evaluates the reliable change by means of a variation of the standard error (SE) in the measurement which takes the pre-intervention and post-intervention evaluations into account. The change presented by an adolescent that is outside the range which could be attributed to the variability in measurement is considered the reliable change. Chi-square tests were performed. Finally, the moderating effects of gender, age, depression, anxiety and stress were tested using the PROCESS Macro for SPSS. The change from T1 to T2 in emotional intelligence, self-esteem, affect balance, difficulties, and prosocial behaviour were the dependent variables. The independent variable was the experimental condition.
Results
The chi-square results indicated no statistically significant differences between the experimental group and the control group for gender (χ2 = 2.15; p = .143), age (χ2 = 6.71; p = .152), sexual orientation (χ2 = 6.71; p = .082), and family type (χ2 = 2.11; p = .716).
MANOVA and MANCOVA
The results showed no statistically significant differences between the experimental group and the control group in the first evaluation (Wilks’ lambda, λ = .96, F = 0.48, p = .900; η2 p = .05). Both groups could therefore be considered comparable because they present similar baseline levels (Table 3). The MANCOVA results showed statistically significant differences between experimental group and control group after the implementation of the programme (Wilks’ λ = .77; F = 2.10; p = .035; η2p = .22). Adolescents who participated in the programme showed more self-esteem and affect balance, and fewer emotional symptoms, behavioural problems, and hyperactivity than adolescents in the control group. The effect size on emotional intelligence, affect balance, peer and behavioural problems, hyperactivity, and prosocial behaviour ranges between η2p = .01 and η2p = .06; while the effect on self-esteem and emotional symptoms ranges between η2p = .12 and η2p = .15. Power analyses reveal that emotional intelligence and peer problems showed between 19% and 48% of statistical power; behavioural problems and hyperactivity showed between 70% and 78%; and self-esteem, emotional symptoms, and affective balance exceed 80% of statistical power (1-β).
Hierarchical multiple regression
The results of the first step in the hierarchical regression showed that the baseline levels of the adolescents influence changes in emotional intelligence, self-esteem, hedonic balance, prosocial behaviour, and total difficulties (Table 4). In other words, the higher the baseline scores, the less change (negative β). The second step showed that the experimental condition predicts change by controlling the baseline level of variables. The higher the condition (1>0), the greater the change from T1 to T2 (positive regression coefficient). In specific terms, the results indicated that adolescents in the experimental group had a greater change in self-esteem and affect balance (positive β), while their emotional problems and hyperactivity decreased (negative β).
Reliable change index
The results show that the experimental group presented consistently higher or equal percentages of positive change and lower percentages of negative change than the control group (Table 5). The chi-square test show that only in behavioural problems the experimental group and the control group are statistically different (χ2 = 3.98; p≤.05).
Moderating effects of gender, age, depression, anxiety, and stress
The moderating effects of gender, age, depression, anxiety, and stress on the impact of the intervention were tested (Table 6). Analyses indicate that anxiety moderated the influence of the intervention on self-esteem. Adolescents with low anxiety (b = 5.69; t = 4.09; p≤.001; LLCI = 2.93; ULCI = 8.46) and medium anxiety (b = 3.62; t = 3.71; p≤.001; LLCI = 1.68; ULCI = 5.56) improved their self-esteem with the intervention, while adolescents with high anxiety did not improve it.
Discussion
The purpose of this study was to analyse the effectiveness of a game-based social-emotional programme on adolescents called emoTIC. Based on previous research related to social-emotional intervention programmes, our first hypothesis was that adolescents who participated in the game-based programme were expected to improve their emotional intelligence and self-esteem compared to a control group. The present study showed that emoTIC is effective to improve adolescents’ self-esteem, but not clearly their emotional intelligence. These results are partially in line with previous studies [27].
On the one hand, high emotional intelligence is composed of high clarity and repair as well as moderate attention [60]. Although attention tends to decline while clarity and repair tend to increase in the experimental group, the results of our study showed no statistically significant development. A previous mixed-model study evidenced that adolescents perceived an improvement of their emotional competences using emoTIC [58]. However, the improvement of emotional competences cannot be confirmed by the results of the present study. One possible explanation may be related to the measurement instrument used. Previous studies suggest that the instrument might not capture the changes with adequate sensitivity [61, 62].
On the other hand, the hypothesis is confirmed with respect to self-esteem. The adolescents who participated in the intervention programme increased their self-esteem; it means they improved their attitude towards themselves. Self-esteem is considered to be more of a dynamic rather than a static construct [63], and may therefore be incorporated into social-emotional programmes.
As for the second hypothesis, the adolescents who participated in the programme were expected to experience a positive effect on affect balance, emotional symptoms, behavioural problems, peer relationship problems, and hyperactivity [28, 39]. In overall terms, the results of the study support the hypothesis, and suggest that emoTIC may be an effective programme for preventing the increase of emotional, behavioural, and relational problems. The adolescents who completed the programme showed higher levels of affect balance and lower levels of emotional symptoms, behavioural problems, and hyperactivity compared with the control group. The activities carried out during the programme invited the adolescents to focus on positive aspects of their lives and to reflect on their emotions, which may have influenced their hedonic balance and emotional symptoms. Moreover, the dynamism of the group sessions, combined with the use of smartphones, may have helped the adolescents to focus their attention on activities and enabled positive interaction with their peers, which may have influenced their hyperactivity, and their peer and behavioural problems.
Finally, previous studies suggest that demographic factors and affective symptoms may moderate the effect of the intervention programmes [42]. The third hypothesis therefore tested a model of moderation with gender, age, depression, anxiety, and stress as the moderating variables. The results obtained suggest that anxiety may moderate the effectiveness of the programme in improving self-esteem. Adolescents with low or medium anxiety benefited from the programme, while adolescents with high anxiety did not improve their self-esteem. It should therefore be noted that these adolescents may not fully benefit from emoTIC. Knowledge about the potential moderators of the programme effectiveness is essential for increasing the effectiveness of future intervention programmes [42].
This research has several strengths. The effectiveness of an intervention programme implemented through technologies to develop social-emotional competences has been assessed in adolescents. Triangulation of the data was performed using MANCOVA, multiple regression analysis and RCI to determine the effectiveness of emoTIC. The moderating effects were also tested. Despite its strengths, the present study has some limitations. First, only self-report measures were included, and it would be advisable to introduce performance measures for the assessment of emotional competences. Second, it would be useful to include an additional measure to determine the effects of the programme in the long term. Third, some potential covariables (e.g. IQ, socio-economic status, previous or history of mental disorders) were not taken into account should be assessed in future research. Four, a random sampling method should have been used instead of non-probability sampling such as convenience sampling. Likewise, the sample size should be increased in future research.
In conclusion, this study examines emoTIC, a game-based social-emotional programme that influences personal, emotional, and social factors during adolescence. Specifically, emoTIC improve self-esteem, an essential moderator of the relationship between emotional and behavioural problems, and suicidal behaviour. Adolescents with emotional and behavioural difficulties show lower risk of committing suicidal behaviours when they have high self-esteem [47]. This game-based programme may therefore protect adolescents’ mental health. In the same way, affect balance, the affective dimension of subjective well-being [48], may be enhanced by emoTIC. Finally, this game-based programme may decrease emotional symptoms, behavioural problems and hyperactivity of adolescents. During this developmental stage, adolescents are sensitive to the emerging of emotional instability symptoms [18], and programmes such as emoTIC can provide adolescents with skills to manage their own emotional states. This programme has a double impact. On the one hand, the intervention programme enhances strengths that protect adolescents’ development. On the other hand, it reduces risk factors that can lead to the emergence of mental health problems. With regard to the implementation, the development of emotional intelligence by means of technologies could be more attractive and useful for adolescents, and could increase their commitment to the programme [35, 36]. Moreover, the approach of emoTIC as a game adventure may generate positive and pleasant emotions in adolescents, which may facilitate learning and contribute to academic achievement [5]. Using technology in the development of social-emotional programmes could be the first step towards increasing interest in emotions in adolescents.
References
- 1. Johnson D, Deterding S, Kuhn KA, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: A systematic review of the literature. Internet Interv. 2016;6:89–106. pmid:30135818
- 2. Pbert L, Druker S, Crawford S, Frisard C, Trivedi M, Osganian SK, et al. Feasibility of a Smartphone App with Mindfulness Training for Adolescent Smoking Cessation: Craving to Quit (C2Q)-Teen. Mindfulness. 2020;11:720–33. pmid:33343761
- 3. Wouters P, van Nimwegen C, van Oostendorp H, van Der Spek ED. A meta-analysis of the cognitive and motivational effects of serious games. J Educ Psychol. 2013;105(2):249–65.
- 4. Deterding S. The lens of intrinsic skill atoms: A method for gameful design. Human-Computer Interact. 2015;30:294–335.
- 5. Um E, Plass JL, Hayward EO, Homer BD. Emotional design in multimedia learning. J Educ Psychol. 2012;104:485–98.
- 6. Nussbaum M, Beserra VDS. Educational videogame design. Proc—IEEE 14th Int Conf Adv Learn Technol ICALT 2014. 2014;2–3.
- 7. Boyle EA, Connolly TM, Hainey T, Boyle JM. Engagement in digital entertainment games: A systematic review. Comput Human Behav. 2012;28(3):771–80.
- 8. Boyle EA, Hainey T, Connolly TM, Gray G, Earp J, Ott M, et al. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Comput Educ. 2016;94:178–92.
- 9. Lau HM, Smit JH, Fleming TM, Riper H. Serious games for mental health: Are they accessible, feasible, and effective? A systematic review and meta-analysis. Front Psychiatry. 2017;7:209. pmid:28149281
- 10. Sandí JC, Bazan P. Educational Serious Games as a Service: Challenges and Solutions. J Comput Sci Technol. 2019;19:66–80.
- 11. Sawyer SM, Afifi RA, Bearinger LH, Blakemore SJ, Dick B, Ezeh AC, et al. Adolescence: A foundation for future health. Lancet. 2012;379(9826):1630–40. pmid:22538178
- 12. Vannucci A, Flannery KM, Ohannessian CMC. Age-varying associations between coping and depressive symptoms throughout adolescence and emerging adulthood. Dev Psychopathol. 2018;30(2):665–81. pmid:29692294
- 13. Kessler RC, Petukhova M, Sampson NA, Zaslavsky AM, Wittchen HU. Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. Int J Methods Psychiatr Res. 2012;21(3):169–84. pmid:22865617
- 14. Fuhrmann D, Knoll LJ, Blakemore SJ. Adolescence as a sensitive period of brain development. Trends Cogn Sci. 2015;19(10):558–66. pmid:26419496
- 15. Mayer J, Salovey P, Caruso D. Emotional intelligence: Theory, findings, and implications. Psychol Inq. 2004;15:197–215.
- 16. de la Barrera U, Schoeps K, Gil-Gómez JA, Montoya-Castilla I. Predicting adolescent adjustment and well-being: The interplay between socio-emotional and personal factors. Int J Environ Res Public Health. 2019;16:4650. pmid:31766641
- 17. Sánchez-Álvarez N, Extremera N, Fernández-Berrocal P. The relation between emotional intelligence and subjective well-being: a meta- analytic investigation. J Posit Psychol. 2016;11:276–285.
- 18. Godfrey EB, Burson EL, Yanisch TM, Hughes D, Way N. A bitter pill to swallow? Patterns of critical consciousness and socioemotional and academic well-being in early adolescence. Dev Psychol. 2019;55(3):525–37. pmid:30802104
- 19. Estevez E, Jimenez T, Segura L. Emotional Intelligence and Empathy in Aggressors and Victims of School Violence. J Educ Psychol. 2019;111:488–96.
- 20. Schoeps K, Villanueva L, Prado-Gascó VJ, Montoya-Castilla I. Development of Emotional Skills in Adolescents to Prevent Cyberbullying and Improve Subjective Well-Being. Front Psychol. 2018;9:2050. pmid:30416471
- 21. Goh YLD, Wilkinson RB. Attachment Strength and Relationship Expectancies in the Prediction of Adolescent Stress and Depression. Educ Dev Psychol. 2017;34(2):106–23.
- 22. Rosenberg ER, Burt KB, Forehand RL, Paysnick AA. Youth self-views, coping with stress, and behavioral/emotional problems: The role of incremental self-theory. J Child Fam Stud. 2016;25:1713–23.
- 23. Fomina T, Burmistrova-Savenkova A, Morosanova V. Self-regulation and psychological well-being in early adolescence: A two-wave longitudinal study. Behav Sci. 2020;10:67. pmid:32164173
- 24. Sarrionandia A. Effects of an emotional intelligence program on socioemotional factors and psychosomatic symptoms. Rev Latinoam Psicol. 2017;49:110–8.
- 25. Viguer P, Cantero MJ, Bañuls R. Enhancing emotional intelligence at school: Evaluation of the effectiveness of a two-year intervention program in Spanish pre-adolescents. Pers Individ Dif. 2017;113:193–200.
- 26. Villegas E, Raffaelli M. Experiencing and learning about emotions: A Longitudinal Analysis of Youth Program Participants. J Youth Adolesc. 2018;47(8):1684–96. pmid:29961240
- 27. Hodzic S, Scharfen J, Ripoll P, Holling H, Zenasni F. How efficient are emotional intelligence trainings: A meta-analysis. Emot Rev. 2018;10:138–48.
- 28. Sklad M, Dieskstra R, de Ritter M, Ben J, Gravesteijn C. Effectiveness of school-based universal social, emotional, and behavioral programs: do they enhance students’ development in the area of skill, behavior, and adjustment? Psychol Sch. 2012;49(9):892–909.
- 29. Paiva ACR, Flores NH, Barbosa AG, Ribeiro TPB. iLearnTest–Framework for Educational Games. Procedia—Soc Behav Sci. 2016;228:443–8.
- 30. All A, Nuñez-Castellar EP, Van Looy J. Assessing the effectiveness of digital game-based learning: Best practices. Comput Educ. 2016;92–93:90–103.
- 31. Clark DB, Tanner-Smith EE, Killingsworth SS. Digital Games, Design, and Learning: A Systematic Review and Meta-Analysis. Rev Educ Res. 2016;86(1):79–122. pmid:26937054
- 32. Garaigordobil M, Martínez-Valderrey V. Impact of cyberprogram 2.0 on different types of school violence and aggressiveness. Front Psychol. 2016;7:428. pmid:27064802
- 33. Kreuze E, Jenkins C, Gregoski M, York J, Mueller M, Lamis DA, et al. Technology-enhanced suicide prevention interventions: A systematic review. J Telemed Telecare. 2017;23:605–17. pmid:27377792
- 34. Navarro-Pérez JJ, Carbonell Á, Oliver A. The Effectiveness of a Psycho-educational App to Reduce Sexist Attitudes in Adolescents. Rev Psicodidáctica. 2019;24(1):9–16.
- 35. Almeida F. Adoption of a Serious Game in the Developing of Emotional Intelligence Skills. Eur J Investig Heal Psychol Educ. 2020;10(1):30–43.
- 36. Iaosanurak C, Chanchalor S, Murphy E. Social and emotional learning around technology in a cross-cultural, elementary classroom. Educ Inf Technol. 2016;21:1639–62.
- 37. Kahn J, Ducharme P, Rotenberg A, Gonzalez-Heydrich J. “RAGE-Control”: A Game to Build Emotional Strength. Games Health J. 2013;2(1):53–7. pmid:26196556
- 38. David OA, Predatu RM, Cardoș RAI. A pilot study of the REThink online video game applied for coaching emotional understanding in children and adolescents in the therapeutic video game environment: The Feeling Better resources game. J Evidence-Based Psychother. 2018;18(1):57–67.
- 39. Cejudo J, López-Delgado ML, Losada L. Effectiveness of the videogame “Spock” for the improvement of the emotional intelligence on psychosocial adjustment in adolescents. Comput Human Behav. 2019;101:380–6.
- 40. Herrero JF, Lorenzo G. An immersive virtual reality educational intervention on people with autism spectrum disorders (ASD) for the development of communication skills and problem solving. Educ Inf Technol. 2020;25(3):1689–722.
- 41. Shandley K, Austin D, Klein B, Kyrios M. An evaluation of “Reach Out Central”: An online gaming program for supporting the mental health of young people. Health Educ Res. 2010;25(4):563–74. pmid:20150530
- 42. Feiss R, Dolinger SB, Merritt M, Reiche E, Martin K, Yanes JA, et al. A Systematic Review and Meta-Analysis of School-Based Stress, Anxiety, and Depression Prevention Programs for Adolescents. J Youth Adolesc. 2019;48(9):1668–85. pmid:31346924
- 43. Fernández-Berrocal P, Extremera N, Ramos N. Validity and reliability of the Spanish Modified version of the Trait Meta-Mood Scale. Psychol Rep. 2004;94:751–5. pmid:15217021
- 44. Pedrosa I, Suárez-Álvarez J, Lozano LM, Muñiz J, García-Cueto E. Assessing Perceived Emotional Intelligence in Adolescents: New Validity Evidence of Trait Meta-Mood Scale–24. J Psychoeduc Assess. 2014;32(8):737–46.
- 45. Guerra-Bustamante J, León-Del-Barco B, Yuste-Tosina R, López-Ramos VM, Mendo-Lázaro S. Emotional intelligence and psychological well-being in adolescents. Int J Environ Res Public Health. 2019;16(10):1–12. pmid:31100799
- 46.
Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965.
- 47. de la Barrera U, Montoya-Castilla I, Pérez-Albéniz A, Lucas-Molina B, Fonseca-Pedrero E. Mental health difficulties related to suicidal behavior in adolescents: the moderating role of self-esteem. Arch Suicide Res. 2020. pmid:33027593
- 48. Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi D won, Oishi S, et al. New well-being measures: Short scales to assess flourishing and positive and negative feelings. Soc Indic Res. 2010;97(2):143–56.
- 49. Prado-Gascó V, Romero-Reignier V, Mesa-Gresa P, Górriz AB. Subjective well-being in Spanish adolescents: Psychometric properties of the scale of positive and negative experiences. Sustainability. 2020;12:4011.
- 50. Mónaco E, Schoeps K, Montoya-Castilla M. Attachment Styles and Well-Being in Adolescents : How Does Emotional Development Affect This Relationship? Int J Environ Res Public Heal Artic. 2019;16:2554. pmid:31319570
- 51. Goodman R. The strengths and difficulties questionnaire: A research note. J Child Psychol Psychiatry Allied Discip. 1997;38(5):581–6. pmid:9255702
- 52. Ortuño-Sierra J, Chocarro E, Fonseca-Pedrero E, Riba SSI, Muñiz J. The assessment of emotional and Behavioural problems: Internal structure of The Strengths and Difficulties Questionnaire. Int J Clin Heal Psychol. 2015;15:265–73. pmid:30487843
- 53. Lovibond PF, Lovibond SH. The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther. 1995;33(3):335–43. pmid:7726811
- 54. Daza P, Novy DM, Stanley MA, Averill P. The depression anxiety stress scale-21: Spanish translation and validation with a Hispanic sample. J Psychopathol Behav Assess. 2002;24(3):195–205.
- 55. Fonseca-Pedrero E, Paino M, Lemos-Giráldez S, Muñiz J. Psychometric properties of the Depression Anxiety and Stress Scales-21 (DASS-21) in Spanish college students. Ansiedad y Estres. 2010;16(2–3):215–26.
- 56.
Mayer JD, Salovey P. What is emotional intelligence? In: Salovey P, Sluyter D, editors. Emotional Development and Emotional Intelligence: Implications for Educators. New York, NY: Basic Books; 1997. p. 3–31. https://doi.org/10.1177/1066480710387486
- 57. Mayer JD, Caruso DR, Salovey P. The Ability Model of Emotional Intelligence: Principles and Updates. Emot Rev. 2016;8(4):290–300.
- 58. de la Barrera U, Postigo Zegarra S, Tamarit A, Gil-Gómez JA, Montoya-Castilla I. Desarrollo de competencias socioemocionales mediante plataforma tecnológica (Programa emoTIC): Valoración de los beneficios del programa según los participantes [Development of socio-emotional competencies through a technological platform (emoTIC programme): the benefits according to the participants]. Know Share Psychol. 2020;1(4):241–55.
- 59. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–91. pmid:17695343
- 60. Salovey P, Stroud LR, Woolery A, Epel ES. Perceived emotional intelligence, stress reactivity, and symptom reports: Further explorations using the trait meta-mood scale. Psychol Heal. 2002;17:611–627.
- 61. Sigüenza-Marín VS, Carballido-Guisado R, Pérez-Albéniz A, Fonseca-Pedrero E. Implementation and Evaluation of an Emotional Intelligence Program in Adolescents. Univ Psychol. 2019;18(3).
- 62. Pérez-Albéniz A, Pedrero EF, Carballido R, Sigüenza VS, Lucas-Molina B. Implementation and evaluation of the efficiency of an Emotional Education Program in Teenagers diagnosed with ADHD. Summa Psicologica. 2019;16(2):98–109.
- 63. Baldwin SA, Hoffmann JP. The dynamics of self- esteem: A growth curve analysis. J Youth Adolesc. 2002;31(2):101–113.