Abstract
The Emotions as a Child Scale (EAC) assesses five parental emotion socialization strategies for three emotions (anger, fear/anxiety, and sadness): reward, override, neglect, magnify, and punish. However, there is limited research on the factorial and cross-cultural validity and test-retest reliability of the EAC. In the current study, the validity and reliability of the anger socialization component of the EAC was examined among Japanese children and adolescents. In Study 1, to test factorial validity and predictive validity, 655 children and adolescents completed the EAC and a measure of depressive symptoms, and their parents completed a measure of child oppositional defiant behaviors. Neither the original five-factor model nor other previous models fit our data, and a two-factor model (supportive and unsupportive responses) was suggested by exploratory and confirmatory factor analyses. The factorial and predictive validity were sufficient. In Study 2, to assess test-retest reliability and convergent validity, 406 children completed the EAC in two waves separated by a one-month interval and the Parental Bonding Instrument. The test-retest and convergent validity were sufficient. Overall, the Japanese version of the EAC showed adequate reliability and validity.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The datasets generated during and/or analyzed in the current study are not publicly available due to confidentiality agreements.
Notes
As Shikishima et al. (2006) noted, Japanese people tend to be more reluctant to discuss their psychological states with scientific researchers and are generally hesitant to take part in research activities, which results in generally low participation rates in research among the Japanese population. For example, the cooperation rate per household with children of elementary or junior high school age was 48.4–59.5% in the Japan Child Panel Survey (JCPS), a large longitudinal survey in Japan, but the continuation rate from the first survey (JCPS 2010) was 70.3% (Shikishima, 2013).
References
Bandalos, D. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9(1), 78–102. https://doi.org/10.1207/S15328007SEM0901_5.
Birleson, P. (1981). The validity of depressive disorder in childhood and the development of a self-rating scale: A research report. Journal of Child Psychology and Psychiatry, 22, 73–88. https://doi.org/10.1111/j.1469-7610.1981.tb00533.x.
Brand, A. E., & Klimes-Dougan, B. (2010). Emotion socialization in adolescence: The roles of mothers and fathers. New Directions for Child and Adolescent Development, 2010(128), 85–100. https://doi.org/10.1002/cd.270.
Branje, S. (2018). Development of parent–adolescent relationships: Conflict interactions as a mechanism of change. Child Development Perspectives, 12, 171–176. https://doi.org/10.1111/cdep.12278.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245–276. https://doi.org/10.1207/s15327906mbr0102_10.
Cui, L., Criss, M. M., Ratliff, E., Wu, Z., Houltberg, B. J., Silk, J. S., & Morris, A. S. (2020). Longitudinal links between maternal and peer emotion socialization and adolescent girls’ socioemotional adjustment. Developmental Psychology, 56(3), 595–607. https://doi.org/10.1037/dev0000861.
Eisenberg, N. (2020). Findings, issues, and new directions for research on emotion socialization. Developmental Psychology, 56(3), 664–670. https://doi.org/10.1037/dev0000906.
Eisenberg, N., Cumberland, A., & Spinrad, T. (1998). Parental socialization of emotion. Psychological Inquiry, 9, 241–273. https://doi.org/10.1207/s15327965pli0904_1.
Fabes, R. A., Poulin, R. E., Eisenberg, N., & Madden-Derdich, D. A. (2002). The coping with children’s negative emotions scale (CCNES): Psychometric properties and relations with chil- dren’s emotional competence. Marriage & Family Review, 34(3–4), 285–310. https://doi.org/10.1300/J002v34n03_05.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instrument. Psychological Assessment, 7, 286–299. https://doi.org/10.1037/1040-3590.7.3.286.
Friedlmeier, W., Corapci, F., & Cole, P. M. (2011). Emotion socialization in cross-cultural perspective. Social and Personality Psychology Compass, 5, 410–427. https://doi.org/10.1111/j.1751-9004.2011.00362.x.
Fujisato, H., Ito, M., Takebayashi, Y., Hosogoshi, H., Kato, N., Nakajima, S., Miyamae, M., Oe, Y., Usami, S., Kanie, A., Horikoshi, M., & Berking, M. (2017). Reliability and validity of the Japanese version of the emotion regulation skills questionnaire. Journal of Affective Disorders, 208, 145–152. https://doi.org/10.1016/j.jad.2016.08.064.
Garside, R. B., & Klimes-Dougan, B. (2002). Socialization of discrete negative emotions: Gender differences and links with psychological distress. Sex Roles, 47, 115–128. https://doi.org/10.1023/A:1021090904785.
Guo, J., Mrug, S., & Knight, D. C. (2017). Factor structure of the emotions as a child scale in late adolescence and emerging adulthood. Psychological Assessment, 29(9), 1082–1095. https://doi.org/10.1037/pas0000412.
Harada, Y., Saitoh, K., Iida, J. Sakuma, A., Iwasaka, H., Imai, J., Hirabayashi, M., Yamada,S., Hirabayashi, S., Uchiyama, T., Ohta, S., & Amano, N. (2004). The reliability and validity of the oppositional defiant behavior inventory. European Child & Adolescent Psychiatry, 13, 185–190. https://doi.org/10.1007/s00787-004-0376-0.
Harada, Y., Saitoh, K., Iida, J., Sasayama, D., Sakai, A., Imai, J., Iwasaka, H., Hirabayashi, M., Yamada, S., Hirabayashi, S., Uchiyama, T., & Amano, N. (2008). Establishing the cut-off point for the oppositional defiant behavior inventory. Psychiatry and Clinical Neurosciences, 62(1), 120–122. https://doi.org/10.1111/j.1440-1819.2007.01771.x.
Hayashi, A., Karasawa, M., & Tobin, J. (2009). The Japanese preschool 's pedagogy of feeling: Cultural strategies for supporting young children's emotional development. Ethos, 37, 32–49. https://doi.org/10.1111/j.1548-1352.2009.01030.x.
Hofstede, G., Hofstede G. J., & Minkov, M. (2010). Cultures and organizations: Software of the mind. Revised and expanded (3rd ed.). McGraw-hill.
Horn, J. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447.
IBM Corp. (2012). IBM SPSS statistics for windows, version 21.0. IBM Corp.
JASP Team (2020). JASP (Version 0.13.1) [Computer software].
Johnson, A. M., Hawes, D. J., Eisenberg, N., Kohlhoff, J., & Dudeney, J. (2017). Emotion socialization and child conduct problems: A comprehensive review and meta-analysis. Clinical Psychology Review, 54, 65–80. https://doi.org/10.1016/j.cpr.2017.04.001.
Kehoe, C. E., Havighurst, S. S., & Harley, A. E. (2014). Tuning in to teens: Improving parent emotion socialization to reduce youth internalizing difficulties. Social Development, 23, 413–431. https://doi.org/10.1111/sode.12060.
Kitamura, T., & Suzuki, T. (1993). A validation study of the parental bonding instrument in a Japanese population. Psychiatry and Clinical Neurosciences, 47, 29–36. https://doi.org/10.1111/j.1440-1819.1993.tb02026.x.
Klimes-Dougan, B., Brand, A., & Garside, R. B. (2001, August). Factor structure, reliability, and validity of an emotion socialization scale. In C. O’Neal (chair), Multiple approaches to emotion socialization: Methodology and emotional development. Symposium conducted at the annual meeting of the American Psychological Association, San Francisco, CA.
Klimes-Dougan, B., Pearson, T. E., Jappe, L., Mathieson, L., Simard, M. R., Hastings, P., & Zahn-Waxler, C. (2014). Adolescent emotion socialization: A longitudinal study of friends' responses to negative emotions. Social Development, 23(2), 395–412. https://doi.org/10.1111/sode.12045.
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012.
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling, 9(2), 151–173. https://doi.org/10.1207/S15328007SEM0902_1.
Lougheed, J. P., Craig, W. M., Pepler, D., Connolly, J., O'Hara, A., Granic, I., & Hollenstein, T. (2016). Maternal and peer regulation of adolescent emotion: Associations with depressive symptoms. Journal of Abnormal Child Psychology, 44(5), 963–974. https://doi.org/10.1007/s10802-015-0084-x.
Luo, J., Wang, M.-C., Gao, Y., Deng, J., & Qi, S.-S. (2020). Factor structure and construct validity of the emotions as a child scale (EAC) in Chinese children. Psychological Assessment, 32(1), 85–97. https://doi.org/10.1037/pas0000762.
Magai, C. & O'Neal, C. R. (1997). Emotions as a child (child version), Unpublished manuscript Long Island University, Brooklyn.
Matsumoto, D. (1991). Cultural influences on facial expressions of emotion. Southern Communication Journal, 56, 128–137. https://doi.org/10.1080/10417949109372824.
Matsumoto, D. (2018). Time to rethink the common view. Asian Journal of Social Psychology, 21(4), 324–330. https://doi.org/10.1111/ajsp.12334.
Morris, A. S., Silk, J. S., Steinberg, L., Myers, S. S., & Robinson, L. R. (2007). The role of the family context in the development of emotion regulation. Social Development, 16, 361–388. https://doi.org/10.1111/j.1467-9507.2007.00389.x.
Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.) Muthén & Muthén.
Namikawa, T., Tani, I., Wakita, T., Kumagai, R., Nakane, A., Noguchi, H., & Tsujii, M. (2011). Development of a short-form Birleson depression self-rating scale for children. Clinical Psychiatry, 53(5), 489–496. [Japanese] https://doi.org/10.11477/mf.1405101871
Ogawa, M. (1991). PBI (parenting bonding instrument) nihonban no shinraisei datousei ni kansuru kenkyu. [the study of the reliability and the validity of the Japanese version of the PBI (parenting bonding instrument)]. Japanese Journal of Psychiatric Treatment, 6, 1193–1201. [Japanese]
O'Neal, C. R., & Magai, C. (2005). Do parents respond in different ways when children feel different emotions? The emotional context of parenting. Development and Psychopathology, 17(2), 467–487. https://doi.org/10.1017/s0954579405050224.
O'Neal, C. R., Weston, L. C., He, X., Huang, K. Y., Pine, D. S., Kamboukos, D., & Brotman, L. M. (2017). Change in depression across adolescence: The role of early anger socialization and child anger. Journal of Adolescence, 59, 1–7. https://doi.org/10.1016/j.adolescence.2017.05.011.
Parker, G., Tupling, H., & Brown, L. B. (1979). A parental bonding instrument. British Journal of Medical Psychology, 52, 1–10. https://doi.org/10.1111/j.2044-8341.1979.tb02487.x.
Perry, N. B., Dollar, J. M., Calkins, S. D., Keane, S. P., & Shanahan, L. (2020). Maternal socialization of child emotion and adolescent adjustment: Indirect effects through emotion regulation. Developmental Psychology, 56(3), 541–552. https://doi.org/10.1037/dev0000815.
R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.r-project.org/index.html
Revelle, W., (2017). Psych: Procedures for psychological, psychometric, and personality research. Software.
Rothbaum, F., Pott, M., Azuma, H., Miyake, K., & Weisz, J. (2000). The development of close relationships in Japan and the United States: Paths of symbiotic harmony and generative tension. Child Development, 71(5), 1121–1142. https://doi.org/10.1111/1467-8624.00214.
Shikishima, C. (2013). Overview of the Japan child panel survey 2012. Panel Data Research Center at Keio University. https://www.pdrc.keio.ac.jp/uploads/SDP2012-002.pdf
Shikishima, C., Ando, J., Ono, Y., Toda, T., & Yoshimura, K. (2006). Registry of adolescent and young adult twins in the Tokyo area. Twin Research and Human Genetics, 9(6), 811–816. https://doi.org/10.1375/twin.9.6.811.
Shortt, J. W., Katz, L. F., Allen, N. B., Leve, C., Davis, B., & Sheeber, L. B. (2016). Emotion socialization in the context of risk and psychopathology: Mother and father socialization of anger and sadness in adolescents with depressive disorder. Social development, 25(1), 27-46. https://doi.org/10.1111/sode.12138.
Shortt, J. W., Stoolmiller, M., Smith-Shine, J. N., Eddy, J. M., & Sheeber, L. (2010). Maternal emotion coaching, adolescent anger regulation, and siblings’ externalizing symptoms. Journal of Child Psychology and Psychiatry, 51, 799–808. https://doi.org/10.1111/j.1469-7610.2009 .02207.x.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428. https://doi.org/10.1037/0033-2909.86.2.420.
Silk, J. S., Shaw, D. S., Prout, J. T., O’Rourke, F., Lane, T. J., & Kovacs, M. (2011). Socialization of emotion and offspring internalizing symptoms in mothers with childhood-onset depression. Journal of Applied Developmental Psychology, 32, 127–136. https://doi.org/10.1016/j.appdev.2011.02.001.
Sugimura, K., Crocetti, E., Hatano, K., Kaniušonytė, G., Hihara, S., & Žukauskienė, R. (2018). A cross-cultural perspective on the relationships between emotional separation, parental trust, and identity in adolescents. Journal of Youth and Adolescence, 47(4), 749–759. https://doi.org/10.1007/s10964-018-0819-4.
Takano, Y., & Osaka, E. (2018). Comparing Japan and the United States on individualism/ collectivism: A follow-up review. Asian Journal of Social Psychology, 21(4), 301–316. https://doi.org/10.1111/ajsp.12322.
Tao, A., Zhou, Q., & Wang, Y. (2010). Parental reactions to children's negative emotions: Prospective relations to Chinese children's psychological adjustment. Journal of Family Psychology, 24(2), 135–144. https://doi.org/10.1037/a0018974.
Trommsdorff, G., & Heikamp, T. (2013). Socialization of emotions and emotion regulation in cultural context. Barnow, S., & Balkir, N. (Eds.). Cultural variations in psychopathology: From research to practice (pp. 67-92). Hogrefe.
Uji, M., Tanaka, N., Shono, M., & Kitamura, T. (2006). Factorial structure of the parental bonding instrument (PBI) in Japan: A study of cultural, developmental, and gender influences. Child Psychiatry and Human Development, 37, 115–132. https://doi.org/10.1007/s10578-006-0027-4.
Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557.
Acknowledgements
This study was funded by KAKENHI (17 J40022, 19 K03278) from the Japan Society for the Promotion of Science. Portions of the study findings were presented as a poster at the 31st Annual Meeting for the Japan Society of Developmental Psychology, Osaka, Japan. We gratefully acknowledge the support of children and adolescents, teachers, parents, and principals who participated in the study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Not applicable.
Conflict of Interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 16 kb)
Rights and permissions
About this article
Cite this article
Deno, M., Iimura, S. & Endo, T. Reliability and validity of the Emotions as a Child Scale in Japanese children and adolescents: Focusing on children’s anger. Curr Psychol 42, 8112–8124 (2023). https://doi.org/10.1007/s12144-021-02136-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-021-02136-1