Skip to main content
Top
Gepubliceerd in:

08-02-2019

Towards Scalable, Integrative Assessment of Children’s Self-Regulatory Capabilities: New Applications of Digital Technology

Auteurs: Jamin Day, Kate Freiberg, Alan Hayes, Ross Homel

Gepubliceerd in: Clinical Child and Family Psychology Review | Uitgave 1/2019

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The assessment of self-regulation in children is of significant interest to researchers within education, clinical and developmental psychology, and clinical neuroscience, given its importance to adaptive functioning across a wide range of social, educational, interpersonal, educational and health domains. Because self-regulation is a complex, multidimensional construct, a range of assessment approaches have been developed to assess its various components including behavioural, cognitive and emotional domains. In recent years, digital technology has been increasingly used to enhance or supplement existing measurement approaches; however, developments have predominantly focused on translating traditional testing paradigms into digital formats. There is a need for more innovation in digital psychological assessments that harness modern mechanisms such as game-based design and interactivity. Such approaches have potential for the development of scalable, adaptable universal approaches to screening and assessment of children’s self-regulatory capabilities, to facilitate early identification of difficulties in individuals and also guide planning and decision-making at a population level. We highlight a novel, innovative digital assessment tool for children called Rumble’s Quest, a new measure of children’s socio-emotional functioning that shows promise as an integrative assessment of well-being and self-regulation, and which incorporates both self-report and direct assessment of cognitive self-regulation. This tool is scalable, can be integrated into normal classroom activities, and forms part of a comprehensive prevention support system that can be used to guide stakeholders’ decision-making regarding early intervention and support at the individual, classroom, school and community level. We finish by discussing other innovative possibilities for psychological assessment with children, using new and emerging technologies and assessment approaches.
Literatuur
go back to reference Andersson, G., Bergström, J., Buhrman, M., Carlbring, P., Holländare, F., Kaldo, V., … Waara, J. (2008). Development of a new approach to guided self-help via the internet: The Swedish experience. Journal of Technology in Human Services, 26(2–4), 161–181. https://doi.org/10.1080/15228830802094627. Andersson, G., Bergström, J., Buhrman, M., Carlbring, P., Holländare, F., Kaldo, V., … Waara, J. (2008). Development of a new approach to guided self-help via the internet: The Swedish experience. Journal of Technology in Human Services, 26(2–4), 161–181. https://​doi.​org/​10.​1080/​1522883080209462​7.
go back to reference Andersson, G., & Titov, N. (2014). Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 13(1), 4–11. https://doi.org/10.1002/wps.20083. Andersson, G., & Titov, N. (2014). Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 13(1), 4–11. https://​doi.​org/​10.​1002/​wps.​20083.
go back to reference Baggett, K. M., Davis, B., Feil, E. G., Sheeber, L. B., Landry, S. H., Carta, J. J., & Leve, C. (2010). Technologies for expanding the reach of evidence-based interventions: Preliminary results for promoting social-emotional development in early childhood. Topics in Early Childhood Special Education, 29(4), 226–238. https://doi.org/10.1177/0271121409354782.PubMedPubMedCentral Baggett, K. M., Davis, B., Feil, E. G., Sheeber, L. B., Landry, S. H., Carta, J. J., & Leve, C. (2010). Technologies for expanding the reach of evidence-based interventions: Preliminary results for promoting social-emotional development in early childhood. Topics in Early Childhood Special Education, 29(4), 226–238. https://​doi.​org/​10.​1177/​0271121409354782​.PubMedPubMedCentral
go back to reference Bauer, M., Wylie, C., Jackson, T., Mislevy, B., Hoffman-John, E., John, M., & Corrigan, S. (2017). Why video games can be a good fit for formative assessment. Journal of Applied Testing Technology, 18(S1), 19–31 Bauer, M., Wylie, C., Jackson, T., Mislevy, B., Hoffman-John, E., John, M., & Corrigan, S. (2017). Why video games can be a good fit for formative assessment. Journal of Applied Testing Technology, 18(S1), 19–31
go back to reference Baumeister, R., Schmeichel, B., & Vohs, K. (2008). Self-regulation and the executive function: The self as controlling agent. In A. W. Kruglanski & E. T. Higgins (Eds.), Social psychology: Handbook of basic principles (2nd edn., p. 516). New York: The Guilford Press. Baumeister, R., Schmeichel, B., & Vohs, K. (2008). Self-regulation and the executive function: The self as controlling agent. In A. W. Kruglanski & E. T. Higgins (Eds.), Social psychology: Handbook of basic principles (2nd edn., p. 516). New York: The Guilford Press.
go back to reference Beaumont, R., Rotolone, C., & Sofronoff, K. (2015). The secret agent society social skills program for children with high-functioning autism spectrum disorders: A comparison of two school variants. Psychology in the Schools, 52(4), 390–402. https://doi.org/10.1002/pits.21831. Beaumont, R., Rotolone, C., & Sofronoff, K. (2015). The secret agent society social skills program for children with high-functioning autism spectrum disorders: A comparison of two school variants. Psychology in the Schools, 52(4), 390–402. https://​doi.​org/​10.​1002/​pits.​21831.
go back to reference Boonstra, T. W., Nicholas, J., Wong, Q. J., Shaw, F., Townsend, S., & Christensen, H. (2018). Using mobile phone sensor technology for mental health research: Integrated analysis to identify hidden challenges and potential solutions. Journal of Medical Internet Research, 20(7), e10131. https://doi.org/10.2196/10131.PubMedPubMedCentral Boonstra, T. W., Nicholas, J., Wong, Q. J., Shaw, F., Townsend, S., & Christensen, H. (2018). Using mobile phone sensor technology for mental health research: Integrated analysis to identify hidden challenges and potential solutions. Journal of Medical Internet Research, 20(7), e10131. https://​doi.​org/​10.​2196/​10131.PubMedPubMedCentral
go back to reference Bronfenbrenner, U. (1986). Ecology of the family as a context for human development: Research perspectives. Developmental Psychology, 22(6), 723. Bronfenbrenner, U. (1986). Ecology of the family as a context for human development: Research perspectives. Developmental Psychology, 22(6), 723.
go back to reference Burns, J. M., Davenport, T. A., & Christensen, H. (2013). Game on: Exploring the impact of technologies on young men’s mental health and wellbeing. Findings from the first Young and Well National Survey. Retrieved from http://scholar.google.com/scholar?hl=en%5C&btnG=Search%5C&q=intitle:Game+On:+Exploring+the+Impact+of+Technologies+on+Young+Men’s+Mental+Health+and+Wellbeing%5C#0. Burns, J. M., Davenport, T. A., & Christensen, H. (2013). Game on: Exploring the impact of technologies on young men’s mental health and wellbeing. Findings from the first Young and Well National Survey. Retrieved from http://​scholar.​google.​com/​scholar?​hl=​en%5C&btnG=Search%5C&q=intitle:Game+On:+Exploring+the+Impact+of+Technologies+on+Young+Men’s+Mental+Health+and+Wellbeing%5C#0.
go back to reference Campbell, S. B., Denham, S. A., Howarth, G. Z., Jones, S. M., Whittaker, J. V., Williford, A. P., … Darling-Churchill, K. (2016). Commentary on the review of measures of early childhood social and emotional development: Conceptualization, critique, and recommendations. Journal of Applied Developmental Psychology, 45, 19–41. https://doi.org/10.1016/j.appdev.2016.01.008. Campbell, S. B., Denham, S. A., Howarth, G. Z., Jones, S. M., Whittaker, J. V., Williford, A. P., … Darling-Churchill, K. (2016). Commentary on the review of measures of early childhood social and emotional development: Conceptualization, critique, and recommendations. Journal of Applied Developmental Psychology, 45, 19–41. https://​doi.​org/​10.​1016/​j.​appdev.​2016.​01.​008.
go back to reference Carlson, S. M., & Zelazo, P. D. (2014). Minnesota executive function scale: test manual. Reflection Sciences, LLC: St. Paul, MN. Carlson, S. M., & Zelazo, P. D. (2014). Minnesota executive function scale: test manual. Reflection Sciences, LLC: St. Paul, MN.
go back to reference Casey, L. M., Oei, T. P. S., Raylu, N., Horrigan, K., Day, J., Ireland, M., & Clough, B. A. (2017). Internet-based delivery of cognitive behaviour therapy compared to monitoring, feedback and support for problem gambling: A randomised controlled trial. Journal of Gambling Studies. https://doi.org/10.1007/s10899-016-9666-y.PubMed Casey, L. M., Oei, T. P. S., Raylu, N., Horrigan, K., Day, J., Ireland, M., & Clough, B. A. (2017). Internet-based delivery of cognitive behaviour therapy compared to monitoring, feedback and support for problem gambling: A randomised controlled trial. Journal of Gambling Studies. https://​doi.​org/​10.​1007/​s10899-016-9666-y.PubMed
go back to reference Clarke, J., Proudfoot, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., … Hadzi-Pavlovic, D. (2014). Effects of mental health self-efficacy on outcomes of a mobile phone and web intervention for mild-to-moderate depression, anxiety and stress: Secondary analysis of a randomised controlled trial. BMC Psychiatry, 14(1), 272. https://doi.org/10.1186/s12888-014-0272-1.PubMedPubMedCentral Clarke, J., Proudfoot, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., … Hadzi-Pavlovic, D. (2014). Effects of mental health self-efficacy on outcomes of a mobile phone and web intervention for mild-to-moderate depression, anxiety and stress: Secondary analysis of a randomised controlled trial. BMC Psychiatry, 14(1), 272. https://​doi.​org/​10.​1186/​s12888-014-0272-1.PubMedPubMedCentral
go back to reference Cummins, R. A., & Lau, A. L. D. (2005). Personal Wellbeing Index–School Children. Cummins, R. A., & Lau, A. L. D. (2005). Personal Wellbeing Index–School Children.
go back to reference DiCerbo, K. E., Shute, V., & Kim, Y. J. (2017). The future of assessment in technology-rich environments: Psychometric considerations. In J. M. Spector, B. Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–21). New York: Springer. DiCerbo, K. E., Shute, V., & Kim, Y. J. (2017). The future of assessment in technology-rich environments: Psychometric considerations. In J. M. Spector, B. Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–21). New York: Springer.
go back to reference Doherty, G., Coyle, D., & Sharry, J. (2012). Engagement with online mental health interventions: An Exploratory Clinical Study of a Treatment for Depression. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI’12 (p. 1421). New York: ACM Press. https://doi.org/10.1145/2207676.2208602. Doherty, G., Coyle, D., & Sharry, J. (2012). Engagement with online mental health interventions: An Exploratory Clinical Study of a Treatment for Depression. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI’12 (p. 1421). New York: ACM Press. https://​doi.​org/​10.​1145/​2207676.​2208602.
go back to reference Eyberg, S. M., & Pincus, D. (1999). Eyberg child behavior inventory and Sutter–Eyberg student behavior inventory—Revised: Professional manual. Odessa: Psychological Assessment Resources. Eyberg, S. M., & Pincus, D. (1999). Eyberg child behavior inventory and Sutter–Eyberg student behavior inventory—Revised: Professional manual. Odessa: Psychological Assessment Resources.
go back to reference Freiberg, K., Homel, R., Batchelor, S., Carr, A., Hay, I., Elias, G., … Lamb, C. (2005). Creating pathways to participation: a community-based developmental prevention project in Australia. Children & Society, 19(2), 144–157. https://doi.org/10.1002/chi.867. Freiberg, K., Homel, R., Batchelor, S., Carr, A., Hay, I., Elias, G., … Lamb, C. (2005). Creating pathways to participation: a community-based developmental prevention project in Australia. Children & Society, 19(2), 144–157. https://​doi.​org/​10.​1002/​chi.​867.
go back to reference Freiberg, K., Homel, R., & Lamb, C. (2007). The pervasive impact of poverty on children: Tackling family adversity and promoting child development through the pathways to prevention project. In A. France & R. Homel (Eds.), Pathways and crime prevention: Theory, policy and practice (Vol 226, pp. 226–246). Cullumpton: Willan Publishing. Freiberg, K., Homel, R., & Lamb, C. (2007). The pervasive impact of poverty on children: Tackling family adversity and promoting child development through the pathways to prevention project. In A. France & R. Homel (Eds.), Pathways and crime prevention: Theory, policy and practice (Vol 226, pp. 226–246). Cullumpton: Willan Publishing.
go back to reference Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). BRIEF-2: Behavior rating inventory of executive function. Lutz, FL: Psychological Assessment Resources. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). BRIEF-2: Behavior rating inventory of executive function. Lutz, FL: Psychological Assessment Resources.
go back to reference Harter, S. (1985). Manual for the self-perception profile for children. Denver: University of Denver. Harter, S. (1985). Manual for the self-perception profile for children. Denver: University of Denver.
go back to reference Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test (WCST): Manual: Revised and Expanded. Odessa, FL: Psychological Assessment Resources (PAR). Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test (WCST): Manual: Revised and Expanded. Odessa, FL: Psychological Assessment Resources (PAR).
go back to reference Kagan, J. (1964). Matching familiar figures test. Cambridge: Harvard University. Kagan, J. (1964). Matching familiar figures test. Cambridge: Harvard University.
go back to reference Kramer, J., Velden, M. T., Kafkes, A., Basu, S., Federico, J., & Kielhofner, G. (2014). Child occupational self assessment. Chicago: Model of Human Occupation Clearinghouse. Kramer, J., Velden, M. T., Kafkes, A., Basu, S., Federico, J., & Kielhofner, G. (2014). Child occupational self assessment. Chicago: Model of Human Occupation Clearinghouse.
go back to reference Manly, T., Robertson, I. H., Anderson, V., & Nimmo-Smith, I. (1999). TEA-Ch: The test of everyday attention for children manual. Bury St. Edmunds: Thames Valley Test Company Limited. Manly, T., Robertson, I. H., Anderson, V., & Nimmo-Smith, I. (1999). TEA-Ch: The test of everyday attention for children manual. Bury St. Edmunds: Thames Valley Test Company Limited.
go back to reference Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” Tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734.PubMed Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” Tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://​doi.​org/​10.​1006/​cogp.​1999.​0734.PubMed
go back to reference Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013). Internet cognitive behavioural therapy for mixed anxiety and depression: a randomized controlled trial and evidence of effectiveness in primary care. Psychological Medicine, 43(12), 2635–2648. https://doi.org/10.1017/S0033291713000111.PubMed Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013). Internet cognitive behavioural therapy for mixed anxiety and depression: a randomized controlled trial and evidence of effectiveness in primary care. Psychological Medicine, 43(12), 2635–2648. https://​doi.​org/​10.​1017/​S003329171300011​1.PubMed
go back to reference Nigg, J. T. (2017). Annual Research Review: On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. Journal of Child Psychology and Psychiatry, 58(4), 361–383. https://doi.org/10.1111/jcpp.12675.PubMed Nigg, J. T. (2017). Annual Research Review: On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. Journal of Child Psychology and Psychiatry, 58(4), 361–383. https://​doi.​org/​10.​1111/​jcpp.​12675.PubMed
go back to reference Parshall, C. G., Spray, J. A., Kalohn, J., & Davey, T. (2002). Practical considerations in computer-based testing. Berlin: Springer. Parshall, C. G., Spray, J. A., Kalohn, J., & Davey, T. (2002). Practical considerations in computer-based testing. Berlin: Springer.
go back to reference Picard, L., Abram, M., Orriols, E., & Piolino, P. (2017). Virtual reality as an ecologically valid tool for assessing multifaceted episodic memory in children and adolescents. International Journal of Behavioral Development, 41(2), 211–219. https://doi.org/10.1177/0165025415616198. Picard, L., Abram, M., Orriols, E., & Piolino, P. (2017). Virtual reality as an ecologically valid tool for assessing multifaceted episodic memory in children and adolescents. International Journal of Behavioral Development, 41(2), 211–219. https://​doi.​org/​10.​1177/​0165025415616198​.
go back to reference Ponitz, C. E. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J. (2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology, 45(3), 605–619. https://doi.org/10.1037/a0015365.PubMed Ponitz, C. E. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J. (2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology, 45(3), 605–619. https://​doi.​org/​10.​1037/​a0015365.PubMed
go back to reference Riva, G. (1997). Virtual reality in neuro-psycho-physiology: Cognitive, clinical and methodological issues in assessment and rehabilitation. Amsterdam: IOS Press. Riva, G. (1997). Virtual reality in neuro-psycho-physiology: Cognitive, clinical and methodological issues in assessment and rehabilitation. Amsterdam: IOS Press.
go back to reference Shapiro, E. S. (2000). School psychology from an instructional perspective: Solving big, not little problems. School Psychology Review, 29(4), 560. Shapiro, E. S. (2000). School psychology from an instructional perspective: Solving big, not little problems. School Psychology Review, 29(4), 560.
go back to reference Shute, V. J., Ke, F., & Wang, L. (2017). Assessment and Adaptation in Games. In P. Wouters & H. van Oostendorp (Eds.), Instructional techniques to facilitate learning and motivation of serious games (pp. 59–78). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-39298-1_4. Shute, V. J., Ke, F., & Wang, L. (2017). Assessment and Adaptation in Games. In P. Wouters & H. van Oostendorp (Eds.), Instructional techniques to facilitate learning and motivation of serious games (pp. 59–78). Cham: Springer International Publishing. https://​doi.​org/​10.​1007/​978-3-319-39298-1_​4.
go back to reference Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R., Prosser, S., … Kenardy, J. (2008). Online CBT in the treatment of child and adolescent anxiety disorders: Issues in the development of BRAVE–ONLINE and two case illustrations. Behavioural and Cognitive Psychotherapy, 36(04), 411–430. https://doi.org/10.1017/S135246580800444X. Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R., Prosser, S., … Kenardy, J. (2008). Online CBT in the treatment of child and adolescent anxiety disorders: Issues in the development of BRAVE–ONLINE and two case illustrations. Behavioural and Cognitive Psychotherapy, 36(04), 411–430. https://​doi.​org/​10.​1017/​S135246580800444​X.
go back to reference Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R. E., Prosser, S., & Kenardy, J. (2011). A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. Journal of Consulting and Clinical Psychology, 79(5), 629–642. https://doi.org/10.1037/a0024512.PubMed Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R. E., Prosser, S., & Kenardy, J. (2011). A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. Journal of Consulting and Clinical Psychology, 79(5), 629–642. https://​doi.​org/​10.​1037/​a0024512.PubMed
go back to reference Turner, K. M. T., Baker, S., & Day, J. J. (2018). Technology-assisted delivery of parenting programs. In T. G. Mazzucchelli & M. R. Sanders (Eds.), The power of positive parenting: Transforming the lives of children, parents and communities using the Triple P system (1st ed.). Oxford: Oxford University Press. Turner, K. M. T., Baker, S., & Day, J. J. (2018). Technology-assisted delivery of parenting programs. In T. G. Mazzucchelli & M. R. Sanders (Eds.), The power of positive parenting: Transforming the lives of children, parents and communities using the Triple P system (1st ed.). Oxford: Oxford University Press.
go back to reference Wagner, B., Fitzpatrick, J. P., Mazzucchelli, T. G., Symons, M., Carmichael Olson, H., Jirikowic, T., … Latimer, J. (2018). Study protocol for a self-controlled cluster randomised trial of the Alert Program to improve self-regulation and executive function in Australian Aboriginal children with fetal alcohol spectrum disorder. BMJ Open, 8(3), e021462.PubMedPubMedCentral Wagner, B., Fitzpatrick, J. P., Mazzucchelli, T. G., Symons, M., Carmichael Olson, H., Jirikowic, T., … Latimer, J. (2018). Study protocol for a self-controlled cluster randomised trial of the Alert Program to improve self-regulation and executive function in Australian Aboriginal children with fetal alcohol spectrum disorder. BMJ Open, 8(3), e021462.PubMedPubMedCentral
go back to reference Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. latent structure. Developmental Psychology, 44(2), 575.PubMed Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. latent structure. Developmental Psychology, 44(2), 575.PubMed
go back to reference Zapata-Rivera, D., & Bauer, M. (2012). Exploring the role of games in educational assessment. Technology-based assessments for twenty-first-century skills: Theoretical and practical implications from modern Research, 147–169. Zapata-Rivera, D., & Bauer, M. (2012). Exploring the role of games in educational assessment. Technology-based assessments for twenty-first-century skills: Theoretical and practical implications from modern Research, 147–169.
Metagegevens
Titel
Towards Scalable, Integrative Assessment of Children’s Self-Regulatory Capabilities: New Applications of Digital Technology
Auteurs
Jamin Day
Kate Freiberg
Alan Hayes
Ross Homel
Publicatiedatum
08-02-2019
Uitgeverij
Springer US
Gepubliceerd in
Clinical Child and Family Psychology Review / Uitgave 1/2019
Print ISSN: 1096-4037
Elektronisch ISSN: 1573-2827
DOI
https://doi.org/10.1007/s10567-019-00282-4