Skip to main content
main-content
Top

Tip

Swipe om te navigeren naar een ander artikel

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 2/2016

13-08-2015

A Comparison of Paper and Computer Administered Strengths and Difficulties Questionnaire

Auteurs: Praveetha Patalay, Daniel Hayes, Jessica Deighton, Miranda Wolpert

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 2/2016

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The Strengths and Difficulties Questionnaire (SDQ) is one of the most widely used measures of young people’s mental health difficulties in research and clinical decision-making. Although the SDQ is available in both paper and computer survey formats, cross-format equivalences have yet to be established. The current study aimed to assess the measure’s equivalence across paper- and computer-based survey formats in a community-based school setting. The study examined self-reported measures completed by a matched sample of 11–14 year olds in secondary schools in England (589 completed paper version; 589 online version). Analyses demonstrate that the factor structure, although did not vary by survey format, resulted in poorly fitting models limiting the use of model based invariance testing. Results indicate that the measure does not operate similarly across different formats, with scale-level mean differences observed for the hyperactivity scale, which also affects the total difficulties score, with higher scores seen in the paper version. Responses to the impact supplement were also influenced by survey format, with higher impact in specific domains disclosed on the computer-based measure. Item-level differential item functioning was observed for four items in the measure; two from the prosocial scale where the DIF is large enough to affect the scale (DTF, ν2 = 0.14). The inconsistency across survey formats highlights the need for more assessment of influences of different survey formats on young people, their perceived privacy and their mental health disclosures via different media. The findings also highlight the potential confounding effect of format when different methods of data collection are used, with a potentially substantive impact on cross-sample comparisons and within child clinical review.
Literatuur
go back to reference Achenbach, T. M., Becker, A., Dopfner, M., Heiervang, E., Roessner, V., Steinhausen, H. C., & Rothenberger, A. (2008). Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: research findings, applications, and future directions. Journal of Child Psychology and Psychiatry, 49, 251–275. CrossRefPubMed Achenbach, T. M., Becker, A., Dopfner, M., Heiervang, E., Roessner, V., Steinhausen, H. C., & Rothenberger, A. (2008). Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: research findings, applications, and future directions. Journal of Child Psychology and Psychiatry, 49, 251–275. CrossRefPubMed
go back to reference American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC:American Psychological Association. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC:American Psychological Association.
go back to reference Brown, T. A. (2012). Confirmatory factor analysis for applied research: Guilford Press. Brown, T. A. (2012). Confirmatory factor analysis for applied research: Guilford Press.
go back to reference Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399–412. CrossRefPubMed Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399–412. CrossRefPubMed
go back to reference Giannakopoulos, G., Tzavara, C., Dimitrakaki, C., Kolaitis, G., Rotsika, V., & Tountas, Y. (2009). The factor structure of the strengths and difficulties questionnaire (SDQ) in Greek adolescents. Annals General Psychiatry, 8. Giannakopoulos, G., Tzavara, C., Dimitrakaki, C., Kolaitis, G., Rotsika, V., & Tountas, Y. (2009). The factor structure of the strengths and difficulties questionnaire (SDQ) in Greek adolescents. Annals General Psychiatry, 8.
go back to reference Goodman, A., & Goodman, R. (2009). Strengths and difficulties questionnaire as a dimensional measure of child mental health. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 400–403. CrossRefPubMed Goodman, A., & Goodman, R. (2009). Strengths and difficulties questionnaire as a dimensional measure of child mental health. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 400–403. CrossRefPubMed
go back to reference Goodman, R. (1997). The strengths and difficulties questionnaire: a research note. Journal Of Child Psychology And Psychiatry, 38, 581–586. CrossRefPubMed Goodman, R. (1997). The strengths and difficulties questionnaire: a research note. Journal Of Child Psychology And Psychiatry, 38, 581–586. CrossRefPubMed
go back to reference Goodman, R., Meltzer, H., & Bailey, V. (1998). The strengths and difficulties questionnaire: a pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7, 125–130. CrossRef Goodman, R., Meltzer, H., & Bailey, V. (1998). The strengths and difficulties questionnaire: a pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7, 125–130. CrossRef
go back to reference Goodman, R., & Scott, S. (1999). Comparing the strengths and difficulties questionnaire and the child behavior checklist : is small beautiful ? Journal of Abnormal Child Psychology, 27, 17–24. CrossRefPubMed Goodman, R., & Scott, S. (1999). Comparing the strengths and difficulties questionnaire and the child behavior checklist : is small beautiful ? Journal of Abnormal Child Psychology, 27, 17–24. CrossRefPubMed
go back to reference Hagquist, C. (2007). The psychometric properties of the self-reported SDQ–an analysis of Swedish data based on the rasch model. Personality and Individual Differences, 43, 1289–1301. CrossRef Hagquist, C. (2007). The psychometric properties of the self-reported SDQ–an analysis of Swedish data based on the rasch model. Personality and Individual Differences, 43, 1289–1301. CrossRef
go back to reference Hale, D., Patalay, P., Fitzgerald-Yau, N., Hargreaves, D., Bond, L., Görzig, A.,... Viner, R. (2014). School-level variation in health outcomes in adolescence: analysis of three longitudinal studies in England. Prevention Science, 15, 600–610. doi: 10.​1007/​s11121-013-0414-6. Hale, D., Patalay, P., Fitzgerald-Yau, N., Hargreaves, D., Bond, L., Görzig, A.,... Viner, R. (2014). School-level variation in health outcomes in adolescence: analysis of three longitudinal studies in England. Prevention Science, 15, 600–610. doi: 10.​1007/​s11121-013-0414-6.
go back to reference Holländare, F., Andersson, G., & Engström, I. (2010). A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. Journal of Medical Internet Research, 12. doi: 10.​2196/​jmir.​1392. Holländare, F., Andersson, G., & Engström, I. (2010). A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. Journal of Medical Internet Research, 12. doi: 10.​2196/​jmir.​1392.
go back to reference Hu, L. t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi: 10.​1080/​1070551990954011​8.​ Hu, L. t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi: 10.​1080/​1070551990954011​8.​
go back to reference Joseph, L., Gyorkos, T. W., & Coupal, L. (1995). Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. American Journal of Epidemiology, 141, 263–272. PubMed Joseph, L., Gyorkos, T. W., & Coupal, L. (1995). Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. American Journal of Epidemiology, 141, 263–272. PubMed
go back to reference Klasen, H., Woerner, W., Wolke, D., Meyer, R., Overmeyer, S., Kaschnitz, W.,... Goodman, R. (2000). Comparing the German versions of the strengths and difficulties questionnaire (SDQ-Deu) and the child behavior checklist. European Child & Adolescent Psychiatry, 9, 271–276. Klasen, H., Woerner, W., Wolke, D., Meyer, R., Overmeyer, S., Kaschnitz, W.,... Goodman, R. (2000). Comparing the German versions of the strengths and difficulties questionnaire (SDQ-Deu) and the child behavior checklist. European Child & Adolescent Psychiatry, 9, 271–276.
go back to reference Leuven, E., & Sianesi, B. (2003). PSMATCH2: Stata module to perform full mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing (version revised 19 Jul 2012): Boston College Department of Economics. Leuven, E., & Sianesi, B. (2003). PSMATCH2: Stata module to perform full mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing (version revised 19 Jul 2012): Boston College Department of Economics.
go back to reference Liu, I. M., & Agresti, A. (1996). Mantel-haenszel-type inference for cumulative odds ratios with a stratified ordinal response. Biometrics, 52, 1223–1234. CrossRefPubMed Liu, I. M., & Agresti, A. (1996). Mantel-haenszel-type inference for cumulative odds ratios with a stratified ordinal response. Biometrics, 52, 1223–1234. CrossRefPubMed
go back to reference Livingstone, S. (2008). Taking risky opportunities in youthful content creation: teenagers use of social networking sites for intimacy, privacy and self-expression. New Media & Society, 10, 393–411. doi: 10.​1177/​1461444808089415​. CrossRef Livingstone, S. (2008). Taking risky opportunities in youthful content creation: teenagers use of social networking sites for intimacy, privacy and self-expression. New Media & Society, 10, 393–411. doi: 10.​1177/​1461444808089415​. CrossRef
go back to reference Mellor, D., & Stokes, M. (2007). The factor structure of the strengths and difficulties questionnaire. European Journal of Psychological Assessment, 23, 105–112. CrossRef Mellor, D., & Stokes, M. (2007). The factor structure of the strengths and difficulties questionnaire. European Journal of Psychological Assessment, 23, 105–112. CrossRef
go back to reference Mojtabai, R. (2006). Serious emotional and behavioral problems and mental health contacts in American and British children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 1215–1223. CrossRefPubMed Mojtabai, R. (2006). Serious emotional and behavioral problems and mental health contacts in American and British children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 1215–1223. CrossRefPubMed
go back to reference Mullick, M. S., & Goodman, R. (2001). Questionnaire screening for mental health problems in Bangladeshi children: a preliminary study. Social Psychiatry and Psychiatric Epidemiology, 36, 94–99. CrossRefPubMed Mullick, M. S., & Goodman, R. (2001). Questionnaire screening for mental health problems in Bangladeshi children: a preliminary study. Social Psychiatry and Psychiatric Epidemiology, 36, 94–99. CrossRefPubMed
go back to reference Muthén, L. K., & Muthén, B. O. (2012). Mplus User's Guide, 7th Edn. Los Angeles, CA:Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (2012). Mplus User's Guide, 7th Edn. Los Angeles, CA:Muthén & Muthén.
go back to reference Obel, C., Heiervang, E., Rodriguez, A., Heyerdahl, S., Smedje, H., Sourander, A.,... Olsen, J. (2004). The strengths and difficulties questionnaire in the Nordic countries. European Child & Adolescent Psychiatry, 13, ii32-ii39. doi: 10.​1007/​s00787-004-2006-2. Obel, C., Heiervang, E., Rodriguez, A., Heyerdahl, S., Smedje, H., Sourander, A.,... Olsen, J. (2004). The strengths and difficulties questionnaire in the Nordic countries. European Child & Adolescent Psychiatry, 13, ii32-ii39. doi: 10.​1007/​s00787-004-2006-2.
go back to reference Patalay, P., Deighton, J., Fonagy, P., & Wolpert, M. (2015). Equivalence of paper and computer formats of a child self-report mental health measure. European Journal of Psychological Assessment, 31, 54-61. Patalay, P., Deighton, J., Fonagy, P., & Wolpert, M. (2015). Equivalence of paper and computer formats of a child self-report mental health measure. European Journal of Psychological Assessment, 31, 54-61.
go back to reference Penfield, R., & Algina, J. (2006). A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests. Journal of Educational Measurement, 43, 295–312. CrossRef Penfield, R., & Algina, J. (2006). A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests. Journal of Educational Measurement, 43, 295–312. CrossRef
go back to reference Raykov, T., Marcoulides, G. A., & Li, C.-H. (2012). Measurement invariance for latent constructs in multiple populations a critical view and refocus. Educational and Psychological Measurement, 72, 954–974. CrossRef Raykov, T., Marcoulides, G. A., & Li, C.-H. (2012). Measurement invariance for latent constructs in multiple populations a critical view and refocus. Educational and Psychological Measurement, 72, 954–974. CrossRef
go back to reference Rønning, J. A., Handegaard, B. H., Sourander, A., & Mørch, W.-T. (2004). The strengths and difficulties self-report questionnaire as a screening instrument in Norwegian community samples. European Child & Adolescent Psychiatry, 13, 73–82. CrossRef Rønning, J. A., Handegaard, B. H., Sourander, A., & Mørch, W.-T. (2004). The strengths and difficulties self-report questionnaire as a screening instrument in Norwegian community samples. European Child & Adolescent Psychiatry, 13, 73–82. CrossRef
go back to reference Ronning, J. A., Handegaard, B. H., Sourander, A., & Morch, W. T. (2004). The strengths and difficulties self-report questionnaire as a screening instrument in Norwegian community samples. European Child & Adolescent Psychiatry, 13, 73–82. CrossRef Ronning, J. A., Handegaard, B. H., Sourander, A., & Morch, W. T. (2004). The strengths and difficulties self-report questionnaire as a screening instrument in Norwegian community samples. European Child & Adolescent Psychiatry, 13, 73–82. CrossRef
go back to reference Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39, 33–38. Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39, 33–38.
go back to reference StataCorp (2011). Stata Statistical Software: Release 12. College Station:StataCorp LP. StataCorp (2011). Stata Statistical Software: Release 12. College Station:StataCorp LP.
go back to reference Suler, J. (2004). The online disinhibition effect. Cyber Psychology and Behavior, 7, 321–333. CrossRef Suler, J. (2004). The online disinhibition effect. Cyber Psychology and Behavior, 7, 321–333. CrossRef
go back to reference Wijndaele, K., Matton, L., Duvigneaud, N., Lefevre, J., Duquet, W., Thomis, M.,... Philippaerts, R. (2007). Reliability, equivalence and respondent preference of computerized versus paper-and-pencil mental health questionnaires. Computers in Human Behavior, 23, 1958–1970. doi: 10.​1016/​j.​chb.​2006.​02.​005. Wijndaele, K., Matton, L., Duvigneaud, N., Lefevre, J., Duquet, W., Thomis, M.,... Philippaerts, R. (2007). Reliability, equivalence and respondent preference of computerized versus paper-and-pencil mental health questionnaires. Computers in Human Behavior, 23, 1958–1970. doi: 10.​1016/​j.​chb.​2006.​02.​005.
go back to reference Wolpert, M., Cheng, H., & Deighton, J. (2015). Measurement issues: review of four patient reported outcome measures: SDQ, RCADS, CORS and GBO–their strengths and limitations for clinical use and service evaluation. Child and Adolescent Mental Health, 20, 63–70. Wolpert, M., Cheng, H., & Deighton, J. (2015). Measurement issues: review of four patient reported outcome measures: SDQ, RCADS, CORS and GBO–their strengths and limitations for clinical use and service evaluation. Child and Adolescent Mental Health, 20, 63–70.
go back to reference Wolpert, M., Görzig, A., Deighton, J., Fugard, A. J. B., Newman, R., & Ford, T. (2015). Comparison of indices of clinically meaningful change in child and adolescent mental health services: Difference scores, reliable change, crossing clinical thresholds and ‘added value’ – an exploration using parent rated scores on the SDQ. Child and Adolescent Mental Health, 20, 94–101. doi: 10.​1111/​camh.​12080. CrossRef Wolpert, M., Görzig, A., Deighton, J., Fugard, A. J. B., Newman, R., & Ford, T. (2015). Comparison of indices of clinically meaningful change in child and adolescent mental health services: Difference scores, reliable change, crossing clinical thresholds and ‘added value’ – an exploration using parent rated scores on the SDQ. Child and Adolescent Mental Health, 20, 94–101. doi: 10.​1111/​camh.​12080. CrossRef
Metagegevens
Titel
A Comparison of Paper and Computer Administered Strengths and Difficulties Questionnaire
Auteurs
Praveetha Patalay
Daniel Hayes
Jessica Deighton
Miranda Wolpert
Publicatiedatum
13-08-2015
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 2/2016
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-015-9507-9