Skip to main content
Top
Gepubliceerd in:

30-06-2018 | Original Article

Identifying Psychosocial Problems Among Children and Youth in the Child Welfare System Using the PSC-17: Exploring Convergent and Discriminant Validity with Multiple Informants

Auteurs: Elizabeth M. Parker, Jedediah Jacobson, Michael D. Pullmann, Suzanne E. U. Kerns

Gepubliceerd in: Child Psychiatry & Human Development | Uitgave 1/2019

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Youth who enter foster care are at risk of mental health need, but questions arise as to the validity of their self-reported symptomatology. This study examines the screening validity of the youth-report version of the Pediatric Symptom Checklist-17 (PSC-17) in a child welfare population. Data come from 2389 youth who completed a version of the PSC-17 adapted for youth report, and their biological and foster parents who completed the parent-report version. Youth also completed a shortened version of the Screen for Child Anxiety Related Disorders (SCARED). Convergent and discriminant validity of the PSC-17 was assessed using multi-trait multi-method matrices. The PSC-17’s internalizing subscale was strongly correlated, attention subscale was moderately correlated, and externalizing subscale was weakly correlated with the SCARED’s anxiety and PTSD subscales. Comparing youth and foster parent scores, the PSC-17 had moderate convergent validity and weak/fair discriminant validity. Comparing youth, foster parent, and biological parent scores, the PSC-17 had moderate convergent validity and weak/fair discriminant validity. The current study provides some support for the validity of the PSC-17 for the population of youth in foster care.
Literatuur
1.
go back to reference U.S. Department of Health and Human Services, Administration on Children, Youth, and Families, Children’s Bureau (2016) The AFCARS Report. 1–6 U.S. Department of Health and Human Services, Administration on Children, Youth, and Families, Children’s Bureau (2016) The AFCARS Report. 1–6
2.
go back to reference Finkelhor D, Turner H, Ormrod R, Hamby SL (2009) Violence, abuse, and crime exposure in a national sample of children and youth. Pediatrics 124(5):1411–1423CrossRefPubMed Finkelhor D, Turner H, Ormrod R, Hamby SL (2009) Violence, abuse, and crime exposure in a national sample of children and youth. Pediatrics 124(5):1411–1423CrossRefPubMed
3.
go back to reference Greeson JKP, Briggs EC, Kisiel CL, Layne CM, Ake GS, Ko SJ et al (2011) Complex trauma and mental health in children and adolescents placed in foster care: findings from the National Child Traumatic Stress Network. Child Welfare 90(6):91PubMed Greeson JKP, Briggs EC, Kisiel CL, Layne CM, Ake GS, Ko SJ et al (2011) Complex trauma and mental health in children and adolescents placed in foster care: findings from the National Child Traumatic Stress Network. Child Welfare 90(6):91PubMed
4.
go back to reference Hurlburt MS, Leslie LK, Landsverk J, Barth RP, Burns BJ, Gibbons RD et al (2004) Contextual predictors of mental health service use among children open to child welfare. Arch Gen Psychiatry 61(12):1217–1224CrossRefPubMedPubMedCentral Hurlburt MS, Leslie LK, Landsverk J, Barth RP, Burns BJ, Gibbons RD et al (2004) Contextual predictors of mental health service use among children open to child welfare. Arch Gen Psychiatry 61(12):1217–1224CrossRefPubMedPubMedCentral
5.
go back to reference Bellis MA, Hughes K, Leckenby N, Perkins C, Lowey H (2014) National household survey of adverse childhood experiences and their relationship with resilience to health-harming behaviors in England. BMC Med 12:72CrossRefPubMedPubMedCentral Bellis MA, Hughes K, Leckenby N, Perkins C, Lowey H (2014) National household survey of adverse childhood experiences and their relationship with resilience to health-harming behaviors in England. BMC Med 12:72CrossRefPubMedPubMedCentral
6.
go back to reference McMillen JC, Zima BT, Scott Jr LD, Auslander WF, Munson MR, Ollie MT, Spitznagel EL (2005) Prevalence of psychiatric disorders among older youths in the foster care system. J Am Acad Child Adolesc Psychiatry 44(1):88–95CrossRefPubMed McMillen JC, Zima BT, Scott Jr LD, Auslander WF, Munson MR, Ollie MT, Spitznagel EL (2005) Prevalence of psychiatric disorders among older youths in the foster care system. J Am Acad Child Adolesc Psychiatry 44(1):88–95CrossRefPubMed
7.
go back to reference Pilowsky DJ, Wu L-T (2006) Psychiatric symptoms and substance use disorders in a nationally representative sample of American adolescents involved with foster care. J Adolesc Health 38(4):351–358CrossRefPubMedPubMedCentral Pilowsky DJ, Wu L-T (2006) Psychiatric symptoms and substance use disorders in a nationally representative sample of American adolescents involved with foster care. J Adolesc Health 38(4):351–358CrossRefPubMedPubMedCentral
8.
go back to reference Yampolskaya S, Sharrock P, Armstrong MI, Strozier A, Swanke J (2014) Profile of children placed in out-of-home care: association with permanency outcomes. Child Youth Serv Rev 36:195–200CrossRef Yampolskaya S, Sharrock P, Armstrong MI, Strozier A, Swanke J (2014) Profile of children placed in out-of-home care: association with permanency outcomes. Child Youth Serv Rev 36:195–200CrossRef
9.
go back to reference Akin BA (2011) Predictors of foster care exits to permanency: a competing risks analysis of reunification, guardianship, and adoption. Child Youth Serv Rev 33(6):999–1011CrossRef Akin BA (2011) Predictors of foster care exits to permanency: a competing risks analysis of reunification, guardianship, and adoption. Child Youth Serv Rev 33(6):999–1011CrossRef
10.
go back to reference Koh E, Rolock N, Cross TP, Eblen-Manning J (2013) What explains instability in foster care? Comparison of a matched sample of children with stable and unstable placements. Child Youth Serv Rev 37:36–45CrossRef Koh E, Rolock N, Cross TP, Eblen-Manning J (2013) What explains instability in foster care? Comparison of a matched sample of children with stable and unstable placements. Child Youth Serv Rev 37:36–45CrossRef
11.
12.
go back to reference Raghavan R, Zima BT, Andersen RM, Leibowitz AA, Schuster MA, Landsverk J (2005) Psychotropic medication use in a national probability sample of children in the child welfare system. J Child Adolesc Psychopharmacol 15(1):97–106CrossRefPubMed Raghavan R, Zima BT, Andersen RM, Leibowitz AA, Schuster MA, Landsverk J (2005) Psychotropic medication use in a national probability sample of children in the child welfare system. J Child Adolesc Psychopharmacol 15(1):97–106CrossRefPubMed
13.
go back to reference Halemba G, Siegel G (2011) Doorways to Delinquency: multi-system involvement of delinquent youth in King County. National Center for Juvenile Justice, Pittsburgh Halemba G, Siegel G (2011) Doorways to Delinquency: multi-system involvement of delinquent youth in King County. National Center for Juvenile Justice, Pittsburgh
14.
go back to reference Hayek M, Mackie TI, Mule CM, Bellonci C, Hyde J, Bakan JS, Leslie LK (2014) A multi-state study on mental health evaluation for children entering foster care. Adm Policy Ment Health 41(4):552–567CrossRefPubMed Hayek M, Mackie TI, Mule CM, Bellonci C, Hyde J, Bakan JS, Leslie LK (2014) A multi-state study on mental health evaluation for children entering foster care. Adm Policy Ment Health 41(4):552–567CrossRefPubMed
15.
go back to reference Kerns SEU, Pullmann MD, Negrete A, Uomoto JA, Berliner L, Shogren D et al (2016) Development and implementation of a child welfare workforce strategy to build a trauma-informed system of support for foster care. Child Maltreat 21(2):135–146CrossRefPubMed Kerns SEU, Pullmann MD, Negrete A, Uomoto JA, Berliner L, Shogren D et al (2016) Development and implementation of a child welfare workforce strategy to build a trauma-informed system of support for foster care. Child Maltreat 21(2):135–146CrossRefPubMed
16.
go back to reference Kerns SEU, Pullmann MD, Putnam B, Buher A, Holland S, Berliner L et al (2014) Child welfare and mental health: facilitators of and barriers to connecting children and youths in out-of-home care with effective mental health treatment. Child Youth Serv Rev 46(0):315–324CrossRef Kerns SEU, Pullmann MD, Putnam B, Buher A, Holland S, Berliner L et al (2014) Child welfare and mental health: facilitators of and barriers to connecting children and youths in out-of-home care with effective mental health treatment. Child Youth Serv Rev 46(0):315–324CrossRef
17.
go back to reference McCrae JS, Brown SM (2017) Systematic review of social–emotional screening instruments for young children in child welfare. Res Soc Work Pract 104973151668669 McCrae JS, Brown SM (2017) Systematic review of social–emotional screening instruments for young children in child welfare. Res Soc Work Pract 104973151668669
18.
go back to reference Gardner W, Murphy M, Childs G, Kelleher K, Pagano M, Jellinek M et al (1999) The PSC-17: a brief pediatric symptom checklist with psychosocial problem subscales. Ambul Child Health 5(3):225–236 Gardner W, Murphy M, Childs G, Kelleher K, Pagano M, Jellinek M et al (1999) The PSC-17: a brief pediatric symptom checklist with psychosocial problem subscales. Ambul Child Health 5(3):225–236
20.
go back to reference Gardner W, Lucas A, Kolko DJ, Campo JV (2007) Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry 46(5):611–618CrossRefPubMed Gardner W, Lucas A, Kolko DJ, Campo JV (2007) Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. J Am Acad Child Adolesc Psychiatry 46(5):611–618CrossRefPubMed
21.
go back to reference Jellinek MS, Murphy J, Little M, Pagano ME, Comer DM, Kelleher KJ (1999) Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Arch Pediatr Adolesc Med 153(3):254–260CrossRefPubMedPubMedCentral Jellinek MS, Murphy J, Little M, Pagano ME, Comer DM, Kelleher KJ (1999) Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study. Arch Pediatr Adolesc Med 153(3):254–260CrossRefPubMedPubMedCentral
22.
go back to reference Dorsey S, Kerns SEU, Trupin EW, Conover KL, Berliner L (2012) Child welfare caseworkers as service brokers for youth in foster care. Child Maltreat 17(1):22–31CrossRefPubMed Dorsey S, Kerns SEU, Trupin EW, Conover KL, Berliner L (2012) Child welfare caseworkers as service brokers for youth in foster care. Child Maltreat 17(1):22–31CrossRefPubMed
23.
go back to reference Pelham W, Murphy D, Milich R, Murphy H (1989) Normative data on the IOWA Conners teacher rating scale. J Chil Child Psychol 18(1989):259–262CrossRef Pelham W, Murphy D, Milich R, Murphy H (1989) Normative data on the IOWA Conners teacher rating scale. J Chil Child Psychol 18(1989):259–262CrossRef
24.
go back to reference Kostanecka A, Power T, Clarke A, Watkins M, Hausman C, Blum N (2008) Behavioral health screening in urban primary care settings: construct validity of the PSC-17. J Dev Behav Pediatr 29(2):124–128CrossRefPubMed Kostanecka A, Power T, Clarke A, Watkins M, Hausman C, Blum N (2008) Behavioral health screening in urban primary care settings: construct validity of the PSC-17. J Dev Behav Pediatr 29(2):124–128CrossRefPubMed
25.
go back to reference Briggs-Gowan M, Carter A, Schwab-Stone M (1996) Discrepancies among mother, child, and teacher reports: examining the contributions of maternal depression and anxiety. J Abnorm Child Psychol 24(6):749–765CrossRefPubMed Briggs-Gowan M, Carter A, Schwab-Stone M (1996) Discrepancies among mother, child, and teacher reports: examining the contributions of maternal depression and anxiety. J Abnorm Child Psychol 24(6):749–765CrossRefPubMed
26.
go back to reference Duke N, Ireland M, Borowsky IW (2005) Identifying psychosocial problems among youth: factors associated with youth agreement on a positive parent-completed PSC-17. Child: Care Health Dev 31:563–573 Duke N, Ireland M, Borowsky IW (2005) Identifying psychosocial problems among youth: factors associated with youth agreement on a positive parent-completed PSC-17. Child: Care Health Dev 31:563–573
27.
go back to reference Masters JC, Achenbach TM, McConaughy SH, Howell CT (1987) Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 101(2):213–232CrossRef Masters JC, Achenbach TM, McConaughy SH, Howell CT (1987) Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 101(2):213–232CrossRef
28.
go back to reference Darlington Y, Feeney JA, Rixon K (2005) Interagency collaboration between child protection and mental health services: practices, attitudes and barriers. Child Abuse Negl 29(10):1085–1098CrossRefPubMed Darlington Y, Feeney JA, Rixon K (2005) Interagency collaboration between child protection and mental health services: practices, attitudes and barriers. Child Abuse Negl 29(10):1085–1098CrossRefPubMed
29.
go back to reference Chi T, Hinshaw S (2002) Mother–child relationships of children with ADHD: the role of maternal depressive symptoms and depression-related distortions. J Abnorm Child Psychol 30(4):387–400CrossRefPubMed Chi T, Hinshaw S (2002) Mother–child relationships of children with ADHD: the role of maternal depressive symptoms and depression-related distortions. J Abnorm Child Psychol 30(4):387–400CrossRefPubMed
30.
go back to reference Mineka S, Frick PJ, O’Brien BS, Wootton JM, McBurnett K (1994) Psychopathy and conduct problems in children. J Abnorm Psychol 103(4):700–707CrossRef Mineka S, Frick PJ, O’Brien BS, Wootton JM, McBurnett K (1994) Psychopathy and conduct problems in children. J Abnorm Psychol 103(4):700–707CrossRef
31.
go back to reference Seiffge-Krenke I, Kollmar F (1998) Discrepancies between mothers’ and fathers’ perceptions of sons’ and daughters’ problem behaviour: a longitudinal analysis of parent-adolescent agreement on internalising and externalising problem behaviour. J Child Psychol Psychiatry 39(5):687–697CrossRefPubMed Seiffge-Krenke I, Kollmar F (1998) Discrepancies between mothers’ and fathers’ perceptions of sons’ and daughters’ problem behaviour: a longitudinal analysis of parent-adolescent agreement on internalising and externalising problem behaviour. J Child Psychol Psychiatry 39(5):687–697CrossRefPubMed
32.
go back to reference Tarren-Sweeney MJ, Hazell PL, Carr VJ (2004) Are foster parents reliable informants of children’s behaviour problems? Child Care Health Dev 30(2):167–175CrossRefPubMed Tarren-Sweeney MJ, Hazell PL, Carr VJ (2004) Are foster parents reliable informants of children’s behaviour problems? Child Care Health Dev 30(2):167–175CrossRefPubMed
33.
go back to reference Pagano ME, Cassidy LJ, Little M, Murphy JM, Jellinek MS (2000) Identifying psychosocial dysfunction in school-age children: the pediatric symptom checklist as a self-report method. Psychol Sch 37(2):91–106CrossRefPubMedPubMedCentral Pagano ME, Cassidy LJ, Little M, Murphy JM, Jellinek MS (2000) Identifying psychosocial dysfunction in school-age children: the pediatric symptom checklist as a self-report method. Psychol Sch 37(2):91–106CrossRefPubMedPubMedCentral
34.
go back to reference Kerns S, Pullmann MD, Putnam B, Payton L, Buher A, Holland S et al (2014) Child welfare and mental health: facilitators and barriers of connecting children and youth in out-of-home care with effective mental health treatment. Child Youth Serv Rev 46:315–324CrossRef Kerns S, Pullmann MD, Putnam B, Payton L, Buher A, Holland S et al (2014) Child welfare and mental health: facilitators and barriers of connecting children and youth in out-of-home care with effective mental health treatment. Child Youth Serv Rev 46:315–324CrossRef
35.
go back to reference Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M (1999) Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry 38(10):1230–1236CrossRefPubMed Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M (1999) Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry 38(10):1230–1236CrossRefPubMed
36.
go back to reference Muris P, Merckelbach H, Korver P, Meesters C (2000) SCARED brief assessment of anxiety and PTS symptoms (ages 7–17) Muris P, Merckelbach H, Korver P, Meesters C (2000) SCARED brief assessment of anxiety and PTS symptoms (ages 7–17)
37.
go back to reference IBM Corp (2010) IBM SPSS statistics for windows (Version 19.0). Armonk IBM Corp (2010) IBM SPSS statistics for windows (Version 19.0). Armonk
38.
go back to reference Williams EJ (1959) The comparison of regression variables. J R Stat Soc B 21(2):396–399 Williams EJ (1959) The comparison of regression variables. J R Stat Soc B 21(2):396–399
39.
go back to reference Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43:543–549CrossRefPubMed Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43:543–549CrossRefPubMed
40.
go back to reference Banerjee M, Capozzoli M, McSweeney L, Sinha D (1999) Beyond kappa: a review of interrater agreement measures. Can J Stat 27(1):3–23CrossRef Banerjee M, Capozzoli M, McSweeney L, Sinha D (1999) Beyond kappa: a review of interrater agreement measures. Can J Stat 27(1):3–23CrossRef
41.
go back to reference Hutchinson TP (1993) Kappa muddles together two sources of disagreement: tetrachoric correlation is preferable. Res Nurs Health 16(4):313–316CrossRefPubMed Hutchinson TP (1993) Kappa muddles together two sources of disagreement: tetrachoric correlation is preferable. Res Nurs Health 16(4):313–316CrossRefPubMed
42.
go back to reference Becker S, Marshall S, McBurnett K (2014) Sluggish cognitive tempo in abnormal child psychology: an historical overview and introduction to the special section. J Abnorm Child Psychol 42(1):1–6CrossRefPubMed Becker S, Marshall S, McBurnett K (2014) Sluggish cognitive tempo in abnormal child psychology: an historical overview and introduction to the special section. J Abnorm Child Psychol 42(1):1–6CrossRefPubMed
43.
go back to reference Cohen J (1960) A coefficients of agreement for nominal scales. Edu Psychol Meas 20:37–46CrossRef Cohen J (1960) A coefficients of agreement for nominal scales. Edu Psychol Meas 20:37–46CrossRef
44.
go back to reference Kuhn C, Aebi M, Jakobsen H, Banaschewski T, Poustka L, Grimmer Y et al (2017) Effective mental health screening in adolescents: should we collect data from youth, parents or both? Child Psychiatry Hum Dev 48(3):385–392CrossRefPubMed Kuhn C, Aebi M, Jakobsen H, Banaschewski T, Poustka L, Grimmer Y et al (2017) Effective mental health screening in adolescents: should we collect data from youth, parents or both? Child Psychiatry Hum Dev 48(3):385–392CrossRefPubMed
45.
go back to reference De Los Reyes A, Kazdin AE (2005) Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol Bull 131(4):483–509CrossRefPubMed De Los Reyes A, Kazdin AE (2005) Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol Bull 131(4):483–509CrossRefPubMed
46.
go back to reference Trout AL, Hoffman S, Epstein MH, Thompson RW (2014) Family teacher and parent perceptions of youth needs and preparedness for transition upon discharge from residential care. J Soc Work 14(6):594–604CrossRef Trout AL, Hoffman S, Epstein MH, Thompson RW (2014) Family teacher and parent perceptions of youth needs and preparedness for transition upon discharge from residential care. J Soc Work 14(6):594–604CrossRef
47.
go back to reference Becker A, Hagenberg N, Roessner V, Woerner W, Rothenberger A (2004) Evaluation of the self-reported SDQ in a clinical setting: do self-reports tell us more than ratings by adult informants? Eur Child Adolesc Psychiatry 13(2):ii17–ii24PubMed Becker A, Hagenberg N, Roessner V, Woerner W, Rothenberger A (2004) Evaluation of the self-reported SDQ in a clinical setting: do self-reports tell us more than ratings by adult informants? Eur Child Adolesc Psychiatry 13(2):ii17–ii24PubMed
48.
go back to reference Sawyer MG, Baghurst P, Mathias J (1992) Differences between informants’ reports describing emotional and behavioural problems in community and clinic-referred children: a research note. J Child Psychol Psychiatry 33(2):441–449CrossRefPubMed Sawyer MG, Baghurst P, Mathias J (1992) Differences between informants’ reports describing emotional and behavioural problems in community and clinic-referred children: a research note. J Child Psychol Psychiatry 33(2):441–449CrossRefPubMed
49.
go back to reference Jee SH, Szilagyi M, Conn A-M, Nilsen W, Toth S, Baldwin CD, Szilagyi PG (2011) Validating office-based screening for psychosocial strengths and difficulties among youths in foster care. Pediatrics 127(5):904CrossRefPubMed Jee SH, Szilagyi M, Conn A-M, Nilsen W, Toth S, Baldwin CD, Szilagyi PG (2011) Validating office-based screening for psychosocial strengths and difficulties among youths in foster care. Pediatrics 127(5):904CrossRefPubMed
Metagegevens
Titel
Identifying Psychosocial Problems Among Children and Youth in the Child Welfare System Using the PSC-17: Exploring Convergent and Discriminant Validity with Multiple Informants
Auteurs
Elizabeth M. Parker
Jedediah Jacobson
Michael D. Pullmann
Suzanne E. U. Kerns
Publicatiedatum
30-06-2018
Uitgeverij
Springer US
Gepubliceerd in
Child Psychiatry & Human Development / Uitgave 1/2019
Print ISSN: 0009-398X
Elektronisch ISSN: 1573-3327
DOI
https://doi.org/10.1007/s10578-018-0824-6

Andere artikelen Uitgave 1/2019

Child Psychiatry & Human Development 1/2019 Naar de uitgave