Skip to main content
Top
Gepubliceerd in: Journal of Child and Family Studies 9/2020

24-06-2020 | Original Paper

Psychometric Evaluation of the Big Five Questionnaire for Children (BFQ-C): A Rasch Model Approach

Auteurs: Marcos Cupani, Valeria E. Morán, Fernanda B. Ghío, Ana E. Azpilicueta, Sebastián J. Garrido

Gepubliceerd in: Journal of Child and Family Studies | Uitgave 9/2020

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The Big Five Questionnaire for Children, (BFQ-C) is an instrument for personality assessment in children and adolescents widely used worldwide. The aim of this work was to study the psychometric properties of the instrument scores from the item response theory (IRT) perspective. We worked with a Partial Credit Rasch Model to analyze an Argentinean sample to validate the scale for its use in this population. We opted for an instrumental design, and for each factor we applied an item calibration plan consisting of different analysis: unidimensionality, classification of response categories, fit levels of items and persons, specific objectivity, and differential item functioning as regards sex. We worked with a sample of 1162 high school students aged 12–17 years. The five original subscales did not show satisfactory fit, so modifications were made to improve their properties. As a result, we could demonstrate that each subscale measures a single latent trait, meets the invariance assumption regarding the sample and the assumption of local independence, showing no sex differential item functioning (DIF). Finally, the ordinal scores were converted to an interval scale, which allows more accurate analysis and better confidence in outcomes. Our results showed that the five subscales corresponding to each factor were in line with the IRT key parameters, although we suggest further studies on both the test capacity to assess extreme scores and the relevance of using a five-response category scoring.
Literatuur
go back to reference Abad, F. J., Olea, J., Aguado, D., Ponsoda, V., & Barrada, J. R. (2010). Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT (Deterioration of the parameters of the items in computerized adaptive tests: study with eCAT). Psicothema, 22(2), 340–347. http://goo.gl/fAjIj6. Abad, F. J., Olea, J., Aguado, D., Ponsoda, V., & Barrada, J. R. (2010). Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT (Deterioration of the parameters of the items in computerized adaptive tests: study with eCAT). Psicothema, 22(2), 340–347. http://​goo.​gl/​fAjIj6.
go back to reference Abedalaziz, N., & Leng, C. H. (2018). The relationship between CTT and IRT approaches in analyzing item characteristics. Malaysian Online Journal of Educational Sciences, 1(1), 64–70. https://bit.ly/2Z2IgKC. Abedalaziz, N., & Leng, C. H. (2018). The relationship between CTT and IRT approaches in analyzing item characteristics. Malaysian Online Journal of Educational Sciences, 1(1), 64–70. https://​bit.​ly/​2Z2IgKC.
go back to reference Andrich, D., Sheridan, B. & Luo, G. (2010). Rasch models for measurement: RUMM2030. Perth: RUMM Laboratory Pty Ltd. Andrich, D., Sheridan, B. & Luo, G. (2010). Rasch models for measurement: RUMM2030. Perth: RUMM Laboratory Pty Ltd.
go back to reference Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: fundamental measurement in the human sciences (3rd ed.). New York: Routledge/Taylor & Francis Group. Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: fundamental measurement in the human sciences (3rd ed.). New York: Routledge/Taylor & Francis Group.
go back to reference Bore, M., Laurens, K. R., Hobbs, M. J., Green, M. J., Tzoumakis, S., Harris, F., & Carr, V. J. (2018). Item response theory analysis of the Big Five Questionnaire for Children–Short Form (BFC-SF): a self-report measure of personality in children aged 11–12 years. Journal of Personality Disorders, 1–24. https://doi.org/10.1521/pedi_2018_32_380. Bore, M., Laurens, K. R., Hobbs, M. J., Green, M. J., Tzoumakis, S., Harris, F., & Carr, V. J. (2018). Item response theory analysis of the Big Five Questionnaire for Children–Short Form (BFC-SF): a self-report measure of personality in children aged 11–12 years. Journal of Personality Disorders, 1–24. https://​doi.​org/​10.​1521/​pedi_​2018_​32_​380.
go back to reference Briggs, D. C., & Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4(1), 87–100. https://bit.ly/2LCIoZ7. Briggs, D. C., & Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4(1), 87–100. https://​bit.​ly/​2LCIoZ7.
go back to reference Chahín-Pinzón, N. (2014). Aspectos a tener en cuenta cuando se realiza una adaptación de test entre diferentes culturas (Aspects to take into account when performing a test adaptation between different cultures). Psychología: Avances de la Disciplina, 8(2), 109–112. https://doi.org/10.21500/19002386.1225.CrossRef Chahín-Pinzón, N. (2014). Aspectos a tener en cuenta cuando se realiza una adaptación de test entre diferentes culturas (Aspects to take into account when performing a test adaptation between different cultures). Psychología: Avances de la Disciplina, 8(2), 109–112. https://​doi.​org/​10.​21500/​19002386.​1225.CrossRef
go back to reference Chahín-Pinzón, N., Lorenzo-Seva, U., & Vigil-Colet, A. (2012). Características psicométricas de la adaptación colombiana del Cuestionario de Agresividad de Buss y Perry en una muestra de preadolescentes y adolescentes de Bucaramanga (Psychometric characteristics of the Colombian adaptation of the Buss and Perry Aggression Questionnaire in a sample of preadolescents and adolescents from Bucaramanga). Universitas Psychologica, 11(3), 979–988. https://bit.ly/3cEsysU https://bit.ly/3cEsysU.CrossRef Chahín-Pinzón, N., Lorenzo-Seva, U., & Vigil-Colet, A. (2012). Características psicométricas de la adaptación colombiana del Cuestionario de Agresividad de Buss y Perry en una muestra de preadolescentes y adolescentes de Bucaramanga (Psychometric characteristics of the Colombian adaptation of the Buss and Perry Aggression Questionnaire in a sample of preadolescents and adolescents from Bucaramanga). Universitas Psychologica, 11(3), 979–988. https://​bit.​ly/​3cEsysU https://​bit.​ly/​3cEsysU.CrossRef
go back to reference Cupani, M., & Ruarte, M. (2008). Propiedades psicométricas del Cuestionario de los Cinco Factores para Niños (BFQ-C) en una muestra de adolescentes argentinos (Psychometric properties of the Five-Factor Questionnaire for Children (BFQ-C) in a sample of Argentine adolescents). Estudios de Psicología, 29(3), 351–364. https://doi.org/10.1174/021093908786145421.CrossRef Cupani, M., & Ruarte, M. (2008). Propiedades psicométricas del Cuestionario de los Cinco Factores para Niños (BFQ-C) en una muestra de adolescentes argentinos (Psychometric properties of the Five-Factor Questionnaire for Children (BFQ-C) in a sample of Argentine adolescents). Estudios de Psicología, 29(3), 351–364. https://​doi.​org/​10.​1174/​0210939087861454​21.CrossRef
go back to reference Del Barrio, M. V., Carrasco, M. A., & Holgado, P. (2006). BFQ-NA cuestionario de los Cinco Grandes para niños y adolescentes (adaptación a la población española) [BFQ-NA questionnaire of the Big Five for children and adolescents (adaptation to the Spanish population)]. Madrid: TEA. Del Barrio, M. V., Carrasco, M. A., & Holgado, P. (2006). BFQ-NA cuestionario de los Cinco Grandes para niños y adolescentes (adaptación a la población española) [BFQ-NA questionnaire of the Big Five for children and adolescents (adaptation to the Spanish population)]. Madrid: TEA.
go back to reference Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. New Jersey: LEA. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. New Jersey: LEA.
go back to reference Engelhard Jr., G. (2013). Invariant measurement: using Rasch models in the social, behavioral, and health sciences. New York: Routledge. Engelhard Jr., G. (2013). Invariant measurement: using Rasch models in the social, behavioral, and health sciences. New York: Routledge.
go back to reference John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big-Five trait taxonomy: history, measurement, and conceptual issues. In O. P. John, R. W. Robins & L. A. Pervin (Eds.), Handbook of personality: theory and research (pp. 114–158). New York: Guilford Press. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big-Five trait taxonomy: history, measurement, and conceptual issues. In O. P. John, R. W. Robins & L. A. Pervin (Eds.), Handbook of personality: theory and research (pp. 114–158). New York: Guilford Press.
go back to reference Maples-Keller, J. L., Williamson, R. L., Sleep, C. E., Carter, N. T., Campbell, W. K., & Miller, J. D. (2017). Using item response theory to develop a 60-item representation of the NEO PI–R using the international personality item pool: development of the IPIP–NEO–60. Journal of Personality Assessment, 1–12. https://doi.org/10.1080/00223891.2017.1381968. Maples-Keller, J. L., Williamson, R. L., Sleep, C. E., Carter, N. T., Campbell, W. K., & Miller, J. D. (2017). Using item response theory to develop a 60-item representation of the NEO PI–R using the international personality item pool: development of the IPIP–NEO–60. Journal of Personality Assessment, 1–12. https://​doi.​org/​10.​1080/​00223891.​2017.​1381968.
go back to reference Morizot, J. (2015). 10 The Contribution of temperament and personality traits to criminal and antisocial behavior development and desistance. In J. Morizot & L. Kazemian (eds), The development of criminal and antisocial behavior (pp. 137–165). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-08720-7. Morizot, J. (2015). 10 The Contribution of temperament and personality traits to criminal and antisocial behavior development and desistance. In J. Morizot & L. Kazemian (eds), The development of criminal and antisocial behavior (pp. 137–165). Cham: Springer International Publishing. https://​doi.​org/​10.​1007/​978-3-319-08720-7.​
go back to reference Nieto, M. D., Abad, F. J., Hernández-Camacho, A., Garrido, L. E., Barrada, J. R., Aguado, D., & Olea, J. (2017). Calibrating a new item pool to adaptively assess the Big Five. Psicothema, 29(3), 390–395. https://bit.ly/2T7bJiw.PubMed Nieto, M. D., Abad, F. J., Hernández-Camacho, A., Garrido, L. E., Barrada, J. R., Aguado, D., & Olea, J. (2017). Calibrating a new item pool to adaptively assess the Big Five. Psicothema, 29(3), 390–395. https://​bit.​ly/​2T7bJiw.​PubMed
go back to reference Parkitny, L., McAuley, J. H., Walton, D., Costa, L. O. P., Refshauge, K. M., Wand, B. M., Di Pietro, F., & Moseley, G. L. (2012). Rasch analysis supports the use of the depression, anxiety, and stress scales to measure mood in groups but not in individuals with chronic low back pain. Journal of Clinical Epidemiology, 65(2), 189–198. https://doi.org/10.1016/j.jclinepi.2011.05.010.CrossRefPubMed Parkitny, L., McAuley, J. H., Walton, D., Costa, L. O. P., Refshauge, K. M., Wand, B. M., Di Pietro, F., & Moseley, G. L. (2012). Rasch analysis supports the use of the depression, anxiety, and stress scales to measure mood in groups but not in individuals with chronic low back pain. Journal of Clinical Epidemiology, 65(2), 189–198. https://​doi.​org/​10.​1016/​j.​jclinepi.​2011.​05.​010.CrossRefPubMed
go back to reference Ramada-Rodilla, J. M., Serra-Pujadas, C., & Delclós-Clanchet, G. L. (2013). Adaptación cultural y validación de cuestionarios de salud: revisión y recomendaciones metodológicas (Cultural adaptation and validation of health questionnaires: review and methodological recommendations). Salud pública de México, 55, 57–66. https://doi.org/10.1590/s0036-36342013000100009.CrossRefPubMed Ramada-Rodilla, J. M., Serra-Pujadas, C., & Delclós-Clanchet, G. L. (2013). Adaptación cultural y validación de cuestionarios de salud: revisión y recomendaciones metodológicas (Cultural adaptation and validation of health questionnaires: review and methodological recommendations). Salud pública de México, 55, 57–66. https://​doi.​org/​10.​1590/​s0036-3634201300010000​9.CrossRefPubMed
go back to reference Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhague: Danish Institute for Educational Research. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhague: Danish Institute for Educational Research.
go back to reference Samejima, F. (1997). Graded response model. In W. J. Van Der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85–100). New York: Springer. Samejima, F. (1997). Graded response model. In W. J. Van Der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85–100). New York: Springer.
go back to reference Smith, E. V. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.PubMed Smith, E. V. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.PubMed
go back to reference Tennant, A., & Pallant, J. F. (2006). Unidimensionality matters! (A tale of two Smiths?). Rasch Measurement Transactions, 20, 1048–1051. Tennant, A., & Pallant, J. F. (2006). Unidimensionality matters! (A tale of two Smiths?). Rasch Measurement Transactions, 20, 1048–1051.
go back to reference Tennant, A., & Pallant, J. F. (2012). The root mean square error of approximation (RMSEA) as a supplementary statistic to determine fit to the Rasch model with large sample sizes. Rasch Measurement Transactions, 25, 1348–1349. Tennant, A., & Pallant, J. F. (2012). The root mean square error of approximation (RMSEA) as a supplementary statistic to determine fit to the Rasch model with large sample sizes. Rasch Measurement Transactions, 25, 1348–1349.
go back to reference Twiss, J., McKenna, S. P., Graham, J., Swetz, K., Sloan, J., & Gomberg-Maitland, M. (2016). Applying Rasch analysis to evaluate measurement equivalence of different administration formats of the Activity Limitation scale of the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR). Health and Quality of Life Outcomes, 14(1). https://doi.org/10.1186/s12955-016-0462-2. Twiss, J., McKenna, S. P., Graham, J., Swetz, K., Sloan, J., & Gomberg-Maitland, M. (2016). Applying Rasch analysis to evaluate measurement equivalence of different administration formats of the Activity Limitation scale of the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR). Health and Quality of Life Outcomes, 14(1). https://​doi.​org/​10.​1186/​s12955-016-0462-2.
go back to reference Wright, B. D., & Stone, M. H. (2004). Making measures. Chicago: Phaneron Press. Wright, B. D., & Stone, M. H. (2004). Making measures. Chicago: Phaneron Press.
go back to reference Zickar, M. J., & Broadfoot, A. A. (2009). The partial revival of a dead horse? Comparing classical test theory and item response theory. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: doctrine, verity, and fable in the organizational and social sciences (pp. 37–59). New York: Routledge. Zickar, M. J., & Broadfoot, A. A. (2009). The partial revival of a dead horse? Comparing classical test theory and item response theory. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: doctrine, verity, and fable in the organizational and social sciences (pp. 37–59). New York: Routledge.
go back to reference Zuffian, A., Alessandri, G., Gerbino, M., Luengo Kanacri, B. P., Di Giunta, L., Milioni, M., & Caprara, G. V. (2013). Academic achievement: The unique contribution of self-efficacy beliefs in self-regulated learning beyond intelligence, personality traits, and self-esteem. Learning and Individual Differences, 23(1), 158–162. https://doi.org/10.1016/j.lindif.2012.07.010.CrossRef Zuffian, A., Alessandri, G., Gerbino, M., Luengo Kanacri, B. P., Di Giunta, L., Milioni, M., & Caprara, G. V. (2013). Academic achievement: The unique contribution of self-efficacy beliefs in self-regulated learning beyond intelligence, personality traits, and self-esteem. Learning and Individual Differences, 23(1), 158–162. https://​doi.​org/​10.​1016/​j.​lindif.​2012.​07.​010.CrossRef
Metagegevens
Titel
Psychometric Evaluation of the Big Five Questionnaire for Children (BFQ-C): A Rasch Model Approach
Auteurs
Marcos Cupani
Valeria E. Morán
Fernanda B. Ghío
Ana E. Azpilicueta
Sebastián J. Garrido
Publicatiedatum
24-06-2020
Uitgeverij
Springer US
Gepubliceerd in
Journal of Child and Family Studies / Uitgave 9/2020
Print ISSN: 1062-1024
Elektronisch ISSN: 1573-2843
DOI
https://doi.org/10.1007/s10826-020-01752-y

Andere artikelen Uitgave 9/2020

Journal of Child and Family Studies 9/2020 Naar de uitgave