Skip to main content
Top
Gepubliceerd in: Journal of Autism and Developmental Disorders 11/2021

14-01-2021 | Original Paper

Content Validity Evidence for the Verbal Behavior Milestones Assessment and Placement Program

Auteurs: Kristen L. Padilla, Jessica S. Akers

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 11/2021

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The purpose of this study is to provide content validity evidence for the Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP). A national panel of 13 experts provided an evaluation of the domain relevance, age appropriateness, method of measurement appropriateness, and domain representation across the three levels of the Milestones Assessment, Early Echoic Skills Assessment (EESA), and Barriers Assessment. Overall, the content validity evidence for the VB-MAPP Milestones, EESA, and Barriers Assessment was moderate to strong across the evaluated areas although there were areas with limited or conflicting support. The evidence suggests that the scores of the VB-MAPP provide information relevant to the target behaviors of interest but a few domains may not be fully represented by their specific items.
Literatuur
go back to reference Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavioral Education, 28, 362–388.CrossRef Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavioral Education, 28, 362–388.CrossRef
go back to reference American Educational Research Association, American Psychological Association, and National Council on Measurement in education, & Joint Committee on Standards for Educational and Psychological Testing. (2014). Standards or educational and psychological testing. AERA American Educational Research Association, American Psychological Association, and National Council on Measurement in education, & Joint Committee on Standards for Educational and Psychological Testing. (2014). Standards or educational and psychological testing. AERA
go back to reference Anastasi, A. (1988). Psychological testing. New York: MacMillan Publishing Company. Anastasi, A. (1988). Psychological testing. New York: MacMillan Publishing Company.
go back to reference Austin, K., & Thomas, J. (2017, May). Administering assessments for comprehensive behavior analytic programs: Analyzing practitioner skills and reliability. Symposium at the 43rd Annual Convention for the Association for Behavior Analysis International, Denver, CO. Austin, K., & Thomas, J. (2017, May). Administering assessments for comprehensive behavior analytic programs: Analyzing practitioner skills and reliability. Symposium at the 43rd Annual Convention for the Association for Behavior Analysis International, Denver, CO.
go back to reference Axelrod, S., McElrath, K. K., & Wine, B. (2012). Applied behavior analysis: Autism and beyond. Behavioral Interventions, 27, 1–15.CrossRef Axelrod, S., McElrath, K. K., & Wine, B. (2012). Applied behavior analysis: Autism and beyond. Behavioral Interventions, 27, 1–15.CrossRef
go back to reference Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17(1), 10–17.CrossRef Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17(1), 10–17.CrossRef
go back to reference Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Boston: Pearson Education Inc. Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Boston: Pearson Education Inc.
go back to reference Cramér, H. (1946). A contribution to the theory of statistical estimation. Scandinavian Actuarial Journal, 1946(1), 85–94.CrossRef Cramér, H. (1946). A contribution to the theory of statistical estimation. Scandinavian Actuarial Journal, 1946(1), 85–94.CrossRef
go back to reference Crocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rinehart, and Winston. Crocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rinehart, and Winston.
go back to reference Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443–507). New York: American Council on Education. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443–507). New York: American Council on Education.
go back to reference Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281.CrossRef Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281.CrossRef
go back to reference DeSouza, A. A., Akers, J. S., & Fisher, W. W. (2017). Empirical application of Skinner’s Verbal behavior to interventions for children with autism: A review. The Analysis of Verbal Behavior, 33(2), 229–259.CrossRef DeSouza, A. A., Akers, J. S., & Fisher, W. W. (2017). Empirical application of Skinner’s Verbal behavior to interventions for children with autism: A review. The Analysis of Verbal Behavior, 33(2), 229–259.CrossRef
go back to reference Dixon, M. R. (2014). The PEAK relational training system. Carbondale: Shawnee Scientific Press. Dixon, M. R. (2014). The PEAK relational training system. Carbondale: Shawnee Scientific Press.
go back to reference Ebel, R. L. (1956). Obtaining and reporting evidence on content validity. Educational and Psychological Measurement, 16(3), 269–282.CrossRef Ebel, R. L. (1956). Obtaining and reporting evidence on content validity. Educational and Psychological Measurement, 16(3), 269–282.CrossRef
go back to reference Esch, B. E. (2014). Early echoic skills assessment (EESA). In M. L. Sundberg (Ed.), VB-MAPP: Verbal behavior milestones assessment and placement program: A language and social skills assessment program for children with autism or other developmental disabilities (2nd ed., pp. 42–48). Concord: AVB Press. Esch, B. E. (2014). Early echoic skills assessment (EESA). In M. L. Sundberg (Ed.), VB-MAPP: Verbal behavior milestones assessment and placement program: A language and social skills assessment program for children with autism or other developmental disabilities (2nd ed., pp. 42–48). Concord: AVB Press.
go back to reference Fitzpatrick, A. R. (1983). The meaning of content validity. Applied Psychological Measurement, 7(1), 3–13.CrossRef Fitzpatrick, A. R. (1983). The meaning of content validity. Applied Psychological Measurement, 7(1), 3–13.CrossRef
go back to reference Foxx, R. M. (2008). Applied behavior analysis treatment of autism: The state of the art. Child and Adolescent Psychiatric Clinics of North America, 17, 821–834.CrossRef Foxx, R. M. (2008). Applied behavior analysis treatment of autism: The state of the art. Child and Adolescent Psychiatric Clinics of North America, 17, 821–834.CrossRef
go back to reference Gould, E., Dixon, D. R., Najdowski, A. C., Smith, M. N., & Tarbox, J. (2011). A review of assessments for determining the content of early intensive behavior intervention programs for autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 990–1002.CrossRef Gould, E., Dixon, D. R., Najdowski, A. C., Smith, M. N., & Tarbox, J. (2011). A review of assessments for determining the content of early intensive behavior intervention programs for autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 990–1002.CrossRef
go back to reference Grant, J. S., & Davis, L. L. (1997). Selection and use of content experts for instrument development. Research in Nursing & Health, 20, 269–274.CrossRef Grant, J. S., & Davis, L. L. (1997). Selection and use of content experts for instrument development. Research in Nursing & Health, 20, 269–274.CrossRef
go back to reference IBM Corp. (2017). IBM SPSS statistics for Windows, version 25. IBM Corp. IBM Corp. (2017). IBM SPSS statistics for Windows, version 25. IBM Corp.
go back to reference Iwata, B. A., Dorsey, M. F., Slifer, K. J., Bauman, K. E., & Richman, G. S. (1982). Toward a functional analysis of self-injury. Analysis and Intervention in Developmental Disabilities, 2, 3–20.CrossRef Iwata, B. A., Dorsey, M. F., Slifer, K. J., Bauman, K. E., & Richman, G. S. (1982). Toward a functional analysis of self-injury. Analysis and Intervention in Developmental Disabilities, 2, 3–20.CrossRef
go back to reference Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.CrossRef Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.CrossRef
go back to reference Liebetrau, A. M. (1983). Measures of association (Vol. 32). Newbury Park: Sage.CrossRef Liebetrau, A. M. (1983). Measures of association (Vol. 32). Newbury Park: Sage.CrossRef
go back to reference Linehan, M. M. (1980). Content validity: Its relevance to behavioral assessment. Behavioral Assessment, 2, 147–159. Linehan, M. M. (1980). Content validity: Its relevance to behavioral assessment. Behavioral Assessment, 2, 147–159.
go back to reference Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3(3), 635–694.CrossRef Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3(3), 635–694.CrossRef
go back to reference Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Counseling and Clinical Psychology, 55, 3–9.CrossRef Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Counseling and Clinical Psychology, 55, 3–9.CrossRef
go back to reference Luiselli, J. K., Campbell, S., Cannon, B., DiPietro, E., Ellis, J. T., Taras, M., & Lifter, K. (2001). Assessment instruments used in the education and treatment of persons with autism: Brief report of a survey of a national service centers. Research in Developmental Disabilities, 22, 389–398.CrossRef Luiselli, J. K., Campbell, S., Cannon, B., DiPietro, E., Ellis, J. T., Taras, M., & Lifter, K. (2001). Assessment instruments used in the education and treatment of persons with autism: Brief report of a survey of a national service centers. Research in Developmental Disabilities, 22, 389–398.CrossRef
go back to reference Lynn, M. R. (1986). Determination and quantification of content validity. Nursing research, 35(6), 382–385.CrossRef Lynn, M. R. (1986). Determination and quantification of content validity. Nursing research, 35(6), 382–385.CrossRef
go back to reference Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: Macmillan. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: Macmillan.
go back to reference Montallana, K. L., Gard, B. M., Lotfizadeh, A. D., & Poling, A. (2019). Inter-rater agreement for the milestones and barriers assessments of the verbal behavior milestones assessment and placement program (VB-MAPP). Journal of Autism and Developmental Disorders, 49(5), 2015–2023.CrossRef Montallana, K. L., Gard, B. M., Lotfizadeh, A. D., & Poling, A. (2019). Inter-rater agreement for the milestones and barriers assessments of the verbal behavior milestones assessment and placement program (VB-MAPP). Journal of Autism and Developmental Disorders, 49(5), 2015–2023.CrossRef
go back to reference Mosier, C. I. (1947). A critical examination of the concepts of face validity. Educational and Psychological Measurement, 7(2), 191–205.CrossRef Mosier, C. I. (1947). A critical examination of the concepts of face validity. Educational and Psychological Measurement, 7(2), 191–205.CrossRef
go back to reference National Autism Center. (2015). Findings and conclusions: National Standards Project, Phase2. National Autism Center. National Autism Center. (2015). Findings and conclusions: National Standards Project, Phase2. National Autism Center.
go back to reference Nunnally, J. (1967). Psychometric methods. Bombay: McGraw-Hill. Nunnally, J. (1967). Psychometric methods. Bombay: McGraw-Hill.
go back to reference Padilla, K. L. (2020a). Content validity evidence for the verbal behavior milestones assessment and placement program (Document No. 11211). [Doctoral Dissertation, Baylor University]. ProQuest Dissertations & Theses Global. Padilla, K. L. (2020a). Content validity evidence for the verbal behavior milestones assessment and placement program (Document No. 11211). [Doctoral Dissertation, Baylor University]. ProQuest Dissertations & Theses Global.
go back to reference Padilla K. L., Morgan, G. B., Weston, R., Lively, P., & O’Guinn, N. (2020). Validity and reliability of behavior analytic assessments: A review of the literature. Unpublished manuscript. Padilla K. L., Morgan, G. B., Weston, R., Lively, P., & O’Guinn, N. (2020). Validity and reliability of behavior analytic assessments: A review of the literature. Unpublished manuscript.
go back to reference Partington, J. W. (2006). Assessment of basic language and learning skills, revised. California: Behavior Analysts Inc. Partington, J. W. (2006). Assessment of basic language and learning skills, revised. California: Behavior Analysts Inc.
go back to reference Popham, W. J. (1992). Appropriate expectations for content judgments regarding teacher licensure tests. Applied Measurement in Education, 5, 285–301.CrossRef Popham, W. J. (1992). Appropriate expectations for content judgments regarding teacher licensure tests. Applied Measurement in Education, 5, 285–301.CrossRef
go back to reference Raymond, M. R., & Reid, J. B. (2001). Who made thee a judge? Selecting and training participants for standard setting. In: G. J. Cizek (Eds), Setting performance standards: Theory and application. Lawrence Erlbaum Associates, pp. 133–172. Raymond, M. R., & Reid, J. B. (2001). Who made thee a judge? Selecting and training participants for standard setting. In: G. J. Cizek (Eds), Setting performance standards: Theory and application. Lawrence Erlbaum Associates, pp. 133–172.
go back to reference Rea, L. M., & Parker, R. A. (1992). Designing and conducting survey research. San Francisco: Jossey-Bass. Rea, L. M., & Parker, R. A. (1992). Designing and conducting survey research. San Francisco: Jossey-Bass.
go back to reference Rulon, P. J. (1946). On the validity of educational tests. Harvard Educational Review, 16, 290–296. Rulon, P. J. (1946). On the validity of educational tests. Harvard Educational Review, 16, 290–296.
go back to reference Shultz, K. S., Whitney, D. J., & Zickar, M. J. (2014). Measurement theory in action: Case studies and exercises. Milton: Routledge. Shultz, K. S., Whitney, D. J., & Zickar, M. J. (2014). Measurement theory in action: Case studies and exercises. Milton: Routledge.
go back to reference Sireci, S. (1998). The construct of content validity. Social Indicators Research, 45, 83–117.CrossRef Sireci, S. (1998). The construct of content validity. Social Indicators Research, 45, 83–117.CrossRef
go back to reference Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26, 100–107.PubMed Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26, 100–107.PubMed
go back to reference Steinbrenner, J. R., Hume, K., Odom, S. L., Morin, K. L., Nowell, S. W., Tomaszewski, B., Szendrey, S., McIntyre, N. S., Yücesoy-Özkan, S., & Savage, M. N. (2020). Evidence-based practices for children, youth, and young adults with Autism. The University of North Carolina at Chapel Hill, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team. Steinbrenner, J. R., Hume, K., Odom, S. L., Morin, K. L., Nowell, S. W., Tomaszewski, B., Szendrey, S., McIntyre, N. S., Yücesoy-Özkan, S., & Savage, M. N. (2020). Evidence-based practices for children, youth, and young adults with Autism. The University of North Carolina at Chapel Hill, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team.
go back to reference Sundberg, M. L. (2014). VB-MAPP: Verbal behavior milestones assessment and placement program: A language and social skills assessment program for children with autism or other developmental disabilities. Concord, CA: AVB Press. Sundberg, M. L. (2014). VB-MAPP: Verbal behavior milestones assessment and placement program: A language and social skills assessment program for children with autism or other developmental disabilities. Concord, CA: AVB Press.
go back to reference Usry, J., Partington, S. W., & Partington, J. W. (2018). Using expert panels to examine the content validity and inter-rater reliability of the ABLLS-R. Journal of Developmental & Physical Disabilities, 30(1), 27–38.CrossRef Usry, J., Partington, S. W., & Partington, J. W. (2018). Using expert panels to examine the content validity and inter-rater reliability of the ABLLS-R. Journal of Developmental & Physical Disabilities, 30(1), 27–38.CrossRef
go back to reference Wilson, F. R., Pan, W., & Schumsky, D. A. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197–210.CrossRef Wilson, F. R., Pan, W., & Schumsky, D. A. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197–210.CrossRef
Metagegevens
Titel
Content Validity Evidence for the Verbal Behavior Milestones Assessment and Placement Program
Auteurs
Kristen L. Padilla
Jessica S. Akers
Publicatiedatum
14-01-2021
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 11/2021
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-020-04864-y

Andere artikelen Uitgave 11/2021

Journal of Autism and Developmental Disorders 11/2021 Naar de uitgave