Skip to main content

Evaluation of Treatment Effectiveness in the Field of Autism

Psychometric Considerations and an Illustration

  • Chapter
  • First Online:
Interventions for Autism Spectrum Disorders
  • 9013 Accesses

Abstract

Evidence-based treatment and the assessment of treatment effectiveness are dependent upon the collection of data during the evaluation process providing information about symptoms, impairment, and abilities. Such an assessment allows for a seamless transition from assessment and diagnosis to effective treatment. Evaluating the effectiveness of a treatment strategy or program is important for interventions designed to address symptoms related to any psychological or developmental disorder. The validity of this entire process is closely related to the tools used during the diagnostic and treatment process. More specifically, the reliability and validity of the tools used will be directly related to the psychometric attributes of the instruments. As in all areas of science, what is learned depends upon the quality of the data generated and the manner in which the findings are interpreted. Scientifically developed diagnostic and assessment instruments yield accurate and informative data. Tests and rating scales developed to provide valid and reliable information about the examinee better informs researchers and clinicians. Tools chosen for diagnostic decision-making and treatment planning have a profound impact on the information obtained and the conclusions reached. The better the tools, the more valid and reliable the decisions and most importantly, the more helpful the information gathered will be in developing a treatment plan, monitoring progress, and documenting treatment effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.

    Google Scholar 

  • Arick, J., Young, H., Falco, R., Loos, L., Krug, D., Gense, M., & Johnson, S. (2003). Designing an outcome study to monitor the progress of students with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 18(2), 75–87.

    Article  Google Scholar 

  • Bracken, B. A. (1987). Limitations of preschool instruments and standards for minimal levels of technical adequacy. Journal of Psychoeducational Assessment, 5(4), 313–326.

    Article  Google Scholar 

  • Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Harcourt.

    Google Scholar 

  • Goldstein, S., & Naglieri, J. A. (2009). Autism spectrum rating scale. Toronto: Multi Health Systems.

    Google Scholar 

  • Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19.

    Article  PubMed  Google Scholar 

  • Jensen, P. S. (2001). Clinical equivalence: A step, a misstep, or just a misnomer? Clinical Psychology: Science and Practice, 8(4), 436–440.

    Article  Google Scholar 

  • Kasari, C., Paparella, T., Freeman, S., & Jahromi, L. (2008). Language outcome in autism: Randomized comparison of joint attention and play interventions. Journal of Consulting and Clinical Psychology, 76(1), 125–137.

    Article  PubMed  Google Scholar 

  • LeBuffe, P. A., & Naglieri, J. A. (2003). Devereux early childhood assessment clinical form (DECA-C). Lewisville: Kaplan Press.

    Google Scholar 

  • Naglieri, J. A. (2012). Psychological assessment by school psychologists: Opportunities and challenges of a changing landscape. In K. Geisinger, & B. A. Bracken (Eds.), APA handbook of testing and assessment in psychology. Washington, DC: APA.

    Google Scholar 

  • Naglieri, J. A., & Chambers, K. (2009). Psychometric issues and current scales for assessing autism spectrum disorders. In S. Goldstein, J. A. Naglieri, & S. Ozonoff (Eds.), Assessment of autism spectrum disorders (pp. 55–90). New York: Springer.

    Google Scholar 

  • Naglieri, J. A., McNeish, T. J., & Bardos, A. N. (1991). Draw a person: Screening procedure for emotional disturbance. Austin: Pro-Ed.

    Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Salvia, J., & Ysseldyke, J. E. (1981). Assessment in special and remedial education (2nd ed.). Boston: Houghton Mifflin.

    Google Scholar 

  • Tingey, R. C., Lambert, M. J., Burlingame, G. M., & Hansen, N. B. (1996). Clinically significant change: Practical indicators for evaluating psychotherapy outcome. Psychotherapy Research, 6(2), 144–153.

    Article  PubMed  Google Scholar 

  • Wechsler, D., & Naglieri, J. A. (2006). Wechsler nonverbal scale of ability. San Antonio: Pearson.

    Google Scholar 

  • Williams, K. T. (1997). Expressive vocabulary test (2nd ed.). Minneapolis: Pearson Assessments.

    Google Scholar 

  • World Health Organization. (2007). International statistical classification of diseases and related health problems—10th Revision. Geneva: Author.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jack A. Naglieri .

Editor information

Editors and Affiliations

Appendix

Appendix

Quick Solution Guide

Peer Socialization

Increase ability to seek out other children

Initiate conversation with other children

Increase ability to play appropriately with other children

Increase ability to understand humor

Improve ability to carry on normal conversation with peers

Respond appropriately when other children initiate

Adult Socialization

Respond appropriately to adult requests

Maintain eye contact when speaking with an adult

Maintain on task conversation when speaking with adult

Social/Emotional Reciprocity

Demonstrate appropriate emotion

Enjoy fun activities with others

Look at others when speaking to them

Pick up on social cues

Understand the feelings of others

Share enjoyment with others

Smile appropriately

Atypical Language

Use language appropriate for age

Speak with normal, pitch, tone and rhythm

Avoid echolalia

Maintain a topic when speaking

Use appropriate pronouns

Stereotypy

Reduce repetitive behavior such as hand flapping

Shift focus of discussion easily

Avoid fascination with parts of objects

Avoid repetitive activities with objects such as twirling, spinning or banging

Behavioral Rigidity

Increase ability to handle change in routine

Avoid obsession with details

Avoid insistence on doing things the same way each time

Sensory Sensitivity

Desensitize to fabrics and tags in clothing

Desensitize to touch

Avoid smelling, tasting or eating inedible objects

Become comfortable with touch

React normally to sound in the environment

Attention/Self-Regulation

Stick with boring tasks

Continue working with surrounding noise

Sustain effort during work

Stay focused when reading

Maintain an on task conversation

Sustain attention and concentrate for long periods of time

Listen to instructions

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Naglieri, J.A., Goldstein, S. (2013). Evaluation of Treatment Effectiveness in the Field of Autism. In: Goldstein, S., Naglieri, J. (eds) Interventions for Autism Spectrum Disorders. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-5301-7_3

Download citation

Publish with us

Policies and ethics