Skip to main content
SpringerLink
Log in

An Exploratory Factor Analysis of the Knowledge of Evidence-Based Services Questionnaire

  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

Recent developments for disseminating and implementing evidence-based practices (EBPs) have emphasized the importance of increasing therapists’ knowledge of such techniques. However, systematic efforts to measure knowledge in therapists serving youth have mostly relied on poorly researched study-specific measures. This study investigated the structure of EBP knowledge in a large sample of youth community therapists (N = 240) via a therapist report instrument emphasizing therapeutic commonalities across various types of treatment approaches. Findings supported a three-factor structure of knowledge with scores on factors varying by therapists’ primary practice setting and education level. The relationships between therapist knowledge of and attitudes towards EBPs are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Chambless DL, Hollon SD. Defining empirically supported therapies. Journal of Consulting and Clinical Psychology 1998; 66: 7–18. DOI: 10.1037/0022-006X.66.1.7.

    Article  CAS  PubMed  Google Scholar 

  2. Lonigan CJ, Elbert JC, Johnson S. Empirically supported psychosocial interventions for children: An overview. Journal of Clinical Child Psychology 1998; 27: 138–145. DOI: 10.1207/s15374424jccp2702_1.

    Article  CAS  PubMed  Google Scholar 

  3. Chorpita BF, Yim LM, Donkervoet JC, et al. Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science and Practice 2002; 9(2): 165–190. DOI: 10.1093/clipsy/9.2.165.

    Google Scholar 

  4. Hoagwood K, Burns BJ, Kiser L, et al. Evidence-based practice in child and adolescent mental health services. Psychiatric Services 2001; 52: 1179–1189. DOI: 10.1176/appi.ps.52.9.1179.

    Google Scholar 

  5. Task Force on Promotion and Dissemination of Psychological Procedures. Training in and dissemination of empirically-validated psychological treatments: Report and recommendations. Clinical Psychologist 1995; 48: 3–23.

    Google Scholar 

  6. Daleiden E, Lee J, Tolman R. Annual evaluation report: Fiscal year 2004. Honolulu, HI: Hawaii Department of Health, Child and Adolescent Mental Health Division 2004. Retrieved February 25, 2008, from http://hawaii.gov/health/mental-health/camhd/library/pdf/rpteval/ge/ge/ge011.pdf

  7. Weersing RV, Weisz JR, Donenberg GR. Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child Psychology 2002; 31: 168–180.

    Article  Google Scholar 

  8. Becker KD, Nakamura BJ, Young J, et al. What better place than here? What better time than now? ABCT’s burgeoning role in the dissemination and implementation of evidence-based practices. The Behavior Therapist 2009; 32: 89–96.

    Google Scholar 

  9. Chorpita BF, Regan J. Dissemination of effective mental health treatment procedures: Maximizing the return on a significant investment. Behaviour Research & Therapy 2009; 47: 990–993. DOI: 10.1016/j.brat.2009.07.002.

    Article  Google Scholar 

  10. Fixsen DL, Naoom SF, Blase KA, et al. Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Research Institute, The National Implementation Research Network, 2005. (FMHI Publication #231).

  11. Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science 2009; 4(50): 1–15. DOI:10.1186/1748-5908-4-50

  12. Rogers EM. Diffusion of innovations (5th ed.). New York: Free Press, 2003.

    Google Scholar 

  13. Arbuthnot J. (1974). Environmental knowledge and recycling behavior as a function of attitudes and personality characteristics. Personality and Social Psychology Bulletin; 1: 119–121. DOI: 10.1177/014616727400100140.

    Article  Google Scholar 

  14. Higa CK, Chorpita BF. Evidence-based therapies: Translating research into practice. In R. G. Steele, T. D. Elkin, & M. C. Roberts (Eds.), Handbook of evidence-based therapies for children and adolescents: Bridging science and practice (pp. 45-61). New York: Springer-Verlag, 2007.

    Google Scholar 

  15. Sanders M, Prinz R, Shapiro C. Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administrative Policy and Mental Health 2009; 36: 133–143. DOI: 10.1007/s10488-009-0205-3.

    Article  Google Scholar 

  16. Seng A, Prinz R, Sanders M. The role of training variables in effective dissemination of evidence-based parenting interventions. International Journal of Mental Health Promotion 2006; 8: 19–27.

    Article  Google Scholar 

  17. Persons JB. Why practicing psychologists are slow to adopt empirically validated treatments. In S. C. Hayes, V. M. Follette, R. M. Dawes, & K. E. Grady (Eds.), Scientific standards of psychological practice: Issues and recommendations (pp. 141–157). Reno, NV: Context Press, 1995.

    Google Scholar 

  18. Kazdin AE. Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist 2008; 63: 146–159. DOI: 10.1037/0003-066X.63.3.146.

    Article  PubMed  Google Scholar 

  19. Miller W, Sorensen J, Selzer J, et al. Disseminating evidence based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment 2006; 31: 25–39. DOI: 10.1016/j.jsat.2006.03.005.

    Google Scholar 

  20. Chorpita BF, Daleiden E. Evidence-based Services Committee—Biennial report—Effective psychological interventions for youth with behavioral and emotional needs. Honolulu, HI: Hawaii Department of Health Child and Adolescent Mental Health Division, 2009.

    Google Scholar 

  21. Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology 2009; 77: 566–579. DOI: 10.1037/a0014565.

    Article  PubMed  Google Scholar 

  22. Chorpita BF, Daleiden EL, Weisz JR. Identifying and selecting the common elements of evidence-based interventions: A distillation and matching model. Mental Health Services Research 2005; 7: 5–20. DOI: 10.1007/s11020-005-1962-6.

  23. Chorpita BF, Weisz JR. Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, or Conduct Problems (MATCH-ADTC). Satellite Beach, FL: PracticeWise, LLC, 2009.

  24. Weisz JR, Chorpita BF, Palinkas LA, et al. Testing standard and modular designs for psychotherapy with youth depression, anxiety, and conduct problems: A randomized effectiveness trial. Archives of General Psychiatry 2012; 69: 274–282. DOI:10.1001/archgenpsychiatry.2011.147

  25. Garland AF, Hawley KM, Brookman-Frazee L, et al. Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child & Adolescent Psychiatry 2008; 47: 505–515. DOI: 10.1097/CHI.0b013e31816765c2.

    Google Scholar 

  26. Beidas RS, Barmish AJ, Kendall PC. Training as usual: Can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Therapist 2009; 32: 97–101.

    Google Scholar 

  27. Stumpf RE, Higa-McMillan CK, Chorpita BF. Implementation of Evidence-Based Services for Youth: Assessing Provider Knowledge. Behavior Modification 2009; 33: 48–65. DOI: 10.1177/0145445508322625.

    Article  PubMed  Google Scholar 

  28. Kreiter CD, Frisbie DA. Effectiveness of multiple true-false items. Applied Measurement in Education 1989; 2: 207–216.

    Article  Google Scholar 

  29. Weist M, Lever N, Stephan S, et al. Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health 2009; 1: 196–211. DOI: 10.1007/s12310-009-9018-5.

  30. Orimoto TE, Higa-McMillan CK, Mueller, CW, et al. Measurement and organization of therapeutic practice elements in a youth community mental health setting. Psychiatric Services 2012; 63: 343–350. DOI: 10.1176/appi.ps.201100129

    Article  PubMed  Google Scholar 

  31. Nakamura BJ, Higa-McMillan CK, Okamura KH, et al. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research 2011; 38: 287–300. DOI: 10.1007/s10488-011-0351-2

  32. Lim A, Nakamura BJ, Higa-McMillan CK., et al. Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers. Behaviour Research and Therapy 2012; 50(6): 397–406. DOI: 10.1016/j.brat.2012.03.008

  33. Jensen-Doss A, Hawley KM. Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child and Adolescent Psychology 2010; 39: 885–896. DOI: 10.1080/15374416.2010.517169

    Article  PubMed  PubMed Central  Google Scholar 

  34. Jensen-Doss A, Hawley KM. Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research 2011; 38, 476–485. DOI: 10.1007/s10488-011-0334-3

    Article  PubMed  Google Scholar 

  35. Jensen-Doss A, Hawley KM, Lopez M, et al. Using evidence-based treatments: The experiences of youth providers working under a mandate. Professional Psychology: Research and Practice 2009; 40(4): 417–424. DOI: 10.1037/a0014690

    Google Scholar 

  36. Chorpita BF, Daleiden E. Evidence-based Services Committee—Biennial report—Effective psychological interventions for youth with behavioral and emotional needs. Honolulu, HI: Hawaii Department of Health Child and Adolescent Mental Health Division, 2007.

    Google Scholar 

  37. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Mental Health Services Research 2004; 6: 61–74. DOI: 10.1023/B:MHSR.0000024351.12294.65.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Aarons GA, Glisson C, Hoagwood K, et al. Research Network on Youth Mental Health. Psychometric properties and U.S. National norms of the Evidence‐Based Practice Attitude Scale (EBPAS). Psychological Assessment 2010; 22(2): 356–365. DOI:10.1037/a0019188

  39. Borntrager CF, Chorpita BF, Higa-McMillan CK, et al. Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services 2009; 60: 677–681. DOI: 10.1176/appi.ps.60.5.677.

    Google Scholar 

  40. SPSS, Inc. PASW® Statistics 18 Core System User’s Guide: Prentice Hall, 2010.

  41. Little RJA, Rubin DB. Statistical Analysis with Missing Data. Wiley, New York, 1987.

    Google Scholar 

  42. Cohen J. Quantitative methods in psychology: A power primer. Psychological Bulletin 1992; 112: 155–159.

    Article  CAS  PubMed  Google Scholar 

  43. Comrey AL, Lee HB. A first course in factor analysis (Second edition). Hillsdale, NJ: Erlbaum, 1992.

  44. Cattell RB. The scree test for the number of factors. Multivariate Behavioral Research 1966; 1: 245–276. DOI: 10.1207/s15327906mbr0102_10.

    Article  CAS  PubMed  Google Scholar 

  45. Nunnally JC. Psychometric Theory: Second Edition. New York: McGraw Hill, 1978.

    Google Scholar 

  46. Tabachnick BG, Fidell LS. Using Multivariate Statistics, Sixth Edition. Needham Heights, MA: Allyn & Bacon, 2007.

    Google Scholar 

  47. Garland AF, Brookman-Frazee L, Hurlburt M, et al. Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services 2010; 61(8): 788–795. DOI: 10.1176/appi.ps.61.8.788

  48. Borntrager C, Chorpita BF, Higa-McMillan CK, et al. Usual care for trauma-exposed youth: Are clinician-reported therapy techniques evidence-based? Children and Youth Services Review 2013; 35: 133–141. doi:10.1016/j.childyouth.2012.09.018

    Google Scholar 

Download references

Conflict of Interest

We certify that there is no conflict of interest with any financial organization regarding the material discussed in this manuscript.

Author information

Authors and Affiliations

  1. Department of Psychology, University of Hawaii at Manoa, 2530 Dole Street, Sakamaki C-400, Honolulu, HI, 96822, USA

    Kelsie H. Okamura MA, Brad J. Nakamura PhD, Charles Mueller PhD & Kentaro Hayashi PhD

  2. Department of Psychology, University of Hawaii at Hilo, 200 West Kawili Street, Hilo, HI, 96720, USA

    Charmaine K. Higa McMillan PhD

Authors
  1. Kelsie H. Okamura MA
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brad J. Nakamura PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Charles Mueller PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kentaro Hayashi PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Charmaine K. Higa McMillan PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kelsie H. Okamura MA.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Okamura, K.H., Nakamura, B.J., Mueller, C. et al. An Exploratory Factor Analysis of the Knowledge of Evidence-Based Services Questionnaire. J Behav Health Serv Res 43, 214–232 (2016). https://doi.org/10.1007/s11414-013-9384-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-013-9384-5

Keywords

Search

Navigation