Skip to main content
Log in

Modeling Prevention Program Effects on Growth in Substance Use: Analysis of Five Years of Data from the Adolescent Alcohol Prevention Trial

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

The efficacy of prevention programs is typically determined through analysis of covariance. To date, a growth curve modeling approach is not used extensively in program evaluation. However, for longitudinal data there are several advantages to using this approach as compared to methods comparing means at two time points in a piecemeal fashion. In this study, latent growth curve models were used to evaluate the effect of a program on the average level of drug use, rate of change (growth) of drug use, and acceleration or deceleration in the rate of change of drug use. The study relied on data from the Adolescent Alcohol Prevention Trial, a randomized longitudinal drug use prevention program. The program consists of drug use information, resistance skills training, and normative education components. Data regarding cigarette and alcohol use were collected over a 5-year period, grade 7 to grade 11. Students receiving the normative education program had significantly lower average levels of reported cigarette and alcohol use, lower rates of growth for reported cigarette and alcohol use, and less deceleration of reported levels of cigarette and alcohol use as compared with the control group. Growth curve analysis is a powerful and effective tool with which to model change and program efficacy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis.Psychometrika, 49, 155–173.

    Google Scholar 

  • Anthony, J. C., & Petronis, K. R. (1995). Early-onset drug use and risk of later drug problems. Drug and Alcohol Dependence, 40, 9–15.

    Google Scholar 

  • Barcikowski, R. S., and Robey, R. R. (1993). Use and misuse of repeated measures designs. In L. M. Collins and L. Seitz (Eds.). Advances in data analysis for prevention intervention research (pp. 302–341). National Institute on Drug Abuse Research Monograph Series (#142). Washington DC: National Institute on Drug Abuse.

    Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models.Psychological Bulletin, 107, 238–246.

    Google Scholar 

  • Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606.

    Google Scholar 

  • Biglan, A., Severson, H., Ary, D. V., Faller, C., Gallison, C., Thompson, R., Glasgow, R., & Lichtenstein, E. (1987). Do smoking prevention programs really work? Attrition and the internal and external validity of an evaluation of a refusal skills training program. Journal of Behavioral Medicine, 10, 159–171.

    Google Scholar 

  • Botvin, G. J., & Eng, A. (1982). The efficacy of a multicomponent approach to the prevention of cigarette smoking. Preventive Medicine, 11, 199–211.

    Google Scholar 

  • Brekke, J. S., Long, J. D., Nesbitt, N., & Sobel, E. (1997). The impact of service characteristics on functional outcomes from community support programs for persons with schizophrenia: A growth curve analysis. Journal of Consulting and Clinical Psychology, 65(3), 464–475.

    Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.). Testing Structural Equation Models (pp. 136–162). Newbury Park, CA: Sage.

    Google Scholar 

  • Bryk, A. S., & Raudenbush, S. W. (1987). Application of hierarchical linear models to assessing change. Psychological Bulletin, 101, 147–158.

    Google Scholar 

  • Cumsille, P., & Sayer, A. (1999) Trajectories of alcohol use and positive alcohol expectancies from early to middle adolescence: Across-domain analysis. Paper presented at the Society for Research on Child Development Biennial Meeting. Albuquerque, New Mexico.

  • Curran, P. J. & Muthèn, B. O. (1999). The application of latent curve analysis to testing developmental theories in intervention research. American Journal of Community Psychology, 27(4), 567–595.

    Google Scholar 

  • Curran, P. J., Stice, E., & Chassin, L. (1997). The relation between adolescent alcohol use and peer alcohol use: A longitudinal random coefficients model. Journal of Consulting and Clinical Psychology, 65(1), 130–140.

    Google Scholar 

  • Donaldson, S. I., Graham, J. W., & Hansen, W. B. (1994). Testing the generalizability of intervening mechanism theories: Understanding the effects of adolescent drug use prevention interventions. Journal of Behavioral Medicine, 17, 195–216.

    Google Scholar 

  • Donaldson, S. I., Graham, J. W., Piccinin, A. M., & Hansen, W.B. (1995). Resistance skills training and onset of alcohol use: Evidence for beneficial and potentially harmful effects in public schools and in private Catholic schools. Health Psychology, 14, 291–300.

    Google Scholar 

  • Donaldson, S. I., Thomas, C. W., Graham, J. W., Au, J. G., & Hansen, W. B. (1999). Verifying drug abuse prevention program effects using reciprocal best friend reports. Unpublished manuscript. The Claremont School, Claremont, CA.

    Google Scholar 

  • Duncan, S. C., & Duncan, T. E. (1994). Modeling incomplete longitudinal substance use data using latent variable growth curve methodology. Multivariate Behavioral Research, 29, 313–338.

    Google Scholar 

  • Duncan, T. E., Duncan, S. C., Alpert, A., Hops, H., Stoolmiller, M., & Muthèn, B. (1997). Latent variable modeling of longitudinal and multilevel substance use data. Multivariate Behavioral Research, 32(3), 275–318.

    Google Scholar 

  • Ellickson, P. L., & Bell, R. M. (1990). Drug prevention in junior high: A multi-site longitudinal test. Science, 247, 1299–1305.

    Google Scholar 

  • Flay, B. R., d'Avernas, J. R., Best, J. A., Kersell, M. W., & Ryan, K. B. (1983). Cigarette smoking: Why young people do it and ways of preventing it. In P. McGrath & P. Firestone (Eds.).Pediatric and adolescent behavioral medicine (pp. 132–183).New York: Springer-Verlag.

    Google Scholar 

  • Flay, B. R. (1985). Psychosocial approaches to smoking prevention: A review of findings. Health Psychology, 4, 449–488.

    Google Scholar 

  • Graham, J. W., & Hofer, S. M. (2000). Multiple imputation in multivariate research. In T. D. Little, K. U. Schnabel, & J. Baumert, (Eds.). Modeling longitudinal and multiple-group data: Practical issues, applied approaches, and specific examples (pp. 201–218). Hillsdale, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Graham, J. W., Hofer, S. M., Donaldson, S. I., MacKinnon, D. P., & Schafer, J. L. (1997). Analysis with missing data in prevention research. In K. Bryant, M. Windle, & S. West (Eds.). The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 325–366).Washington, DC: American Psychological Association.

    Google Scholar 

  • Graham, J.W., Hofer, S. M., & MacKinnon, D. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31, 197–218.

    Google Scholar 

  • Graham, J. W., Hofer, S. M., & Piccinin, A. M. (1994). Analysis with missing data in drug prevention research. In L. M. Collins and L. Seitz (Eds.). Advances in data analysis for prevention intervention research. National Institute on Drug Abuse Research Monograph Series (#142), Washington DC: National Institute on Drug Abuse.

    Google Scholar 

  • Graham, J. W., & Schafer, J. L. (1999). On the performance of multiple imputation for multivariate data with small sample size. In R. Hoyle (Ed.). Statistical strategies for small sample research (pp. 1–29). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Graham, J.W., Taylor, B. J., & Cumsille, P. E. (in press). Planned missing data designs in analysis of change. In A. Sayer & L. Collins (Eds.), Best methods for the analysis of change. Washington, DC: American Psychological Association.

  • Hansen, W. B. (1992). School-based substance abuse prevention: A review of state of the art in curriculum, 1980–1990. Health Education Research: Theory & Practice, 7, 403–430.

    Google Scholar 

  • Hansen, W. B., & Graham, J.W. (1991). Preventing alcohol, marijuana, and cigarette use among adolescents: Peer pressure resistance training versus establishing conservative norms.Preventive Medicine, 20, 414–430.

    Google Scholar 

  • Hansen, W. B., Graham, J. W., Wolkenstein, B. H., Lundy, B. Z., Pearson, J. L., Flay, B. R., & Johnson, C. A. (1988). Differential impact of three alcohol prevention curricula on hypothesized mediating variables. Journal of Drug Education, 18, 143–153.

    Google Scholar 

  • Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568–579.

    Google Scholar 

  • Hansen, W. B., Johnson, C. A., Flay, B. R., Graham, J. W., & Sobel, J. L. (1988). Affective and social influences approaches to the prevention of multiple substance abuse among seventh grade students: Results from Project SMART. Preventive Medicine, 17, 135–154.

    Google Scholar 

  • Hawkins, J. D., Graham, J. W., Maguin, E., Abbott, R., Hill, K.G., & Catalano, R. F. (1997). Exploring the effects of age of alcohol use initiation and psychosocial risk factors on subsequent alcohol misuse. Journal of Studies on Alcohol, 58, 280–290.

    Google Scholar 

  • Irvine, A. B., Biglan, A., Smolkowski, K., Metzler, W. W., & Ary, D. V. (1999). The effectiveness of a parenting skills program for parents of middle school students in small communities.Journal of Consulting & Clinical Psychology, 67(6), 811–825.

    Google Scholar 

  • Johnston L. D., O'Malley, P. M., & Bachman, J. G. (1999). National survey results on drug use from the Monitoring the Future study, 1975–1998. Volume I: Secondary school students. (NIH Publication No. 99-4660). Rockville, MD: National Institute on Drug Abuse.

    Google Scholar 

  • Jöreskog, K. G. & Sörbom, D., (1993). LISREL 8 User's Reference Guide. Mooresville, IN: Scientific Software, Inc.

    Google Scholar 

  • Klesges, R. C., Winders, S. E., Meyers, A. W., Eck, L. H., Ward, K. D., Hultquist, C. M., Ray, J. W., & Shadish, W. R. (1997).How much weight gain occurs following smoking cessation: A comparison of weight gain using both continuous and point prevalence abstinence. Journal of Consulting and Clinical Psychology, 65(2), 286–291.

    Google Scholar 

  • Luepker, R. V., Johnson, C. A., Murray, D. M., & Pechacek, T. F. (1983). Prevention of cigarette smoking: Three-year follow-up of an education program for youth. Journal of Behavioral Medicine, 6, 53–62.

    Google Scholar 

  • MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. Y. I. (1991). Mediating mechanisms in a school-based drug prevention program: Firstyear effects of the Midwestern Prevention Project. Health Psychology, 10, 164–172.

    Google Scholar 

  • Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodnessof-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391–410.

    Google Scholar 

  • McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110–133.

    Google Scholar 

  • Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122.

    Google Scholar 

  • Murray, D. M., Richards, P. S., Luepker, R. V., & Johnson, C. A. (1987). The prevention of cigarette smoking in children: twoand three-year follow-up comparisons of four prevention strategies. Journal of Behavioral Medicine, 10, 595–611.

    Google Scholar 

  • Muthén, B. O. & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2(4), 371–402.

    Google Scholar 

  • Osgood, D. W., & Smith, G. L. (1995). Applying hierarchical linear modeling to extended longitudinal evaluations: The Boys Town Follow-up Study. Evaluation Review, 19(1), 3–38.

    Google Scholar 

  • Palmer, R. F., Graham, J. W., White, E. L., & Hansen, W. B. (1998). Applying multilevel analytic strategies in adolescent substance use prevention research. Preventive Medicine, 27, 328–336.

    Google Scholar 

  • Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989). A multicommunity trial for primary prevention of adolescent drug abuse.Journal of the American Medical Association, 261, 3259–3266.

    Google Scholar 

  • Raykov, T. (1996). Plasticity in fluid intelligence of older adults: An individual latent growth curve modeling application.Structural Equation Modeling, 3(3), 248–265.

    Google Scholar 

  • Schafer, J. (1997). Analysis of Incomplete Multivariate Data. New York: Chapman & Hall.

    Google Scholar 

  • Schafer, J. L., & Olsen, M. K. (1998). Multiple imputation for multivariate missing-data problems: A data analyst's perspective.Multivariate Behavioral Research, 33, 545–571.

    Google Scholar 

  • Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180.

    Google Scholar 

  • Stoolmiller, M. (1994). Antisocial behavior, delinquent peer association, and unsupervised wandering for boys: Growth and changes from childhood to early adolescence. Multivariate Behavior Research, 24(3), 263–288.

    Google Scholar 

  • Svartberg, M., Seltzer, M. H., Stiles, T. C., & Khoo, S. (1995).Symptom improvement and its temporal course in short-term dynamic psychotherapy: A growth curve analysis. Journal of Nervous and Mental Disease, 183(4), 242–248.

    Google Scholar 

  • Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.

    Google Scholar 

  • Wang, J., Siegal, H. A., Falck, R. S., Carlson, R. G., & Rahman, A. (1999). Evaluation of HIV risk reduction intervention programs via latent growth model. Evaluation Review, 23(6), 648–662.

    Google Scholar 

  • Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116(2), 363–381.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Taylor, B.J., Graham, J.W., Cumsille, P. et al. Modeling Prevention Program Effects on Growth in Substance Use: Analysis of Five Years of Data from the Adolescent Alcohol Prevention Trial. Prev Sci 1, 183–197 (2000). https://doi.org/10.1023/A:1026547128209

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1026547128209

Navigation