Abstract
The efficacy of prevention programs is typically determined through analysis of covariance. To date, a growth curve modeling approach is not used extensively in program evaluation. However, for longitudinal data there are several advantages to using this approach as compared to methods comparing means at two time points in a piecemeal fashion. In this study, latent growth curve models were used to evaluate the effect of a program on the average level of drug use, rate of change (growth) of drug use, and acceleration or deceleration in the rate of change of drug use. The study relied on data from the Adolescent Alcohol Prevention Trial, a randomized longitudinal drug use prevention program. The program consists of drug use information, resistance skills training, and normative education components. Data regarding cigarette and alcohol use were collected over a 5-year period, grade 7 to grade 11. Students receiving the normative education program had significantly lower average levels of reported cigarette and alcohol use, lower rates of growth for reported cigarette and alcohol use, and less deceleration of reported levels of cigarette and alcohol use as compared with the control group. Growth curve analysis is a powerful and effective tool with which to model change and program efficacy.
Similar content being viewed by others
REFERENCES
Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis.Psychometrika, 49, 155–173.
Anthony, J. C., & Petronis, K. R. (1995). Early-onset drug use and risk of later drug problems. Drug and Alcohol Dependence, 40, 9–15.
Barcikowski, R. S., and Robey, R. R. (1993). Use and misuse of repeated measures designs. In L. M. Collins and L. Seitz (Eds.). Advances in data analysis for prevention intervention research (pp. 302–341). National Institute on Drug Abuse Research Monograph Series (#142). Washington DC: National Institute on Drug Abuse.
Bentler, P. M. (1990). Comparative fit indexes in structural models.Psychological Bulletin, 107, 238–246.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606.
Biglan, A., Severson, H., Ary, D. V., Faller, C., Gallison, C., Thompson, R., Glasgow, R., & Lichtenstein, E. (1987). Do smoking prevention programs really work? Attrition and the internal and external validity of an evaluation of a refusal skills training program. Journal of Behavioral Medicine, 10, 159–171.
Botvin, G. J., & Eng, A. (1982). The efficacy of a multicomponent approach to the prevention of cigarette smoking. Preventive Medicine, 11, 199–211.
Brekke, J. S., Long, J. D., Nesbitt, N., & Sobel, E. (1997). The impact of service characteristics on functional outcomes from community support programs for persons with schizophrenia: A growth curve analysis. Journal of Consulting and Clinical Psychology, 65(3), 464–475.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.). Testing Structural Equation Models (pp. 136–162). Newbury Park, CA: Sage.
Bryk, A. S., & Raudenbush, S. W. (1987). Application of hierarchical linear models to assessing change. Psychological Bulletin, 101, 147–158.
Cumsille, P., & Sayer, A. (1999) Trajectories of alcohol use and positive alcohol expectancies from early to middle adolescence: Across-domain analysis. Paper presented at the Society for Research on Child Development Biennial Meeting. Albuquerque, New Mexico.
Curran, P. J. & Muthèn, B. O. (1999). The application of latent curve analysis to testing developmental theories in intervention research. American Journal of Community Psychology, 27(4), 567–595.
Curran, P. J., Stice, E., & Chassin, L. (1997). The relation between adolescent alcohol use and peer alcohol use: A longitudinal random coefficients model. Journal of Consulting and Clinical Psychology, 65(1), 130–140.
Donaldson, S. I., Graham, J. W., & Hansen, W. B. (1994). Testing the generalizability of intervening mechanism theories: Understanding the effects of adolescent drug use prevention interventions. Journal of Behavioral Medicine, 17, 195–216.
Donaldson, S. I., Graham, J. W., Piccinin, A. M., & Hansen, W.B. (1995). Resistance skills training and onset of alcohol use: Evidence for beneficial and potentially harmful effects in public schools and in private Catholic schools. Health Psychology, 14, 291–300.
Donaldson, S. I., Thomas, C. W., Graham, J. W., Au, J. G., & Hansen, W. B. (1999). Verifying drug abuse prevention program effects using reciprocal best friend reports. Unpublished manuscript. The Claremont School, Claremont, CA.
Duncan, S. C., & Duncan, T. E. (1994). Modeling incomplete longitudinal substance use data using latent variable growth curve methodology. Multivariate Behavioral Research, 29, 313–338.
Duncan, T. E., Duncan, S. C., Alpert, A., Hops, H., Stoolmiller, M., & Muthèn, B. (1997). Latent variable modeling of longitudinal and multilevel substance use data. Multivariate Behavioral Research, 32(3), 275–318.
Ellickson, P. L., & Bell, R. M. (1990). Drug prevention in junior high: A multi-site longitudinal test. Science, 247, 1299–1305.
Flay, B. R., d'Avernas, J. R., Best, J. A., Kersell, M. W., & Ryan, K. B. (1983). Cigarette smoking: Why young people do it and ways of preventing it. In P. McGrath & P. Firestone (Eds.).Pediatric and adolescent behavioral medicine (pp. 132–183).New York: Springer-Verlag.
Flay, B. R. (1985). Psychosocial approaches to smoking prevention: A review of findings. Health Psychology, 4, 449–488.
Graham, J. W., & Hofer, S. M. (2000). Multiple imputation in multivariate research. In T. D. Little, K. U. Schnabel, & J. Baumert, (Eds.). Modeling longitudinal and multiple-group data: Practical issues, applied approaches, and specific examples (pp. 201–218). Hillsdale, NJ: Lawrence Erlbaum.
Graham, J. W., Hofer, S. M., Donaldson, S. I., MacKinnon, D. P., & Schafer, J. L. (1997). Analysis with missing data in prevention research. In K. Bryant, M. Windle, & S. West (Eds.). The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 325–366).Washington, DC: American Psychological Association.
Graham, J.W., Hofer, S. M., & MacKinnon, D. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31, 197–218.
Graham, J. W., Hofer, S. M., & Piccinin, A. M. (1994). Analysis with missing data in drug prevention research. In L. M. Collins and L. Seitz (Eds.). Advances in data analysis for prevention intervention research. National Institute on Drug Abuse Research Monograph Series (#142), Washington DC: National Institute on Drug Abuse.
Graham, J. W., & Schafer, J. L. (1999). On the performance of multiple imputation for multivariate data with small sample size. In R. Hoyle (Ed.). Statistical strategies for small sample research (pp. 1–29). Thousand Oaks, CA: Sage.
Graham, J.W., Taylor, B. J., & Cumsille, P. E. (in press). Planned missing data designs in analysis of change. In A. Sayer & L. Collins (Eds.), Best methods for the analysis of change. Washington, DC: American Psychological Association.
Hansen, W. B. (1992). School-based substance abuse prevention: A review of state of the art in curriculum, 1980–1990. Health Education Research: Theory & Practice, 7, 403–430.
Hansen, W. B., & Graham, J.W. (1991). Preventing alcohol, marijuana, and cigarette use among adolescents: Peer pressure resistance training versus establishing conservative norms.Preventive Medicine, 20, 414–430.
Hansen, W. B., Graham, J. W., Wolkenstein, B. H., Lundy, B. Z., Pearson, J. L., Flay, B. R., & Johnson, C. A. (1988). Differential impact of three alcohol prevention curricula on hypothesized mediating variables. Journal of Drug Education, 18, 143–153.
Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568–579.
Hansen, W. B., Johnson, C. A., Flay, B. R., Graham, J. W., & Sobel, J. L. (1988). Affective and social influences approaches to the prevention of multiple substance abuse among seventh grade students: Results from Project SMART. Preventive Medicine, 17, 135–154.
Hawkins, J. D., Graham, J. W., Maguin, E., Abbott, R., Hill, K.G., & Catalano, R. F. (1997). Exploring the effects of age of alcohol use initiation and psychosocial risk factors on subsequent alcohol misuse. Journal of Studies on Alcohol, 58, 280–290.
Irvine, A. B., Biglan, A., Smolkowski, K., Metzler, W. W., & Ary, D. V. (1999). The effectiveness of a parenting skills program for parents of middle school students in small communities.Journal of Consulting & Clinical Psychology, 67(6), 811–825.
Johnston L. D., O'Malley, P. M., & Bachman, J. G. (1999). National survey results on drug use from the Monitoring the Future study, 1975–1998. Volume I: Secondary school students. (NIH Publication No. 99-4660). Rockville, MD: National Institute on Drug Abuse.
Jöreskog, K. G. & Sörbom, D., (1993). LISREL 8 User's Reference Guide. Mooresville, IN: Scientific Software, Inc.
Klesges, R. C., Winders, S. E., Meyers, A. W., Eck, L. H., Ward, K. D., Hultquist, C. M., Ray, J. W., & Shadish, W. R. (1997).How much weight gain occurs following smoking cessation: A comparison of weight gain using both continuous and point prevalence abstinence. Journal of Consulting and Clinical Psychology, 65(2), 286–291.
Luepker, R. V., Johnson, C. A., Murray, D. M., & Pechacek, T. F. (1983). Prevention of cigarette smoking: Three-year follow-up of an education program for youth. Journal of Behavioral Medicine, 6, 53–62.
MacKinnon, D. P., Johnson, C. A., Pentz, M. A., Dwyer, J. H., Hansen, W. B., Flay, B. R., & Wang, E. Y. I. (1991). Mediating mechanisms in a school-based drug prevention program: Firstyear effects of the Midwestern Prevention Project. Health Psychology, 10, 164–172.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodnessof-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103, 391–410.
McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110–133.
Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122.
Murray, D. M., Richards, P. S., Luepker, R. V., & Johnson, C. A. (1987). The prevention of cigarette smoking in children: twoand three-year follow-up comparisons of four prevention strategies. Journal of Behavioral Medicine, 10, 595–611.
Muthén, B. O. & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2(4), 371–402.
Osgood, D. W., & Smith, G. L. (1995). Applying hierarchical linear modeling to extended longitudinal evaluations: The Boys Town Follow-up Study. Evaluation Review, 19(1), 3–38.
Palmer, R. F., Graham, J. W., White, E. L., & Hansen, W. B. (1998). Applying multilevel analytic strategies in adolescent substance use prevention research. Preventive Medicine, 27, 328–336.
Pentz, M. A., Dwyer, J. H., MacKinnon, D. P., Flay, B. R., Hansen, W. B., Wang, E. Y. I., & Johnson, C. A. (1989). A multicommunity trial for primary prevention of adolescent drug abuse.Journal of the American Medical Association, 261, 3259–3266.
Raykov, T. (1996). Plasticity in fluid intelligence of older adults: An individual latent growth curve modeling application.Structural Equation Modeling, 3(3), 248–265.
Schafer, J. (1997). Analysis of Incomplete Multivariate Data. New York: Chapman & Hall.
Schafer, J. L., & Olsen, M. K. (1998). Multiple imputation for multivariate missing-data problems: A data analyst's perspective.Multivariate Behavioral Research, 33, 545–571.
Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180.
Stoolmiller, M. (1994). Antisocial behavior, delinquent peer association, and unsupervised wandering for boys: Growth and changes from childhood to early adolescence. Multivariate Behavior Research, 24(3), 263–288.
Svartberg, M., Seltzer, M. H., Stiles, T. C., & Khoo, S. (1995).Symptom improvement and its temporal course in short-term dynamic psychotherapy: A growth curve analysis. Journal of Nervous and Mental Disease, 183(4), 242–248.
Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.
Wang, J., Siegal, H. A., Falck, R. S., Carlson, R. G., & Rahman, A. (1999). Evaluation of HIV risk reduction intervention programs via latent growth model. Evaluation Review, 23(6), 648–662.
Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116(2), 363–381.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Taylor, B.J., Graham, J.W., Cumsille, P. et al. Modeling Prevention Program Effects on Growth in Substance Use: Analysis of Five Years of Data from the Adolescent Alcohol Prevention Trial. Prev Sci 1, 183–197 (2000). https://doi.org/10.1023/A:1026547128209
Issue Date:
DOI: https://doi.org/10.1023/A:1026547128209