Skip to main content
SpringerLink
Log in

Test–Retest Reliability of Self-Reported Sexual Behavior, Sexual Orientation, and Psychosexual Milestones Among Gay, Lesbian, and Bisexual Youths

  • Original Article
  • Published:
Archives of Sexual Behavior Aims and scope Submit manuscript

Despite the importance of reliable self-reported sexual information for research on sexuality and sexual health, research has not examined reliability of information provided by gay, lesbian, and bisexual (GLB) youths. Test–retest reliability of self-reported sexual behaviors, sexual orientation, sexual identity, and psychosexual developmental milestones was examined among an ethnically diverse sample of 64 self-identified GLB youths. Two face-to-face interviews were conducted approximately 2 weeks apart using the Sexual Risk Behavior Assessment Schedule for Homosexual Youths (SERBAS-Y-HM). Overall, the mean of the test–retest reliability coefficients was substantial for 6 of the 7 domains: lifetime sexual behaviors (M=.89), sexual behavior in the past 3 months (M=.96), unprotected sexual behavior in the past 3 months (M=.93), sexual identity (κ=.89), sexual orientation (M=.82), and ages of various psychosexual developmental milestones (M=.77). Inconsistent reliability was found for reports of sexual behaviors while using substances. A small number of gender differences emerged, with lower reliability among female youths in the lifetime number of same-sex partners. The overall findings suggest that a wide range of self-reported sexual information can be reliably assessed among GLB youths by means of interviewer-administered questionnaires, such as the SERBAS-Y-HM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. A fourth item assessing sexual orientation with respect to past sexual behaviors (consistent with the Kinsey definition of sexual orientation was also assessed. However, because it was interviewer-rated, not self-reported, it was not included in this analysis of the reliability of self-reported sexuality.

  2. Examination of the data did not indicate the existence of any outliers, but rather, a pattern of inconsistency characterizing a large number of female youths. For other low reliability coefficients, the potential impact of outliers also was examined, but not found.

REFERENCES

  • Bartko, J. J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports, 19, 3–11.

    PubMed  CAS  Google Scholar 

  • Boekeloo, B. O., Schamus, L. A., Simmens, S. J., & Cheng, T. L. (1998). Ability to measure sensitive adolescent behaviors via telephone. American Journal of Preventative Medicine, 14, 209–216.

    Article  CAS  Google Scholar 

  • Brener, N. D., Billy, J. O. G., & Grady, W. R. (2003). Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: Evidence from the scientific literature. Journal of Adolescent Health, 33, 436–457.

    Article  PubMed  Google Scholar 

  • Brener, N. D., Collins, J. L., Kann, L., Warren, C. W., & Williams, B. I. (1995). Reliability of the youth risk behavior survey questionnaire. American Journal of Epidemiology, 141, 575–580.

    PubMed  CAS  Google Scholar 

  • Brener, N. D., Kann, L., McManus, T., Kinchen, S. A., Sundberg, E. C., & Ross, J. G. (2002). Reliability of the 1999 youth risk behavior survey questionnaire. Journal of Adolescent Health, 31, 336–342.

    Article  PubMed  Google Scholar 

  • Catania, J. A., Gibson, D. R., Chitwood, D. D., & Coates, T. J. (1990). Methodological problems in AIDS behavioral research: Influences on measurement error and participation bias in studies of sexual behavior. Psychological Bulletin, 108, 339–362.

    Article  PubMed  CAS  Google Scholar 

  • Coates, R., Soskolne, C., Clazavara, L., Read, S., Fanning, N., Schpahard, F., et al. (1986). The reliability of sexual histories in AIDS related research: Evaluation of an interview administered questionnaire. Canadian Journal of Public Health, 77, 343–348.

    CAS  Google Scholar 

  • Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–220.

    Article  CAS  PubMed  Google Scholar 

  • Des Jarlais, D. C., Paone, D., Milliken, J., Turner, C. F., Miller, H., Gribble, J., et al. (1999). Audio-computer interviewing to measure risk behaviour for HIV among injecting drug users: A quasi-randomized trial. Lancet, 353, 1657–1662.

    Article  PubMed  CAS  Google Scholar 

  • Dugan, T. M., & Meyer-Bahlburg, H. F. L. (2003). A training program for sex research interviewers. In D. di Mauro, G. Herdt, & R. Parker (Eds.), Handbook of sexuality research training initiatives (pp. 80–92). New York: Social Science Research Council.

    Google Scholar 

  • Durant, L. E., & Carey, M. P. (2002). Reliability of retrospective self-reports of sexual and nonsexual health behaviors among women. Journal of Sex and Marital Therapy, 28, 331–338.

    Article  PubMed  Google Scholar 

  • Ellen, J. E., Gurvey, J. E., Pasch, L., Tschann, J., Nanda, J. P., & Catania, J. (2002). A randomized comparisons of A-CASI and phone interviews to assess STD/HIV-related risk behaviors in teens. Journal of Adolescent Health, 31, 26–30.

    Article  PubMed  Google Scholar 

  • Flisher, A. J., Evans, J., Muller, M., & Lombard, C. (2004). Test–retest reliability of self-reported adolescent risk behavior. Journal of Adolescence, 27, 207–212.

    Article  PubMed  Google Scholar 

  • Hays, W. L. (1994). Statistics (5th ed.). Fort Worth, TX: Harcourt Brace.

  • Hearn, K. D., O’Sullivan, L. F., & Dudley, C. D. (2003). Assessing reliability of early adolescent girls’ reports of romantic and sexual behavior. Archives of Sexual Behavior, 32, 513–521.

    Article  PubMed  Google Scholar 

  • Jennings, T. E., Lucenko, B. A., Malow, R. M., & Devieux, J. G. (2002). Audio-CASI vs. interview method of administration of an HIV/STD risk of exposure screening instrument for teenagers. International Journal of STD and AIDS, 13, 781–784.

    Article  PubMed  Google Scholar 

  • Macalino, G. E., Celentano, D. D., Latkin, C., Strathdee, S. A., & Vlahov, D. (2002). Risk behaviors by audio computer-assisted self-interviews among HIV-seropositive and HIV-seronegative injection drug users. AIDS Education and Prevention, 14, 367–378.

    Article  PubMed  Google Scholar 

  • McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30–46.

    Article  Google Scholar 

  • McLaws, M. L., Oldenburg, B., Ross, M. W., & Cooper, D. A. (1990). Sexual behavior in AIDS-related research: Reliability and validity of recall and diary measures. Journal of Sex Research, 27, 265–281.

    Google Scholar 

  • Metzger, D. S., Koblin, B., Turner, C., Navaline, H., Valenti, F., Holte, S., et al. (2000). Randomized controlled trial of audio computer-assisted self-interviewing: Utility and acceptability in longitudinal studies. American Journal of Epidemiology, 152, 99–106.

    Article  PubMed  CAS  Google Scholar 

  • Meyer-Bahlburg, H. F. L., Ehrhardt, A. A., Exner, T. A., & Gruen, R. S. (1988). Sexual Risk Behavior Assessment Schedule for Youths (SERBAS-Y-SH). Unpublished measure, HIV Center for Clinical and Behavioral Studies, New York State Psychiatric Institute.

  • Meyer-Bahlburg, H. F. L., Ehrhardt, A. A., Exner, T. A., & Gruen, R. S. (1994). Sexual Risk Behavior Assessment Schedule for Homosexual Youths (SERBAS-Y-HM). Unpublished measure. (Available from H. F. L. Meyer-Bahlburg, HIV Center for Clinical and Behavioral Studies, New York State Psychiatric Institute, 1051 Riverside Drive, Unit 15, New York, NY 10032, meyerb@childpsych.columbia.edu.)

  • Newcomer, S., & Udry, J. R. (1988). Adolescents’ honesty in a survey of sexual behavior. Journal of Adolescent Research, 3, 419–423.

    Article  Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

  • Rosario, M., Hunter, J., Maguen, S., Gwadz, M., & Smith, R. (2001). The coming-out process and its adaptational and health-related associations among gay, lesbian, and bisexual youths: Stipulation and exploration of a model. American Journal of Community Psychology, 29, 133–160.

    Article  PubMed  CAS  Google Scholar 

  • Rosario, M., Mahler, K., Hunter, J., & Gwadz, M. (1999). Understanding the unprotected sexual behaviors of gay, lesbian, and bisexual youths: An empirical test of the cognitive–environmental model. Health Psychology, 18, 272–280.

    Article  PubMed  CAS  Google Scholar 

  • Rosario, M., Meyer-Bahlburg, H. F. L., Hunter, J., Exner, T. M., Gwadz, M., & Keller, A. M. (1996). The psychosexual development of urban lesbian, gay, and bisexual youths. Journal of Sex Research, 33, 113–126.

    Article  Google Scholar 

  • Rosario, M., Meyer-Bahlburg, H. F. L., Hunter, J., & Gwadz, M. (1999). Sexual risk behaviors of gay, lesbian, and bisexual youths in New York City: Prevalence and correlates. AIDS Education and Prevention, 11, 476–496.

    PubMed  CAS  Google Scholar 

  • Rosario, M., Schrimshaw, E. W., & Hunter, J. (2004). Ethnic/racial differences in the coming-out process of lesbian, gay, and bisexual youths: A comparison of sexual identity development over time. Cultural Diversity and Ethnic Minority Psychology, 10, 215–228.

    Article  PubMed  Google Scholar 

  • Saltzman, S. P., Stoddard, A. M., McCusker, J., Moon, M. W., & Mayer, K. H. (1987). Reliability of self-reported sexual behavior risk factors for HIV infection in homosexual men. Public Health Reports, 102, 692–697.

    PubMed  CAS  Google Scholar 

  • Schroder, K. E. E., Carey, M. P., & Vanable, P. A. (2003). Methodological challenges in research on sexual risk behavior: II. Accuracy of self-reports. Annals of Behavioral Medicine, 26, 104–123.

    Article  PubMed  Google Scholar 

  • Siegel, D. M., Aten, M. J., & Roghmann, K. J. (1998). Self-reported honesty among middle and high school students responding to a sexual behavior questionnaire. Journal of Adolescent Health, 23, 20–28.

    Article  PubMed  CAS  Google Scholar 

  • Weinhardt, L. S., Forsyth, A. D., Carey, M. P., Jaworski, B. C., & Durant, L. E. (1998). Reliability and validity of self-report measures of HIV-related sexual behavior: Progress since 1990 and recommendations for research and practice. Archives of Sexual Behavior, 27, 155–180.

    Article  PubMed  CAS  Google Scholar 

  • Wiederman, M. W. (2002). Reliability and validity of measurement. In M. W. Wiederman & B. E. Whitley (Eds.), Handbook for conducting research on human sexuality (pp. 25–50). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Williams, M. L., Freeman, R. C., Bowen, A. M., Zhao, Z., Elwood, W. N., Gordon, C., et al. (2000). A comparison of the reliability of self-reported drug use and sexual behaviors using computer-assisted versus face-to-face interviewing. AIDS Education and Prevention, 12, 199–213.

    PubMed  CAS  Google Scholar 

Download references

ACKNOWLEDGMENTS

This work was supported by the National Institute of Mental Health Center Grant P50-MH43520 (Anke A. Ehrhardt, Principal Investigator of the HIV Center for Clinical and Behavioral Studies; Margaret Rosario, Principal Investigator of research project “HIV Risk and Coming-Out Among Gay and Lesbian Adolescents”; and Heino F. L. Meyer-Bahlburg, Principal Investigator of the Psychosexual Core).

Author information

Authors and Affiliations

  1. Doctoral Program in Psychology, The City University of New York - Graduate Center, New York, New York, USA

    Eric W. Schrimshaw M.A. & Margaret Rosario Ph.D.

  2. Department of Psychology, The City University of New York - The City College, New York, New York, USA

    Margaret Rosario Ph.D.

  3. HIV Center for Clinical and Behavioral Studies, New York State Psychiatric Institute, New York, New York, USA

    Heino F. L. Meyer-Bahlburg Dr. rer. nat.

  4. Department of Psychology, Iona College, New Rochelle, New York, USA

    Alice A. Scharf-Matlick Ph.D.

  5. the Center for the Psychosocial Study of Health & Illness, Mailman School of Public Health, Columbia University, 100 Haven Avenue, Suite 6A, New York, New York 10032, USA

    Eric W. Schrimshaw M.A.

Authors
  1. Eric W. Schrimshaw M.A.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Margaret Rosario Ph.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heino F. L. Meyer-Bahlburg Dr. rer. nat.
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alice A. Scharf-Matlick Ph.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eric W. Schrimshaw M.A..

Rights and permissions

Reprints and permissions

About this article

Cite this article

Schrimshaw, E.W., Rosario, M., Meyer-Bahlburg, H.F.L. et al. Test–Retest Reliability of Self-Reported Sexual Behavior, Sexual Orientation, and Psychosexual Milestones Among Gay, Lesbian, and Bisexual Youths. Arch Sex Behav 35, 220–229 (2006). https://doi.org/10.1007/s10508-005-9006-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10508-005-9006-2

KEY WORDS:

Search

Navigation