Elsevier

Drug and Alcohol Dependence

Volume 161, 1 April 2016, Pages 29-35
Drug and Alcohol Dependence

Full length article
Interviewer-administered TLFB vs. self-administered computerized (A-CASI) drug use frequency questions: a comparison in HIV-infected drug users

https://doi.org/10.1016/j.drugalcdep.2016.01.007Get rights and content

Highlights

  • We evaluated agreement between Timeline Follow-Back (TLFB) and Audio Computer-Assisted Self Interview (A-CASI) among HIV positive drug users.

  • Patients reported more days used drugs with the A-CASI, relative to the TLFB.

  • Agreement between the TLFB and A-CASI on days used drug was excellent (ICC = 0.80).

  • Ethnicity, gender and age predicted discrepant reporting between the measures.

Abstract

Background

Substance use can have major consequences among HIV patients. Interviewer- or self-administered modalities are widely used to measure drug use frequency. This often involves Timeline Follow-Back (TLFB) interviewer-administered measures, or self-administered computerized questions assessing similar information via Audio Computer-Assisted Self Interview (A-CASI). Little is known about agreement between these two modalities on drug use frequency in HIV-infected samples.

Methods

Prior to randomization into a trial of brief interventions to reduce drug use, 240HIV patients completed a baseline A-CASI assessment battery that included questions on drug use frequency, followed by an interviewer-administered TLFB. Each measure generated number of days patients used their primary drug in the prior 30 days. Agreement between TLFB and A-CASI modalities on days using primary drug was determined using intraclass correlation coefficients (ICC). Regression analysis tested the association of patient characteristics with discrepancies between TLFB and A-CASI modalities.

Results

Overall agreement was excellent (ICC = .80), with little variation by primary drug, education, race, current drug treatment, binge drinking or years since HIV diagnosis. Gender, ethnicity (Hispanic vs. non-Hispanic) and age predicted differences in days used (p < 0.05); the A-CASI modality reflected more days used than TLFB.

Conclusions

Measures of days used primary drug showed high agreement whether assessed by interviewer-administered TLFB or by questions self-administered via the A-CASI modality. Differences by gender, ethnicity and age suggest some caution in using the TLFB, although additional studies are needed. However, findings generally indicate that studies based on one assessment method or the other can be compared with reasonable confidence.

Introduction

Substance use among HIV-infected individuals is associated with many adverse consequences, including poor treatment outcomes (Pacek et al., 2014), low antiretroviral treatment (ART) initiation (Kapadia et al., 2005), HIV sexual risk behaviors, STI transmission (Khan et al., 2013) and hepatitis C virus (HCV; Hermanstyne et al., 2012). Substance use is prevalent among HIV-infected persons (Mimiaga et al., 2013, Pacek et al., 2014); in a recent U.S. national survey, 33.1% of those with HIV/AIDS used an illegal drug in the prior 30 days (Pacek et al., 2014). Further, non-injecting drug use is increasingly associated with HIV infection (Des Jarlais et al., 2007). Thus, developing and disseminating effective interventions to reduce drug use in this population is a public health priority. In order to test the efficacy of such interventions, or methods of disseminating them, researchers and clinicians must often measure frequency of substance use.

Measuring frequency of drug use poses significant challenges. Studies often use participant self-reports, which are relatively easy to administer, but can be vulnerable to under-reporting due to two main factors: participants’ inability to accurately recall drug use (forgetting), and social desirability bias (responding inaccurately in an interview due to the desire to appear favorably to the interviewer). Forgetting may occur when the assessment time frame is longer than a day or two, including the common time frame of the prior 30 days. Social desirability bias may occur because drug use is illegal, stigmatizing and potentially embarrassing to report (Rosenbaum et al., 2006), problems that are compounded in HIV-infected individuals who often suffer from multiple stigmatized conditions (Eaton et al., 2015, Katz et al., 2013). Consistent with this, HIV-infected persons consistently report distrust of healthcare institutions (Beer et al., 2009, Eaton et al., 2015), poor communication with providers (Flickinger et al., 2013, Messer et al., 2013), and fears about loss of confidentiality (Beer et al., 2009). In research in a healthcare setting, these issues can all contribute to under-reporting of drug use frequency. Therefore, in HIV patients, drug use frequency could vary by the measurement modality used (Beck et al., 2014, Grucza et al., 2007, Rosenbaum et al., 2006), depending on whether the modality primarily focuses on reducing forgetting, or on reducing social desirability bias.

To assess self-reported drug use frequency, two widely-used modalities are commonly used, interviewer-administered assessments and self-administered assessments. A commonly-used interviewer-administered assessment is the Timeline Follow-Back (TLFB; Sobell and Sobell, 1992). Self-administered assessments, which may consist of simple questions about frequency of drug use, often use the Audio Computer-Assisted Self Interview (A-CASI) modality. Each method has a differential emphasis on reducing forgetting or social desirability bias as a source of under-reporting, as well as other advantages and disadvantages.

In an interviewer-administered TLFB, interviewers work actively to address forgetting by assisting patients to recall events. At the beginning of a TLFB interview, an interviewer uses a calendar with the participant as a recall and memory aid (Carey et al., 2004, Richter and Johnson, 2001, Robinson et al., 2014) reviewing events that occurred in the participant’s life during the time frame of interest (e.g., past 30 days). After noting these events, the interviewer then uses unstructured questions to help the participant recall days of substance use, which are noted on the calendar and tallied later to produce measures such as drug use frequency. A major assumption about the interviewer-administered TLFB modality is that the face-to-face, interviewer-administered, semi-structured format establishes trust and rapport between interviewer and participant (Rosenbaum et al., 2006), overcoming social desirability bias. An advantage of interviewer-administered TLFBs is that interviewers can work to ensure that patients attend to each question, and can also provide additional instructions and clarifications on the procedure for patients as needed. Thus, the TLFB is seen as advantageous for diverse patients, including those with mild cognitive impairments or other characteristics potentially affecting attention and recall (Sacks et al., 2003). The major disadvantage of the TLFB is that respondents may minimize their drug use reports to present themselves in a socially desirable manner. In addition, although TLFB interviewers are trained to administer the TLFB in a standardized way, they may unintentionally offer patients varying levels of non-standardized communication and feedback (Richter and Johnson, 2001). Despite these potential influences on reporting, the TLFB has shown strong test-retest reliability across several substances (Robinson et al., 2014) and across diverse populations (Carey et al., 2004, Fals-Stewart et al., 2000, Levy et al., 2004, Sacks et al., 2003). The TLFB has also shown strong concurrent validity using biological measures(Hjorthøj et al., 2012), other interviewer-administered instruments (Dennis et al., 2004, Fals-Stewart et al., 2000) and self-report instruments (Fals-Stewart et al., 2000, Sacks et al., 2003).

In the A-CASI modality, questions about drug use frequency (simple or complex) are self-administered without an interviewer, allowing patients to respond privately and thus reducing the threat of social desirability bias (Estes et al., 2010, Richter and Johnson, 2001). This privacy could result in more accurate and honest responses, yielding greater reports of drug use. For example, patients may feel uncomfortable reporting substance use behaviors to an interviewer due to fear of stigmatization. The confidentiality of the A-CASI format is assumed to eliminate this (Dolezal et al., 2012, Estes et al., 2010). Another A-CASI advantage is the consistency in administration of questionnaire items within and across patients. The same program and questions are always used, ensuring a standardized protocol. In addition, the program used to administer the A-CASI questionnaire automatically generates a data file for analysis, eliminating the need for post-interview data entry and tallying. However, A-CASI administration leaves the study team reliant on patients' willingness and ability to read questionnaire items carefully and enter their data accurately, with no way of identifying data entry errors and outlier responses. This could yield some responses that appear implausible, with no obvious way to resolve them (Rosenbaum et al., 2006, Wright et al., 1998). Drug use frequency questions administered in the A-CASI modality have demonstrated good test-retest reliability (McNeely et al., 2014) and validity (Qian et al., 2014, Simões and Bastos, 2004) to measure drug use in primary care patients and in drug users (Islam et al., 2012).

Past research has typically demonstrated that respondents report higher rates of drug and alcohol use with a self-administered questionnaire than a face-to-face interview (Bjarnason and Adalbjarnardottir, 2000, Rosenbaum et al., 2006). However, little is known about the agreement between the interviewer-administered TLFB and other questions on frequency of drug use administered via A-CASI to HIV-infected patients who are drug users. Substantial disagreement would indicate that studies using one method should not be compared to similar studies that used the other method, impairing the field's ability to aggregate data across studies. Further, knowledge is limited on whether or not disclosure of drug use between the two modalities varies by patient characteristics. Previous studies suggest that in general, demographic characteristics such as age (Ledgerwood et al., 2008, Vigil-Colet et al., 2015, Welte and Russell, 1993), race (Johnson and Fendrich, 2005, Ledgerwood et al., 2008, White et al., 2014) gender (Bjarnason and Adalbjarnardottir, 2000, Dolezal et al., 2012) and socioeconomic status (Welte and Russell, 1993) may be related to differential reporting of sensitive health behaviors. Whether these characteristics differentially affect reporting of drug use frequency in interviewer-administered vs. A-CASI-administered assessments among HIV positive patients is presently unknown.

The main purpose of this study was therefore to test the agreement on drug use frequency in the prior 30 days between questions administered in an A-CASI battery and in data tallied from interviewer-administered TLFB interviews. We also examined whether the agreement between A-CASI and TLFB data was associated with patient demographic and clinical characteristics.

Section snippets

Procedures

The current study uses baseline data from an ongoing randomized trial of brief interventions to reduce non-injection drug use (NIDU) in HIV primary care patients (Aharonovich et al., 2012). Participants were recruited from two large HIV primary care clinics in New York City between 2011 and 2014. The HIV clinics mainly serve low-SES, minority patients from all five boroughs of New York City. Participants were referred by clinic staff to a bi-lingual study coordinator, who screened patients for

Results

As shown in Table 1, most patients were male (82.8%) and African American (66.5%). Participants were primarily in mid-adulthood (mean age: 46.6 years) and had at least a high school education (68.1%). Many identified cocaine or crack as their primary drug (70.2%), about a fifth reported receiving alcohol or drug treatment outside the study (17.6%), and about one-third were binge drinkers (34.3%).

Participants reported using their primary drug an average of 10.0 days in past 30 days with the

Discussion

The aims of this study were to assess the agreement between two widely used methods to assess frequency of illicit drug use, i.e., days used primary drug in the prior 30 days. Each of these measures attempts to reduce under-reporting, but focuses on different ways of accomplishing this. One measure consisted of structured questions self-administered via computer (A-CASI), a modality that provides participant privacy to reduce under-reporting due to social desirability. The other measure, the

Conflict of interest

No conflict declared.

Funding

Financial support for this research was provided by the National Institutes of Health grants R01 DA024606 (EA) and R01 AA023163 (DSH) and the New York State Psychiatric Institute (DSH). The funding sources had no further involvement in this research.

Contributors

EA and DSH conducted the original trial from which data were used. EMD was responsible for statistical analyses and drafting of the manuscript. EMD, EA, and DSH participated in interpretation of data, critical revisions, and approval of the manuscript.

References (45)

  • K.B. Carey et al.

    Temporal stability of the Timeline Followback interview for alcohol and drug use with psychiatric outpatients

    J. Stud. Alcohol

    (2004)
  • Company, N.R

    Questionnaire Development System

    (2013)
  • M.L. Dennis et al.

    Cross-validation of the alcohol and cannabis use measures in the Global Appraisal of Individual Needs (GAIN) and Timeline Followback (TLFB; Form 90) among adolescents in substance abuse treatment

    Addiction

    (2004)
  • D.C. Des Jarlais et al.

    Convergence of HIV seroprevalence among injecting and non-injecting drug users in New York City

    AIDS

    (2007)
  • C. Dolezal et al.

    A comparison of audio computer-assisted self-interviews to face-to-face interviews of sexual behavior among perinatally HIV-exposed youth

    Arch. Sex. Behav.

    (2012)
  • L.A. Eaton et al.

    The role of stigma and medical mistrust in the routine health care engagement of black men who have sex with men

    Am. J. Public Health

    (2015)
  • L.J. Estes et al.

    Perceptions of audio computer-assisted self-interviewing (ACASI) among women in an HIV-positive prevention program

    PLoS ONE

    (2010)
  • W. Fals-Stewart et al.

    The timeline followback reports of psychoactive substance use by drug-abusing patients: psychometric properties

    J. Consult. Clin. Psychol.

    (2000)
  • T.E. Flickinger et al.

    Higher quality communication and relationships are associated with improved patient engagement in HIV care

    J. Acquir. Immune Defic. Syndr.

    (2013)
  • R.A. Grucza et al.

    Discrepancies in estimates of prevalence and correlates of substance use and disorders between two national surveys

    Addiction

    (2007)
  • K.A. Hermanstyne et al.

    The association between use of non-injection drug implements and hepatitis C virus antibody status in homeless and marginally housed persons in San Francisco

    J. Public Health (Oxf.)

    (2012)
  • Inc., S.I

    Base SAS 9.4 Procedures Guide

    (2014)
  • Cited by (0)

    View full text