Flowchart of participant recruitment.
Smith PC, Schmidt SM, Allensworth-Davies D, Saitz R. A Single-Question Screening Test for Drug Use in Primary Care. Arch Intern Med. 2010;170(13):1155-1160. doi:10.1001/archinternmed.2010.140
Drug use (illicit drug use and nonmedical use of prescription drugs) is common but underrecognized in primary care settings. We validated a single-question screening test for drug use and drug use disorders in primary care.
Adult patients recruited from primary care waiting rooms were asked the single screening question, “How many times in the past year have you used an illegal drug or used a prescription medication for nonmedical reasons?” A response of at least 1 time was considered positive for drug use. They were also asked the 10-item Drug Abuse Screening Test (DAST-10). The reference standard was the presence or absence of current (past year) drug use or a drug use disorder (abuse or dependence) as determined by a standardized diagnostic interview. Drug use was also determined by oral fluid testing for common drugs of abuse.
Of 394 eligible primary care patients, 286 (73%) completed the interview. The single screening question was 100% sensitive (95% confidence interval [CI], 90.6%-100%) and 73.5% specific (95% CI, 67.7%-78.6%) for the detection of a drug use disorder. It was less sensitive for the detection of self-reported current drug use (92.9%; 95% CI, 86.1%-96.5%) and drug use detected by oral fluid testing or self-report (81.8%; 95% CI, 72.5%-88.5%). Test characteristics were similar to those of the DAST-10 and were affected very little by participant demographic characteristics.
The single screening question accurately identified drug use in this sample of primary care patients, supporting the usefulness of this brief screen in primary care.
Illicit drug use and nonmedical use of prescription drugs are common in the primary care setting and are underrecognized.1,2 Screening for drug use allows clinicians to counsel patients and, when indicated, refer them to treatment. Because of this, the Substance Abuse and Mental Health Services Administration has promoted the integration of screening and brief intervention for substance use disorders into the primary care setting.3 Screening for drug use is also useful as part of routine clinical care, for instance to aid in diagnosis and to avoid medication interactions. Few screening instruments for drug use or drug disorders have been validated, however, for use in primary care settings. Time is also limited during the primary care office visit, and commonly recommended drug screening instruments are composed of multiple questions, can be time consuming to administer, and may require scoring.4,5 Practice guidelines currently recommend the use of a single screening question for the detection of unhealthy alcohol use in primary care settings.6 Analogous single screening questions may also improve screening for drug use. We therefore set out to validate such a screening question in a sample of primary care patients.
The study was conducted between October 2006 and June 2007 at an urban safety-net hospital-based primary care clinic at an academic medical center. The participant selection and data collection methods have been described previously.7 Briefly, a sample of patients in the waiting room was selected by a research associate who systematically approached those waiting to be seen according to a predetermined pattern based on waiting room seating, which was varied daily. This was done to minimize biased selection of participants, because, owing to the large number of patients attending the clinic, all patients could not be approached. Prior to being approached for eligibility screening, patients saw no advertisement or indication by the research associate as to what the study was about. Patients who were younger than 18 years were excluded, as were those who, in the judgment of the research associate, would be unable to complete the questionnaire because of limited English, cognitive impairment, or acute illness. People in the waiting room accompanying patients who reported that they themselves were not patients of the clinic were also excluded. The institutional review board of Boston University Medical Center, Boston, Massachusetts, reviewed and approved all study procedures.
Interviews were conducted by trained research staff in a private setting, and data were recorded anonymously, unaccompanied by any unique identifiers. Participants were first asked the single screening question, “How many times in the past year have you used an illegal drug or used a prescription medication for nonmedical reasons?” (where a response of ≥1 time was considered positive for drug use). If asked to clarify the meaning of “nonmedical reasons,” the research associate added “for instance because of the experience or feeling it caused.” After participants responded to the single screening question, they were asked if they had ever experienced any of a list of problems related to drug use. For this we modified the previously described Short Inventory of Problems–Alcohol and Drug (SIP-AD) questionnaire, which asks about problems ever experienced in the participant's lifetime related to alcohol or drug use.8 We modified this by eliminating the word alcohol from the questions, a modification we hereafter refer to as the Short Inventory of Problems–Drug Use (SIP-DU). In a separate analysis (but in these participants) we determined the reliability and validity of the SIP-DU as a measure of drug use consequences.9 The computerized version of the Composite International Diagnostic Interview (CIDI) Substance Abuse Module was used for the assessment of current (12-month) drug use disorders.10 This structured interview yields a Diagnostic and Statistical Manual of Mental Disorders(Fourth Edition) diagnosis of drug abuse or dependence. In addition, as part of the CIDI, individuals were asked detailed questions about current (past year) use of illicit drugs (marijuana, cocaine, heroin, stimulants, or hallucinogens) and nonmedical use of prescription drugs. Following the interview, participants were asked to undergo oral fluid testing for the presence of common drugs of abuse (opiates, benzodiazepines, cocaine, methamphetamines, or tetrahydrocannabinol). Once collected, oral fluid was sent to an outside laboratory for analysis using methods that yielded results comparable to urine drug screening (Intercept immunoassay; OraSure Technologies, Bethlehem, Pennsylvania).11- 14 To aid in the interpretation of drug test results, individuals had been asked, as part of the interview, if they had recently been prescribed any drugs from a list of opiates or benzodiazepines. Because this question was added to the questionnaire during the study, responses were missing from 23 patients who underwent oral fluid testing. Participants were not told that they would be asked to undergo drug testing until the interview was complete. After completing the interview, they were compensated and thanked for their participation. They were then asked to undergo oral fluid testing, and a second informed consent process was completed. Following the single drug screening question, but before the other assessments, the 10-item Drug Abuse Screening Test (DAST-10) was administered for comparison.4 As part of a parallel study on screening for unhealthy alcohol use, participants were also asked a single alcohol screening question (preceding the drug screening question), 2 other brief alcohol screening questionnaires, and a calendar-based assessment of past-month alcohol consumption (all after the drug screen and prior to the CIDI).7
Participants were considered to have current drug use if, during the CIDI, they reported the use of an illicit drug (marijuana, cocaine, heroin, stimulants, or hallucinogens), or the use of a prescription drug for nonmedical reasons, during the past 12 months. A second analysis included only individuals who consented to oral fluid testing. Participants in this analysis were considered to have current drug use if they met these criteria; if oral fluid testing was positive for cocaine, tetrahydrocannabinol, or methamphetamines; or if it was positive for opiates or benzodiazepines and they had not reported receiving a recent prescription for one of these medications. Participants were considered to have drug-related problems if they had current drug use and responded positively to any of the 15 SIP-DU questions. Those with drug abuse or dependence as determined by the CIDI and who reported experiencing symptoms within the past 12 months were considered to have a current drug use disorder.
We calculated the sensitivity, specificity, likelihood ratios, and area under the receiver operating curve (AUC) of the single-question screen for the detection of drug use, drug use associated with problems, and a current drug use disorder as defined in the previous subsection. The AUC, a measure of a test's discriminatory power, can be interpreted as the probability, given 1 participant without drug use and 1 with drug use drawn at random from the population, that the person with drug use will score higher on the test. An AUC of 1.0 indicates perfect discrimination, an AUC higher than 0.8 indicates good discrimination, and an AUC of less than 0.7 indicates poor discrimination.15 For comparison with the single-question screen, we calculated the sensitivity, specificity, likelihood ratios, and AUC of another longer screening test, the DAST-10, for the detection of the same conditions. The DAST-10 yields a score of 0 to 10. A total of more than 2 points is considered a positive screening test result.4 We calculated 95% confidence intervals (CIs) using published formulas.16 Statistical analyses were performed using SAS software (version 9.1; SAS Institute Inc, Cary North Carolina).
Of the 1781 people approached, 903 (51%) agreed to be screened for study eligibility (Figure). Of these, 509 (56%) were ineligible for the study: 302 (33%) did not speak English and 207 (23%) were not clinic patients. Of the 394 patients who were eligible, 303 (76%) participated: 4 (1%) refused to participate, 87 (22%) did not show up for the planned interview after the visit with their physician, and of the 303 individuals who arrived and gave consent to participate, 3 (1%) were unable to complete the interview. The data of 14 participants (5%) were lost owing to an electronic error, leaving 286 whose data were analyzed (73% of those eligible). After completion of the interview, patients were asked to undergo oral fluid testing for common drugs of abuse, to which 240 (84%) consented. Of these, 217 were asked about a recent prescription for opiates or benzodiazepines.
Of the 286 participants, 54% were women, and the median age was 49 years (range, 21-86 years) (Table 1). Most participants (63%) identified themselves as black or African American, with whites (17%) and Hispanics (16%) comprising most of the remainder. Most (78%) had completed high school, but only 14% had completed college. The prevalence of self-reported current (past-year) drug use was 35% (with 32% reporting at least 1 problem relating to use), and among those who consented to oral fluid testing, 40% either self-reported drug use or had a positive test result (38% with problem use). The prevalence of current drug abuse or dependence was 13%. The lifetime prevalence of alcohol use disorders (44%) and drug use disorders (47%) was high.
The single-question screen was 100% sensitive (95% CI, 90.6%-100%) and 73.5% specific (95% CI, 67.7%-78.6%) for the detection of a current drug use disorder (Table 2). It was slightly less sensitive (92.9%; 95% CI, 86.1%-96.5%) and was more specific (94.1%; 95% CI, 89.8%-96.7%) for the detection of current drug use (although CIs overlapped). If oral fluid test results were taken into account, the sensitivity for detecting current drug use was lower (84.7%; 95% CI, 75.6%-90.8%). The longer DAST-10 screen was also 100% sensitive (95% CI, 90.6%-100%) for the detection of a current drug use disorder and was 77% specific (95% CI, 71.5%-81.9%); overall, its test characteristics were similar to those of the single-question screen (Table 3). Participant education and primary language affected point estimates of the sensitivity and specificity of the single-item screen very little, although for some groups with small sample sizes there was insufficient power to exclude large differences (Table 4). The single-item screen may be less specific for the detection of a current drug use disorder in men and in Hispanic patients.
A single-question screen was sensitive and specific for the detection of drug use and drug use disorders in a sample of primary care patients. Its test characteristics were similar to those of a longer screening tool in this sample, as well as in other studies reported in the literature.4
Drug use is prevalent in primary care.1 While national guidelines do not currently recommend universal screening for drug use in primary care, recent evidence supports the effectiveness of brief intervention in this setting, and screening, brief intervention, and referral to treatment initiatives are widespread.3,17 In addition to identifying patients who might benefit from brief physician counseling, drug use screening is likely worthwhile in many clinical circumstances, such as identifying potential medication interactions and prescribing risks (as when clinicians ask patients to report prescription and over-the-counter medication use and alternative medicines as part of routine care).
Time constraints in the primary care setting have been cited as a reason for failure to provide screening and prevention in general (according to one estimate, providing all recommended preventive services to an average primary care panel would require 7.4 hours out of each workday18). Successful screening and brief intervention programs therefore require a means of quickly selecting, from among all primary care patients, those most likely to benefit from further assessment and intervention. Single-question screening tests for unhealthy alcohol use have been validated, and one such test is currently recommended by the National Institute on Alcohol Abuse and Alcoholism in its most recent clinician's guide.6 To our knowledge, no other single-question screening test for drug use has been validated in any setting. Such a screening test could facilitate early identification and brief intervention, as well as the avoidance of prescription errors and associated risks.
A number of drug use screening instruments have been proposed for use in general medical settings, ranging from 2 questions to more than 70.5,19 Some of these are modified versions of alcohol screening tests, and some ask simultaneously about both alcohol and drugs (so-called conjoint screens). Conjoint screens may be more acceptable to some patients than direct questioning about drug use but also require more clarification of a positive screen result, and some of the questions, adapted from alcohol screening tests, may be less applicable to drug use (eg, the “eye-opener” question from the CAGE-AID [“Adapted to Include Drugs”] questionnaire).20 A brief, 2-item conjoint screen (TICS) has been validated, representing a screening strategy of equivalent brevity to asking a single question about drug use and a single question about alcohol. The TICS was 79% sensitive and 78% specific for either an alcohol or drug use disorder. The sensitivity for a drug use disorder was similar, but specificity was not reported.19 Two longer, but still brief, conjoint screens, the CAGE-AID and RAFFT, have been tested in adults, with similar test characteristics.20,21 These conjoint tests target drug disorders but do not specifically identify drug use.
The DAST-10 (to our knowledge, not validated in a primary care sample until the present article), the Drug Use Disorders Identification Test (validated only in criminal justice and detoxification settings), and the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), 3 screening questionnaires that ask about drug use specifically, have better test characteristics than the shorter conjoint screening tests and address part of the spectrum of clinical interest beyond drug diagnoses to include use and problems, but their length (10-28 questions for the DAST-10 and >70 questions for the ASSIST) and the need for scoring represent significant barriers to their use as screens in the primary care setting.4,5,22 As a screening test (as opposed to an assessment of severity or a diagnostic tool), the single-question screen performed almost as well as the longer DAST-10 in the sample that we studied. Longer screening tools may, however, have promise as electronic medical record systems with decision support become more widespread (and as evidence for the validity of the ASSIST accumulates), potentially as a follow-up assessment after a positive single-question screen result, or even as a written previsit questionnaire. In summary, in terms of brevity, ease of scoring, and validity for detecting the spectrum of drug use conditions of interest in primary care, and therefore, likely greater widespread implementation, the single-question screen seems to have favorable characteristics.
For a screening test for drug use to be useful, it must be applicable to the broad range of people seen in primary care. The diversity of our participant sample allowed us to examine the effect of sex, ethnicity, primary language, and education on the accuracy of the single-question screen. While variations were seen in the sensitivity and specificity of the test across these groups, the differences were small.
Our study has several limitations. A higher than expected proportion of participants reported substance use disorders, likely reflecting the fact that they were recruited from an urban safety-net hospital located in a community where the prevalence of such problems is high. While this potentially limits the generalizability of our results, it is this type of high-risk population that is typically targeted for screening and brief intervention (as mentioned, universal screening of all adults is not currently recommended, whereas targeted screening is recommended).23 Nevertheless, additional study of the screening question in other settings (as well as in other language and in written and computer-based versions) is warranted. Participants were also assured anonymity, a condition that improves the accuracy of the reference standard interview but that may also serve to overestimate the accuracy of the screening test itself. This is consistent, however, with the methods of most other studies of screening tests for substance use disorders, thus allowing comparability of our findings with those of other studies.
The single-question screen accurately identified primary care patients who use drugs. Some patients who have positive tests results will have severe drug use disorders requiring referral to substance abuse treatment, while those who use drugs but have not experienced severe health or interpersonal problems might benefit from brief intervention by the primary care provider. The lack of an efficient way to distinguish these 2 groups is a challenge that must be addressed when implementing screening for drug use. The DAST-10 and the ASSIST screening tools, in providing scores, provide a measure of severity. Even though they may be too long for universal screening in many settings, they might be used for assessments after a single-item screening question is answered in the affirmative. However, this approach has not been tested or validated.
The single-question screen accurately identified a broad spectrum of drug use in this sample of primary care patients. The sensitivity and specificity of this single question was comparable with that reported for longer instruments in other studies. These findings support the use of this brief screen when identification of drug use is desired in primary care settings, which should, in turn, facilitate the implementation of screening and brief intervention programs in this setting.
Correspondence: Peter C. Smith, MD, MSc, Section of General Internal Medicine, Department of Medicine, Boston University School of Medicine, Second Floor, Crosstown Center, 715 Albany St, Boston, MA 02118 (firstname.lastname@example.org).
Accepted for Publication: December 14, 2009.
Author Contributions:Study concept and design: Smith and Saitz. Acquisition of data: Smith, Schmidt, and Saitz. Analysis and interpretation of data: Smith, Allensworth-Davies, and Saitz. Drafting of the manuscript: Smith, Schmidt, and Saitz. Critical revision of the manuscript for important intellectual content: Smith, Allensworth-Davies, and Saitz. Statistical analysis: Allensworth-Davies. Obtained funding: Smith and Saitz. Administrative, technical, and material support: Schmidt, Allensworth-Davies, and Saitz. Study supervision: Smith and Saitz.
Financial Disclosure: None reported.
Funding/Support: This research was supported by a grant from the National Institute on Alcohol Abuse and Alcoholism (R01-AA010870).
Previous Presentations: This study was presented in abstract form at the Addiction Health Services Research Conference; October 22, 2008; Boston, Massachusetts; and at the annual meeting of the Association for Medical Education and Research in Substance Abuse; November 8, 2008; Washington, DC.