Objective
To describe barriers to the successful use of the 1997 National Heart, Lung, and Blood Institute (NHLBI) asthma guidelines.
Methods
We conducted 3 focus groups to understand barriers to the use of 4 recommendations within the NHLBI guidelines (prescription of inhaled corticosteroids, recommendation of daily peak flowmeter use, smoking cessation screening and counseling, and allergen exposure counseling).
Participants
Twenty-one pediatricians and 1 nurse practitioner, who each followed an average of 47 patients with asthma, participated. Six participants (27%) had a faculty or adjunct appointment at a medical school. Nineteen (90%) of the 21 pediatricians were board certified.
Results
We identified 171 comments about barriers to adherence. Type of recommendation and physician year of graduation from medical school were related to which barrier was prominent. For corticosteroid prescription, senior physicians mentioned lack of agreement, whereas younger physicians described lack of confidence in dosing or recognizing contraindications. For peak flowmeter use, senior physicians emphasized lack of training. Only senior physicians described the inertia of previous practice as a barrier. All groups mentioned time limitations.
Conclusions
Efforts to improve adherence to asthma guidelines should consider the range of barriers that pediatricians face, such as lack of awareness, familiarity, or agreement, and external barriers owing to environmental, guideline, or patient factors. In addition, this study documents barriers not previously considered, such as lack of self-efficacy, lack of outcome expectancy, and inertia of previous practice, that prevent adherence. Because type of recommendation and physician demographics are related to which barriers are prominent, interventions to improve NHLBI guideline adherence should be tailored to these factors.
ASTHMA IS the most common childhood disease, affecting close to 5 million children. In 1997 the National Heart, Lung, and Blood Institute (NHLBI)1 published the latest Guidelines for the Diagnosis and Management of Asthma to "bridge the gap between current knowledge and practice." Guidelines should improve care by decreasing inappropriate variation and expediting the application of new advances.2
However, the ability of guidelines to change physician behavior or patient outcomes has been limited.3 For example, a national survey4 of emergency department directors reported that only 46% of respondents were aware of the NHLBI asthma guidelines. Physician prescribing patterns also suggest that use of anti-inflammatory asthma medication is not consistent with NHLBI guidelines.5 In addition, the percentages of inner-city pediatric patients with asthma who use peak flowmeters (PFMs) (30%), take daily anti-inflammatory agents (39%), or use mattress covers (32%) also indirectly suggest poor physician guideline adherence.6
Surveys7,8 of pediatrician attitudes about guidelines in general report barriers to adherence such as lack of awareness, lack of agreement with specific recommendations, or lack of agreement with the concept of guidelines in general. Regarding the NHLBI guidelines, barriers such as lack of familiarity9 and lack of agreement10 have been documented among internists. Additional hypothesized barriers to physician adherence include economic disincentives to perform recommendations, patient noncompliance, and inadequate time or resources to perform recommendations.11,12 Identification of these barriers can suggest opportunities to improve physician adherence and, thus, improve patient care.
However, we are not aware of any study that attempts to identify the broad range of barriers to the NHLBI guidelines that are encountered by pediatricians. The purpose of this study is to describe these barriers to the successful use of the guidelines and to identify strategies to improve adherence.
We conducted 3 focus groups with primary care physicians and nurse practitioners to understand barriers to the successful use of the 1997 NHLBI asthma guidelines.
Because factors that affect adherence to guidelines are complex, we believe that focus groups are useful for investigating practitioner behavior and providing in-depth information about what people think or feel about an issue.13,14
Participants were practicing physicians and nurse practitioners attending a national continuing medical education (CME) conference at a university medical center. We conducted sessions at least 1 day before any presentations about asthma. No honorarium was offered.
We organized each group based on the participant's year of graduation from medical school. From the distribution of years of graduation, tertiles were created. Twenty-two of 33 physicians who expressed an interest in participating were assigned to 1 of 3 groups based on the tertile of their year of graduation; the remaining 11 were placed on a waiting list. Two physicians who did not attend the focus groups were replaced by similar-aged physicians from the waiting list.
Twenty-one pediatricians and 1 nurse practitioner participated in focus groups of 6 to 8 participants (Table 1). Participants were 14 women and 8 men, representing 11 states and 1 foreign country, who each followed up an average of 47 patients with asthma. Fifteen of 21 participants indicated that they received a fixed salary.
The median year of graduation from medical school for each group was 1990, 1971, and 1961. All physicians completed a pediatric (n=20) or medicine-pediatrics (n=1) residency. Six participants had faculty or adjunct appointments at a medical school or residency program, and 19 were board certified in pediatrics.
Two moderators (M.D.C. and B.E.E.), both aware of the research questions, led the focus group sessions using a format outlined by Krueger.14 The 1-hour sessions were taped in their entirety using nonconcealed microphones. Participants were informed that they could refuse to answer any questions, that they could leave at any time, and that transcripts would not contain participant identifiers. The study was approved by the institutional review board of Johns Hopkins Bayview Medical Center, Baltimore, Md.
We asked open-ended questions to elicit barriers to successful use of the 1997 NHLBI asthma guidelines and 4 specific recommendations within the guidelines. Questions (Table 2) were developed based on a review of the literature and were pilot tested with pediatricians in fellowship training.
Audiotapes of the sessions were transcribed verbatim, except for identifying information. Two investigators (M.D.C. and B.E.E.) independently read each transcript and marked off comments about barriers to adherence.
Two board-certified physicians, who were not present at the focus group sessions and were not involved in development of the model, independently classified each comment into a taxonomy, described in the following paragraphs. They were provided with a brief description of each category of barriers and asked to classify comments about barriers as internal barriers, external barriers that affected internal barriers, or ambiguous.
The taxonomy was based on a previously developed model of physician adherence based on a systematic review of the literature.15 The model suggests that guideline adherence depends on overcoming 6 internal barriers (lack of awareness, lack of familiarity, lack of agreement, lack of self-efficacy, lack of outcome expectancy, and the inability to overcome the inertia of previous practice) and external barriers (ie, patient, environmental, and guideline factors). In general, internal barriers affect adherence through a cognitive component (knowledge) or an affective component (attitudes), whereas external barriers affect adherence through restriction of physician ability.
According to the model, physician nonadherence occurs in the presence of any internal or external barrier. In addition, an external barrier may exacerbate an internal barrier. For example, lack of time during a patient visit (external barrier) may compromise a physician's ability (internal barrier—lack of self-efficacy) to address PFM use for a patient with asthma (physician nonadherence). In another example, inadequate distribution of guidelines (external barrier) may affect physician awareness (internal barrier) of proper corticosteroid prescription for patients with asthma (physician nonadherence).
A third investigator (M.D.C.) adjudicated differences in classification. If differences remained, the comment was considered ambiguous and excluded from further analysis. Finally, 3 additional investigators (L.C.P., N.R.P., and C.S.R.) reviewed the general taxonomy of the barriers for relevance and consistency.
We identified 171 distinct comments about barriers to the successful use of the NHLBI guidelines and classified them within 1 of 6 internal barriers. The 171 comments referred to prescription of inhaled corticosteroids (n=36), recommendation of PFM use (n=25), smoking cessation counseling (n=18), and allergen exposure counseling (n=26). There were 66 comments about the guidelines in general. Fifty-one (30%) of 171 comments required adjudication, and 7 (4%) of 171 comments were considered ambiguous.
Different recommendations elicited different patterns of barriers. We present the different barriers mentioned with each guideline recommendation in the following sections. We then present differences in barriers mentioned by the different groups of physicians, who were grouped by year of medical school graduation.
Barriers to prescribing daily inhaled corticosteroids
Barriers to prescribing daily inhaled corticosteroids were related to lack of familiarity, lack of agreement, lack of self-efficacy, and lack of outcome expectancy (Table 3).
Physicians mentioned disagreement regarding the safety of long-term corticosteroid use as a barrier. "Everybody says there are no problems with inhaled steroids. I'm not so sure about that. We just don't have the experience . . . I think that without 30 or 40 years without using these things chronically, they can't really say that." Specific concerns included cushingoid effects, osteoporosis, growth stunting, and cataract development. Some physicians preferred using cromolyn sodium to inhaled corticosteroids.
Even if comfortable with prescribing corticosteroids, physicians mentioned that parental concern about corticosteroids made prescription difficult. Physicians may not have time or confidence in their ability to address parental concerns. Lack of an education program to which to refer parents and patients and poor continuity of care also hampered physician ability.
Parental fear of corticosteroid adverse effects was associated with poor outcome expectancy as well. Parental fears, which some physicians perceive as media driven, were linked to noncompliance. "The parents pick up anything that gets onto one of those TV news shows, and it gives them another reason for not wanting to comply."
Barriers to the recommendation of daily pfm use
Barriers to recommending daily PFM use were related to lack of agreement, lack of self-efficacy, and lack of outcome expectancy (Table 4).
Physicians mentioned disagreement with PFM usefulness in general and reported recommending PFM use selectively. Barriers that affected self-efficacy included lack of office time to properly measure peak flow, inadequate staff or physician training, and poor follow-up to use PFM readings. Low outcome expectancy was mentioned in relation to poor patient compliance. Furthermore, patients were not always able to purchase or obtain PFMs because of lack of insurance coverage.
Barriers to smoking cessation counseling
Barriers to screening and counseling were associated with lack of self-efficacy and lack of outcome expectancy (Table 5). Unlike other recommendations, lack of agreement or familiarity was not mentioned.
Barriers related to low self-efficacy included lack of training and lack of confidence in physician ability to counsel. If parents wanted to quit, pediatricians did not feel comfortable prescribing anxiolytic agents, antidepressant drugs, or nicotine replacement therapy for smoking cessation. Furthermore, pediatricians mentioned that they were not reimbursed for their efforts.
Smoking cessation counseling was described as time-consuming. Pediatricians also felt pressured to focus only on "urgent" issues as opposed to chronic issues like tobacco use. Other barriers included poor documentation of previous efforts at counseling and a lack of community resources or clinics to which they could refer parents.
Pediatricians described poor outcome expectancy and frustration by poor success at counseling. In addition, other family members at a patient's home who smoke and are not interested in smoking cessation may continue to expose patients to tobacco smoke. Even if cessation is successful, physicians mentioned other sources of chemical irritants (eg, wood-burning stoves), so the overall effect on a patient's asthma may be negligible.
Poor outcome expectancy may be related to guideline recommendations that are contrary with the cultural norms of a segment of the patient population.
"Where I practice, our minority groups are Native Americans and it is the norm in their society to smoke." In this case, it was believed that even well-conducted smoking cessation counseling could not overcome this norm.
Barriers to allergen exposure counseling
Barriers to allergen exposure counseling were associated with lack of agreement, lack of self-efficacy, and lack of outcome expectancy (Table 6).
Some physicians disagreed with the effectiveness of interventions and the application of the guidelines to all patients.
Physicians also reported poor self-efficacy in discussing difficult and sensitive subjects such as limiting exposure to house pets. This process was more difficult by the lack of time to counsel. "In managed care there's time constraints. Every 10 minutes you have to see a patient. You don't have much time really to sit with a patient and talk about these things."
Physicians also reported poor outcome expectancy because of poor compliance and resistance to giving up a family pet. "I think there is greater resistance to giving up a pet than making the home smoke free." As a result, "you have to choose your battles carefully and pick what will most likely work." If families lived in rented housing, they could not always comply with recommendations such as removing wall-to-wall carpeting. In addition, many families did not have adequate insurance coverage or could not afford recommended interventions.
Barriers to adherence to the guidelines in general
Physicians mentioned barriers not specific to a particular recommendation but in reference to the guidelines in general (Table 7). These barriers were associated with all the internal barriers.
Lack of awareness was associated with lack of time to stay informed and poor guidelines distribution. Physicians suggested distribution to hospital libraries, emergency departments, and community hospitals. Distribution through pharmaceutical representatives was viewed with suspicion. "Right now I feel that I am at the mercy of the drug reps, and they have their own little agenda. It's horrible. That's where the information is coming from."
Although physicians were aware of the guidelines' existence, they were not necessarily familiar with all recommendations. Poor presentation may have added to a lack of physician familiarity because the guidelines were described as tedious, repetitive, confusing, and unclear.
Physicians disagreed with the categories used to describe patients, the timeliness of therapeutic recommendations, and the guidelines' "stepwise" and simplistic nature. Barriers associated with self-efficacy, ie, confidence in the ability to carry out recommendations,16 included difficulty in applying guideline categories, lack of time and reimbursement for following recommendations, and lack of continuity for follow-up.
Outcome expectancy is the belief that performing a recommendation will have an effect. If physicians have low outcome expectancy, they will be less likely to perform a recommendation.16 Associated barriers included patient noncompliance, denial, lack of understanding, and lack of patient appreciation for preventive care.
When the guidelines suggested modifying current practice, physicians also mentioned inertia as a barrier. Some physicians preferred gradual changes or needed to "test" recommendations before consistently following them. If patients were already doing well, physicians were resistant to changing current practice.
Differences among physician age groups
The groups were organized according to year of graduation from medical school. Senior physicians emphasized barriers different from those mentioned by younger colleagues. For example, only senior physicians noted inertia of previous practice as a barrier to adherence.
For corticosteroid prescription, senior physicians mentioned lack of agreement owing to concern about adverse effects, whereas younger physicians described lack of self-efficacy, including less confidence in their ability to determine dosing for corticosteroids or recognize contraindications.
For recommending PFM use, only senior physicians described lack of self-efficacy owing to lack of training and lack of confidence in their ability to interpret readings.
For smoking cessation counseling, younger physicians mentioned barriers associated with lack of training, whereas senior physicians emphasized barriers associated with lack of outcome expectancy owing to patient noncompliance.
For allergen control counseling, all groups mentioned similar barriers. All groups also mentioned barriers related to "time pressures" for all guideline recommendations.
We identified a range of barriers that physicians face when using the NHLBI asthma guidelines. Different types of barriers were prominent for different recommendations from the same guideline. In addition, different types of barriers were prominent for different groups of physicians. Identification of these barriers and an understanding of how recommendation and physician characteristics affect barriers can suggest interventions to improve adherence.
Internal and external barriers to adherence
As in previous studies,7,8 we document barriers such as lack of awareness and lack of agreement. However, we are also the first to report additional sources of poor adherence to the NHLBI guidelines, such as lack of self-efficacy, lack of outcome expectancy, and inertia of previous practice, that have not been examined previously.
According to social cognitive theory, self-efficacy is the belief that one can actually execute a behavior, whereas outcome expectancy is the belief that a behavior will lead to a particular consequence.16 Both factors affect whether a behavior (ie, adhering to guidelines) will be initiated and are associated with preventive health education and counseling.15,16 Results of this study confirm that these barriers (ie, low self-efficacy in using PFMs and low outcome expectancy in the effectiveness of smoking cessation counseling) also affect NHLBI guideline adherence. This study also confirms the importance of barriers associated with the inertia of previous practice (ie, physician habit), as described with other guidelines.15,17-20
By not considering this variety of barriers, interventions may be overlooked, such as incorporating in-depth skills training into CME to improve self-efficacy,21,22 using audit and feedback by respective peers to overcome inertia of previous practice,20 and provision of nurse educators to address time limitations.23 With multiple barriers, a comprehensive strategy with multiple interventions may be necessary.24
Low outcome expectancy may be caused by physician inability to discern counseling success at a population level. For example, physicians voiced frustration at the low success rate of smoking cessation counseling. Although consistent smoking cessation counseling may increase a population's quit rate from only 3% to 5%,25 even this small change is enormously beneficial.26 Because physicians see patients one at a time and may not be cognizant of practicewide results, feedback of population-level success rates may improve outcome expectancy and subsequent adherence.
Interventions to address low outcome expectancy could also focus on the associated external barrier. For example, low patient compliance was associated with low physician outcome expectancy. Targeted education programs for patients and parents have been effective in improving asthma self-management.27,28 Office-based interventions can also improve patient compliance.29 Improving patient compliance has a direct effect on patient outcomes. In addition, by addressing physician perceptions of low outcome expectancy owing to poor patient compliance, physicians may be more enthusiastic about adhering to NHLBI guidelines.
Although lack of awareness and lack of familiarity are previously described9 barriers to adherence, there were unique themes to the NHLBI guidelines.
Although guideline dissemination via pharmaceutical representatives increases availability, physicians viewed any information from such sources with suspicion. Physicians preferred receiving information from "neutral" sources such as CME conferences or libraries, or directly from the NHLBI.
Direct mailing from the National Institutes of Health of its consensus statement on osteoporosis was effective in improving physician awareness in a controlled trial.30 The use of clinical alerts by the National Institutes of Health has also been effective in disseminating new information and changing physician practice.31 Interventions using local opinion leaders to improve awareness and familiarity might also be effective and credible.32
Guideline presentation, which affected familiarity, must balance 2 possibly competing concerns. Some comments suggested brevity because the guidelines were described as repetitious, dense, and lengthy. These comments are similar to results of other studies. For example, in a case study,33 physicians transformed a national guideline for the treatment of depression from a "research literature" orientation to a more "clinical decision–oriented" document for local use. In another study,34 physicians at an academic hospital preferred the use of "algorithms with treatment-specific information that is placed on the front of a patient chart." However, in our study, physicians also described the NHLBI guidelines as too simplistic or cookbook and unable to handle the complex realities of everyday practice. The use of multiple formats, ie, concise, clinical-oriented summaries with references to more detailed explanations, might accommodate the different needs of different physicians.8,35,36
Results of this study also confirm disagreement as a barrier to adherence.10 However, with respect to corticosteroid recommendations, disagreement was associated with senior pediatricians.
Local medical communities can be relatively closed systems, where changes in an individual's practice are primarily affected by local colleagues and consensus.37 Opinion leaders are members of a local medical community who influence the acceptance of an innovation, such as a guideline, by that community.38 As a result, interventions that target these persons may be effective in helping shape local consensus or agreement about a guideline.32,39
In addition to interventions targeted toward opinion leaders, physician participation in guideline development may be useful in addressing barriers owing to lack of agreement.10 Anecdotally, physician participation in guideline development has been associated with increased guideline acceptance.40 Guideline endorsement by a physician's own specialty organization has also been associated with improved physician confidence in a guideline.36,41,42
Recommendation and physician characteristics
A single clinical practice guideline is a collection of many systematically developed statements or recommendations.2 Previous studies that examined pediatric guideline adherence have generalized barriers from a single guideline to each of its recommendations.7,8 This study suggests that specific recommendations within the NHLBI guidelines have a different set of barriers. For example, although lack of agreement is a barrier to corticosteroid prescription, it is not an issue for smoking cessation counseling. Despite being within the same guideline, different recommendations may demand different types of interventions.
Previous studies7,8 also have not considered physician demographics. This study suggests that at least one physician characteristic—years since graduation from medical school—is related to barriers to adherence.
Although focus groups are helpful in describing participants' perceptions of abstract concepts such as barriers to guideline adherence or understanding complex behavior such as physician practice, the results are difficult to quantify. In addition, these individual perceptions may not include insight at a peer group or community level. Other methods, such as physician surveys, are useful in quantifying the prevalence and intensity of these barriers and in identifying larger patterns of barriers owing to geographic variation in implementation.43
Physicians may not be aware of or sensitive to all the barriers that affect adherence. For example, a barrier described by a physician as parental disinterest in educational materials might actually be poor patient health literacy or poor physician cultural competency.44-46
This study's generalizability is also limited by how participants were selected. Volunteers were recruited from a 1-week CME conference and may represent practices that are more affluent or conscious of staying up-to-date. The sessions were also conducted at an academic setting, which may influence participants to give "correct" or "professionally acceptable" responses. Finally, the data are based on physician perception of barriers, which may be actual or perceived and thus affect the type of intervention needed to overcome the barrier.
Our results suggest implications for interventions to improve adherence to the NHLBI guidelines. Efforts to improve adherence should consider the range of barriers besides lack of awareness or agreement. This study documents barriers not considered in previous studies, such as lack of self-efficacy, lack of outcome expectancy, and inertia of previous practice, that prevent adherence. These barriers may require tailored interventions such as CME with skills training (to improve self-efficacy), practice audit and feedback by peers (to overcome inertia of previous practice), or feedback of population-level successes (to improve outcome expectancy).
Suggestions to improve awareness of the NHLBI guidelines include improved distribution using "neutral" sources such as CME, libraries, or the NHLBI directly. Physicians commented that poor familiarity was associated with poor guideline presentation.
Finally, different recommendations within the same guideline have different barriers. Physician year of graduation from medical school is also associated with different barriers. For example, although lack of agreement prevents physician adherence to recommendations for daily inhaled corticosteroid prescription, it was most associated with senior physicians. As a result, efforts to improve adherence should be tailored to the specific guideline recommendation and to physician characteristics.
Accepted for publication January 5, 2000.
This work was supported in part by the Robert Wood Johnson Foundation, Princeton, NJ.
Presented in part at the Annual Meeting of the Society for Medical Decision Making, Boston, Mass, October 24, 1998.
We thank John Lovejoy, MD, Anna Reisman, MD, Edward Sills, MD, and Colette M. Shoukas for their help in organizing this study.
Reprints: Michael D. Cabana, MD, MPH, Division of General Pediatrics, Department of Pediatrics and Communicable Diseases, University of Michigan Medical System, D3202 Medical Professional Bldg, 1500 E Medical Center Dr, Ann Arbor, MI 48109-0718.
1.National Heart, Blood, and Lung Institute, Expert Panel Report 2: Guidelines for the Management of Asthma. Bethesda, Md National Institutes of Health1997;Publication 97-4051.
2.Institute of Medicine,Field
MJedLohr
KNed Clinical Practice Guidelines: Directions for a New Program. Washington, DC National Academy Press1990;
3.Lomas
JAnderson
GMDomnick-Pierre
KVayda
EEnking
MWHannah
WJ Do practice guidelines guide practice? the effect of a consensus statement on the practice of physicians.
N Engl J Med. 1989;3211306- 1311
Google ScholarCrossref 4.Crain
EFWeiss
KBFagan
MJ Pediatric asthma care in US emergency departments: current practice in the context of the National Institutes of Health guidelines.
Arch Pediatr Adolesc Med. 1995;149893- 901
Google ScholarCrossref 5.Goodman
DCLozano
PStukel
TAChang
CHecht
J Has asthma medication use in children become more frequent, more appropriate, or both?
Pediatrics. 1999;104187- 194
Google ScholarCrossref 6.Warman
KLSilver
EJMcCourt
MPStein
RE How does home management of asthma exacerbations by parents of inner-city children differ from NHLBI guideline recommendations?
Pediatrics. 1999;103422- 427
Google ScholarCrossref 7.Christakis
DARivara
FP Pediatricians' awareness of and attitudes about four clinical practice guidelines.
Pediatrics. 1998;101825- 830
Google ScholarCrossref 8.Flores
GLee
MKastner
BBauchner
H What pediatricians really think about practice guidelines: a national survey of attitudes and practices. Paper presented at: Annual Meeting of the Ambulatory Pediatric Association May 3, 1998 New Orleans, La.
9.Doershung
KCPeterson
MWDayton
CSKline
JN Asthma guidelines: an assessment of physician understanding and practice.
Am J Respir Crit Care Med. 1999;1591735- 1741
Google ScholarCrossref 10.Picken
HAGreenfield
STeres
DHirway
PSLandis
JN Effect of local standards on the implementation of national guidelines for asthma.
J Gen Intern Med. 1998;13659- 663
Google ScholarCrossref 12.Stavish
S Managed care fumbles asthma guidelines.
Pediatric News. March1998;38
Google Scholar 13.Shye
DFreeborn
DKRomeo
JEraker
S Understanding physicians' imaging test use in low back pain care: the role of focus groups.
Int J Qual Health Care. 1998;1083- 91
Google ScholarCrossref 14.Krueger
RA Focus Groups: A Practical Guide for Applied Research. 2nd ed. Thousand Oaks, Calif Sage Publications1994;
15.Cabana
MDRand
CSPowe
NR
et al. Why don't physicians follow clinical practice guidelines? a framework for improvement.
JAMA. 1999;2821458- 1465
Google ScholarCrossref 16.Bandura
A Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ Prentice-Hall International Inc1986;
17.Grol
R National standard setting for quality of care in general practice: attitudes of general practitioners and response to a set of standards.
Br J Gen Pract. 1990;40361- 364
Google Scholar 18.Hudak
BBO'Donnell
JMazyrka
N Infant sleep position: pediatricians' advice to parents.
Pediatrics. 1995;9555- 58
Google Scholar 19.Pathman
DEKonrad
TRFreed
GLFreeman
VAKoch
GG The awareness-to-adherence model of the steps to clinical guideline compliance: the case of pediatric vaccine recommendations.
Med Care. 1996;34873- 889
Google ScholarCrossref 20.Main
DSCohen
SJDiClemente
CC Measuring physician readiness to change cancer screening: preliminary results.
Am J Prev Med. 1995;1154- 58
Google Scholar 21.Pololi
LHPotter
S Behavioral change in preventive medicine: an efficacy assessment of a physician education module.
J Gen Intern Med. 1996;11545- 547
Google ScholarCrossref 22.Clark
NMGong
MSchork
A
et al. Impact of education for physicians on patient outcomes.
Pediatrics. 1998;101831- 836
Google ScholarCrossref 23.Premartne
UNSterne
JAMarks
GBWebb
JRAzima
HBurney
PG Clustered randomised trial of an intervention to improve the management of asthma: Greenwich Asthma Study.
BMJ. 1999;3181251- 1255
Google ScholarCrossref 24.Hendricson
WDWood
PRHidalgo
HAKromer
MEParcel
GSRamirez
AG Implementation of a physician education intervention: the Childhood Asthma Project.
Arch Pediatr Adolesc Med. 1994;148595- 601
Google ScholarCrossref 25.Wilson
DMTaylor
DWGilbert
JR
et al. A randomized trial of family physican intervention for smoking cessation.
JAMA. 1988;2601570- 1574
Google ScholarCrossref 26.Cummings
SRRubin
SMOster
G The cost-effectiveness of counseling smokers to quit.
JAMA. 1989;26175- 79
Google ScholarCrossref 27.Clark
NMFeldman
CHEvans
D
et al. Managing better: children, parents, and asthma.
Patient Educ Couns. 1986;827- 38
Google ScholarCrossref 28.Evans
RGergen
PJMitchell
H
et al. A randomized clinical trial to reduce asthma morbidity among inner-city children: results of the National Cooperative Inner-City Asthma Study.
J Pediatr. 1999;135332- 338
Google ScholarCrossref 29.Maiman
LABecker
MHLiptak
GSNazarian
LFRounds
KA Improving pediatricians' compliance-enhancing practices: a randomized trial.
AJDC. 1988;142773- 779
Google Scholar 30.Jacoby
IClark
SM Direct mailing as a means of disseminating NIH consensus statements.
JAMA. 1986;2551328- 1330
Google ScholarCrossref 31.Gross
CPSteiner
CABass
EBPowe
NR Pre-publication dissemination of clinical trial results: does it make a difference?
Med Decis Making. 1999;19521
Google Scholar 32.Soumerai
SBMcLaughlin
TJGurwitz
JH
et al. Effect of local medical opinion leaders on quality of care for acute myocardial infarction.
JAMA. 1998;2791358- 1363
Google ScholarCrossref 33.Brown
JBShye
DMcFarland
B The paradox of guideline implementation: how AHCPR's depression guideline was adapted at Kaiser Permanente Northwest Region.
Jt Comm J Qual Improv. 1995;215- 21
Google Scholar 34.Stone
TTKivlahan
CHCox
KR Evaulation of physician preferences for guideline implementation.
Am J Med Qual. 1999;14170- 177
Google ScholarCrossref 36.Hayward
RSAGuyatt
GHMoore
KAMcKibbon
ACarter
AO Canadian physicians' attitudes about and preferences regarding clinical practice guidelines.
CMAJ. 1997;1561715- 1723
Google Scholar 37.Weinberg
ADUllian
LRichards
WDCooper
P Informal advice and information seeking between physicians.
J Med Educ. 1981;56174- 180
Google Scholar 38.Greer
AL The state of the art versus the state of the science: the diffusion of new medical technologies into practice.
Int J Technol Assess Health Care. 1988;45- 26
Google ScholarCrossref 39.Mittman
BSTonesk
XJacobson
PD Implementing clinical practice guidelines: social influence strategies and practitioner behavior change.
QRB Qual Rev Bull. 1992;18413- 422
Google Scholar 40.Lagoe
RJAspling
DL Enlisting physician support for practice guidelines in hospitals.
Health Care Manage Rev. 1996;2161- 67
Google ScholarCrossref 41.James
PACowan
TMGraham
RPMajeroni
BA Family physicians' attitudes about and use of clinical practice guidelines.
J Fam Pract. 1997;45341- 347
Google Scholar 42.Tunis
SRHayward
RSAWilson
MC
et al. Internists' attitudes about clinical practice guidelines.
Ann Intern Med. 1994;120956- 963
Google ScholarCrossref 43.Pope
CMays
N Qualitative research: reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research.
BMJ. 1995;31142- 45
Google ScholarCrossref 44.Davis
TCMayeaux
EJFredrickson
D
et al. Reading ability of parents compared to reading level of pediatric patient education materials.
Pediatrics. 1994;93460- 468
Google Scholar 45.Massett
HA Appropriateness of Hispanic print materials: a content analysis.
Health Educ Res. 1996;11231- 242
Google ScholarCrossref 46.Zwiefler
JGonzalez
AM Teaching residents to care for culturally diverse populations.
Acad Med. 1998;731056- 1061
Google ScholarCrossref