Objective
To determine factors related to residents’ self-reported skill level for the skin cancer examination (SCE).
Design
Survey of residents in November 2003.
Setting
Four US residency programs.
Participants
Medical residents in family medicine, pediatrics, obstetrics and gynecology, and internal medicine and specialists.
Main Outcome Measure
Proportion of residents reporting their current skill level for the performance of the SCE.
Results
Of 454 surveys distributed, 342 residents completed the survey (75.3% response rate). Clinical training for the SCE during residency was infrequent. During residency, 75.8% were never trained in the SCE, 55.3% never observed an SCE, and 57.4% never practiced the examination. Only 15.9% of residents reported being skilled in the SCE. However, the conduct of 4 SCEs (or slightly more than 1 per each year of residency) was associated with manifold increases in self-reported skill levels.
Conclusions
Information now collected from 7 medical schools and 4 residency programs underscores the need for more supervised opportunities to enable physicians in training to perform an SCE during routine patient examinations.
With recent advances in screening tests and a national effort to promote early detection, many of the leading causes of cancer mortality are decreasing.1 Melanoma is the only detectable cancer for which death rates are not decreasing, yet screening rates remain the same.2 In 2008, it is estimated that 62 480 individuals will be diagnosed as having melanoma and 8420 will die of melanoma.3 Melanoma remains the second most common cause of cancer in individuals 15 to 29 years of age. In response, a number of recommendations have been made to provide training programs for instruction of the skin cancer examination (SCE).4-6
An estimated one-fourth of all melanoma is discovered by a physician, most often a primary care physician.7-9 In fact, there is an emerging consensus that melanoma detected by physicians as opposed to by patients themselves is generally thinner, with a more favorable prognosis.10,11 However, most primary care physicians do not routinely examine the skin.12
Although earlier studies6 have documented the lack of adequate teaching and practice opportunities for the SCE in US medical schools, there have been no similar studies of US residency programs. Therefore, we sought to examine associations among observation, training, practice, and self-reported skills for the SCE by medical residents.
In November 2003, we surveyed medical residents at teaching hospitals for the following residency programs: Cambridge Hospital/Cambridge Health Alliance, Cambridge, Massachusetts; University of North Dakota, Grand Forks; University of Tennessee, Chattanooga; and University of Texas Southwestern, Dallas. We selected residents from the primary care tracks of family medicine, internal medicine, obstetrics and gynecology, and pediatrics (94.1%) as well as medical subspecialties (5.9%). At 2 of the programs (University of Tennessee, Chattanooga, and University of Texas Southwestern), residents from all primary care tracks and 6 subspecialists were surveyed. At the other 2 programs (Cambridge Hospital/Cambridge Health Alliance and University of North Dakota), family medicine and internal medicine were represented, along with 14 subspecialists.
These residency training programs were chosen because of geographic diversity, inclusion of public and private institutions, diverse ethnic mix of patients, and interest in skin cancer screening among the 4 dermatology residents who conducted the surveys. The survey respondents were anonymous, and institutional review boards at the respective institutions provided exempt status.
The resident survey was adapted from surveys used in previous studies of skin cancer education among medical students at Boston University School of Medicine and nationwide.6 The current instrument was further refined by study leaders and pilot-tested to assess clarity, readability, difficulty, and time required to complete the survey.
Medical residents were asked to rate their current skill levels for performance of the SCE categorized as very unskilled, somewhat unskilled, neither skilled nor unskilled, somewhat skilled, or very skilled. Independent predictors included the following: (1) demographics: age, sex, residency program (location), postgraduate year, percentage of white patients treated at that specific institution, and current specialty (family medicine, internal medicine, obstetrics and gynecology, or pediatrics); (2) dermatology course work: participation in medical school or residency dermatology elective, prior teaching of the SCE in medical school, and number of hours spent in the dermatology clinic; (3) training, practice, and observation: number or times during residency he or she received training in the SCE, number of adult patients for whom the SCE has been performed, and number of formal observations of a physician who performed the SCE; (4) prevention practices: routine examination of the skin of patients, teaching the ABCDs (asymmetry, border irregularity, color variability, and diameter larger than a pencil eraser) of melanoma to patients, questions with regard to changes in moles or new skin lesions in review of systems, and inquiry about family history of melanoma and skin cancer; and (5) personal risk reduction practices: skin self-examination practices and routine physician SCE and preferences for ideal teaching of the SCE during residency.
We sought to determine factors associated with self-reported skill levels of residents. Self-reported skill was categorized in 2 distinct ways. The first set of comparisons divided the sample into 3 groups (very or somewhat skilled, neither skilled nor unskilled, and very or somewhat unskilled). Bivariate associations between the independent predictors and self-reported skill (skilled vs unskilled and neither vs unskilled) were then assessed. The second set of comparisons assessed the distribution of independent predictors among residents who reported being very or somewhat skilled compared with the other skill levels. Bivariate associations and associations adjusted for the age of the resident, percentage of patients who were white, and location of residency were assessed. All associations were assessed by means of logistic regression, and odds ratios and 95% confidence intervals are reported.
Of 454 surveys distributed, 342 residents completed the survey (75.3% response rate). Of these, 165 (50.3%) were female and 210 (61.4%) were younger than 30 years. Residents were postgraduate year 1 (128; 40.8%), postgraduate year 2 (94; 29.9%), and postgraduate years 3 and 4 (92; 29.3%). Specialties comprised internal medicine (150; 44.0%), pediatrics (65; 19.1%), family medicine (66; 19.3%), obstetrics and gynecology (40; 11.7%), and other medical specialties (20; 5.9%). A total of 127 residents (40.6%) reported that more than 50% of their patients were white (Table 1).
Most respondents had not taken a dermatology elective in medical school (196; 57.5%) or during their residency (272; 80.0%), and 142 (41.8%) had never received training in the SCE in medical school. Clinical training for the SCE during residency was infrequent. A total of 188 residents (55.3%) had never observed an SCE, 257 (75.8%) had never been trained in the SCE, and 195 (57.4%) had never practiced the SCE. More specific practice patterns related to early detection were also low. Less than one-third of residents reported routine examination of patient skin. Far fewer discussed the ABCDs of melanoma (33; 10.2%) or asked about changing moles or skin lesions (59; 18.3%) or a family history of melanoma (41; 12.7%). Overall, only 54 residents (15.9%) reported being somewhat to very skilled in the SCE, and 92 (27.1%) reported being neither skilled nor unskilled (Table 2). No differences were found in self-reported skill levels between residents in a primary care track vs those from medical subspecialties.
Residents who treated a greater proportion of white patients and family medicine residents were more likely to report being very or somewhat skilled in the SCE; however, no differences were found by age, sex, or postgraduate level (Table 3).
After adjustment for the sex and age of the resident, percentage of patients who were white, and geographic location of residency, residents who received training in the SCE in medical school, participated in a dermatology elective in residency, spent 1 or more hours in a dermatology clinic, and had at least 4 observations, trainings, or practice opportunities were more likely to report being very or somewhat skilled in the performance of SCEs (compared with neither skilled nor unskilled and very or somewhat unskilled) (Table 4).
Practice of at least 1 SCE during residency was driven by one's earlier training in medical school or residency. Of 257 residents with at least 1 experience in the SCE (defined as those residents who received training in the SCE in medical school or participated in a dermatology elective in residency or medical school or spent more than 1 hour in a dermatology clinic), 128 (49.8%) had examined at least 1 patient during their residency. In contrast, only 13 (17.1%) residents without similar prior exposures had practiced the examination even once.
Personal practices had little bearing on practices with patients. Performance of skin self-examinations or having had a physician skin examination had little effect on resident screening practices with patients. Only 103 residents (31.8%) performed skin self-examinations, and only 67 (21.3%) had ever had a physician SCE. Among those who reported a skin self-examination, 20 (19.4%) were skilled in the patient SCE; among those who did not report a skin self-examination, 30 (13.6%) were skilled in the SCE (P = .18). Among those who reported a personal physician SCE, 9 (13.4)% were skilled in the SCE; among those who did not report a personal physician SCE, 40 (16.2)% had performed an SCE (P = .57). When asked to list possible areas in the curriculum for the incorporation of SCE education, 127 residents thought core curriculum sessions would be ideal, whereas 60 preferred departmental sessions and 30 preferred grand rounds sessions.
Prompt recognition and appropriate triaging of persons with suspicious lesions are essential. Visits to internists and family practitioners make up an estimated 40% of physician visits in the United States, and nearly two-thirds of patients with melanoma report a physician visit in the year before diagnosis.13 Primary care physicians are thus ideally suited to screen and triage high-risk patients and those with suspicious lesions. The teaching of physicians in training, such as medical students and primary care residents, is a vital part of a professional education strategy.
We examined the relationship between medical school and residency training and self-reported skill for performance of the SCE among medical residents. Self-reported skill levels were low, as were observation, training, and practice in the SCE. Fifty-five percent of respondents never practiced the SCE during their residency, and only 16% reported being skilled in the SCE. A prior study6 showed that 43% of fourth-year US medical students had never practiced the SCE and only 28% of students reported being somewhat to very skilled in the SCE. Information now collected from 7 medical schools and 4 residency programs underscores the need for more supervised opportunities for physicians in training to perform SCEs.
There are many barriers to effective integration of the SCE in residency programs. First, the lack of evidence for the SCE in the reduction of melanoma mortality from a randomized trial may preclude it from being added to the resident program curriculum. However, it should be noted that other examinations, such as the digital rectal examination, are routinely taught in both medical school and residency without convincing evidence that suggests efficacy in the reduction of prostate cancer mortality.14 Second, it is possible that residency program preceptors and/or chief residents have never been trained to perform the SCE and do not feel adequately prepared to teach skin examination skills. Third, there is often an insufficient number of dermatology faculty members to provide small-group teaching or to interact with primary care residents in clinics, on the wards, or in offices. Fourth, expansion of dermatology didactic teaching may be impractical given the increasingly large volume of information that must be covered during these years.
Notwithstanding these important barriers, there are small but important steps that residency programs can provide to increase opportunities for the teaching of the SCE. First, although it is important to have realistic expectations of the amount of new teaching that residency programs can absorb, in our study the conduct of 4 SCEs (or slightly more than 1 per each year of residency) was associated with manifold increases in self-reported skill levels. Residents expressed their strongest preferences for core curriculum sessions as ideal teaching venues. Given obvious time constraints and the overall lack of resources, it would be impractical for dermatologists alone to lead new core curriculum sessions for residents or students. However, the American Academy of Dermatology could be instrumental in the sponsorship of a national initiative to educate residency program directors and/or chief residents at medical schools and teaching hospitals in the basics of the SCE and triage via Web-based learning modules. These program leaders can then serve as primary educators during the core curriculum sessions at their home institutions. Such an initiative has been shown to be effective in the growth of teaching confidence and practice when tested in alcohol clinical training.15 In programs that cannot feasibly add new core curriculum sessions, innovative educational sessions that use online education or CDs should be explored.
Although lack of time for integration of the SCE in the residency curriculum may be a barrier, primary care residents exposed to a brief 3- to 4-hour, multicomponent educational intervention program showed improvement in the evaluation and diagnosis of melanoma and squamous cell carcinoma.16 Web-based education has been shown to be a useful and beneficial learning tool for promotion of self-guided teaching at all levels of medical education.17-20 A recent study18 highlighted the ability of computer-based learning modules to be at least as effective as traditional lecture series in the education of medical students with regard to dermatology morphology. A separate study19 of a Web-based interactive teaching and examination model for the study of dermatology morphology found that 93% of students strongly supported the development and integration of Web-based resources into their curriculum. Standardized patients could be used to assess clinical practice and facilitate ongoing education by providing information and direct feedback on clinical practice, as well as to promote time-efficient strategies for the performance of an SCE in the primary care setting.21
We acknowledge several limitations to this study. First, the analysis was conducted at only 4 residency programs; thus, the results may not be generalizable. It is possible that students with a particular interest in dermatology or those with a more favorable impression of their SCE training would be more likely to respond to and complete the survey. However, the generally poor self-ratings for skill levels, observation, training, and practices slightly mitigate any concern about overestimation of performance. Second, all data were self-reported, with no objective measures available to assess accuracy in the SCE. Third, although the survey question asked residents to rate their skill on a 5-point scale, some residents may have indirectly reported their confidence for this technique. Future studies should consider ways to more objectively evaluate the accuracy for the assessment and triage of significant lesions. Fourth, although the effect sizes are generally large, the distribution of respondents in the strata of the predictors is uneven, which results in small cell sizes. As a result, there is a lack of precision in the estimates (ie, wide confidence intervals). Strengths of the study include its relatively high response rate, inclusion of major primary care disciplines, and recall of experiences in medical school and residency programs.
Although our survey of 4 US resident training facilities included geographically diverse institutions with different training curricula, residents from the University of Texas Southwestern had fewer white patients than the other 3 programs and reported lower rates for performing the SCE. With a large Hispanic patient population, it could be argued that the importance of the SCE was less emphasized in this program or in other programs that serve a large Hispanic population. With increasing rates of melanoma in populations other than that of whites, attention must also be paid to teaching the SCE across diverse populations.22 Another potential concern was the inclusion of pediatric residents in the sample. Likewise, the incidence of pediatric melanoma is increasing,23 which justifies the need to examine the skin of high-risk children and adolescents.
To our knowledge, this is the first study to explore the SCE practices of US medical residents. We see reasons for strong concern mixed with cautious optimism. Few residents report adequate practice or skill in the SCE, but small increases in training and practice opportunities were associated with higher self-reported skill levels. Residency programs and medical schools may have neither the time nor the infrastructure to teach an expert, comprehensive examination to all physicians in training. However, the basic ability to recognize potentially suspicious lesions and triage persons with such lesions should be a vital and key component of both training programs. If current physicians in training do not learn this skill set in medical school or residency, there is a low likelihood that they will acquire this knowledge in their day-to-day practice, which could have potentially devastating consequences for melanoma recognition going forward. New generations of physicians in training should be instructed to perform a careful and thorough SCE in their clinical training.
Correspondence: Alan Geller, MPH, RN, Division of Public Health Practice, Harvard School of Public Health, Landmark Center, 401 Park Dr, Third Floor East, Boston, MA 02115 (ageller@hsph.harvard.edu).
Accepted for Publication: March 3, 2009.
Author Contributions: Dr Wise and Mr Geller had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Wise, Moore, Hayes, Dickerson, and Geller. Acquisition of data: Moore, Hayes, Dickerson, and Ness. Analysis and interpretation of data: Wise, Singh, Brooks Biello, and Geller. Drafting of the manuscript: Wise and Geller. Critical revision of the manuscript for important intellectual content: Wise, Singh, Moore, Hayes, Brooks Biello, Dickerson, Ness, and Geller. Statistical analysis: Brooks Biello. Administrative, technical, and material support: Wise, Moore, Hayes, Dickerson, Ness, and Geller. Study supervision: Geller.
Financial Disclosure: None reported.
2.Geller
ACSwetter
SMBrooks
KRDemierre
MFYaroch
A Screening, early detection, and trends for melanoma: current status (2000-2006) and future directions.
J Am Acad Dermatol 2007;57
(4)
555- 576
PubMedGoogle ScholarCrossref 4.Goldsmith
LAKoh
HKBewerse
BA
et al. Full proceedings from the National Conference to Develop a National Skin Cancer Agenda, American Academy of Dermatology and Centers for Disease Control and Prevention, Washington, D.C., April 8-10, 1995.
J Am Acad Dermatol 1996;35
(5, pt 1)
748- 756
PubMedGoogle ScholarCrossref 5.Weinstock
MAGoldstein
MGDube
CERhodes
ARSober
AJ Basic skin cancer triage for teaching melanoma detection.
J Am Acad Dermatol 1996;34
(6)
1063- 1066
PubMedGoogle ScholarCrossref 6.Moore
MMGeller
ACZhang
Z
et al. Skin cancer examination teaching in US medical education.
Arch Dermatol 2006;142
(4)
439- 444
PubMedGoogle ScholarCrossref 7.Koh
HKMiller
DRGeller
ACClapp
RWMercer
MBLew
RA Who discovers melanoma? patterns from a population-based survey.
J Am Acad Dermatol 1992;26914- 919
Google ScholarCrossref 8.Brady
MSOliveria
SAChristos
PJ
et al. Patterns of detection in patients with cutaneous melanoma.
Cancer 2000;89
(2)
342- 347
PubMedGoogle ScholarCrossref 9.McPherson
MElwood
MEnglish
DRBaade
PDYoul
PHAitken
JF Presentation and detection of invasive melanoma in a high-risk population.
J Am Acad Dermatol 2006;54
(5)
783- 792
PubMedGoogle ScholarCrossref 10.Epstein
DSLange
JRGruber
SBMofid
MKoch
SE Is physician detection associated with thinner melanomas?
JAMA 1999;281
(7)
640- 643
PubMedGoogle ScholarCrossref 11.Schwartz
JLWang
TSHamilton
TALowe
LSondak
VKJohnson
TM Thin primary cutaneous melanomas: associated detection patterns, lesion characteristics, and patient characteristics.
Cancer 2002;95
(7)
1562- 1568
PubMedGoogle ScholarCrossref 12.Geller
ACO'Riordan
DLOliveria
SAValvo
STeich
MHalpern
AC Overcoming obstacles to skin cancer examinations and prevention counseling for high-risk patients: results of a national survey of primary care physicians.
J Am Board Fam Pract 2004;17
(6)
416- 423
PubMedGoogle ScholarCrossref 13.Oliveria
SAChristos
PJMarghoob
AAHalpern
AC Skin cancer screening and prevention in the primary care setting: national ambulatory medical care survey 1997.
J Gen Intern Med 2001;16
(5)
297- 301
PubMedGoogle ScholarCrossref 14.Lim
LSSherin
KACPM Prevention Practice Committee, Screening for prostate cancer in U.S. men: ACPM position statement on preventive practice [published correction appears in
Am J Prev Med. 2008;34(5):454].
Am J Prev Med 2008;34
(2)
164- 170
PubMedGoogle ScholarCrossref 15.Alford
DPRichardson
JMChapman
SEDubé
CESchadt
RWSaitz
R A web-based Alcohol Clinical Training (ACT) curriculum: is in-person faculty development necessary to affect teaching?
BMC Med Educ 2008;811
PubMedGoogle ScholarCrossref 16.Gerbert
BBronstone
AWolff
M
et al. Improving primary care residents' proficiency in diagnosis of skin cancer.
J Gen Intern Med 1998;13
(2)
91- 97
PubMedGoogle ScholarCrossref 17.Cook
DABeckman
TJThomas
KGThompson
WG Adapting Web-based instruction to residents' knowledge improves learning efficiency: a randomized controlled trial.
J Gen Intern Med 2008;23
(7)
985- 990
PubMedGoogle ScholarCrossref 18.Jenkins
SGoel
RMorrell
DS Computer-assisted instruction versus traditional lecture for medical student teaching of dermatology morphology: a randomized control trial.
J Am Acad Dermatol 2008;59
(2)
255- 259
PubMedGoogle ScholarCrossref 19.Hong
CHMcLean
DShapiro
JLui
H Using the Internet to assess and teach medical students in dermatology.
J Cutan Med Surg 2002;6
(4)
315- 319
PubMedGoogle ScholarCrossref 20.Curran
VRHoekman
TGulliver
WLandells
IHatcher
L Web-based continuing medical education, II: evaluation study of computer-mediated continuing medical education.
J Contin Educ Health Prof 2000;20
(2)
106- 119
PubMedGoogle ScholarCrossref 21.Hornung
RLHansen
LASharp
LKPoorsattar
SPLipsky
MS Skin cancer prevention in the primary care setting: assessment using a standardized patient.
Pediatr Dermatol 2007;24
(2)
108- 112
PubMedGoogle ScholarCrossref 22.Cockburn
MGZadnick
JDeapen
D Developing epidemic of melanoma in the Hispanic population of California.
Cancer 2006;106
(5)
1162- 1168
PubMedGoogle ScholarCrossref 23.Strouse
JJFears
TRTucker
MAWayne
AS Pediatric melanoma: risk factor and survival analysis of the surveillance, epidemiology and end results database.
J Clin Oncol 2005;23
(21)
4735- 4741
PubMedGoogle ScholarCrossref