Figure. Participant enrollment diagram. Eligibility assessments at Minneapolis included a review of all incoming electronic consults for eligibility, whereas the Columbia site could not use that same mechanism. Eligibility assessments at Columbia required interaction with potential participants. Other reasons for exclusion included inability to follow up with the potential participant after the consultation was placed to determine interest or eligibility. More than one reason for not meeting inclusion criteria was possible among the 271 patients not meeting the inclusion criteria. The patient mislocated to conventional care was excluded from all analyses.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Whited JD, Warshaw EM, Edison KE, et al. Effect of Store and Forward Teledermatology on Quality of Life: A Randomized Controlled Trial. JAMA Dermatol. 2013;149(5):584–591. doi:10.1001/2013.jamadermatol.380
Author Affiliations: Harry S Truman Memorial Veterans' Hospital (Dr Whited) and Department of Dermatology, University of Missouri (Dr Edison), Columbia; Minneapolis Veterans Affairs Health Care System (Drs Warshaw, Raju, Cook, Engasser, and Pullen and Ms Parks) and Department of Dermatology, University of Minnesota (Dr Warshaw), Minneapolis; Cooperative Studies Program Coordinating Center, Hines Veterans Affairs Hospital, Hines, Illinois (Drs Kapur and Reda, Mss Thottapurathu and Motyka, and Messrs Sindowski, Brown, and Moritz); Durham Veterans Affairs Medical Center, Division of General Internal Medicine, Duke University Medical Center, Durham, North Carolina (Dr Datta); Department of Dermatology, University of California, San Francisco, San Francisco Veterans Affairs Medical Center, San Francisco (Dr Chren); St Cloud Veterans Affairs Health Care System, St Cloud (Dr Marty), Minnesota. Dr Whited is currently with the Durham VA Medical Center, Durham, North Carolina.
Importance Although research on quality of life and dermatologic conditions is well represented in the literature, information on teledermatology's effect on quality of life is virtually absent.
Objective To determine the effect of store and forward teledermatology on quality of life.
Design Two-site, parallel-group, superiority randomized controlled trial.
Setting Dermatology clinics and affiliated sites of primary care at 2 US Department of Veterans Affairs medical facilities.
Participants Patients being referred to a dermatology clinic were randomly assigned, stratified by site, to teledermatology or the conventional consultation process. Among the 392 patients who met the inclusion criteria and were randomized, 326 completed the allocated intervention and were included in the analysis.
Interventions Store and forward teledermatology (digital images and a standardized history) or conventional text-based consultation processes were used to manage the dermatology consultations. Patients were followed up for 9 months.
Main Outcome Measures The primary end point was change in Skindex-16 scores, a skin-specific quality-of-life instrument, between baseline and 9 months. A secondary end point was change in Skindex-16 scores between baseline and 3 months.
Results Patients in both randomization groups demonstrated a clinically significant improvement in Skindex-16 scores between baseline and 9 months with no significant difference by randomization group (P = .66, composite score). No significant difference in Skindex-16 scores by randomization group between baseline and 3 months was found (P = .39, composite score).
Conclusions Compared with the conventional consultation process, store and forward teledermatology did not result in a statistically significant difference in skin-related quality of life at 3 or 9 months after referral.
Trial Registration clinicaltrials.gov Identifier: NCT00488293
For many dermatologic conditions, the health outcome measure of principal importance is self-reported quality of life.1,2 The effect skin disease may have on patient well-being and quality of life can be significant.3-6 For example, psoriasis was found to be more detrimental to quality of life than angina or hypertension and was associated with a reduction in physical and mental functioning comparable to that seen with cancer, arthritis, heart disease, diabetes, and depression.3,7 It has been reported that patients with pruritus are willing to forfeit 13% of their life expectancy to live without that symptom.8 Furthermore, the clinician's judgment of skin disease severity is a poor proxy for the patient's perspective.9-14
Although research on quality of life and dermatologic conditions is well represented in the literature, information on teledermatology's effect on quality of life is virtually absent. To address this issue, we evaluated the effect of store and forward teledermatology on patients' quality of life. We used the Skindex-16 as our quality-of-life measure. The Skindex-16 is a self-administered questionnaire developed using strict psychometric principles and is considered a superior measure for dermatology-specific quality-of-life research.15 Prior Skindex versions have been extensively tested and incrementally refined, resulting in a 16-item instrument that has internal consistency, reliability, reproducibility, evidence of content and construct validity, and responsiveness to clinical change.9,16-18 Skindex-16 measures 3 domains: symptoms, emotions, and functioning. Using the Skindex-16 and the Medical Outcomes Study 12-Item Short Form Health Survey, version 2 (SF-12 v2), we compared skin-specific quality of life and health status between patients undergoing a store and forward teledermatology consultation process with patients seen via a conventional clinic-based consultation process.
The study was a 2-site, parallel-group, superiority randomized controlled trial. The study was designed to assess quality of life, clinical course, and economic outcomes. The primary outcome, quality of life, is presented in this article, and our hypothesis was that teledermatology would result in a significantly improved quality of life as measured by the Skindex-16. The study was powered using a 2-tailed test to assess for the alternative of conventional care superiority. Approval for this study was granted by the respective institutional review boards, and all participants provided informed consent.
The setting for this study was the dermatology services of 2 Department of Veterans Affairs (VA) facilities: the Harry S Truman Memorial Veterans' Hospital (Truman VA) in Columbia, Missouri, and the Minneapolis Veterans Affairs Health Care System (MVAHCS) in Minneapolis, Minnesota. These 2 medical centers serve as the site of dermatology care for the remote facilities from which patients were recruited. Patients in the catchment area for the Truman VA were recruited from 2 community-based outpatient clinics (primary care sites) affiliated with the Truman VA located 27 miles and 25 miles (to convert miles to kilometers, multiple by 1.6) from Columbia. Patients in the catchment area of the MVAHCS were recruited from the St Cloud VA Medical Center. The St Cloud VA Medical Center is located 66 miles from Minneapolis.
Eligible participants were adult patients being referred to one of the dermatology services from the remote sites of primary care. Patients were excluded if they had more than one skin condition for which they were being referred, did not have a visible or photographable skin condition, requested a full-body examination, were unable to read or speak English, failed a single-question literacy assessment,19,20 had an emergent skin condition, had a pending dermatology clinic appointment within the next 9 months, had previously enrolled in this study, or had an impending move from the area in the next 9 months.
Potential study participants were identified when their primary care clinician generated a consultation with the dermatology service. Patients randomizing to usual care underwent the conventional consultation process used by each site. This process consisted of the referring clinician generating a consultation that was forwarded to the dermatology service via the VA's electronic medical record. The electronic consultation includes text-based information only. In the case of Minneapolis, a template is used by the dermatology service with the option to include free text, whereas in Columbia the entire consultation is a free-text description. The dermatology services receive these consultations, review the text-based information, and typically schedule patients for a clinic-based visit. Patients are then asked to travel to the dermatology clinic at their respective medical center for a clinic-based evaluation.
Patients randomizing to teledermatology also used the electronic consultation request feature of the medical record because this is the required means of communicating referral requests and consultation results. In addition to the standard text field, the teledermatology consultation included a standardized history and a digital image set. The standardized history included a characterization of the condition as a rash vs growth, anatomical location, duration of presence, change in size (if any), symptoms or signs (pruritus, pain/burning, bleeding, change in color, or weeping/oozing), personal history of skin cancer, family history of skin cancer, history of childhood eczema, history of asthma or hay fever, previous treatments, and any other self-reported dermatologic history. All images were obtained with an 8-megapixel digital camera with an integrated flash (Canon Powershot S5 IS, Canon Inc). When necessary, a digital ring flash was used for short focal length or macroimages (SLR Digital Ring Light, Sakar International). The imaging protocol specified that the affected anatomical area be identifiable. Generally, this required at least one distance or midrange shot to show anatomical location and one close-up view of the affected area. However, a single image was allowable if the anatomical area was adequately represented by the close-up view. When necessary, additional images were obtained to show the entire distribution of the condition (eg, widespread rashes) or for close-up views that highlighted different areas of involvement.
Teledermatology as implemented in this study has been described as a teletriage system because the teledermatology consultation was not meant to replace the need or function as a surrogate for in-person visits for all referrals.21 A dermatologist reviewed the teledermatology consultation and either scheduled the patient for a clinic-based visit in the VA dermatology clinic or replied to the consultation with a diagnosis and/or management plan without scheduling the patient for a visit. In the latter case, the referring clinician was responsible for implementing the recommendations and relaying this information to the patient. Consistent with this teletriage concept, clinic-based procedure recommendations (eg, biopsies) were expected to result in an in-person dermatology clinic visit. However, medication recommendations (eg, trial of a topical steroid) would generally be implemented by the referring clinician. Patients could be re-referred by the primary care clinicians if they did not respond to recommendations or if they otherwise believed the patient needed to be seen in person by a dermatologist.
Quality of life was assessed using Skindex-16 with the standard 1-week recall. Health status was assessed using the standard (4-week recall) SF-12 v2. All patients underwent baseline data collection that included the collection of demographic information, Skindex-16, SF-12 v2, and a comorbidity assessment. These last 3 instruments were self-administered. At 3 months after enrollment, the participants received the Skindex-16 and the SF-12 v2 via mail. Finally, the Skindex-16, SF-12 v2, and the comorbidity assessment were readministered (self-administration) at an in-person close-out dermatology clinic visit, scheduled 9 months after enrollment. If patients could not present for a close-out visit then the 9-month study instruments were mailed. A body diagram designating the location of the referred condition was completed at the baseline visit. To assist the patients in recalling their referred skin condition when filling out the Skindex-16, copies of this body diagram were provided to the patients at both the 3- and 9-month data collection points.
The instructions patients received for completion of the Skindex-16 instrument directed them to answer questions based on the skin condition that resulted in the dermatology referral (identified on the accompanying body diagram). Skindex-16 scoring and interpretation were performed in the standard method as described by Chren et al.18 Briefly, responses are recorded on a 0- (never bothered) to 100-point (always bothered) scale. Skindex-16 generates 3 domain scores (symptoms, emotions, and functioning) and a composite score (mean of 3 subscale scores).22 A Skindex-16 change score of 10 points is considered clinically significant—a value developed using an anchor-based approach to scale interpretation.23 In previous work, Skindex-16 scores were compared among patients before and after treatment for nonmelanoma skin cancer to a global “anchor” that assessed overall bother from the skin cancer.24 The anchor instrument had 7 response choices, and the minimum meaningful clinical difference was assumed to correspond to a difference in one response choice, based on previous interpretations and use of health transition global ratings.25-28 The mean change in Skindex-16 subscale scores of 10 points, for improvement or deterioration, correlated with the minimum change in the global rating response24 consistent with those observed for similar quality-of-life instruments.27
The SF-12 v2 scoring was performed according to the standard method described by Ware et al.29,30 The SF-12 v2 was used to determine the global health status of each study group at baseline, 3 months, and 9 months. A comorbidities checklist assessed whether the patients had any of 24 chronic medical conditions, whether they had any allergies, and if they took any over-the-counter or prescription medications. The checklist was a self-reported survey obtained on entry into the study and repeated at 9 months. A single question assessing global satisfaction with the care received for their skin condition was obtained from study participants at 9 months.
The study was designed to include the spectrum of skin disease expected in the target population and did not systematically include or exclude any specific conditions or attempt to analyze diagnostic-specific outcomes. However, we collected diagnostic information at close-out that assigned the patient's diagnosis to 1 of 16 categories (or “other” diagnosis) that was used to provide descriptive diagnostic information of the skin conditions encountered among the study participants.
The study was powered based on detecting a mean absolute difference of 10 points in the change score for Skindex-16 between baseline and 9 months using a 2-sided t test. The estimate of SD (30 points) was obtained from Chren et al.24 The study was powered at 90% with an α of .05 (2-tailed), which required 190 patients per enrollment group. Consenting patients were randomized using a simple randomization scheme stratified by site to either a store and forward teledermatology consultation or the conventional consultation process (usual care). Randomization assignments were made by placing a telephone call to the statistical coordinating center after a prerandomization checklist was completed by the enrolling sites and verified by the coordinating center. Masking to study assignment was impossible with the study interventions.
Demographic characteristics were compared between groups using χ2 tests for categorical variables and the t test for continuous variables. Quality of life as measured by the Skindex-16 was analyzed by the t test for the domains and composite score between groups. The SF-12 v2 was analyzed by the t test. Comorbidity assessments at baseline and 9 months were compared between study groups by χ2 tests. When baseline differences were found, an adjusted analysis was performed. Longitudinal analyses for each domain and composite Skindex-16 score using a mixed-effects model with random intercept and trend model to account for correlation among observations for each patient were performed. Finally, a global satisfaction assessment was obtained from the patients at 9 months. Satisfaction with the care they received for their skin condition was assessed using a 5-point Likert scale and was analyzed using the χ2 test. All analyses were conducted using SAS statistical software for Windows, version 9.2 (SAS Institute Inc).
Recruitment, occurring between 2008 and 2011, was terminated when the scheduled enrollment deadline was reached. A total of 1163 consultations for patients being referred to the dermatology services was available for inclusion, and 392 patients enrolled in the study for an enrollment rate of 34%. Reasons for nonenrollment appear in the Figure. A total of 196 patients were randomized to the teledermatology intervention (160 patients at the Minneapolis site and 36 patients at the Columbia site), and 196 patients were randomized to the conventional consultation process (159 patients at the Minneapolis site and 37 patients at the Columbia site). A total of 166 patients in the usual care group and 160 patients in the teledermatology group completed the 9-month close-out procedures. Two patients in usual care did not complete a Skindex-16 survey at close-out, and 1 patient in teledermatology did not complete the symptoms domain questions at baseline.
Demographic characteristics of the 2 study groups are listed in Table 1. No differences were found in demographic characteristics or baseline Skindex-16 scores between the 2 randomization groups, although “type of skin cancer–personal” approached statistical significance (P = .053). There was likewise no difference in demographic characteristics within each site of enrollment. The baseline Skindex-16 by site of enrollment found a significantly different mean (SD) functioning domain score (12.1 [21.5] vs 19.2 [26.4]; P = .02), with the lower score being recorded by the Columbia site. In an adjusted analysis by site of enrollment that used a longitudinal mixed-effects model, no differences in site of enrollment were found. The model included visit (baseline, 3 months, and 9 months), randomization group, site of enrollment, and their interaction terms. Only the visit variable showed significance with a negative slope (improved Skindex-16 score) for each domain.
One hundred twenty patients (61.5%) who randomized to teledermatology were seen at least once for an in-person dermatology clinic visit. Teledermatology patients had a mean of 1.10 (range, 0-5) in-person dermatology clinic visits compared with a mean of 1.55 (range, 0-6) for usual care patients.
Between baseline and 3 months, the point estimate Skindex-16 scores improved for both study groups among all domains and by composite score (Table 2). The improved mean scores are indicated by a negative mean difference. For the teledermatology group, a mean (SD) clinically significant improvement in the emotions domain was found (−11.6 [27.2]). No evidence suggested a difference in the change in quality of life as measured by the Skindex-16 between treatment groups. Likewise, between baseline and 9 months, the Skindex-16 scores improved for both study groups among all domains and by composite score (Table 2). Clinically significant improvements were reported for symptoms, emotions, and composite score for both randomization groups. In addition, no evidence suggested a difference in quality of life as measured by the Skindex-16 between treatment groups.
The SF-12 v2 found no evidence to suggest a difference in health status for any scale between study groups at any time point with one exception (data not shown). For the bodily pain assessed at 3 months scale, a significantly lower score (worse health state) was reported for the teledermatology group. The SF-12 v2 scores remained essentially unchanged during the study for both randomization groups. Likewise, the comorbidity assessment found no differences in self-reported morbidity with one exception (data not shown). Significantly more patients reported a history of transient ischemic attack among the conventional care group compared with teledermatology at baseline (13 vs 3; P = .01). However, no difference was noted for this disease entity at 9 months because 3 fewer conventional care patients reported this history and 2 additional teledermatology patients reported transient ischemic attacks.
The global satisfaction assessment found no evidence for a difference in the level of satisfaction reported between patients managed by the 2 consultation modalities (Table 3). Few patients were unsatisfied with their care in either randomization group, although 3 patients in the teledermatology group expressed strong disagreement to the satisfaction query compared with no patients expressing that sentiment in usual care. Two of these 3 patients were not seen in a dermatology clinic for an in-person visit during the 9-month study period.
The diagnostic categorization data are given in Table 4. As descriptive data, Table 4 indicates a similar spectrum of skin disease among the 2 groups.
Compared with the conventional (in-person) consultation process, store and forward teledermatology did not result in a statistically significant difference in skin-related quality of life at 3 or 9 months after referral. Participants in both randomization groups demonstrated improved point estimate skin-related quality-of-life scores at the 3- and 9-month periods. The randomization groups were comparable at baseline, health status and comorbidities were similar, and completion of the 3- and 9-month study procedures was high. Thus, our findings indicate that skin-related quality of life is not affected by consultation modality, and clinically significant improvements in quality of life are achieved with conventional care and store and forward teledermatology.
Only one prior study31 has assessed quality of life among recipients of teledermatology services. With no conventional care group for comparison, patients using teledermatology services were found to have mean Dermatology Quality of Life scores comparable to dermatology outpatients with a wide range of skin conditions (mean [SD] Dermatology Quality of Life score, 6.34 [6.68]). Overall, participants were very satisfied with the teledermatology intervention, with some evidence to suggest a relationship between reported quality of life and satisfaction.
Our findings are consistent with previous evidence for Skindex responsiveness in a heterogeneous group of skin conditions.9 We found that patients in both study groups, representing a wide range of ambulatory skin disease, had improved Skindex-16 scores at the 2 postreferral time points. Further, clinically significant improvements in 2 domains and the composite score were noted 9 months after referral for both study groups.
Contrary to our Skindex-16 findings, overall health status as measured by the SF-12 v2 remained relatively stable in both study groups throughout the study. It is, perhaps, not surprising that a skin-specific measure of quality of life would be more responsive to change over time to a dermatology intervention than would a generic measure, although our cohort had a fairly high level of competing comorbidities that could influence a generic measure, such as the SF-12 v2. These findings support the assertion that quality-of-life assessments in ambulatory skin disease populations should include a skin-specific instrument as an evaluation tool because other more generic instruments may lack discriminatory ability.16,32-34
The lack of evidence for a difference in the satisfaction level expressed by patients in both study groups is also an important finding. This finding suggests that patients' judgment of the experience with the modality itself, which in the case of teledermatology was likely a novel experience, probably did not influence the outcomes, or perceived outcomes, of the care they received.
Our findings have some limitations. First, our demographic was primarily an elderly, male, and white population, which may influence the case mix of skin disease and the generalizability of our findings. Second, most of our data were based on self-report and required the ability to recall the referred skin condition. However, we do not believe this feature had an important influence on our data because we used valid and reliable instruments, we administered them in the standard fashion, and at each administration a body diagram marked with the location of the referred lesion was provided with the skin-specific study instrument (Skindex-16). Third, the missing data percentage for our primary outcome (Skindex-16) was 17%. Although this is a relatively low missing data rate, it is, nonetheless, possible that the nonresponders may have altered our findings. Nonresponse rates were similar between randomization groups. Fourth, our findings only apply to a teledermatology application that provides the option of in-person dermatology clinic follow-up after the teledermatology consultation is reviewed. The fact that most teledermatology patients also received in-person dermatology care may have contributed to the homogeneity of our findings. Our results may not be reproduced in teledermatology systems that are meant to replace all in-person contact with a dermatologist.35
An important strength of this study was that we assessed true site-to-site implementation of store and forward teledermatology with actual health care provision occurring via teledermatology. Thus, as an effectiveness study, it evaluated store and forward teledermatology in the manner that it would actually be provided in this setting. We believe this feature of the study design and the lack of evidence to suggest a difference in quality of life and global satisfaction has important operational implications for teledermatology. Before implementation, it is important to determine how a store and forward teledermatology consultation process performs compared with conventional care. Assessing an outcome of principal importance in ambulatory dermatology populations, we found no evidence to suggest a difference in quality of life between consultation modalities.
Correspondence: John D. Whited, MD, MHS, Durham VA Medical Center, Research (151), 508 Fulton St, Durham, NC 27705 (firstname.lastname@example.org).
Accepted for Publication: July 17, 2012.
Published Online: February 20, 2013. doi:10.1001/2013.jamadermatol.380
Author Contributions: Drs Whited, Warshaw, and Kapur had full access to the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Whited, Warshaw, Reda, Moritz, and Datta. Acquisition of data: Raju, Cook, Engasser, Pullen, Parks, Warshaw, Edison, and Marty. Analysis and interpretation of data: Whited, Warshaw, Kapur, Thottapurathu, Moritz, Reda, Motyka, Sindowski, Brown, and Datta. Drafting of the manuscript: Whited. Critical revision of the manuscript for important intellectual content: Warshaw, Kapur, Moritz, Reda, Datta, Edison, Chren, and Marty. Statistical analysis: Kapur, Thottapurathu, Motyka, Moritz, and Reda. Administrative, technical, and material support: Moritz, Sindowski, Motyka, Brown, and Chren. Study supervision: Whited, Warshaw, Reda, and Moritz. Obtained funding: Whited and Warshaw.
Conflict of Interest Disclosures: Drs Whited and Edison are coeditors of the book Teledermatology: A User's Guide published by Cambridge University Press and receive royalties based on sales. Dr Chren is a consultant to Genetech Inc (on patient-reported outcomes).
Funding/Support: Dr Chren is supported by grant K24 AR052667 from the National Institute of Arthritis and Musculoskeletal and Skin Disease, National Institutes of Health. This study was supported by grant HSR&D IIR 05-278 from the US Department of Veterans Affairs Health Services Research and Development Service.
Disclaimer: The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the US Department of Veterans Affairs or the US government.
Additional Information: Skindex-16 was used with the permission of Mary-Margaret Chren, MD.