[Skip to Content]
Sign In
Individual Sign In
Create an Account
Institutional Sign In
OpenAthens Shibboleth
[Skip to Content Landing]
Figure.  Study Flow Chart
Study Flow Chart

aAlthough 16 participants were lost to follow-up, they were included in the analysis of consultation rate, with the assumption that they did not have consultations.

Table 1.  Baseline Characteristics of Study Participants
Baseline Characteristics of Study Participants
Table 2.  Comparative Results for Primary and Secondary Outcomes Across Follow-up
Comparative Results for Primary and Secondary Outcomes Across Follow-up
Table 3.  Descriptive Results of Continuous Secondary Outcomes at 6-Month and 12-Month Follow-up
Descriptive Results of Continuous Secondary Outcomes at 6-Month and 12-Month Follow-up
Table 4.  Descriptive Results on Binary Secondary Outcomes at 6-Month and 12-Month Follow-up
Descriptive Results on Binary Secondary Outcomes at 6-Month and 12-Month Follow-up
1.
Erdei  E, Torres  SM.  A new understanding in the epidemiology of melanoma.  Expert Rev Anticancer Ther. 2010;10(11):1811-1823. doi:10.1586/era.10.170PubMedGoogle ScholarCrossref
2.
International Agency for Research on Cancer. Global Cancer Observatory. http://gco.iarc.fr/. Accessed August 5, 2019.
3.
Mistry  M, Parkin  DM, Ahmad  AS, Sasieni  P.  Cancer incidence in the United Kingdom: projections to the year 2030.  Br J Cancer. 2011;105(11):1795-1803. doi:10.1038/bjc.2011.430PubMedGoogle ScholarCrossref
4.
Glazer  AM, Winkelmann  RR, Farberg  AS, Rigel  DS.  Analysis of trends in US melanoma incidence and mortality.  JAMA Dermatol. 2017;153(2):225-226. doi:10.1001/jamadermatol.2016.4512PubMedGoogle ScholarCrossref
5.
Office for National Statistics. Cancer registration statistics, England: 2016. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/cancerregistrationstatisticsengland/final2016. Accessed August 5, 2019.
6.
Belbasis  L, Stefanaki  I, Stratigos  AJ, Evangelou  E.  Non-genetic risk factors for cutaneous melanoma and keratinocyte skin cancers: an umbrella review of meta-analyses.  J Dermatol Sci. 2016;84(3):330-339. doi:10.1016/j.jdermsci.2016.09.003PubMedGoogle ScholarCrossref
7.
Linos  E, Swetter  SM, Cockburn  MG, Colditz  GA, Clarke  CA.  Increasing burden of melanoma in the United States.  J Invest Dermatol. 2009;129(7):1666-1674. doi:10.1038/jid.2008.423PubMedGoogle ScholarCrossref
8.
Office for National Statistics. Cancer survival in England: national estimates for patients followed up to 2017. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/cancersurvivalinengland/nationalestimatesforpatientsfollowedupto2017. Accessed August 5, 2019.
9.
Gershenwald  JE, Scolyer  RA, Hess  KR,  et al; for members of the American Joint Committee on Cancer Melanoma Expert Panel and the International Melanoma Database and Discovery Platform.  Melanoma staging: evidence-based changes in the American Joint Committee on Cancer eighth edition cancer staging manual.  CA Cancer J Clin. 2017;67(6):472-492.PubMedGoogle ScholarCrossref
10.
Luke  JJ, Flaherty  KT, Ribas  A, Long  GV.  Targeted agents and immunotherapies: optimizing outcomes in melanoma.  Nat Rev Clin Oncol. 2017;14(8):463-482. doi:10.1038/nrclinonc.2017.43PubMedGoogle ScholarCrossref
11.
Neal  RD, Tharmanathan  P, France  B,  et al.  Is increased time to diagnosis and treatment in symptomatic cancer associated with poorer outcomes? systematic review.  Br J Cancer. 2015;112(suppl 1):S92-S107. doi:10.1038/bjc.2015.48PubMedGoogle ScholarCrossref
12.
Rubin  G, Berendsen  A, Crawford  SM,  et al.  The expanding role of primary care in cancer control.  Lancet Oncol. 2015;16(12):1231-1272. doi:10.1016/S1470-2045(15)00205-3PubMedGoogle ScholarCrossref
13.
Baughan  P, O’Neill  B, Fletcher  E.  Auditing the diagnosis of cancer in primary care: the experience in Scotland.  Br J Cancer. 2009;101(Suppl 2):S87-S91. doi:10.1038/sj.bjc.6605397PubMedGoogle ScholarCrossref
14.
Keeble  S, Abel  GA, Saunders  CL,  et al.  Variation in promptness of presentation among 10,297 patients subsequently diagnosed with one of 18 cancers: evidence from a National Audit of Cancer Diagnosis in Primary Care.  Int J Cancer. 2014;135(5):1220-1228. doi:10.1002/ijc.28763PubMedGoogle ScholarCrossref
15.
Walter  FM, Birt  L, Cavers  D,  et al.  ‘This isn’t what mine looked like’: a qualitative study of symptom appraisal and help seeking in people recently diagnosed with melanoma.  BMJ Open. 2014;4(7):e005566. doi:10.1136/bmjopen-2014-005566PubMedGoogle Scholar
16.
Rueegg  CS, Stenehjem  JS, Egger  M,  et al.  Challenges in assessing the sunscreen-melanoma association.  Int J Cancer. 2019;144(11):2651-2668.PubMedGoogle ScholarCrossref
17.
Grossman  DC, Curry  SJ, Owens  DK,  et al; US Preventive Services Task Force.  Behavioral counseling to prevent skin cancer: US Preventive Services Task Force recommendation statement.  JAMA. 2018;319(11):1134-1142. doi:10.1001/jama.2018.1623PubMedGoogle ScholarCrossref
18.
Johnson  MM, Leachman  SA, Aspinwall  LG,  et al.  Skin cancer screening: recommendations for data-driven screening guidelines and a review of the US Preventive Services Task Force controversy.  Melanoma Manag. 2017;4(1):13-37. doi:10.2217/mmt-2016-0022PubMedGoogle ScholarCrossref
19.
Deloitte. UK public are ‘glued to smartphones’ as device adoption reaches new heights. https://www2.deloitte.com/uk/en/pages/press-releases/articles/uk-public-glued-to-smartphones.html. Accessed August 5, 2019.
20.
Kassianos  AP, Emery  JD, Murchie  P, Walter  FM.  Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review.  Br J Dermatol. 2015;172(6):1507-1518. doi:10.1111/bjd.13665PubMedGoogle ScholarCrossref
21.
Usher-Smith  JA, Kassianos  AP, Emery  JD,  et al.  Identifying people at higher risk of melanoma across the U.K.: a primary-care-based electronic survey.  Br J Dermatol. 2017;176(4):939-948. doi:10.1111/bjd.15181PubMedGoogle ScholarCrossref
22.
Mills  K, Emery  J, Lantaff  R,  et al.  Protocol for the melatools skin self-monitoring trial: a phase II randomised controlled trial of an intervention for primary care patients at higher risk of melanoma.  BMJ Open. 2017;7(11):e017934. doi:10.1136/bmjopen-2017-017934PubMedGoogle Scholar
23.
Williams  LH, Shors  AR, Barlow  WE, Solomon  C, White  E.  Identifying persons at highest risk of melanoma using self-assessed risk factors.  J Clin Exp Dermatol Res. 2011;2(6):1000129. doi:10.4172/2155-9554.1000129PubMedGoogle Scholar
24.
Walter  F, Webster  A, Scott  S, Emery  J.  The Andersen Model of Total Patient Delay: a systematic review of its application in cancer diagnosis.  J Health Serv Res Policy. 2012;17(2):110-118. doi:10.1258/jhsrp.2011.010113PubMedGoogle ScholarCrossref
25.
Walter  FM, Emery  JD, Mendonca  S,  et al.  Symptoms and patient factors associated with longer time to diagnosis for colorectal cancer: results from a prospective cohort study.  Br J Cancer. 2016;115(5):533-541. doi:10.1038/bjc.2016.221PubMedGoogle ScholarCrossref
26.
Walter  FM, Rubin  G, Bankhead  C,  et al.  Symptoms and other factors associated with time to diagnosis and stage of lung cancer: a prospective cohort study.  Br J Cancer. 2015;112(suppl 1):S6-S13. doi:10.1038/bjc.2015.30PubMedGoogle ScholarCrossref
27.
Walter  FM, Mills  K, Mendonça  SC,  et al.  Symptoms and patient factors associated with diagnostic intervals for pancreatic cancer (SYMPTOM Pancreatic Study): a prospective cohort study.  Lancet Gastroenterol Hepatol. 2016;1(4):298-306. doi:10.1016/S2468-1253(16)30079-6PubMedGoogle ScholarCrossref
28.
Craig  P, Dieppe  P, Macintyre  S, Michie  S, Nazareth  I, Petticrew  M; Medical Research Council Guidance.  Developing and evaluating complex interventions: the new Medical Research Council guidance.  BMJ. 2008;337:a1655. doi:10.1136/bmj.a1655PubMedGoogle ScholarCrossref
29.
Manne  S, Lessin  S.  Prevalence and correlates of sun protection and skin self-examination practices among cutaneous malignant melanoma survivors.  J Behav Med. 2006;29(5):419-434. doi:10.1007/s10865-006-9064-5PubMedGoogle ScholarCrossref
30.
Smith  S, Fielding  S, Murchie  P,  et al.  Reducing the time before consulting with symptoms of lung cancer: a randomised controlled trial in primary care.  Br J Gen Pract. 2013;63(606):e47-e54. doi:10.3399/bjgp13X660779PubMedGoogle ScholarCrossref
31.
Glanz  K, Geller  AC, Shigaki  D, Maddock  JE, Isnec  MR.  A randomized trial of skin cancer prevention in aquatics settings: the Pool Cool program.  Health Psychol. 2002;21(6):579-587. doi:10.1037/0278-6133.21.6.579PubMedGoogle ScholarCrossref
32.
Moye  MS, King  SM, Rice  ZP,  et al.  Effects of total-body digital photography on cancer worry in patients with atypical mole syndrome.  JAMA Dermatol. 2015;151(2):137-143. doi:10.1001/jamadermatol.2014.2229PubMedGoogle ScholarCrossref
33.
Zigmond  AS, Snaith  RP.  The Hospital Anxiety and Depression Scale.  Acta Psychiatr Scand. 1983;67(6):361-370. doi:10.1111/j.1600-0447.1983.tb09716.xPubMedGoogle ScholarCrossref
34.
Ware  J  Jr, Kosinski  M, Keller  SD.  A 12-item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity.  Med Care. 1996;34(3):220-233. doi:10.1097/00005650-199603000-00003PubMedGoogle ScholarCrossref
35.
Henson  KE, Elliss-Brookes  L, Coupland  VH,  et al.  Data resource profile: National Cancer Registration Dataset in England  [published online April 23, 2019].  Int J Epidemiol. 2019:dyz076. doi:10.1093/ije/dyz076PubMedGoogle Scholar
36.
Walter  FM, Abel  GA, Lyratzopoulos  G,  et al.  Seasonal variation in diagnosis of invasive cutaneous melanoma in Eastern England and Scotland.  Cancer Epidemiol. 2015;39(4):554-561. doi:10.1016/j.canep.2015.06.006PubMedGoogle ScholarCrossref
37.
Robinson  JK, Wayne  JD, Martini  MC, Hultgren  BA, Mallett  KA, Turrisi  R.  Early detection of new melanomas by patients with melanoma and their partners using a structured skin self-examination skills training intervention: a randomized clinical trial.  JAMA Dermatol. 2016;152(9):979-985. doi:10.1001/jamadermatol.2016.1985PubMedGoogle ScholarCrossref
38.
Aneja  S, Brimhall  AK, Kast  DR,  et al.  Improvement in patient performance of skin self-examinations after intervention with interactive education and telecommunication reminders: a randomized controlled study.  Arch Dermatol. 2012;148(11):1266-1272. doi:10.1001/archdermatol.2012.2480PubMedGoogle ScholarCrossref
39.
Weinstock  MA, Risica  PM, Martin  RA,  et al.  Melanoma early detection with thorough skin self-examination: the “Check It Out” randomized trial.  Am J Prev Med. 2007;32(6):517-524. doi:10.1016/j.amepre.2007.02.024PubMedGoogle ScholarCrossref
40.
Paddock  LE, Lu  SE, Bandera  EV,  et al.  Skin self-examination and long-term melanoma survival.  Melanoma Res. 2016;26(4):401-408. doi:10.1097/CMR.0000000000000255PubMedGoogle ScholarCrossref
41.
Swetter  SM, Pollitt  RA, Johnson  TM, Brooks  DR, Geller  AC.  Behavioral determinants of successful early melanoma detection: role of self and physician skin examination.  Cancer. 2012;118(15):3725-3734. doi:10.1002/cncr.26707PubMedGoogle ScholarCrossref
42.
Körner  A, Coroiu  A, Martins  C, Wang  B.  Predictors of skin self-examination before and after a melanoma diagnosis: the role of medical advice and patient’s level of education.  Int Arch Med. 2013;6(1):8. doi:10.1186/1755-7682-6-8PubMedGoogle ScholarCrossref
43.
Hall  S, Murchie  P.  Can we use technology to encourage self-monitoring by people treated for melanoma? a qualitative exploration of the perceptions of potential recipients.  Support Care Cancer. 2014;22(6):1663-1671. doi:10.1007/s00520-014-2133-3PubMedGoogle ScholarCrossref
44.
Körner  A, Drapeau  M, Thombs  BD,  et al.  Barriers and facilitators of adherence to medical advice on skin self-examination during melanoma follow-up care.  BMC Dermatol. 2013;13:3. doi:10.1186/1471-5945-13-3PubMedGoogle ScholarCrossref
45.
Murchie  P, Allan  JL, Brant  W,  et al.  Total skin self-examination at home for people treated for cutaneous melanoma: development and pilot of a digital intervention.  BMJ Open. 2015;5(8):e007993. doi:10.1136/bmjopen-2015-007993PubMedGoogle Scholar
46.
Wolf  JA, Ferris  LK.  Diagnostic inaccuracy of smartphone applications for melanoma detection: reply.  JAMA Dermatol. 2013;149(7):885. doi:10.1001/jamadermatol.2013.4337PubMedGoogle ScholarCrossref
Limit 200 characters
Limit 25 characters
Conflicts of Interest Disclosure

Identify all potential conflicts of interest that might be relevant to your comment.

Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.

Err on the side of full disclosure.

If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.

Not all submitted comments are published. Please see our commenting policy for details.

Limit 140 characters
Limit 3600 characters or approximately 600 words
    Original Investigation
    Dermatology
    February 26, 2020

    Effect of a Skin Self-monitoring Smartphone Application on Time to Physician Consultation Among Patients With Possible Melanoma: A Phase 2 Randomized Clinical Trial

    Author Affiliations
    • 1The Primary Care Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, United Kingdom
    • 2Department of General Practice and the Centre for Cancer Research, Faculty of Medicine, Dentistry, and Health Science, Victorian Comprehensive Cancer Centre, University of Melbourne, Australia
    • 3Institute of Applied Health Science, Centre of Academic Primary Care, University of Aberdeen, Aberdeen, United Kingdom
    • 4Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
    JAMA Netw Open. 2020;3(2):e200001. doi:10.1001/jamanetworkopen.2020.0001
    Key Points español 中文 (chinese)

    Question  Does a smartphone application that prompts monthly skin self-monitoring result in individuals with increased risk of melanoma having more timely or more frequent family practice consultations for skin changes?

    Findings  In this phase 2 randomized clinical trial of 238 participants, there were no significant differences in skin consultation rates, measures of skin self-monitoring, or psychological harm.

    Meaning  Because there was no evidence that a smartphone application increased skin self-examination or health care consulting rates among a family practice population at increased risk of melanoma, its implementation is not yet recommended.

    Abstract

    Importance  Melanoma is among the most lethal skin cancers; it has become the fifth most common cancer in the United Kingdom, and incidence rates are rising. Population approaches to reducing incidence have focused on mass media campaigns to promote earlier presentation and potentially improve melanoma outcomes; however, interventions using smartphone applications targeting those with the greatest risk could promote earlier presentation to health care professionals for individuals with new or changing skin lesions.

    Objective  To study the effect of a commercially available skin self-monitoring (SSM) smartphone application among individuals with increased risk of melanoma on their decision to seek help for changing skin lesions.

    Design, Setting, and Participants  This phase 2 randomized clinical trial was conducted in 12 family practices in Eastern England between 2016 and 2017. A total of 238 participants, aged 18 to 75 years and with an increased risk of melanoma, were identified using a real-time melanoma risk assessment tool in family practice waiting rooms. Analysis was intention to treat. Participants were observed for 12 months, and data analysis was conducted from January to August 2018.

    Intervention  The intervention and control groups received a consultation with standard written advice on sun protection and skin cancer detection. The intervention group had an SSM application loaded on their smartphone and received instructions for use and monthly self-monitoring reminders.

    Main Outcomes and Measures  The coprimary outcomes were skin consultation rates with family practice physicians and patient intervals, measured as the time between noticing a skin change and consulting with a family practice clinician. Follow-up questionnaires were sent at 6 and 12 months, and consultation rates were extracted from family practice records. Secondary outcomes included skin self-examination benefits and barriers, self-efficacy for consulting without delay, perceived melanoma risk, sun protection habits, and potential harms.

    Results  A total of 238 patients were randomized (median [interquartile range] age, 55 [43-65] years, 131 [55.0%] women, 227 [95.4%] white British; 119 [50.0%] randomized to the intervention group). Overall, 51 participants (21.4%) had consultations regarding skin changes during the 12 months of follow-up, and 157 participants (66.0%) responded to at least 1 follow-up questionnaire. There were no significant differences in skin consultation rates (adjusted risk ratio, 0.96; 95% CI, 0.56 to 1.66; P = .89), measures of SSM (adjusted mean difference, 0.08; 95% CI, −0.83 to 1.00; P = .86), or psychological harm (eg, Melanoma Worry Scale: adjusted mean difference, −0.12; 95% CI, −0.56 to 0.31; P = .58).

    Conclusions and Relevance  In this study, recruitment, retention, and initial delivery of the intervention were feasible, and this research provided no evidence of harm from the SSM smartphone application. However, no evidence of benefit on skin self-examination or health care consulting was found, and there is no reason at this stage to recommend its implementation in this population at increased risk of melanoma.

    Trial Registration  isrctn.org Identifier: ISRCTN16061621

    Introduction

    Melanoma is among the most lethal forms of skin cancer.1 While it accounts for less than 5% of all cutaneous malignant neoplasms worldwide, melanoma is responsible for most skin cancer deaths.2 Internationally, melanoma has among the fastest rising incidence rates of any cancer.3 In the United States, during the 7 years from 2009 to 2016, raw incidence rates per 100 000 residents climbed from 22.2 to 23.6, with an estimated 76 380 new cases in 2016.4 In England, in the decade from 2007 to 2016, age-standardized incidence increased by 37%, with 13 748 new cases and 1937 deaths in 2016.5 Melanoma is largely preventable; more than 80% of newly diagnosed melanomas are associated with an increase in recreational sun exposure and tanning bed use.6,7 Melanoma is also largely curable, with 5-year net-standardized survival of 100% for stage-1 tumors, and most tumors among patients with melanoma are stage-1 tumors.8 However, among patients presenting with later-stage disease, overall survival rates fall significantly, and once the disease has spread beyond surgical intervention, metastatic melanoma remains largely incurable despite the recent introduction of systemic therapies extending survival.9,10

    There is growing evidence that time to patient presentation to health care and initial management in primary care are key determinants of patient outcomes for most cancers.11,12 Compared with other cancers, melanoma has among the longest delays measured as median time to patient presentation.13,14 To understand possible reasons, recent studies have explored symptom appraisal and help-seeking among individuals recently diagnosed with melanoma. Factors contributing to later presentation to health care include having limited awareness of the seriousness of some skin changes, considering changes in skin as part of normal aging, and having concerns about wasting their own and their general practitioners’ time.15

    Mass media campaigns have been the main population approach to reduce sun exposure and improve time to presentation. In Australia, public health campaigns such as Slip-Slap-Slop have been highly effective in primary prevention, and incidence rates for new melanoma are plateauing.16 Mass media approaches in the United Kingdom, such as SunSmart and the Be Clear on Cancer Skin Cancer campaign, have been less effective in reducing sun exposure or promoting consultations to health care. Initiatives in the United States have focused on educational and clinician-led approaches to minimizing exposure among children and young adults with fair skin types to UV radiation.17 Routine screening of the general population is not currently recommended internationally, although some countries (eg, the United Kingdom, Australia, New Zealand, Germany, the Netherlands) recommend regular skin checks and/or self-examination for certain subsets of patients with increased risk of melanoma.18

    More targeted interventions aimed at individuals with increased risk of melanoma could promote earlier presentation to health care. There is a great deal of interest in new technological approaches, such as smartphone applications. People have increasing access to smartphone applications; in 2017, more than 77% of the US and UK populations owned a smartphone.19 Smartphone applications can be used to inform prevention and awareness messages, photograph skin lesions, and monitor possible skin changes.20 We have demonstrated that it is possible to use a simple patient-completed risk assessment tool in the UK family practice setting to stratify the population into those with population risk and those with increased risk of melanoma.21 Individuals with increased risk could receive targeted interventions to promote earlier presentation to health care.

    We chose the MySkinPal app as an exemplar for this study, following extensive phase 1 evaluation. Having reviewed the availability of potentially suitable smartphone skin self-monitoring (SSM) applications, also known as skin self-examination (SSE) applications,20 we undertook qualitative research, using focus groups and interviews, with individuals with increased risk of melanoma to provide in-depth understanding of consumer views on the usefulness and usability of 2 short-listed applications. MySkinPal was selected for its superior ease of use, including photography, straightforward instructions, and built-in notifications to complete future skin self-monitoring22 (eFigure in Supplement 1). We aimed to test the SSM application in a family practice population with increased risk of melanoma and measure its effect on time to consultation and consultation rates for skin changes.

    Methods

    The trial protocol has been published22 and is available in Supplement 2; therefore, the methods are reported briefly here. This study was approved by the Cambridgeshire and Hertfordshire NHS research ethics committee. This report followed the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline.

    Trial Design and Participants

    This individually randomized phase 2 clinical trial was conducted in 12 family practices in Eastern England. Eligible participants were general practice attendees aged 18 to 75 years who owned a smartphone and were identified as having increased risk of melanoma after completing an electronic questionnaire (ie, MelaTools Q risk assessment tool21) using tablet computers. Participants were able to read and write English and give informed consent. Exclusion criteria were having a severe psychiatric or cognitive disorder or a physical disorder severe enough to inhibit the use of a smartphone. Potentially eligible patients were given a trial appointment at their general practice. Randomization was performed after written informed consent had been obtained.

    Control

    A research nurse invited participants in the control group to complete the baseline questionnaire; the nurse and participants then had a brief discussion about skin health, using the Cancer Research UK leaflets “Be sunsmart—cut your cancer risk” and “Skin cancer—how to spot the signs and symptoms.” Participants then received usual care at their general practice.

    Intervention

    In addition to consultation with a nurse, participants randomized to the intervention group had the SSM application loaded on their smartphones and were given verbal and written instructions on its use. A monthly prompt to self-monitor for skin changes was set on the applications, and participants were reimbursed with a voucher for £10 (US $13) to cover the cost of the application.

    Outcomes and Measures

    We collected information on sociodemographic and clinical variables as follows: age, sex, marital status, postcode, highest educational level, occupation, history of skin cancer, skin and hair type, and number of raised moles on both arms at baseline.21,23 The coprimary clinical outcomes of this trial were as follows: (1) family practice consultation rates and (2) patient interval (ie, time between first noticing a change and consultation24) for any skin changes or pigmented skin lesions. Data on consultations in the year before the trial and for 12 months after the trial consultation were collected through audits of general practitioner medical records. Data on the patient interval were measured using the Skin Questionnaire. This self-completed questionnaire, based on the Symptom instrument,25-27 obtains data on presenting symptoms and their duration before consultation. Monthly electronic searches of general practitioner medical records identified recent skin consultations. Participants were sent (electronically or by mail) a Skin Questionnaire to complete regarding skin changes associated with that consultation.

    This was a phase 2 randomized clinical trial of a complex intervention,28 so we collected feasibility outcomes, particularly regarding recruitment and retention. Our outcomes were additionally designed to test whether the intervention had the potential to facilitate the early detection of melanoma by evaluating its effect across a range of intermediate end points. The following outcomes were assessed at baseline and in 6-month and 12-month follow-up questionnaires: (1) skin self-examination benefits and barriers, a 10-item scale, validated in the United States among melanoma survivors29; (2) self-efficacy for consulting without delay, an 8-item scale adapted from a 10-item scale30; (3) perceived melanoma risk, 2 items29; and (4) sun protection habits scale, a 5-item measure validated in a US skin cancer prevention program31 with additional questions about sun protection. We also assessed potential harms from the intervention in the 6-month and 12-month follow-up questionnaires, as follows: (1) the Melanoma Worry Scale, a 4-item scale with a range of 4 to 17, with higher scores suggesting increased anxiety32; (2) the Hospital Anxiety and Depression Scale, a widely used 14-item scale33; and (3) quality of life, using the 12-item Short Form Health Survey scale.34

    Participant-completed measures were collected at baseline, 1 month, and 12 months. Health service utilization data were collected at 12 months by general practice medical record audit.

    Sample Size

    This feasibility trial was designed to have a sample size of 200, with 100 participants in each group. This would provide sufficient data on ease of recruitment and attrition and to estimate effect size to inform a future phase 3 randomized clinical trial.22

    Randomization

    Eligible patients who consented to participate were randomized 1:1 to either the control or intervention group. Randomization was performed using an online system, and a block randomization method was applied using computer-generated, randomly permuted blocks of sizes 2, 4, and 6, established by a professional independent randomization service (King’s College London Clinical Trials, United Kingdom).

    Masking

    Outcomes assessed by self-report obviated the need for researcher masking. For the extraction and analysis of health service data, research staff were masked to group assignment. All statistical analyses were performed masked to group assignment.

    Statistical Analysis

    We wrote a statistical analysis plan (agreed on by F.M.W., M.E.B., and C.L.S.), including outlines of all results tables and all analysis code, before exploring any data, and unmasking only occurred after all the analyses had been completed. These methods followed our previously reported approach to this analysis, published in the study protocol. This plan appears in Supplement 2.22

    Poisson regression was used to analyze the consultation rate primary outcome, and linear regression was used to analyze the patient interval primary outcome, with practice-level random effects to account for possible clustering of outcomes within general practices. Secondary outcomes were analyzed using linear (continuous outcomes) or logistic (binary outcomes) regression, with participant-level random effects to account for the similarity of answers when participants responded at both 6 and 12 months follow-up. Formal statistical comparisons were only made when rates of missing data were similar (prespecified as a difference of 10 percentage points or less). We made no correction for multiple testing, using a 2-sided P < .05 as the threshold for statistical significance. All analyses were performed using Stata version 15 (StataCorp).

    Results

    We recruited patients from 12 general practices in 7 clinical commissioning groups (CCGs) across eastern England, with a range of list sizes (1 practice [8.3%], <10 000 patients; 8 practices [66.7%], 10 000-20 000 patients; 3 practices [25.0%], >20 000 patients) and locations (3 [25.0%] rural; 1 [8.3%] urban; 8 [66.7%] mixed rural and urban). Between August 22, 2016, and January 6, 2017, we assessed 1729 family practice attendees for eligibility, of whom 1319 (76.3%) did not meet our eligibility criteria (ie, they did not have an increased risk of melanoma), leaving 410 (23.7%) who were eligible. A total of 238 eligible patients (58.0%) consented to be randomized (Figure), with an overall median (interquartile range) age of 55 (43-65) years, 131 (55.0%) women, and 227 (95.4%) white British participants.

    Table 1 presents baseline data on the trial cohort. The 238 participants (119 randomized to the intervention group and 119 to the control group) were well matched, with no obvious differences in any of the measures collected at baseline. People older than 60 years were less likely to complete the initial assessment compared with people younger than 60 years (236 of 322 [73.3%] vs 152 of 374 [40.6%], P < .001). There was no difference in consent rates by sex, and no patients were diagnosed with melanoma during the 12-month follow-up period. A total of 16 participants (6.7%) were lost to follow-up during the trial. Comparing baseline melanoma incidence data during 3 years (2013-2015), provided to the research team by the English National Cancer Registry,35 there was no evidence of difference between the study practices and those in the rest of England.

    The primary outcome of rate of family practice skin consultation in the year following the intervention was determined for 222 of 238 participants (93.3%). Analysis of consultation rate included all patients and assumed that the 16 participants (6.7%) who were lost to follow-up during the trial had no skin consultations after they were lost to follow-up. The patient interval was determined for 19 of 51 participants (37.3%) who had skin consultations; 8 of 25 (32.0%) in the intervention group and 11 of 26 (42.3%) in the control group completed a Skin Questionnaire after a relevant family practice consultation. Secondary outcomes were available for 157 participants (66.0%) for at least 1 point.

    Coprimary Outcomes

    There was no evidence of difference in consultation numbers and rates between the control group and the intervention group (adjusted risk ratio, 0.96; 95% CI, 0.56-1.66; P = .89). However, the mean (SD) consultation rate per person in the intervention group was higher in the 12 months before the trial than in the 12 months during the trial (0.29 [0.61] vs 0.21 [0.66]) (eTable in Supplement 1). Adjusting for age, sex, and clustering within general practices did not change the results. We did not perform formal statistical testing for the patient interval coprimary outcome because of differences in the rates of missing data between the control and intervention groups (Table 2).

    Secondary Outcomes

    Table 2, Table 3, and Table 4 present the results of the participant-reported secondary outcomes, ie, skin self-examination benefits and barriers, self-efficacy for consulting without delay, perceived melanoma risk, sun protection habits, melanoma worry, anxiety and depression, and quality of life. There were no statistically significant differences between trial groups on any of the secondary outcome measures (eg, measures of SSM: adjusted mean difference, 0.08; 95% CI, −0.83 to 1.00; P = .86; Melanoma Worry Scale: adjusted mean difference, −0.12; 95% CI, −0.56 to 0.31; P = .58). A sensitivity analysis additionally adjusting for age and sex showed similar results.

    Discussion
    Summary

    To our knowledge, this is among the first trials worldwide to investigate the potential effect of a behavioral intervention using an SSM application to promote help-seeking in patients with increased risk of melanoma. We combined evidence-based approaches to identify people at increased risk in the family practice setting with new approaches using smartphone applications for SSM. We were unable to demonstrate any effect on consultation rates or patient interval, but importantly, there was no evidence of psychological harm from the intervention during the following 12 months. At the same time, there was also no evidence of any beneficial effect on sun protection habits, skin self-examination behavior, or perceived risk of developing melanoma among those receiving the intervention. Trial recruitment, retention, and initial delivery of the intervention were all feasible. However, we have no data on the actual use of the SSM app; this process measure is an important further dimension to assess before making a feasibility decision regarding a larger trial powered to demonstrate effects on either consultation rates or the primary care interval.

    The intervention, including uploading the app, demonstrating use of the app, and providing regular reminders, was not found to alter consultation rates or help-seeking for skin symptoms. This may have been because of the short follow-up time and possibly influenced by seasonal variation in detecting skin changes.36 We also found no differences in our quantitative measurements of sun protection habits, skin self-examination, self-efficacy to consult, melanoma risk perception, or measures of general or cancer-specific anxiety.

    It is not easy to interpret these findings in the context of other similar studies given that we have not been able to identify any trial evidence using a smartphone application to support SSM or SSE for individuals with increased melanoma risk. There is US trial evidence for the efficacy of SSE skills training and reminders among patients recently diagnosed with melanoma37 and among skin clinic patients without melanoma.38 Furthermore, the Check It Out randomized clinical trial, set in the United States among a similar population with increased risk of melanoma, reported that increasing SSE practices in the short-term resulted in more abnormal lesions detected and more skin surgical procedures,39 although, like our trial, it was not powered to detect melanoma diagnosis. In the United States, most studies have been set among people previously treated for a melanoma and, therefore, with very high risk for development of a new primary melanoma as well as recurrence. These studies have not demonstrated strong evidence that SSE influences melanoma mortality,40 although it has been shown to reduce the incidence of thick melanomas.41 Other studies set in the United Kingdom and elsewhere have shown that SSE practice is frequently suboptimal,42,43 and barriers to initiating and maintaining SSE include lack of initial training, declining motivation, and insufficient time.44

    These barriers could be addressed by several of the features of smartphone applications that enable self-monitoring among individuals with increased risk of melanoma. Our findings relate to the concept of using an SSM application rather than the properties of the specific application selected following extensive evaluation of more than 40 available applications in 2016.20 The Achieving Self-directed Integrated Cancer Aftercare intervention is a rigorously developed, theoretically based, digitally supported application that uses specified behavior-change techniques to prompt users to perform regular, high-quality SSE and gives appropriate clinical responses when they raise a concern45; it is currently under evaluation in a UK randomized clinical trial among individuals recently treated for primary melanoma.22 Both the Achieving Self-directed Integrated Cancer Aftercare trial and our trial depend on patients using the applications optimally. We have no knowledge of how much the application was used in this trial, although no participants in either trial group reported that they had contaminated the trial by downloading other SSM smartphone applications.

    Limitations

    This study has limitations. The study was designed as a phase 2 trial of a complex intervention.28 We based the coprimary outcomes of family practice skin consultation rates and the patient interval on the intervention logic model. Encouraging people with increased risk of melanoma to self-monitor their own skin and consult their general practitioner if they have any concerns could reduce potential diagnostic delay for melanoma and could result in the detection of earlier-stage disease. Therefore, the coprimary outcomes were the most suitable intermediate measures along this causal pathway. Nevertheless, no participants were diagnosed with melanoma, and few consulted with their general practitioners during the 12-month follow-up period despite the participant population having increased risk of melanoma. This trial was not designed to have sufficient statistical power to detect a meaningful difference; a much larger trial would be needed for sufficient power to detect differences in the patient interval or skin consultation rates and an even larger trial to detect differences in time to diagnosis, stage at diagnosis, or mortality from melanoma.

    Although the feasibility outcomes around recruitment were satisfactory, older individuals were less likely to consent to participate. More than half of those found to be eligible for the trial consented to participate. The randomized groups were well-balanced, and few participants were lost to follow-up over 12 months (16 [6.7%]). However, there were fewer than expected events across both groups (ie, 51 skin consultations) and a low response (ie, 37%) to the Skin Questionnaire, meaning that we were unable to report on the effect of the intervention on the time to consultation (ie, patient interval). The control group received a brief discussion about skin health and Cancer Research UK leaflets. While intended as an attention control, this could potentially have increased consultations about skin changes and reduced the effect size of the intervention. We were unable to accurately assess the use of the application by participants (either by direct or electronic questioning) and cannot say whether it was used regularly for skin self-monitoring or whether that contributed to the absence of effect on consultation rates in the intervention arm. We consider the findings generalizable beyond the East of England because of the recruitment of patients from 12 general practices located in urban and rural areas with a range of size of patient lists and socioeconomic deprivation.

    Conclusions

    In this phase 2 randomized trial, the use of a SSM smartphone application did not have an effect on the rate at which participants with higher risk of melanoma consulted with family practice physicians regarding skin changes. Therefore, significant uncertainty remains regarding the best strategies to promote early detection of melanoma. For those with moderate risk of melanoma, behavioral approaches, such as using an SSM smartphone application to prompt timely consultation, remain an option, promoted particularly among policy makers, but our trial does not offer even preliminary randomized clinical trial evidence to support this. While such applications have not been shown to have value in diagnosing melanoma,46 they may have more promise as monitoring tools to identify skin changes. Further evidence on how to ensure people with increased risk of melanoma engage with and use these applications and whether this leads to earlier detection is needed. Until then, the role of smartphone applications as a strategy to detect melanoma earlier remains unclear.

    Back to top
    Article Information

    Accepted for Publication: December 15, 2019.

    Published: February 26, 2020. doi:10.1001/jamanetworkopen.2020.0001

    Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Walter FM et al. JAMA Network Open.

    Corresponding Author: Fiona M. Walter, FRCGP, The Primary Care Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge CB1 8RN, United Kingdom (fmw22@medschl.cam.ac.uk).

    Author Contributions: Dr Walter had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

    Concept and design: Walter, Mills, Murchie, Emery.

    Acquisition, analysis, or interpretation of data: Walter, Pannebakker, Barclay, Saunders, Corrie, Hall, Burrows, Emery.

    Drafting of the manuscript: Walter, Pannebakker, Barclay, Burrows.

    Critical revision of the manuscript for important intellectual content: Walter, Barclay, Mills, Saunders, Murchie, Corrie, Hall, Burrows, Emery.

    Statistical analysis: Barclay, Saunders.

    Obtained funding: Walter, Emery.

    Administrative, technical, or material support: Pannebakker, Barclay, Mills, Emery.

    Supervision: Corrie.

    Conflict of Interest Disclosures: Dr Emery reported receiving funding from an National Health and Medical Research Council Practitioner Fellowship. Dr Walter and Dr Emery reported that they are director and associate director, respectively, of the multiinstitutional CanTest Collaborative, which is funded by Cancer Research UK. Dr Hall reporting serving as a consultant for Lifescan and Health Screen UK. No other disclosures reported.

    Funding/Support: Dr Walter was funded by National Institute for Health Research Clinician Scientist award CS-012-030 for this research project. Dr Emery is funded by a National Health and Medical Research Council Practitioner Fellowship. Service support costs were obtained from the Department of Health with the support of NHS Cambridgeshire and the East of England Primary Care Research Network.

    Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

    Disclaimer: This publication presents independent research funded by the National Institute for Health Research. The views expressed are those of the authors, and not necessarily those of the National Health Service, the National Institute of Health Research, or the Department of Health and Social Care.

    Data Sharing Statement: See Supplement 3.

    Additional Contributions: We thank ORION for designing the MelaTools app, and state that ORION had no influence on the design or analysis of this trial. ORION was compensated for tool development. We thank King’s Clinical Trials Unit at King’s College London for trial support. We are grateful to the patients, research nurses, GPs and practices who contributed to the MelaTools-Skin Self-monitoring trial and to the clinical research network Eastern for their help with recruiting the participants. We thank Mrudula Utukuri for her contribution to the study and the researchers and patients in the MelaTools Steering Committee for their scientific support and comments throughout the design, set-up, and conduct of the trial: Gary Abel, PhD; Katharine Acland, MBBS; Patricia Fairbrother; Margaret Johnson; Simon Rodwell; and Ed Wilson, PhD. They were not compensated for their time.

    References
    1.
    Erdei  E, Torres  SM.  A new understanding in the epidemiology of melanoma.  Expert Rev Anticancer Ther. 2010;10(11):1811-1823. doi:10.1586/era.10.170PubMedGoogle ScholarCrossref
    2.
    International Agency for Research on Cancer. Global Cancer Observatory. http://gco.iarc.fr/. Accessed August 5, 2019.
    3.
    Mistry  M, Parkin  DM, Ahmad  AS, Sasieni  P.  Cancer incidence in the United Kingdom: projections to the year 2030.  Br J Cancer. 2011;105(11):1795-1803. doi:10.1038/bjc.2011.430PubMedGoogle ScholarCrossref
    4.
    Glazer  AM, Winkelmann  RR, Farberg  AS, Rigel  DS.  Analysis of trends in US melanoma incidence and mortality.  JAMA Dermatol. 2017;153(2):225-226. doi:10.1001/jamadermatol.2016.4512PubMedGoogle ScholarCrossref
    5.
    Office for National Statistics. Cancer registration statistics, England: 2016. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/cancerregistrationstatisticsengland/final2016. Accessed August 5, 2019.
    6.
    Belbasis  L, Stefanaki  I, Stratigos  AJ, Evangelou  E.  Non-genetic risk factors for cutaneous melanoma and keratinocyte skin cancers: an umbrella review of meta-analyses.  J Dermatol Sci. 2016;84(3):330-339. doi:10.1016/j.jdermsci.2016.09.003PubMedGoogle ScholarCrossref
    7.
    Linos  E, Swetter  SM, Cockburn  MG, Colditz  GA, Clarke  CA.  Increasing burden of melanoma in the United States.  J Invest Dermatol. 2009;129(7):1666-1674. doi:10.1038/jid.2008.423PubMedGoogle ScholarCrossref
    8.
    Office for National Statistics. Cancer survival in England: national estimates for patients followed up to 2017. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/cancersurvivalinengland/nationalestimatesforpatientsfollowedupto2017. Accessed August 5, 2019.
    9.
    Gershenwald  JE, Scolyer  RA, Hess  KR,  et al; for members of the American Joint Committee on Cancer Melanoma Expert Panel and the International Melanoma Database and Discovery Platform.  Melanoma staging: evidence-based changes in the American Joint Committee on Cancer eighth edition cancer staging manual.  CA Cancer J Clin. 2017;67(6):472-492.PubMedGoogle ScholarCrossref
    10.
    Luke  JJ, Flaherty  KT, Ribas  A, Long  GV.  Targeted agents and immunotherapies: optimizing outcomes in melanoma.  Nat Rev Clin Oncol. 2017;14(8):463-482. doi:10.1038/nrclinonc.2017.43PubMedGoogle ScholarCrossref
    11.
    Neal  RD, Tharmanathan  P, France  B,  et al.  Is increased time to diagnosis and treatment in symptomatic cancer associated with poorer outcomes? systematic review.  Br J Cancer. 2015;112(suppl 1):S92-S107. doi:10.1038/bjc.2015.48PubMedGoogle ScholarCrossref
    12.
    Rubin  G, Berendsen  A, Crawford  SM,  et al.  The expanding role of primary care in cancer control.  Lancet Oncol. 2015;16(12):1231-1272. doi:10.1016/S1470-2045(15)00205-3PubMedGoogle ScholarCrossref
    13.
    Baughan  P, O’Neill  B, Fletcher  E.  Auditing the diagnosis of cancer in primary care: the experience in Scotland.  Br J Cancer. 2009;101(Suppl 2):S87-S91. doi:10.1038/sj.bjc.6605397PubMedGoogle ScholarCrossref
    14.
    Keeble  S, Abel  GA, Saunders  CL,  et al.  Variation in promptness of presentation among 10,297 patients subsequently diagnosed with one of 18 cancers: evidence from a National Audit of Cancer Diagnosis in Primary Care.  Int J Cancer. 2014;135(5):1220-1228. doi:10.1002/ijc.28763PubMedGoogle ScholarCrossref
    15.
    Walter  FM, Birt  L, Cavers  D,  et al.  ‘This isn’t what mine looked like’: a qualitative study of symptom appraisal and help seeking in people recently diagnosed with melanoma.  BMJ Open. 2014;4(7):e005566. doi:10.1136/bmjopen-2014-005566PubMedGoogle Scholar
    16.
    Rueegg  CS, Stenehjem  JS, Egger  M,  et al.  Challenges in assessing the sunscreen-melanoma association.  Int J Cancer. 2019;144(11):2651-2668.PubMedGoogle ScholarCrossref
    17.
    Grossman  DC, Curry  SJ, Owens  DK,  et al; US Preventive Services Task Force.  Behavioral counseling to prevent skin cancer: US Preventive Services Task Force recommendation statement.  JAMA. 2018;319(11):1134-1142. doi:10.1001/jama.2018.1623PubMedGoogle ScholarCrossref
    18.
    Johnson  MM, Leachman  SA, Aspinwall  LG,  et al.  Skin cancer screening: recommendations for data-driven screening guidelines and a review of the US Preventive Services Task Force controversy.  Melanoma Manag. 2017;4(1):13-37. doi:10.2217/mmt-2016-0022PubMedGoogle ScholarCrossref
    19.
    Deloitte. UK public are ‘glued to smartphones’ as device adoption reaches new heights. https://www2.deloitte.com/uk/en/pages/press-releases/articles/uk-public-glued-to-smartphones.html. Accessed August 5, 2019.
    20.
    Kassianos  AP, Emery  JD, Murchie  P, Walter  FM.  Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review.  Br J Dermatol. 2015;172(6):1507-1518. doi:10.1111/bjd.13665PubMedGoogle ScholarCrossref
    21.
    Usher-Smith  JA, Kassianos  AP, Emery  JD,  et al.  Identifying people at higher risk of melanoma across the U.K.: a primary-care-based electronic survey.  Br J Dermatol. 2017;176(4):939-948. doi:10.1111/bjd.15181PubMedGoogle ScholarCrossref
    22.
    Mills  K, Emery  J, Lantaff  R,  et al.  Protocol for the melatools skin self-monitoring trial: a phase II randomised controlled trial of an intervention for primary care patients at higher risk of melanoma.  BMJ Open. 2017;7(11):e017934. doi:10.1136/bmjopen-2017-017934PubMedGoogle Scholar
    23.
    Williams  LH, Shors  AR, Barlow  WE, Solomon  C, White  E.  Identifying persons at highest risk of melanoma using self-assessed risk factors.  J Clin Exp Dermatol Res. 2011;2(6):1000129. doi:10.4172/2155-9554.1000129PubMedGoogle Scholar
    24.
    Walter  F, Webster  A, Scott  S, Emery  J.  The Andersen Model of Total Patient Delay: a systematic review of its application in cancer diagnosis.  J Health Serv Res Policy. 2012;17(2):110-118. doi:10.1258/jhsrp.2011.010113PubMedGoogle ScholarCrossref
    25.
    Walter  FM, Emery  JD, Mendonca  S,  et al.  Symptoms and patient factors associated with longer time to diagnosis for colorectal cancer: results from a prospective cohort study.  Br J Cancer. 2016;115(5):533-541. doi:10.1038/bjc.2016.221PubMedGoogle ScholarCrossref
    26.
    Walter  FM, Rubin  G, Bankhead  C,  et al.  Symptoms and other factors associated with time to diagnosis and stage of lung cancer: a prospective cohort study.  Br J Cancer. 2015;112(suppl 1):S6-S13. doi:10.1038/bjc.2015.30PubMedGoogle ScholarCrossref
    27.
    Walter  FM, Mills  K, Mendonça  SC,  et al.  Symptoms and patient factors associated with diagnostic intervals for pancreatic cancer (SYMPTOM Pancreatic Study): a prospective cohort study.  Lancet Gastroenterol Hepatol. 2016;1(4):298-306. doi:10.1016/S2468-1253(16)30079-6PubMedGoogle ScholarCrossref
    28.
    Craig  P, Dieppe  P, Macintyre  S, Michie  S, Nazareth  I, Petticrew  M; Medical Research Council Guidance.  Developing and evaluating complex interventions: the new Medical Research Council guidance.  BMJ. 2008;337:a1655. doi:10.1136/bmj.a1655PubMedGoogle ScholarCrossref
    29.
    Manne  S, Lessin  S.  Prevalence and correlates of sun protection and skin self-examination practices among cutaneous malignant melanoma survivors.  J Behav Med. 2006;29(5):419-434. doi:10.1007/s10865-006-9064-5PubMedGoogle ScholarCrossref
    30.
    Smith  S, Fielding  S, Murchie  P,  et al.  Reducing the time before consulting with symptoms of lung cancer: a randomised controlled trial in primary care.  Br J Gen Pract. 2013;63(606):e47-e54. doi:10.3399/bjgp13X660779PubMedGoogle ScholarCrossref
    31.
    Glanz  K, Geller  AC, Shigaki  D, Maddock  JE, Isnec  MR.  A randomized trial of skin cancer prevention in aquatics settings: the Pool Cool program.  Health Psychol. 2002;21(6):579-587. doi:10.1037/0278-6133.21.6.579PubMedGoogle ScholarCrossref
    32.
    Moye  MS, King  SM, Rice  ZP,  et al.  Effects of total-body digital photography on cancer worry in patients with atypical mole syndrome.  JAMA Dermatol. 2015;151(2):137-143. doi:10.1001/jamadermatol.2014.2229PubMedGoogle ScholarCrossref
    33.
    Zigmond  AS, Snaith  RP.  The Hospital Anxiety and Depression Scale.  Acta Psychiatr Scand. 1983;67(6):361-370. doi:10.1111/j.1600-0447.1983.tb09716.xPubMedGoogle ScholarCrossref
    34.
    Ware  J  Jr, Kosinski  M, Keller  SD.  A 12-item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity.  Med Care. 1996;34(3):220-233. doi:10.1097/00005650-199603000-00003PubMedGoogle ScholarCrossref
    35.
    Henson  KE, Elliss-Brookes  L, Coupland  VH,  et al.  Data resource profile: National Cancer Registration Dataset in England  [published online April 23, 2019].  Int J Epidemiol. 2019:dyz076. doi:10.1093/ije/dyz076PubMedGoogle Scholar
    36.
    Walter  FM, Abel  GA, Lyratzopoulos  G,  et al.  Seasonal variation in diagnosis of invasive cutaneous melanoma in Eastern England and Scotland.  Cancer Epidemiol. 2015;39(4):554-561. doi:10.1016/j.canep.2015.06.006PubMedGoogle ScholarCrossref
    37.
    Robinson  JK, Wayne  JD, Martini  MC, Hultgren  BA, Mallett  KA, Turrisi  R.  Early detection of new melanomas by patients with melanoma and their partners using a structured skin self-examination skills training intervention: a randomized clinical trial.  JAMA Dermatol. 2016;152(9):979-985. doi:10.1001/jamadermatol.2016.1985PubMedGoogle ScholarCrossref
    38.
    Aneja  S, Brimhall  AK, Kast  DR,  et al.  Improvement in patient performance of skin self-examinations after intervention with interactive education and telecommunication reminders: a randomized controlled study.  Arch Dermatol. 2012;148(11):1266-1272. doi:10.1001/archdermatol.2012.2480PubMedGoogle ScholarCrossref
    39.
    Weinstock  MA, Risica  PM, Martin  RA,  et al.  Melanoma early detection with thorough skin self-examination: the “Check It Out” randomized trial.  Am J Prev Med. 2007;32(6):517-524. doi:10.1016/j.amepre.2007.02.024PubMedGoogle ScholarCrossref
    40.
    Paddock  LE, Lu  SE, Bandera  EV,  et al.  Skin self-examination and long-term melanoma survival.  Melanoma Res. 2016;26(4):401-408. doi:10.1097/CMR.0000000000000255PubMedGoogle ScholarCrossref
    41.
    Swetter  SM, Pollitt  RA, Johnson  TM, Brooks  DR, Geller  AC.  Behavioral determinants of successful early melanoma detection: role of self and physician skin examination.  Cancer. 2012;118(15):3725-3734. doi:10.1002/cncr.26707PubMedGoogle ScholarCrossref
    42.
    Körner  A, Coroiu  A, Martins  C, Wang  B.  Predictors of skin self-examination before and after a melanoma diagnosis: the role of medical advice and patient’s level of education.  Int Arch Med. 2013;6(1):8. doi:10.1186/1755-7682-6-8PubMedGoogle ScholarCrossref
    43.
    Hall  S, Murchie  P.  Can we use technology to encourage self-monitoring by people treated for melanoma? a qualitative exploration of the perceptions of potential recipients.  Support Care Cancer. 2014;22(6):1663-1671. doi:10.1007/s00520-014-2133-3PubMedGoogle ScholarCrossref
    44.
    Körner  A, Drapeau  M, Thombs  BD,  et al.  Barriers and facilitators of adherence to medical advice on skin self-examination during melanoma follow-up care.  BMC Dermatol. 2013;13:3. doi:10.1186/1471-5945-13-3PubMedGoogle ScholarCrossref
    45.
    Murchie  P, Allan  JL, Brant  W,  et al.  Total skin self-examination at home for people treated for cutaneous melanoma: development and pilot of a digital intervention.  BMJ Open. 2015;5(8):e007993. doi:10.1136/bmjopen-2015-007993PubMedGoogle Scholar
    46.
    Wolf  JA, Ferris  LK.  Diagnostic inaccuracy of smartphone applications for melanoma detection: reply.  JAMA Dermatol. 2013;149(7):885. doi:10.1001/jamadermatol.2013.4337PubMedGoogle ScholarCrossref
    ×