key: cord-1033383-qe8ecgbm
authors: Jones, Leah; Jameson, Michael; Oakley, Amanda
title: Remote Skin Cancer Diagnosis: Adding Images to Electronic Referrals Is More Efficient Than Wait-Listing for a Nurse-Led Imaging Clinic
date: 2021-11-20
journal: Cancers (Basel)
DOI: 10.3390/cancers13225828
sha: eba55218e028de72937ec0f9a8f34e547e185e06
doc_id: 1033383
cord_uid: qe8ecgbm

SIMPLE SUMMARY: Skin cancer is a significant cause of death and disability, particularly in New Zealand. Expert diagnosis reduces unnecessary excision of benign lesions, reduces patient anxiety, and allows early identification of skin cancer, particularly of melanoma. The study assessed an electronic referral pathway for teledermatology—diagnosing skin lesions remotely using a standardised template with regional, close-up, and dermoscopic images—and compared this to scheduled nurse-led teledermoscopy clinics. A dermatology opinion was reached more rapidly with comparable efficacy when referrals include good quality images, compared to nurse-led imaging clinics. ABSTRACT: We undertook a retrospective comparison of two teledermatology pathways that provide diagnostic and management advice for suspected skin cancers, to evaluate the time from referral to diagnosis and its concordance with histology. Primary Care doctors could refer patients to either the Virtual Lesion Clinic (VLC), a nurse-led community teledermoscopy clinic or, more recently, to the Suspected Skin Cancer (SSC) pathway, which requires them to attach regional, close-up, and dermoscopic images. The primary objective of this study was to determine the comparative time course between the SSC pathway and VLC. Secondary objectives included comparative diagnostic concordance, skin lesion classification, and evaluation of missed skin lesions during subsequent follow-up. VLC referrals from July to December 2016 and 2020 were compared to SSC referrals from July to December 2020. 408 patients with 682 lesions in the VLC cohort were compared with 480 patients with 548 lesions from the 2020 SSC cohort, matched for age, sex, and ethnicity, including histology where available. Median time (SD) from referral to receipt of teledermatology advice was four (2.8) days and 50 (43.0) days for the SSC and VLC cohorts, respectively (p < 0.001). Diagnostic concordance between teledermatologist and histopathologist for benign versus malignant lesions was 70% for 114 lesions in the SSC cohort, comparable to the VLC cohort (71% of 122 lesions). Referrals from primary care, where skin lesions were imaged with variable devices and quality resulted in faster specialist advice with similar diagnostic performance compared to high-quality imaging at nurse-led specialist dermoscopy clinics.

Skin cancer prevalence is increasing in association with an ageing population with sun-damaged skin [1] . New Zealand has one of the highest rates of melanoma in the world, due to high ultraviolet intensities in the Southern Hemisphere during summer and high proportion of the population with fair skin [2, 3] . It has an age-standardised incidence of 30-50 per 100,000 [4, 5] . The incidence of basal cell carcinoma (BCC) and squamous cell carcinoma (SCC) is harder to evaluate, given that these are not required to be reported

The objectives of this retrospective study were to assess the efficacy and efficiency of direct teledermoscopy via GP electronic referral to the SSC pathway in comparison to the VLC pathway. The primary objective was to compare the time from receipt of the referral to return of the Dermatologist advice. Secondary objectives were, firstly, to determine diagnostic concordance between GP and dermatologist (and histology if available) between the SSC 2020 cohort and VLC cohorts from 2020 and 2016, and secondly, the identification of any incidental suspected skin cancers found during follow-up specialist appointments.

The Health and Disabilities Committee (HDEC) of New Zealand determined the study to be a service review and therefore out of scope for formal ethics approval (22 December 2020) .

We undertook a retrospective review to compare outcomes of referrals for possible skin cancer to either the VLC or SSC pathway in 2020 or the VLC in 2016. As there was a reduction in referral numbers during the first four months of 2020, due to healthcare interruptions related to COVID-19, we chose to evaluate referrals received 1 July-31 December in 2016 and 2020 for consistency.

Referrals were identified by searching departmental records. For the 2020 SSC and VLC cohorts, the keywords 'lesion' and 'skin cancer' were used; for the 2016 VLC cohort a unique coding identifier was used. Referrals for reasons other than a suspected skin cancer were excluded.

From the 2020 SSC referrals, 2020 VLC and 2016 VLC referrals, we determined the number of referrals, the time from referral to advice, the number of lesions per referral, and patient demographics-including age, sex, ethnicity, and whether urban, rural, or semirural residence-based on the Statistics New Zealand Urban Accessibility Classification [23] . For the SSC pathway cohort, we recorded data on image quality. Propensity score matching was used to create a subset of the 2020 SSC pathway cohort matched for age, gender, and ethnicity to those in the 2016 VLC cohort. This was used to obtain data on time to definitive management, lesion histology, and additional lesions of concern during specialist review.

We classified skin lesions as benign, malignant, or pre-malignant, recorded the specific diagnosis, and determined the diagnostic concordance between GP, dermatologist, and histology report, along with the management advice, the time to definitive treatment, and the number of incidental lesions identified at related in-person specialist appointments (Appendix A).

For the benign/malignant classification, a diagnosis was concordant if the GP or teledermatologist's diagnosis (or in the case of multiple diagnoses, the first diagnosis) was classified in the same group (benign, malignant, pre-malignant) as histology where available, otherwise in the same group as the teledermatologist's diagnosis in the case of GP-dermatologist concordance. For the specific diagnosis, this was deemed completely concordant if the GP or teledermatologist only provided one diagnosis and this was the same as the histology diagnosis. A diagnosis was partially concordant if more than one diagnosis was provided by the GP or teledermatologist and one of those was the same as the histology. If a diagnosis was not provided or was labelled uncertain by the GP or teledermatologist, this was deemed not concordant.

Statistical analysis was performed using Microsoft Excel (2016, version 16.0.4591.1000, Microsoft, Redmond, WA, USA) and IBM SPSS Statistics (version 26, IBM, Armonk, NY, USA) software. The chi-squared test was used for comparison of categorical variables between groups. One-way analysis of variance (ANOVA) was used for comparison of continuous variables. A two-sided p-value of < 0.05 was used to determine statistical significance.

Between 1 July and 31 December 2016, 481 patients were referred to the VLC, of whom 400 patients with 682 lesions were eligible for analysis. In the period 1 July to 31 December 2020, 1307 patients of 1495 referred to the SSC pathway, and 108 patients (with 277 lesions) of 134 referred to the VLC, were eligible for analysis ( Figure 1 ). 1307 met the eligibility criteria. Propensity score matching of the SSC cohort to the 2016 VLC cohort identified 481 patients with 548 lesions from the SSC cohort. Patient characteristics are detailed in Table 1 . Patients in the total SSC group had a mean age of 61 years compared to 59 years for the 2020 VLC group and 55 years for the 2016 VLC group (p < 0.001) ( Table 1 ). There was a slight female preponderance (56%, 59%, and 64% respectively). Ethnicity was predominantly Caucasian with 84% New Zealand European in the SSC pathway total cohort, 78% in the SSC matched cohort, 74% in 2020 VLC cohort and 79% in 2016 VLC group. Maori ethnicity was claimed by 6%, 11% and 7% respectively. Analysis of patient and referrer location revealed a similar proportion of rural patients in all groups, however there was a larger portion of patients located semi-rurally in the 2020 VLC (60% for patients and 62% for referrers, p < 0.01) and 2016 VLC cohorts (42% for patients and 44% for referrers, p = 0.1, p = 0.02), compared to 37% for patients and 36% for referrers in the total SSC pathway group.

A group of 45 patients were lost to follow-up after receiving teledermatologist advice (19 (4%) in SSC matched cohort, 13 (12%) in the 2020 VLC cohort and 13 (3%) in the 2016 cohort). In the total SSC group, 71 lesions (5%) were unable to be diagnosed due to poor image quality. Another 115 lesions (9%) were able to be diagnosed but the images were noted by the dermatologist to be of poor quality (Table 2 ). Diagnostic and management advice was provided by two teledermatologists in 2020 and by three in 2016 time period; one was common to both time periods. Median time from referral to teledermatologist advice was 4 days (range 0-19) in the SSC pathway total cohort. For the VLC cohorts, the median time to advice was 42 days (range 16-184) in 2020 and 50 days (range 17-313) in 2016 (p < 0.001) ( Table 3) . Waiting time for a clinic appointment was the rate-limiting factor, with a median time of 26 days (range 0-173) in 2020 and 43 days (range 1-308) in 2016. The time from advice to definitive treatment (e.g., excision, in-person review) was 21.5 days in the SSC pathway cohort compared to 45 days in the 2020 VLC cohort and 60 days in the 2016 cohort. This increases to 94 days and 112 days for the 2020 and 2016 VLC cohorts respectively when calculating time from acceptance of the referral to treatment. Skin lesions were classified as benign or malignant and by specific diagnosis (Table 4 , Figures 2 and 3 ).

In the SSC pathway matched cohort, the teledermatologist recorded benign lesions in 65%, with a benign-to-malignant ratio of 3.0, compared to a benign-to-malignant ratio of 1.3 for GP (Table 4 ).

In the 2020 and 2016 VLC cohorts, the teledermatologist recorded benign lesions in 64% and 67%, and benign-to-malignant ratio of 3.4 and 3.8 respectively, compared to 1.7 and 0.8 for GP (Table 4) .

Analysis of histology of malignant lesions revealed a keratinocytic-to-melanocytic ratio of 1.8 in the SSC matched cohort, 1.2 in the 2020 VLC cohort and 3.4 in the 2016 cohort ( Table 5 ). Analysis of melanomas revealed a melanoma-in-situ-to-invasive melanoma ratio of 3.7 in the SSC matched cohort and 2.0 and 2.3 for the 2020 VLC and 2016 VLC cohorts respectively (Table 5 ). In the SSC pathway matched cohort, the teledermatologist recorded benign lesions in 65%, with a benign-to-malignant ratio of 3.0, compared to a benign-to-malignant ratio of 1.3 for GP (Table 4 ).

In the 2020 and 2016 VLC cohorts, the teledermatologist recorded benign lesions in 64% and 67%, and benign-to-malignant ratio of 3.4 and 3.8 respectively, compared to 1.7 and 0.8 for GP (Table 4) .

Analysis of histology of malignant lesions revealed a keratinocytic-to-melanocytic ratio of 1.8 in the SSC matched cohort, 1.2 in the 2020 VLC cohort and 3.4 in the 2016 cohort ( Table 5 ). Analysis of melanomas revealed a melanoma-in-situ-to-invasive melanoma ratio of 3.7 in the SSC matched cohort and 2.0 and 2.3 for the 2020 VLC and 2016 VLC cohorts respectively (Table 5 ). No further management was recommended by the dermatologist for 56%, 57%, and 69% of matched SSC pathway, 2020 VLC and 2016 VLC cohorts respectively (Table 6) . Surgical management with either biopsy or excision was recommended for 26% of lesions in the matched SSC group compared to 16% in the 2020 VLC and 16% in the 2016 VLC groups (p < 0.001). In-person review was more common in the VLC cohorts at 7% in 2020 and 5% in 2016, compared to 0% in the SSC pathway. No further management was recommended by the dermatologist for 56%, 57%, and 69% of matched SSC pathway, 2020 VLC and 2016 VLC cohorts respectively (Table 6) . Surgical management with either biopsy or excision was recommended for 26% of lesions in the matched SSC group compared to 16% in the 2020 VLC and 16% in the 2016 VLC groups (p < 0.001). In-person review was more common in the VLC cohorts at 7% in 2020 and 5% in 2016, compared to 0% in the SSC pathway. GP-dermatologist diagnostic concordance was available for 528 lesions in the SSC matched cohort, 172 lesions in the 2020 VLC cohort and 601 lesions in the 2016 VLC cohort ( Table 7 ). The concordance for the benign/malignant classification was 58%, 22%, and 32% for the SSC, 2020 VLC and 2016 VLC cohorts, respectively (p < 0.001). Concordance for the specific diagnosis was 46% (35% complete, 11% partial), 31% (22% complete, 9% partial), and 24% (17% complete, 7% partial) for the SSC, 2020 VLC and 2016 VLC cohorts, respectively (p < 0.001). Histology was available for 114 lesions in the SSC pathway matched cohort, 32 lesions in the 2020 VLC cohort, and 122 lesions in the 2016 cohort (Table 7) .

For the SSC pathway cohort, dermatologist-histology concordance was 70% for benign/malignant classification, whereas GP-histology concordance was 60% (p = 0.01). Dermatologist-histology concordance for specific diagnosis was 66% (53% complete, 13% partial), compared to GP-histology concordance of 48% (40% complete, 8% partial) (p < 0.001).

For the 2020 VLC cohort, dermatologist-histology concordance was 63% for benign/malignant classification, compared to 12% for GP-histology concordance (p = 0.21). Dermatologist-histology concordance for specific diagnosis was 65% (59% complete, 6% partial), whereas GP-histology concordance was 12% (6% complete, 6% partial) (p = 0.73).

For the 2016 VLC cohort, dermatologist-histology concordance was 71% for benign/malignant classification compared to GP-histology concordance of 49% (p = 0.001). Dermatologist-histology concordance was 57% for specific diagnosis (57% complete, 0% partial) compared to GP-histology concordance of 46% (41% complete, 5% partial) respectively (p = 0.03).

The benign/malignant dermatologist-histology concordance was similar between the SSC pathway and 2016 VLC cohorts at 70% and 71% respectively. Non-concordant results for specific diagnoses were 34% in the SSC cohort and 43% in the 2016 VLC cohort (p < 0.001). There were 11 lesions overall (4%) that were identified as being likely benign by dermatologists and malignant by histology with four (4%) in the matched SSC pathway, two (6%) in 2020 VLC and five (4%) in 2016 VLC cohorts. The teledermatology recommendation was 'no further management' for two of these lesions, 'monitoring' for one lesion, 'topical therapy' for one lesion, 'excision/biopsy to remove doubt', and 'in-person review' for two lesions.

A public hospital specialist Dermatology or Plastic Surgery outpatient appointment for a study lesion was made for 156 patients (41 in the matched SSC pathway cohort, 24 in the 2020 VLC cohort and 91 in the 2016 cohort). A mean of 0.2 incidental lesions of concern were identified (0.2, 0.0, and 0.2 in SSC pathway, 2020 VLC and 2016 VLC cohorts, respectively) (Tables S1 and S2). Eight out of 11 lesions (73%) were malignant on histology in the SSC pathway cohort, with a keratinocytic to melanocytic ratio of 3.0. The 2016 VLC cohort was found to have 6 out of 16 lesions (38%) malignant and a keratinocytic to melanocytic ratio of 1.0.

The VLC nurse specialists identified 107 incidental lesions in patients attending imaging clinics (78 in 2016 and 29 in 2020). Histology was available for 26 lesions in the 2016 VLC cohort with a benign-to-malignant ratio of 0.2 and 11 lesions in the 2020 VLC cohort with a benign-to-malignant ratio of 0.0 (Table S3) .

Good quality teledermatology and teledermoscopy allow effective skin lesion diagnosis and management [24] . Electronic referrals from primary to secondary care are increasingly used by district health boards in New Zealand. Availability of outpatient appointments for patients with suspected skin cancer is outstripped by the number of referrals to dermatology; other sites may offer remote advice, hold dedicated clinics, or forward referrals to a surgical specialty. The use of teledermatology worldwide increased during 2020 due to the COVID-19 pandemic compared to few sites using it in 2016. We have compared GP referrals to our SSC pathway, where images of mixed quality were taken using various devices, to our nurse-led VLC, where uniformly high-quality images were taken with standardized cameras.

The study has met our primary objective to demonstrate a statistically significant reduction in time to dermatologist advice using the SSC pathway in 2020 compared to the VLC in 2016 and 2020, with a median time from referral to advice of 4 days compared to 42 days and 50 days, respectively (p < 0.001). The longer time to advice included waits due to missed or rescheduled appointments. This is comparable to a US teledermatology service, where the time to advice was reduced from 70 days when using in-person clinic assessments to 0.5 days when using electronic referrals [21] . There was also a reduction in time to definitive treatment when using the SSC pathway compared to the 2016 and 2020 VLC, both for time from referral assessment (or triage for patients referred to the VLC) and for the time from dermatologist advice to treatment. This is likely explained by the differences in how advice is managed in each pathway, with GPs arranging excisions in the SSC pathway. This can lead to excision of lesions of concern within a few days to weeks in the private sector. In contrast, lesions requiring excision identified at VLC are referred to plastic surgery or dermatology at the hospital with longer wait times. The Standards of Service Provision for Melanoma Patients in New Zealand (2014) recommended "patients referred with a high suspicion of melanoma receive their first cancer treatment within 62 days of receipt of referral" [25] . A large retrospective study by Conic et al. showed improved survival in patients treated within 90 days for melanoma stages I-III and improved survival for patients treated within 30 days for stage I melanoma [26] . The reduction in time to treatment by a median of 62.5 days and 90.5 days compared to 2020 VLC and 2016 VLC are likely to significantly improve the proportion of patients meeting these standards.

The higher proportions of melanoma-in-situ found in the SSC pathway matched cohort compared to the 2016 VLC cohort were striking. We suspect that the rapid response to referrals in the SSC pathway allowed GPs to get a second opinion on lesions they would have otherwise managed independently. The total referral numbers for 2020 SSC pathway were significantly higher than for the 2016 VLC and the GP benign-to-malignant ratio in the SSC pathway matched cohort was higher at 1.3 compared to 0.8 in the 2016 VLC. This also hints at a lower threshold for referral.

Interpretation is complicated by differing rates of diagnostic uncertainty in the referrals: the SSC pathway template required the GP to select a suspected diagnosis (including an option, 'uncertain' in 20%), but this was not required for referrals to the VLC in 2016 where any referral without a diagnosis was deemed uncertain (42%).

The histology benign-to-malignant ratio was higher in the SSC pathway matched cohort (0.6) than the 2016 VLC cohort (0.2). This could indicate that dermatologists were conservative in diagnosing SSC pathway lesions due to some images of inferior quality. It is important to note that both ratios are very low. A recent systematic review estimated the number-needed to biopsy to find one melanoma for global dermatologists to be 7.5 [27] . In our study, the number needed to biopsy for melanoma was 4.2 in the SSC pathway cohort and 6.1 in the 2016 VLC cohort, despite including keratinocytic skin cancers. This raises the concern of missed melanoma. The high ratio of melanoma-in-situ to melanoma indicating enhanced early diagnosis of melanoma through the SSC pathway, reduces this possibility. Conversely, given these higher rates of melanoma-in-situ in the 2020 SSC pathway cohort, we need to be mindful of the possibility of overdiagnosis. The natural history of melanomain-situ is still not completely established [28] . Studies with high melanoma-in-situ excision rates or those assessing skin cancer screening, have frequently failed to show a mortality benefit [28, 29] . In addition, the considerable variability in histopathologist classification of melanoma-in-situ versus atypical naevus further complicates this assessment [30] . There is currently no consensus on the best way to manage the risk of overdiagnosis, whilst still ensuring early treatment of invasive melanoma. Perhaps better education in skin lesion assessment will lead to improvements in this area.

Dermatologists recommended 'no further action' for fewer lesions in the SSC pathway cohort (56%) and 2020 VLC cohort (57%), compared to the 2016 VLC cohort (69%). They more frequently recommended surgery (by 10%), monitoring (4%), and topical treatment (3%) in the SSC pathway compared to 2016 VLC. This may reflect reduced confidence due to the inferior quality of the teledermatology images or the dermatologists' individual practices, with only one out of three diagnosing the 2016 cohort also diagnosing in 2020. In the 2020 VLC group, the main increases were 5% increased monitoring (due to more immunosuppressed and transplant patients requiring surveillance), 6% increased topical treatment, and 2% more in-person review. The rates of surgical treatment were the same as in 2016 at 16%.

The SSC pathway dermatologist-histology diagnostic concordance for benign/malignant of 70% and the 2016 VLC of 71% are consistent with a systematic review of 21 studies in which teledermatologist-histology concordance was 51-85% [31] . There was a slight improvement in overall concordance for specific diagnoses in the SSC pathway cohort at 66% (53% complete, 13% partial), compared to 2016 VLC at 57% (57% complete, 0% partial). Partial SSC pathway concordance reflects a lack of confidence in lesions of poor quality.

One potential problem encountered when calculating concordance is the ambiguity among histopathologists, dermatologists, and GPs regarding classification of some lesions, particularly atypical naevus and melanoma-in-situ (one is benign and the other malig-nant) [32] . SCC-in-situ was categorised as pre-malignant and SCC as malignant, so clinician classification as the former and pathologist classification as the latter would be discordant; in practice, both diagnoses would be managed similarly. These classification differences may have increased non-concordance between dermatologist and histology.

The average age of patients in the total SSC pathway cohort was 6 years older than in the 2016 VLC cohort; this is only partially explained by an aging population in the Waikato area. Statistical data from NZ stats show the median age of the Waikato region to be 37.6 years in 2013 and 38.2 years in 2018 [33] . The convenience of the SSC referral method may encourage GPs to refer a greater proportion of older patients, as has been found in other studies [18, [34] [35] [36] . A higher proportion of 2020 VLC referrals were from semi-rural locations compared to 2020 SSC pathway and 2016 VLC. This suggests that GPs in these locations have less access or familiarity with dermoscopy.

New Zealand Europeans made up the majority of patients referred to the SSC pathway and 2016 VLC. Only 6% and 7% of patients referred to the SSC pathway and to the 2016 VLC respectively were Maori, whereas the total proportion of Maori in the Waikato region was 21% in 2018, likely reflecting lower rates of skin cancer associated with darker skin types [33] .

The dermatologists indicated that the large majority of referrals to the SSC pathway had images of adequate quality (86%); poor quality was usually associated with lack of dermoscopic images, images out of focus, and, less often, lack of macroscopic images. Other reasons for poor quality included excessive blood/hair or insufficient gel used for dermoscopy images. Melanoma diagnosis requires high quality macroscopic and dermoscopic images to diagnose confidently. A systematic review assessing the use of smartphones to detect melanoma reported that up to 20% of images were of insufficient quality for diagnosis [37] . A randomised controlled trial assessing smartphone images with dermoscopy in participants without healthcare training found 5% were inadequate for diagnosis [38] .

Not all patients referred to a dermatologist with a skin cancer have had a full skin check by a competent health professional. Patients with one skin cancer are likely to have others [39] [40] [41] . We reviewed the small subset of patients who had a related in-person assessment by a hospital plastic surgeon or dermatologist: incidental lesions were identified in 11 patients (27%) in the matched SSC pathway cohort, 2 patients (8%) in the 2020 VLC cohort, and 22 patients (24%) in the 2016 VLC cohort with histology available for few of these lesions (11, 2, and 16 respectively). We can extrapolate that many of the patients diagnosed with skin cancer through the SSC pathway will have had other significant lesions.

Limitations: The majority of skin lesions in 2020 were assessed by the SSC pathway. Only those in which the GP did not provide images or images were deemed inadequate were seen in VLC. This cohort has a potential selection bias for lesions that were more difficult to diagnose or were more likely to be malignant that may explain a lower diagnostic concordance in 2020 VLC compared to the SSC pathway. This could potentially be an issue, to a lesser extent in the 2016 VLC, if referrers had a higher threshold for referral. Low numbers and non-significant p-value may also reflect the small sample size. Histology reviews were limited to biopsies requested by the dermatologists; we did not look for histology of any lesion that the teledermatologist had not indicated should be excised and thus we did not calculate a false negative rate. Some SSC referrals were missed due to misleading referral description on manual searching. Follow-up time was limited to 4 months after the 2020 cohorts, excluding 19% of the 2020 VLC cohort as they had not yet received a planned outpatient appointment or surgical procedure. This compares to 17% of the 2016 VLC cohort that did not attend. For the matched SSC pathway cohort, histology was unavailable for 27 lesions (19% of those planned for excision), compared to the 2016 VLC cohort where histology was not found for 8 lesions (6%).

We found that referrals for skin lesions imaged in primary care with variable devices and image quality results in faster dermatologist advice with similar diagnostic performance, compared to referrals to nurse-led specialist clinics where there is consistently high-quality imaging. Use of the SSC pathway encourages early referral and diagnosis of atypical melanocytic lesions. Detection of incidental lesions in some of the skin cancer patients seen in-person is a reminder to encourage full skin examination and a low threshold for referral of suspicious lesions. Improved diagnostic performance through the SSC pathway could be achieved by more consistent adherence to the imaging requirements of the SSC referral pathway. Our results support increased uptake of teledermatological solutions in skin lesion assessment. This will be important as support tools offering augmented intelligence are integrated into clinical practice in the future. The lack of in-person lesion evaluation by dermatologists creates a burden on primary care to undertake skin checks and identify suspicious lesions requiring a second opinion.

Population Pyramids of the World from 1950 to 2100

Selected Cancers

Possible causes and comparisons with Australia and the northern hemisphere

The growing burden of invasive melanoma: Projections of incidence rates and numbers of new cases in six susceptible populations through 2031

Melanoma in Maori, Asian, and Pacific peoples in New Zealand

Incidence, demographics and surgical outcomes of cutaneous squamous cell carcinoma diagnosed in Northland

The burden of non-melanoma skin cancers in Auckland

Health Workforce New Zealand Dermatology Workforce Service. Ministry of Health NZ

Population of Waikato DHB

Teledermatology in the times of COVID-19-A systematic review

Successful triage of patients referred to a skin lesion clinic using teledermoscopy (IMAGE IT trial)

Better, sooner, more convenient: A successful teledermoscopy service

Proceedings of the Waikato Clinical Campus Biannual Research Seminar

E-referrals and teledermatoscopy grading for melanoma: A successful model of care

Successful melanoma triage by a virtual lesion clinic (teledermatoscopy)

Mobile teledermatology is here to stay

Pandemic pressure: Teledermatology and health care disparities

Teledermatology addressing disparities in health care access: A review

The use of teledermoscopy in the accurate identification of cancerous skin lesions in the adult population: A systematic review

Results of a multicentre study on 43 pigmented skin lesions

Creation of an internal teledermatology store-and-forward system in an existing electronic health record: A pilot study in a safety-net public health and hospital system

Impact of dermatology eConsults on access to care and skin cancer screening in underserved populations: A model for teledermatology services in community health centers

Urban Rural Profile Categories

Teledermatology for diagnosing skin cancer in adults

Standards of Service Provision for Melanoma Patients in New Zealand-Provisional

Determination of the impact of melanoma surgical timing on survival using the National Cancer Database

Evaluation of the Number-Needed-to-Biopsy Metric for the Diagnosis of Cutaneous Melanoma. A Systematic Review and Meta-analysis

Overdiagnosis of melanoma-Causes, consequences and solutions

Dermoscopy and overdiagnosis of melanoma in situ

Pathologists' diagnosis of invasive melanoma and melanocytic proliferations: Observer accuracy and reproducibility study

Teledermatology for the diagnosis and management of skin cancer: A systematic review

The "dysplastic nevus" conundrum: A look back, a peek forward

Grouped Total Responses), for Census Usually Resident Population Counts

Use of teledermatology to improve dermatological access in rural areas

Teledermatology via a social networking web site: A pilot study between a general hospital and a rural clinic

Feasibility and cost of a medical student proxy-based mobile teledermatology consult service with Kisoro, Uganda, and Lake Atitlán

Use of Smartphones for Early Detection of Melanoma: Systematic Review

Accuracy of mobile digital teledermoscopy for skin self-examinations in adults at high risk of skin cancer: An open-label, randomised controlled trial

Increased risk of second primary cancers after a diagnosis of melanoma

Development of multiple-lesion basal cell carcinoma of the skin: A comprehensive review

The incidence and clinical analysis of non-melanoma skin cancer

The Waikato District Health Board dermatologists and registrars for their contribution to the research and skin triage pathways.

Jones and Jameson have no conflict of interest to declare. Oakley has two conflicts to declare. Amanda Oakley is paid a consultation fee for diagnosing private patients for MoleMap New Zealand, the provider of the VLC service. She was not paid a consultation fee for diagnosing cases for the VLC, as this was part of her hospital commitment. Until December 2019, Amanda Oakley was a board member of Waikato Medical Research Foundation (WMRF) and on the Grants Committee. She was no longer in these positions when an application for funding was submitted. The funder had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

The following are available online at https://www.mdpi.com/article/10 .3390/cancers13225828/s1, Table S1 : Patient demographics of incidental lesions during specialist follow-up, Table S2 : Incidental lesions during specialist follow-up, Institutional Review Board Statement: Ethical review and approval were waived for this study by the Health and Disability Ethics Committees with formal acknowledgement 22 December 2020, due to the study being an audit or related activity and not involving the use of human tissue without consent.

All patients attending the Virtual Lesion Clinic consented to the use of their data. The majority of patients referred to the eTriage system consented for their images to be used for research and audit. However, the data used for this study did not evaluate images. Patient consent was waived due to the use of retrospective, de-identified information from the healthcare database.

Original data for this study is retained on a protected District Hospital Server. The authors have not prepared a dataset suitable for a public archive.