key: cord-0014335-a4bc5rj9 authors: Godden, Amy R.; O’Connell, Rachel L.; Barry, Peter A.; Krupa, Katherine C. D.; Wolf, Lisa M.; Mohammed, Kabir; Kirby, Anna M.; Rusby, Jennifer E. title: 3-Dimensional objective aesthetic evaluation to replace panel assessment after breast-conserving treatment date: 2020-06-19 journal: Breast Cancer DOI: 10.1007/s12282-020-01117-9 sha: cd1351d00a7d258c5047a02fda978013e4960883 doc_id: 14335 cord_uid: a4bc5rj9 BACKGROUND: Two-thirds of patients with early breast cancer undergo breast-conserving treatment (BCT). Aesthetic outcome is important and has long term implications for psychosocial wellbeing. The aesthetic goal of BCT is symmetry for which there is no gold-standard measure. Panel scoring is the most widely adopted assessment but has well-described limitations. This paper describes a model to objectively report aesthetic outcome using measures derived from 3-dimensional surface images (3D-SI). METHOD: Objective measures and panel assessment were undertaken independently for 3D-SI of women who underwent BCT 1–5 years previously. Univariate analysis was used to test for association between measures and panel score. A forward stepwise multiple linear regression model was fitted to identify 3D measurements that jointly predicted the mean panel score. The fitted model coefficients were used to predict mean panel scores for an independent validation set then compared to the mean observed panel score. RESULTS: Very good intra-panel reliability was observed for the training and validation sets (wκ = 0.87, wκ = 0.84). Six 3D-measures were used in the multivariate model. There was a good correlation between the predicted and mean observed panel score in the training (n = 190) and validation (n = 100) sets (r = 0.68, r = 0.65). The 3D model tended to predict scores towards the median. The model was calibrated which improved the distribution of predicted scores. CONCLUSION: A six-variable objective aesthetic outcome model for BCT has been described and validated. This can predict and could replace panel assessment, facilitating the independent and unbiased evaluation of aesthetic outcome to communicate and compare results, benchmark practice, and raise standards. Breast cancer is a common and emotive diagnosis with 54,722 new cases diagnosed in the UK in 2017 [1] Twothirds of women managed surgically for breast cancer undergo Breast-Conserving Treatment (BCT). Aesthetic outcome after BCT has a well-documented influence on patients' psychosocial wellbeing and quality of life [2] [3] [4] [5] [6] [7] [8] [9] [10] . With advancements in treatment and the excellent survival expectations of 90% at 1 year and 80% at 10 years [1] , more women are living with the long-term impact of treatment. Surgeons and clinical oncologists should now focus on excellent long-term aesthetic outcome in addition to excellent disease control. There is no gold standard measure for aesthetic outcome. Patient-Reported Outcome Measures (PROMs) have been used as an aesthetic evaluation method in their own right. However, PROMs lack objectivity and consistently report aesthetic outcome more favourably than panel assessment which highlights the need for an objective method of evaluation of aesthetics in addition to PROMs. Although anthropometric assessment, subjective rating scales, and photographic measurements have all been used to evaluate aesthetic outcome from breast surgery, none has been widely accepted and each comes with its own well-described limitations [11] [12] [13] [14] [15] [16] [17] [18] . The intricacies of aesthetic evaluation are subtle and challenging to articulate and the complexities are reflected in poor agreement between patient, physician, and objective scales [9, 19, 20] . Panel assessment is the most widely accepted technique to measure aesthetic outcome in breast surgery but is inherently biased, costly, time-consuming, and un-standardised. The aesthetic goal of BCT is to achieve or maintain symmetry which is reflected in the most widely adopted scale, the Harvard Cosmesis Scale, developed by Harris et al. in the 1970s [21] . Panellists score symmetry between the breasts using a 4-point Likert scale from 1, which is poor, to 4, which is excellent. Deficiencies shared to a variable extent by all panel scales include lack of responsiveness (ability to distinguish clinically relevant differences), repeatability, and interpretability. 3-Dimensional surface imaging (3D-SI) has the potential to overcome the limitations of alternative methods for evaluating aesthetics. It is simple to use and provides multiple views from one capture including the cranial and caudal views which help visualise projection and the inframammary fold (IMF) (Fig. 1) . It delivers linear measures in addition to breast volume and surface symmetry calculations. These 3D-SI derived measures could replace panel assessment negating the subjective variability, inherent bias, and associated logistical challenges. Objective evaluation of aesthetic outcome is essential for the communication and comparison of results e.g. between current and emerging techniques. It informs us of individual performance and can be used to benchmark performance between centres, regions, and at a national level. Robust reporting methods strengthen the evidence on which to base decisions and guidelines. The aim of this study was therefore to develop an objective aesthetic evaluation model based on measures derived from 3D-SI. The protocol was reviewed and approved by London-Riverside NRES committee [Ref 15/LO/0010] and is available at clinicaltrials.gov [NCT02304614] . The training set was recruited as part of an earlier study and an amendment was granted by NRES to analyse the images for the purpose of this study. The validation set was recruited independently using the same eligibility criteria. Inclusion criteria were women who have had BCT for DCIS or invasive cancer within 1-6 years of study recruitment attending for surveillance mammography. Exclusion criteria included removal of the nipple-areola complex with no reconstruction, symmetrizing surgery, previous ipsilateral or contralateral breast surgery. Eligible potential participants were identified by working consecutively and chronologically through the surveillance mammography register. Invitation to participate was by letter with a follow-up telephone call by a member of the study team to endorse the study. Participants had 3D-SI at the same time as their screening mammogram. The 3D-SIs were scored by an expert panel for the aesthetic outcome and objective measurements were performed independently as described in the sections below. Comparison between objective measures and panel score identified associations, and a model was built based on the relationships in a training set and validated using an independently recruited cohort from the same institution (validation set). The 3D-SIs were captured using VECTRA ® XT (Canfield Scientific) using a pre-defined protocol [22] . Objective measures were derived using Mirror ® software (Canfield Scientific). Validated methods were used to measure volume and surface symmetry which were calculated as an average of three measures [22] . The upper proportion was defined as the proportion of breast above the nipple. Independent measures e.g. Nipple to Sternal Notch (N-SN) distance were presented as the percentage difference between a patient's breasts (%), and comparative measures e.g. surface asymmetry and projection, as absolute values. The Panel comprised three consultant oncoplastic surgeons, a consultant radiation oncologist, and one senior breast care nurse. Panellists were blinded to the patient, operating surgeon and treating radiation oncologist identity. The Harvard cosmesis scale was used to assess AP, oblique, lateral, cranial and caudal views of 3D-SIs. The Harvard scale (1-4) is based upon symmetry: 1 = poor (treated breast seriously distorted), 2 = fair (treated breast clearly different from the untreated breast but not significantly distorted), 3 = good (treated breast slightly different from the untreated breast), and 4 = excellent (treated breast nearly identical to the untreated breast). The Likert scale was available throughout for reference. Individual panellist's scores were recorded before a consensus panel score was agreed by discussion. The mean of the individual panellist's scores was calculated for each image. Ten random images were presented more than once to test for internal consistency in the consensus scores for both the training and the validation set. The same panel was used to validate the model due to the inherent inconsistencies between panels rendering comparison between different panels unreliable. Examples of images from the training set receiving poor, fair, good and excellent scores were shown at the start of the assessment of the validation set to benchmark the panel. The training set was analysed using linear regression models to determine the relationship between each individual measurement and mean observed Harvard panel score. Then, a forward stepwise multiple linear regression model (at p < 0.05 variable inclusion) was fitted to identify the measurements that jointly predicted the mean observed Harvard panel score. The fitted model coefficients (intercept and slopes) were then used to predict panel scores for the validation dataset. The association between the mean observed and predicted panel score was assessed using scatter graphs and the correlation co-efficient (r) reported for both sets separately. Bland-Altman plots were used to assess agreement between mean observed and predicted panel scores and the mean difference and limits of agreement reported. Intra-panel agreement was assessed for repeated images and reported as weighted kappa (wκ) for both sets. 3D-SIs from 190 women were used for the training set and a further 100 women were recruited for the validation set. Clinico-pathological data for both sets were comparable (Table 1) . Surgery was performed between 2009 and 2014 for the training set and 2010 and 2016 for the validation set. The median time (in months) from surgery to participation was 36 (IQR18-49) for the training set and 34 (IQR23-47) for the validation set. The tumour was located in the upper outer quadrant for the majority of women in both groups and most women had a standard wide local excision with no complex tissue rearrangement. All women in the training set and 94% of women in the validation set had adjuvant radiotherapy. The mean pre-operative tumour size (measured on ultrasound) for the training and validation sets was 14 mm and 16 mm, respectively. The median weight of the excision specimen was 32 g in the training set and 44 g in the validation set. Very good intra-panel consistency (wκ = 0.87) was observed for 10 repeated images in the training set, with 7/10 consensus scores agreeing and 3/10 varying by one point. In the validation set, the intra-panel agreement was also very good (wκ = 0.84) with 6/10 consensus scores agreeing and 4/10 varying by one point. A significant relationship was identified between all but one (Nipple-to-Nipple distance) of the 3D-SI-derived measures and the mean panel score. Seven measures were found to be independently associated with mean panel score on multivariate analysis. Six of these variables were included in the multivariate model. The upper proportion difference produced similar measurements to Nipple-to-Sternal Notch (N-SN) distance and was considerably more time consuming to measure so was excluded. A summary of the variables is reported in Table 2 . A good correlation (r = 0.68) was seen between predicted and mean observed panel score for the training set. Bland-Altman analysis demonstrated a mean difference of 0 (95% CI − 0.084 to 0.084) between the observed panel score and the predicted score using the 3D model suggesting no A summary of the mean observed Harvard panel score, predicted panel score (using the multivariate model), and 3D-SI measures for the training and validation set are presented in Table 3 . A good correlation was found between the predicted and mean observed panel score for the validation set (r = 0.65). Bland-Altman analysis demonstrates a mean difference of − 0.055 (95% CI − 0.166: 0.056) between the observed panel score and the predicted score using the 3D model suggesting no bias, with narrow limits of agreement within which 95% of the differences fall (− 1.173 to 1.062). Bland-Altman analysis illustrated that the 3D model overpredicts for lower panel scores, and under predicts for higher panel scores. Histograms corroborate this finding by illustrating a clustering of predicted scores about the median (Fig. 2b) . To improve the spread of predicted scores, the model was calibrated to the mean observed frequency distribution of panel score in the training set. The correlation between the calibrated model and the mean observed panel scores is similar to that of the 3D model (r = 0.67 and 0.69 for the training and validation sets, respectively) (Fig. 3a, b) . Bland-Altman analysis of the calibrated model demonstrated a mean difference of − 0.05 and 0 for the training and validation sets compared to the calibrated model respectively, suggesting no bias, with narrow limits of agreement within which 95% of the differences (Fig. 2) . This is reflected in the broader IQR observed in the calibrated model versus 3D model in Table 4 . The net result is a model that has a very similar correlation and agreement with the observed panel score, with more discrimination between outcomes i.e. scores are not clustered at the median value. In the training set, the calibrated model correctly predicted panel score to within 0.5 points of the mean observed Harvard panel score in 99 (52%), within 1 point in 166 (87%), within 1.5 points in 187 (98%) and all patients within 2 points. In the validation set the calibrated model correctly predicted panel score to within 0.5 points of the mean observed Harvard panel score in 57 (57%), within 1 point in 86 (86%), within 1.5 points in 97 (97%) and all patients within 2 points. In-depth analysis of cases where the model over predicted by more than 1.5 points illustrated focal volume deficits which detract from the overall aesthetic result which may not have been captured by the overall asymmetry score delivered during 3D-SI analysis (Fig. 4) . This paper describes the development of a six-variable objective aesthetic outcome model for Breast-Conserving Treatment (BCT) which can predict and could ultimately replace panel assessment. The model accurately measures and reports aesthetic outcome incorporating evaluation of views unique to three-dimensional photography enabling surface symmetry and projection to be incorporated into the assessment, a potential advantage over 2D images. Many attempts have been made to objectively evaluate the aesthetic outcome of breast surgery, however, each method has its limitations [23, 24] . The Breast Cancer Conservative Treatment. cosmetic results (BCCT.core) model is the most widely cited in the literature [25] [26] [27] [28] . The BCCT.core model evaluates breast asymmetry in two dimensions so measures such as volume, 3D surface symmetry, and projection cannot be evaluated. The breast is a 3-dimensional structure, therefore, is not comprehensively assessed in two dimensions. 3D-SI has the ability to produce volume and shape symmetry measures which have recently been validated in-vivo providing an additional component to objective aesthetic evaluation [22] . Cardoso et al. have recently published results for a 3D version of the BCCT.core model based on the capabilities of Microsoft Kinect. They concluded the addition of the third dimension is not necessary, based on the lack of improvement in the association between model and panel score [29] . The conclusion was based on the addition of a single 3D parameter to BCCT.core, volume symmetry, which was not found to be independently associated with panel score on multivariate analysis in our study. Additional capabilities of 3D measures were not included, such as surface symmetry and projection, so the conclusion was perhaps drawn upon an oversimplified application of 3D technology. Another advantage of the 3D model described in this paper is that it produces a score on a continuous scale, enabling more detailed feedback on performance i.e. a score of 2.4 or 1.5 Fig. 3 Scatter plots illustrating the correlation between the observed Harvard panel score and the Calibrated Model for the training set (a) and the validation set (b). Correlation co-efficient r = 0.67 and 0.69 respectively would be delivered rather than a score of 2, which would be the rounded score for both. Clinicians and patients may have divergent views of what constitutes a good aesthetic outcome. Potter et al. outlined a core outcome set for breast reconstruction based on Delphi methodology in which 'patient satisfaction with cosmetic outcome' was rated highly amongst medical professionals and patients alike [30] . Patient-Reported Outcome Measures (PROMs) are clearly the most important evaluation of aesthetic outcome but lack objectivity, are affected by the treatment path leading to the final outcome and are consistently discordant from professional assessment, being frequently reported more favourably [9, [31] [32] [33] . Dahlbäck et al. have recently emphasised the importance of PROMs in aesthetic evaluation demonstrating a stronger predictive ability for longer-term health-related quality of life as compared to objective measures or panel assessment [9] . The objective model described in this paper is not designed to replace PROMs, and PROMs cannot obviate the need for an objective model designed to produce an independent and unbiased evaluation of aesthetic outcome. The two methods of aesthetic evaluation must co-exist, and development into a combined outcome set for BCT may be considered a further area of study. A very good intra-panel agreement using the Harvard scale (wκ = 0.87, wκ = 0.84 for test and validation sets respectively) is reported. However, the reported internal consistency of panel assessment is variable in the literature illustrating one of the limitations of this evaluation method [9, 26, 32, 34, 35] . Even when panellists were selected from a group of experts based upon the agreement of their previous scores with the consensus opinion, their individual Harvard score switched category to match consensus 30% of the time [27] . The logistics of arranging a panel assessment are complex and inefficient both in terms of time and cost. Objective assessment using 3D-SI can be performed on a case by case basis with greater flexibility and a greatly reduced time and resource burden. The surface asymmetry measure in Mirror ® gives an average over the entire breast surface (root mean squared), thereby giving a representative result when there is global surface asymmetry or surface asymmetry affecting a moderate area of the breast. However, for very small areas of volume deficit in an otherwise symmetrical breast, the focal surface asymmetry will be countered by the remaining global surface symmetry, so can be 'hidden' in the measure. The ability measure and report upon a focal volume deficit is an area for development which may help to refine the accuracy of the model in the small subset of patients affected by this. To improve the applicability into everyday practice, the software requires development to enable automated calculation of the outcome score. In addition, there is some difficulty imaging women with very large volume breasts and on occasion the lateral view is cropped to the mid-axillary line to enable capture of the anterior contour of the breasts. The automatic placement of surface landmarks is less reliable for larger breasts and moderate ptosis, sometimes requiring manual adjustment or placement, which decreases the efficiency of measuring. However, manually placing landmarks is still very quick and the software provides diagrams to guide placement so prior training is not essential. The model was based upon and tested against a clearly defined method of expert panel assessment with very-good internal consistency, a large dataset of 3D-SIs and included an independently recruited cohort for validation. Validation at a different centre, or within a prospectively-collected cohort is an area for future work. A prospective study would also eliminate selection bias. For now, it is encouraging that the median Q-score for "satisfaction with breasts " for the training set using the BREAST-Q BCT module was 68 (IQR 55-80) out of 100, where 100 is best. This is concordant with other contemporary analyses where the median Q-scores 3-6 years after surgery ranged from 65 to 68 [9] . It may be possible to extend the principle used within this study to women who have undergone breast reconstruction, however, a large multicenter study would be required to generate a 3D-SI library large enough to reflect the diversity in practice in the UK. Survivorship is a rapidly expanding area of interest, and continued development of portable, cheaper 3D capture systems has the potential to revolutionise aesthetic evaluation by the integration of 3D-SI into research and clinical practice. The psychological impact of immediate rather than delayed breast reconstruction Effect of esthetic outcome after breast-conserving surgery on psychosocial functioning and quality of life Breast reconstruction at a district general hospital Immediate breast reconstruction after mastectomy for cancer Body image, self concept, and self-esteem in women who had a mastectomy and either wore an external breast prosthesis or had breast reconstruction and women who had not experienced mastectomy. Health Care for Women International Effect of cosmetic outcome on quality of life after breast cancer surgery Long-term results of oncoplastic breast surgery with latissimus dorsi flap reconstruction: a pilot study of the objective cosmetic results and patient reported outcome Aesthetic outcome following breast-conserving surgery assessed by three evaluation modalities in relation to health-related quality of life Cosmetic outcome and quality of life are inextricably linked in breast-conserving therapy Reporting clinical outcomes of breast reconstruction: a systematic review Practical do-it-yourself device for accurate volume measurement of breast A simple means for accurate breast volume determination Measurement of breast volume with thermoplastic casts Mammographic determination of breast volume: comparing different methods The accuracy of breast volume measurement methods: a systematic review Breast retraction assessment: an objective evaluation of cosmetic results of patients treated conservatively for breast cancer Cosmetic evaluation of breast conserving treatment for mammary cancer. 1. Proposal of a quantitative scoring system Proposal for a gold standard for cosmetic evaluation after breast conserving therapy: results from the St George and Wollongong Breast Boost trial Cosmetic and functional outcomes of breast conserving treatment for early stage breast cancer. 1. Comparison of patients' ratings, observers' ratings, and objective assessments Analysis of cosmetic results following primary radiation therapy for stages I and II carcinoma of the breast Validation of the Vectra XT three-dimensional imaging system for measuring breast volume and symmetry following oncological reconstruction Assessment of cosmesis after breast reconstruction surgery: a systematic review Systematic review: aesthetic assessment of breast reconstruction outcomes by healthcare professionals Towards an intelligent medical system for the aesthetic evaluation of breast cancer conservative treatment Turning subjective into objective: the BCCT. core software for evaluation of cosmetic results in breast cancer conservative treatment Is face-only photographic view enough for the aesthetic evaluation of breast cancer conservative treatment? Comparing two objective methods for the aesthetic evaluation of breast cancer conservative treatment The value of 3D images in the aesthetic evaluation of breast cancer conservative treatment. Results from a prospective multicentric clinical trial Development of a core outcome set for research and audit studies in reconstructive breast surgery Aesthetics in breast conserving therapy: do objectively measured results match patients' evaluations? Objective assessment of aesthetic outcome after breast conserving therapy: subjective third party panel rating and objective BCCT.core software evaluation Early breast cancer: cosmetic and functional results after treatment by conservative techniques Validation of the methods of cosmetic assessment after breast-conserving therapy in the EORTC "boost versus no boost" trial. EORTC Radiotherapy and Breast Cancer Cooperative Groups. European Organization for Research and Treatment of Cancer Cosmetic outcome assessment following breast-conserving therapy: a comparison between BCC.Tcore software and panel evaluation Conflict of interest Miss Godden declares that she has no conflict of interest. Miss O'Connell declares that she has no conflict of interest. Mr Barry declares he has no conflict of interest. Miss Krupa declares that she has no conflict of interest. Mrs Wolf declares that she has no conflict of interest. Mr Mohammed declares he has no conflict of interest. Dr Kirby declares she has no conflict of interest. Miss Rusby declares she has no conflict of interest.Ethical approval All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.