key: cord-0827893-h6wpiby1 authors: Vaz-Pereira, Sara; Morais-Sarmento, Tiago; De Salvo, Gabriella title: Sensitivity and specificity of MultiColor imaging in detecting proliferative diabetic retinopathy date: 2021-10-26 journal: Int Ophthalmol DOI: 10.1007/s10792-021-02062-y sha: e542a8ac6732d53582e8c5bfc6dc6199347873db doc_id: 827893 cord_uid: h6wpiby1 PURPOSE: To evaluate the accuracy of MultiColor imaging (MC) compared to fluorescein angiography (FA) in detecting proliferative diabetic retinopathy (PDR) and associated diabetic retinopathy features. METHODS: Fifty-nine eyes from 38 PDR patients were included. MC images were reviewed by 2 independent masked graders. A qualitative analysis based on the following features was performed: neovascular complexes (NVC), disc neovascularization (NVD), neovascularization elsewhere (NVE), microaneurysm (MA), intraretinal hemorrhage (IRH), vitreous hemorrhage (VH), preretinal hemorrhage (PRH), fibrosis, hard exudates (HE), epiretinal membrane (ERM), diabetic macular edema (DME), ischemia and laser spots (LS). Measures of diagnostic accuracy compared to FA were determined. RESULTS: The sensitivity for the detection of NVC using MC was 95.1%, with a specificity of 40.0%, positive predictive value (PPV) of 92.9% and negative predictive value (NPV) of 50.0%. Sensitivity and specificity were higher in detecting NVD (88.9% and 76.9%) while NVE registered higher PPV (88.9%). MC was highly sensitive in detecting IRH, HE, ERM and LS (100%), MA (98.0%) and fibrosis (95.5%). Highest specificity was found for VH (100.0%), DME (100.0%), PRH (98.1%) and LS (89.5%). The area under the receiver-operating characteristic analysis of MC was excellent in NVD (0.83, 95% confidence interval (CI), 0.71–0.95, p < 0.001), IRH (0.89, 95% CI 0.74–1.00, p < 0.001), VH (0.81, 95% CI 0.60–1.00, p = 0.005) and PRH (0.89, 95% CI 0.68–1.00, p = 0.004) and outstanding in LS detection (0.95, 95% CI 0.87–1.00, p < 0.001). These results are likely due to the contrast and quality of the MC since better discrimination is enabled by the green wavelength. CONCLUSION: MC is useful in evaluation of PDR patients and can complement noninvasive imaging. MC detected some PDR features more accurately than FA such as NVD, IRH, VH, PRH, and LS. Diabetic retinopathy (DR) is a leading cause of blindness [1, 2] . By 2030, the World Health Organization estimates the prevalence of DM to reach 366 million adult patients and DR is estimated to affect 191 million [2] . This emphasizes the need for appropriate and early screening and, thus, the screening programs need to become as effective as possible [3] . Also, patient flow needs to be optimized in clinics with obtention of more information from less testing or without moving patients to different machines and/ or rooms, which can be very time-consuming. This has become even more significant with the COVID-19 pandemic which has created a new healthcare reality. MultiColor scanning laser imaging (MC) is a recent non-invasive modality which uses 3 laser wavelengths simultaneously to obtain high-resolution en face images of the retina. The blue, green, and infrared wavelengths have different penetration ranges and thus have the ability to show structures at different depths within the retina. The blue wavelength is more useful to study the vitreoretinal interface and inner retina; the green wavelength shows details of the retinal vasculature and intraretinal features such as blood and exudation and the infrared wavelength has a higher penetration and improves visualization at the level of the outer retina, choroid and retinal pigment epithelium [4, 5] . MC presents some advantages when compared to conventional fundus examination and color fundus photography (CFP), namely (1) a superior penetration through media opacities such as cataract, (2) a better performance in undilated pupils, (3) the confocal technology blockage of scattered light offers higher resolution and higher contrast, (4) the eye-tracking technology of image stability and averaging acquisition improves resolution and (5) it is incorporated in an optical coherence tomography (OCT)/OCT and fluorescein angiography (FA) platform, not requiring the need to move to a different machine [4] . As such, this new imaging modality can identify DR pathologic changes, such as retinal neovascularization in PDR [4, [6] [7] [8] [9] [10] . PDR is an important cause of vision loss in diabetic individuals and is characterized by the presence of neovascular complexes (NVC) on the optic disc (NVD) or elsewhere in the retina (NVE) [11, 12] . Although there have been significant advances in imaging techniques to evaluate PDR [13, 14] , FA, described in 1961 [15] , is considered the gold standard to classify disease activity, guide laser therapy and evaluate treatment response. Nonetheless, it is a timeconsuming invasive technique that involves intravenous administration of a fluorescein dye to obtain a vascular map of the eye and, as such, cannot be performed at every visit [16] [17] [18] . In this situation, MC may be advantageous as it can reveal retinal neovascularization undetected by CFP or funduscopy by the use of the green laser wavelength [4, [6] [7] [8] [9] . Also, when compared to FA, MC might be a good alternative in patients with poor quality FA or in which FA is contraindicated, due to its noninvasive character and higher penetration rate in opacities. In this study, we evaluated the accuracy of MultiColor imaging in detecting PDR and associated DR features. This retrospective case series included eyes from patients with PDR from the medical retina clinic at Hospital de Santa Maria, Lisbon, Portugal. This study was approved by the local ethics committee and was conducted according to the tenets of the Declaration of Helsinki. All subjects provided informed consent. Patients were identified using a database search and subsequent chart review. Exclusion criteria included other etiologies of proliferative retinopathy or reduced imaging quality due to significant media opacities. Clinical and demographic data were collected along with same-day FA and MC images. It is our Institution's protocol to obtain MC images when performing FA. All MC images were independently evaluated by 2 trained masked medical retina specialists-SVP and GDS-with ambiguities resolved by open adjudication to decide the final grading based on previous publications on MC imaging of DR lesions [4, [6] [7] [8] [9] [10] 19] . The FA grading was performed openly according to the ETDRS classification from fluorescein angiograms [20, 21] . Retinal neovascularization was classified as NVE and disc neovascularization or within 1 disc diameter from its margin as NVD [22] . Other imaging features classified were: presence of round artifact [23] , microaneurysm (MA), intraretinal hemorrhage (IRH), vitreous hemorrhage (VH), preretinal hemorrhage (PRH), fibrosis, hard exudates (HE), diabetic macular edema (DME), epiretinal membrane (ERM), ischemia and laser spots (LS). High-resolution digital MC images with a field of view of 55°were obtained using Spectralis HRA with MultiColor (Heidelberg Engineering, Heidelberg, Germany). Images were captured at the time of FA and retrospectively reviewed. An initial quality check was performed and only cases with at least 10 averaged scans were included. Images were analyzed using the Heidelberg Eye Explorer (version 1.10.4.0) and the software tools were modified for improved visualization of the neovascularization in MC, respectively the color balance was changed to greenblue enhances, the noise reduction was set to low, and the sharpen function to medium [5] . Statistical analysis was performed using Microsoft Office Excel 2020 for Mac version 16.39 and SPSS version 24.0 (IBM Corp, Armonk, NY). Data were analyzed with frequency and descriptive statistics. Categorical variables were presented as counts and percentages and continuous variables as mean ± standard deviation (SD). For each feature, we calculated the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), through cross-tabulation [24] . Receiver-operating characteristic (ROC) analysis was performed for several features with calculation of area under the curve (AUC) value with the respective 95% confidence interval (95%CI) and p-value for statistical significance compared to reference. AUC was classified as previously suggested [25, 26] and only results over 0.7 (acceptable) were included. Concordance between graders for the qualitative MC features assessed was determined with k index. The strength of agreement was considered fair from 0.21 to 0.40, moderate from 0.41 to 0.60, substantial from 0.61 to 0.80, and almost perfect from 0.81 to 1.00, as previously described [27] . P-value \ 0.05 was considered statistically significant. Fifty-nine eyes from 38 individuals with a confirmed diagnosis of PDR were evaluated. The mean age ± SD was 56.6 ± 11.6, 20 (52.6%) were male, 28 (73.7%) Caucasian and 10 (26.3%) had African origin. Eight (21.1%) patients had type 1 DM and 30 (78.9%) had type 2 DM. Fifteen (39.5%) patients had bilateral disease. The affected eye was the right eye in 31 (52.5%) of cases, 2 (3.4%) eyes were treatment naïve, 42 (72.4%) received laser pan-retinal photocoagulation (PRP), 14 (24.1%) were submitted to a combination of PRP and anti-VEGF therapy and 5 (8.6%) eyes had additional surgery (pars plana vitrectomy). The detection of eyes with PDR using MultiColor imaging compared to fluorescein angiography is presented in Tables 3 and 4 . A round artifact was identified in 55 (93.2%) MC images and in none (0%) of the FA images evaluated (Fig. 3) , with a specificity of 6.8% and an NPV of 100%. MA was observed in 49 (83.1%) eyes using MC and in 58 (98.3%) with FA, for a sensitivity of 98.0% and PPV of 100.0% (Fig. 2) . IRH was more frequently observed in MC-40 (67.8%) versus 36 (61.0%) using FA (Fig. 2) , with a sensitivity of 100.0%, specificity of 76.9%, PPV of 91.7%, and NPV of 100%. The grading of VH was quite similar between the modalities, 6 (10.2%) eyes in MC and 8 (13.6%) in FA (Fig. 3) , with a specificity, specificity, PPV, and NPV of 62.5%, 100.0%, 100.0%, and 94.1%, respectively. The presence of PRH was balanced in both MC and FA -5 (8.5%) for each - (Fig. 3) , meaning a sensitivity, specificity, PPV and NPV of 80.0%, 98.1%, 80.0%, and 98.1%, correspondingly. The presence of HE had a sensitivity and NPV of 100% and specificity and PPV of 16.0% and 2.1%, respectively. HE was observed in 45 (76.3%) of The intergrader agreement for the MC features accessed was almost perfect with a weighted kappa of 0.86 (standard error: 0.02, 95% confidence interval: 0.82-0.88) (highlighted in bold in Table 6 ). The hallmark of PDR is the presence of neovascularization, which is induced by global retina ischemia [11, 28] . CFP and FA are still considered the gold standard for PDR although there have been recent advances in other imaging modalities [4, 6, [29] [30] [31] [32] . The NVC is friable and can bleed, thus hemorrhagic complications such as the presence of VH or PRH are a sign of neovascularization and their presence determines the presence of high-risk PDR [22, 28, 33] . In this study, we compared the accuracy of MC to conventional FA to evaluate the presence of PDR and associated features. A screening test should be able to accurately identify diseased and non-diseased individuals and ideally should be highly sensitive (high probability of detecting disease) and specific (high probability of excluding the disease). However, sensitivity and specificity are inversely proportional, which means that an increase in sensitivity will result in a decrease in specificity and vice versa [24] . We report that MC alone revealed an excellent performance in diagnosing NVCs due to its high sensitivity and PPV (very low rate of false positives), which could be helpful in diagnosing PDR, as the green reflectance highlights both the vascular and fibrotic component of neovascularization [4, [6] [7] [8] [9] . However, MC was not so useful for PDR screening purposes due to its low specificity and NPV value, resulting in low accuracy for excluding negative cases (high rate of false negatives). We also found that the specificity and NPV were higher for NVD compared to NVE. This means that MC was able to correctly identify 76.9% of patients as having no NVD, while it properly returned a negative result for 63.6% of NVE. We believe this result may be due to better contrast in the MC image at the disc area, as the vessels are reddish and the optic disc is yellowish, and also because the area of interest is much smaller, as the definition of NVD is neovascularization at or within 1 disc diameter of the disc margin [8, 22] . Indeed, the ROC analysis showed MC had excellent and statistically significant discrimination for NVD compared to FA and an only acceptable and statistically significant discrimination for NVE. This could be explained by some difficulty in distinguishing early NVE from IRMA in MC, which led to a more precise classification when using FA due to the identification of fluorescein leakage in NVE [20, 21] . Nevertheless, albeit the presence of NVE determines a more severe disease, IRMA is a known risk factor for PDR [31, 34, 35] and, in the natural disease course, about 50% of patients with severe non-proliferative DR develop PDR within a year and 15% develop high-risk Regarding other features of DR, MC was highly sensitive in detecting MA, IRH, fibrosis, and HE. These results are likely due to the contrast and quality of the images, allowing for better discrimination [4, [6] [7] [8] [9] [10] . Also, FA is black and white, and therefore, whitish fibrotic tissue and yellow HE are more easily unapparent in FA. MC has been reported to offer the possibility of identifying ischemic areas because of the green wavelength [4, 6, 7] . We identified the areas of nonperfusion as areas with a red enhancement when compared to the surrounding homogeneous orange background color. The ischemia appeared to be reddish and faded and could be better highlighted as hyporeflectant if seen with the blue-green wavelength filters. We found a PPV of 81.3% for ischemia and NPV of 59.1%, with acceptable discrimination in the AUC analysis. Nevertheless, MC was outstanding in the identification of laser scars from PDR treatment, with high sensitivity, specificity, PPV, and NPV. We have demonstrated that MC has advantages over FA and it can be acquired along OCT and/or FA as it is integrated into the Heidelberg Spectralis platform (Heidelberg Engineering, Heidelberg, Germany), obviating the need to move the patient to another imaging device [4, 6] , which is even more valuable as we go through the current COVID-19 pandemic. Also, our work reinforces the conclusions of other authors [4, 6, 9] , that one single device allows saving time in high-volume clinics. Albeit the sensitivity was higher than the specificity when compared to FA, Roy et al. [9] validated it against CFP and so MC may be useful for diabetic screening as it can be incorporated in the Spectralis-HRA, Spectralis-OCT, or Spectralis HRA ? OCT. This could be advantageous in countries that regularly perform diabetic retinal screening and are going to upgrade it with OCT. The combination of Spectralis-OCT with MC instead of separate OCT and CFP could ultimately lead to less referrals of ''ungradable'' cases as MC performs better in media opacities and does not require dilation [4, 6, 9] . Nonetheless, we should consider its limitations. In fact, the technique is not widely available and requires a learning curve for appropriate clinical correlation as MC incorporates 3 wavelengths, demanding a longer duration of fixation for acquisition, and the findings appear different from CFP [4, 5] . We used two trained retina specialists, familiarized with this imaging modality and thus the excellent agreement. Furthermore, the study is retrospective in nature and includes a small sample; further multicenter clinical studies are needed to complement our observations. We have chosen to compare MC to FA as the Spectralis imaging platform does not incorporate standard CFP and we stopped performing it in our routine practice. Finally, the negative impact of imaging artifacts, such as ghost maculopathy, should also be considered [4, 23] . The presence of the artifact precluded a proper assessment of macular features such as DME and ERM, which led to many cases of unsure/ungradable. In conclusion, MC detected some PDR features such as NVD, VH, PRH, IRH, and laser spots, more accurately than FA. These findings make MC a useful test for the diagnosis and follow-up evaluation of PDR, complementing the noninvasive imaging of this disease. Ethics approval and consent to participate This study was approved by Centro Hospitalar Universitário de Lisboa Norte, EPE-Hospital de Santa Maria local ethics committee (Lisbon, Portugal) and was conducted in accordance with the ethical principles of the Declaration of Helsinki. Informed consent was obtained from all participants. Global burden of diabetes, 1995-2025: prevalence, numerical estimates, and projections Global prevalence of diabetes: estimates for the year 2000 and projections for 2030 The english national screening programme for diabetic retinopathy 2003-2016 Clinical application of multicolor imaging technology Engineering Academy -SPEC-TRALIS MultiColor -Interpreting MultiColor images in 3 steps Multicolor scanning laser imaging in diabetic retinopathy Multicolor imaging in neovascularization of disc Clinical application of multicolour scanning laser imaging in diabetic retinopathy Validation of multicolor imaging of diabetic retinopathy lesions vis a vis conventional color fundus photographs MultiColor imaging to detect different subtypes of retinal microaneurysms in diabetic retinopathy Neovascularization of the retina Meta-Analysis for Eye Disease Study G (2012) Global prevalence and major risk factors of diabetic retinopathy Diabetic retinopathy studied by fluorescein angiography Contemporary retinal imaging techniques in diabetic retinopathy: a review A method of photographing fluorescence in circulating blood in the human retina Diabetic retinopathy studied by fluorescein angiography A fluorescein angiographic study of macular dysfunction secondary to retinal vascular disease. IV. Diabetic retinal angiopathy New findings in diabetic maculopathy and proliferative disease by swept-source optical coherence tomography angiography Visualization of macular pucker by multicolor scanning laser imaging Classification of diabetic retinopathy from fluorescein angiograms. ETDRS report number 11. Early Treatment Diabetic Retinopathy Study Research Group Relationship of treatment effect to fluorescein angiographic and other retinal characteristics at baseline: ETDRS report no. 19. Early Treatment Diabetic Retinopathy Study Research Group Grading diabetic retinopathy from stereoscopic color fundus photographs-an extension of the modified Airlie House classification Ghost maculopathy: an artifact on near-infrared reflectance and multicolor imaging masquerading as chorioretinal pathology Understanding and using sensitivity, specificity and predictive values Applied logistic regression Receiver operating characteristic curve in diagnostic test assessment The measurement of observer agreement for categorical data Diabetic retinopathy preferred practice patternÒ Advances in retinal imaging for diabetic retinopathy and diabetic macular edema Multimodal imaging of diabetic retinopathy Optical coherence tomography features of neovascularization in proliferative diabetic retinopathy: a systematic review Imaging in diabetic retinopathy: a review of current and future techniques Early Treatment Diabetic Retinopathy Study design and baseline patient characteristics Evaluation of preretinal neovascularization in proliferative diabetic retinopathy using optical coherence tomography angiography Reevaluating the definition of intraretinal microvascular abnormalities and neovascularization elsewhere in diabetic retinopathy using optical coherence tomography and fluorescein angiography Early photocoagulation for diabetic retinopathy. ETDRS report number 9. Early Treatment Diabetic Retinopathy Study Research Group Acknowledgements The authors would like to thank Sofia Sousa Mano, MD (Hospital de Santa Maria, Lisbon, Portugal) for helping in the preliminary identification of PDR patients with MultiColor images.Animal research Not applicable.Consent for publication All participants consented to the use of their anonymized data. Authors' contribution SVP collected the data. SVP, TMS, and GDS contributed to the conception and design of the work and to data analysis and interpretation. SVP, TMS, and GDS drafted the manuscript. SVP elaborated the figures and SVP and TMS created the tables. All authors read and approved the final manuscript.Funding None.Data availability The data is available from the corresponding author upon reasonable request. Competing interest SVP reports consultant fees from Allergan, Alimera Sciences, Bayer, Novartis, and Roche, outside the submitted work. TMS has nothing to disclose. GDS reports consultant fees from Allergan, Bayer, Heidelberg Engineering and Novartis, outside the submitted work.