key: cord-0903390-k46i5kur authors: Qiu, Yue; Su, Ying; Tu, Guo-Wei; Ju, Min-Jie; He, Hong-Yu; Gu, Zhun-Yong; Yang, Cheng; Luo, Zhe title: Neutrophil-to-Lymphocyte Ratio Predicts Mortality in Adult Renal Transplant Recipients with Severe Community-Acquired Pneumonia date: 2020-11-04 journal: Pathogens DOI: 10.3390/pathogens9110913 sha: c65eb6bf9337b42be153c00e4d48fc4a3ab07d7d doc_id: 903390 cord_uid: k46i5kur Mortality of renal transplant recipients with severe community-acquired pneumonia (CAP) remains high, despite advances in critical care management. There is still a lack of biomarkers for predicting prognosis of these patients. The present study aimed to investigate the association between neutrophil-to-lymphocyte ratio (NLR) and mortality in renal transplant recipients with severe CAP. A total of 111 renal transplant recipients with severe CAP admitted to the intensive care unit (ICU) were screened for eligibility between 1 January 2009 and 30 November 2018. Patient characteristics and laboratory test results at ICU admission were retrospectively collected. There were 18 non-survivors (22.2%) among 81 patients with severe CAP who were finally included. Non-survivors had a higher NLR level than survivors (26.8 vs. 12.3, p < 0.001). NLR had the greatest power to predict mortality as suggested by area under the curve (0.88 ± 0.04; p < 0.0001) compared to platelet-to-lymphocyte ratio (0.75 ± 0.06; p < 0.01), pneumonia severity index (0.65 ± 0.08; p = 0.05), CURB-65 (0.65 ± 0.08; p = 0.05), and neutrophil count (0.68 ± 0.07; p < 0.01). Multivariate logistic regression models revealed that NLR was associated with hospital and ICU mortality in renal transplant recipients with severe CAP. NLR levels were independently associated with mortality and may be a useful biomarker for predicting poor outcome in renal transplant recipients with severe CAP. Community-acquired pneumonia (CAP) has high morbidity and mortality, with frequent requirement for intensive care support. As a unique group of immunosuppressed patients, solid organ transplant recipients, including renal transplant recipients, are at high risk of acquiring CAP due to the routine use of immunosuppressive regimens [1] [2] [3] . The first-year mortality in renal transplant recipients with CAP can increase by 6-to 12-fold [4] . Notably, mortality of renal transplant recipients with severe CAP (diagnosed according to the Infectious Diseases Society of America/American Thoracic Society (IDSA/ATS) guidelines (2007) [5] ) has remained high in recent years, despite advances in critical care management [6] [7] [8] [9] . Early identification of high-risk patients would help to administer appropriate treatment and further improve clinical outcome. Many prognostic scoring systems or biomarkers aimed at stratifying risk and predicting prognosis in immunocompetent patients with CAP have been developed, such as the pneumonia severity index (PSI) [10] , CURB-65 [11] , and procalcitonin (PCT) [11] [12] [13] . However, biomarkers for predicting poor outcome in renal transplant recipients with severe CAP are still lacking. Neutrophil-to-lymphocyte ratio (NLR), the ratio of neutrophil count to lymphocyte count, is a simple and inexpensive biomarker of systemic inflammation. NLR is reported to be associated with poor outcome and showed a better performance than PSI, CURB-65, and C-reactive protein (CRP) in predicting 30-day mortality in immunocompetent patients with CAP [14, 15] . Moreover, NLR was found to be correlated with poor outcome in various diseases, such as oncology, cardio-cerebrovascular diseases, and bacteremia. Similarly, platelet-to-lymphocyte ratio (PLR) has been described as a novel potential inflammatory marker, which is associated with poor outcome in various diseases [16] [17] [18] [19] [20] . However, the role of NLR and PLR in renal transplant recipients with severe CAP remains unclear. In the present study, we investigated the association between NLR/PLR and mortality in renal transplant recipients with severe CAP. A total of 111 renal transplant recipients with dyspnea admitted to the intensive care unit (ICU) between 1 January 2009 and 30 November 2018 were reviewed. Of these patients, 30 patients were excluded, including 11 with cardiogenic pulmonary edema at ICU admission, 12 with infection in multiple sites, three who were readmitted to the ICU, three with hospital-acquired pneumonia, and one with a do-not-intubate (DNI) order. Finally, 81 renal transplant recipients diagnosed to have severe CAP were included in the study (59 males (72.8%); median age, 52 [40~59] years) ( Figure 1 ). The baseline demographics and clinical and laboratory characteristics of the 81 recipients are presented in Table 1 . In the present study, 63 patients survived (77.8%) and 18 patients died during hospital stay (22.2%). The baseline immunosuppressive regimens included cyclosporine A (CsA), tacrolimus (TAC), mycophenolate mofetil (MMF), rapamycin (Rapa), and prednisone (Pred). APACHE II, Acute Physiology and Chronic Health Evaluation II; ALT, alanine aminotransferase; AST, aspartate aminotransferase; ALP, Alkaline phosphatase; CRP, C-reactive protein; GFR, glomerular filtration rate; γ-GT, γ-glutamyl transpeptidase; NLR, neutrophil-to-lymphocyte ratio; PLR, platelet-to-lymphocyte ratio; PSI, Pneumonia Severity Index. Non-survivors had a significantly lower PaO 2 /FiO 2 ratio (p < 0.01) and a higher Acute Physiology and Chronic Health Evaluation II (APACHE II) score (p < 0.01) than survivors. However, the CURB-65 score only slightly differed between survivors and non-survivors (2 [2, 2] vs. 3 [2, 3] , respectively, p = 0.02). PSI was comparable between both groups (110 [98, 128] vs. 126 [104, 155] , respectively, p = 0.06). A balanced distribution was observed between survivors and non-survivors with regard to other baseline clinical characteristics, including gender, age, comorbidities prior to admission, immunosuppressive regimens, and time course before admission, except for diabetes mellitus (7.9% vs. 27.8%, respectively, p = 0.04). The white blood cell (WBC) count was comparable between survivors and non-survivors (p = 0.07). However, lymphocytopenia was more severe in non-survivors than in survivors (0. There were no significant differences in the levels of procalcitonin (PCT), serum creatinine (Scr), troponin T (TnT), N-terminal pro-brain natriuretic peptide (NT-proBNP), D-dimer, and C-reactive protein (CRP) between survivors and non-survivors (all p > 0.05). The numbers of patients receiving invasive mechanical ventilation (IMV) and those requiring a vasopressor within 24 h after ICU admission and renal replacement treatment were higher in non-survivors (all p < 0.001). In addition, non-survivors had a longer ICU and hospital stay length than survivors (16 [6, 28] vs. 7 [4, 11] days, p = 0.01; 30 [17, 41] vs. 20 [14, 29] , p = 0.04). The microbiological findings are shown in Table 1 . A total of 51 patients (63.0%) had positive microbiological findings during the treatment process according to noninvasive and/or invasive diagnostic tests. Bacterial infection (32.1%) was the primary cause of severe CAP in renal transplant recipients, followed by viral (25.9%) and fungal infections (25.9%). Non-survivors had a higher rate of bacterial infection than survivors (77.8% vs. 19.0%, respectively, p < 0.001). There were no differences in viral and fungal infections between the two groups. A total of 37% patients had unidentified pathogens. The survivors had a higher rate of undetermined etiology than non-survivors (44.4% vs. 11.1%, respectively, p = 0.01). Receiver operating characteristic (ROC) curves were constructed to examine the predictive performance of several indicators for hospital mortality ( Figure 2 ). The area under the curve (AUC), optimal cutoff value, sensitivity, and specificity of each indicator are presented in Table 2 . NLR showed the largest AUC of 0.88 ± 0.04, and NLR ≥ 15.25 was proposed as the optimal cutoff value, which provided a sensitivity of 100% and a specificity of 67.21% for predicting hospital mortality. PLR had an AUC of 0.75 ± 0.06, and PLR ≥ 520 was proposed as the optimal cutoff value, which provided a sensitivity of 77.78% and a specificity of 68.33% for predicting hospital mortality. Pairwise comparison of ROC curves confirmed that the AUC of NLR was significantly higher than those of PLR (p < 0.01), CURB-65 (p = 0.01), PSI (p = 0.01), and neutrophil count (p < 0.01). The AUCs of APACHE II score (p = 0.74) and lymphocyte count (p = 0.14) were identical to that of NLR. The combination of APACHE II score and NLR had an excellent prediction of hospital mortality with an AUC value of 0.91 ± 0.05 (p < 0.0001), which is higher than that of APACHE II score (0.85 ± 0.05; p < 0.0001). Furthermore, we performed univariate and multivariate logistic regression analyses to confirm the association of each variable with mortality (Table A1 in Appendix A and Tables 3 and 4 ). The multivariate logistic models showed that NLR was associated with hospital and ICU mortality in renal transplant recipients with severe CAP (model 1, adjusted odd ratio (OR), 1.07 [1.02-1.14], p = 0.01; model 2, adjusted OR, 1.07 [1.02-1.14], p = 0.01; Tables 3 and 4 , respectively), while PLR was not associated Pathogens 2020, 9, 913 5 of 13 with hospital mortality and ICU mortality (models 5 and 6, all p > 0.05; Tables 3 and 4 ). NLR was further classified into three levels: high (≥24.0), medium (16.2-24.0), and low (≤16.2), based on data distribution. The multivariate logistic models confirmed that NLR was associated with hospital and ICU mortality (models 3 and 4, all p for trend < 0.01; Tables 3 and 4 ). the association of each variable with mortality (Table A1 in Appendix A and Tables 3 and 4 ). The multivariate logistic models showed that NLR was associated with hospital and ICU mortality in renal transplant recipients with severe CAP (model 1, adjusted odd ratio (OR), 1.07 [1.02-1.14], p = 0.01; model 2, adjusted OR, 1.07 [1.02-1.14], p = 0.01; Tables 3 and 4, respectively), while PLR was not associated with hospital mortality and ICU mortality (models 5 and 6, all p > 0.05; Tables 3 and 4 ). NLR was further classified into three levels: high (≥24.0), medium (16.2-24.0), and low (≤16.2), based on data distribution. The multivariate logistic models confirmed that NLR was associated with hospital and ICU mortality (models 3 and 4, all p for trend < 0.01; Tables 3 and 4 ). To the best of our knowledge, this is the first study to focus on the predictive value of NLR in renal transplant recipients with severe CAP. Our study demonstrated that elevated NLR level was associated with mortality in renal transplant recipients with severe CAP. Moreover, NLR had better performance than PLR, PSI, and CURB65 score in predicting mortality. Inflammatory responses play an important role in the development and progression of CAP. As a simple and convenient marker of inflammatory status, NLR was found to be an independent predictor of mortality in immunocompetent patients with CAP, including children and elderly patients [14, 15, [21] [22] [23] . Moreover, NLR was recently considered as an independent biomarker in patients with coronavirus disease 2019 (COVID-19) [18, 24] . Generally speaking, neutrophilia and/or lymphopenia are common immune responses during infection, which finally result in elevated NLR level. The possible mechanisms that drive neutrophilia and lymphopenia include demargination and delayed apoptosis of neutrophils as well as margination and accelerated apoptosis of lymphocytes [25] [26] [27] [28] . NLR has also been reported to be correlated with a wide range of disorders. On the one hand, NLR was found to be associated with poor prognosis in various conditions, such as severe infections, systemic inflammation, acute coronary syndrome, and cancer [29] [30] [31] [32] [33] [34] . On the other hand, it has been demonstrated that high NLR level was associated with renal recovery in patients with rapidly progressive glomerulonephritis [19] . These findings indicate the complex role of NLR in various diseases. To date, the role of NLR in renal transplant recipients with severe CAP remains unknown. Renal transplant recipients, who are usually administered immunosuppressive agents and steroids, are a subgroup of immunocompromised populations. As innate and adaptive immune responses are usually inhibited by immunosuppressive agents and chronic steroid administration, neutropenia and lymphocytopenia are common in renal transplant recipients [35] . Therefore, an inflammatory response against pneumonia in renal transplant recipients differs greatly from those in immunocompetent patients. In the present study, lymphocytopenia was common in renal transplant recipients with severe CAP, while the median neutrophil level was in the normal range. Lymphocytopenia was more severe in non-survivors than in survivors, while the neutrophil level, despite in the normal range, was higher in non-survivors than in survivors. These factors led to higher NLR in non-survivors than in survivors. PLR has also been highlighted as a potential new marker of systemic inflammation. Several studies have reported that PLR is linked with poor outcome in various diseases, including COVID-19, rheumatoid arthritis, glomerulonephritis, and cancer [16] [17] [18] [19] [20] . However, our results did not confirm the association between the PLR level and mortality in renal transplant recipients with severe CAP. PLR has lower AUC values in predicting hospital mortality than NLR. This may be partially explained by the comparable platelet levels between survivors and non-survivors. Many prognostic scoring systems aimed at stratifying risk in patients with CAP have been developed, such as PSI and CURB-65. Their performances in predicting mortality have been validated in large, independent populations that included immunocompetent patients with CAP [36, 37] . However, their performances in renal transplant recipients with severe CAP were unsatisfactory when compared with that of NLR. Thus, common scoring systems, such as PSI and CURB-65, may not be suitable for renal transplant patients with severe CAP. In the present study, bacterial infection was the primary cause of severe CAP in renal transplant recipients. Non-survivors had a higher rate of bacterial infection than survivors. Multivariate logistic regression models also confirmed that bacterial infection in these patients was associated with mortality. This implied that renal transplant recipients with CAP caused by bacteria tended to be susceptible to develop highly severe disease, resulting in poor outcome. However, it should be noted that 37% of our patients had undetermined microbiological findings, and non-survivors had a lower rate of undetermined pathogens than survivors. The possible reasons for this finding are that non-survivors had high severity of disease and tended to receive invasive diagnostic procedures to determine the etiology, such as fiberoptic bronchoscopy with bronchoalveolar lavage. The rate of invasive mechanical ventilation was lower in survivors than in non-survivors (4.8% vs. 88.9%, respectively, p < 0.001). The possible reasons for this finding are that interdisciplinary approaches have been implemented in our center since 2009 to delay or avoid intubation, which include appropriate oxygen therapy, adjustment of immunosuppressive regimen and steroids, individual antibiotic therapy, and so on [8, [38] [39] [40] [41] . The overall mortality was, therefore, markedly decreased from nearly 50% prior to 2009 to 22.2% [40] . This retrospective study has several limitations. First, the study was limited by the small sample size, which might have affected the statistical power and restricted stratified analysis. Further confirmation should be obtained using a larger cohort in future studies. Second, other inflammatory indicators, such as interferon-gamma (IFN-γ) and tumor necrosis factor-alpha (TNF-α), were not measured in our study. Third, the conclusion based on kidney transplant recipients may not be generalized for all immunosuppressed patients. The study protocol complied with the standards of the Declaration of Helsinki and current ethical guidelines and was approved by the Ethics Committee of Zhongshan Hospital, Fudan University. Renal transplant recipients with dyspnea admitted to the ICU of Zhongshan Hospital, Fudan University, between 1 January 2009 and 30 November 2018 were retrospectively reviewed. CAP was diagnosed as pneumonia acquired outside of a hospital setting [42] . Hospital-acquired pneumonia (HAP) was defined according to previous reports [43] . Severe CAP was diagnosed according to the Infectious Diseases Society of America/American Thoracic Society (IDSA/ATS) guidelines (2007) [5] . Patients who met either one major criterion or at least three minor criteria were diagnosed to have severe CAP. The major criteria included the following: (1) septic shock in need of vasopressors and (2) respiratory failure requiring mechanical ventilation. The minor criteria included the following: (1) PaO 2 /FiO 2 ratio < 250 mmHg; (2) respiratory rate (RR) > 30 breaths/min; (3) infiltration in multilobes; (4) confusion/disorientation; (5) uremia (blood urea nitrogen (BUN) > 20 mg/dl); (6) leukopenia (white blood cell (WBC) count = 4000/mL); (7) thrombocytopenia (platelet count < 100,000/mL); (8) hypothermia (core temperature < 36 • C); (9) hypotension requiring aggressive fluid resuscitation. Patients were excluded if they met the following criteria: (1) HAP; (2) cardiogenic pulmonary edema on admission; (3) readmission to ICU; (4) concurrent infection in other sites (urinary tract, abdomen, and so on); (5) do-not-intubate (DNI) order. A summary of standardized approaches for renal transplant recipients with severe pneumonia has been described in our previous studies [8, 44] . High-resolution computed tomography (HRCT) examination was performed for diagnosis and evaluation before hospital admission and during ICU stay. Diagnostic tests for identifying the pathogens of severe CAP included noninvasive procedures (urine and sputum cultures) and invasive diagnostic procedures (fiberoptic bronchoscopy with bronchoalveolar lavage, blood culture, and detection of serum antibodies against cytomegalovirus (CMV), Epstein-Barr virus (EBV), Legionella, and Mycoplasma). Additionally, the 1,3-β-d glucan test (G test), galactomannan antigen detection (GM test), T cell spot test for tuberculosis (T-SPOT), and tuberculin test were performed. Patient demographics (baseline clinical characteristics including the Acute Physiology and Chronic Health Evaluation II (APACHE II) score, Pneumonia Severity Index (PSI), CURB-65 score, and PaO 2 /FiO 2 ratio), laboratory data at ICU admission (including hemoglobin level, platelet count, Pathogens 2020, 9, 913 9 of 13 white blood cell count, alanine aminotransferase (ALT) level, aspartate aminotransferase (AST) level, alkaline phosphatase (ALP) level, C-reactive protein (CRP) level, D-dimer level, γ-glutamyl transpeptidase (γ-GT) level, bilirubin level, troponin T (TnT) level, N-terminal pro-brain natriuretic peptide (NT-proBNP) level, serum creatinine (Scr) level, glomerular filtration rate (GFR), and procalcitonin (PCT) level) and microbiological findings were collected. In our center, complete blood count was measured using the Beckman Coulter LH-750 Hematology Analyzer (Beckman Coulter, Inc., Fullerton, CA, USA). Blood biochemical parameters were measured by an automatic biochemistry analyzer (Roche Cobas 8000 modular analyzer, Roche Diagnostics, Mannheim, Germany). NT-proBNP was measured by the Elecsys Electro-chemo luminescent assay (Cobas e 411 analyzer, Roche Diagnostics). Treatments during ICU stay, including vasopressor use within 24 h after ICU admission, renal replacement therapy, and invasive mechanical ventilation (IMV), and clinical outcomes, including length of ICU stay and hospital stay and ICU and hospital mortality, were also recorded. NLR was calculated using the following formula: NLR (%) = Neutrophil count/Lymphocyte count × 100%. Categorical variables were compared using the chi-square test or Fisher's exact test, while continuous variables were compared using the Mann-Whitney U test. To determine the sensitivity and specificity of variables to predict mortality, receiver operating characteristic (ROC) curves were plotted, and the area under the curve (AUC) and Youden's index were then calculated from ROC curves. The optimal cutoff value was based on Youden's index. The ROC curve for the combination of APACHE II and NLR for predicting hospital mortality was also plotted according to the Mackinnon and Mulligan's weighted sum rule [45] . Pairwise comparison of ROC curves was conducted using the method of DeLong et al., 1988 [46] . Univariate logistic regression analysis was used to identify the possible risk factors for hospital mortality and ICU mortality. Variables with probability (p) value less than 0.1 in univariate models were introduced into the multivariate logistic models. A p value of less than 0.05 was considered to be statistically significant. SPSS software package, version 13.0 (SPSS Inc., Chicago, IL, USA) was used for statistical analysis of the data. NLR was independently associated with mortality in renal transplant recipients with severe CAP. NLR may be a useful prognostic marker for renal transplant recipients with severe CAP. The authors declare no conflict of interest. APACHE II, Acute Physiology and Chronic Health Evaluation II; ALT, alanine aminotransferase; AST, aspartate aminotransferase; ALP, Alkaline phosphatase; CRP, C-reactive protein; GFR, glomerular filtration rate; γ-GT, γ-glutamyl transpeptidase; NLR, neutrophil-to-lymphocyte ratio; PLR, platelet-to-lymphocyte ratio; PSI, Pneumonia Severity Index. Epidemiology of pneumonia in kidney transplantation Solid organ transplantation in the 21(st) century Infectious complications following heart transplantation in the era of high-priority allocation and extracorporeal membrane oxygenation Clinical and economic consequences of first-year urinary tract infections, sepsis, and pneumonia in contemporary kidney transplantation practice Infectious Diseases Society of America/American Thoracic Society Consensus Guidelines on the Management of Community-Acquired Pneumonia in Adults Evolution over a 15-year period of the clinical characteristics and outcomes of critically ill patients with severe community-acquired pneumonia Outcomes in patients with community-acquired pneumonia admitted to the intensive care unit Early-and late-onset severe pneumonia after renal transplantation Machine learning for the prediction of severe pneumonia during posttransplant hospitalization in recipients of a deceased-donor kidney transplant A prediction rule to identify low-risk patients with community-acquired pneumonia update of BTS pneumonia guidelines: What's new? Thorax Usefulness of procalcitonin levels in community-acquired pneumonia according to the patients outcome research team pneumonia severity index Active surveillance of ventilator-associated pneumonia in the intensive care unit and establishment of the risk grading system and effect evaluation Neutrophil-To-Lymphocyte Ratio: An Emerging Marker Predicting Prognosis in Elderly Adults with Community-Acquired Pneumonia The neutrophil-lymphocyte count ratio in patients with community-acquired pneumonia Meta-analysis of neutrophil-to-lymphocyte and platelet-to-lymphocyte ratio in rheumatoid arthritis Association between neutrophil-lymphocyte & platelet lymphocyte ratios with prognosis & mortality in rapidly progressive glomerulonephritis The diagnostic and predictive role of NLR, d-NLR and PLR in COVID-19 patients Prognostic Value of Neutrophil-To-Lymphocyte Ratio and Platelet-To-Lymphocyte Ratio for Renal Outcomes in Patients with Rapidly Progressive Glomerulonephritis Neutrophil-to-lymphocyte ratio (NLR) and platelet-to-lymphocyte ratio (PLR) were associated with disease activity in patients with systemic lupus erythematosus Neutrophil-to-lymphocyte ratio as a serum biomarker associated with community acquired pneumonia Neutrophil-to-lymphocyte Ratio Relation to Sepsis Severity Scores and Inflammatory Biomarkers in Patients with Community-acquired Pneumonia: A Case Series Neutrophil/lymphocyte and C-reactive protein/mean platelet volume ratios in differentiating between viral and bacterial pneumonias and diagnosing early complications in children Neutrophil-to-lymphocyte ratio as an independent risk factor for mortality in hospitalized patients with COVID-19 Lymphocyte subset counts during the course of community-acquired pneumonia: Evolution according to age, human immunodeficiency virus status, and etiologic microorganisms Early circulating lymphocyte apoptosis in human septic shock is associated with poor outcome Relation between lymphopenia and bacteraemia in UK adults with medical emergencies Differential lymphopenia-induced homeostatic proliferation for CD4+ and CD8+ T cells following septic injury Ratio of neutrophil to lymphocyte counts-rapid and simple parameter of systemic inflammation and stress in critically ill Neutrophil/lymphocyte ratio and its association with survival after complete resection in non-small cell lung cancer Predictive value of neutrophil to lymphocyte ratio in outcomes of patients with acute coronary syndrome Neutrophil-lymphocyte ratio as a predictor of adverse outcomes of acute pancreatitis Assessment of neutrophil-lymphocyte ratio in ulcerative colitis: A promising marker in predicting disease severity The Optimal Cut-Off Value of Neutrophil-to-Lymphocyte Ratio for Predicting Prognosis in Adult Patients with Henoch-Schonlein Purpura Management of leukopenia in kidney and pancreas transplant recipients Review: CURB65, CRB65, and Pneumonia Severity Index similarly predict mortality in community-acquired pneumonia Severity assessment tools for predicting mortality in hospitalised patients with community-acquired pneumonia. Systematic review and meta-analysis Combination of caspofungin and low-dose trimethoprim/sulfamethoxazole for the treatment of severe Pneumocystis jirovecii pneumonia in renal transplant recipients Moderate-dose glucocorticoids as salvage therapy for severe pneumonia in renal transplant recipients: A single-center feasibility study An interdisciplinary approach for renal transplant recipients with severe pneumonia: A single ICU experience High-flow Nasal Cannula Versus Noninvasive Ventilation for Treatment of Acute Hypoxemic Respiratory Failure in Renal Transplant Recipients Diagnosis and Treatment of Adults with Community-acquired Pneumonia. An Official Clinical Practice Guideline of the Management of Adults With Hospital-acquired and Ventilator-associated Pneumonia: 2016 Clinical Practice Guidelines by the Infectious Diseases Society of America and the Lactate dehydrogenase as a prognostic marker of renal transplant recipients with severe community-acquired pneumonia: A 10-year retrospective study Combining cognitive testing and informant report to increase accuracy in screening for dementia Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach