key: cord-0027229-wyhb3z9n authors: Wang, Jia; Lai, Yiwei; Jiang, Chao; Bai, Yu; Xu, Baolei; Du, Xin; Dong, Jianzeng; Ma, Changsheng title: Feasibility and Validity of Cambridge Neuropsychological Test Automated Battery in Mild Cognitive Impairment Screening for Patients with Atrial Fibrillation date: 2022-02-08 journal: Comput Math Methods Med DOI: 10.1155/2022/1527292 sha: debe95e209b4744c18ee8ab5c22cde4295f2f994 doc_id: 27229 cord_uid: wyhb3z9n BACKGROUND: Atrial fibrillation (AF) is associated with the worsening of cognitive function. Strategies that are both convenient and reliable for cognitive screening of AF patients remain underdeveloped. We aimed to analyze the sensitivity and specificity of computerized cognitive screening strategies using subtests from Cambridge Neuropsychological Test Automated Battery (CANTAB) in AF patients. METHODS: The Multitasking Test (MTT), Rapid Visual Information Processing (RVP), and Paired Associates Learning (PAL) subtests from CANTAB were performed in 105 AF patients. Traditional standard neuropsychological tests were used as a reference standard. Cognitive screening models using different CANTAB subtests were established using multivariable logistic regression. Further stepwise regression using the Akaike Information Criterion (AIC) was applied to optimize the models. Receiver operating characteristic curve analyses were used to study the sensitivity and specificity of these models. RESULTS: Fifty-eight (55%) patients were diagnosed with mild cognitive impairment (MCI). MTT alone had reasonable sensitivity (82.8%) and specificity (74.5%) for MCI screening, while RVP (sensitivity 72.4%, specificity 70.2%) and PAL (sensitivity 70.7%, specificity 57.4%) were less effective. Stepwise regression of all available variables revealed that a combination of MTT and RVP brought about higher specificity (sensitivity 82.8%, specificity 85.8%), while PAL was not included in the optimal model. Moreover, adding education to the models did not result in improved validity for MCI screening. CONCLUSION: The CANTAB subtests are feasible and effective strategies for MCI screening among AF patients independent of patients' education levels. Hence, they are practical for cardiologists or general practitioners. Atrial fibrillation (AF) is a significant public health problem due to its increasing mortality rate, higher risks of stroke and heart failure, and escalating health care expenses [1] . In recent years, emerging evidence has revealed a higher risk of cognitive impairment among AF patients [2] . About 22%-51% of AF individuals are undergoing cognitive impairment [3, 4] . Mild cognitive impairment (MCI) is a condition in which individuals demonstrate cognitive decline with or without minimal impairment of instrumental activities of daily living (IADL) [5] . It is a critical stage for early treatment and prevention in the natural history of cognitive decline. However, MCI is often neglected by both physicians and patients for its mild symptoms. In AF patients, the prevalence of MCI could be as high as 60% in previous studies and patients may go through MCI even at a young age [6] [7] [8] . As a nonnegligible complication of AF, more emphasis should be placed on mild cognitive impairment and it should be routinely screened in clinical practice. However, our current understanding is limited, as only a few instruments were validated and were able to characterize patterns of cognitive impairment in the AF population. Furthermore, considering the necessity of longterm cognitive monitoring in the AF population, conventional paper-based scales that require in-person interviews and may have practice effect in the long run may not be the best choice. With the rapid development of societies and economies worldwide, health technologies have been enhanced [9] . The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a computerized neuropsychological test battery [10] . The tests are all standardized by automated voiceover instructions and are simple to use. In the present study, we aim to investigate an automated MCI screening strategy using CANTAB subtests to facilitate clinical management of cognitive impairment in AF patients. The present study was approved by the ethics committee of Beijing Anzhen Hospital (D11110700300000) and was conducted ethically in accordance with the World Medical Association Declaration of Helsinki. Chinese-speaking AF patients were randomly enrolled between September 2019 and January 2020 from a tertiary medical center (Beijing Anzhen Hospital, Beijing, China). Inclusion criteria are as follows: (1) complete clinical data, (2) in accordance with the diagnostic criteria of AF (AF was documented by a standard 12-lead electrocardiogram), (3) patient age over 50 years, and (4) no abnormalities in hearing or vision. Exclusion criteria were (1) known neurological or psychiatric disease or dementia, (2) alcoholism (40 mg for males and 20 mg for females) or antipsychotics, (3) patients who cannot or are unable to complete cognitive tests, and (4) patients who were treated with catheter ablation. All 105 patients were able to complete traditional standard neuropsychological tests and CANTAB tests independently and orderly. Demographics and medical histories were extracted from electronic medical records. The flow chart of the study is shown in Figure 1 . The standard cognitive assessments used for MCI diagnosis in the present study are comprised of a setting of traditional standard neuropsychological tests with published normative data of the Chinese population. As recommended by the 2018 Chinese guideline for the management of dementia and cognitive disorders [11] , we applied the Huashan version of the auditory verbal learning test (AVLT-H) [12] to assess episodic memory; in the auditory verbal learning test (AVLT), there are 12 words from three categories (flowers, occupations, and apparels) with four words for each category in the list. The AVLT-H measures both short-term recall (3-or 5-minute delay) and long-term recall (20minute delay) of the 12 words in the list over three learning trials. The digit span test (DST) [13] is for attention and working memory; in the test, there is a list of consecutive numbers; in the first trial, participants are asked to recall the consecutive numbers in the same order; in the second trial, participants should recall the numbers in the reverse order. The trail making tests A and B (TMT A and B) [14] are for executive function and information processing speed. In TMT A, the participant is asked to draw a line from 1 through 25 as fast as possible. In TMT B, the numbers are contained in circle and square shapes; the participant is asked to connect the numbers in order from the numbers 1 to 25 as quickly as possible. The semantic and phonetic verbal fluency test (VFT) [13] is for language; it consisted of two parts: phonetic verbal fluency test and semantic verbal fluency test. The phonetic verbal fluency test asked subjects to recall as many words beginning with "yi" and "wan" as they could in 2 minutes; the score is the total number of "yi" and "wan." The semantic verbal fluency test requires the participant to generate words from the category of animals and commodities; every participant is told to name animals for 60 s. The score is the total number of animals and the commodities in 1 min. And the Rey-Osterrieth complex figure test (RCFT) [15] is for visual spatial ability; the participants were required to imitate the graph and recall the graph about 20 minutes later without being reminded. The total score was 36 points. Besides, the functional activity questionnaire (FAQ) [16] was evaluated in all patients. All abovementioned tests were administered by the same physician (J Wang) who had been trained for these tests to ensure test quality consistency across all patients. The reference standard for MCI using Jak/Bondi criteria [17] is (1) impairment in any one of the cognitive tests (defined as >1.5 SD below the age-corrected normative mean) and (2) normal or mildly impaired daily activity (FAQ < 9). (CANTAB) Subtests. The CANTAB is a computerized cognitive test battery originally developed for the elderly population, containing 25 subtests for 7 cognitive domains. Considering that memory [18] , attention [19] , and executive function [20, 21] are most commonly impaired in AF patients, three corresponding subtests were selected in the present study. (1) Multitasking Test (MTT) [22] is a test of executive function which provides a measure of the ability to use multiple sources of potentially conflicting information to guide behavior; it can be done in 8 minutes. During each trial, an arrow appears on the right or left side of the screen, and the subject will be asked to make a right or left response. Before each trial, instructions on whether to respond according to "direction" or "side" will be provided to the subject. For sections of the test, the arrows' directions and sides are incongruent (2) Rapid Visual Information Processing (RVP) [23] is a sensitive tool to assess sustained attention and processing speed; it can be done in 9 minutes. In the test, there will be a white box in the center of the screen; 2 Computational and Mathematical Methods in Medicine single digits from 2 to 9 will appear in pseudorandom order at a rate of 100 digits per minute. Subjects must detect the target sequences (3-5-7) and press the button as a response (3) Paired Associates Learning (PAL) [23] is a sensitive tool to assess episodic memory and new learning; it can be done in 8 minutes. In the test, boxes will be opened on the screen in a randomized order to display the patterns hidden inside. The patterns will appear in the center of the screen, one at a time, and the subjects must touch the box where the pattern was originally located The patients completed the CANTAB subtests using an iPad under the voiceover instructions of the system without any help from physicians. The test results were generated automatically by the testing system. Analysis. R 3.5.1 was used for data analyses. We calculated the differences in test scores between MCI and cognitively normal patients using χ 2 or t-tests. Pearson or Spearman correlation analyses were then conducted to examine the association between CANTAB models and the standard tests. Model generation was conducted in a computerized method. Each CANTAB subtest provides a quantity of variables to describe cognitive function. Variables of each subtest together with age and education level were included in a multivariate logistic model, and stepwise regression was conducted to optimize the models ( Table 1 ). The stepwise regression conformed to the Akaike Information Criterion (AIC) and was achieved by the "stepAIC" function in the R package "MASS." Likewise, age, education level, and all available variables from all three subtests were included in one logistic model and then optimized in the same way to investigate the most effective and efficient combination of subtests. Receiver operating characteristic (ROC) curve analyses were further conducted to determine and compare the validity of each model, using the pROC package [24] . Among all cut-off points, the cut-off point with the highest Yourdon index (sensitivity > 80%) is selected as the optimal threshold Table 2 . The population studied has an average age of 63.8; 70 (66.7%) of them were male. 61 (58.1%) of the patients had 7-12 years of education, while 24 (22.9%) had >12 years of education and 20 (19.0%) had ≤6 years of education. Hypertension is the most common comorbidity occurring in 64 (61.0%) patients, followed by dyslipidemia (32.4%) and diabetes (21.9%). Eight (7.6%) patients had a history of stroke. All patients were given oral anticoagulants because of the radiofrequency ablation. According to the standard neuropsychological assessment (five cognitive domain tests), 47 patients were cognitively normal, and 58 patients had mild cognitive impairment. Of the 105 AF patients, 27.0% indicated single domain cognitive impairment, 28.0% had multidomain cognitive impairment. 47 (81.0%) of the MCI were nonamnestic, while only 2 (3.4%) were single-domain amnestic MCI. The detailed distribution of impaired cognitive domain in MCI with AF is shown in Figure 2 . Among patients with MCI, executive function was most commonly impaired (n = 38), followed by attention (n = 27), visual spatial function (n = 21), memory (n = 11), and language (n = 8). The models created by stepwise regression using single or multiple CANTAB subtests and their optimal sensitivity and specificity are listed in Table 3 , and the ROC curves are shown in Figure 3 . For a single CANTAB subtest, MTT alone could reach both reasonable sensitivity (82.8%) and specificity (74.5%) for MCI screening independent of age and education level, while the validities of models using RVP (sensitivity = 72:4%, specificity = 70:2%) or PAL (sensitivity = 70:7%, specificity = 57:4%) were inadequate as an ideal screening tool. After stepwise regression of age, education level and all available variables from the three tests, age, and variables from MTT and RVP were included in the optimal model (model 4), which had the same sensitivity (82.8%) as model 3 but resulted in higher specificity (85.1%). Education level as an additional factor to the models failed to improve the optimal sensitivity or specificity, further verifying the reliability and stability of the models (Table 4 ). Cognitive Tests. Correlations between computerized models and traditional battery are shown in Table 5 AF plays a significant role in cognitive decline. Emerging evidence highlighted the possibility of AF patients going through cognitive decline at a younger age [8] . Several studies have also demonstrated the negative impacts of MCI on the prognosis and treatment of AF patients [25, 26] . For example, AF patients with MCI may have to undergo worse PALTEA: PAL total errors (adjusted), the number of times the subject chose the incorrect box for a stimulus on assessment problems. RVPA: RVPA′, A′ (A prime) is the signal detection measure of a subject's sensitivity to the target sequence (string of three numbers), regardless of response tendency (the expected range is 0.00 to 1.00; bad to good). RVPML: RVP mean response latency, the mean response latency on trials where the subject responded correctly. Calculated across all assessed trials. RVPLSD: RVP response latency (SD), the standard deviation of response latency on trials where the subject responded correctly. MTTTIC: MTT total incorrect, the number of trials for which the outcome was an incorrect response (subject pressed the incorrect button within the response window). Calculated across all assessed trials. MTTLMD: MTT reaction latency (median), the median latency of response (from stimulus appearance to button press). Calculated across all correct, assessed trials. MTTMTCMD: MTT multitasking cost (median), the difference between the median latency of response (from stimulus appearance to button press) during assessed blocks in which both rules are used versus assessed blocks in which only a single rule is used. Calculated by subtracting the median latency of response during single-task block(s) from the median latency of response during multitasking block(s). [25] . MCI may also influence AF patients' ability to self-care and perform daily work [25] ; the AF patients with MCI had low gait speed which impaired their quality of life [26] . Therefore, cognitive screening for MCI is crucial for AF patients to identify cognitive impairment at an early stage so that immediate preventative measures such as lifestyle improvement and cognitive training can be taken. Preservation of mental health may in turn favour medication compliance and management of AF. Hence, cognitive screening should be a routine consideration in the clinical management of AF. Executive function is more vulnerable in AF patients than general populations [19] ; this implies the importance of MTT in MCI screening of AF patients. The correlation of MTT and RVP to cognitive domains other than executive function and attention provides these tests with additional feasibility and efficacy. A combination of MTT and RVP results in higher specificity than MTT alone, but at the cost of longer testing time (8 minutes vs. 17 minutes). Therefore, clinical application should be at the discretion of clinical circumstances; RVP should be considered if more misdiagnoses were to be avoided. It is well established that limited education or schooling is associated with cognitive decline [27] [28] [29] [30] . Cognitive assessment of these older adults is particularly challenging, because the comprehension of some traditional texts requires a certain level of education [31] . Intriguingly, in the present study, education is automatically excluded by stepwise regression in all the models; the sensitivity analysis indicated that it provides no extra increase in sensitivity and specificity regardless of the component of the models. This result is consistent with previous findings [32] , indicating that CANTAB can be widely applied in patients with varying education levels without needing to adjust the model for differing education backgrounds of patients. In the present study, the screening strategy based on CANTAB is studied expressly in the AF population, which may outperform the conventional clinical practice where scales originated from the geriatric or Alzheimer population [33] , the CANTAB strategy may be advantageous in many aspects. The CANTAB tests not only have a short testing time but also reduce the burden of test administration such as recording, scoring, and training of the administrators [34] . More importantly, unlike MoCA or the paper-pencil tests, CANTAB can minimize the practice effects, which occurs as a result of repeated testing, leading to an overestimation of the treatment effects and an underestimation of the disease progression [34, 35] . In addition, the predominantly nonverbal nature of the tests minimizes the risk of errors arising from differences in language or cultural understanding. As a remote cognitive screening tool, CANTAB prevents the problem of failing to complete follow-ups. Thus, CANTAB is an ideal instrument in longitudinal studies to trace the decline of cognitive functions. The present study has several limitations. Firstly, The number of cases we can collect is not many. And selection bias may occur, as some patients refused the neuropsychological testing. Meanwhile, the CANTAB tests are less feasible in patients with hearing loss who are at high risk of cognitive impairment. Secondly, we did not evaluate the visual-spatial ability test and language function. Whether implementation of these subtests can lead to an additional increase in screening validity requires further study, though at the cost of prolonged testing time. In conclusion, the CANTAB subtests are feasible and effective in identifying MCI patients in the AF population. It is an ideal preliminary screening instrument for cardiologists or general practitioners, because it is effective and simple to navigate. And it may further facilitate timely intervention and the preservation of mental health in AF patients. The data used to support the findings of this study are available from the corresponding authors upon request. The present study was approved by the ethics committee of Beijing Anzhen Hospital (D11110700300000) and was conducted ethically in accordance with the World Medical Association Declaration of Helsinki. All methods were carried out in accordance with relevant guidelines and regulations. Data on individual identification were removed, and only anonymous information was kept during the study process. The authors declare that they have no competing interests. 50 year trends in atrial fibrillation prevalence, incidence, risk factors, and mortality in the Framingham Heart Study: a cohort study Cognitive impairment associated with atrial fibrillation: a meta-analysis Atrial fibrillation in stroke-free patients is associated with memory impairment and hippocampal atrophy Atrial fibrillation is an independent determinant of low cognitive function: a cross-sectional study in elderly men Practice guideline update summary: mild cognitive impairment: report of the guideline development, dissemination, and implementation subcommittee of the American Academy of Neurology Atrial fibrillation as a risk factor for cognitive decline and dementia Alzheimer's disease Atrial fibrillation and cognitive function Using sequence mining to predict complex systems: a case study in influenza epidemics Does the Cambridge Automated Neuropsychological Test Battery (CANTAB) distinguish between cognitive domains in healthy older adults? Chinese guide for diagnosis and treatment of dementia 7 Computational and Mathematical Methods in Medicine and cognitive impairment Short-term delayed recall of auditory verbal learning test is equivalent to long-term delayed recall for identifying amnestic mild cognitive impairment Normative data on a battery of neuropsychological tests in the Han Chinese population Diagnostic accuracy of the Chinese version of the trail-making test for screening cognitive impairment Application of Rey-Osterrieth complex figure test in Chinese normal old people Functional activities questionnaire items that best discriminate and predict progression from clinically normal to mild cognitive impairment Atrial fibrillation, cognitive impairment, and neuroimaging Atrial fibrillation and cognitive function: case-control study Atrial fibrillation and cognitive decline in the Framingham Heart Study Association of atrial fibrillation with cognitive decline and dementia over 20 years: the ARIC-NCS (Atherosclerosis Risk in Communities Neurocognitive Study) Association of left atrial enlargement and atrial fibrillation with cognitive function and decline: the ARIC-NCS Effects of hemoencephalographic biofeedback with virtual reality on selected aspects of attention in children with ADHD Comparing web-based and lab-based cognitive assessment using the Cambridge Neuropsychological Test Automated Battery: a within-subjects counterbalanced study Developing a recognition system for classifying COVID-19 using a convolutional neural network algorithm. Cmc-Tech Mild cognitive impairment impacts health outcomes of patients with atrial fibrillation undergoing a disease management intervention Gait speed and mood, cognition, and quality of life in older adults with atrial fibrillation Illiteracy, dementia risk, and cognitive trajectories among older adults with low education Late life education and cognitive function in older adults Education and agerelated decline in cognitive performance: systematic review and meta-analysis of longitudinal cohort studies Atrial fibrillation and risk of dementia: epidemiology, mechanisms, and effect of anticoagulation Cognitive assessment tools for screening older adults with low levels of education: a critical review Influence of schooling and age on cognitive performance in healthy older adults Cognitive tests to detect dementia Test-retest reliability analysis of the Cambridge Neuropsychological Automated Tests for the assessment of dementia in older people living in retirement homes Distinctive pattern of cognitive disorders during multiple sclerosis relapse and recovery based on computerized CANTAB tests We sincerely thank our research nurses Wenyue Zhou and Yuan Tian who organized the in-person interviews. Further, we want to thank Dr. Liu He for providing statistical consultation. This work was supported by the National Key Research and Development Program of China (2020YFC2004803) and grant from the Beijing Municipal Commission of Science and Technology (D171100006817001). Jia Wang and Yiwei Lai contributed equally to this work.