key: cord-0728968-gqibvh54 authors: Liu, Ligai; Wang, Xin; Hao, Yiwei; Yang, Jingming; Yang, Di; Duan, Xuefei; Fang, Gaoli; Han, Bing; Jiang, Chunguo; Li, Junnan; Liu, Yao; Wang, Yang; Song, Rui title: The Gaps Between the Self and Professional Evaluation in Mental Health Assessment of COVID-19 Cluster Cases date: 2021-08-31 journal: Front Psychol DOI: 10.3389/fpsyg.2021.614193 sha: 77cc889d5c2fdf54b7d74fc5b73f2309c811233e doc_id: 728968 cord_uid: gqibvh54 Objective: To analyze the discrepancy between self-rating and professional evaluation of mental health status in coronavirus disease 2019 (COVID-19) cluster cases. Method: A total of 65 COVID-19 cluster cases admitted to Beijing Ditan Hospital Capital Medical University from June 14, 2020 to June 16, 2020 were included in the study. Mental health assessment was completed by self-rating and professional evaluation. The gaps between self-rating and professional evaluation in different demographic characteristics were compared. Results: The results of self-rating were inconsistent with those of professional evaluation. The gap was statistically different among certain demographic subgroups. As for anxiety, the gaps had remarkable statistics differences in subgroups of sex, monthly income, infection way, and anxiety/depression medical history. Similarly, in the terms of depression, the gaps had significant statistic differences in the subgroups of the medical history of anxiety/depression, history of physical disease, employment status and the insurance type, marriage, education (year), residing in Beijing (year), and the monthly income. Conclusion: Compared to the professional evaluation, patients had a higher self-rating, which may be related to some demographic characteristics. It suggests that screening can be conducted in patients with COVID-19 by self-rating first, and then professional evaluation should be carried out in the patients with suspicious or positive results. Since the coronavirus disease 2019 caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) had been reported in December 2019 (Zhu et al., 2020) , it has gained wide attention rapidly. SARS-CoV-2 is highly contagious (Fang et al., 2020) , and it could develop into a severe even fatal respiratory system disease (Guan et al., 2020; Huang et al., 2020) , as well as develop neurological disorders (Wenting et al., 2020; Taquet et al., 2021) . Studies show clear signs of the harmful consequences, both mentally and psychologically, of COVID-19 in the general population (e.g., anxiety and depression; World Health Organization, 2020; de Vroege and van den Broek, 2021) . Being similar to other coronaviruses (Mak et al., 2009) , patients with COVID-19 might show mental pressure, anxiety and depression syndromes, psychiatric dysfunction, and other such problems (Li et al., 2020a; Liu et al., 2020; Pappa et al., 2020; Qi et al., 2020; Torales et al., 2020; Zhang et al., 2020) , even in the long term after the disease (Taquet et al., 2021) . It is possibly because the patients experienced fear of the consequences of severe disease and the contagion (Xiang et al., 2020) . Furthermore, strict quarantine and mandatory contact-tracing policy by the health authorities could cause societal rejection, financial loss, discrimination, and stigmatization Brooks et al., 2020; Carlucci et al., 2020; Shigemura et al., 2020; Vindegaard and Benros, 2020) . Some patients even committed suicide after experiencing anxiety and insomnia in the beginning of the hospitalization. In Italy, since the beginning of the COVID-19 quarantine, domestic homicides, and murder suicides registered to date increased . But it remains unclear whether the risks are attributable to viral infections per se or the host immune response (Troyer et al., 2020) . Therefore, accurate assessment of the mental status of patients is especially important (Epstein et al., 2020) , which can avoid wastage of the limited mental health resources, and patients can be supported through less intense ways. On the contrary, it can also reduce the burden of medical workers. Previous studies showed that there were differences between self-rating and professional evaluation results, and the depression rate reported through self-rating scale was significantly higher than those through clinical interview (Lim et al., 2018) . For the slightly depression conditions, more depression symptoms can be generated through self-rating (Rush et al., 1987) . Professional evaluation and self-rating are two common clinical scales, and can provide important information for clinical doctors (Möller, 2000) . Self-rating, which is economical and practical, is widely used for survey and screening procedures, especially for slight diseases such as anxiety (Maier et al., 1990 ). The problem is the self-awareness of the patients may not reflect reality. It's hard to complete for some patients lack of reading ability (Hamilton, 1976) . While professional evaluation is a comprehensive evaluation to the symptoms of the patients by clinically trained professionals with experience, which is still the golden standard for mental disorder diagnosis (Dunstan et al., 2017) . The self-rating anxiety scale (SAS) and self-rating depression scale (SDS) of Zung are the widely used for anxiety and depression evaluation (Zung, 1965 (Zung, , 1971 Möller, 2000) . The Hamilton Anxiety (HAMA) and the Hamilton Depression (HAMD) rating scales are commonly used in evaluating anxiety and depression (Hamilton, 1959 (Hamilton, , 1960 . They are the golden standard in the depression evaluation (Bagby et al., 2004) . During the COVID-19 pandemic, it was widely used to investigate the psychological status of the different population (Li et al., 2020b) . Most of the researches on the psychological evaluation of patients with COVID-19 used self-rating scales (Guo et al., 2020) , and the application of the professional evaluations is rare. Besides, the rare research has reported the difference between self-rating and professional evaluation in the patients with COVID-19. This study conducted that both self-rating and professional evaluation in COVID-19 cluster cases, and compared the results obtained by these two methods. There were 65 cluster patients with COVID-19 enrolled in this study. All of them were admitted to Beijing Ditan Hospital from June 14, 2020 to 16 June 16, 2020, including 38 male patients, aging from 21 to 65 (42.29 ± 12.344). This is a cross-sectional observational study that is approved by the Ethics Committee of Beijing Ditan Hospital affiliated to Capital Medical University. The inclusion criteria were: (i) age >18, (ii) diagnosed as COVID-19 (mild-type to normal-type), which was based on the COVID-19 diagnosis protocol (trial version 7) issued by the State Health Committee, and (iii) patient informed consent. The exclusion criteria were: (i) had a recent history of travel and residence overseas or in other high-risk areas, (ii) had severe psychological trauma recently, (iii) having severe heart, liver, kidney, or nervous system diseases, and (iv) failed to cooperate to complete the self-rating and the professional evaluation. Demographic data were collected, including sex, age, marital status, educational background, length of residence in Beijing in the years, employment status, monthly income, insurance type, infection way, family member infected or not, smoking history, psychological disease, and other physical disease history. This study, through online survey, conducted self-evaluation by using SAS and SDS. The Chinese norm shows that the cut-off value of the SAS standard score is 50. From 50 to 59 points was slightly anxiety, 60 to 69 points were medium anxiety, and above 70 points is heavily anxiety. The Chinese norm shows that the cut-off value of the SDS standard score is 53. From 53 to 62 is slightly depression, 63 to 72 is medium depression, and above 72 is heavily depression. In addition, the mental health of the patients was assessed by the two trained attending psychiatrists, who passed the consistency evaluation, through with HAMA and HAMD. Hamilton Anxiety rating scale items were concluded into two dimensions: (i) mental anxiety and (ii) somatic anxiety. HAMD items were concluded into seven dimensions: (i) Anxiety/somatization: consisting of mental anxiety, physical anxiety, digestive symptoms, hypochondria, and insight, (ii) Weight: weight loss item, (iii) Cognitive disorder: consisting of self-guilt, suicidal, intense, depersonalization and derealization, paranoid symptoms, and obsessive compulsive symptoms, (iv) Diurnal variation: only this item, (v) Retardation: consisting of the depressive emotions, work and hobby, retardation, and sex symptoms, (vi) Sleeping disorder: consisting of the difficulty falling into sleep, sleep light and early wakeup, (vii) Desperation: consisting of the sense of diminished ability, desperation and sense of inferiority. HAMA ≥7, anxiety symptoms exist and HAMD ≥8, depression symptoms exist. The SPSS 17.0 software was used to analyze the data. Quantitative data with normal distribution were expressed using the format mean ± SD (x ± s). The t-test for the two isolated samples was used to make comparison between the two groups. One-way ANOVA was used to compare multiple groups. Mann-Whitney U-test was used to make comparison between two quantitative data groups with non-normal distribution. The Kruskal-Wallis test was used to make comparison among multiple isolated samples with non-normal distribution, and p < 0.05 was considered statistically significant. We calculate the gaps between the self-rating scale and professional evaluation in the same dimension. However, the selfrating scale and professional evaluation have completely different measurement and the scoring system. So, 0-1 normalization process is used to standardize the scores in each dimension, which makes the dimension scores comparable between the self-rating scale and the professional evaluation. The 0-1 normalization process of the ith question for the jth patient is calculated as follow: Standard i is the standardized scores for the ith question, score ij is the initial score of the ith question for the jth patient in the HAMD scale. Max (score i ) and min(score i ) are the theoretical maximum and minimum values of the scores in the ith question. Take the HAMD scores as an example, max (score i ) − mi n (score i ) = 4 − 0 = 4. We conduct this process for all the questions in the HAMD scale, and then calculate the average standardize scores in each dimension. By this way, we get the standard scores in seven dimensions in the HAMD scale. After the 0-1 normalization, the maximum standard score becomes 1 and the standard minimum score becomes 0. The exactly same process is also conducted in the SDS scale and their anxiety evaluation counterparts. Although the self-rating scale and the professional evaluation have different measurement in both the anxiety and depression evaluation, the 0-1 normalization process makes it possible to make a compare of one particular dimension between the self-rating scale and the professional evaluation. The gap between self-rating and professional evaluation within one particular dimension is calculated by the standard professional evaluation score minus standard self-rating score. All the data collected by the scales were stored in the database. Then, the calculation functions in the database could help to finish the 0-1 normalization process, and the statistical analysis was running based on these data. So, the methods allow for the replication studies. A total of 65 patients participated in this study, and 58 patients had finished both the self-rating and the professional evaluation. The self-rating is inconsistent with the professional evaluation as Figure 1 shows Kappa Consistence. The Anxiety Gap Values Between Self-Rating and Professional Evaluation The SAS score was (31.79 ± 4.742), with anxiety symptoms 0 case. The HAMA score was (4.16 ± 4.043), 12 cases (20.7%) had anxiety symptoms. The scores of two dimensions of SAS were both higher than HAMA (Figure 2) , and the differences were statistically significant (p = 0.001, p = 0.018). The value of p < 0.05 indicates that the factors are the reason for the significant difference in the gaps, and that may be the reason for the difference between the results of SAS and HAMA ( Table 1) . Among/between the subgroups of sex, monthly, and anxiety/depression medical history, the mental anxiety gap had significant difference. Between the subgroups of the infection way, the somatic anxiety gap had significant difference. The SDS score was (38.55 ± 8.664), 24 cases (41.4%) had depression symptoms, including 19 cases of mild depression, and 5 cases of moderate depression. The HAMD score was (6.10 ± 4.734), 16 cases (27.6%) had depressive symptoms, all were slightly depressed. The SDS scores on seven dimensions were all higher than HAMD (Figure 3) , and the differences were statistically significant, p < 0.05. The value of p < 0.05 indicates that the factors are the reason for the significant difference in the gaps, and that may be the reason for the difference between the results of the SDS and HAMD ( Table 2) . Among the subgroups of the insurance type, the anxiety/somatization gap had significant difference. Between the subgroups of the history of physical disease, the cognitive gap had significant difference. Among/between the subgroups of marriage, education (year), and residing in Beijing (year), the retardation gap had significant difference. Among the subgroups of education (year) and monthly, the desperation gap had significant difference. Among the subgroups of monthly, the diurnal variation gap had significant difference. Between the subgroups of the employment status and anxiety/depression medical history, the sleeping gap had significant difference. By introducing the concept of gap, this study discussed the discrepancy between self-rating and professional evaluation in the COVID-19 cluster cases for the first time. It showed that SAS and SDS scores in the same dimension were significantly higher than the HAMA and HAMD, indicating that there were significant differences between the self-rating and the professional evaluation. This was consistent with the previous reports (Rush et al., 1987; Enns et al., 2014; Krebber et al., 2014; Lim et al., 2018) . Moreover, the male subgroup and the subgroup with higher income had higher self-rating scores in the mental anxiety dimension, which might be due to the fact that they assume more family and social responsibilities, so that they were more likely to worry about the impact of illness on themselves, family life, and the career. Notably, as compared with the indirect contact with Xinfadi, where COVID-19 broke out, the patients with direct contact had higher self-rating of the somatic anxiety, who might be more in need of the attention of doctors (Troyer et al., 2020) , which is possibly because the cluster disease increased their feelings of fear and guilt to some extent. In terms of depression, patients who were non-insured were more likely to have higher self-rating of anxiety/somatic status, which might be due to their fear of bearing high-medical costs. The patients without a history of physical disease had a higher self-rating of cognitive, which might be due to the greater psychological burden of the hospitalization because they had not been hit by the disease. Compared with the patients who were divorced and widowed, the patients who were unmarried and married had higher self-rating of retardation, which might be due to their concern about the impact on their relationship or the family life. The patients with higher education level had higher self-rating of cognitive and desperation status. It was probably because the patients with better education background had better reading ability and could complete the questionnaire accurately, and also knew more about COVID-19 and understood the risk of novel coronavirus infection, which increased their depression mood. The patients with the higher income made a higher selfrating of desperation and diurnal variation, which might be caused by the fear of the disease affecting career and work, and the inability to maintain the current income level. It seemed incomprehensible that the patients without a history of depression tend to have a higher self-rating of sleeping disorder. The patients with a history of depression were able to make a more objective self-rating when they developed insomnia symptoms after being infected with the SARS-CoV-2, which was probably because they had severe insomnia before, and in particular, they had filled the similar rating scales often ever before. Those differences may be associated with the personality and demography of the patients, which is consistent with the previous studies (Enns et al., 2014) . So, when planning to assess the mental health of the patients with COVID-19 by self-rating, it is necessary to pay attention to the age, gender, work status, monthly, education level, employment status, medical history, and infection way of the patients. There may be an unobjective evaluation. For instance, the scores of the two dimensions of anxiety self-rating were both higher than those of the professional evaluation, but the patients with anxiety were not found according to the anxiety selfrating standard, which was not in accordance with the actual situation. We supposed that the SAS diagnostic threshold may need to be adjusted or improved the self-rating questionnaire when used. Therefore, in the clinical practice, we suggest that screening can be conducted by self-rating first, then the professional evaluation should be carried for the patients with suspicious or positive results, so as to reduce unnecessary contact with the patients and the workload of the medical workers (de Vroege and van den Broek, 2021). The limitations are the limited number of cases included in the study and the lack of a control group. Fortunately, the included cases were cluster cases, all from Xinfadi where COVID-19 broke, with relatively consistent background and mild condition. As a result those cases are highly homogeneous. It, to some extent, proves something. However, whether selfrating can accurately and effectively assess mental status of the patients and the reasons for the difference between the self-rating and professional evaluation will likely require the closer examination. The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s. The Hamilton Depression Rating Scale: has the gold standard become a lead weight? Italians on the age of COVID-19: the self-reported depressive symptoms through web-based survey The psychological impact of quarantine and how to reduce it: rapid review of the evidence Demographic and attitudinal factors of adherence to quarantine guidelines during COVID-19: the Italian model Results of mental support for health care professionals and mental care during the COVID-19 pandemic Screening for anxiety and depression: reassessing the utility of the Zung scales Discrepancies between self and observer ratings of depression. The relationship to demographic, clinical and personality variables Anxiety and suicidality in a hospitalized patient with COVID-19 infection Transmission dynamics of the COVID-19 outbreak and effectiveness of government interventions: a data-driven analysis Clinical characteristics of coronavirus disease 2019 in China Immediate psychological distress in quarantined patients with COVID-19 and its association with peripheral inflammation: a mixed-method study The assessment of anxiety states by rating A rating scale for depression Comparative value of rating scales Clinical features of patients infected with 2019 novel coronavirus in Wuhan Prevalence of depression in cancer patients: a meta-analysis of diagnostic interviews and self-report instruments Progression of mental health services during the COVID-19 outbreak in China Psychological status among different populations during COVID-19 epidemic: a systematic review and meta-analysis (in Chinese) Prevalence of depression in the community from 30 countries between 1994 and Effects of progressive muscle relaxation on anxiety and sleep quality in patients with COVID-19 Selfand observer assessment in anxiolytic drug trials: a comparison of their validity Longterm psychiatric morbidities among SARS survivors Rating depressed patients-observer-vs self-assessment Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID19 pandemic: a systematic review and meta-analysis Psychological morbidities and fatigue in patients with confirmed COVID-19 during disease outbreak: prevalence and associated biopsychosocial risk factors. medRxiv A comparison of self-reported versus clinician-related symptoms in depression Public responses to the novel 2019 coronavirus (2019-nCoV) in Japan: mental health consequences and target populations 6-month neurological and psychiatric outcomes in 236 379 survivors of COVID-19: a retrospective cohort study using electronic health records The outbreak of COVID-19 coronavirus and its impact on global mental health Are we facing a crashing wave of neuropsychiatric sequelae of COVID-19? Neuropsychiatric symptoms and potential immunologic mechanisms COVID-19 pandemic and mental health consequences: systematic review of the current evidence COVID-19 neurological manifestations and underlying mechanisms: a scoping review Facing Mental Health Fallout From the Coronavirus Pandemic Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed The differential psychological distress of populations affected by the COVID-19 pandemic A novel coronavirus from patients with pneumonia in China A self-rating depression scale A rating instrument for anxiety disorders The studies involving human participants were reviewed and approved by the Ethics Committee of Beijing Ditan Hospital affiliated to Capital Medical University. The patients/participants provided their written informed consent to participate in this study. RS developed the ideas in the paper and provided feedback on several drafts of the paper. LL collected the data of demographic and self-rating, and wrote the paper. XW and JY evaluated the patients by HAMA and HAMD. YH conducted statistical analysis of the data in this study. DY, XD, GF, BH, CJ, JL, YL, and YW introduced the study to the patients and obtain their consent. All authors contributed to the article and approved the submitted version. The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.Publisher's Note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.Copyright © 2021 Liu, Wang, Hao, Yang, Yang, Duan, Fang, Han, Jiang, Li, Liu, Wang and Song. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.