key: cord-0768408-465v3b36 authors: Shinohara, Tomoyuki; Saida, Kosuke; Tanaka, Shigeya; Murayama, Akihiko; Higuchi, Daisuke title: Construct validity of the Questionnaire for Older Senior Citizens based on a confirmatory factor analysis: A study during the period of self‐restraint to prevent the spread of coronavirus disease 2019 date: 2021-10-01 journal: Geriatr Gerontol Int DOI: 10.1111/ggi.14285 sha: c2cb391622ef60e51d78b89a347e2c723341c52b doc_id: 768408 cord_uid: 465v3b36 AIM: This study aims to clarify the construct and criterion‐related validity of the Questionnaire for Older Senior Citizens (QO) during the COVID‐19 pandemic. METHODS: This cross‐sectional study was conducted in Japan between November 11, 2020 and January 10, 2021. Of the 1645 (63.5%) older adults who responded, data from 900 participants were analyzed. First, we conducted an exploratory factor analysis (EFA) among older‐older adults (aged ≥75 years) and extracted the factors. Next, we conducted a confirmatory factor analysis (CFA) using structural equation modeling. We also conducted this analysis among younger‐older adults (aged ≥65 and <75 years) using the same model. Moreover, we compared each item of the QO with frailty status. RESULTS: Results of the EFA revealed six factors: social conditions and lifestyle, subjective conditions, cognitive functions, physical activity, oral functions, and physical functions. The results of the CFA were as follows: comparative fit index (CFI) = 0.971, adjusted goodness of fit index (AGFI) = 0.978, root mean square error of approximation (RMSEA) = 0.018, and standardized root mean square residual (SRMR) = 0.030. The results among the younger‐older adults were as follows: CFI = 0.880, AGFI = 0.940, RMSEA = 0.037, and SRMR = 0.048. Many QO items were significantly associated with frailty (P < 0.05). CONCLUSIONS: Among the older‐older adults group, the model used for the QO has sufficient suitability and construct validity; among the younger‐older adults group, there also is sufficient questionnaire suitability. Moreover, the QO has criterion related validity with frailty. Geriatr Gerontol Int 2021; 21: 1018–1025. Japan is an aging society, with 17.6 million (13.9%) people between 65 and 74 years old, and 18.0 million (14.2%) aged 75 or older. 1 The proportion of the population aged 65 or older is predicted to increase to 30% (reaching 35.3%) by 2040. This will affect healthcare systems, as they work differently for older adults (especially for those over 75 years old). For people over 75 years old, maintaining quality of life is particularly important, alongside providing treatments and preventing disease. Therefore, the Questionnaire for Older Senior Citizens (QO) was developed by the Japanese Ministry of Health, Labor, and Welfare 2 to comprehensively evaluate health conditions and lifestyles based on participant characteristics (e.g., frailty), in contrast to conventional questionnaires that assess metabolic syndromes. However, its validity and reliability have not yet been verified. Frailty is considered relative to deficit accumulation 3 and has multidimensional issues related to its physical, 4 psychological, and social domains. 5 Physical frailty is used as a phenotype of frailty and is operationally defined based on weight loss, muscle weakness, increased fatigue, decreased walking ability, and a reduction in activity. 4 In the psychological and cognitive domain, frailty is defined when a person exhibits declining physical and cognitive functions, 6 while social frailty involves being without interaction with the local community, which may worsen life prognosis, similar to physical frailty. 7 Living alone and not leaving the house and/or interacting with other people also leads to a decline in physical functions. 8 In addition to these three domains, oral frailty is defined as poor oral status and is a strong predictor of physical frailty, sarcopenia, the need for long-term care, and mortality. 9 Given this information, the QO may be useful for assessing the multidimensional aspects of frailty. Although the QO has been a healthcare requirement for ascertaining conditions in older adults since April 2020, 10 the assessment process has been delayed because of the spread of coronavirus disease 2019 . In Japan, the state of emergency was extended to all 47 prefectures on April 16, 2020. 11 Therefore, the validity of the QO has not yet been confirmed. Clarifying the QO's validity is useful because it can guide policymakers and healthcare professionals regarding public health strategies in Japan. Although infection control was required, we conducted the QO among community-dwelling older adults during the COVID-19 pandemic through a survey. As such, this study aimed to clarify the construct and criterion-related validity of the QO with frailty. This cross-sectional study was conducted between November 11, 2020 and January 10, 2021 in Takasaki City, Gunma Prefecture, Japan. Eligible participants were 2590 community-dwelling people aged 65 or above who lived in local housing in 14 community areas of Takasaki City and received regular support from local volunteers or support professionals. Those needing regular support were defined as such by supporters, based on their daily condition. Participants who had applied for long-term care insurance or who had cancer or had suffered a stroke were excluded. Surveys, instructions, and written consent forms were distributed by local volunteers or support professionals, which were all returned by mail. In total, 1645 older adults returned the survey forms with written consent, a total response rate of 63.5%. Approximately 1387 older adults answered all items in the QO. The number of older adults who met the exclusion criteria (having applied to long-term care insurance or having had a stroke or cancer) was 487. Therefore, 900 participants were included in the construct validity analysis (Fig. 1) . This study was approved by the Research Ethics Committee of Takasaki University of Health and Welfare (approval number 2009) and was conducted in accordance with the Declaration of Helsinki. The purpose and the handling of the information were explained to all participants, and signed written consent was obtained. This study was registered with the University Hospital Medical Information Network (UMIN000040335). The survey included the following: sociodemographic characteristics (e.g., age, sex, morbidity, living arrangements [with cohabitant or alone]) and the QO. Responses were either yes/no or ratings on a 3-to 5-point Likert scale. 2 Frailty was assessed using the Frailty Screening Index (FSI) 12 via a questionnaire and did not require face-to-face measurement. Frailty status was based on the participant's score: a score of ≥3 was defined as frail, 1 to 2 as pre-frail, and 0 as robust. Participants were divided into the older-older adults group (aged 75 years and over) and the younger-adults group (aged 65 to 74 years) and an older-older adults group (aged 75 years or over), because the QO was developed to assess health conditions of people aged 75 years and older. Descriptive statistics were run on sociodemographics and results from the QO. First, an exploratory factor analysis (EFA) was conducted on the older-older adults group to identify dimensionality among the QO items. A principal axis factor analysis with a Promax rotation method with Kaiser normalization was used. The Kaiser-Guttman eigenvalue-greater-than-one rule was used to select the number of factors to be extracted. As the QO was structured using multidimensional frailty concepts that had been previously established, items could not be dropped. Therefore, items with a factor loading of >0.20 were adopted. Second, among the older-and younger-older adults groups, a confirmatory factor analysis (CFS) using structural equation modeling (SEM) was conducted on the QO model using EFA. To evaluate model fit, a comparative fit index (CFI), adjusted goodness of fit index (AGFI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR) were used. To indicate criterion-related validity with frailty, the association between the QO and frailty status among the older-and younger-older adults groups was assessed. Because the QO was not developed for calculating a total score with all items, each of the QO response items was compared with frailty status using a chi-square test or Fisher's exact test. QO items 6, 7, and 9 are part of the FSI; therefore, these items were excluded from the analysis for criterion-related validity with frailty. Has it become more difficult to eat hard food than it was 6 months ago? Table 1 shows the participants' sociodemographic data. The mean age for the older-older adults group (n = 578) was 81.1 AE 4.4 years, and 451 participants (78.0%) were women. The most common disease was hypertension (n = 272, 47.0%), followed by dyslipidemia (n = 88, 15.2%), osteoporosis (n = 84, 14.5%), and heart disease (n = 84, 14.5%). A total of 192 participants had multimorbidity (33.2%), and 349 were living alone (60.4%). The mean age of the younger-older adults group (n = 322) was 71.0 AE 2.4 years, and 231 participants (71.7%) were women. The most common disease was hypertension (n = 129, 40.1%), followed by dyslipidemia (n = 55, 17.1%) and diabetes mellitus (n = 35, 10.9%). A total of 79 participants had multimorbidity (24.5%), and 123 were living alone (38.2%). Table 2 shows the results for each QO item. For each item, the higher the number, the worse the respondent's condition; for the number of responses, see Table 2 . EFA for the QO was performed using principal axis factor analysis with a Promax rotation method in the older-older adults group. Six factors with an eigenvalue of >1.0 were extracted based on the Kaiser-Guttman rule. The Kaiser-Meyer-Olkin measure of sampling adequacy was calculated at 0.609, and Bartlett's test of sphericity was significant (P < 0.001). We confirmed that all communalities were between 0 and 1, and there was no Heywood case. Factor loadings >0.20 were assigned to each factor (Table 3) . Factor 1 included four items: 3, 12, 14, and 15 (social conditions and lifestyle); Factor 2 involved items 1 and 2 (subjective conditions); Factor 3 involved items 10 and 11 (cognitive functions); Factor 4 involved items 9 and 13 (physical activity); Factor 5 involved items 4 and 5 (oral functions); and Factor 6 involved items 6, 7, and 8 (physical functions). We structured the QO model to comprehensively assess health conditions, assuming that the six factors extracted by the EFA were components of health conditions. The results of the CFA using SEM among the older-older adults group were as follows: CFI = 0.971, AGFI = 0.978, RMSEA = 0.018, and SRMR = 0.030 (Fig. 2a) . Meanwhile, the results for the younger-older adults group were as follows: CFI = 0.880, AGFI = 0.940, RMSEA = 0.037, and SRMR = 0.048 (Fig. 2b) . To indicate criterion-related validity with frailty, 888 participants who were able to fully complete the FSI were analyzed. The association between the QO and frailty status is presented in Table 4 . For the older-and younger-older adults groups, many items of the QO had significant associations with frailty (P < 0.05). The items for choking, smoking, and having someone to talk to if feeling unwell had no statistically significant association with frailty. The EFA for the QO extracted six factors: (1) social conditions and lifestyle, (2) subjective conditions, (3) cognitive functions, (4) physical activity, (5) oral functions, and (6) physical functions. The model for the QO involved all 15 items that were assumed to form part of a health condition assessment. The model's CFA demonstrated high suitability among the older-and younger-older adults groups. Factors 2 to 6 were structured using homogeneous items. The QO was proposed to assess frailty in older adults. It has been suggested that frailty has three domains: physical, psychological, and social; 13,14 the current study model included all three. Factor 4 (physical activity) and Factor 6 (physical functions) were related to the physical domain; Factor 2 (subjective conditions) and Factor 3 (cognitive functions) were related to the psychological domain; and Factor 1 addressed the social domain through factors such as eating (item 3), smoking (item 12), and social activities 14 and 15 ). Recently, oral frailty, which strongly predicts the onset of adverse health outcomes including mortality, has also been proposed. 9 Therefore, Factor 5 (oral functions) was assessed by asking about item 4, which asked about difficulty in eating food, and item 5, which asked about choking on tea or soup. Each factor in this model had a different significance, thereby indicating health conditions that were associated with the three domains of frailty or oral frailty. This indicated that the QO could comprehensively assess health conditions related to frailty. Four items in Factor 1 were positively related to each other based on their factor loadings (i.e., if the participants consistently ate three meals a day, were able to communicate with others or supporters, or did not smoke). In a meta-analysis, smokers in 15 countries consumed more calories, although this was not the case in Japan. 15 There was no association between smoking and caloric consumption in this context, 16 and female smokers actually consumed fewer calories. 17 The question about meals was included in the QO because greater dietary variety helps in maintaining physical performance among older adults, 18 and the smoking question was included because smoking is associated with life prognosis. 19 However, as these lifestyle choices were unlikely to be directly related to the social conditions of items 14 and 15, combining these four items into Factor 1 would result in a spurious correlation. Regarding the results of the CFA using SEM among the olderolder adults group, the CFI and AGFI were over 0.95, RMSEA Has it become more difficult to eat hard food than it was 6 months ago? 20, 21 RMSEA was recommended to be lower than 0.06, and SRMR lower than 0.08. 22 Therefore, we conclude that the model assumed for the QO based on the EFA is suitable, indicating that the QO has construct validity. Although there might be room for improvement in the model with a CFI of 0.880, the model among the younger-older adults group generally had sufficient suitability, despite the CFI. The QO prepared for the older-older adults group could also have been useful for the younger-older adults. In the model for both the older-and younger-older adults groups, the factor with the strongest correlation with health conditions was Factor 6 (i.e., physical functions). Thus, an older adult's health condition might be related to physical frailty, such as the ability or inability to walk. It was not surprising that many QO items had a statistically significant association with frailty, as QO was developed to evaluate the characteristics of frailty. 2 Although we could not assess the criterion-related validity of the QO's total score, we found that many QO items had criterion-related validity with frailty. Choking (item 5) was one of the oral status items and its decline was associated with oral frailty. 9 Oral frailty 9 and smoking habits 23 (item 12) have been reported to be predictors of frailty. However, in the present study, these factors had no cross-sectional association with frailty. The opportunity to talk to people (item 14) was related to social frailty. 24 Having someone to talk to if feeling unwell (item 15), which had no statistically significant association with frailty, might differ from opportunities to talk to people, as item 15 relates more to social support. During the QO development, item 15 was included because lack of social support was significantly associated with psychological distress. 25 Therefore, we suggest that lack of social support has a strong psychological dimension and a weak relationship with frailty, or frailty assessed by the FSI has strong physical and cognitive aspects and weak psychological and social aspects. The model of the current study, developed during the COVID-19 pandemic, is an appropriate measure of frailty. As a result of COVID-19 restrictions, the more frailty older adults had, the less subjective physical activity and smaller meal size they had. 26 Time for physical activity decreased compared with what was possible before the COVID-19 pandemic. 27 The lifestyle of the older adults may have changed during this study. Health conditions during the pandemic might have differed from those in non-pandemic times, which could have affected the findings. In particular, the opportunity for exercise and physical activities may relate to frailty differently compared with in non-pandemic times. How the finding for the QO structure might differ in pandemic and non-pandemic times should be examined in future studies. This study has several limitations. First, the QO was developed using health guidance for older adults based on their answers to each item, and the spurious structure was not considered. Second, the Japanese Ministry of Health, Labor and Welfare suggested 10 domains for the QO, 2 and the Japanese Geriatrics Society categorized the 15 items into six groups based on frailty domains. 28 As the QO might have several models, the association between the factors of the QO and clinical anchors ought to be investigated further. Third, this study was conducted in a limited area. Generalizability, by including results from other areas or participants, should be assessed in future studies. In conclusion, we have suggested a QO model that is structured by six factors (social conditions and lifestyle, subjective conditions, cognitive functions, physical activity, oral functions, and physical functions) and includes frailty domains. The CFA using SEM for the older-older adults group found that CFI = 0.971, AGFI = 0.978, RMSEA = 0.018, and SRMR = 0.030. The CFA using SEM for the younger-older adults group found that CFI = 0.880, AGFI = 0.940, RMSEA = 0.037, and SRMR = 0.048. The QO model could evaluate health conditions among the older-older adults groups as it has sufficient suitability and the QO has construct validity. Similarly, the QO generally has sufficient suitability for the younger-older adults group. Moreover, many QO items has criterion-related validity with frailty. Annual report on the ageing society Ministry of Health, Labour and Welfare. Explanation and notes for the Questionnaire for Older Senior Citizens Frailty in relation to the accumulation of deficits Frailty in older adults: evidence for a phenotype Toward a conceptual definition of frail community dwelling older people Cognitive frailty: rational and definition from an Prevalence of frailty phenotypes and risk of mortality in a community-dwelling elderly cohort Social frailty in community-dwelling older adults as a risk factor for disability Oral frailty as a risk factor for physical frailty and mortality in community-dwelling elderly Labour and Welfare. The changes for the Questionnaire used in the health checkup of medical insurance for older-older adults Covid-19: Japan prepares to extend state of emergency nationwide as "untraceable" cases soar Predictive value of frailty scores for healthy life expectancy in community-dwelling older Japanese adults The Tilburg frailty indicator: psychometric properties Fried phenotype of frailty: cross-sectional comparison of three frailty stages on various health domains Cigarette smoking is associated with unhealthy patterns of nutrient intake: a meta-analysis Dietary intake in male and female smokers, ex-smokers, and never smokers: the INTERMAP study Association between smoking status and nutrient and food group intakes among community-dwelling Japanese adults Dietary variety and decline in lean mass and physical performance in community-dwelling older Japanese: a 4-year follow-up study Population attributable numbers and fractions of deaths due to smoking: a pooled analysis of 180,000 Japanese A new look at the big five factor structure through exploratory structural equation modeling Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives Smoking as a predictor of frailty: a systematic review Is living alone a risk factor of frailty? A systematic review and meta-analysis Factors associated with psychological distress in a community-dwelling Japanese population: the Ohsaki cohort 2006 study Association between frailty and changes in lifestyle and physical or psychological conditions among older adults affected by the coronavirus disease 2019 countermeasures in Japan Effect of the COVID-19 epidemic on physical activity in community-dwelling older adults in Japan: a cross-sectional online survey Response Manual for the Questionnaire for Older Senior Citizens We would like to express our sincere gratitude to Kenichi Sudo, Munehisa Sudo, Atsushi Kuwabara, Satoshi Tanaka The authors declare no conflict of interest. Only the authors can access to the study data in accordance with the contract with the participants.