key: cord-0066933-vdt1u1mk authors: Thørrisen, Mikkel Magnus; Sadeghi, Talieh; Wiers-Jenssen, Jannecke title: Internal Consistency and Structural Validity of the Norwegian Translation of the Ten-Item Personality Inventory date: 2021-08-11 journal: Front Psychol DOI: 10.3389/fpsyg.2021.723852 sha: f1da4cfe5e1263674caa6be3ab6e749d976967e1 doc_id: 66933 cord_uid: vdt1u1mk Background: The Ten-Item Personality Inventory (TIPI) is a validated brief instrument measuring the five-factor model (FFM) personality dimensions, developed for instances where more comprehensive FFM instruments are impractical to use. The TIPI has been translated into several languages, but psychometric properties of the Norwegian version (N-TIPI) have not been systematically explored. Objectives: This study aimed to explore the psychometric properties of the N-TIPI, in terms of internal consistency and structural validity. Methods: In a cross-sectional study, responses on the N-TIPI were collected from 5,009 Norwegian master graduates. Descriptive statistics for the subscales and correlations between subscales were calculated. Internal consistency was assessed with inter-item correlations, Cronbach’s α and Spearman-Brown coefficients. Structural validity was explored with principal component analysis, parallel analysis, and visual scree plot inspection. Results for the N-TIPI were compared with those previously reported for the original TIPI as well as the German, French, Spanish, and Portuguese versions. Results: Compared with the original and non-English versions of TIPI, results for N-TIPI showed comparable subscale rank order of means, standard deviations, and pattern of correlations between subscales, as well as inter-item correlations and Cronbach’s α. The 10 N-TIPI items were adequately reduced to five components, theoretically corresponding with the FFM personality domains. Conclusion: The N-TIPI demonstrated acceptable internal consistency and satisfactory structural validity. Although further research is warranted, the instrument stands out as feasible when it is essential to minimize participants’ response burden in studies that aim to explore personality as one among several concepts or utilize personality traits as covariates. The five-factor model (FFM) of personality (McCrae and Costa, 2008) , often referred to as the Big Five, represents the predominant model for capturing and understanding individual differences in personality (John et al., 2008) . The FFM assumes that personality is organized in five broad domains: extraversion (E), agreeableness (A), conscientiousness (C), neuroticism (N; also oppositely named emotional stability, ES), and openness to experience (O; John et al., 2008) . The FFM taxonomy has demonstrated cross-cultural replicability (McCrae et al., 1998) , and a large body of evidence has suggested that personality traits predict a variety of life outcomes, such as health, longevity, marital success, and educational as well as occupational attainment (Ozer and Benet-Martinez, 2006; Roberts et al., 2007) . In research, measurement of personality is expedient for a variety of purposes across fields and topic areas. Several instruments for measuring the FFM domains have been developed and validated, including the 240-item NEO Personality Inventory-Revised (NEO-PI-R; Costa and McCrae, 1992) , the 60-item NEO Five-Factor Inventory (NEO-FFI; Costa and McCrae, 1992) , and the 44-item Big-Five Inventory (BFI; John and Srivastava, 1999) . The most comprehensive instrument, the NEO-PI-R, takes approximately 45 min to complete (Gosling et al., 2003) , which is often considered too lengthy in research that does not solely focus on personality exploration. In many instances, even the NEO-FFI and BFI may be considered too comprehensive, taking approximately 15 and 5 min to complete, respectively (John and Srivastava, 1999) . Researchers may want to study personality as one among several concepts, or simply control for participants' personality characteristics (Storme et al., 2016) , which can be difficult by means of relatively lengthy instruments. In practice, "circumstances are often not ideal and researchers may be faced with a stark choice of using an extremely brief instrument or using no instrument at all" (Gosling et al., 2003, p. 505) . Gosling et al. (2003) developed the Ten-Item Personality Inventory (TIPI) as a brief and time-efficient measure of the FFM personality domains. The TIPI comprises a total of 10 items. More specifically, the instrument consists of five two-item subscales corresponding to the FFM domains, scored on a seven-point Likert scale. The original psychometric evaluation of the TIPI (Gosling et al., 2003) concluded that this brief instrument constitutes a reasonable proxy for more comprehensive FFM instruments, e.g., by demonstrating acceptable convergent and discriminant validity, test-retest reliability, and patterns of external correlations. Also, the TIPI has been used to measure personality states in experience sampling studies (e.g., Sosnowska et al., 2020) . The TIPI has been utilized comprehensively, which is reflected in that the instrument's validation article (Gosling et al., 2003) has been cited more than 7,500 times in the literature. The TIPI has later been translated into a variety of languages, and several non-English versions of the instrument have demonstrated acceptable psychometric properties, including translations into Bangla (Islam, 2019) , Catalan (Renau et al., 2013) , French (Storme et al., 2016) , Georgian (Martskvishvili et al., 2020) , German (Muck et al., 2007) , Indonesian (Akhtar, 2018) , Japanese (Iwasa and Yoshida, 2018) , Persian (Azkhosh et al., 2020) , Portuguese (Nunes et al., 2018) , and Spanish (Romero et al., 2012; Renau et al., 2013) . A Norwegian version of the TIPI (N-TIPI) was developed by Cristina Aicher and is available online (Gosling, n.d.) . According to Bergvik and Wynn (2012, p. 392) , the N-TIPI "was developed by using standard translation back-translation procedures by bilingual native English and native Norwegian researchers. " The N-TIPI has been utilized in research, for instance in studies of study and work addiction (Atroszko et al., 2016) , the use of digital technology among hospitalized patients (Bergvik and Wynn, 2012) , pandemic behavior (Götz et al., 2021) , and anxiety and depression among odontology students (Risstad et al., 2017) . However, the internal consistency and structural validity of the N-TIPI have not been systematically explored. The aim of this study was to explore the psychometric properties of the Norwegian version of the TIPI (N-TIPI), in terms of internal consistency and structural validity. Psychometric properties of the N-TIPI were compared with the original version (Gosling et al., 2003; Ehrhart et al., 2009 ) as well as with four non-English translations: German (Muck et al., 2007) , French (Storme et al., 2016) , Portuguese (Nunes et al., 2018) , and Spanish (Renau et al., 2013) . These non-English versions were selected based on them being properly validated. It was a priori assumed that it was more suitable to compare the Norwegian translation with other European languages than for instance with Bangla, Indonesian, or Persian translations. This study was designed as a cross-sectional psychometric assessment of the N-TIPI, conducted in a sample of 5,009 Norwegian master graduates. Data were obtained from the Norwegian graduate survey, a digital survey conducted among Norwegian graduates with a master degree or equivalent in 2019, 3 years upon graduation, by the Nordic Institute for Studies in Innovation, Research and Education (NIFU; Skjelbred, 2019). The eligible sample included all individuals who had graduated from Norwegian higher education institutions in 2016 (n = 12,578) as well as Norwegian citizens who had graduated from higher education institutions abroad in 2015 and 2016 (n = 5,018). Hence, a total of 17,596 individuals were invited, and 6,188 (35.2%) provided informed consent and agreed to participate. According to Skjelbred et al. (2019) , individuals who agreed to participate were substantially representative of the population. However, 1,179 graduates failed to respond on all relevant study items and were excluded, leaving a final study sample of 5,009 individuals. Frontiers in Psychology | www.frontiersin.org Females constituted the majority of the sample (62.4%), individuals aged 28-30 years represented the most common age group (49.3%), and social sciences/law (22.1%) and natural/ technical sciences (21.7%) were the most prevalent fields of study among the participants. Characteristics of the study sample are presented in Table 1 . The N-TIPI was administered to participants by means of a digital survey. The 10 items are designed to measure the FFM personality domains (E, A, C, ES, and O), each domain with two items (Gosling et al., 2003) . Participants were asked to indicate, on a seven-point Likert scale (1 = disagree strongly; 2 = disagree moderately; 3 = disagree a little; 4 = neither agree nor disagree; 5 = agree a little; 6 = agree moderately; and 7 = agree strongly), the extent to which they agreed that a set of 10 descriptive statements applied to them. For instance, "extraverted, enthusiastic" (Norwegian: "utadvendt, entusiastisk") and "reserved, quiet" (Norwegian: "reservert, stille") represented the indicators of the E domain. An overview of items, item wordings, and response categories for the N-TIPI and the original TIPI is presented in Table 2 . The five subscales were constructed with the following procedure (Gosling et al., 2003) : First, reverse-scored items (N-TIPI-2, N-TIPI-4, N-TIPI-6, N-TIPI-8, and N-TIPI-10) were recoded, ensuring that higher scores indicated higher domain values. Second, a mean score was calculated for each subscale. The 10 N-TIPI items were analyzed descriptively by calculating means (M) and standard deviations (SD), separately for the 10 items as well as for the five subscales. Descriptive statistics for the N-TIPI subscales were compared with results reported for the original TIPI (Gosling et al., 2003) , the German TIPI-G (Muck et al., 2007) , the French TIPI-F (Storme et al., 2016) , the Spanish TIPI-SPA (Renau et al., 2013) , and the Portuguese TIPI-P (Nunes et al., 2018) . The N-TIPI pattern of subscale correlations was calculated and compared to those reported for the original TIPI (Ehrhart et al., 2009) , and for the TIPI-G and TIPI-F. Internal consistency of the N-TIPI was assessed by calculating inter-item correlations (Pearson r), Cronbach's α, and Spearman-Brown coefficients (S-B) for each of the five two-item subscales. N-TIPI estimates of internal consistency were compared with those reported for the original TIPI, TIPI-G, TIPI-F, TIPI-SPA, and TIPI-P. Although S-B coefficients are generally considered more appropriate than Pearson r and Cronbach's α for estimating internal consistency of two-item scales (Eisinga et al., 2013) , the two latter statistics were also applied in this study to enable comparisons with the other TIPI versions. (Gosling et al., 2003) . b Norwegian translation, developed by Cristina Aicher (Gosling, n.d.) . The structural validity of the N-TIPI was assessed with exploratory principal component analysis (PCA) using orthogonal (varimax) rotation. Parallel analysis (Horn, 1965) and visual scree plot inspection (Cattell, 1966) were performed to aid in determining the adequate number of components to extract. It was a priori defined that a fully satisfactory component structure had to meet the following six criteria: (1) The 10 items had to be suitable for PCA, as indicated by a statistically significant Bartlett's test of sphericity (p < 0.05; Bartlett, 1954 ) and a Kaiser-Meyer-Olkin measure of sampling adequacy (KMO) reaching ≥0.50 (Kaiser, 1974; Hutcheson and Sofroniou, 1999) ; (2) the component structure had to demonstrate five components with Eigenvalues (λ) ≥1.00 (Kaiser, 1960) , and the extraction of five components had to be supported by both parallel analysis and visual scree plot inspection; (3) the five-component structure had to explain ≥50% of the variance in the data, and each of the five components had to explain ≥10% of the variance (Merenda, 1997) ; (4) the 10 items had to load pairwise on the five components, theoretically in accordance with the FFM personality domains; (5) each item had to load substantially (≥0.40) on its corresponding FFM component (Ford et al., 1986; Hair et al., 1998) , without any cross-loadings, i.e., without loadings of ≥0.32 on two or more components (Costello and Osborne, 2005) ; and (6) each item communality (h 2 ) had to reach ≥0.20 (Child, 2006 ). An exploratory analysis was chosen in order to investigate whether it was possible to generate a FFM with a bottom-up (data driven) approach that satisfied the abovementioned six criteria, rather than to simply examine properties of a pre-defined five-factor solution (confirmatory analysis). Orthogonal rotation was chosen based on an a priori assumption that components would not be correlated at ≥0.32 (Tabachnick and Fidell, 2013) . All analyses were performed with IBM SPSS version 27, with the exception of parallel analysis that was conducted with an engine developed by Patil et al. (2017) . The analytical procedures were based on the COSMIN guidelines for evaluating internal consistency and structural validity of measurement instruments (Terwee et al., 2012) . Participants were assured confidentiality and informed that participation was voluntary. Written informed consent was obtained from all participants (see Skjelbred et al., 2019 for more details). Gosling et al. (2003) . b Muck et al. (2007) . c Storme et al. (2016) . d Renau et al. (2013) . e Nunes et al. (2018) . Frontiers in Psychology | www.frontiersin.org Means and standard deviations for the N-TIPI items are presented in Table 3 . Of the N-TIPI subscales, the highest mean scores were found for C (M = 5.78; SD = 1.07), followed by O (M = 5.33; SD = 0.99), ES (M = 5.15; SD = 1.24), E (M = 4.88; SD = 1.45), and A (M = 4.77; SD = 1.09). Descriptive statistics for the N-TIPI subscales -compared with the original TIPI, TIPI-G, TIPI-F, TIPI-SPA, and TIPI-P -are presented in Table 4 . Table 4 , the N-TIPI subscales demonstrated a comparable rank order of means and standard deviations as the original TIPI, TIPI-G, and TIPI-SPA, i.e., with higher mean scores for C and O than for ES, E, and A. TIPI-F and TIPI-P deviated from this pattern by having higher mean scores for A and C than for O, ES, and E. All five N-TIPI subscales were significantly correlated, yet none of the subscales were correlated ≥0.32. In line with the original TIPI, all subscale associations were positive and the correlation between E and O was the strongest (r = 0.28, p < 0.001 for the N-TIPI). Correlations between N-TIPI subscales -compared with the original TIPI, TIPI-G, and TIPI-F -are presented in Table 5 . As shown in Table 5 , the pattern of correlations between the N-TIPI subscales was quite comparable to those reported for the original TIPI, TIPI-G, and TIPI-F. Internal consistency was highest for the E subscale (r = 0.61, Internal consistency for the N-TIPI subscales -compared with the original TIPI, TIPI-G, TIPI-F, TIPI-SPA, and TIPI-P -are presented in Table 6 . As evident in Table 6 , N-TIPI subscale inter-item correlations (range: r = 0.22 to 0.61) and estimates of Cronbach's α (range: α = 0.35 to 0.75) were quite comparable to those reported for the original TIPI (r = 0.28 to 0.61; α = 0.40 to 0.74) and TIPI-G (α = 0.42 to 0.67). The internal consistency of N-TIPI was somewhat higher than results reported for the TIPI-F Gosling et al. (2003) , 2 Muck et al. (2007) , 3 Storme et al. (2016) , 4 Renau et al. (2013) , and 5 Nunes et al. (2018) . Frontiers in Psychology | www.frontiersin.org 6 August 2021 | Volume 12 | Article 723852 (r = 0.13 to 0.52; α = 0.22 to 0.69), TIPI-SPA (r = 0.16 to 0.46; α = 0.08 to 0.71), and TIPI-P (α = 0.39 to 0.72). The N-TIPI demonstrated satisfactory structural validity. The 10 items were deemed suitable for PCA (Table 7) , as indicated by a statistically significant Bartlett's test of sphericity (p < 0.001) and a KMO of 0.56. The PCA identified five components with λ exceeding 1.0 (C 1 = 2.24; C 2 = 1.63; C 3 = 1.29; C 4 = 1.06; C 5 = 1.03). A parallel analysis ( Table 8 ) indicated that only components with an λ of ≥1.01 should be retained. Hence, parallel analysis supported the extraction of five components (for the sixth component, the randomly generated λ exceeded the corresponding λ in the data: λ6 random = 0.99; λ6 data = 0.86). Although somewhat unclear, the scree plot (Figure 1 ) indicated an inflection between the fifth and sixth components, supporting the extraction of five components. Frontiers in Psychology | www.frontiersin.org Table 7 , the five-component structure explained a total of 72.4% of the variance in the data, and each of the five components explained more than 10% of the variance (C 1 = 22.36%; C 2 = 16.25%; C 3 = 12.89%; C 4 = 10.64%; C 5 = 10.25%). The 10 N-TIPI items loaded pairwise on the five components, theoretically in accordance with the FFM personality domains. Each item loaded substantially (≥0.40) on its corresponding FFM component without any cross-loadings. Each item communality (h 2 ) reached ≥0.20 (range: h 2 = 0.48 to 0.84). In sum, the results showed that the N-TIPI met the six a priori defined criteria for a fully satisfactory component structure. First, preliminary analyses yielded suitability for PCA. Second, a five-component structure was supported by PCA, parallel analysis, and visual scree plot inspection. Third, the five-component structure explained more than 50% of the variance in the data and each of the components explained at least 10% of the variance. Fourth, the items loaded pairwise on the five components in accordance with the FFM personality domains and each item loaded substantially on its corresponding FFM component without any cross-loadings. Finally, each item communality reached ≥0.20. The aim of this study was to explore the psychometric properties of the Norwegian version of the TIPI (N-TIPI). Results showed that the N-TIPI demonstrated acceptable psychometric properties in terms of internal consistency and structural validity. Compared to the original TIPI (Gosling et al., 2003) , the German TIPI-G (Muck et al., 2007) , and the Spanish TIPI-SPA (Renau et al., 2013) , the N-TIPI demonstrated a comparable rank order of subscale means and standard deviations. TIPI-F (Storme et al., 2016) and TIPI-P (Nunes et al., 2018 ) displayed a somewhat different pattern, which can be attributed to measurement issues, or may reflect actual cultural differences between countries. The N-TIPI also showed a comparable pattern of correlations between subscales with those reported for the original TIPI (Ehrhart et al., 2009), TIPI-G, and TIPI-F (Storme et al., 2016) . Moreover, the N-TIPI demonstrated satisfactory structural validity: The 10 N-TIPI items could be adequately reduced to five components, theoretically corresponding with the FFM personality domains (E, A, C, N/ES, and O). Previous research on the TIPI has indicated that this brief instrument constitutes a reasonable proxy for more comprehensive FFM instruments (Gosling et al., 2003) , such as the 240-item NEO-PI-R and 60-item NEO-FFI (Costa and McCrae, 1992) as well as the 44-item BFI (John and Srivastava, 1999) . Response burden is an important consideration when designing questionnaires. Research has indicated that participation rates have been declining over time (Galea and Tracy, 2007; Boyle et al., 2021) and a systematic review and meta-analysis of the relationship between response rate and questionnaire length found that longer questionnaires were associated with lower response rates (Rolstad et al., 2011) . Response rate is seen as an indicator of study quality, and low response rates constitute a concern for external validity, i.e., for the "generalizability of findings to and across target populations" (Pedhazur and Schmelkin, 1991, p. 229) . The N-TIPI may thus be a serviceable alternative to more comprehensive FFM instruments when it is essential to minimize participants' response burden in studies that aim to explore personality as one among several concepts or utilize personality as a covariate. Although the N-TIPI generated estimates of internal consistency comparable to those reported for the original TIPI, TIPI-G, TIPI-F, TIPI-SPA, and TIPI-P, low internal consistency (e.g., low Cronbach's α coefficients for the subscales) has been emphasized as a limitation applying to most versions of this brief instrument (Storme et al., 2016) . It should be noted, however, that it is far from straightforward to adequately assess internal consistency for two-item scales. Scholars disagree on which measures are most appropriate in such instances. While Cronbach's α is the most frequently applied statistic, some argue that Pearson correlation is more appropriate, yet others advocate the utilization of Spearman-Brown coefficients (Eisinga et al., 2013) . Eisinga et al. (2013, p. 641) conclude that the latter is most serviceable to two-item scales: "[T]he Spearman-Brown coefficient is never lower than coefficient alpha and almost always higher. It is also on average less biased, especially if the correlation between the items is relatively strong. " In this study of the N-TIPI, we assessed subscale internal consistency in terms of Pearson correlations, Cronbach's α, and Spearman-Brown coefficients. Unfortunately, Spearman-Brown coefficients are not reported for the other versions of TIPI. Hence, we were only able to compare inter-item correlations and α coefficients. The current exploration of measurement properties of the N-TIPI assumed a reflective approach based on an assumption that items were correlated and constituted effects of common latent factors (Markus and Borsboom, 2013) . Hence, it was deemed appropriate to assess internal consistency and component structure. One may argue that the TIPI (in line with other FFM instruments) is based on a reflective model, which is evident in that the validation of the original instrument focused on reflective statistical procedures, such as inter-item correlations and Cronbach's α (Gosling et al., 2003) . However, rather than emphasizing internal consistency, the original TIPI was designed with an aim of maximizing content validity in order to capture the breadth of the FFM domains (Gosling et al., 2003) . Therefore, one may not expect the TIPI to reach commonly accepted thresholds of internal consistency. As noted by Chiorri et al. (2014, p. 110) , the developers could have tackled this problem by using "items with a very high correlation (e.g., r > 0.70), which, given their unavoidable redundancy, would have undermined content coverage. " According to DeVellis (2003) , satisfactory scale internal consistency is indicated by Cronbach's α reaching ≥0.70. Given that the TIPI consists of two-item subscales, and since the instrument was not designed to maximize internal consistency, it was in this study more pivotal to compare the internal consistency of N-TIPI with other validated versions of TIPI rather than with conventional thresholds for acceptable scale reliability. Alternatively, measurement properties of the N-TIPI could have been explored with a formative approach, i.e., assuming that items did not necessarily correlate and that they constituted samples of particular behaviors rather than effects of common latent factors (Markus and Borsboom, 2013) . For instance, Myszkowski et al. (2019) demonstrated that a formative approach had merits in comparison with a traditional reflective approach for short scales with a broad content, such as the TIPI. This is the first study to systematically explore psychometric properties of the Norwegian version of the TIPI (N-TIPI). We were able to demonstrate acceptable internal consistency and satisfactory structural validity of the N-TIPI. The study sample was large (n = 5,009) and substantially representative of the eligible sample . However, certain limitations should be kept in mind when interpreting results from this study. First, the sample consisted solely of individuals who had completed a master's degree or equivalent, and participants were thus far higher educated than the general Norwegian population. Second, due to the study's cross-sectional design and certain data limitations (N-TIPI was the only FFM instrument in the survey), we were not able to assess test-retest reliability of the N-TIPI or convergent validity with other validated FFM instruments. This study represents an important step on the path to a fully validated Norwegian version of the TIPI. Future research on the N-TIPI could benefit from utilizing general population samples, exploring test-retest reliability and convergent validity with other validated Norwegian FFM instruments, i.e., the NEO-PI-R, NEO-FFI, and BFI (Martinsen et al., 2003 (Martinsen et al., , 2005 Engvik and Føllesdal, 2005) . A large and growing number of TIPI versions have been and are being developed, and this brief FFM instrument is widely utilized in research. Future research on the TIPI could benefit from secondary research efforts (e.g., systematic or scoping reviews) focusing on providing an overview of translated and validated versions and their psychometric properties. This was the first study to systematically explore psychometric properties of the N-TIPI. The N-TIPI demonstrated acceptable internal consistency and satisfactory structural validity. Although further research on the N-TIPI is warranted, the instrument stands out as feasible when it is essential to minimize participants' response burden in studies that aim to explore personality as one among several concepts or utilize personality traits as covariates. Publicly available datasets were analyzed in this study. The data analyzed in this study was obtained from the Norwegian Centre of Research Data (NSD; https://doi.org/10.18712/ NSD-NSD2941-V1). Requests to access this dataset should be directed to nsd@nsd.no. The studies involving human participants were reviewed and approved by Norwegian Centre for Research Data. The patients/ participants provided their written informed consent to participate in this study. This study was designed by MT, TS, and JW-J. MT analyzed the data and drafted the manuscript. TS and JW-J provided scientific input to the different drafts and provided data interpretation. All authors made critical revisions and provided intellectual content to the manuscript, approved the final version to be published, and agreed to be accountable for all aspects of this work. Translation and validation of the ten-item personality inventory (TIPI) into Bahasa Indonesia The relationship between study addiction and work addiction: a cross-cultural longitudinal study Reliability and validity of the 10-item personality inventory among older Iranians A note on the multiplying factors for various χ 2 approximations The use of short message service (SMS) among hospitalized coronary patients Physical measures and biomarker collection in health surveys: propensity to participate The scree test for the number of factors The Essentials of Factor Analysis Psychometric properties of a revised version of the ten item personality inventory Revised NEO Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis Scale Development: Theory and Applications. 2nd Edn Testing the latent factor structure and construct validity of the ten-item personality inventory The reliability of a twoitem scale: Pearson, Cronbach, or spearman-Brown? The big five inventory på norsk [The big five inventory in Norwegian The application of exploratory factor analysis in applied psychology: a critical review and analysis Participation rates in epidemiologic studies Ten Item Personality Inventory (TIPI). Available at A very brief measure of the big-five personality domains How personality and policy predict pandemic behavior: understanding shelteringin-place in 55 countries at the onset of COVID-19 Multivariate Data Analysis. 5th Edn A rationale and test for the number of factors in factor analysis The Multivariate Social Scientist The big five model of personality in Bangladesh: examining the ten-item personality inventory Psychometric evaluation of the Japanese version of the ten-item personality inventory (TIPI-J) among middle-aged, and elderly adults: concurrent validity, internal consistency and test-retest reliability Paradigm shift to the integrative big five trait taxonomy The big five trait taxonomy: history, measurement, and theoretical perspectives The application of electronic computers to factor analysis An index of factorial simplicity Reflective measurement models, behavior domains, and common causes Norsk utgave av Revised NEO Personality Inventory (NEO-PI-R) [Nowegian version of the Revised NEO Personality Inventory Norske versjoner av NEO PI-R og NEO FFI [Norwegian versions of NEO PI-R and NEO FFI Psychometric properties of the Georgian versions of the big five questionnaires Empirical and theoretical status of the five-factor model of personality traits Cross-cultural assessment of the five-factor model: the revised NEO personality inventory A guide to the proper use of factor analysis in the conduct and reporting of research: pitfalls to avoid Construct validation of a short five-factor model instrument. A self-peer study on the German adaptation of the ten-item personality inventory (TIPI-G) Are reflective models appropriate for very short scales? Proofs of concept of formative models using the ten-item personality inventory Short scales for the assessment of personality traits: development and validation of the Portuguese ten-item personality inventory (TIPI) Personality and the prediction of consequential outcomes Parallel analysis engine to aid in determining number of factors to retain using R Measurement, Design, and Analysis: An Integrated Approach Translation and validation of the ten-item personality inventory into Spanish and Catalan. Aloma: Revista de Psicologia Angst og depresjon blant norske tannlegestudenter [Anxiety and Depression Among Norwegian Odontology Students The power of personality: the comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes Response burden and questionnaire length: is shorter better? A review and meta-analysis Measuring personality traits with ultra-short scales: a study of the ten item personality inventory (TIPI) in a Spanish sample The Norwegian Candidate Survey Betydningen av utdanning fra utlandet for tidlig karriere Nordic Institute for Studies in Innovation, Research and Education (NIFU) New directions in the conceptualization and assessment of personality -a dynamic systems approach Psychometric properties of the French ten-item personality inventory (TIPI) Using Multivariate Statistics. 6th Edn Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.