key: cord-0028884-s7bgf9cl authors: Lee, Sangmi T.; Yang, Eunbae B. title: Factors affecting social accountability of medical schools in the Korean context: exploratory factor and multiple regression analyses date: 2022-03-21 journal: nan DOI: 10.1080/10872981.2022.2054049 sha: 595c3b0cdc6c92aa162b5415f423a999d1c43ba6 doc_id: 28884 cord_uid: s7bgf9cl The concept of social accountability of medical schools is becoming increasingly important worldwide, and numerous frameworks and evaluation tools have been developed. This study examined how global concepts work in a specific context by identifying the factors affecting medical schools’ social accountability performance in the Korean context. A survey was conducted with 40 current deans of medical schools and 15 medical education experts in Korea to assess their opinions on the implementation of social accountability of medical schools. A questionnaire survey comprising five key factors, including 39 items, was developed based on a literature review. Exploratory factors were analyzed to derive factors affecting social accountability Multiple regression analysis was conducted to determine the importance of each factor in the implementation of social accountability of medical schools. The exploratory factor analysis revealed that eight factors in three areas influenced the implementation of social accountability by medical schools. The hardware (H) area included the declaration of social accountability and physicians, organizations and systems for implementing social accountability, and physical environment and finance. The software (S) area included curriculum design-related social accountability and monitoring and evaluation system. The partner (P) area included the proximity between partners, building partnerships among stakeholders, and interactions between partners. Multiple regression analysis revealed that ‘interactions between partners’ had the greatest impact on the implementation of social accountability of medical schools. It is a social accountability implementation model that reflects global principles within the Korean context. The HSP model is significant in that individual medical schools can be used in establishing mandated mechanisms for accreditation. Future studies could adapt this model to study standards and indicators in other contexts. As life expectancy increases with the development of medical technology, health systems across the globe face the common challenges of aging and lack of access to quality health services [1] . Medical education at medical schools in rural areas worldwide is rapidly developing; however, the simultaneous lack of interest in primary care and the outflow of human resources into metropolitan areas are causing health inequality [2] . The concept of social accountability of medical schools is important to the World Health Organization (WHO) and the World Federation of Medical Education (WFME) [3] , who have exhorted changes in the role of health-care workers and advocate designing medical education for them. In addition, the concept of social accountability of medical schools encourages the reform of the health-care system [4] . The Korean government has proposed a new policy on public health care, and the demand for strengthening social accountability education and accreditation of medical schools is increasing. Since the WHO announced the concept of social accountability in 1995, its implementation in medical schools has been emphasized even further [5] . Medical schools should respond to the demand for social accountability and produce graduates whose professionalism reaches beyond being good practitioners and who serve as agents of change in the health system [6] . To be socially accountable, medical schools should develop a positive impact in the communities they serve, train competent health professionals who can address populations' needs, and define their health priorities jointly with their community, regional, and national health-care stakeholders [7] . The Alma-Ata Declaration (1978) and Astana Declaration (2018) called for urgent action by all governments, the global health workforce, and the world community to protect 'health for all' people globally [8] . In 2010, the Global Consensus for the Social Accountability of Medical Schools (GCSA) established 10 strategic directions to guide medical schools to become socially accountable by redefining their role, reorienting their education, research, and service, and strengthening governance and partnership with other stakeholders. The consensus also stated that all countries should establish accreditation mechanisms for medical schools [9] . Prior studies on the social accountability of medical schools can be largely divided into research related to concepts of social accountability [4, 5, 10, 11] , accountability frameworks and performance models [7, [12] [13] [14] [15] , accountability-related programs [16] [17] [18] [19] , accountability assessmentrelated indicators [20] [21] [22] [23] [24] [25] , partnerships with key stakeholders [2, 26, 27] , and so on. Furthermore, based on the factors affecting the implementation of social accountability in medical schools, previous studies can be categorized into those focused on human resource factors, program factors, organizational factors, partnership factors, and environmental factors. These prior studies provide insight into the development and implementation of social accountability. However, most of these studies focus primarily on global principles, while context-specific examination of the social accountability of medical schools is still lacking in extant literature. In addition, attempts and educational reforms to measure social accountability performance in the areas of education, research, and service of medical schools, such as the grid model, CPU model, THEnet framework, AIDER model, ASPIRE criteria, and CARE model, are emerging [14] . However, it is necessary to fully discuss whether models developed within the USA, Canada, and Europe can be applied to specific countries. This research, therefore, aimed to examine the key factors affecting the social accountability of medical schools in the Korean context using exploratory factor analysis (EFA) and multiple regression analysis. The findings are expected to help establish an essential mechanism for accreditation in the Korean context and effectively establish a continuous improvement plan for the implementation of social accountability. In the Korean context, medical schools have traditionally emphasized quantitative growth and training of medical personnel centered on patient care from a macro perspective, without much focus on the role of social accountability of medical schools to the community, region, or country. The ultimate purpose of this study was to reconsider the role of medical schools in social accountability within the community, region, and country, and to present a model that could strengthen their performance. To identify the factors affecting the implementation of social accountability in medical schools, 55 responses, including those of the current deans of all 40 medical schools in Korea, and 15 from medical education experts in Korea, were incorporated in the final report. The dean of a medical school represents the overall education and the implementation of accountability of the medical school, and medical education experts have expertise related to the implementation of social accountability. The group of 15 medical education experts selected for this study comprised people with more than 5 years of medical education and research experience and was divided into three subgroups (Group A: five medical education majors, Group B: five evaluation experts with experience in accreditation, and Group C: five evaluation experts with self-evaluation experience in medical schools). Full-time faculty related to medical education, and those with more than 5 years of education experience were selected to meet all the selection criteria suggested in this study. The specific criteria for selecting Group A were those who held a doctorate in medical education or pedagogy, and who were currently serving as full-time faculty in the medical education department. Group B's expert group related to accreditation comprised full-time faculty who were members of the Korean Institute of Medical Education and Evaluation (KIMEE) and belonged to the Committee on Standards. Group C's selfevaluation committee chairman and executive secretary expert group were selected from each medical school that had accreditation based on ASK2019, the current accreditation standard for Korean medical schools. All 40 medical schools' deans and 15 medical education experts selected for the study were assured that they would not be identified through any report in this study and that their data would be anonymized, after which they provided written consent to participate. This study was approved by the Institutional Review Board at Yonsei University Health System (Y-2020-0087). We developed a survey tool to identify the key factors influencing the social accountability performance of medical schools, called the 'Opinion Survey on the Importance of Factors Influencing the Implementation of Social Accountability by Medical Schools,' consisting of 39 questions based on five factors. We conducted a literature review to establish a theoretical basis for social accountability concepts and performance in the preliminary phase. The tool was reviewed based on the questions used in previous studies to ensure the suitability of its contents. These were the concept of social accountability of medical schools in the grid model [4] , the conceptualizationproduction-usability (CPU) model [10] , and 10 areas of GCSA's standards [9, 23] , and an evaluation framework developed by The Training for Health Equity Network (THEnet) [13, 28] , the student's toolkit on social accountability in medical schools developed by the International Federation of Medical Student's Association (IFMSA) [29, 30] , and the criteria of social accountability area in the A School Programmed for International Recognition of Excellence in Education (ASPIRE) [31] that were translated within the Korean context. Based on previous research, this study hypothesized five key factors (human resource factors, program factors, organization internal factors, partnership factors, and environmental factors), with a total of 39 items, as indicated in Table 1 . The questionnaire comprised three sections. The first section included questions related to medical school information. The second section consisted of questions assessing the implementation of social accountability, and the respondents were required to rate their agreement on each statement using a 5-point Likert scale, ranging from 1 = strongly disagree to 5 = strongly agree. The third section related to suggestions. The survey was conducted from 24 July to 7 September 2020, and all 40 medical schools' deans and 15 medical education experts responded to the survey (100% response rate). A reliability analysis of the questionnaire indicated that skewness ranged from −.41 to .11 and kurtosis from −.95 to −.38, meeting the univariate normality assumptions, with the absolute values of skewness and kurtosis not exceeding 2 and 7, respectively. Therefore, it was considered appropriate to verify the significance of the study model using the maximum likelihood method, as it satisfies the assumption of normal distribution for all variables. An exploratory factor analysis was conducted based on 37 questions, with the exception of two less question-in-quantity consistencies, by examining the question-in-quantity consistency of question 39. Exploratory factor analysis was conducted using the maximum likelihood method and direct oblimin rotation method, and Cronbach's alpha coefficient was calculated to confirm the internal consistency of the questionnaire. The number of factors was determined by considering eigenvalues and scree tests, where the minimum eigenvalue was 1 and the slope changed rapidly in the scree chart. The criteria for interpreting the factors in the final structure were set at .40. The factors used a root-mean-square error of approximation (RMSEA) goodness-of-fit because of its advantage of being less sensitive to sample size and the simplicity of the model; an acceptable goodnessof-fit was determined as a RMSEA value of less than or equal to 10. An exploratory factor analysis was performed using the SPSS statistical package (SPSS for Windows, version 25.0, SPSS Inc., Chicago, IL, USA). Furthermore, Pearson's correlation analysis was conducted to compare the magnitude of influence among factors affecting the performance of social accountability at medical schools, and multiple regression analysis was conducted to examine the importance of influence on the performance of social accountability at medical schools. Finally, an analysis of differences between groups was conducted to identify the important factors influencing the social accountability performance of the deans and professional groups of medical schools. An exploratory factor analysis was conducted to determine whether the factors affecting the implementation of social accountability of medical schools were represented by the five factors examined in this study. In the exploratory factor analysis, eight factors with eigenvalues higher than Kaiser's criterion of 1 were calculated using the maximum likelihood and direct oblimin rotation methods. As illustrated in Table 2 , the eight factors accounted for approximately 76.7% of the variance. One item (Item 1.3) with less than 0.40 in common was removed. Four items (Items 1.2, 3.8, 5.2, and 5.5) had factor loadings of less than 0.40. Three items (1.4, 2.5, and 3.5) did not have adequate internal consistency and were excluded. Cronbach's α for the 29-item HSP Model was 0.96, whereas Cronbach's α for the eight factors/subscales ranged from 0.71 to 0.95. The correlations between the items were sufficiently large to conduct factor analysis. A decision was made to adopt the 29 items and eight factors of the HSP model for the purpose of validating a framework for implementing social accountability at medical schools in the Korean context. Table 3 provides a summary of the exploratory factor analysis results for the 29-item HSP model (n55). It was named the HSP model in the same sense as structural approaches such as computer hardware, software that actually works, and partnerships with major stakeholders. Based on the HSP model, eight factors in three areas influenced the implementation of social accountability by medical schools in the Korean context. The hardware (H) area included the declaration of social accountability and physician workforce, organizations and systems for implementing social accountability, and physical and financial environmental factors. The software (S) area included the curriculum design based on social accountability and the monitoring and evaluation system factors. Finally, the partner (P) area included the proximity between partners, building partnerships among stakeholders, and interactions between partner factors. A scree plot is a useful method to determine the number of factors that should be retained in an analysis. An examination of the scree plot in the current study, which indicated that the line began to flatten at component number 9, justified the retention of these eight factors. The results of the crosscomparisons of the 2-factor, 3-factor, 4-factor, 5-factor, 6-factor, 7-factor, and 8-factor models are shown in Table 4 to evaluate the suitability of the 8-factor models identified in this study. Pearson's correlation analysis between factors affecting social accountability is shown in Table 5 , where all factors are represented as static to important, which indicates increasing importance as factors increase. Table 6 indicates the results of a stepwise multiple regression analysis of the effect size of the eight factors that affect the implementation of social accountability of medical schools. Among these, 'interactions between partners' was the most salient factor in the implementation of social accountability of medical schools in the Korean context. Excluding the partnership building factor, seven factors demonstrated approximately 97.8% (R 2 = .978) explanatory power (model fit F = 303.642, p < .001). Following 'interactions between partners' (ß = .292), being the most influential factor, 'the curriculum design based 76.69 F1 = building partnerships among stakeholders, f2 = monitoring and evaluation system, f3 = organizations and system for implementing social accountability, f4 = curriculum design based on social accountability, f5 = interactions between partners, f6 = contributing to proximity between partners, f7 = the physical and financial environment, f8 = the declaration of social accountability and physician workforce. on social accountability' (ß = .261), 'organizations and system for implementing social accountability' (ß = .210), 'physical and financial environment' (ß = .163), 'monitoring and evaluation' (ß = .131), 'the declaration of social accountability and physician workforce' (ß = .120), and 'contributing to proximity between partners' (=.090) contributed, in this order, to the implementation of social accountability of medical schools in Korea. Table 7 illustrates the results of the independent samples t-test to examine the difference between the deans and experts in their recognition of the importance of the factors influencing the implementation of social accountability of medical schools. The differences between the two groups demonstrated that the deans group scored higher across all factors. They recognized 'the declaration of social accountability and physician workforce,' 'the curriculum design based on social accountability,' and 'organizations and system for implementing of social accountability' as the most important factors. Table 8 describes the factors that hinder the implementation of social accountability of medical schools and action strategies in hardware, software, and partner areas. The results of this study support the outcome of previous studies that indicated that recognition and performance of the concept of social accountability of medical schools can vary depending on the national and social context of each medical school. The impact factors of social accountability performance could be explained using the HSP model consisting of eight factors, including building partnerships among stakeholders, interactions between partners, and curriculum design-related social accountability. However, it was also found that some factors, considered important globally, are not a part of the HSP model in the Korean context due to societal and cultural differences. Therefore, the results of this study are consistent with previous findings indicating that the outlook of social accountability differs based on each country's social and cultural context [3, 4, 6, 12, 25] . The HSP model reflects global principles, such as responding to society's priority health needs, partnership with key stakeholders in the health sector, and establishing mandated mechanisms for accreditation. The model had to be tailored to fit the societal needs in the Korean context, such as policies to select vulnerable people or socially disadvantaged people in Korea, and factors that encourage and support graduates to work in vulnerable areas or primary health care, which are not fully reflected in the global HSP model. These particular needs are related to the Cut-offs used to indicate goodness of fit: RMSEA ≤0.08 Table 5 . Pearson's correlations of variables. Factor Importance The declaration of social accountability and physician workforce .661** The curriculum design based on social accountability .727** Organizations and system for implementing social accountability .823** The monitoring and evaluation system .766 The physical and financial environmental .723** Contributing to proximity between partners .778** Building partnerships among stakeholders .772** Interactions between partners .880** **p < 0.01 social, economic, and political factors that influence the Korean medical field. These factors also have a direct influence on the outlook of medical students in Korea. This is because, unlike advanced countries, such as the USA, Canada, and the UK, where public funds are provided to support medical students during their academic career, medical students in Korea go to medical school immediately after graduating from high school, and the financial burden for their studies is carried by the students and their families. Furthermore, it was found that, in Korea, it is more financially beneficial to work in metropolitan areas. This leads to many graduates seeking employment in a metropolitan setting rather than pursuing careers in health care for the vulnerable or socially disadvantaged. Finally, although 63% of Korean medical schools are located in non-metropolitan areas, a large number of hospitals, local patients, medical personnel, and medical institutions are concentrated in Seoul and the metropolitan area because of the development of transportation such as high-speed railways and IT technology being centered in these areas [54] . There remain many obstacles that must be overcome and practical tasks that must be accomplished to strengthen and promote the social accountability of medical schools within the Korean context. The main barrier is the lack of conceptual awareness among key stakeholders. It may also be that, although schools were accredited before 2014, it was only thereafter that the accreditation standards included components of social accountability. In addition, the Korea Institute of Medical Education and Evaluation was awarded recognition status by the WFME in 2016, which likely also increased medical schools' interest in understanding social accountability and enforcing accountability standards [54] . Consequently, consensus among key stakeholders had not been reached, resulting in a lack of understanding [55] . This lack of understanding led to a lack of educational programs related to the last step in the process of social accountability. Prior studies have highlighted the importance of medical schools in establishing a shared vision and social accountability strategies with key stakeholders within the national health-care system to achieve social accountability [2, 3, 8] . However, it has also been found that this can lead to conflicts among stakeholders [3, 5, 8] . Therefore, to minimize the resistance of key stakeholders, it is important to build consensus on the social accountability of medical schools worldwide and to establish a clear and improved understanding of these concepts among them. In addition, it is necessary to develop guidelines on social accountability standards that can create a common vision and awareness by holding accountability consortiums with key stakeholders, such as medical schools, countries, and regions, to strengthen and spread the social accountability of medical schools. Partnerships with key stakeholders related to social accountability are very important for medical schools to meet levels of responsiveness and accountability beyond social responsibility. Consortiums with key stakeholders may include an intercollege consortium that can establish consensus on the concept of social accountability of medical schools, develop joint programs for community, regional, and national levels of social accountability, and share best practices for medical schools. Medical schools and communities can enhance the survey of health and medical challenges in the community, expand the implementation of learning communities and service learning curriculums through establishing relationships with the community, and facilitate continuous interaction through mentoring and tutoring. Finally, medical schools and national government agencies can raise policy interest by developing and promoting standards for implementing social accountability for health care, supporting national policy considerations and budgets, expanding joint research projects at the national level, and holding regular consortiums with major stakeholders [22] . Finally, continuous reflection is needed on how global concepts and accreditation work in various national, social, and cultural contexts. Research on reasoning and reviewing the priorities of social accountability performance in the global and specific contexts is necessary [9, 12] . In addition, a comparative study on social accountability between countries is needed. Korea has been verifying social accountability based on WFME's accreditation standards since 2019, which requires post-monitoring. A limitation of this study is that it is a study of social accountability attitudes of deans and experts but not social accountability measures of social accountability actions and outcomes in medical schools. Also, it does not examine the perception of social accountability from the perspectives of students and professors. It is also necessary to examine the role of social accountability of medical schools expected by communities, regions, and countries. Finally, future research is needed to investigate the strategies and methods used to carry out social accountability according to the specific situation of each medical school. Factors affecting the implementation of social accountability in medical schools are explained as common factors and distinguished factors according to the social and cultural contexts of various countries. The HSP model reflects the global principles of the social accountability of medical schools and can be used by individual medical schools as a checklist for the development of social accountability implementation frameworks. Individual medical schools can strengthen social accountability and establish specific strategies depending on their particular situation and characteristics. A shared perception and partnership among stakeholders are important to strengthen the implementation of social accountability in medical schools. The HSP model presented in this study is novel in that it examines the implementation of social accountability of medical schools in the Korean context. In future studies, the development of standards and indicators to assess the implementation of social accountability of medical schools in different contexts should be pursued. Transforming and scaling up health professionals' education and training. Guidelines Building a socially accountable health professions school: towards unity for health. Educ Health (Abingdon) Social accountability of medical education: aspects on global accreditation Division of Development of Human Resources for Health, World Health Organization Accessed 5 Producing a socially accountable medical school: AMEE Guide No. 109 Social accountability: the extra leap to excellence for educational institutions Why should social accountability be a benchmark for excellence in medical education? Educación Médica Primary health care, the Declaration of Astana and COVID-19 Global Consensus for social accountability of medical schools Accessed 24 The social accountability of medical schools and its indicators Building blocks for social accountability: a conceptual framework to guide medical schools Social accountability: a framework for medical schools to improve the health of the populations they serve Measuring social accountability in health professional education: development and international pilot testing of an evaluation framework Social accountability of the curriculum in medical education: a review on the available models The CARE model of social accountability: promoting cultural change The ASPIRE-to-Excellence program: a global effort to improve the quality of medical education Social accountability. A vision for Canadian medical schools. Ottawa: Canada: Ministry of Public Works and Government Services Teaching social accountability by making the links: qualitative evaluation of student experiences in a service-learning project How do undergraduate medical students perceive social accountability? Social accountability of medical schools: do accreditation standards help promote the concept? Suggested new standards to measure social accountability of medical schools in the accreditation systems Accrediting excellence for a medical school's impact on population health. Educ Health (Abingdon) Developing social accountability indicators at medical schools Seeking impact of medical schools on health: meeting the challenges of social accountability Social accountability and accreditation: a new frontier for educational institutions The role of medical schools in promoting social accountability through shared decision-making Social accountability frameworks and their implications for medical education and program evaluation: a narrative review THEnet's evaluation framework for socially accountable health professional education. Version 1.0. Monograph I. Brussels: The Training for Health Equity Network Students' toolkit on social accountability in medical schools IFMSA policy proposal social accountability in medical schools Association for medical education in Europe. ASPIRE-to-Excellence Award Conceptualising social accountability as an attribute of medical education The impact of socially-accountable health professional education: a systematic review of the literature Canada's new medical school: the Northern Ontario school of medicine: social accountability through distributed community engaged learning Socially accountable medical education: an innovative approach at Florida International University Herbert Wertheim college of medicine Arrhythmogenic right ventricular cardiomyopathy type 5 is a fully penetrant, lethal arrhythmic disorder caused by a missense mutation in the TMEM43 gene Building a medical workforce in Tasmania: a profile of medical student intake Educational factors that influence the urban-rural distribution of health professionals in South Africa: a case-control study The El-Tal El-Kebir story: an example of social accountability from Egypt Socially accountable medical education strengthens community health services Translating medical school social missions to student experiences The university of Sheffield faculty of medicine, dentistry & health. About social accountability at Sheffield Social accountability in theory and practice Thunder Bay (ON): northern Ontario school of medicine The training for health equity network evaluation framework: a pilot study at five health professional schools The community health worker as service extender, cultural broker and social change agent: a critical interpretive synthesis of roles, intent and accountability The social accountability of doctors: a relationship based framework for understanding emergent community concepts of caring Evaluation and assessment of social accountability in medical schools Accreditation in a sub Saharan medical school: a case study at makerere university Social accountability of medical schools and academic primary care training in Latin America: principles but not practice Adapting health care institutions and medical schools to societies' needs Social accountability of medical schools: concept and implementation strategies AM Last Page: social accountability of medical schools We would like to thank Editage (www.editage.co.kr) for English language editing. No potential conflict of interest was reported by the author(s). This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. The data that support the findings of this study are available on request from the corresponding author, [EBY, nara@yuhs.ac].