key: cord-0968080-e0b9d8p1
authors: Jang, Jae-Hyuk; Kim, Sang Suk; Kim, Sunghee
title: Educational Simulation Program Based on Korean Triage and Acuity Scale
date: 2020-12-03
journal: Int J Environ Res Public Health
DOI: 10.3390/ijerph17239018
sha: 1e65cea8e5c45f95ecf6017903acee3620271757
doc_id: 968080
cord_uid: e0b9d8p1

This study aimed to develop and implement an educational simulation program based on the Korean Triage and Acuity Scale (KTAS) for nurses in emergency medical centers who completed the KTAS training, and assess its effects. We examined the educational effects of the program by evaluating clinical decision-making ability, job satisfaction, and customer orientation among the participants, namely 27 nurses in the emergency center of a general hospital. Data were collected from 3 to 24 May 2017, and analyzed using SPSS 22.0. There was a significant difference in nurses’ mean scores on clinical decision-making ability, job satisfaction, and customer orientation before and after the simulation-based education. In other words, after completing the KTAS-based simulation education program, the emergency nurses showed improved clinical decision-making ability, job satisfaction, and customer orientation. Based on the results of this study, it is expected that this educational program can be effectively used for KTAS education, and it was confirmed that simulation-based education is a useful learning method for triage nurses in emergency medical centers.

According to National Emergency Medical Center statistics, emergency medical centers in Korea are being consistently used by more than 10 million people per year, with 10.343.983 visits in 2015 because of the Middle East Respiratory Syndrome outbreak, 10 .419.983 in 2014, and 10.186 .341 in 2013 [1] . In addition, the use of emergency medical centers is rising due to an increase in the number of disasters and accidents; higher levels of service at emergency medical centers are being requested because of improvements in individuals' quality of life due to medical technology developments [2] . Moreover, during the outbreak of coronavirus disease 2019 in Korea in 2020, the preparedness of emergency departments for triaging patients and ensuring the safety of staff has been of utmost importance [3] .

However, the reality is that most Korean emergency medical centers are used as waiting rooms for hospitalizations; consequently, the problem of work stagnation has worsened, leading to the inability of the emergency medical center to provide a satisfactory service to their visitors [4] . The increase in non-emergency patients also leads to inefficient management of medical resources; therefore, the need for a severity classification system to determine and categorize patients' severity for efficient management has been in the limelight [5] . Severity classification involves the systematic classification of patients visiting the emergency medical center by assessing the severity of the health problem, making a judgment about the order of prioritization of care, performing emergency treatment, and allocating cases to appropriate departments [6] . Previous research found that the emphasis on severity classification has sometimes led to disability in patients because of inadequate classification

The development of the KTAS-based simulation training program for emergency medical center nurses followed five steps-analysis, design, development, implementation, and evaluation-based on the Analysis, Design, Development, Implementation, Evaluation (ADDIE) model, which is a representative model of instructional system design [17] . The development process for the simulation-based Korean severity classification training program using standardized patients is shown in Figure 1 . 

The development of the KTAS-based simulation training program for emergency medical center nurses followed five steps-analysis, design, development, implementation, and evaluation-based on the Analysis, Design, Development, Implementation, Evaluation (ADDIE) model, which is a representative model of instructional system design [17] . The development process for the simulation-based Korean severity classification training program using standardized patients is shown in Figure 1 . 

The participants in this study were nurses working at emergency medical centers who completed the KTAS training, understood the purpose and contents of this study, and voluntarily agreed to participate. A sample of 30 nurses was recruited based on a minimum sample size of 27, which was calculated with an effect size of 0.50, a significance level of 0.50, and a power of 0.80 using G*Power 3.1.9 (Heinrich-Heine-Universität Düsseldorf, Mannheim, Germany) for Windows, considering a 10% drop-out rate. However, of the 30 nurses, 3 were withdrawn, resulting in a final sample of 27 participants.

Data were collected from May 3 to 24, 2017. After receiving approval and confirmation of cooperation from the participating hospital, the surveys were distributed to emergency medical center nurses. Data were collected before and after the implementation of the simulation education program developed in our study.

To measure clinical decision-making ability, a tool developed by Jenkins [18] and revised by Baek [19] was used in this study. Clinical decision-making ability refers to the process by which a nurse identifies a nursing problem and finds and selects an appropriate approach. In this study, the 

The participants in this study were nurses working at emergency medical centers who completed the KTAS training, understood the purpose and contents of this study, and voluntarily agreed to participate. A sample of 30 nurses was recruited based on a minimum sample size of 27, which was calculated with an effect size of 0.50, a significance level of 0.50, and a power of 0.80 using G*Power 3.1.9 (Heinrich-Heine-Universität Düsseldorf, Mannheim, Germany) for Windows, considering a 10% drop-out rate. However, of the 30 nurses, 3 were withdrawn, resulting in a final sample of 27 participants.

Data were collected from 3 to 24 May 2017. After receiving approval and confirmation of cooperation from the participating hospital, the surveys were distributed to emergency medical center nurses. Data were collected before and after the implementation of the simulation education program developed in our study.

To measure clinical decision-making ability, a tool developed by Jenkins [18] and revised by Baek [19] was used in this study. Clinical decision-making ability refers to the process by which a nurse identifies a nursing problem and finds and selects an appropriate approach. In this study, the severity triage manager was involved in the decision-making process for severity triage through patient assessment, which may be influenced by clinical experience, education related to previous emergencies, or simulation experience. The tool consists of 40 items in four sub-domains, each with 10 items. A higher score indicates a higher clinical decision-making ability. Reliability was confirmed by a value of Cronbach's α of 0.82 at the time of development, and 0.86 in the present study.

To measure job satisfaction, the tool revised by Lee in 2010 [20] was used in our study, which consists of 12 items. A higher score indicates higher job satisfaction. Cronbach's α was 0.86 in the original study, and 0.88 in the present study.

To measure customer orientation, the tool developed by Saxe and Weitz [21] was used. It comprises a total of six items, and a higher score indicates higher customer orientation. In a previous study, Cronbach's α was 0.90 [22] , and in the present study, it was 0.89.

Collected data were analyzed using IBM SPSS Statistics for Windows, version 22.0. General characteristics and comparison of key variables before and after program participation were analyzed using percentages, means, standard deviations, and mean comparisons with paired t-tests. The reliability of the study measures was confirmed using Cronbach's α.

The study plan was reviewed and approved by the participating institution research ethics boards (IRB File No.: NHIMC 2016-12-008-001). The purpose and methods of this study were explained to the participants, and only those who provided written informed consent were enrolled. It was explained to participants that they could terminate their participation at any time during this study, and that this would not lead to any disadvantages.

The simulation-based KTAS education program in this study was developed in five stages: analysis, design, development, implementation, and evaluation, based on the ADDIE model [17] .

To select an educational topic for the educational program, group interviews were conducted with the study participants in the conference room of the emergency medical center using the question, "Which patient is the most difficult to judge when applying the KTAS?" In the interviews with a total of 30 nurses, difficulties were reported regarding the classification of patients with heart disease complaining of gastrointestinal symptoms, classification of high-risk patients, determination of the treatment range for trauma patients, and assessment of pain and discomfort in children. Approximately 70% of the study participants (21 nurses) reported difficulties in the classification of heart disease patients who complained of gastrointestinal symptoms; thus, this was selected as the subject of the simulation education program.

The educational objective of the program was to quickly and accurately classify severity using the KTAS and assess the patient using therapeutic communication. The simulation program comprised pre-debriefing, scenario operation with standardized patients, and debriefing. The evaluation of the effects of the simulation education program based on the KTAS was designed as shown in Figure 2 .

evaluation of the effects of the simulation education program based on the KTAS was designed as shown in Figure 2 . 

To develop the scenarios, the KTAS manual was used. The scenario was as follows: an adult male visited the emergency room because of sudden abdominal pain, and said that the pain was in a different location compared to previous times; however, as a result of the classification, medical treatment was not required immediately, so he was asked to wait in the patient waiting room. This case was designed to quickly and accurately classify the patient based on the KTAS, and to assess the patient according to the chief complaint through therapeutic communication. The contents of the scenarios were standardized by one emergency medicine specialist, two clinical nurses with more than 10 years of experience in the emergency medical center, and one KTAS instructor. After the pilot test, the scenarios and the problems of the evaluation checklist were revised and supplemented, and the scenarios was finally confirmed.

From May 3 to 24, 2017, a total of five times were run for 40 min each. Four to six nurses were grouped together, and each person took 10 min for pre-debriefing, 10 min for scenario operation, and 20 min for debriefing (Supplementary Material); thus, the total simulation operation time was 40 min.

Clinical decision-making ability, job satisfaction, and customer orientation were evaluated to check the effectiveness of the simulation education program based on KTAS.

The final sample consisted of 27 emergency medical center nurses. Of the 27 participants, 14 (51.9%) were in their 20s, and the average age was 33 years. Females comprised the majority with 24 

To develop the scenarios, the KTAS manual was used. The scenario was as follows: an adult male visited the emergency room because of sudden abdominal pain, and said that the pain was in a different location compared to previous times; however, as a result of the classification, medical treatment was not required immediately, so he was asked to wait in the patient waiting room. This case was designed to quickly and accurately classify the patient based on the KTAS, and to assess the patient according to the chief complaint through therapeutic communication. The contents of the scenarios were standardized by one emergency medicine specialist, two clinical nurses with more than 10 years of experience in the emergency medical center, and one KTAS instructor. After the pilot test, the scenarios and the problems of the evaluation checklist were revised and supplemented, and the scenarios was finally confirmed.

From 3 to 24 May 2017, a total of five times were run for 40 min each. Four to six nurses were grouped together, and each person took 10 min for pre-debriefing, 10 min for scenario operation, and 20 min for debriefing (Supplementary Material); thus, the total simulation operation time was 40 min.

Clinical decision-making ability, job satisfaction, and customer orientation were evaluated to check the effectiveness of the simulation education program based on KTAS.

The final sample consisted of 27 emergency medical center nurses. Of the 27 participants, 14 (51.9%) were in their 20s, and the average age was 33 years. Females comprised the majority with 24 participants (88.9%), and the rest were males (11.1%). As for clinical experience, we used a model based on the Dreyfus model of skill acquisition, which was further revised to fit the Korean clinical environment. Clinical experience was divided into four clinical stages excluding the expert stage: beginner (1 year after entering), advanced beginner (2-3 years), competent (4-6 years), and skilled (7 years or more). According to total clinical experience, 14 nurses (51.8%) were considered competent, and there was no one in the beginner stage. As for work experience in emergency medical centers, 14 nurses (51.8%) were considered competent, and the average experience in emergency medical centers was 71.3 months.

The results regarding the effect of the KTAS-based simulation education on clinical decision-making ability are shown in Table 1 . In terms of clinical decision-making ability, "Review of goals and values" showed the largest effect, while "Search for information and synchronize by connecting with new information" showed the smallest effect. All 12 items in the job satisfaction tool showed a significant before-after difference ( Table 2) . "My hospital has many opportunities for promotion" showed the largest effect, while "Considering the above, I am satisfied with my current job" showed the smallest effect. All six items in the customer orientation tool showed a significant before-after difference (Table 3) . "I try to pay attention to the opinions of my customers" showed the largest effect, while "I try to understand what the customer wants" showed the smallest effect. 

The purpose of this study was to develop a simulation education program based on KTAS and implement it with nurses in emergency medical centers to assess its impact. After the simulation education program, the participants showed significant improvement in clinical decision-making ability, job satisfaction, and customer orientation.

In this study, training needs were analyzed through interviews with nurses who were KTAS graduates, who reported difficulties in classifying patients with high risk, determining the range of treatment for trauma patients, assessing pain and discomfort in children, and classifying patients with heart disease complaining of gastrointestinal symptoms. This is in line with the study by Kim, Kim, and Park [23] on the training demands of intensive care unit nurses, the study by Han [24] on the training demands of university hospital nurses regarding clinical skills, and the analysis of demands by Kim and Kang [16] in their study on the development and assessment of effectiveness of a simulation program for novice nurses in specialized units (emergency room and intensive care unit). Therefore, prior research shows that the training demands of nurses who work in emergency settings are higher for specialized clinical skills and knowledge than general nursing knowledge.

Lecture-based education is effective for knowledge transfer, but there are limitations in improving nursing clinical skills [25] . Therefore, our study aimed to develop a simulation-based training program to actualize continuous learning in an environment similar to clinical settings. Scenarios were developed for the classification of heart disease patients who reported digestive symptoms, reflecting previous training demands. We aimed to develop a scenario to diagnose and classify diseases rather than using scenarios related to direct interventions such as cardiopulmonary resuscitation and circulatory diseases used in prior studies [26] [27] [28] . The developed simulation-based learning program helped with quick and accurate decision making when classifying severity using the KTAS.

Although simulation-based training programs for nurses have been previously developed in Korea, most were related to infection control training [29] , basic life support, or advanced cardiac life support [26] [27] [28] 30] . This study is thought to be meaningful in that it confirmed the educational needs of emergency room nurses and provided simulation-based education on the severity classification of emergency patients to nurses who had completed KTAS education.

Recently, there have been studies on simulation-based learning in different medical professions. For instance, Stocker et al. [31] found an increase in crisis management ability among surgeons, cardiologists, anesthesiologists, and nurses in pediatric intensive care units via simulation-based training. Colacchio et al. [32] found improvements in teamwork after implementing simulation-based training with medical professionals in neonatal intensive care units. As emergency medical centers are places where professionals from a variety of fields work together, it is necessary to reenact complex clinical scenarios to increase the effectiveness of simulation-based education, and conduct research on the use of simulation-based education in various medical fields.

The second objective of this study was to test the effectiveness of the simulation-based program by comparing the clinical decision-making ability, job satisfaction, and customer orientation of nurses before and after participation in the program. The results are discussed based on each of the three variables.

First, when examining the effectiveness of the KTAS-based simulation program, we found a significant improvement in clinical decision-making ability. Although this is difficult to compare with previous studies given the lack of research on clinical decision making among emergency medical center nurses in the context of simulation training, our results are in line with those from a study by Kim and Park [33] on the development and effectiveness of a simulation training program for novice nurses in special units (emergency room and critical care unit), and a study by Maxson et al. [34] that found improved clinical decision-making ability after a multidisciplinary implementation of simulation-based training. Furthermore, studies on clinical decision-making ability [19, 33, 35, 36] also reported a significant effect of job satisfaction, critical thinking disposition, and autonomy on clinical decision-making ability. This is similar to our results, as the opportunity to learn through repeated training and on-site reenactment learning in a safe environment may have led to improved clinical decision-making ability. Moreover, simulation-based education involving reenacting clinical situations may be especially useful to new nurses who lack clinical decision-making ability and clinical skills.

Second, after implementing the KTAS-based simulation program, we found a significant increase in job satisfaction, signaling that the simulation was effective. This is similar to the results of Cheng et al. [37] , who found increased satisfaction after simulation training for pediatric emergency situations for various medical professionals. The increase in job satisfaction in our study may have been due to increased self-confidence because of the simulation training in a safe environment that is similar to a clinical situation. Based on this, education and training using simulations may help to improve the satisfaction of health professionals and medical staff. In addition, a follow-up study related to this is necessary.

Third, the results of the evaluation of the KTAS-based simulation program showed a significant increase in customer orientation, indicating that the program was also effective in this respect. This is in line with a study on the effect of hospital nurses' perception of inter-marketing, empowerment, and job satisfaction on their customer orientation [38] , a study on the effect of customer orientation, emotional labor, exchange relation, and close ties on the willingness to change jobs in hospital nurses [39] , and a study on the effect of specialty professionalism of specialized hospital nurses on job satisfaction, customer orientation, and quality of service [40] , these studies found that increased customer orientation was associated with higher job satisfaction, lower willingness to change jobs, and more active inter-marketing.

Despite the increasing demand for high-quality services in emergency medical centers, the satisfaction rate among emergency room visitors is low at 42.1%, with emergency medical costs and waiting time as factors influencing dissatisfaction [1] . Kindness toward medical staff (doctors, nurses) increased slightly compared to 2014 (53.9%) in response to 57.1% of responding that they were satisfied, but it was found that patients who visited the emergency room felt that the quality of service was low in relation to the cost [1] . Based on this, improvement in nurses' job satisfaction will lead to improved customer orientation, which further leads to an enhancement in the image of the hospital. Thus, the customer orientation improvement seen in our study is a relevant result for the improvement of satisfaction among inpatient and outpatient visitors. Furthermore, in a medical setting where the demand for customer service is increasing, the improvement of customer orientation found in this study is considered a finding that meets the public's expectations regarding future emergency medical centers.

Overall, our study found that the KTAS-based simulation education program had a positive effect on nurses' clinical decision-making ability, job satisfaction, and customer orientation. Therefore, simulation-based nursing programs using standardized patients must be developed targeting various clinical skills and treatments required in emergency medical centers. Moreover, using simulation education based on the KTAS can lead to more realistic training, and the resulting ability to quickly and accurately classify severity can have a positive effect in the prognosis and satisfaction of patients.

This study also had certain limitations. First, this study did not include a control group for comparison. Second, additional evaluations were not performed over time to confirm the effects of training in the longer term. Third, the association between general characteristics such as age or clinical experience and the study variables was not examined. Finally, we did not investigate highly crowded emergency medical centers as a potential context; therefore, future studies should develop a scenario related to overpopulation in the emergency room that requires a quick decision on severity classification, such as a scenario where an emergency patient and a non-emergency patient are admitted simultaneously to the emergency medical center.

To determine the efficacy of simulation-based education, it is necessary to put it into practice. This study confirmed that the KTAS-based simulation education program developed for emergency medical center nurses was effective in improving their clinical decision-making ability, job satisfaction, and customer orientation. The results of this study provide evidence for the application of simulation-based education in the clinical field, deviating from traditional education methods. In addition, this education program was helpful in improving the professionalism of emergency nurses. 

COVID-19 Emergency Department Protocols: Experience of protocol implementation through in-situ simulation

Stress and Job Satisfaction of Triage Nurses Working in University Affiliated Hospitals

Clinical characteristics and worsening prognosis for undertriage patients in the emergency department: A university affiliated hospital observational study

Assessment of Paying Subject of Emergency Management Charge in Two Stage Triage after application of Korean Triage and Acuity Scale

Accuracy of emergency department triage using the Emergency Severity Index and independent predictors of under-triage and over-triage in Brazil: A retrospective cohort analysis

Nurses working with Manchester triage-The impact of experience on patient security

Factors influencing customer orientation of nurses

Relation between Ability of Clinical Decision Making of Nurse in Emergency Room with Performing Nursing Work

Evidence of clinical competence by simulation, a hermeneutical observational study

Exploratory randomized controlled trial of hybrid obstetric simulation training for undergraduate students

The International Nursing Association for Clinical Simulation and Learning (INASCL)

Simulation in nursing practice: The impact on patient care

SimZones: An organizational innovation for simulation programs and centers

The development and effects of a tailored simulation learning program for new nursing staffs in intensive care units and emergency rooms

Instructional Design Strategies and Tactics

A research tool for measuring perceptions of clinical decision making

Relationship between Level of Autonomy and Clinical Decision-Making in Nursing Scale of E.T Nurse

Research on Relations between the Internal Marketing of Hospitals & Job Satisfaction and Organizational Commitment

The Soco Scale: A measure of the customer orientation of salespeople

The Effect of Hospital Internal Marketing on Nurses

Educational needs based on analysis of importance, frequency and difficulty of ICU nursing practice for ICU nurses

A Study on clinical competence and education needs of hospital nurses

Plan, do, study, act model to improve an orientation program

Effect of a simulation-based education on cardio-pulmonary emergency care knowledge, clinical performance ability and problem solving process in new nurses

Effects of simulation-based training on the critical care nurses' competence of advanced cardiac life support

Effects of simulation-based ACLS education on self-confidence performance of ACLS among nursing officers

The effects of simulation-based infection control training on the intensive care unit nurses' perception, clinical performance, and self-efficacy of infection control

The effects of simulation training for new graduate critical care nurses on knowledge, self-efficacy, and performance ability of emergency situations at intensive care unit

Impact of an embedded simulation team training programme in a paediatric intensive care unit: A prospective, single-centre, longitudinal study

An approach to unit-based team training with simulation in a neonatal intensive care unit

The relationship between nursing professionalism, clinical decision making abilities, and job performance in advanced practice nurses

Enhancing Nurse and Physician Collaboration in Clinical Decision Making through High-Fidelity Interdisciplinary Simulation Training

Impact of nursing professional self-concept, clinical decision making ability, critical thinking disposition, professional autonomy of clinical nurses

Professional autonomy and clinical decision making ability in clinical nurses

Simulation-based crisis resource management training for pediatric critical care medicine: A review for instructors. Pediatr

Influence of Internal Marketing Perception, Empowerment, and Job Satisfaction on Customer Orientation of Clinical Nurses. Korean

Influences of customer orientation, emotional labor, unit manager-nurse exchange and relational bonds on nurses' turnover intension

Effect of nurse's professionalism on customer orientation, job satisfaction and service delivery level in specialty hospital

Funding: This research received no external funding.

The authors declare no conflict of interest.