key: cord-1012885-uy23y3gp
authors: Kleib, Manal; Jackman, Deirdre; Duarte Wisnesky, Uirá; Ali, Shamsa
title: Academic Electronic Health Records in Undergraduate Nursing Education: Mixed Methods Pilot Study
date: 2021-04-27
journal: JMIR Nurs
DOI: 10.2196/26944
sha: 170d9d409ebf83e3576a92596ab2e8499b6a1c71
doc_id: 1012885
cord_uid: uy23y3gp

BACKGROUND: Teaching students about electronic health records presents challenges for most nursing programs, primarily because of the limited training opportunities within clinical practice settings. A simulated electronic health record is an experiential, learner-centered strategy that enables students to acquire and apply the informatics knowledge needed for working with electronic records in a safe learning environment before the students have encounters with real patients. OBJECTIVE: The aim of this study is to provide a preliminary evaluation of the Lippincott DocuCare simulated electronic health record and determine the feasibility issues associated with its implementation. METHODS: We used one-group pretest-posttest, surveys, and focus group interviews with students and instructors to pilot the DocuCare simulated electronic health record within an undergraduate nursing program in Western Canada. Volunteering students worked through 4 case scenarios during a 1-month pilot. Self-reported informatics knowledge and attitudes toward the electronic health record, accuracy of computerized documentation, satisfaction, and students’ and educators’ experiences were examined. Demographic and general information regarding informatics learning was also collected. RESULTS: Although 23 students participated in this study, only 13 completed surveys were included in the analysis. Almost two-thirds of the students indicated their overall understanding of nursing informatics as being fair or inadequate. The two-tailed paired samples t test used to evaluate the impact of DocuCare on students’ self-reported informatics knowledge and attitudes toward the electronic health record revealed a statistically significant difference in the mean score of knowledge before and after using DocuCare (before: mean 2.95, SD 0.58; after: mean 3.83, SD 0.39; t(12)=5.80, two-tailed; P<.001). There was no statistically significant difference in the mean scores of attitudes toward the electronic health record before and after using DocuCare (before: mean 3.75, SD 0.40; after: mean 3.70, SD 0.34; t(12)=0.39, two-tailed; P=.70). Students’ documentation scores varied from somewhat accurate to completely accurate; however, performance improved for the majority of students as they progressed from case scenarios 1 to 4. Both the faculty and students were highly satisfied with DocuCare and highly recommended its integration. Focus groups with 7 students and 3 educators revealed multiple themes. The participants shared suggestions regarding the DocuCare product customization and strategies for potential integration in undergraduate nursing programs. CONCLUSIONS: This study demonstrated the feasibility and suitability of the DocuCare program as a tool to enhance students’ learning about informatics and computerized documentation in electronic health records. Recommendations will be made to academic leadership in undergraduate programs on the basis of this study. Furthermore, a controlled evaluation study will be conducted in the future.

Electronic health records (EHRs) are an essential component of modern-day digitally connected health care. An EHR is a secure and integrated digital health technology that houses patients' information and encounters with the health system. EHRs help improve access to health services, enhance the quality and safety of care, and increase the efficiency of the health system [1] . As the largest group of care providers, nurses are increasingly using digital health tools across practice settings [2, 3] . Therefore, nursing schools must provide theoretical and technical knowledge related to these health information systems for nursing students [4, 5] . This is particularly important given the growing concerns regarding the lack of preparedness in using health information systems among graduating students once they join the workplace [6] [7] [8] [9] [10] . However, teaching students about EHRs presents challenges for most schools of nursing, primarily because of the limited EHR training opportunities within practice settings and the complexity of educating a large number of students in busy and often complex clinical environments [5, [11] [12] [13] .

Simulated EHRs for academic purposes have been proposed as an innovative pedagogy to promote the acquisition of theoretical knowledge of informatics and the skills needed to use EHRs in a safe environment before encounters with real patients [14] [15] [16] [17] [18] [19] [20] [21] [22] [23] [24] [25] . Incorporating these learning experiences within undergraduate nursing education expands the realm of effective teaching and learning practice, fulfills accreditation requirements, and ensures graduates have the required entry-to-practice competencies in nursing informatics upon exiting the program so that they are better prepared for practice in today's digitally rich health care environment [3, [26] [27] [28] . A simulated EHR is a learner-centered pedagogy grounded in a constructivist approach of experiential learning where learners are actively involved in the process of knowledge construction and reflective learning as opposed to passively receiving information [15, 29, 30] . Using case scenarios that mimic real-world clinical practice enables the students to learn how to use EHRs for care delivery, eg, identifying and interpreting patient data such as verifying medication accuracy, in a supervised environment before clinical encounters with real patients; thus, it improves learning outcomes and can contribute to promoting patient safety [20, [30] [31] [32] [33] [34] [35] [36] .

Simulated EHRs resemble electronic patient records used in practice settings [22, 37] . A number of products are available for nurse educators to choose from including open-source EHR or electronic medical record (EMR) and vendor-operated EHR or EMR platforms [38] . Examples of open-source platforms include OpenEMR, WorldVistA, and OSCAREMR. Vendor-operated platforms are available through health information system technology vendors such as Cerner. These also are offered through publishing companies such as Lippincott DocuCare by Wolters Kluwer, EHR Tutor by Assessment Technologies Institute, SimChart by Elsevier, and NEEHR Perfect, now known as ehr go , by Archetype Innovations. Although these products have similar platforms, they vary in cost and functionality [38] .

Research suggests that integrating simulated EHRs in prelicensure nursing education is beneficial to students' learning and development of important educational outcomes [20, 30, 34] . Simulated EHRs help improve students' critical thinking [18] and their ability to navigate EHRs and understand informatics concepts such as data management [19, 39, 40] . Other researchers found that simulated EHRs help enhance students' skills in electronic documentation [24, 41, 42] and aid in the development of positive attitudes and perspectives about electronic records [43, 44] . The integration of simulated EHRs also enhances students' confidence and self-efficacy in using electronic records [23, [44] [45] [46] and increases informatics knowledge and competency [16, 40, 47] . Despite these benefits, factors such as cost and faculty expertise continue to be major challenges in integrating simulated EHRs in nursing education [18, 34, 48, 49] .

At our university, curricular revisions presented an ideal opportunity to explore the integration of a simulated EHR within undergraduate nursing programs to expose students to health information technologies used in practice and to acquire the required entry-to-practice informatics competencies. This direction was enforced further by the introduction of Connect Care, a new EMR, in our health system. Although our students will have the opportunity to complete a user-training program before their clinical practicum in units that transitioned to Connect Care, these students have no previous exposure to hands-on practice with electronic records within their laboratory or simulation education, which is a gap in our curriculum. To support students' learning and application of informatics knowledge that is currently taught in theory courses and the computerized documentation introduced in the new curriculum across all clinical courses, we reviewed a number of simulated EHR solutions considering the benefits and value in meeting the students' and program's needs [16, 18, 37, 38] . We opted for the Lippincott DocuCare simulated EHR because it is user friendly and is aligned with the V-Sim resources currently used in our simulation laboratory. In addition, the cost of DocuCare for an individual student's web access at US $100 for 12 months (negotiable when based on an institutional purchase plan) provided additional support for choosing this product over others. The next step of our evaluation was to obtain feedback from students and faculty on the suitability of this product for integration into our programs.

This pilot study aimed to provide a preliminary evaluation of the Lippincott DocuCare program and to determine the feasibility issues associated with its implementation. The following research questions were examined:

1. Is there a significant difference in the mean scores of self-reported informatics knowledge and attitudes toward the EHR before and after using DocuCare? 2. What is the accuracy of students' electronic documentation? 3. Are students satisfied with using DocuCare as a learning tool? 4. How do students and educators describe their experiences using DocuCare as a learning tool to improve computerized documentation and overall informatics competency?

In this mixed method pilot study, a quasi-experimental one-group pretest-posttest design using short surveys was used to answer research questions 1 to 3, which were relevant to students' learning and satisfaction with DocuCare. Focus group interviews with students and educators were used to answer research question 4 [50] . A convenience sample from third-and fourth-year nursing students enrolled in undergraduate nursing programs in the Faculty of Nursing was invited to participate in this study because, at this level of education, they would have had some exposure to clinical practice and would have accumulated sufficient theoretical knowledge. Nursing educators involved in laboratory and clinical teaching within the undergraduate programs were also invited to participate.

Students were recruited through an announcement supplemented with an information sheet on the e-class site, inviting students registered in a number of third-and fourth-year courses to express interest in participating by contacting the researchers. A list of interested participants was then compiled, and the volunteering students were enrolled in the study on a first-come first-serve basis.

Interested student participants were contacted via email and asked to complete a survey (pretest), as described later, and to indicate their availability for attending an in-person orientation session to have a practice demo, using a scavenger hunt exercise, on how to use DocuCare. Two dates were provided with the option for an evening and weekend meeting time to accommodate students' schedules. At the same time, a total of 50 access codes were requested from DocuCare for use by students and educators in this study at no cost. Students who completed the pretest survey were then contacted and given the unique DocuCare access codes. As only a few students were able to attend the in-person orientation, a supplementary written guide with step-by-step directions and URL links to DocuCare publisher training videos on how to use the program was provided as a reference when they used DocuCare on their own.

The pretest-posttest survey included 18 items organized into 3 sections. This survey was administered to students at the beginning of the pilot (pretest) and used again as a posttest at the end of the pilot. Section 1 included 8 questions related to demographic and general information: program, year of study, opportunities for learning about informatics competencies in theory and laboratory training, exposure to electronic documentation in clinical sites, and support resources available to students when learning about computerized documentation. Section 2 included 5 Likert-type scale items (strongly disagree to strongly agree) that measured self-reported informatics knowledge using the entry-to-practice informatics competency indicators relevant to documentation and data management. These indicators have been validated in another study (Cronbach α=.93) [51] . Section 3 included 5 Likert-type scale items (strongly disagree to strongly agree) that measured nurses' attitudes and dispositions toward the EHRs (Cronbach α=.77) [52] . A high score on this scale indicates a positive disposition, and a low score indicates a negative disposition. Research Electronic Data Capture (REDCap; Vanderbilt University) software was used to administer the data collection tools [53] .

During the pilot, which was conducted over approximately 1 month, the participating students were asked to work on 4 patient case scenarios within the DocuCare platform, 1 scenario per week, or as their schedule permitted. Each case scenario required 1 to 2 hours on average, during which time the students needed to find information required for care planning, electronically document the care provided, and submit their completed work to the instructor for assessment. A standardized answer key for each scenario and a marking rubric, developed for the purpose of this study, were used to enhance objectivity and consistency in marking students' submissions in DocuCare. For each case scenario, the students' submissions were marked against the rubric using a rating scale from 1 to 4 (1=inaccurate, 2=somewhat accurate, 3=fairly accurate, and 4=completely accurate). A total score of 16 was tallied for the 4 case scenarios for each student. Students' previous documentation skills were not tested at baseline. Owing to their workload, laboratory educators were not available to participate in marking students' submissions. Instead, a master's-level graduate student was hired to assist with the project. The graduate student marked the students' submissions, provided feedback, tracked the students' progress, and responded to questions they had during the pilot. These marks were not included in academic grades. The case scenarios used in this pilot were identified from the Lippincott VR-Sim library and adapted slightly to balance the difficulty level, that is, simple-to-complex concepts. Each scenario was also mapped to relevant entry-to-practice informatics competency indicators as they applied to the focus of the scenario [27] .

A few days after completion of the 1-month pilot, the students were asked to complete the posttest survey and a satisfaction survey and to express interest in participating in semistructured focus group interviews to share their experiences. Two focus groups were scheduled to accommodate students' schedules. The satisfaction survey included 15 items measured on a rating scale from 1 to 5 (1 being very dissatisfied and 5 being very satisfied). Some of these survey items were related to ease of use and user experience that, with permission, were slightly adapted from the DocuCare vendor product satisfaction survey. The remaining items related to perceptions of the impact on learning were added by the researchers. This survey was integrated as a complementary measure in case students were not able to participate in interviews because of their workload.

For nurse educators, a poster invitation was sent to recruit interested participants. Those who expressed interest in participating were offered a training webinar along with access to DocuCare and the same scenarios that students used for them to try out the product over a 2-week period and share their perspectives. Educators were also asked to express interest in participating in a focus group interview.

Each focus group interview lasted between 60 and 90 minutes. The interviewers (second and third authors) facilitated all discussions in English using an interview guide. Field notes were taken and used, where required, to assist with reflecting on the data during analysis. The discussions were audio-recorded and transcribed verbatim.

Data from completed surveys were included in the analysis, and incomplete surveys were excluded. Using IBM SPSS Statistics version 25.0, descriptive statistics, including frequencies, means, and SDs, were used to summarize and describe the data. A two-tailed paired t test using a difference score (posttest and pretest) was applied to test the null hypothesis: there was no statistically significant difference in students' self-reported informatics knowledge and attitudes toward EHR mean scores before and after using the DocuCare program for 1 month (H0: M1−M2=0). For the qualitative interview data, the third author (UDW) compared all transcriptions and audio recordings to ensure the trustworthiness of the data. All transcripts were imported into the NVivo 11 data management software (QSR International Pty Ltd) and the data were coded and analyzed inductively. All authors discussed and defined emergent codes and themes to ensure intercoder reliability. The final codes and themes were refined until a consensus about the interpretations or coding frameworks was reached. Data were stored, managed, accessed, and analyzed within a secure SharePoint drive.

This study was approved by the institutional review and ethics board. Participation was voluntary, and students were assured that their participation had no impact on their academic performance. Each participant received an information sheet detailing the study procedures, benefits, and risks. Surveys were completed by implied covert action (ie, completion and submission of surveys). Written informed consent was obtained from all participants before the focus group sessions. Each interview began with an explanation of the purpose and procedures of the interview and assurance that the discussion would remain confidential.

Although 23 students participated in this pilot study, the results are reported based on an analysis of 13 completed pretest-posttest surveys. This decision was made because of missing data between the pre-and posttest surveys. Most of these respondents represented 2 large undergraduate nursing programs: the Collaborative Program (n=7 students; 5 were third-year and 2 were second-year students) and the After-Degree Program (n=5; all were in their second year of study). Only one third-year student was from the honors program. There was no representation from first-year After-Degree students or those in the bilingual program.

Students (n=13) described their overall understanding of the concept of nursing informatics and its relevance to their future practice as moderate (4/13, 31%), fair (6/13, 46%), or inadequate (3/13, 23%). The majority indicated receiving specific learning about informatics competencies expected of registered nurses in Canada: information and knowledge management (12/13, 92%) and professional and regulatory accountability (13/13, 100%), but fewer reported on the competency pertinent to the use of digital health technology in clinical practice (10/13, 77%).

With regard to learning about computerized documentation in EHRs during undergraduate education, 54% (7/13) of respondents indicated yes, whereas 46% (6/13) of them indicated no. Regarding permissions for students in the clinical setting, 54% (7/13) indicated they were permitted to view patient information with instructor or preceptor supervision. For permissions related to electronic documentation, almost two-third of the students (9/13, 69%) indicated that most clinical placement sites they went to did not use electronic documentation, whereas 23% (3/13) indicated yes and 8% (1/13) indicated sometimes. Table 1 provides an overview of the mean difference scores for the pre-and posttest surveys. The two-tailed paired samples t test to evaluate the impact of DocuCare on students' self-reported informatics knowledge and attitudes toward the EHR revealed a statistically significant difference in the mean score of knowledge before (mean 2.95, SD 0.58) and after using DocuCare (mean 3.83, SD 0.39; t 12 =5.80, two-tailed; P<.001).

The mean score was −0.88 (SD 0.54) with a 95% CI ranging from −1.21 to −0.55. The eta-squared statistic (0.74) indicated a large effect size. Therefore, the null hypothesis was rejected. However, there was no statistically significant difference in the mean scores of attitudes toward the EHR before (mean 3.75, SD 0.40) and after using DocuCare (mean 3.70, SD 0.34; t 12 =0.39, two-tailed; P=.70). The mean score was 0.05 (SD 0.43), with a 95% CI ranging from −0.21 to 0.30. Therefore, we failed to reject the null hypothesis, that is, there was no statistically significant difference in students' self-reported informatics attitudes toward the EHR mean scores before and after using the DocuCare program. 

For most students, their scores improved as they progressed from case scenarios 1 to 4, with more practice and ongoing feedback. Of the 13 students, 9 completed the 4 case scenarios. The lowest total score obtained by these students was 11 of 16, whereas the highest score was 15.

Of the 13 student participants, 12 (92%) completed the satisfaction survey at the end of the pilot. Only 42% (5/12) of these students attended the in-person orientation. Of these 5 students, 3 (60%) were satisfied with this session. Regarding the frequency of accessing DocuCare during the pilot, 58% (7/12) of students indicated accessing the program once a week, 25% (3/12) accessed it multiple times each week, and 17% (2/12) accessed it once a day or multiple times each day. Most students (11/12, 92%) were satisfied to very satisfied with the ability to access DocuCare at any time and from anywhere, the ease of use when submitting completed learning activities for assessment, and the ability to learn at their own pace. In addition, students were satisfied to very satisfied with the DocuCare layout (8/12, 67%) and reported that they encountered no technical glitches when using DocuCare (7/12, 58%).

With regard to learning, two-thirds of the students (9/12, 75%) were satisfied to very satisfied that DocuCare provided a realistic learning experience about computerized charting in EHRs because, in principle, it was similar to the electronic health or patient records used in the clinical setting. It also helped increase their confidence in gathering relevant patient information to inform clinical judgment and nursing care planning for the assigned case scenarios used in this pilot study and care planning in general. The majority of the students (11/12, 92%) were also satisfied to very satisfied that DocuCare increased their critical thinking and clinical judgment abilities and their overall confidence in applying computerized charting in a real clinical setting (10/12, 83%). Overall, 92% (11/12) of students were satisfied to very satisfied that using DocuCare enabled them to progressively enhance their informatics competencies and recommended using it for students' learning about computerized charting in undergraduate nursing programs.

In their responses to an open-ended question at the end of the satisfaction survey that asked what was helpful and what could be improved, the students provided some insights. One student indicated:

It could've been better if I attended the orientation session prior to the study as the program was hard to use in the beginning. However, the program allowed me to find the areas which I need to improve on such as critical thinking skills and judgement. I think it will be helpful/beneficial to students if the DocuCare program becomes part of the school curriculum.

Another student asserted that DocuCare was user friendly:

it was nice and simple to follow through with the steps, and the feedback was really helpful as well.

Another student added: 

A total of 7 students participated in focus groups, one interview had 4 students whereas the other had 3 students. A total of 7 educators attended the DocuCare webinar and tested the product; however, only 3 educators expressed an interest and participated in the focus group interview. Participants described their experiences using DocuCare as a learning tool to improve computerized documentation and overall informatics competency. Overall, 5 themes emerged, which were as follows:

(1) current challenges related to documentation, (2) motivating factors for embracing computerized charting as an educational tool, (3) educators' and students' experiences with DocuCare, (4) educators' and students' suggestions for improving DocuCare, and (5) recommendations for integrating DocuCare in undergraduate nursing curricula.

Reflecting on teaching and learning experiences in clinical practicum sites and acknowledging that they may become more complicated with the ongoing Connect Care implementation, the participating educators and students agreed that a number of challenges related to documentation currently exist in clinical and laboratory learning. This first theme, current challenges related to documentation, comprised 6 categories, 4 of which were exclusively from educators' perspectives: students' level of experience, stressful clinical settings, student-instructor ratios, and limited laboratory training hours. The following excerpt illustrates educators' concerns about students' level of experience and student-instructor ratios: 

Participants' reflection on informatics and DocuCare as a simulated record assisted in creating the second theme: motivating factors for embracing computerized charting as an educational tool. This theme included 3 categories: ideal timing, fostering exposure, and learning opportunity.

Participants acknowledged the need to prioritize the introduction of EHRs during their nursing education. They felt that their time in school was the ideal time to learn about EHRs because of their availability and openness and the school's propitious learning environment. According to one student: 

During the focus group interviews, participants described their experiences with DocuCare. On the basis of the accounts that emerged, we attempted to understand the experiences with DocuCare for both students and educators. This third theme is divided into 4 categories: ease of use, provision of feedback to students, well-integrated layout, and tools to provide safer care.

Although educators did not complete a satisfaction survey, they shared important insights through the focus group interviews. Educators described DocuCare as easy to use and having many features that can facilitate engagement with learners:

I think it was pretty easy to go in and find the tabs, and then you'd find something else the next time you went in that you missed last time, so-it was just a matter of spending that time doing it, right? [Educator 1]

Educators also mentioned the DocuCare feature for providing feedback to students on their submissions was seamless and efficient, thus promoting learning and positive interactions with students. As an educator indicated:

I thought it was kind of easy because you could just go in there and say, Okay, incomplete assessment, now please resubmit...It was non-offensive, supportive, which is sort of what we do, and then there's a box to add your comments [Educator 1] Educators also found that the layout of tabs within DocuCare was well integrated and presented a comprehensive view of the clinical information that students need to document, and it included a review of the care provided. According to one educator: 

Many responses were assigned to the theme suggestions for improving DocuCare. This theme, which is concerned with suggestions for improvement, is divided into 3 categories: warning signs, search functions, and indexing patient information. Educators suggested that it might be beneficial to have a warning sign within DocuCare, allowing users to know when the data chart is incomplete. Educators clarified that they (students):

Conversely, students felt that having a search function in DocuCare would make it more user friendly and easier to navigate. One student explained: 

This theme comprised recommendations for integrating DocuCare in the undergraduate nursing curricula. Specifically, it included 4 categories: better orientation and support, more exposure and frequency, scheduling DocuCare in the curriculum and integrating it within courses, and flexibility of delivery with a focus on learning, not grading.

Both educators and students agreed that the introduction of DocuCare in the undergraduate curricula should start with an orientation for both educators and students on the system usage coupled with ongoing technical and human support. According to one student: Educators and students also agreed that incorporating DocuCare in the education of nursing students should be systematic, with more frequent exposure. They suggested that exposing students to it in the simulation laboratory and, where possible, in clinical settings would allow adequate opportunities for students to develop proficiency and integration with their overall repertoire of clinical skills. One student pointed out: 

The purpose of this pilot study was to determine feasibility issues and evaluate the suitability of DocuCare from the perspectives of students and educators, as a tool for supporting students' acquisition of informatics competency and to enhance their readiness for future practice in digital health environments. The use of DocuCare in this study contributed to improving students' knowledge about informatics and accuracy of electronic documentation, congruent with findings from previous research [16, 19, 24, [40] [41] [42] 47] . There was no change in attitudes toward EHRs. On the basis of the findings from focus group interviews with students, this could be explained by the fact that students already had positive attitudes toward this technology, as demonstrated in their responses. In our study, educators agreed that hands-on learning opportunities through simulated electronic records were vitally important for the application of knowledge, development of critical thinking and documentation competencies, and building confidence in using clinical information systems in practice settings. Similarly, students were overwhelmingly satisfied to very satisfied with DocuCare and highly recommended using it in undergraduate nursing programs. They indicated that opportunities for electronic documentation will not only strengthen their communication skills but also enhance their critical thinking skills and their understanding of informatics concepts. It could ease their transition to using advanced technology in the work setting, which is congruent with findings from previous research [11, 47] .

The results of this study and other research confirm that students recognize gaps in their informatics preparedness to meet workplace requirements regarding the use of electronic tools to support nurses' work, particularly for data management and electronic charting [5, 6, 11, 16, 42] . Uniquely, in our study, students and educators provided suggestions for improving the DocuCare platform. They also shared strategies and recommendations on how DocuCare could be incorporated in strategic ways to augment students' learning about digital health and informatics without creating additional workload or overwhelming the already content-heavy curricula. Students were also quite passionate and willing to take on a self-directed role in embracing this technology to support their education. They recognize that the technological changes taking place in the clinical environment warrant action, but their education was not keeping pace. Although these findings reflect more awareness among student nurses regarding the importance of digital health and informatics in nursing practice, they also assert the need for more work on the part of nursing schools and nurse educators in creating learning opportunities within the curriculum to enhance students' preparedness for their future nursing roles. Unfortunately, within Canadian prelicensure education, significant gaps still need to be addressed.

In a recent survey of Canadian schools of nursing, fewer than 20% of 360 nurse educators surveyed reported using EHR simulation in conjunction with teaching clinical skills in a simulation laboratory [5] . Congruent with these findings, in another survey conducted by Canada Health Infoway, only 35% of the nurse educators surveyed reported using a training version of an electronic record or clinical information system to support the teaching of nursing skills [2]. In addition, despite the increased utilization of digital health tools in practice, only 6 of 10 nurses surveyed about the use of virtual care reported having adequate knowledge and skills to use these systems [2].

Nagle et al [5] identified that teaching students about the use of EHRs is challenging in practice settings because there are few opportunities for students to access or use fully functional EHR systems in health care facilities. These findings are congruent with our findings and those in the general literature [11, 34] . Nagle et al [5] also highlighted the need for an affordable EHR sandbox that could be used in simulation laboratories to teach students how to integrate these tools as they learn other clinical skills. They also identified the need for academic administration support for nurse educators as they implemented these tools [5, 54] . Simulated EHRs are valuable for students learning about informatics and computerized charting; therefore, removing barriers to integrating them within Canadian nursing education should be a priority [5, 20, 34, 42, 54] .

Educating future nurses about digital health and informatics is no longer an option but rather a core requirement in modern-day nursing practice [5, 34, 40, 42, [54] [55] [56] [57] [58] [59] . Although the abrupt transition to remote delivery of education during the COVID-19 pandemic highlighted the current gaps in technology infrastructure and created challenges for higher education institutions worldwide, it also revealed opportunities for embracing technology and virtual simulation. This could be an important opportunity for nursing programs to capitalize on as we navigate more virtual practice across all domains of nursing [60] [61] [62] [63] [64] .

As this was a pilot study and voluntary participation was appreciated, the small sample size and the use of a one-group quasi-experimental design affected the power of the study. Numerous contextual factors may also have influenced students' willingness to participate in the study. The participants' recruitment was interrupted because of the COVID-19 pandemic and the public health guidelines restrictions. Students' academic workload, disruption of clinical placements, stress and feelings of uncertainty related to the COVID-19 pandemic, and the uncertainty regarding the completion of their program and entering the workforce in an evolving global pandemic may have also influenced students' desire to participate in this research. Finally, students who agreed to participate might have been more interested in the topic of the study compared with those who did not participate, which may have resulted in a response bias.

The integration of simulated EHRs within the nursing curriculum has the potential to improve students' knowledge and understanding of informatics and build confidence in using EHRs, including computerized charting. In this pilot study, the opportunity to use DocuCare firsthand enabled our students and educators to provide important insights and recommendations to the curriculum committee on the suitability and value of this educational tool for improving teaching and learning about informatics, computerized documentation, and the use of EHRs. This preliminary evaluation will also inform the planning of a future larger, controlled evaluation study, inviting students and educators from other sites within our collaborative nursing programs in Alberta. Given the paucity of Canadian research on simulated EHRs, the findings of this study may also be useful to other schools of nursing.

2020 National survey of Canadian nurses: use of digital health technology in practice. Canada Health Infoway

| iss. 2 | e26944 | p

Canadian Nurses Association and Canadian Nursing Informatics Association

Chapter 18: Effects of informatics and technology on curriculum development and evaluation

Digital Health in Canadian Schools of Nursing Part A: nurse educators' perspectives. Qual Advance Nurs Edu -Avancées en formation infirmière

Graduating nurses' self-evaluation of information technology competencies

Baccalaureate nursing students' information technology competence-agency perspectives

Novice nurse preparedness to effectively use electronic health records in acute care settings: critical informatics knowledge and skill gaps

Electronic documentation: assessment of newly graduated nurses' competency and confidence levels

A qualitative study of new graduates' readiness to use nursing informatics in acute care settings: clinical nurse educators' perspectives

Restrictions on nursing students' electronic health information access

Education of student nurses -a systematic literature review

Nursing students' learning dynamics and influencing factors in clinical contexts

What is the solution for clinical nurse educators and the electronic medical record? Teach Learn Nurs

The value of simulation-based learning in pre-licensure nurse education: a state-of-the-art review and meta-analysis

Assessment of the need to integrate academic electronic medical records into the undergraduate clinical practicum: a focus group interview

Innovative strategies for nursing education: enhancing curriculum with the electronic health record

Utilization of academic electronic medical records in undergraduate nursing education

Enhancing prelicensure nursing students' use of an electronic health record

Implementing electronic health records in nursing education

The impact of nursing students' use of electronic health records in the home setting

Integrating the academic electronic health record into nursing curriculum: preparing student nurses for practice

Development of the electronic health records for nursing education (EHRNE) software program

Electronic medical record in the simulation hospital: does it improve accuracy in charting vital signs, intake, and output? Comput Inform Nurs

National nursing education framework: final report. Canadian Association of Schools of Nursing

| iss. 2 | e26944 | p

Nursing informatics entry-to-practice competencies for registered nurses. Canadian Association of Schools of Nursing

A vision for the changing faculty role: preparing students for the technological works of health care 2015. National League of Nursing

Simulation Methodology in Nursing Education and Adult Learning Theory

Effectiveness of patient simulation in nursing education: meta-analysis

Simulation research to enhance patient safety and outcomes: recommendations of the Simnovate Patient Safety Domain Group

Simulation and patient safety: the use of simulation to enhance patient safety on a systems level

Enhancing patient safety in nursing education through patient simulation. Patient safety and quality: An evidence-based handbook for nurses

Introduction of patient electronic medical records (EMR) into undergraduate nursing education: an integrated literature review

Participation in EHR based simulation improves recognition of patient safety issues

The role of nursing informatics on promoting quality of health care and the need for appropriate education

Selecting an academic electronic health record

Educational electronic health record project. BCcampus

Student nurses and the electronic medical record: a partnership of academia and healthcare

Use of a simulated electronic health record to support nursing student informatics knowledge and skills

Incorporating electronic documentation into beginning nursing courses facilitates safe nursing practice

Students nurses' knowledge toward ED training. Can J Nurs Inform

Electronic medical records in clinical teaching

Factors influencing nursing students' acceptance of electronic health records for nursing education (EHRNE) software program

Impact of simulation training on self-efficacy of outpatient health care providers to use electronic health records

Student perceptions of electronic health record use in simulation

Effects of using mobile device-based academic electronic medical records for clinical practicum by undergraduate nursing students: a quasi-experimental study

Successful Integration of an Academic Electronic Health Record Into the Curriculum of an Associate Degree Nursing Program

Integrating an academic electronic health record: challenges and success strategies

Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research (Subscription)

Psychometric properties of the canadian nurse informatics competency assessment scale

Electronic health records documentation in nursing: nurses' perceptions, attitudes, and preferences

Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support

Digital Health in Canadian Schools of Nursing-Part B: Academic Nurse Administrators' Perspectives. Quality Advancement in Nursing Education -Avancées en formation infirmière

Education into policy: embedding health informatics to prepare future nurses -a Zew Zealand case study

Tudor Car L. A digitally competent health workforce: scoping review of educational frameworks

Educating the nurses of 2025: technology trends of the next decade

Preparing today's nursing students for tomorrow's career

Health in the 21st century: Putting data to work for stronger health systems. Organisation for Economic Cooperation and Development (OECD)

Simulations and Virtual Learning Supporting Clinical Education During the COVID 19 Pandemic

COVID-19 Pandemic as a Driver for Spreading Virtual Care Globally: The Future Starts Now

Maintaining Clinical Continuity Through Virtual Simulation During the COVID-19 Pandemic

State of the art of nursing education and the challenges to use remote technologies in the time of Corona Virus Pandemic

Virtual care: new models of caring for our patients and workforce

The Teaching and Learning Enhancement Fund from the University of Alberta funded this study.

MK was involved in funding acquisition, conceptualization, designing the methodology, investigation, formal analysis, project administration, resources, supervision, and writing, reviewing, and editing the original draft. DJ was involved in investigation and writing the review. UDW was involved in investigation, formal analysis, and writing and editing the review. SA was involved in investigation, formal analysis, and writing and editing the review.

None declared. information, a link to the original publication on https://nursing.jmir.org/, as well as this copyright and license information must be included.