key: cord-0802751-34ebzzce
authors: Ford, James H.; Rotzenberg, Katherine; Mott, David A.
title: Novel Integration of Administrative Pharmacy Residents in a Management Course
date: 2021-04-22
journal: Innov Pharm
DOI: 10.24926/iip.v12i2.3622
sha: b9a9e8a00f8e38ce6c11f80f408988d21c5f54c1
doc_id: 802751
cord_uid: 34ebzzce

BACKGROUND: Management skills are an essential component of a pharmacy graduate’s abilities for successful practice. Although pharmacy education standards require that students have a working knowledge of management principles, students often do not see the value in management and business courses. One innovative approach is restructuring course content using case examples and real-world experiences to improve student understanding of finance and management principles. INNOVATION: Two specific changes were implemented in a second year (P2) management and finance course to improve the relevance of business principles. Course content was organized around current pharmacy service cases from a variety of practice settings and supported by the value of problem-based learning. Post-graduate year 1 (PGY-1) administrative pharmacy residents were engaged as course teaching assistants (TAs) who brought real-world experiences into the class. An analysis of pre- and post-course voluntary surveys, course evaluations, and TA evaluations assessed the impact of the course redesign. FINDINGS: The course redesign achieved its intended goal of improving student-perceived course relevance. This was shown through statistically significant improvements in course evaluations that were intended to measure student perception of pharmacy management and its relevance in their future career. Student completed TA evaluations showed that those who reported their TA shared real-world applications had higher confidence in applying course concepts and greater understanding of course materials. CONCLUSIONS: Administrative pharmacy residents were successfully integrated into a pharmacy management course redesign, resulting in improved student perceptions of course relevance.

The instructors reviewed the pharmacy literature to determine how others have improved relevance in their business courses and sought input from the administrative pharmacy team at a local partner academic teaching hospital. The instructors supplied the administrative team with the syllabus, objectives for each lecture and the course evaluation comments from students. As a result, the instructors elected to implement a two-pronged approach to increase course relevance for students:

(1) Organize course content around current pharmacy service cases across a variety of practice settings, supported by evidence of the value of problem-based learning with progressive cases. 7 (2) Engage PGY-1 administrative pharmacy residents as course TAs, supported by evidence that guest lecturers with real-world experience can improve course relevance [8] [9] [10] The instructors expected that sharing of real-world examples would underscore the relevance of management and finance principles, and that PGY-1 administrative pharmacy residents would be better able to demonstrate relevance and daily application of these principles in healthcare and pharmacy practice. This paper describes a partnership between a pharmacy management course and a PGY-1 administrative residency program, and reports on the process of the integration and research findings.

The modular design of the course provided an overview of management and finance principles and discussed their application across three pharmacy settings (Table 1) . With six discussion sections but only five resident TAs, one additional TA was recruited from the third-year pharmacy student (P3) class (the previous source of all TAs for this course). Each TA led one discussion section of 21-25 students which met weekly for 90 minutes. The instructors and TAs met in weekly staff meetings starting two weeks before the semester began to discuss and gather feedback on the plan for the upcoming weeks. Each TA was expected to include their own personal examples into the basic set of presentation materials and were encouraged to customize as needed to support their students. The COVID-19 pandemic required asynchronous delivery of the last three weeks of the course; subsequently, the last two weekly discussions were converted to remote, self-guided student activities.

In return for PGY-1 administrative pharmacy resident support, the school provided the residents with two credits of independent study and structured the experience as a teaching rotation within their residency program. One instructor served as the lead preceptor for the teaching rotation and had previous experience precepting residents in clinical and management rotations. The lead preceptor worked with the residency program director to establish the outcomes for the rotation and then established the evidence for achieving each outcome with the other course instructor. The outcomes and evidence were presented to the TAs at the beginning of the semester to ensure understanding of expectations. The instructors scheduled observations for each TA at the midpoint and end of the course to determine outcome achievement and submitted final evaluations on rotation performance at the end of the course. Resident TAs also completed an evaluation at the conclusion of the rotation and provided feedback on their experience. The P3 TA was compensated monetarily. She was observed and evaluated in the same manner as the residents, but did not complete a post-course evaluation.

The impact of the course redesign was evaluated via three outcomes: (a) a pre/post voluntary anonymous survey, that examined changes in student perceptions about management and financial principles; (b) the course evaluation; and (c) a modified TA evaluation. The last two outcomes are standardized across all courses in the School of Pharmacy. All analysis was conducted using SPSS 25 (IBM Corp. Armonk, NY). This course redesign and evaluation was certified as quality improvement/program evaluation by the University of Wisconsin-Madison Health Sciences Institutional Review Board (IRB).

The survey was administered at the beginning of the course (paper-based) and at the end of the course (electronically via Qualtrics, Provo, UT). The survey used a five-point Likert scale (1= strongly disagree to 5=strongly agree) and consisted of 17 management and finance principles questions and ten additional questions asked only on the post-course survey. Using an independent sample t=test, the pre-and post-course voluntary survey results (response rate of 90% on the pre-and 75% on the post-survey) showed significant improvement in agreement with the statement Pharmacy management topics are relevant to my future pharmacy career, increasing from 3.5 (SD 1.17) at the beginning of the semester to 4.0 (SD 0.99) at the end of the semester (p < 0.001).

All courses at the school of pharmacy are evaluated by students using a standardized, web-based course evaluation. The evaluation includes 13 questions about the course (5=Extremely to 1=Not at all) and an overall score for course quality (7=A to 1=F). We compared responses to the 2019 and the 2020 course evaluations with an independent sample t-test that tested for homogeneity of variances to assess the impact of the course redesign on student perceptions of the course overall. Significant improvements existed in every evaluation item from 2019 (n=138 students, 98.6% response) to 2020 (n=133 students, 96.4% response). The letter grade students assigned regarding overall course quality also improved from an average BC grade (3.96 ± 1.8) to between a B and AB (5.64 ± 0.97, p < 0.001).

The last assessment was the TA evaluation, which included 12 questions used campus-wide to evaluate the quality of TA teaching and provide feedback on TA performance. Three additional TA evaluation questions, related to real world experiences, were included specific to this inquiry ( Table 2) . Each question was scored using a 5-point Likert scale (5=Extremely to 1=Not at all). Two groups were createdstudents with resident TAs and students with P3 TA -to determine if student perceptions varied by the type of TA given the greater management exposure of the resident TAs. The results from the independent sample t-test considering the results of the homogeneity of variance test (Table 2 ) found significant differences between the TA groups (resident vs. P3) for seven of the twelve evaluation questions. When significant differences existed, students rated the P3 higher than the hospital residents. For example, This TA explained material clearly (residents = 4.5 versus P3 = 4.9, p=0.035) and The topics discussed during my discussion section contributed to my understanding of the course material (residents = 4.2 versus P3 = 4.8, p=0.004). A Chi-Square analysis examined association between responses to the real-world applications question on the TA evaluation and responses to the two questions about understanding and confidence by TA group. Students who reported their TA shared real-world applications also reported higher confidence in applying course concepts (χ2 =125.49, p=<.0001) and greater understanding of course materials (χ2 =125.49, p=<.0001) regardless of TA type. The course and TA evaluation were worth 5 points (out of 375 points) for the course.

The course redesign with integration of resident TAs achieved its intended goal of improving student-perceived course relevance and resulted in significantly improved course evaluations. Students who felt more strongly that their TA provided real-world applications of course concepts also reported higher confidence in understanding and applying these concepts. This supported our underlying expectation that real-world applications would help improve student-perceived relevance. However, we did not find a difference by TA type in the perceived frequency of TAs providing real-world applications in class. Instructor observations of TAs leading their discussion sections supported the finding that all TAs incorporated real-world applications in their teaching; however, as students only interacted with a single TA throughout the semester, students are unable to compare the quality and quantity of real-world applications across all TAs.

The P3 TA significantly outperformed the administrative residents in ability to explain concepts clearly and support student understanding of course material. One explanation for this result could be that the residents assumed a higher knowledge among the students (which was directly observed by one instructor); the P3 TA may have been better able to determine the right level of explanation and how the content fit with the other courses the students were taking and/or the students' past experiences. Another explanation could be that the P3 self-selected into the role and was more skilled at making relevant connections for this student cohort. Overall, students gave their TAs very positive evaluations, and a mix of residents and P3 students as TAs can be used going forward. This analysis has several limitations. The anonymity of the preand post-surveys did not allow for comparisons for individual students. Fewer students completed the post-survey; if lessengaged students disproportionately did not complete the post-survey, this may have resulted in artificially higher scores. However, participation rate in both surveys was quite high, so this is less of a concern. A number of changes were implemented simultaneously, and students were not surveyed on every change that was implemented. Therefore, it is not possible to isolate which components of the course design led to positive outcomes.

The persistence of necessary COVID-19 changes of the delivery approach and course structure for the Spring 2021 semester goes beyond changes that were planned based solely on the redesign results. Going forward, a mixture of asynchronous recorded lectures and synchronous learning opportunities will be used to deliver course content. Administrative pharmacy residents will again serve as course TAs. While a modular case study approach will be employed, student knowledge will be evaluated utilizing a new longitudinal group business plan assignment. In this semester, the course was offered online with no face-to face sessions. The business portfolio promotes student interactions and provides a realistic way to apply the concepts taught in the course to a real-world application. TAs will interact with their assigned student groups through this assignment instead of leading synchronous discussion sessions, and in this way, continue to share their relevant management experiences. The standardized course evaluations and a postcourse survey will inform the impact of this revised structure, which continues to leverage real-world applications. 

Exploring communities of practice in the NHS: A core medical trainee experience

Pharmacists' evaluation of key communication skills in practice

Accreditation standards and key elements for the professional program leading to the Doctor of Pharmacy degree

Using emotional intelligence in the planning and implementation of a management skills course

Management education within pharmacy curricula: A need for innovation

Redesign of a required undergraduate pharmacy management course to improve student engagement and concept retention

Development of a problem-based learning course in human resources management

Teaching pharmacy students how to manage effectively in a highly competitive environment

A didactic community pharmacy course to improve pharmacy students' clinical skills and business management knowledge

A mass merchandiser's role in enhancing pharmacy students' business plan development skills for medication therapy management services

Funding: None