key: cord-0686948-ku1wb8wn authors: Hayashi, Meagan; Mahmoud, Sherif Hanafy; Hamdy, Dalia A title: The Efficacy of a Didactic and Case-Based Pharmacogenomics Education Program on Improving the Knowledge and Confidence of Alberta Pharmacists date: 2022-04-23 journal: Pharmgenomics Pers Med DOI: 10.2147/pgpm.s348851 sha: 8bc9694a3e55eac3e9f80b04f6fb836361e1f298 doc_id: 686948 cord_uid: ku1wb8wn BACKGROUND: Pharmacogenomics (PGx) is the study of how genetic variations for functional proteins, such as metabolizing enzymes and drug receptors, impact drug pharmacokinetics and pharmacodynamics. In theory, pharmacists are well suited to utilize PGx in tailoring medications to patient genetics when providing medication therapy management services. However, PGx education needs to reach pharmacists prior to implementation. The aim of this study is to develop and evaluate a PGx course for pharmacists. METHODS: A PGx education program was created and offered synchronously (virtual) and asynchronously (self-study) to pharmacists in Alberta, Canada. Lectures were delivered by experts live (virtual) with a question-and-answer period for synchronous sessions. These sessions were recorded for asynchronous delivery. Six case studies were discussed in large and small groups (“breakout rooms”) in synchronous sessions, and provided for self-study in the asynchronous subgroup. Topics included genetic and PGx concepts; therapeutic applications; ethical, legal, and social considerations; and practical implementation. Pre- and post-course surveys measured self-rated knowledge using a 5-point Likert Scale and tested objective knowledge with a graded quiz. RESULTS: Thirty-six pharmacists completed the course and both surveys. Participants reported backgrounds in community (88.9%) and hospital (38.9%) practice. Prior education in PGx was reported by 44.4% from degree programs and 27.8% from continuing education. Overall responses to statements about confidence in PGx moved from a median of “Disagree” at baseline to “Agree” after receiving PGx education (2-point difference [1,2] on 5-point Likert Scale; p < 0.001), indicating an increase in self-assessed competency in PGx. Likewise, mean participant grades on the knowledge quiz improved (20.8±21.9% pre-course vs 70.2±19.1% post-course, p < 0.001). There was no difference in these results between synchronous and asynchronous groups. CONCLUSION: A didactic and case-based PGx education program was effective at increasing pharmacist knowledge and confidence in PGx in both synchronous and asynchronous environments. Knowledge gained can be utilized in delivery of patient-centered, personalized medication therapy management in the pharmacy setting. Practicing pharmacists in the province of Alberta, Canada, were recruited through email correspondence with pharmacy managers, general social media posts, and word-of-mouth referrals for either synchronous, asynchronous, or mixed attendance. After expressing interest from a potential participant, a formal recruitment email was sent to the potential participant with details regarding both the research study and PGx course. The recruitment email contained a link to the implied consent form and pre-course survey. Recruitment commenced March 2021. Synchronous and mixed participants were accepted until the night before course commencement on June 12, 2021, and asynchronous participants were eligible for inclusion in primary outcome data analysis if pre-course and post-course surveys were completed prior to 23:59 September 20, 2021. Any pharmacist with an active pharmacy practice Alberta license was eligible for inclusion, and there was no specific exclusion criteria. Pre-course surveys without a matched post-course survey were still eligible for inclusion in the secondary outcome analysis of baseline knowledge and confidence among practicing pharmacists. The primary outcome of this research study was the change in median Likert Scale scores for opinion/confidence questions, as well as the change in mean knowledge quiz scores, in paired data analyses of pre-course and post-course surveys. The secondary outcomes of interest were the baseline demographic, individual opinion/confidence answers, and knowledge quiz scores in the pre-course survey only. The secondary outcomes were compared among subgroups of pharmacists based on prior training in pharmacy, years of practice, age, gender, and prior exposure to pharmacogenomics. A survey was created to collect demographic and pharmacy education/experience pre-course and measure subjective and objective competency in pharmacogenomics both pre-and post-course. Education and experience questions focused on practice environment as well as prior exposure to PGx information. There were 11 questions on pharmacist opinions and confidence on pharmacogenomics, each to be rated on a Likert Scale, with possible answers consisting of "Strongly Agree," "Agree," "Neutral," Disagree," and "Strongly Disagree." The survey closed with 7 exam-style questions testing pharmacogenomics knowledge, with varied question types that included single choice and multiple checkbox answers to total a maximum potential mark out of 14. Questions for both Likert Scale and knowledge quiz were created utilizing a review of similar research and consultation with experts. The topics addressed in these were considered of high importance for pharmacist PGx competencies according to the American Association of Colleges of Pharmacy. 32 Survey questions underwent face validation by pharmacy educators and practicing pharmacists to ensure clarity of questions. The surveys took approximately 10 minutes for participants to complete. The full survey is available in Supplementary Materials 1. The training program consisted of 11 lectures (Supplementary Materials 2, Table S2 .1) by various experts covering the competences and therapeutics identified in Figure 1 32 and the scoping review, 16 respectively, and 6 case studies developed by the research team (Supplementary Materials 2, Table S2 .2). Speakers were invited by the research team based on their expertise in the field of PGx in pharmacy, with an aim to recruit experts from different countries to incorporate an international PGx approach. The therapeutic areas of focus for this course were selected based on a scoping review on the use of pharmacogenomics in pharmacy practices. 16, 28 Particularly, the applications of PGx in cardiovascular, psychiatric, and pain indications, which all have guidelines available from organizations such as the CPIC, were found in the literature to be feasible and clinically useful in the pharmacy setting. 16 The AACP PGx Competency statement 32 also informed the education sessions on basic genetic and pharmacogenetic knowledge, as well as the ethical, legal, social, and practical implications of use of PGx in pharmacy practice. The pharmacist patient care process 11, 34 was utilized within a dedicated session as well as throughout course and case-study design to emphasize the role of PGx information in concert with other patient characteristics and the larger clinical picture. The preliminary design of this research study and course was a completely synchronous program to take place over two days, ideally in a live conference setting. However, due to the circumstances of the COVID-19 pandemic, the decision was made to utilize virtual venues in concordance with public health guidelines at the time. Participants were provided with the option to attend both days live (synchronous, virtually), self-study (asynchronous, online), or a combination of these options suitable to their schedule and commitments (mixed). For participants able to attend some or all the content live, a virtual course was held over Zoom (Zoom Video Communications, Inc., San Jose, California) on June 12-13, 2021, for 5 hours each day. Handouts were provided the night prior to each day, containing lecture slides and case studies without answer keys. Within each major topic, case studies would be provided for participants to work through with the facilitators in between didactic sessions. Breakout rooms were included in half of the cases to allow participants to interact with one another and solve problems posed within the cases together with a course facilitator (a research team member and the invited speaker). Each didactic lecture included a question-and-answer period with the speaker, with questions from the chat-box read out by a moderator. The use of a chat-box was to ensure participant confidentiality in recordings of sessions in alignment with research ethics, as these recordings were used in the asynchronous course described below. The breakout rooms where discussions occurred between facilitators and speakers were not recorded. Live didactic sessions ran for 15-45 minutes per session (including the Q&A), and 15-30 minutes were spent on each of the case studies. For participants requiring self-study for some or all the course content, the live sessions were recorded and organized into individual modules. Case studies were provided with answer keys and instructions on the suggested timing to complete the case within the order of the video content. Mixed participants unable to attend the first day live were provided the session recordings, handouts, and case studies by email, with sufficient time to complete these before the second day sessions. Completely asynchronous participants were given access as "viewers" of a Google Drive folder (Google LLC, Mountain View, California) after completing the pre-course survey. The course folder contained instructions for completing the course, each individual session video with slide handout, case studies with answer keys, and supplementary materials such as additional readings and resources referenced in the course. Asynchronous participants were advised of a deadline of September 13, 2021, to complete the post-course survey. Study data were collected and managed using REDCap electronic data capture tools hosted at the University of Alberta. 35, 36 REDCap (Research Electronic Data Capture) is a secure, web-based software platform designed to support data capture for research studies. Pharmacists who expressed interest in participating were sent a pre-course survey from REDCap prior to attending the live course or receiving access to the course materials depending on synchronous or https://doi.org/10.2147/PGPM.S348851 Pharmacogenomics and Personalized Medicine 2022:15 asynchronous participation, respectively. After participants completed either synchronous or asynchronous learning, they received the post-course survey by email. Synchronous participants were given time before closing remarks to complete the post-course survey, and asynchronous participants were provided direction to complete the post-course survey as soon as reasonably possible after viewing all videos and completing all case studies. Participants were not provided with their answers to either survey after completion. Participant demographic data was summarized as mean ± standard deviation (SD), or n (%) for normally distributed numerical variables and categorical variables, respectively. The Central Limit Theorem (CLT) was applied to non-normal data with an n ≥ 30, while non-normal data with an n < 30 was summarized as median (interquartile range; IQR). Likert scale responses were coded as follows: Strongly Disagree (1), Disagree (2), Neutral (3), Agree (4), and Strongly Agree (5), with a higher number reflecting more positive opinions/greater self-confidence. Answers to these questions were analyzed for the primary outcome by paired Wilcoxon Rank Sum analysis for the Likert scales used, and the knowledge-based quiz was graded by the research team and compared pre-and post-education as mean ± SD in a paired Student's t-test if distribution was normal or CLT could be applied. If these assumptions were not met, Wilcoxon Rank Sum was used for analysis. In the secondary analysis, individual responses to Likert scale and knowledge test questions were summarized as n (%). Subgroup comparisons of Likert-scale responses and non-normal knowledge test data were compared using Wilcoxon Rank Sum or Kruskal-Wallis test depending on the number of groups. If significance was found with Kruskal-Wallis, the Dunn test was used for multiple comparisons and adjusted p-values were manually calculated for the number of comparisons. A forward selection linear regression was built for knowledge test scores for all pre-course surveys received using demographic and education history data and mean value of confidence rated on the Likert-scale questions. A similar regression was built for mean confidence scores using demographic and education history data and knowledge test scores pre-course. The mean values were used in the linear regression on confidence scoring rather than median for higher sensitivity. Lastly, to validate the subjective survey administered, mean Likert responses were compared to mean test grades for participants in a linear analysis for all pre-course surveys, all post-course surveys, and the calculated difference in these values from pre-course to post-course. All statistical analyses were performed using STATA version 17 (StataCorp, College Station, Texas, USA), and a p < 0.05 was considered statistically significant. Informed implied consent form was included on the cover page of both the pre-course and post-course surveys. Electronic Consent was implied by completion of the surveys, documented in the de-identified participant record by the completed status on the REDCap database. Written (wet ink) consent was not sought out due to the virtual nature of participation for live course participants from a broad geographical region, and due to the asynchronous nature of participation for self-study course participants. Within this study design, participants never met in person with the research team. However, the study procedures were explained to each participant through the invitation email approved through ethics, with a member of the research team responding to any potential participant queries in a timely manner. The study team's contact information was provided to all participants within the implied consent form, which participants were advised to print for their records. This study and consent procedure was approved by the University of Alberta Research Ethics Board (Pro 0108818). At least 2000 pharmacists were reached through social media, email, and word of mouth referrals ( Figure 2 ). While there is no method to determine the true number of potential participants reached by social media, interested pharmacists reached out through email and social media for more information, and were subsequently sent an email invitation to participate in the study. There were 69 Alberta pharmacists invited to complete the initial pre-course survey. A total of 36 pharmacists were included in the primary outcome analysis: 10 attended all live Zoom sessions synchronously, 9 Table 2 . Most pharmacists who completed both surveys for primary analysis had community experience (88.9%) and over a third had worked in hospital settings. In the primary analysis, only 11 (30.6%) had no prior education or exposure to pharmacogenomics. In addition to face validation, simple linear regression analyses were performed to determine correlation between subjectively rated knowledge (mean Likert scale responses) and objectively tested knowledge (mean scoring on quiz portion of survey). Moderate, statistically significant relationships between subjective and objective knowledge was observed (pre-course r = 0.476, p < 0.001; post-course r = 0.401; p = 0.015). This indicated that a participant's subjectively rated knowledge was proportional to their objectively tested knowledge, with this relationship slightly stronger prior to education. As noted in the statistical analysis, Likert Scale responses were coded 1 = "Strongly Disagree" to 5 = "Strongly Agree". Pharmacist responses to Likert Scale statements changed from a median of "Disagree" (2 [2, 3] ) to "Agree" (4 [4, 4] ) after pharmacogenomics education (p < 0.001) in the 36 participants included in the primary analysis, indicating an overall improvement in participant self-rated knowledge. The improvement in mean subjectively rated knowledge (Likert scales) was determined to have a positive linear relationship with improvements in objective knowledge test grades with pharmacogenomics education (Figure 3) , meaning those who experienced greater improvement in their own self-assessed competency, had also experienced greater improvement in their objectively tested knowledge. Statistically significant improvements in subjective responses were observed consistently among each individual question (Figure 4) , showing global improvement among all PGx domains. There was no significant difference in the change in subjective knowledge or the final subjective knowledge as rated on the Likert scale based on course participation method, all methods demonstrated improvement in PGx DovePress subjective and objective knowledge. Furthermore, there were no identified participant characteristics such as experience, years of practice, or prior use of PGx that indicated a difference in final post-course confidence. Among the 59 pre-course surveys received, median responses for nearly all questions were "Disagree" (2) at baseline. Only the two opinion-based statements, "Pharmacogenomics can enhance the provision of medication-related services (eg, dispensing, care-planning)" and "Pharmacogenomics testing is cost-effective" received median responses greater than 2 (these were 4 and 3, respectively). There was a significant difference in baseline median confidence/opinions between pharmacists with prior PGx training in their degree program vs those without (2 [2, 3] When a forward selection linear regression was built with the mean Likert responses, higher objective knowledge test scores (p = 0.001), international education (p = 0.006), prior experience with PGx testing (p = 0.137, included due to plausible effect), and prior PGx education in degree program (p = 0.002) and in continuing education (p = 0.021) were all found to fit a model that explained 53.1% of the variation in mean Likert responses agreeing with positive opinions and subjective knowledge in PGx pre-course (p < 0.001). Objective knowledge test scores alone appeared to account for 22.6% of the variation in Likert responses on its own in pre-course analysis. This relationship was slightly less strong post-course, with only 16.1% of variation in Likert responses explained by objective knowledge. Mean participant grades in the knowledge test portion of the survey improved significantly pre-course vs post-course (20.8±21.9% vs 70.2±19.1%, p < 0.001; Figure 5 ). Each question saw significant improvement in correct responses postcourse ( In a forward selection linear regression analysis, practice experience less than 10 years (p = 0.034), hospital practice (p = 0.005), foreign pharmacy education (p = 0.209), and higher subjective self-assessments (p = 0.012) all predicted higher pre-course tested knowledge, accounting for 38.2% of variation in pre-course knowledge test scores (p < 0.001). While country of pharmacy education was not significant, it was included in the multivariate model due to its effect on other covariates (without interaction), and impact on r 2 . As noted in the subjective Likert response results, higher post-course subjective confidence/opinions predicted better post-test grades. Pharmacogenomics in clinical practice involves testing genes for certain metabolizing enzymes, receptors, and other functional proteins that are involved in drug disposition and/or effect. 6, 7 This information is used alongside other patient factors such as signs, symptoms, lab values, and preferences, to select optimal drug therapy. 12, 13 Other components of PGx include the education the HCP must provide the patient before and after testing, and the communication of PGx information with other health-care providers. Such clinical PGx use in pharmacy practice has increased dramatically over the last decade. 16 This study resulted in the development of a two-day webinar-style course in PGX for practicing pharmacists to support future clinical implementation. This course was further adapted as a self-study program, and both methods of learning showed significant improvement in self-rated (subjective) knowledge as well as proportional improvement in tested (objective) knowledge. Interest in this course was relatively high considering the COVID-19 pandemic, wherein pharmacists' priorities were already stretched in delivering vaccinations, asymptomatic testing, managing drug shortages exacerbated by the crisis, and patient education, all in addition to pre-existing clinical and distributive roles. 37 In social-media and email communications, there were 69 pharmacists that reached out with interest in this research study, and of these, 85.5% completed the initial survey and 52.2% completed both preand post-course surveys. Anecdotally, many potential participants indicated that the flexibility provided by the self-study option suited their current practice and educational needs as they could complete the material between these competing priorities. While online learning has been present for much of the history of the internet, the recent COVID-19 pandemic has appeared to enhance learners' ability to utilize this platform for education, 38 and this benefit lends itself to this course in many ways. Due to the online nature, speakers were able to be recruited worldwide and as far away as USA, Egypt and Qatar. This allowed the facilitation of a global perspective on the emerging field of PGx, which truly has been an international effort over the last decade. It also brought in a diverse population of Alberta pharmacists within both the synchronous and asynchronous platforms. Participants varied in practice experience, education, and prior knowledge in PGx. Despite these differences, only hospital practice experience appeared to lead to the greatest retained PGx knowledge indicated by testing, and no participant characteristics affected the level of confidence experienced post-course. The results of this study suggest a positive effect of this pharmacogenomics course on both subjective and objective short-term knowledge of pharmacists in pharmacogenomics. Pharmacists transitioned from a median of "Disagree" with competency statements pre-course, to a median "Agree" post-course, indicating positive opinions of their own abilities to manage, interpret, and communicate pharmacogenomic information after receiving education, ie, a greater level of confidence. Tested knowledge also improved by more than 3-fold, with participants answering on average 6.9±3.2 more questions correct (out of a total possible score of 14) in post-course surveys compared to pre-course. Furthermore, there Pre-Course is strong correlation (r = 0.516; p = 0.002) between improvements in pharmacists' tested and self-rated knowledge assessments. This observation indicates two things: 1) improved knowledge was observed by participants themselves, therefore supporting pharmacists confidently applying PGx in practice; and 2) that high self-rated confidence after learning was not simply hubris. This correlation, in addition to moderately strong linear relationships between pre and post course subjective and objective knowledge measures validates pharmacists' ability to recognize and accurately rate their own knowledge in pharmacogenomics using the survey in this study. Thus, they felt more confident in their knowledge and appear able to actualize this potential with the correct use of knowledge gained. The course provided to study participants included a blend of didactic and case-based learning similar to those used by Zembles et al., 23 Kisor et al 39 and Crown et al. 21 The results of this research were congruent with the latter two studies in both subjective and objective measures. 21,39 While Zembles did not report knowledge results, their study did reveal high satisfaction with this method of training congruent with findings of Crown. 21, 23 The mixture of learning methods in the presented study had also supported learning by providing the immediate opportunity within case studies to practice knowledge and skills gained in the lectures. Another study by Kisor et al indicated the critical need for experiential education in PGx training. 40 While Kisor et al did see pharmacist knowledge improve in all domains of the AACP pharmacogenomics competencies without case-based learning, 32, 40 other research, including the results of this study, supports the use of case studies in long-term retention of knowledge gained. One study on pharmacist education in weight management saw the best subjective and objective knowledge four weeks after learning in the small-group discussions, closely followed by large-group discussions, compared to lecture-only groups, indicating better knowledge retention with peer-based learning. 28 The size of the group discussions in the presented study was of similar size to the small-groups in Sarayani et al, with even smaller groups in the three breakout room portions of the live course. Other studies have proved the merits of peer discussion in pharmacist and pharmacy student education in pharmacogenomics, 28, 41 with particular interest in the "flipped classroom" concept, wherein lectures are delivered asynchronously while classroom time is entirely devoted to utilize critical thinking and application of knowledge gained from lectures. 42 One such study on pharmacy students found that specific pharmacogenomic items with flipped content had significant improvement in correct responses on test questions compared to traditional didactic methods. 43 Such a method could be adopted for future pharmacogenomics courses such as this, to allow more time for participant interaction, questions, and practice within cases while shortening the overall time required for live attendance. While asynchronous participants did not receive the benefit of a formal group discussion, the case studies were presented in a scripted format, allowing the participant to read the questions as if they were being asked by a facilitator. They would be asked to solve the question posed before turning to the answer key, then proceed with the next question, thus accomplishing the experiential component. One case study is provided, for example, in Supplementary Materials 3. This design of asynchronous case study appears to be effective in providing similar quality of education to live group discussion, as post-course knowledge and confidence did not appear to differ between synchronous and asynchronous participation methods. The difference in post-course grades seen between synchronous and mixed methods (78.6% [78.6, 92.9] vs 64.3% [42.9, 78.6] ; adj-p=0.014), may be explained by the gap that many participants had between day 1 of live participation, and final course completion indicated by the date of the post-course survey (approximately 3 months). This suggests that future iterations of this course forgo the blended live/self-study route, opting for either a full synchronous or full asynchronous learning only. Among the subgroup analyses, an interesting finding of this study was the high level of agreement among pharmacists with the statements "Pharmacogenomics can enhance the provision of medication-related services (eg, dispensing, careplanning)" and "Pharmacogenomics testing is cost-effective." Many studies before this also show a high degree of support by pharmacists in the clinical utility and feasibility of pharmacogenomics even with low rated or tested knowledge. 44, 45, [47] [48] [49] As with this study, other research has shown that subjective (self-rated) knowledge is greater in those with prior PGx training. 49 However, this study conflicts with other findings that objective (tested) knowledge is also higher in those with prior PGx training, 47 as this study did not find a difference in pre-course test scores between those with PGx education in degree, in continuing education, or prior use of PGx, compared to those with no prior exposure. Some potential explanations for this observation include the rapid changes occurring and quickly advancing technology in PGx, and/or possibly due to knowledge decay in unused information. Other medical skills, such as resuscitation, follow a trend wherein the skills learned in a course are lost after 12 months if not frequently used, whereas knowledge is retained better when it is utilized more frequently in practice. 50 In 2015, the United States Accreditation Council for Pharmacy Education addressed the knowledge gap in pharmacists by adding pharmacogenomics to the required curricula of entry-level Doctor of Pharmacy programs. 17 Although Canada has no formal requirement for PGx education in pharmacy schools at present, adoption of PGx has occurred across most of the country's University pharmacy degree curricula. Therefore, incoming pharmacy graduates within North America are likely to have an acceptable base-level of knowledge of PGx applications. 18, 19 It should be noted, however, that pharmacogenomics is still a relatively new field, and as such, guidelines have been known to change as new evidence becomes available. One example of such is the CPIC guidelines for clopidogrel dosing in percutaneous coronary intervention (PCI) patients, which did not provide a phenotype for CYP2C19 *2/*17 in 2011, and therefore recommended clopidogrel therapy in these patients. 51 In 2013, these guidelines were updated to interpret an "intermediate metabolizer" phenotype from this particular genotype based on more current evidence, thus changing the medication selection advice in these patients to an alternative antiplatelet therapy such as ticagrelor or prasugrel. 52 It is due to frequent changes in evidence, such as this example, that even those with prior education in PGx will need ongoing updates to their knowledge through courses such as this. While pharmacy curriculums are teaching pharmacogenomics to incoming pharmacists, 19 Alberta currently has a limited ability to utilize this in practice. Green Shield, a Canadian pharmacy benefit manager, has only recently added PGx testing to their services while Alberta's largest benefit manager, Alberta Blue Cross, has yet to provide these services to its beneficiaries. In part, this is due to the limited evidence available to support cost-efficacy to date, as one review found that within pharmacy practice, no research to date has followed real-world economic outcomes. 16 With most patients required to pay for this out of pocket ($200-$1000), the demand for pharmacogenomics testing is currently limited. Furthermore, it is reasonable to assume that if the pharmacist population, as shown in this study, is not confident in their ability to manage, interpret, and educate patients and providers on PGx information, they likely will not recommend PGx testing in the first place. Therefore, in addition to recurring education to manage knowledge decay and the changes in information available, pharmacists must also have the opportunity to utilize learned PGx skills in practice, to the benefit of both their ability to provide care, and importantly, to the benefit that PGx can have on patient outcomes. While this study demonstrates the effectiveness of a PGx course on pharmacist competency in this subject, the study and the course itself are not without limitations. A previously validated survey measuring the specific competencies identified by AACP 32 and the therapeutics supported in the literature 16 was not available, and thus had to be created for this study. In addition to undergoing face validation, the observation of congruency between self-reported competence (Likert Scales) and objective knowledge (quiz grades) in baseline, final, and changes between assessments indicates construct validity of the tool used in this study. Further to assessment of survey results, although instructions indicated these were to be completed to the best of the participant's ability, there is no way to confirm that participants did not check resources or notes while completing the quiz. However, a strength of the quiz portion was the inclusion of an option for "I don't know" with each question to minimize correct guesses that falsely overestimate knowledge. Another noted limitation of this study was its inability to measure long-term knowledge retention post-course. Despite longitudinal evaluation was not the focus of the research presented, where only short-term efficacy is reported in this study. Another future study within the same funding grant proposal will be recruiting those participants and their pharmacies to test and educate eligible patients about their PGX and drug gene possible interactions. They will also be responsible to point out possible interventions in their patients' current therapy. This practical component in the upcoming study will test and reflect the long-term knowledge retention. Another strength of this study was the utilization of current guidelines and resources in the generation of course content. These guidelines are subject to frequent updates and changes given the growing body of evidence in this relatively new field. Additionally, the AACP competencies 32 themselves are likely to be updated in the near future. Thus, it is imperative that these clinical and competency updates reach all pharmacists in an accessible format to ensure that PGx practices remain current. This applies to all pharmacists regardless of prior education in pharmacogenomics, as evident by the lack of difference in pre-course objectively measured knowledge between pharmacists with prior PGx education and those without. Therefore, this study highlights the need for recurring PGx education for pharmacists regardless of PGx knowledge background. Another strength of this paper is the comparison between synchronous and asynchronous learning, something that has not been evaluated to date in the available literature of pharmacogenomics education in pharmacists. This study showed no difference in these different learning methods, which may support more accessible PGx education in the future. A PGx course for pharmacists was developed using evidence-based resources and collaboration with field experts, utilizing a blend of didactic lectures with case studies for experiential education. This course was delivered to Alberta pharmacists in live and self-study formats and was found to significantly improve subjectively rated and objectively tested knowledge in PGx regardless of participation format among pharmacists with varying practice experience, education, and prior exposure to PGx information. Knowledge gained can be utilized in delivery of patient-centered, personalized medication therapy management in the pharmacy setting, and this course can be adopted for broader education of pharmacists regardless of current practice in both synchronous and asynchronous learning environments. The effect of pharmacogenetic profiling with a clinical decision support tool on healthcare resource utilization and estimated costs in the elderly exposed to polypharmacy Clinical impact of pharmacogenetic profiling with a clinical decision support tool in polypharmacy home health patients: a prospective pilot randomized controlled trial Pharmacogenomics guided versus standard antidepressant treatment in a community pharmacy setting: a randomized controlled trial Multisite investigation of outcomes with implementation of CYP2C19 genotype-guided antiplatelet therapy after percutaneous coronary intervention CYP2D6-guided opioid therapy improves pain control in CYP2D6 intermediate and poor metabolizers: a pragmatic clinical trial Pharmacogenomics -drug disposition, drug targets, and side effects Cytochrome P450 enzymes in drug metabolism: regulation of gene expression, enzyme activities, and impact of genetic variation PharmGKB: the Pharmacogenomics Knowledge Base The United States food and drug administration Assessment and use of drug information references in Utah pharmacies Introduction to the patient care process Advancing pharmacogenomics as a component of precision medicine: how, where, and who? Pharmacogenomics of drug metabolizing enzymes and transporters: relevance to precision medicine Pharmacogenetic testing in primary care practice: opinions of physicians, pharmacists and patients Emergence and evolution of pharmacogenetics and pharmacogenomics in clinical pharmacy over the past 40 years Applications for pharmacogenomics in pharmacy practice: a scoping review Accreditation Standards and Key Elements for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree Pharmacogenomics courses in pharmacy school curricula Pharmacogenomics education in medical and pharmacy schools: conclusions of a global survey Thinking clinically from the beginning: early introduction of the pharmacists' patient care process A continuing professional development program for pharmacists implementing pharmacogenomics into practice Development and evaluation of a pharmacogenomics educational program for pharmacists An inservice program on pharmacogenetics to individualize drug therapy Implementation of an active-learning laboratory on pharmacogenetics A genotyping exercise for pharmacogenetics in pharmacy practice Development and evaluation of a continuing pharmacy education (CPE) program in thrombosis management Effectiveness of a pharmacy teaching certificate program offered to practicing pharmacists Efficacy of continuing education in improving pharmacists' competencies for providing weight management service: three-arm randomized controlled trial Interprofessional continuing health education for diabetic patients in an urban underserved community Community pharmacists' evolving role in Canadian primary health care: a vision of harmonization in a patchwork system Randomized trial of the effect of pharmacist prescribing on improving blood pressure in the community Pharmacogenomics competencies in pharmacy practice: a blueprint for change Clinical decision support for personalized medicine: an opportunity for pharmacist-physician collaboration Joint Commission of Pharmacy Practitioners. Pharmacists' patient care process The REDCap consortium: building an international community of software platform partners Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support COVID the catalyst for evolving professional role identity? A scoping review of global pharmacists' roles and services as a response to the COVID-19 pandemic Transitioning to online learning in higher education: influence of awareness of COVID-19 and self-efficacy on perceived net benefits and intention Academic and professional pharmacy education: a pharmacogenomics certificate training program Expanding pharmacist and student pharmacist access to genetics/genomics/pharmacogenomics competency education A student initiative to implement peer-led study groups for a pharmacogenomics course: evaluation of student performance and perceptions Flip Your Classroom: Reach Every Student in Every Class Every Day. International Society for Technology in Education Flipping content to improve student examination performance in a pharmacogenomics course Knowledge, perception, and application of pharmacogenomics among hospital pharmacists in Saudi Arabia Pharmacogenomics-based practice in North Cyprus: its adoption by pharmacists and their attitudes and knowledge Assessment of healthcare professionals' knowledge, attitudes, and perceived challenges of clinical pharmacogenetic testing in Egypt Are pharmacists from the province of Quebec ready to integrate pharmacogenetics into their practice Results of a nationwide survey of Japanese pharmacists regarding the application of pharmacogenomic testing in precision medicine Pharmacist's attitudes and knowledge of pharmacogenomics and the factors that may predict future engagement A randomized controlled trial to assess decay in acquired knowledge among paramedics completing a pediatric resuscitation course Clinical pharmacogenetics implementation consortium guidelines for cytochrome P450-2C19 (CYP2C19) genotype and clopidogrel therapy clinical pharmacogenetics implementation consortium guidelines for CYP2C19 genotype and clopidogrel therapy: 2013 update Characterizing Pharmacogenetic Testing Among Children's Hospitals Assessment of the need for pharmacogenomics education among pharmacists in the West Bank of Palestine Pharmacogenetics in clinical practice: current level of knowledge among Flemish physicians and pharmacists Knowledge, attitudes, and perceived barriers toward genetic testing and pharmacogenomics among healthcare workers in the United Arab emirates: a cross-sectional study Implementation of pharmacogenomics in community pharmacies in Alberta: perceptions and challenges Knowledge, attitude, and practice towards pharmacogenomics among hospital pharmacists in Thailand Pharmacogenomics and Personalized Medicine is an international, peer-reviewed, open access journal characterizing the influence of genotype on pharmacology leading to the development of personalized treatment programs and individualized drug selection for improved safety, efficacy and sustainability Drs. Hazem F. Elewa, Jai N. Patel, Susanne B. Haga, and Wafaa M. Rashed for their partial contribution to lectures and for feedback on case studies and knowledge questions; Clare Peters and Grant Wang for providing technical and logistic assistance with the virtual (Zoom) course, lecture recordings, video processing, and video editing. MH: MSc. student, methodology, data acquisition, statistical analysis, writing -original draft, writing-reviewing and revising; SHM: grant co-PI, conceptualization, methodology and study design, funding acquisition, statistical analysis, writing-reviewing and revising; DAH: grant PI and setting research study idea and design, conceptualization, main curricula setting and nominating speakers, methodology and study design, funding acquisition, writing-reviewing and revising. All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work. This work was funded by the Alberta Pharmacists' Association Pharmacy Practice Innovation Grant. The funding source had no involvement in any of the study activities (study design, collection, and interpretation of data). The authors report no conflicts of interest in this work.