key: cord-0839816-dxup0s0a authors: Peasah, Samuel K.; Marshall, Leisa L. title: The use of debates as an active learning tool in a college of pharmacy healthcare delivery course date: 2017-04-14 journal: Curr Pharm Teach Learn DOI: 10.1016/j.cptl.2017.01.012 sha: 85b496d94439a20f3bbcedfd8bf3fae9f7582c9a doc_id: 839816 cord_uid: dxup0s0a BACKGROUND AND PURPOSE: To describe the use of debates, and to evaluate student performance and perceptions, when student debates are incorporated as an active learning tool in a required pharmacy healthcare delivery course. EDUCATIONAL ACTIVITY AND SETTING: Student live debates replaced 15% of a traditional lecture-based course. Twelve healthcare controversies were debated by student teams each year. Student perception of debate utility and opinion on topics, pre- and post-debate, were measured via a voluntary survey. Both peer and instructor's assessments of team performances, as well as individual student performance on the debate-based questions on course exams, contributed to course grade. FINDINGS: The average survey response rates were 76% (2014) and 86% (2015). Fifteen-54% of student respondents changed their opinion on individual debate topics due to the debates. Although exam performance on debate-based questions was no better than on lecture-based questions, respondents who found the debates useful or very useful in mastering course material increased by 19% post versus pre-debate surveys. SUMMARY: Debates are an effective active learning tool for engaging students in controversial subjects. Assessment of student performance should include student and instructor evaluations, and can be incorporated into the course grade. Background and purpose: To describe the use of debates, and to evaluate student performance and perceptions, when student debates are incorporated as an active learning tool in a required pharmacy healthcare delivery course. Educational activity and setting: Student live debates replaced 15% of a traditional lecture-based course. Twelve healthcare controversies were debated by student teams each year. Student perception of debate utility and opinion on topics, pre-and post-debate, were measured via a voluntary survey. Both peer and instructor's assessments of team performances, as well as individual student performance on the debate-based questions on course exams, contributed to course grade. Findings: The average survey response rates were 76% (2014) and 86% (2015) . Fifteen-54% of student respondents changed their opinion on individual debate topics due to the debates. Although exam performance on debate-based questions was no better than on lecture-based questions, respondents who found the debates useful or very useful in mastering course material increased by 19% post versus pre-debate surveys. Summary: Debates are an effective active learning tool for engaging students in controversial subjects. Assessment of student performance should include student and instructor evaluations, and can be incorporated into the course grade. Activities in the classroom that are designed to promote active involvement of students in the learning process instead of passive listening are defined as active learning activities. 1 Examples of active learning activities include group exercises, problem-based learning, and short writing exercises. Active learning activities are effective tools to engage students and encourage learning in the traditional classroom lecture setting. [1] [2] [3] For example, a recent study by Lucas et al. 4 evaluating the correlation between active learning and core content retention that compared examination scores from course content delivered by active learning methods to that delivered by slide-based lectures found higher scores from sections delivered by active learning. Furthermore, active learning has been shown in different fields to increase critical thinking, improve self-reported student engagement, and deepen understanding of course material. [5] [6] [7] reported that students valued the mix of traditional lecturing with active learning activities over traditional lecturing alone because the active learning activities helped to maintain their interest and attention. It is, therefore, not surprising that the Accreditation Council for Pharmacy Education (ACPE) Standards require incorporation of active learning strategies in the pharmacy curriculum. 9 In addition, the Center for the Advancement of Pharmacy Education (CAPE) Educational Outcomes encourages the development of advanced skills that can be enhanced through active learning activities. 10 Debates, defined as "a formal discussion on a particular matter in a public meeting or legislative assembly, in which opposing arguments are put forward and which usually ends with a vote," 11 have been used as an active learning strategy in different disciplines, including pharmacy. [11] [12] [13] In pharmacy, debates have been used in core courses including pharmacotherapy and in electives, for example self-care and ambulatory care. Debates have also been incorporated in core social and administrative sciences courses, for example ethics and healthcare delivery. 11, [14] [15] [16] [17] Different debate formats, live or online, individual or team-based, and different assessments of the utility of this active learning tool have been described in the literature. [11] [12] [13] [14] [15] [16] [17] [18] [19] Debates have been used effectively to stimulate interest, promote active class participation, and enhance presentation, research, and critical thinking skills in professional programs. [11] [12] [13] [14] [15] [16] [17] [18] [19] Literature describing the use of live student debates to deliver a significant amount of content previously delivered by lecture in required pharmacy courses, however, is limited. 15 Furthermore, the literature on debates as an effective active learning strategy in required didactic pharmacy social and administrative sciences courses to increase student awareness of opposing views about healthcare delivery or ethical dilemmas is also limited. 11, 16 The need remains to evaluate the impact of student debates as an active learning strategy on student learning and perception of controversial issues in health care delivery, especially in a live large classroom setting. This study evaluated the incorporation of live student debates as an active learning tool in a required professional first-year pharmacy course, Introduction to the United States Healthcare Delivery (USHD), at Mercer University College of Pharmacy. The study objectives included describing the debate incorporation, assessing student perceptions of these debates including their effect on engagement, and evaluating their debate performance as an integral part of the course over two years. This study seeks to add to the literature demonstrating how debates can be incorporated into a course delivered to a large class where active learning becomes especially critical to learning. This study was approved by Mercer University Institutional Review Board (IRB). USHD is a required course for first year doctor of pharmacy students at Mercer University College of Pharmacy. USHD is a 16week two credit hour course covering topics in health delivery, health policy, healthcare reform, health insurance, pharmacoepidemiology, and health economics including pharmacoeconomics. The course meets once a week for a two-hour class-meeting and in previous years had consisted of only traditional lecture and instructor led discussion format. In 2014, live student debates were introduced as an integral part of the course to enhance active learning. Live student debates replaced about 15% of course previously presented by an instructor via lecture presentations. Course content replaced with debates mostly focused on areas of healthcare or healthcare delivery controversy or areas with diverse opinions. Some healthcare ethical dilemmas relevant to the course were included because the instructor had exposed the students, in a previous semester course, to materials on ethics and professionalism. This study was designed to describe the incorporation of live student debates and to analyze the effectiveness and students' perception of the usefulness of these debates in the course in 2014. The study was extended to the 2015 course offering to obtain two years of data and to be able to analyze the effect of several improvements over the inaugural year. USHD is taught in a large classroom setting and enrollment for 2014 and 2015 were 175 and 151 students, respectively. The students were randomly assigned to 26 teams with a maximum of seven students per team in 2014 and 25 teams with a maximum of six students per team in 2015. Students were given 12 possible debate topics. Eleven of the 12 possible topics are listed in Table 1 . For the twelfth topic each year, students choose a country in Europe or Canada and debate whether their healthcare system was better than or worse than the U.S. healthcare system. In 2014, there was no team representing the U.S. as in 2015. From the 12 topics, the debate teams were asked to choose and rank up to five in order of preference for the topic and to indicate preference for the debate position, either arguing in favor of, "pro," or against the topic, "con." Teams were then assigned topics based either on their selected preferences or availability of topics. There was one debate per week following a traditional lecture, for 12 of the 16 scheduled class meetings. The entire debate session lasted an average of 30 min each of the 12 two-hour class periods in 2014 and 2015. In both years, students took a voluntary survey after each debate where they indicated which team they believed to have won the debate and whether the debates changed their minds about that issue in healthcare delivery. • In 2014, teams were asked to research the debate topics and present at least four verifiable points in support of their position. The order of team presentation, pro versus con, was determined randomly. • Main arguments: The first team presented their case with four verifiable points in debate format with or without an opening statement (10 min). • Opposing team and class participation: The opposing team, and then the entire class, asked the presenting team questions about their presentation (3-5 min). • Concluding remark: The presenting team made a concluding remark (1-2 min). • The second team presented their case in debate format, followed by opposing team and class questions and answers and a concluding remark (14-17 min). In 2015, a few revisions were made to the debate format. The 2015 debate format was as follows: • Opening statement: Each team was required to give an opening statement, with the order determined randomly in turns (about a minute each). • Main arguments: The team that gave the opening statement first presented their four verifiable points (10 min). The opposing team was then allowed to counter these points, or to ask questions (1-2 min). • Rebuttal: The first team was allowed to rebut (1-2 min). The second team then presented their main arguments (10 min) and the opposing team was allowed time to counter these points or ask questions (1-2 min), followed by rebuttal (1-2 min). • Class participation: The class was allowed to ask teams questions after each rebuttal (5 min). • Closing arguments: The second team gave the closing arguments (1-2 min) followed by the first team (1-2 min). In 2014 and 2015, students participated in the post-debate survey, which included voting for the team they believed had won the debate and indicating if the debate had changed their mind about the topics presented. In 2015, students also assigned a letter grade to each team based on their assessment of the content and presentation of the debates. The letter grade choices were A+(95-100), A (90-94), B+(85-89), B (80-84) or C (below 80). In both 2014 and 2015, the incorporation and utility of student debates was evaluated and assessed by team performance on the debates, individual student performance on examination questions based on the debates, and a pre-and post-debate student survey of their individual opinions about the controversial topic in healthcare delivery. In both years, the same instructor graded each debate and assigned a team grade. In 2014 the team grade was worth 10% points of the final course grade and was based on the team slideshow presentation which was required to be submitted a day before the debate. The instructor assessed the slide presentation and returned it to the group with suggestions for revision if it did not address the issue adequately or did not meet the course objectives. Teams could also meet with the instructor while developing their presentation for guidance. The goal was to make sure the topic was adequately covered by the team. A team received full credit if they included and presented at least four points, had verifiable references for each point, and gave a cogent concluding remark. The instructor formulated one multiple-choice question from each team's presentation that was included on either the mid-term or final exams in the course, depending on when the team debated, for a total of 26 questions on course exams. In 2015, a few changes were made to the debate grading, based on student feedback from 2014 end-of-course evaluations. Student feedback included some complaints about the number of debate-based questions added to the course exams, as well as student desire to provide peer assessment of the debate teams beyond stating which team won. In 2015, the team debate grade was increased to 15% of the course grade from the 10% in 2014. Student peer review was added to instructor review for the team debate grade, with 70% of the total team grade from the instructor's assessment and 30% from Would the Affordable Care Act eventually lead to an efficient healthcare system? 2 A patient was declared brain dead in California after a tonsillectomy; the family wants to keep her alive but a Judge ruled against them based on California law. A pregnant mother is brain dead and the husband wants her feeding tube removed but Texas law forbids termination of the baby. Should technology be allowed to sustain life? Would the US Healthcare system be better if structured similar to the Education system? 3 Should a patients' right to their medication (for example Plan-B) trump a pharmacist's religious or cultural rights? Gilead is selling its' hepatitis C drug, Solvadi ® for $1000 a pill. Should the FDA be allowed to put a cap on drug prices during drug approval? 4 Would you recommend long term care insurance? Three states have enacted "Death with Dignity" laws. Would you advocate for such a law in your state? 5 New York Mayor wanted to control the size of soda sold in restaurants as a means to control obesity, should the government regulate health behaviors? Is medical malpractice litigation necessary? 6 Managed care is a better system than traditional insurance With the growing threats of epidemics such as Ebola and SARS, should the government use travel restrictions as a public safety tool? 7 Should the US government adopt comparative effectiveness analysis as a cost containment tool? Chronic diseases are arguably the biggest drivers of healthcare cost. Should the government enact laws to legislate health behavior? 8 The generic market in India is about $11 billion due to the laxity of patency laws. A recent ruling by the Indian Supreme Court denied Novartis' plea to patent an updated version of their cancer drug, Glivec ® . Should there be laxness in patency laws in developing countries? Should professional bodies like the state pharmacy boards become involved in personal behaviors like domestic violence? 9 Corporatization of pharmacy has had negative impact on pharmacy practice Does Advocacy and lobbying, "the third house", reduce the efficiency of government? 10 Should the US adopt a single-payer healthcare delivery system? ACCP is advocating residencies as an entry level requirement for practicing pharmacists. Would you support such a requirement? student peer reviews. In 2015, as part of the voluntary post-debate survey, as well as indicating which team won each debate, the objectives of the debates were explained to students and they were asked to assign a letter grade to each team based on a content (70%) and presentation (30%) rubric. The letter grades were weighted (A+=1, A=0.8, B+=0.6, B=0.4, and C=0.2). These were used to compute the 30% student peer review grade. The instructor also revised the instructor 70% portion of the team grade in 2015. In the rubric, the instructor continued to grade the debates based on content as in 2014, requiring four verifiable points, but this now counted for 70% of the instructor grade and sections on creativity (10%), presentation (10%) and accuracy of claims (10%, with references) were added. The sum of the instructor's portion, 70%, and the student's portion, 30%, were multiplied by 0.15 for the 15% debate portion of the final course grade. In 2014 and 2015 all enrolled students were asked to take voluntary pre-and post-debate surveys, using Moodle™, the online teaching and learning platform for the College of Pharmacy, immediately before and after each debate. In both 2014 and 2015, students were asked their opinion on each controversial debate topic pre-debate and post-debate and were asked to indicate which team won the debate. As mentioned above, in 2015 one additional survey item collected peer grades for the team debate grades. In both 2014 and 2015, students were invited to take a voluntary pre-course survey at the beginning of the semester for demographic data and to indicate how they perceived themselves ideologically. In 2015 this survey also asked their perception of the possible utility of debates to enhance their knowledge of course content. At the end of the semester in 2015, students were invited to take a post course survey to determine their perception of the utility of the debates in enhancing their knowledge of course content and to provide their thoughts on how content from the debates should be assessed. Students were invited, but not required, to take any of the surveys. Students were required as part of the course syllabus, learning objectives, and grading to participate on a team for the debates. Descriptive statistics were used to summarize the demographic data including age, gender, race, and educational background. The percentage responses from the surveys pre-and post-debate as well as the percentage of students that changed their minds pro or con on each topic were summarized using the feedback tool in Moodle™. Open-ended questions were analyzed qualitatively by summarizing the emerging themes. The percentages of students answering the debate based exams questions correctly were summarized and compared with the percentage answering the traditional lecture exams questions correctly using student t-test in SAS 9.3. Statistical significance level was set at 5%. McNemar paired test was used to compare students' responses to the usefulness of debates before and after all the debates. Ninety-seven percent and 99% of enrolled students completed the pre-course surveys in 2014 and 2015, respectively ( Table 2 ). The majority of students were 20-25 years old (62% in 2014 and 66% in 2015). In both years, the majority of the students were female (60%) and majority of students had at least a bachelor's degree before enrolling in pharmacy school (72% in 2014 and 77% in 2015). When asked how they perceived themselves ideologically, 34% in 2014 and 39% in 2015 considered themselves conservatives ( Table 2 ). In the pre-debate surveys students were asked to provide their opinion on each controversial debate topic question ( Tables 3 and 4 ) as "Yes," "No," or "I don't know" if they were either unfamiliar with the topic or did not have an opinion. In the post-debate surveys, however, students were asked to choose whether they were pro or against the topical issue, after hearing the pro and con arguments, by answering "Yes" or "No" to each topic question and to indicate if they changed their minds because of the debates. In 2014, when students did not grade their peers' debate performances, the instructor's assessment out of 100% was an average of 99.65 (SD 2.82, range 70-100). In 2015, the instructor's assessment out of 70 was an average of 68.80 (SD 1.41, range 66-70) and the student's peer assessment out of 30 was an average of 28.26 (SD 0.895, range 24.67-29.35). In 2015, the pre-course survey, as depicted in Table 2 for 2014 and 2015, included one additional item, not shown on Table 2 ; this additional survey item for 2015 sought students' views on the extent to which debates could be useful in learning course content. Twenty-four percent of the 151 respondents said it could be very useful; a total of 71% of students saying at least the debate could be useful. At the end of the course, when asked how useful the debates were in helping them master course material, 38% of respondents said they were very useful (an increase of 14% points); a total of 83% of students saying at least the debates were useful (Fig. 1) . A matched or paired McNemar test of 118 students who took both the pre-and post-survey showed a significant difference (Pr. > S Table 3 Number and percentages of responders to pre-and post-debate surveys per debate topic in 2014. Pre This study evaluated the usefulness of live student debates when incorporated in a social science-related course. The usefulness of debates in developing skills such as critical thinking, teamwork, and public speaking has been established with studies in different disciplines including pharmacy. [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18] [19] [20] This study was unique in that it allowed for two years of data for debate design evaluation and implementation of improvements. It also demonstrated how live team-debates can be assessed and incorporated into individual students' course grades in a required course in a large group classroom setting. In the current study, the number of students who changed their minds on controversial debate topics because of the debates was similar to that reported by Lampkin et al., 15 in which 31% of students changed their minds after the debates. Debates allow both presenters and observers the chance to actively weigh opposing sides of a topic in an engaging way which forces them to re-think their positions more intensely than is required in a traditional slide-based teaching. 20 Although this intensity is likely to be greater in the presenting team than in the listening team, the format, which is different from traditional lectures, can increase the students' level of engagement and interest. Summative assessments are essential in deducing the extent to which students have learned material from a course. In 2014, 20% and 23% of the mid-term and final exams questions, respectively, were from the debates. In addition to the disproportionate number of debate-based questions in both exams, in the finals, the students took exams in another course in the morning prior to USHD exams in the afternoon. This could explain why there was a statistically significant difference in performance between the lecture-based questions and debate-based questions. In 2015, when the debate based questions were reduced to those from six debate presentations, there was no statistically significant difference in the percentage of students' scores in both traditional and debate based questions. Debates are already believed to fall under the higher order in Blooms' Taxonomy of Learning, where the skill acquired is more of the higher level of 'shows-how' instead of 'know or knows how' (which are of the lower level). 11,21 A limitation of this study was that it was not designed to robustly test the difference between traditional and debate-based question performance. Additionally, multiplechoice questions were used because of the size of the class instead of a more appropriate higher order learning assessment tool. The items covered in each was not the same, and the number of questions from the debates was small compared to those from the lectures (26 out of 117 in 2014, 9 out of 71 in 2015). There are other limitations of this study worth mentioning. Policy-heavy courses are often laden with strong ideological stands and it was difficult to tell if students were able to take off those filters in deciding if they changed their minds or not; perhaps not allowing students to choose "I don't know" post-debate reduced our ability to distinguish among those who truly changed their minds. Additionally, a student indication of a changed mind about a controversial topic is not necessarily an indication of learning, but rather showing they were engaged enough to change their opinion. The objective of the debates was not to change students' minds on these controversial issues but to present them with information from both sides of the issue to improve their knowledge of the subject and help them formulate their own decisions. Incorporating debates in a health care delivery course could be a useful active learning tool for student learning and engagement throughout the semester. Preparing for debates is a useful active learning activity for the presenting groups, and the interest generated by the debates provides the necessary engagement for active learning in the classroom by the rest of the class. Assessment of student performance in debates should include student and instructor evaluations, and this can be incorporated into the course grade. Additional ways of assessing students' acquired knowledge from team debates that could be explored in future studies could include a one-page reflection on the debate topics or quizzes after each debate. The authors have no financial disclosures and report of no conflict of interest. Active Learning for the College Classroom An active learning strategies primer for achieving ability-based educational outcomes Implementation of a pharmaceutics course in a large class through active learning using quick-think and case-based learning Correlation between active-learning coursework and student retention of core content during advanced pharmacy practice experiences Active learning in medical education: strategies for beginning implementation Active Learning: Creating Excitement in the Classroom Does active learning work? A review of the research Students' experiences of active engagement through cooperative learning activities in lectures Accreditation Standards and Key Elements for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree Center for the advancement of pharmacy education 2013 educational outcomes Using debates to teach pharmacy students about ethical issues Student perceptions of the use of debates as a teaching strategy in the allied health professions Utilizing debates as an instructional tool for dental students The utility of clinical controversy debates in an ambulatory care elective Active learning through a debate series in a first-year pharmacy self-care course An online debate series for first year pharmacy students Developing critical interaction skills in students: debating clinical pharmacokinetic controversies Online debates to enhance critical thinking in pharmacotherapy Impact of a debate on pharmacy students' views of online pharmacy practice In-class debates: fertile ground for active learning and the cultivation of critical thinking and oral communication skills Taxonomy of educational objectives. The Classification of Educational Goals. Handbook 1: Cognitive Domain The authors will like to thank Mr. Reid Proctor for his technical support with the survey data management.