key: cord-0014620-g59bvfqf authors: Ross, Michael W.; Bayer, Carey Roth; Shindel, Alan; Coleman, Eli title: Evaluating the impact of a medical school cohort sexual health course on knowledge, counseling skills and sexual attitude change date: 2021-01-08 journal: BMC Med Educ DOI: 10.1186/s12909-020-02482-x sha: 75318a3c9ef8f4a954b52a0ea0d56b98a2bdbdc6 doc_id: 14620 cord_uid: g59bvfqf BACKGROUND: Sexual health is generally considered an integral part of medical and allied healthcare professional training. However, many medical schools do not offer this as a mandatory curriculum, or minimize it. Sexual health as an academic area was introduced in the 1970s, but there have been few cohort evaluations of its impact. This was limited by the availability of few psychometric scales for evaluation. We evaluated the full, mandatory, sexual health course in year 1 medicine at a large state university in the Midwest US, including the course with lectures; panels and tutorials; a video app to give students feedback on their sexual history taking skills; and a 3-station sexual history OSCE at the end of the course. RESULTS: Seventy-four medical students (43% of the course cohort) volunteered, for an incentive, to complete evaluation materials pre- and post-course. We used the Sexual Health Education for Professionals Scale (SHEPS), designed and with appropriate psychometric standardization for such evaluation. The SHEPS data covers 7-point Likert scale ratings of 37 patient situations, asking first how well the student could communicate with such a patient, and on the second part how much knowledge they have to care for such a patient. The third subscale examines personal sexual attitudes and beliefs. Data indicated that the matched pretest-posttest ratings for skills and knowledge were all statistically significant and with very large effect sizes. Few of the attitude subscale items were significant and if so, had small effect sizes. Sexual attitudes and beliefs may be well-formed before entry into medical school, and sexual health teaching and learning has minimal effect on sexual attitudes in this US sample. However, using the 3 sexuality OSCE cases scores as outcomes, two of the 26 attitude-belief items predicted > 24% of the variance. CONCLUSIONS: The sexual health course produced major changes in Communications with patients sexual health skills and Knowledge of sexual health, but little change in personal Attitudes about sexuality. These data suggest that personal attitude change is not essential for teaching US medical students to learn about sexual health and sexual function and dysfunction, and comfortably take a comprehensive sexual history. There is widespread support for including sexual health as an integral part of the basic curriculum for medical, physician assistant (PA) and nursing students [1] [2] [3] [4] [5] . Despite such agreement, a 2003 study [6] reported that in valid responses from 101 of 141 U.S. and Canadian medical schools surveyed, over half offered only 3-10 h for the sexual health curriculum and just a third offered 11 or more hours. Twenty percent of medical schools in the U.S. were reported as not requiring mandatory sexual health courses in the curriculum. A later study [7] found that 44% of US medical schools lacked formal sexual health curricula. In nursing schools, only 1 in 6 instructors thought that their students were prepared to deal with sexuality issues [8] . The lack of robust sexual health training for nursing and medical students may be due to a variety of factors, including competition for space in the curriculum, lack of appropriately trained faculty, and failure to recognize the importance of sexuality in clinical practice. Sometimes it is relegated as an elective area. There is a paucity of well-evaluated curricula and standardized psychometric instruments to demonstrate the impact of sexual health courses on student knowledge and skills in the area. Evaluation of academic courses should cover the educational domains of teaching. Bloom's Taxonomy of Educational Objectives [9] covers the domains of cognitive aspects (knowledge), affective components (comfort and feelings about the subject matter, traditionally addressed by Sexual Attitude Reassessment [SAR] seminars), and psychomotor aspects, more broadly conceptualized as the skills needed to perform a history-taking or a physical examination. Parish and Clayton [10] similarly identify the key domains of model sexual health curricula as attitudes, knowledge, and skills. Traditionally, attitudes toward sexual health issues have been seen as both precursors to, and products of, training in sexual health or other sexuality education, but it is difficult in cross-sectional studies to identify the contribution of attitudes about sexuality to affect, knowledge and skills. There are few comprehensive evaluations of sexual health programs in medical schools in the literature. Marcotte and Logan [11] reviewed the data in the mid-1970s and found that SAR workshops which were used to expose students to differing sexual attitudes, showed significant increases in sexual knowledge and positive attitudes toward sexual behaviors following a 2-day SAR in male medical students in 1971. One study on medical students in California showed no changes in attitudes from baseline after a sex education course [12] , while courses at the University of Minnesota and the University of South Carolina showed significant positive improvement over time [13, 14] . These early studies used the Sexual Attitudes and Behaviors Scale and the Sexual Knowledge and Attitude Test (SKAT) [15, 16] developed by Leif, first published in 1964 and copyrighted. Garrard et al. [14] carried out a longitudinal study with the SKAT, in the 1970s at the University of Minnesota, and found significant increases in tolerant attitudes and knowledge which persisted at 12 months. Schnarch and Jones [17] also used the SKAT to evaluate the sex education course at Louisiana State University for 2nd year medical students, using final year medical students who had not attended the course as controls. They found that more liberal (positive) attitudes toward masturbation, abortion, and homosexuality and heterosexuality, and recognition of sexual myths, were significant in those who had attended the course compared with baseline, but not significant compared with the final year students who had not taken the course. Twenty years later, Leiblum [18] carried out a largely qualitative cross-sectional analysis of the human sexuality program at Robert Wood Johnson Medical School that was designed for medical students, PAs, nurses/ midwives, graduate nurses, MPH students, and other health care professionals. She noted high scores on the extent to which the course increased comfort levels talking about sexuality, understanding their own values, increasing their tolerance for the variety of human behavior, and basic knowledge of sexual practices and behaviors. In the same program, Rosen et al. [19] evaluated a half-day intensive workshop for residents who had not studied sexual health courses at medical school. Using a pretest-posttest design, 67% the 34 participants indicated that they had attained a greater awareness of sexual problems, and 52% reported that the workshop had helped them a great deal in developing comfort and skill in sexual history taking. While textbooks have been published on sexual history taking [20, 21] , evaluation of the impacts of sexual health courses remains rare. Evaluation of contemporary sexual health courses requires relevant and standardized evaluation instruments. The SHEPS (Sexual Health Education in Professionals Scale) was developed by Bayer and Shindel in the late 2010s [22] and was first evaluated in both the U.S. and East Africa [23, 24] . A central characteristic of the SHEP S is that instead of looking at general estimates of sexual health knowledge, it focuses on 37 specific provider knowledge questions where the stem was about providing sexuality services, based on the item of specific patient types (e.g. Q3, "A pubescent person, i.e. body changes with puberty, becoming sexually active, decision making"; Q29, "A person who desires contraception"). These questions are first scored by the student on a 7point Likert scale on ability to communicate/assess/discuss the topic with a patient (sexuality communication skills), and then on confidence that one has the knowledge to care for patients with such a concern. Finally, there is a 26 item attitude scale on contemporary sexual attitudes and beliefs. The SHEPS was designed specifically to evaluate educational programs for healthcare providers. We hypothesized that the SHEPS would measure, from baseline to completion of the course, significant impacts on sexual health communication skills, knowledge, and attitudes in first year medical students. In arguing for more sexual health courses in US medical schools, evidence of a measurable impact is essential. Given the paucity of data on sexual health OSCEs, we were also interested in the relationship of the formal curriculum to the OSCEs. The course We evaluated the mandatory sexual health course in year one at a major US medical school in 2019. This comprised ( Fig. 1) 3 components: (1) 20 h of didactic lectures, panels, and tutorials, including two tutorials on sexual history taking, (2) a tutored app which gave students the opportunity to watch themselves taking a sexual history (based on a case history), with a colleague playing the "patient", then reversing roles and getting feedback by rating each other in the exercise [25] , and (3) the final exercise, 3 sexual health OSCE stations. The 3 OSCE stations involved a female standardized patient (SP); a male SP; and a transgender assigned male at birth SP; all with appropriate provided case histories. The University of Minnesota M Simulation Center designs and delivers simulated training experiences for all health sciences learners. The case histories for SP training and support were provided by the Program in Human Sexuality and the School of Nursing. We used the SHEP S for pre-and post-tests. The entire first year (N = 174) of the medical course at the University of Minnesota was invited to engage in the study after the first semester of first year (December). Invitations were to participate by electronically filling out the SHEPS and demographic data (February), with an incentive of $US50 each ($100 total) for pretest and post-test. Post-test was in the week immediately following the end of the summer semester, a few days after the final exam (OSCE, end of June). Pre-and post-tests were anonymous, matched by a student-chosen code usually consisting of initials and a number. After data entry, matching, and cleaning, 6 questionnaires were eliminated: 80 pre-tests and 74 post-tests were completed and matched, leaving a sample size of 74. The period between baseline tests and the course was a semester, approximately 16 weeks. No sexual health material was taught before the pre-test, and the Sexual Health course ran for 20 h spread over 6 weeks, with the OSCE in the 7th week. The three (unknown patient sexual history, 8 min per case) OSCE scores consisted of SP ratings of the student "provider" on how engaged the SP felt, how responsive the provider seemed, how well listened to the SP felt, how at ease with the provider the SP felt, how engaged the provider seemed, how at ease the provider seemed, how on track the interview seemed, how much information the provider shared, and how much the provider encouraged sharing on the part of the SP, scored on a 5-point Likert scale where 1 = poor and 5 = excellent. The OSCE, using experienced SPs who had played sexual health cases for two previous years, was provided as the final practice evaluation and the score was not used for grading, but for research evaluation purposes. The study was approved by the University of Minnesota IRB, study number 00004500. Written informed consent was obtained after reading a plain-language description of the study. Data were analyzed in SPSS version 26 (SPSS Inc., Chicago, Illinois). For the Attitudes scale, since it is composed of both positive and negative items, the negative items were reversed for Attitude scale analyses, with a high score indicating conservatism and a low score liberalism. T-tests were computed between pre-and post-test items, followed by effect size (Cohen's d) calculations, for significant results, using the SocSciStatistics online calculator [26] (Tables 2 and 3 ). Difference scores on all items were calculated by subtracting the Pre-test item score from the Post-test item score. The OSCE scores were factor analyzed (Principal Components, Direct Oblimin rotation, Δ = 0) and only one factor with an eigenvalue > 1 emerged. Consequently, the scores were summed to form an OSCE total (α = 0.95). Correlations between OSCE total scores and SHEPS item difference scores were conducted using Pearson's r (not shown). All significance tests were at p < 0.05, two-tailed. Response was 74/174, 42.5%. The sample characteristics are displayed in Table 1 . Data comparing the gender of the sample with the medical class indicated that the sample was composed of more women (66%) than men (34%), not significantly different from the sex breakdown of the class (Yates corrected χ 2 = 1.68, df = 1, p = 0.19). Median age for the sample and for the larger class was 24. Half of the sample (39, 52.7%) reported some formal sexual health education prior to medical school. Nearly all of the sample (68, 91.9%) reported that they knew someone who was a sexual minority (LGBTQ). The SHEPS took about 20 min to complete. Data (Table 2) for the Communications skills subscale were significant between pretest and post-test at high levels of (Table 2) . However, there were only 7 significant differences in the Attitudes subscale, and those with only 5 small and 1 medium effect sizes (Table 3 ). In a stepwise linear regression of the 6 post-test Attitude scale (attitudes within the week following the OSCE), items which significantly predicted the total OSCE score at p < .05 were identified. Two variables ("Sex is not an issue that physicians should deal with in their practices" (Yes), standardized β = 0.36, p = .000, and "Healthy women always have a lower sex drive than men" (Yes), standardized β = 0.26, p = .000) entered into the equation. The model including both these variables was significant (F = 11.84, df = 2, p = .000), r = 0.49, adjusted r 2 = 0.24, accounting for 24% of the variance in the SP total OSCE score. Correlation of the OSCE total with the attitude scale total was r s = − 0.15, p = 0.21: Attitude scale scores were approximately normally distributed but skewed toward the liberal (right) end of the continuum (see Fig. 2 post-test). These longitudinal data evaluating a medical school sexual health course, using the SHEPS, are among the few recent systematic evaluations of such programs. Using the three domains of the SHEPS, covering self-reported communications skills, knowledge, and attitudes toward sexuality, it is evident ( Table 2 ) that almost every item in the communications skills and knowledge domains significantly improved, and that the effect sizes in the pretest to post-test are mostly in the large to huge effect size range using Cohen's d. Clearly, the 20-h course, training, tutorials and OSCE positively impacted the communications skills and knowledge of the students in these two domains. OSCEs have been shown to have moderate inter-rater reliabilities, higher with experienced SPs [27] . However, the changes in attitudes about sexuality (Table 3) were few and small in effect, leading to the conclusion that attitudes about sexuality are minimally changed by a comprehensive and mandatory sexual course in first year medical students. Several points stand out. Firstly, the 37 items in the first two scales were based on specific clinical scenarios of particular patient characteristics, so it is possible to determine which ones the course impacted most. For communication skills and knowledge, all those scenarios which were specifically addressed in the course, and those marginally or not addressed, were significantly improved. Those which were specifically addressed had the largest effect sizes. It seems, however, that the comfort with communications skills and knowledge generalized positively even in areas that were marginally addressed. As Zamboni and Ross [24] previously reported, "a rising tide lifts all boats": comfort with communication skills in sexuality spread across sexual topics generally. Similarly, the increased knowledge in the knowledge domain of sexuality flowed into a wider spectrum of patient scenarios. That is, the knowledge about human sexuality was connectable and generalizable across these patient scenarios. However, attitudes about sexuality changed minimally or if they did, the effect was small. This seems to fly in the face of the view from studies in the 1970s that SAR seminars were crucial for effective learning and patient care in the field of human sexuality. We believe that a more subtle interpretation of the evidence is called for. Firstly, we are 50 years past the so-called "sexual revolution" of the late 1960s and early 1970s. Sexuality is a common topic in the media and in public and private conversations, and the Internet makes sexual knowledge easily accessible. There is no longer much shock value in seeing explicitly sexual images and erotic videos online. We conjecture that it is likely that sexual attitudes are formed early, in adolescence and early adulthood, and that these students (median age 24) have formed and solidified their personal views about sexual issues in the decade before they come to medical school. Thus, there is minimal change or re-structuring of attitudes and beliefs at this point of early adulthood. Second, the positive implication of these data is that medical students can learn effective communications skills and knowledge about human sexuality without attitudes interfering with that learning. The objective of the course was to give all medical students the skills and comfort to take a good sexual history without their attitudes and beliefs interfering with their skills, comfort or knowledge, not to change their attitudes. Such an interpretation is also supported by the lack of significant correlation between OSCE total scores and the Attitude scale total score, a measure of sexual health liberalismconservatism. Third, we caution that the course did not include a SAR workshop as it is classically taught. It is difficult to replicate the intensity and interaction of a SAR and a small group experience in a large lecture theater, and it could be argued that nothing equivalent to a SAR (which includes sexually explicit media, exploring issues and concerns, and clarifying emotional response to aspects of sexuality) occurred [28] . SARs, however, are typically attended by a select sample, who are paying volunteers, and it may be regarded as inappropriate to require them of students in mandatory and for credit courses. Nevertheless, it is also possible that the SAR was a necessity of its time that now has less relevance, at least in the U.S., as a prerequisite for teaching about human sexuality. Self-assessed communications and knowledge skills are difficult to verify independently. As part of completion of the course, there was an OSCE of 3 stations, each of 8 min of taking a sexual history, plus five minutes of feedback and discussion with the SP. We were able to incorporate the SP's ratings into the data set. The literature suggests that there are few if any predictors of OSCE scores, since they test a viewpoint that is different from typical assessment measures. OSCEs are usually not significantly correlated with USMLEs or other assessments like multiple-choice questions [29, 30] . Violato [31] notes that they concentrate on skills, clinical reasoning, attitudes, and basic knowledge, but that they have had very little empirical scrutiny or validity. As published findings indicated, communication skills and knowledge items were not associated with the OSCE score [27, 28] . This is consistent with the literature cited above which reports that OSCEs generally have few if any correlations with standard measures of performance, but evaluate a different set of skills. However, we did Table 3 ) that OSCE scores were significantly associated with 7 of the 26 items in the Attitudes subscale. Two of these predicted nearly a quarter of the variance in the OSCE score: believing that sex is not an issue that physicians should deal with in their practices, and believing that women always have lower sex drives than men. These data indicate that it may be attitudes about sexual health and its place in medical practice that influence OSCE performance, and not the skills and knowledge themselves. Positively, this may be interpreted as acknowledging that students can learn sexual health communications skills and knowledge and perform well in an OSCE without having their attitudes influence their performance. It does not seem that the course as taught has much impact on attitude change. It may, however, also be that there are floor/ceiling effects on some items, especially if attitudes are already strongly held: item means clustered at high or low points of the scale support this. This would also be consistent with previously solidified attitudes with little opportunity to move. Further research on the relationships between healthcare student sexual health communications skills and attitudes about sexuality is warranted, as is debate on whether, at This pre-test, post-test evaluation has strengths and weaknesses. A weakness is that the sample was selected based on willingness to fill in a questionnaire before and after the course, with a reasonable incentive, and while it did not differ from the composition of the course population based on sex, it was however not a full class sample. Adequate incentive rather than liking the content area should have reduced bias, especially as the questionnaire pre-test was several months before the course to minimize a course-enthusiasm recruitment effect. The final sample comprised a large proportion, 42.5% of the course. Using an instrument, the SHEPS, specifically designed and evaluated to assess sexual health educational interventions in healthcare professionals, and tested in both the U.S. and in Africa, was a strength. However, we caution over-generalization of these data beyond a large Midwest state U.S. medical school. We believe that this study adds to the sparse and somewhat dated body of literature on longitudinal evaluation of the impact of comprehensive sexual health courses in healthcare students. The utility of the SHEPS as a tool for evaluation of sexual health education in healthcare professionals is excellent, for identifying specific content areas of strength or weakness rather than just general impressions, and to calculate effect sizes as well as significance. However, confidence in dealing with patients with a variety of presenting sexually-related issues, many of which were not explicitly taught in the course, suggests generalization to more other sexuality-related issues. While we evaluated an entire course, it is possible to use the SHEPS at several points during a course and to identify where and how changes in curricula are occurring. It this study, we have also demonstrated that changing sexual attitudes is not necessarily a prerequisite to teaching medical students the skills and knowledge to comfortably (for both provider and patient) take a thorough and comprehensive sexual history. This study was carried out with funding from the Joycelyn Elders Chair of Sexual Health Education, University of Minnesota, and a generous donation from Dr. Duane Rost. The datasets generated and analyzed during the current study are not publicly available, due to being course evaluations containing student educational data including performance, under FERPA (the US Family Educational Rights and Privacy Act). The study was approved by the University of Minnesota IRB, study number 00004500. Written informed consent was obtained after reading a plainlanguage description of the study. All methods were performed in accordance with the relevant guidelines and regulations. Not applicable. Sexuality education in North American medical schools: current status and future directions Summit on Medical School Education in Sexual Health: Report of an Expert Consultation The State of Sexual Health Education Sexual health in undergraduate medical education: Existing and future needs and platforms Existing and future educational needs in graduate and postgraduate education The human sexuality education of physicians in North American medical schools Systematic review of sexual and reproductive health content in nursing curricula Medical School Sexual Health Curriculum and Training in the United States Designing a New Taxonomy of Educational Objectives. Experts in Assessment. Thousand Oaks: Sage Sexual medicine education: Review and commentary Medical sex education: Allowing attitude alteration Medical sex education: The world of illusion and the practical realities Preliminary evaluation of a sex education course Follow-up Effects of a Medical School Course in Human Sexuality The sex knowledge and attitude test (SKAT) The Sexual Knowledge and Attitudes Test Efficacy of sex education courses in medical school An established medical school human sexuality curriculum: Description and evaluation Sexual communication skills in residency training: The Robert Wood Johnson model Discussing Sexuality: A Guide for Health Practitioners. Sydney: MacLennan & Petty Sexual Health Concerns: Interviewing and History Taking for Health Practitioners Sexual Health Education for Professionals Scale (SHEPS) in Ross et al. Evaluation of an assessment instrument for a sexual health curriculum for nurses and midwifery students in Tanzania: The Sexual Health Education for Professionals Scale (SHEPS) Evaluation of an assessment instrument for a sexual health curriculum for nurses and midwifery students in Tanzania: The Sexual Health Education for Professionals Scale (SHEPS) Measuring the effect of sexual health education training in professionals: Structure of the Sexual Health Education for Professionals Scale (SHEPS) among marriage and family therapy graduate students A new computer application for teaching sexual history taking to medical students: innovation and evaluation in the UfaceME® program Effect size calculator for t-test Examiner characteristics and interrater reliability in a communication OSCE Using sexually explicit material in adult sex education Relationship between OSCE scores and other typical medical school performance indicators: A 5-year cohort study Does objective structured clinical examination score reflect the clinical reasoning ability of medical students? Assessing competence in medicine and other health professions We thank the medical students who participated, and the Medical School, University of Minnesota, for their support and encouragement for evaluation. Received: 24 September 2020 Accepted: 28 December 2020 Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.