key: cord-0928312-4hvcw2i1
authors: de Oliveira, Laura Maria Andrade; Cordeiro-Spinetti, Eric; Neves, Felipe Piedade Gonçalves; Sujii, Patricia Sanae; Ribeiro, Rachel Leite; de Lyra, Sidcley Silva; Pinto, Tatiana Castro Abreu; Bonatelli, Maria Letícia
title: Going Online in Pandemic Time: A DivulgaMicro Workshop Experience
date: 2021-03-31
journal: J Microbiol Biol Educ
DOI: 10.1128/jmbe.v22i1.2493
sha: 661b135ba519922c821ad4a4053b585abcdcd511
doc_id: 928312
cord_uid: 4hvcw2i1

DivulgaMicro is a Brazilian science communication and outreach project run by three young female scientists. In 2020, due to the COVID-19 pandemic, we promoted the first virtual edition of the DivulgaMicro Workshop. Here, we describe adaptations implemented to deliver the virtual edition and its assessment by the participants. We offered a 3-day workshop addressing manuscript writing and publishing, poster design and oral presentations, and strategies for effectively communicating with the lay public on Days 1, 2, and 3, respectively. Each daily session was divided into short lectures and active learning through interactive and cooperative activities. We applied pre- and postsession surveys daily to assess participants’ learning, with an opinion questionnaire at the end of the workshop. We selected 50 of 221 applicants, but only 38 of those selected participated in the workshop. Correct answers were significantly higher (p < 0.01) in the postsession surveys each day. Most of the 34 participants who answered the opinion questionnaire (97%) would recommend the workshop to their colleagues. Participants stated that the workshop content was transmitted in a clear and straightforward manner, and they considered the online format suitable for knowledge acquisition. Participants were satisfied with the organization, dynamics, and interactivity. Topics addressed on Day 3 (61.8%) and Day 1 (23.5%) were most liked and were considered most useful in the participants’ careers. We believe that the overall success of the workshop is due to the combination of short lectures with active-learning activities, the use of virtual platforms that enabled effective communication between participants and instructors, and the support of our collaborators.

There is a growing understanding that science communication skills are essential for several aspects of science and society. Science communication training and resources can increase appreciation and understanding of science, create and strengthen networks, debunk misinformation, influence decision-making and policy, and more (1) . Altogether, these benefits seek to effectively promote changes in society.

Personal benefits, including increased confidence to communicate with experts and nonexperts and a heightened sense of belonging at scientific meetings, can also be achieved, especially for early-career scientists (1) . In the last decades, science communication has established itself as a research field to be addressed in universities across the world, as a discipline for undergraduate and graduate students, and as a master's degree program (2) . Such activities have had a significant breakthrough in Brazil in recent years, despite some limitations. One of the great current challenges of science communication in Brazil concerns the quantity, quality, and geographical distribution of training courses throughout the country, which in general are concentrated in the urban centers of the southeastern and southern regions (3, 4) . Thus, the offering of online science communication training courses could reach stakeholders in different regions of Brazil and allow for the professional development of journalists, scientific communicators, undergraduate and graduate students, and early-career scientists (4) .

DivulgaMicro is a Brazilian science communication and outreach project that aims to develop young scientists' communication skills, as well as to promote the public understanding of science. The project is run by three young female scientists from Brazil and it has been supported by the American Society for Microbiology (ASM) since its beginning in 2018. Our activities are based on two cornerstones: we provide educational resources and science communication content via our website (http://www.divulgamicro. com.br/en/index.html) and our social media accounts (@ divulgamicro), and we offer on-site science communication workshops throughout Brazil (5) .

Every year we promote at least five on-site Divulga-Micro Workshops in universities or scientific meetings, with one in each of the five Brazilian geographical regions. It is a day-long workshop that addresses several aspects of science communication, including best practices for preparing manuscripts and posters, as well as tips for preparing oral presentations and strategies to communicate effectively with the lay audience (5). Since it launched, DivulgaMicro has promoted 11 editions of our workshop, reaching nearly 600 Brazilian graduate and undergraduate students as well as early-career scientists (6) . In Brazil, initiatives to train students and early-career scientists in science communication are still rare, reinforcing the importance of our initiative (7) .

In 2020, due to the COVID-19 pandemic, in-person activities in Brazil and across the globe were put on hold. Soon after the World Health Organization declared COVID-19 a pandemic in March 2020, quarantine and physical distancing became a reality in people's lives around the world (8) . In Brazil, universities reduced research activities to a minimum and adapted in-person teaching activities to the remote environment, including both synchronous and asynchronous classes (9, 10) . Most courses in Brazilian higher education institutions are taught in person. For that reason, many professors do not have the expertise required to organize and run online courses and have been struggling to adapt their in-person courses to remote teaching (9, 11) . Online educational and professional development courses are well recognized as effective in delivering knowledge to students and other intended audiences (1, 12, 13) . However, there are still many challenges in making online courses engaging and effective in delivering information.

Under these circumstances, the on-site DivulgaMicro Workshop was adapted to an online format. To ensure a highly engaged and informative workshop, we invited a team of scientists to help us develop this new format. To assess participants' learning gains, their socioeconomic profile, and their level of engagement in the online format, we applied pre-and postsession surveys, and socioeconomic and opinion questionnaires. The present work describes the adaptations implemented in DivulgaMicro Workshop to migrate from the in-person to a virtual format, as well as the general perception and knowledge acquisition by the participants. Our aim was to answer two questions: Does an online professional development workshop increase participants' knowledge of science communications skills? Can we have engaging workshops even in a virtual environment? The information provided here can be used by others to convert in-person workshops to an online format and might foster the development of online versions of training courses on science communication across the world.

Workshop candidates filled out an online application form about their demographic and educational background, and they also stated their motivation to participate in the workshop (see Appendix 1) . Based on these criteria, we conducted a blind recruitment process and selected 50 participants. Since our workshop aims to give participants an introduction to science communication topics, we selected candidates with less experience on the subject. To select a diverse group of participants, we took into account the geographical region of the applicants, as well as their selfreported status as part of a minority group.

The online version of DivulgaMicro Workshop was a 24-hour course (8 hours per day) offered from September 21 to 23, 2020. The original content of the workshop was maintained (5), but it was adapted to a 3-day workshop format. The in-person DivulgaMicro Workshop is 1 day long and has been offered since 2018 in universities and at scientific conferences across the country (5). Here we describe the adaptations made to convert the in-person DivulgaMicro Workshop to a remote environment.

The course content was divided as follows:

• On Day 1, we explored best practices for writing manuscripts and publishing scientific articles. We addressed the basic structure of a scientific manuscript, the importance of sending a clear message, how to organize data into figures and tables, and the submission process to a journal. • On Day 2, we talked about best practices and recommendations for designing, formatting, and presenting posters, and for making oral presentations at scientific meetings. We also delved into the process of face-to-face communication and how to prepare for lectures, seminars, and videoconferences. • On Day 3, we addressed strategies for effective communication with the lay public. We discussed storytelling and journalism techniques applied to science outreach; how to use social media to talk with society; and how to organize and run science outreach events.

Each daily session was divided into short lectures, followed by active-learning activities to be completed by the students in groups. Participants were divided into 10 groups and were instructed to work cooperatively. As participants worked on the activities, instructors would mentor different groups to facilitate discussion and help them develop their ideas. Every hands-on activity in groups was followed by a discussion among instructors and participants. On Day 1, each group had to write an abstract (250 words) based on a scientific dataset prepared by the DivulgaMicro team; on Day 2, they used their own abstracts to (i) write a pitch (a speech up to 3 minutes long), (ii) prepare a poster draft, and (iii) prepare a three-slide oral presentation for a scientific meeting. On Day 3, the same bstract was used to prepare content for the lay public for one of three social media platforms, Twitter, Instagram or Facebook, and the content was then posted on DivulgaMicro's social media.

We used the Zoom video conferencing platform to broadcast the workshop sessions in a synchronous format. We used the breakout rooms tool offered by Zoom to divide participants into groups, and Google Drive so they could work together in real time during the group activities. In parallel, we used Slack for text communication between participants and instructors during and after classes. We also created channels in Slack for each group, so instructors could talk to participants from each group about activities. We used Google Drive to share suggested readings, the course program, and other files.

We invited a team of scientists with a science communication background to help us with the logistics and the content of the workshop. They helped us develop the online format of the workshop, acted as speakers, and assisted the participants throughout the workshop.

To evaluate this new workshop format, we asked the participants to fill in different questionnaires using the Google Forms application. At the beginning of the workshop, participants completed a sociodemographic questionnaire, as well as a questionnaire about their prior knowledge on general aspects of the workshop content (see Appendix 1). To assess participants' learning gain, we applied each day a pre-and postsession multiple-choice survey, covering the content of the day. Finally, at the end of the workshop, participants evaluated the entire workshop through an opinion questionnaire (see Appendix 1). The last four items of the questionnaire were open-ended questions to allow participants to express their opinions.

The ethical committee of Universidade Federal do Rio de Janeiro (CAAE: 28948019.0.0000.5257) approved this study. All participants signed a consent and authorized the publication of data collected in the questionnaires.

Both the sociodemographic and opinion questionnaires were analyzed similarly. The open-ended questions were analyzed qualitatively and close-ended questions were analyzed quantitatively, where the frequency of each answer was expressed in a percentage.

Data from the multiple-choice questions applied every day are reported as the number of correct responses presession compared with postsession. The participants' performance dataset consists of, on average, 33 answers per day, since not all participants answered all questionnaires every day. All statistical analyses were performed in R Software (14) . We used the Shapiro-Wilk test for data normality and the Wilcoxon signed-rank test to evaluate the significance. The formula (postsession -presession)/(1 -presession) was used to calculate the normalized learning gains (15) . Statistical significance was considered when p was <0.01.

Two hundred twenty-one candidates applied to the workshop from all five geographical regions of Brazil. After the blind recruitment process, we selected 50 participants. In the end, 38 participants took the workshop, of whom 33 (87%) were women.

Thirty-five participants answered the sociodemographic questionnaire. Participants' ages ranged from 17 to 34 years old, but most of them (63%) were 21 to 25 years old. Most participants (60%) lived in the southeast region of Brazil, followed by the northeast (14.3%), midwest (14.3%), and north (11.4%) regions. Regarding their academic degrees, most participants were graduate (40%) or undergraduate (37.2%) students. We also asked the participants to indicate the scientific field in which they work, according to Brazil's Ministry of Education classification (16) . Biological Sciences was the most frequent answer (45.7%), followed by Health Sciences (25.7%), Exact and Earth Sciences (17.1%), Agricultural Sciences (8.6%), and Engineering (2.9%).

We also assessed the participants' previous experience in science communication. Overall, 60% of participants had never taken a course to improve their science communication skills, and nearly 70% declared they had never submitted a manuscript for publication in a scientific journal. Regarding their experience in preparing and presenting a poster at a scientific meeting, 40% of participants had never submitted an abstract to a scientific meeting, 34.3% participants had already presented a poster at up to three scientific meetings, and 25.7% had the experience of presenting a poster at more than three scientific meetings. Approximately half of participants (51.4%) had no previous contact with activities focusing on communicating science to the lay public.

Groups successfully executed all assigned activities (Day 1, 250-word abstract; Day 2, pitch, poster draft, oral presentation for a scientific meeting; Day 3, content for publication on social media), considering the relatively short time frame they had (Fig. 1) .

Overall, postsession surveys on all days had higher percentages of corrected answers (Fig. 2) . Interestingly, best practices for writing and publishing scientific articles, explored on Day 1, was the topic least well-known by the participants prior to the workshop, with less than 25% giving correct answers to three out of five questions on the presession survey ( Fig. 2A) . However, the question that asked if there is a difference between a scientific article and a scientific manuscript [Day 1, Q1 ( Fig. 2A) When assessing participants' learning gain by day, the overall correct answers were significantly higher (p < 0.01) on the postsession surveys on every single day (Fig. 3) , being that the normalized learning gains were 0.36, 0.53, and 0.28 for the first, second, and third days, respectively. 

Thirty-four (89.5%) of the 38 participants filled out the opinion questionnaire, which was designed to evaluate participants' level of satisfaction and collect feedback that will be used to improve future DivulgaMicro Workshops. Overall, participants enjoyed the workshop and declared that they would recommend it to their colleagues. Participants also stated that the workshop content was transmitted in a clear and straightforward manner and that they acquired knowledge on science communication.

Participants were satisfied with the workshop organization, dynamics, and interactivity. They also considered the online format suitable for knowledge acquisition. Participants approved both the workshop content and the speakers' per-formance. They liked the way we conducted the workshop, with short lectures and active-learning-based activities (Table  1) . Participants liked Day 3 (61.8%) and Day 1 (23.5%) the most; these sessions were also considered by the attendees as the most useful in their careers (41.2% votes each).

When asked "What do you believe made your knowledge acquisition in the online format easier?" and "What did you like the most about the workshop?", participants acknowledged the interactive format of the workshop with hands-on group activities, the speakers, and the content addressed.

Answers to these open-ended questions included the following: "What I liked the most was the hands-on group activities," "I loved everything! The dynamics, the interactivity, the content, and the speakers!" and "I liked the content addressed, the speakers and the network with people from different regions of the country." When answering "What do you believe made your knowledge acquisition in the online format more difficult?", the vast majority of the participants stated that technological limitations, especially unstable Internet connections, were the main cause of difficulties faced during the workshop.

The last open-ended question was "What did you not like about the workshop?". Some people felt that the 3-day workshop was exhausting, others complained about the schedule delays that occurred over the course of the workshop and, for some people, the time to perform the hands-on activities should have been extended. However, most participants declared they were satisfied with all aspects of the workshop, and sentences such as "Everything was great," "I have nothing to complain about, I learned a lot!", "I liked everything, congratulations!" were predominant among the answers.

The 2020 DivulgaMicro Workshop gathered a diverse group of students and early-career scientists from different regions of Brazil, acting in different scientific areas, and with different backgrounds regarding previous knowledge on science communication. The online format enabled greater geographic diversity of participants, as most in-person workshops take place in capital cities, larger cities, or academic centers. Overall, participants had never had any science communication training and had little or no experience in the field. This is a reality in the academic community, since it is still rare for undergraduates and graduates to have formal training to develop science communication skills (17) . Such students usually struggle to prepare well-written scientific articles and abstracts for scientific conferences, to produce engaging and visually attractive posters, and to communicate science to the lay public. In addition, they rarely have the necessary know-how about the process of submitting and publishing scientific manuscripts (1, (18) (19) (20) . This scenario reinforces and justifies initiatives like the DivulgaMicro Workshop. After the daily sessions, participants were found to have improved knowledge on the topics addressed, indicating that the workshop contributed to their professional development on science communication. The combination of short lectures to introduce a subject followed by active-learning activities contributed to that and is especially beneficial in online learning (21) . Short lectures are a good way to deliver new concepts, but active learning, here exemplified by hands-on cooperative group activities, has been shown to result in higher achievement, greater retention, and more positive feelings about the subject (22) . In addition, hands-on experience has already proven to be a valuable resource in science communication training (23) . However, when we analyzed some specific questions on the pre-and postsession surveys, we noticed parts of the workshop's content that can be improved, as well as a need to review these questions. Surveys are useful tools to assess short-term effectiveness of training courses on improving professional development skills, and they have been extensively used to evaluate in-person and online training courses (1, 24) . The next step will be reviewing the content that addressed those questions to make improvements.

Participants stated that the topics of communicating science to the lay public and scientific writing and publishing were the most attractive and useful for their careers. Overall, they approved the workshop format and content and thought that it enhanced their knowledge and improved their science communication skills. The interactive and dynamic format of short lectures followed by hands-on group activities in Zoom's breakout rooms was also highly praised by the participants. Zoom's breakout rooms and each group's channel on Slack enabled closer and direct student-speaker and student-student interactions, which are common in in-person courses and are rare but essential features of a well-designed online course to promote student learning. This was actually the main reason to extend the workshop length, so that participants would have more time to complete the activities and interact with their colleagues and with the instructors. We observed that participants' impressions regarding the workshop format are in line with previous studies that showed well-designed online courses can be as effective as in-person courses (24, 25) . Moreover, Zoom is a dynamic and user-friendly video conferencing platform that provides a wide range of features to promote student engagement and learning, including breakout rooms, live chats, and screen sharing; Slack is a digital workspace for collaborative activities that enables direct, fast, and efficient communication among users; Google Drive is another user-friendly tool that facilitates group activities by allowing participants and instructors to work together on documents in real time. As well as being used in the online version of DivulgaMicro Workshop, Zoom, Slack, and Google Drive have been used in other remote teaching initiatives to facilitate students' learning and can be implemented by teachers with basic informatics experience (26, 27) .

The feedback we received through the open-ended questions on the opinion questionnaire indicated that the participants were very satisfied with the workshop dynamic. Most comments were about the high quality of the speakers and the content addressed in the workshop. However, participants pointed out some topics that could be improved in future online editions of the DivulgaMicro Workshop. Some participants considered the 3-day schedule of the workshop sessions long and somewhat tiring, and some suggested the inclusion of asynchronous speaker presentations in the workshop program because of technical issues they experienced due to instabilities in their Internet connection.

Remote teaching is an educational practice which has already proven to be effective; however, until 2020 it was mostly applied to hybrid courses and for distance learning purposes (24, 28) . For instance, in Brazil, remote teaching has been explored by Fundação Oswaldo Cruz (FIOCRUZ) to offer a training course on science outreach, available in the Massive Open Online Course (MOOC) format (https:// campusvirtual.fiocruz.br/gestordecursos/hotsite/divulgacaocientifica-mooc/). In addition, educational online platforms like Coursera (https://www.coursera.org) and Stanford Online (https://online.stanford.edu/) have been widely used for knowledge dissemination in several scientific areas, including science communication. Due to the COVID-19 pandemic, remote teaching environments became imperative to all kinds of educational activities, although challenges in delivering effective content in an engaging way in the online format exist. Giving participants the opportunity to evaluate the course through open-ended questions allowed us to be aware of what worked for them and what did not work so well, and to evaluate the usefulness of the workshop in addressing the students' career needs (1) . The format adopted to migrate the DivulgaMicro Workshop from the in-person to the online environment can be applied by others and proved to be effective in promoting the students' professional development.

Based on our experience, we believe the overall success of our workshop-from enhancing participants' learning on science communications skills to the participants' approval of the online workshop format-can mostly be attributed to the following: (i) the combination of short lectures with active-learning activities contributed to the participants' increased knowledge acquisition; (ii) the use of Zoom, Slack, and Google Drive enabled effective communication between and among students and instructors, and provided a more friendly and interactive environment; and (iii) the efforts and support of our collaborators, from the online workshop format planning to the participation in the workshop as speakers and assistants, really enriched the workshop experience. We recommend that other in-person workshops seeking to move online apply one or more practices described here to provide a successful workshop experience.

Workshop online Distrito Federal and founder of the science communication project Ciência Informativa (@cienciainformativa); Gracielle Higino, Sidcley Silva de Lyra, and Eric Cordeiro-Spinetti, who founded the science communication projects Ignite (@ ignitescicomm), A Ciência Explica (@acienciaexplica), and Doutorando Numa Fria (@doutorando.numa.fria), respectively. We also thank the American Society for Microbiology for its financial support through the Young Ambassador Project Funding, the companies Analítica and PlastLabor, and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) Scholarship no. 151870/2019-5. We have no conflicts of interest to declare.

Changing the culture of science communication training for junior scientists

Vital and vulnerable: science communication as a university subject

Master's degree program in scientific and cultural communication: preliminary reports on an innovative experience in Brazil

Brazil: history, significant breakthroughs and present challenges in science communication

DivulgaMicro: a Brazilian initiative to empower early-career scientists with science communication skills

Science communication as seen by early-career microbiologists in brazil: the DivulgaMicro experience. Abstr 4934, virtual session 478 -POM02 Microbiology Communication and Outreach

Science communication in Brazil: a historical review and considerations about the current situation

2020. WHO Director-General's opening remarks at the media briefing on CO-VID-19 -11

Adaptation and future challenges for public universities in brazil in the face of the COVID-19 pandemic. Global University Network for Innovation: Higher Education after the COVID-19 crisis

The impacts of the COVID-19 pandemic on the teaching of dentistry in Brazil

The science teaching fellows program: a model for online faculty development of early career scientists interested in teaching

Construction and evaluation of an online microbiology course for nonscience majors

R: A language and environment for statistical computing. R Foundation for Statistical Computing

An online interactive video vignette that helps students learn key concepts of fermentation and respiration

Tabela de Áreas de Conhecimento

Practical science communication strategies for graduate students

Learning to write like a scientist: a writing-intensive course for microbiology/health science students

Engaging in the publication process improves perceptions of scientific communication, critique, and career skills among graduate students

Public engagement in science: mapping out and understanding the practice of science communication in Latin America

Mini-lectures interleaved with exercises found beneficial in online learning

Active learning: cooperation in the classroom

Lessons from science communication training

Experiences vary in learning microbiology online: students viewing lectures online learn microbiology as well as students hearing lectures in traditional classrooms

Traditional versus online biology courses: connecting course design and student learning in an online setting

Using Slack to communicate with medical students

The use of Twitter and Zoom videoconferencing in healthcare professions seminar course benefits students at a commuter college

Comparison of online and onsite bioinformatics instruction for a fully online bioinformatics master's program

We thank all the participants of the 2020 DivulgaMicro Workshop for their impressive participation, which made this workshop an amazing event for all of us. We also would like to thank our collaborators for the online version of the DivulgaMicro Workshop: Felipe Piedade Gonçalves Neves and Rachel Leite Ribeiro from Universidade Federal Fluminense; Patricia Sanae Sujii of Centro Universitário do