key: cord-0699999-snbuo9cp authors: Wolff, Margaret; Burrows, Heather title: Planning for Virtual Interviews: Residency Recruitment During a Pandemic date: 2020-10-15 journal: Acad Pediatr DOI: 10.1016/j.acap.2020.10.006 sha: 8c7ce29e36fc106c1a2143ffc392760f341f3533 doc_id: 699999 cord_uid: snbuo9cp Recent directives from The Coalition for Physician Accountability, Association of Pediatric Program Directors (APPD), Council on Medical Student Education in Pediatrics (COMSEP) and Association of Medical School Pediatric Department Chairs (AMSPDC) recommend virtual recruitment for graduate medical education (GME) programs this year. Driven by concerns for safety, equity and financial pressures, virtual interviewing will require a thoughtful approach to achieve the desired goals of recruitment. Drawing on the fields of communication and human resources management, we examine the potential effects of web-based interviews on communication through the lens of several communication theories: media richness, media naturalness and signaling. We then review the literature on virtual interviews in GME training programs. Finally, we will provide best practices compiled from the literature. leadership and residents, allowing them to assess the overall culture, fit of the program and camaraderie. [4] [5] [6] [7] Additionally, informal gatherings that foster open dialogue with residents (e.g. pre-interview dinner) are a highly valued part of the interview process. 5, 6 Applicants report the interview day heavily influences their Match list rankings. 8 With the benefits of the traditional interview come significant financial and education costs. [9] [10] [11] The annual cost of recruitment for internal medicine programs averages $148,000 while applicants spend between $2,500 to over $10,000 for primary and surgical subspecialties respectively. [9] [10] [11] [12] [13] This process is also timeintensive resulting in lost productivity for faculty and educational time for trainees. [14] [15] [16] While transitioning to WBI may decrease some of the substantial costs of FTF interviews, the differences in communication between these modalities may make it challenging to achieve the same goals as a FTF interview day. The communication theories media richness, media naturalness and signaling have been described in the human resources management (HRM) literature and can provide a framework to understand the potential effects of WBI on communication (figure 1). Media richness theory posits that different modes of communication will vary in their level of richness based on the communication cues carried (verbal, visual, emotional, behavioral) and the immediacy of the feedback afforded. [17] [18] [19] Communication modes that carry more cues and allow more immediate feedback are more complete (richer) and less likely to lead to miscommunication. In this framework, a phone interview has the most limited ability to convey communication cues, whereas the visual presence of WBI allows greater exchange and the physical presence of FTF conveys maximal communication cues and allows for more immediate feedback. For example, an applicant in a FTF interview can lean in to indicate they have a question; the interviewer can see this cue and stop talking to allow the applicant the opportunity to talk. In contrast to this, in a WBI the interviewer may miss this subtle body language forcing the student to choose between interrupting or not asking the question. The related theory of media naturalness describes elements that make communication feel natural and engaging. 20 This theory posits that the naturalness of communication depends on co-location, synchronicity of communication and the ability to express and perceive facial expressions, body language, and speech. When a communication mode feels less natural, participants will have to expend greater cognitive effort and there will be more ambiguity with decreased engagement. As compared with FTF interviews, WBI have less synchronicity (e.g. slower exchanges of information due to audio lag, visual freezing) and decreased ability to transmit facial expressions (e.g. low quality images, poor eye contact, inadequate lighting) and body language (e.g. only part of the body is visible on screen). As individuals gain experience with a mode of communication, they adapt their communication styles to the mode and it becomes more natural. For example, individuals using WBI may rely less on facial expressions over time. Alternatively, they may develop ways to improve the transmission of facial expressions (e.g. improved lighting). The suggestions covered later in the manuscript are adaptations described in the literature to increase the naturalness of this form of communication. Signaling theory builds upon the previously described theories by stating that when an individual (or organization) communicates information (a signal) the recipient must choose how to interpret the information. 21, 22 The more incomplete or ambiguous the signal, the more the intended signal will become distorted as the recipient relies on their own mental models and external information to interpret the signal. Signal distortion can happen anytime there is asymmetry of information. Studies in the field of HRM demonstrate that applicants interpret a wide variety of recruitment experiences, such as diversity of interviewers, as symbolic of broader organizational characteristics. 23 For example, if an applicant interviews only with men they may conclude that the organization does not value women. Signal distortion may occur in both FTF and WBI, but is more likely in WBI than FTF. 17 This is due to the incomplete communication cues relayed and difficulties interpreting facial expressions, body language and speech in WBI. Taken together, these theories suggest that when utilizing WBI, information may be lost and recipients on both sides will unconsciously fill in those gaps. Further, WBI may feel more natural to those that are more experienced with web-based video communication. A recent study by McColl and Michelotti assessed the interactions of these theories in a series of experiments utilizing both WBI and FTF interviews. 17 They found that the less media-rich WBI format was less effective in communicating emotions, non-verbal cues and personality traits than the more media-rich FTF interviews. There were also many potential disruptions in communication that led to distortion of signals including technical problems, environmental factors and verbal and non-verbal communication challenges. Interestingly, they demonstrated that although individuals who were more familiar with videoconferencing appeared more comfortable, their performance was perceived to be inferior to those with less experience with videoconferencing. The researchers postulated that because their experience was derived from social interactions utilizing this modality, their comfort may have been interpreted as being too casual. Over the past decade, several GME training programs have piloted WBI due to the significant financial and time costs associated with recruitment. 16, [24] [25] [26] [27] [28] [29] Predictably, the WBI process was universally associated with decreased costs and time commitments. 16, [24] [25] [26] [27] 30, 31 Despite the significant reduction in time and cost, applicants and faculty in these pilots generally preferred FTF interviews due to perceived ability to represent themselves and develop rapport in FTF interviews. 16, 26, 30 As a result, many authors concluded that WBI would be a reasonable adjunct to the FTF interview, not a replacement. 16, 26, 30 Now that current times necessitate WBI exclusively, these pilots can offer valuable insights (Table 1 ). In the next section, we describe best practices by interpreting the findings of these pilots through the communication theories described above. The sum of these studies can assist GME training programs in developing WBI recruitment strategies that accurately represent their programs and minimize signal distortion. With appropriate planning, thoughtful implementation and deliberate engagement with applicants, limitations of WBI can be at least be partially mitigated (Table 2) . The first step is to identify the key messages that a program wishes to convey to applicants. In addition to highlighting program characteristics, programs should consider the values and culture they wish to depict. As the interview experience is planned, these messages should guide development of recruitment materials and decisions about the recruitment process. For example, a program wishing to portray flexibility may consider offering multiple scheduling options for interviews. The traditional GME interview day is conducted in a half-day or day-long block of time that allows both applicants and faculty to immerse themselves in the experience. This can be replicated in a virtual format by scheduling each applicant's interviews in a consecutive fashion and by encouraging applicants to view supplemental material during that block as well. This provides a more immersive experience and allows applicants to form a solidified program impression. 32 Given the greater cognitive effort expended in WBI, length of interviews may need to be shortened and breaks should be interspersed. 20, 32 Each individual interview should include a buffer of time to troubleshoot any technical problems. 27 Another consideration is the time of day that interviews are offered. One advantage of the WBI format is that interviews can be offered at different times of day to accommodate time zone differences. 28, 29 Additional considerations include format of interview (one-on-one, panel or asynchronous) and question type. The AAMC piloted asynchronous standardized video interviews (SVI) for applicants in emergency medicine to provide programs with objective, standardized information on applicants' interpersonal and communications skills and knowledge of professionalism. 33, 34 The SVI consisted of questions presented as text prompts followed by applicants recording a reply. The program was halted after three years in part due to lack of effectiveness and unfavorable student perceptions. 35 We do not recommend utilizing this as an alternative to live WBI given the limited communication cues transmitted in this one-directional communication. One-on-one interviews are the predominant format described in WBI. 26, 27, 30, 31 Successful panel interviews have been described in WBI as well. 28, 32 However, the panel interviewers were in the same room for the interview for improved synchronicity which may not be possible during this pandemic. 28, 32 In terms of question type, in 2016 the AAMC recommended utilizing standard interview questions and evaluation processes as best practices for conducting residency program interviews. 36 Programs could consider utilizing this overhaul of the interview process to examine their approach to interview questions. There are numerous WBI platforms available with several factors to consider including cost, security, privacy and recording functionality. 37 Programs should select a platform that works on all operating systems and utilize the same platform for all interview activities. 38 With videoconferencing "soaring to record highs" during this pandemic, most users will have some familiarity with videoconferencing. 39 Programs could consider offering applicants a choice of platform to increase the naturalness of the WBI. 24 However, this will necessitate faculty and program staff become familiar with several platforms or risking increased technology disruptions and increased signal distortion. Irrespective of which platform is selected, applicants should have an opportunity to trial and troubleshoot the system in advance of their interview. 16 Ideally this would occur several days prior to the WBI to allow time for adjustments if needed. 16 This will minimize technology disruptions and all allow for applicants to become familiar with the platform. Programs should encourage applicants to review the AAMC's Applicant Preparation Guide for virtual interviews for tips on WBI. 40 Considerable effort should be made to facilitate clear and rich conversation between the applicant and the interviewer. 17 Anything that causes disruption or confusion in communication will lead to signal distortion and potentially miscommunication. McColl identified issues with technology, the setting and non-verbal and verbal communication that contribute to signal distortion. 17 The technical issues include disruptions in audio or video, synchronization of video and audio, frozen videos and ease of establishing a connection. These can be minimized by trialing the system in advance. 16 Another option would be to have immediate on-site technical assistance available. 26, 27 This would require faculty to be in a central location during the interviews. Phone numbers for both faculty and applicants should be provided in advance in case of technology failure. 16 Challenges with the setting include poor lighting (halo or too dark), background noise, distracting visual background, misplaced camera angle and overly casual dress. 17 To minimize these challenges, both faculty and applicants should be provided with tips to optimize WBI including positioning of camera, use of lighting and high-quality microphones. [40] [41] [42] Recording a test session ahead of time and observing the quality of both sound and video can help users identify areas for improvement. Alternatively, programs may consider having all interviewers pair up to trial their set-up in advance including an assessment of their lighting, audio and background. In addition to training on the WBI platform, another essential preparatory component is faculty training on the expected differences in the modality from FTF interviews. For example, faculty should be encouraged to provide more opportunities for applicants to ask questions given it is harder to break into a conversation on WBI. Faculty should be comfortable with the technology and expected process for beginning and ending the interviews (e.g. is there a virtual waiting room? Does the applicant disconnect after the interview or return to waiting room?) In addition, all interviewers should be well-versed in the program so the applicants receive consistent messaging during a time when they will not be interacting with as many people. Faculty should have a clear idea of the goals of the interview process and utilize best practices that limit bias as delineated in the AAMC guidelines. 36 It will be important to utilize the time leading into the interview seasons to prepare faculty for this new process. The potential challenges posed by technology may be alleviated if medical schools provide interview booths with high-quality equipment and onsite assistance. This is likely not possible for all medical schools, however, and may run the risk of introducing bias for students from less-resourced medical schools. During the asynchronous SVI pilot study, students reported variable support from their medical schools to assist with preparation. 43 Commercial services offered preparation assistance for fees ranging from $400 to $7,000. 44 The spirit of the COPA letter is to level the playing field for both programs and students given that some areas of the country have been disproportionally impacted by COVID-19. 1 Medical schools and residency programs will have to be cognizant of this to ensure that their approach does negate this goal. A common concern among applicants in the WBI pilots was the inability to sufficiently interact with faculty and residents. 29 This is a significant concern given the considerable emphasis placed on these interview day interactions by applicants in the traditional FTF interviews. [4] [5] [6] [7] Several strategies to promote engagement with faculty were described in the WBI pilots. The first is to provide a pre-recorded program director video welcome that addresses the elements typically covered by the program director during the FTF recruitment. 16, 24, 27 While a prerecorded session will present the facts and introduce the program director, a live-streamed session offers greater exchange of information and interaction with the program director. 45 Programs may consider a hybrid approach: recorded video for essential details augmented with brief, live-virtual welcome or a question and answer session. In general, programs should consider live-virtual sessions when the goal of the session is to communicate personal connections and culture given the enhanced communication cues and the ability to observe interpersonal dynamics. Pre-recorded sessions should be utilized when the goal is to deliver information or in situations where it is not feasible to have a live-virtual session. Additional videos from residency leadership, faculty representing different missions (scholarship, advocacy, education) and residents could also be considered. To provide both a sense of the interactions between residents and faculty as well as types of didactic instruction provided, programs could provide video clips of conference or live-stream conference on interview days. 16, 46 Live-stream would be preferable if technical disruptions do not interfere. Given that many residency didactics are currently being held over a web-based platform, applicants could be invited to a session. If utilizing Zoom, we suggest requiring a password for entry, change screen-sharing to "host only" and disable "join before host" to prevent zoom-bombing. 47 The virtual interview experience should also include informal portions to allow applicants to engage with residents and experience the program's culture and camaraderie. 32, 38 While some programs may elect to combine all interview day activities into one block of time, others may decide to hold a virtual pre-interview social event. 32 For any informal event, applicants should be told in advance the purpose, the dress code, who will be in attendance and if the session is required. If the event is held during a mealtime, communicate in advance if eating and drinking are welcomed. Virtual social events should start with a welcome and overview of the session. Given that many applicants may not feel comfortable engaging in a large virtual group session, social sessions should incorporate small group break-out sessions. Themed break-out sessions may encourage dialogue. 38 If programs don't wish to hold a large virtual gathering, other formats include offering Google Hangout chat sessions with chiefs, Zoom meetings with small groups of residents, or one on one WBI with residents. 24, 48 Another option recently described as a recruitment tool is the business communication platform, Slack. 49 This internet-based platform offers a broad range of features including private chat rooms, direct messaging and persistent chat rooms (channels). The University of Minnesota utilized this platform for graduate student recruitment during the pandemic with positive feedback from both faculty and applicants. 50 Prior to the interview, programs should provide digital resources that replicate the information traditionally provided in the interview day packet such as curriculum overview, schedules and post-residency career data. 27, 32, 46 This allows the applicants to familiarize themselves with the program in advance and ask meaningful questions. 32 Other helpful resources prior to the interview include an up-to-date website and narrated virtual tours of the hospital and local area. 16, 24, 27, 28 Utilizing local tourism materials or providing links to local recreational activities and resources can also help applicants familiarize themselves with the area without requiring significant resources. 16, 24 Looking Forward As we continue to face unprecedented challenges during this pandemic, the leadership and vision demonstrated by the COPA letter highlights the power of community and the strength in approaching GME recruitment from the national perspective. This pandemic has caused disruption at every level, making it unlikely that GME recruitment will completely return to the pre-pandemic state. For the first time, we have the opportunity to proactively assess WBI without concern of disadvantaging applicants or programs because all programs will be utilizing WBI. Lessons learned from prospectively studying this recruitment cycle as a community will inform future recruitment cycles for years to come. Improving Pediatric Residency Application Process Recommendations Medical School Applicants The Coalition for Physician Accountability's Work Group on Medical Students in the Class of 2021 Moving Across Institutions for Post Graduate Training Conducting Interviews During the Coronavirus Pandemic | AAMC Use of the Interview in Resident Candidate Selection: A Review of the Literature It was the night before the interview: Perceptions of resident applicants about the preinterview reception Impact of a Preinterview Dinner on Candidate Perception of a Fellowship Training Program Factors neurosurgery candidates use when choosing a residency program. Clinical article Factors that affect medical students' perception and impression of a plastic surgery program AAIM Perspectives Resident Recruitment Costs: A National Survey of Internal Medicine Program Directors The cost and burden of the residency match in emergency medicine Financial burden associated with the residency match in neurological surgery Student Expenses in Residency Interviewing The Economic Burden of Residency Interviews on Applicants The Fourth Year of Medical Education : A Literature Review Cost of Applying to Residency Questionnaire Report Randomized evaluation of a web based interview process for urology resident selection Sorry, could you repeat the question? Exploring video-interview recruitment practice in HRM Information richness: A new approach to manager information processing and organization design Media Richness or Media Naturalness? The Evolution of Our Biological Communication Apparatus and Its Influence on Our Behavior Toward E-Communication Tools VdN0AAAAA:TOOmzIy3F3-DhbM6c7cu_u0oCYEp3NCd5k5_KPbtLMfgIlSryg5peMJuKa8ZOqDmpqi-HTGLYx0 Signaling theory: A review and assessment Creating psychological and legal contracts through human resource practices: A signaling theory perspective The Importance of Recruitment in Job Choice: A Different Way of Looking Comparison of webbased and face-to-face interviews for application to an anesthesiology training program: a pilot study Live online video interviews dramatically improve the plastic surgery residency application process Interview from anywhere: Feasibility and utility of web-based videoconference interviews in the gastroenterology fellowship selection process Videoconference Interviews for an Adult Reconstruction Fellowship: Lessons Learned Videoconference Interviewing: Tips for Success Feasibility and usability of teleinterview for medical residency interview Residency Interview Video Conferencing Using Skype as an Alternative for Residency Selection Interviews Virtual Interviews for Surgical Training Program Applicants During COVID-19: Lessons Learned and Recommendations The AAMC Standardized Video Interview: Essentials for the ERAS ® Innovation in Residency Selection: The AAMC Standardized Video Interview Joint Letter to the AAMC on the Standardized Video Interview (SVI) | AAEM -American Academy of Emergency Medicine Best Video Conferencing 2020 | Reviews by Wirecutter Successful Virtual Interviews Zoom booms as demand for video-conferencing tech grows | Technology | The Guardian. The Guardian How to Pull Off a Professional Video Call From Home | Wirecutter Things You Need for Better Video Calls | Wirecutter. The New York Times Applicant Reactions to the AAMC Standardized Video Interview during the 2018 Application Cycle 44. Standardized Video Interview Preparation (SVI Prep TM ) | BeMo® Virtual Interviews for Surgical Training Program Applicants During COVID-19: Lessons Learned and Recommendations Residency Interviews in the 21st Century Beware Zoom Users: Here's How People Can 'Zoom-Bomb' Your Chat Web Conferencing, Webinars, Screen Sharing -Zoom Where work happens | Slack Rethinking Graduate Recruitment Weekends: Using Slack to Make Virtual Recruitment as Effective as In-Person Visits The majority of applicants felt interview length was "just right"