key: cord-0995515-4mekwwpx
authors: Toor, Amolpreet S; Wooding, Denise J; Masud, Sarmad; Khosa, Faisal
title: Cross-Sectional Analysis of Canadian Anesthesiology Residency Program Website Content
date: 2022-03-22
journal: Cureus
DOI: 10.7759/cureus.23410
sha: f873ff46ca230c2cd619cf7183b540ade988332b
doc_id: 995515
cord_uid: 4mekwwpx

Background Residency program websites are an important resource widely used by prospective applicants when applying to programs. The objectives of our study were to evaluate the program content available on Canadian anesthesiology residency program websites using established criteria and identify any areas for improvement. Methods In this cross-sectional study, we evaluated the content available on accredited anesthesiology residency training program websites, between July and August 2021, using 54 criteria provided in the following domains: recruitment; faculty; residents; education and research; clinical work; incentives; wellness; and environment. Website scores were analyzed using descriptive statistics and presented as median (interquartile range), percentage (%), and range. Results We identified 17 programs with publicly available functional websites. Overall, residency programs met a median of 28 (interquartile range: 18-36) website criteria out of 54 (51.9%). Education and research was the highest-scoring domain among residency programs (median 77.8% of criteria met), while resident information and incentives were the lowest (14.3%). Conclusion Canadian anesthesiology residency program websites include information on many domains relevant to prospective applicants, including education and research. However, most websites require improvement and content updates for faculty information, resident information, incentives, wellness, and environment.

The process of choosing and applying for residency programs is challenging for medical students [1] [2] [3] . Online content available on anesthesiology residency websites is a widely used resource for obtaining program information among prospective applicants [1, 4] . Many studies have shown that the quality and content of post-graduate medical program websites are important factors in making an informed decision for an application [4] [5] [6] [7] . For instance, an investigation amongst the United States (US) anesthesia residency applicants demonstrated that 98% of applicants explored program websites during the application process, and 56% reported that the website content influenced their decision to apply to a program [4] . Moreover, the COVID-19 pandemic has only increased the reliance on virtual platforms for medical trainee recruitment, making program websites a major avenue to communicate program-specific information [8] [9] [10] . Despite this, postgraduate medical program websites across many specialties (e.g., obstetrics and gynecology, and radiology) lack important program content that is valued by prospective applicants [11] [12] [13] [14] .

To better facilitate applicant decision-making, it is pertinent to maintain a resource of comprehensive information for prospective applicants. This will help both medical trainees and program recruitment committees to find the most suitable match for their respective goals, aims, and needs. Accordingly, the objectives of our study were to: (1) assess the content available to prospective applicants on Canadian anesthesiology residency websites using established criteria [4, 5, 7, [11] [12] [13] [14] ; (2) identify any content areas requiring improvement.

Benefits (e.g., disability and health insurance) Salary (numerical value) Vacation Statutory and floating holidays Leave (e.g., educational, pregnancy, parental)

Mentorship opportunities (e.g., academic, clinical, and peer mentorship)

Mental health/spiritual resources Physical wellness activities/resources (e.g., fitness, sleep, nutrition) Social wellness (e.g., program social events)

Location highlights (e.g., city/neighborhood amenities, restaurants) Local activities (e.g., outdoor activities) Housing and living (e.g., cost of living) 

A list of RCPSC accredited anesthesiology residency programs was obtained from the Canadian Residency Matching System (CaRMS) website (https://www.carms.ca/match/r-1-main-residency-match/programdescriptions/). Anesthesiology Clinician Investigator Programs (CIP) were excluded from this study because Two website reviewers (AST and DJW) were trained to use the 54-criteria system by examining three randomly selected program websites. Discrepancies in scores were discussed, and coding was determined as a team to establish interrater reliability. Information was considered present on a program website if it was available on: (1) the program website or subpages; (2) linked documents (e.g., program brochures); or (3) websites hyperlinked on the official page (e.g., link to hospital websites). A score of one was recorded for each criterion met by a program website, and zero for every criterion absent. The trained reviewers independently analyzed each anesthesiology program website; the order of program websites for each reviewer was randomly selected using an online generator (https://www.random.org/lists/). The reviewers were not blinded because they were viewing the actual website [11, 19] .

All data were cataloged on Excel (version 16.53 for Mac; Microsoft, Redmond, WA). Website scores were analyzed using descriptive statistics and presented as median (interquartile range), percentage (%), and range. Statistical analyses were performed using SPSS Statistics (version 28 for Mac; IBM, Armonk, NY).

There are a total of 17 RCPSC accredited anesthesiology residency programs; all programs had a functional program website. Overall, the 17 residency program websites met a median of 28 (interquartile range: 18-36) website criteria out of 54 total criteria (51.9%) with scores ranging from 14 to 44 (Table 3) . 

The purpose of our study was to assess program content available to prospective applicants on Canadian anesthesiology residency websites using a 54-point criteria system. Education and research were the highest-scoring domain among residency programs, while resident information and incentives were the lowest.

Residency websites effectively provided program information regarding research opportunities (17/17, 100%), curriculum/didactic learning (14/17, 82.4%), and assessments/evaluations (14/17, 82.4%) within the education and research domain. Similarly, a study of obstetrics and gynecology program websites in Canada and general surgery residency websites in the United States (US) and Puerto Rico found that research opportunities and didactic learning were prevalent criteria on residency program websites [11, 20] . Additionally, an evaluation of 131 anesthesia residency program websites in the US reported that research program information was found in 88% (117/131) of programs, and educational program schedules were found in 67% (88/131) [4] .

Information about faculty, residents, incentives, wellness, and environment were often omitted from anesthesia residency websites. Faculty and resident information (e.g., biography and interests) are considered important content areas on program websites among applicants [6] . Faculty clinical and research interests may give applicants insight on potential mentors and active research areas as part of a program. According to a recent US National Resident Matching Program (NRMP) survey conducted among residency applicants, perceived goodness of fit (e.g., the atmosphere, culture, feel of a program) was considered important in deciding application and program rank by 90.5% of US anesthesiology applicants [21] . Faculty interests, resident biographies, and extracurricular information may help applicants subjectively assess their perceived goodness of fit with a program, making these website criteria useful in recruiting prospective trainees [22] . Additionally, faculty and resident contact information provides an opportunity for applicants to further investigate a program and connect with current residents to learn about their personal experiences with a program [1, 14] . However, it is possible that contact information may be omitted from websites for privacy or security purposes. Additionally, programs may rely on alternative avenues to provide faculty and resident information, including social events (e.g., meet and greets) and information sessions.

Information regarding wellness (e.g., mental, physical, social wellbeing resources) and incentives (e.g., benefits, salary, moonlighting) were also among the least commonly met criteria on anesthesia residency websites. This is despite the increasing emphasis of the anesthesiology specialty on work-life balance and burnout avoidance [18, 23, 24] . Work-life balance is a motivating factor among medical trainees when making career choices [25] . Physical, psychological, and financial well-being affect physician job satisfaction and the quality of care they provide [23, 26, 27] . Moreover, a perceived lack of support at work among anesthesiologists is significantly associated with physician burnout [23] . It is unclear whether the lack of wellness information is due to an actual lack of programming, but this seems unlikely given that resident wellness support is an RCPSC accreditation requirement [16] . However, programs may not prioritize wellness information as much as residents or applicants. This may be due to a lack of faculty awareness surrounding the scope of the problem affecting resident wellness (e.g., burnout and depression) [28] . Nonetheless, providing wellness information through program websites may influence prospective residents' program preferences, and may increase resident awareness and accessibility to wellness resources and satisfaction with a program [24] . Programs may offer wellness (e.g., mental, physical, and social) information on a page of their website in the following ways: (1) describing any active wellness curriculum offered by the program;

(2) listing wellness resources and services offered by the program; (3) accessible links to local, provincial, and RCPSC wellness resources (https://www.royalcollege.ca/rcsite/documents/about/covid-19-wellnessresources-hp-e).

Similarly, information about incentives, including salary, benefits, and moonlighting may help applicants with financial planning. Medical school graduates often have significant educational debt, a factor commonly associated with depression, burnout, low quality of life, and decreased job satisfaction [26] . Salary and benefits information can be directly listed on program websites and continually updated as changes occur. Alternatively, an accessible link to CaRMS provincial salaries and benefits for postgraduate training may be provided (https://www.carms.ca/match/r-1-main-residency-match/salary/#1511459027032-06ec5e41-5301). Opportunities such as moonlighting, a practice permitted by the RCPSC, support trainees dealing with financial hardship, reduce emotional exhaustion, and improve quality of life [26, 29] . It is important to note that while moonlighting is permitted by the RCPSC, there is a regional variation in regulatory policies and eligibility for moonlighting depending on the provincial regulatory body and program [30] . Given the program variability in policies and eligibility for moonlighting, we recommend programs attach a document listing their eligibility criteria and contact information for applicant inquiries. Efforts to promote the availability of website information regarding program incentives may increase interest from applicants, especially those with educational debt, and families to support.

A multitude of reasons may explain the absence of information on residency websites. There is the possibility that programs may not recognize the changing trends for obtaining residency information [8] ; programs may assume most applicants are obtaining information by word of mouth. Residency programs may outsource website maintenance to digital and marketing companies, which may not regularly consult physicians or faculty members. Lastly, residency programs may not consider it necessary to develop comprehensive websites given a large number of qualified applicants.

Data collection took place between July and August 2021 and did not account for website updates that may have taken place after this study period. The 54 criteria used to assess each program website were adapted from previous studies and although they provide a standardized framework for assessing program websites, there is no one set of criteria that can reflect the values of all prospective applicants. Future studies investigating which criteria are important to postgraduate Canadian anesthesiology trainees may be helpful to create a more representative criteria list. Data collection by different individuals may lead to varying results due to the subjectivity involved in identifying the presence of information on program websites. Nevertheless, two trained investigators independently evaluated each program website to mitigate the potential for variability.

In this cross-sectional study, we found that Canadian anesthesiology residency training program websites met most criteria in the education and research domain. However, many program websites lacked content pertinent to prospective applicants. Domains including faculty information, resident information, incentives, wellness, and environment are areas that require improvement and content updates. Addressing these insufficiencies by updating websites may help anesthesiology programs attract prospective applicants as part of their recruitment efforts and may help applicants make informed decisions surrounding their postgraduate training.

Human subjects: All authors have confirmed that this study did not involve human participants or tissue. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue.

In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: Dr. Faisal Khosa is the recipient of the American College of Radiology -Global Humanitarian Award (2021) and the Royal College of Physicians and Surgeons of Canada McLaughlin-Gallie Visiting Professor (2021). This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. This research was supported by Disparities Research Institute Ltd.

Factors important to anesthesiology residency applicants during recruitment

Factors influencing subspecialty choice among radiology residents: a case study of pediatric radiology

The radiology fellowship arms race cannot be won

Self-reported information needs of anesthesia residency applicants and analysis of applicant-related web sites resources at 131 United States training programs

Interventional radiology fellowship website content: what is the relevance to potential applicants

Aspects of residency programs' web sites important to student applicants

Importance of residency program web sites to emergency medicine applicants

Reimagining residency selection: part 1-a practical guide to recruitment in the post-COVID-19 era

Video interviewing: a review and recommendations for implementation in the era of COVID-19 and beyond

Improving the online presence of residency programs to ameliorate COVID-19's impact on residency applications

Program website evaluation of Canadian obstetrics and gynaecology residency and fellowship programs

An evaluation of the content of Canadian and American Nuclear Medicine Fellowship websites

How well do we represent ourselves: an analysis of musculoskeletal radiology fellowships website content in Canada and the USA

How well do we represent ourselves: an analysis of cardiology fellowships website content

Royal College of Physicians and Surgeons of Canada: Anesthesiology training experiences

Royal College of Physicians and Surgeons of Canada: Standards of accreditation for residency programs

Royal College of Physicians and Surgeons of Canada: National curriculum for Canadian anesthesiology residency

Royal College of Physicians and Surgeons of Canada: Special program training requirements for the clinician investigator program (CIP)

An evaluation of the availability, accessibility, and quality of online content of vascular surgery training program websites for residency and fellowship applicants

Evaluation of general surgery residency program websites

National Resident Matching Program: Results of the 2021 NRMP applicant survey

Applicant fit and diversity in the orthopaedic surgery residency selection process: defining and melding to create a more diverse and stronger residency program

Burnout rate and risk factors among anesthesiologists in the United States

Anesthesiology Resident Wellness Program at the University of Saskatchewan: curriculum content and delivery

The stability of factors influencing the choice of medical specialty among medical students and postgraduate radiology trainees

The emotional wellness of radiology trainees: prevalence and predictors 2022 Toor et al

The prevalence of burnout and depression and their association with adherence to safety and practice standards: a survey of United States anesthesiology trainees

Whose problem is it? The priority of physician wellness in residency training

Anesthesiology residents' medical school debt influence on moonlighting activities, work environment choice, and debt repayment programs: a nationwide survey

Royal College of Physicians and Surgeons of Canada: CBD policy working group communique: moonlighting