key: cord-0017733-io77plsh
authors: Gupta, Sahil; Palmer, Scott; Ferreira-Dos-Santos, Guilherme; Hurdle, Mark Friedrich
title: Pain Medicine Fellowship Program Websites in the United States of America – A Nonparametric Statistic Analysis of 14 Different Criteria
date: 2021-05-21
journal: J Pain Res
DOI: 10.2147/jpr.s313513
sha: f88ad739d2afc73a8e47c0db079f948ce9aa9742
doc_id: 17733
cord_uid: io77plsh

OBJECTIVE: To evaluate the content of Pain Medicine Fellowship Program websites in the United States of America. METHODS: We obtained a list of accredited 104 Pain Medicine Fellowship Program websites from the Accreditation Council for Graduate Medical Education and the Electronic Residency Application Service. Individual Pain Medicine Fellowship Program websites were then evaluated on 14 different criteria. We grouped fellowship programs based on census region and Electronic Residency Application Service participation status, and analyzed the differences using nonparametric statistics. RESULTS: A total of 104 accredited Pain Medicine Fellowship Program websites were evaluated for a total of 14 different criteria. Of the 14 different criteria, an average of 3.94 were described in each website. Number of Fellowship positions per year (71.8%), clinical rotations during the program (65.1%), and faculty background (62.2%) were the most frequently described features on the websites. Night call responsibilities (3.9%), meal allowance (7.8%) and parking availability (10.7%) were the least described features in the websites. There were no significant differences between program websites when grouped by census regions or the participation status in the Electronic Residency Applications Service. CONCLUSION: The content of Pain Medicine Fellowship Program websites is extremely variable across the United States of America. This study indicates that there is room for improvement and enhancement of the comprehensiveness of website content for the majority of the programs analyzed. Additionally, this study also emphasizes the importance of having accurate and easily available online information in a post-pandemic era, when prospective fellows evaluate programs online through their websites.

Prospective fellows are increasingly using the internet to evaluate training programs before submitting applications for fellowship positions. This study evaluates the content and comprehensiveness of Pain Medicine Fellowship Program websites in the USA based on 14 different criteria. We report that currently there is lack of program information on websites for prospective trainees. Optimization of these resources would help institutions attract the best suited candidates for their programs.

The internet is an ever-increasing source of information for prospective resident and fellow physicians who want to evaluate training programs when considering their future applications, especially in a post-pandemic era. 1 Therefore, easy accessibility of online information is essential for applicants to know what to expect in each program, from clinical training and research opportunities, to location of training and application requirements. [2] [3] [4] [5] Multiple studies have shown that applicant decisions to apply for, or rank a program, are influenced by its online resources including program websites as well as social media presence. 6, 7 This is even more important for Fellowship programs that accept applicants from several different specialty backgrounds, as is the case of the majority of Pain Medicine Fellowship programs in the United States of America (USA), which accept applicants from Anesthesiology, Neurology, Physical Medicine and Rehabilitation, and Psychiatry, among others. 8, 9 In a pandemic era, when fellowship program directors and candidates have had to reimagine the interview and selection process, it is essential that programs provide comprehensive and accurate information to their prospective applicants through their website, in order to ensure optimal pairing in the Fellowship match. 3, 5, 10 Without the opportunity to visit the programs' locations in person, the majority of prospective applicants are primarily and increasingly depending on program websites and virtual interviews to make important decisions about their future clinical training. 11 Two separate studies have also shown that online resources (e.g. program websites and social media presence) have positively influenced applicant perception of the program which resulted in higher ranking of the program in the rank list order. 7, 12 To our best knowledge, this is the first study to evaluate and report on the comprehensiveness of Pain Medicine Fellowship Program websites in the USA. For this purpose, we reviewed the websites of 104 Pain Medicine Fellowship programs across the USA and evaluated them based on the information offered, including the application process, curriculum and rotations, salary and benefits, faculty profile, among others.

With the detailed evaluation on 14 different criteria presented in this manuscript, we hope to help Pain Fellowship programs update and repurpose their websites to provide comprehensive and easily available information to their prospective applicants.

This project evaluated publicly available websites for information about the corresponding Pain Medicine Fellowship programs. The Accreditation Council for Graduate Medical Education (ACGME) and the Electronic Residency Application Service (ERAS) were accessed for a listing of 104 Pain Medicine Fellowship programs in November of 2020. 13, 14 Institutional review board approval was not required prior to the start of the project as this study did not involve human subjects and all information collected was available in the public domain.

Each of the 104 Fellowship Program websites was searched using the Google online search engine, with the strings "name of the institution" and "Pain Medicine Fellowship". All the programs were evaluated for 14 different criteria (Table 1 ). These criteria have been previously validated by multiple studies which evaluated the content of Residency and Fellowship Program websites across different medical specialties in the USA. [3] [4] [5] [15] [16] [17] These criteria were also congruent with the needs of the applicants as described in studies in the Plastic Surgery and Internal Medicine literature. 18, 19 The websites were given credit only if the criteria evaluated were either directly addressed on the fellowship website or a direct link was provided to access that information. The presence and absence of content in each of the 14 different categories for each program website was recorded in Microsoft Excel. Mann-Whitney and Kruskal-Wallis tests were used for statistical analysis using the SPSS v24, with statistical significance set at P-value <0.05.

Of Programs participating in ERAS reported an average of 3.9 criteria per program, as opposed to non-participating programs, which reported 4.1 criteria on average (Table 2) . No statistically significant difference was found between the number of criteria included on a program website based on the location of the program or its ERAS participation status. Only 4 programs out of the 104 programs analyzed reported 10 or more criteria on their website. The most commonly reported criteria (Table 1) were the number of fellow positions available per year (71.8%), curriculum and mandatory clinical rotations (65.1%), and faculty profile (62.2%). The least reported criteria were night call responsibilities (3.9%), meal allowance (7.8%), and parking availability (10.7%).

To our best knowledge, this is the first study that analyzes the comprehensiveness of Pain Medicine Fellowship Program websites in the USA.

Previous studies published in Anesthesiology and Surgery literature have reported limitations and deficiencies in the amount of information available on Residency and Fellowship Program websites in the USA. 3, 15, 16 Our findings are consistent with these earlier studies involving the evaluation of training program websites, which reveal that Residency and Fellowship programs do not maintain comprehensive and updated information on their websites for prospective applicants. This observation was consistent over different geographic areas, as well as the ERAS participation status. 17, 20 This study reveals that only 71.8% of the programs analyzed had basic information readily available on their websites, such as the number of fellow positions available per year. Other information, like salary, parking availability, or meal allowance was also hard to find or missing altogether. Details on the curriculum, quality of training, vacation, night call responsibilities, and research funding were frequently absent as well. It is likely that this lack of information results in a decrease in applicants' keenness to apply, potentially leading to suboptimal recruitment and Fellowship matching.

A study by Thompson et al showed that International Medical Graduates (IMG) make up about one-third of Pain 

Medicine Fellowship applicants. 21 In this regard, one of the most important questions concerning applicant eligibility is visa sponsorship. Only 21.3% of the 104 programs analyzed reported information about visa sponsorship or IMG eligibility on their websites. When stratifying the data by regions, no statistically significant difference was found between the completeness of Fellowship Program websites in the different USA census regions. This is consistent with website analysis of other training programs. 1, 16, 20 When grouped by ERAS participation status, no statistically significant difference was found in the comprehensiveness of the websites' content. This indicates that there is a low-cost, low-risk window of opportunity for improvement for programs to attract better candidates across the USA.

In a subspecialty like Pain Medicine, where the pool of prospective applicants comes from several different medical backgrounds, this study underlines the need to make training program websites useful and easy to navigate. A recent study from Plastic Surgery literature showed that applicants most value information like career placement, faculty profile, curriculum, and research opportunities, when analyzing programs for which to apply for. 19 We recommend that the information described above be made readily available on the Fellowship Program websites to meet the needs and desires of prospective applicants.

This study was performed at a critical time, when the pandemic has forced both Fellowship programs and applicants to reimagine the interview and selection process. Traditionally, the application process for a Fellowship Program involved a series of on-site interviews in which selected applicants could see and experience the training program first-hand. However, in a post-pandemic world applicants primarily interview virtually using video conferencing software, which means missing out on the in-person aspect of the traditional interview. Due to such limitations, it is incumbent upon the training programs to provide comprehensive and accurate information on their websites, in order to attract the best suited candidates for their program. 

Dr Mark Friedrich Hurdle reports personal fees from Avanos Medical, outside the submitted work. The authors did not receive any other direct or indirect financial or other benefits for the publication of this manuscript.

Interventional radiology fellowship website content: what is the relevance to potential applicants?

Evaluation of the content and accessibility of web sites for accredited orthopaedic sports medicine fellowships

Self-reported information needs of anesthesia residency applicants and analysis of applicant-related web sites resources at 131 United States training programs

Importance of residency program web sites to emergency medicine applicants

Aspects of residency programs' web sites important to student applicants

The role of social networking web sites in influencing residency decisions

Use of social media resources by applicants during the residency selection process

Pain medicine board certification status among physicians performing interventional pain procedures in the State of Florida between

Academic interest in pain: comparison of four specialties with long-standing involvement in pain medicine

Virtual interviews in the era of COVID-19: a primer for applicants

Residency match during the COVID-19 pandemic: the clear and present danger of the remote interview

The impact of social media on plastic surgery residency applicants

General surgery residency program websites: usefulness and usability for resident applicants

Accredited hand surgery fellowship web sites: analysis of content and accessibility

Critical evaluation of interventional neuroradiology fellowship program websites in North America

Use and utility of Web-based residency program information: a survey of residency applicants

Do websites provide what applicants need? Plastic surgery residency program websites versus applicant self-reported needs

Microsurgery fellowship website and social media presence: are programs optimizing recruitment strategy?

Misrepresentation in multidisciplinary pain medicine fellowship applications to a single academic program