key: cord-0948813-5175ua54 authors: Goldhar, Hart A.; Gazel, Ummugulsum; Ivory, Catherine; Maltez, Nancy; Humphrey-Murto, Susan; Milman, Nataliya; Zehra Aydin, Sibel title: Factors affecting patient satisfaction with outpatient rheumatology phone visits during the COVID-19 pandemic date: 2022-05-05 journal: Clin Rheumatol DOI: 10.1007/s10067-022-06182-3 sha: 7ca17dd31ff185cc9d20d3e760887f316f5d991d doc_id: 948813 cord_uid: 5175ua54 The aim was to evaluate patient satisfaction with virtual care, and identify factors associated with level of satisfaction. Surveys were mailed to all patients who had a phone visit at The Ottawa Hospital Rheumatology division. Patients’ satisfaction with various aspects of the phone visits was assessed on a 5-point scale and analyzed according to demographic variables using chi-square and regression analyses. Of 2423 surveys mailed, we received 742 responses (31%). Eighty-nine percent of patients were satisfied overall with the phone visit. Statistically significant less satisfaction was seen in patients who spoke to a resident compared to their rheumatologist (p < 0.001), were not called on time (p < 0.001), had difficulty using a telephone (p < 0.001), needed assistance of a second person (p < 0.01), or had new consultations (versus routine follow-up, p = 0.01), the former 3 factors being significant in a multivariate regression analysis. Rheumatology patients expressed a high level of satisfaction with virtual care; however, areas of improvement were identified. Patients’ satisfaction will be important to inform future decisions regarding the sustainability of virtual care. Further research is required to understand the impacts of virtual care on patients’ SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10067-022-06182-3. The COVID-19 pandemic necessitated an abrupt transition from in-person to virtual medical visits throughout the world [1, 2] . Generally, major protocol changes like this one are preceded by abundant quality improvement research and planning; however, the rapidity of the virus' impact prohibited such a process. The discipline of rheumatology has been employing digital technology for clinical care for decades; however, it has rarely been considered as standard of care, partially due to inadequate electronic infrastructure and concerns around added work, misdiagnosis, liability, privacy, and reimbursement [3, 4] . Proposed benefits have included improved access to specialist care for patients living in remote areas and patient satisfaction regarding more efficient use of time (considering travel, registration, etc.) and reduced costs (for travel and parking) [5] . Specific to the pandemic period, there is also the added benefit of reducing patients' anxiety around coming in person to hospital. As expected, some studies depict less patient satisfaction regarding physician-patient rapport when compared to in-person visits [6] . Furthermore, the effectiveness of telephone visits with respect to accurate diagnosis and disease control is variable among studies [5] [6] [7] [8] [9] [10] Given this pandemic may continue, it is important for rheumatologists to understand the level of satisfaction among their patients. The purpose of this study was to evaluate patient satisfaction with virtual care, and identify factors that may be associated with reduced satisfaction. This quality improvement (QI) study was conducted at The Ottawa Hospital, Division of Rheumatology in Ottawa, Canada. Adult patients who had participated in a telephone visit with any of 12 practicing staff rheumatologists from the division between March 16th, 2020 (first day that telephone visits were utilized), and June 19th, 2020, were approached. Patients were identified through a systematic search of electronic medical records. The study was approved by the Ottawa Health Science Network Research Ethics Board (OHSN-REB). A survey was developed in both French and English, and patients were mailed surveys in their preferred language. The main language used at The Ottawa Hospital is English; however, many of our patients' primary language is French, and some healthcare workers are bilingual. Data pertaining to non-identifying demographic information was collected, including age, rheumatologic diagnosis, ability to communicate in English in clinic, and comfort using a telephone. We also collected patients' ratings (on a 5-point scale) of several aspects of phone visits. The survey was adapted from a 2015 study, and expanded to include questions pertinent to this pandemic [6] . Surveys were distributed by mail. Participants were given the option of returning the survey answers by mail (with a pre-stamped envelope), emailing a scanned copy, or completing it online on the SurveyMonkey® platform. List of statements included in the survey are presented in the Supp App B. If patients entered more than one rheumatologic diagnosis, all autoimmune diagnoses were included for analysis, and non-autoimmune diagnoses (such as osteoarthritis) were not. However, if patients entered only non-autoimmune diagnosis, such as arthritis (A), osteoarthritis (OA), crystal arthritis (CA), or fibromyalgia (FM), only one diagnosis was included, using the following hierarchy: CA > OA > A > FM. For example, if systemic lupus erythematosus (SLE) was listed along with OA and FM, only SLE was recorded for that patient. Descriptive statistics and chi-square analysis were applied for associations between categorical variables. For analysis, "strongly agree" and "agree" responses were grouped together as "overall satisfied," and "strongly disagree" and "disagree" responses were grouped as "overall not satisfied." Linear regression adjusting for clinically and statistically significant confounding variables was used to explore predictive factors of patient satisfaction. The final multivariable logistic regression model for predicting patient satisfaction included the following covariates: preferred language (English vs French), the need for a second person during the visit, being comfortable using a phone, physician spoken to (resident vs staff), and being called on time. Statistical analysis was performed using SPSS (version 22.0, IBM® corp., Armonk, NY, USA). Surveys were mailed on August 31st, 2020. As of October 26th, 742 responses were returned (31%). Fifteen participants were excluded (participants denying having had phone visits, denying having spoken to a physician, having been sent a survey in incorrect language, or having been recently deceased). Of the 742 respondents (Table 1) , 70% were > 60 years old and 72% were female. The most common diagnoses were rheumatoid arthritis (RA, 41%), SLE (11.7%), psoriatic arthritis (PsA, 10.6%), and vasculitis (10.4%). Among all visits, 4% were new consultations. Nine percent were somewhat or very uncomfortable using a telephone for a rheumatology appointment. Eight percent of patients stated they spoke with a resident and their rheumatologist, 17% spoke with a resident only, and the remaining 75% spoke directly to their staff rheumatologist. Seventeen percent needed an in-person visit following the phone visit. Satisfaction was generally rated very high ( Fig. 1 ). Eighty-nine percent of patients agreed or strongly agreed that they were satisfied overall with the phone visit, and 55% stated they would prefer to have some virtual visits after the COVID-19 period. Only 28% felt they would have preferred to be seen in-person despite the risk of COVID-19. Patients generally felt that the phone visit saved them time and money. Less satisfaction was seen in patients who had difficulty using a telephone compared to those who were moderately or very capable (58% vs 80% vs 92%, p < 0.001), generally needed assistance of a second person at clinic visits (79% vs 90%, p < 0.01), spoke to a resident compared to their rheumatologist (86% vs 91%, p < 0.001), had a new consultation compared to routine follow-up (72% vs 91%, p = 0.01), or stated they were not called approximately on time (74% vs 91%, p < 0.001) ( Table 2) . Underlying diagnosis or age category did not affect satisfaction. There was a trend towards OA patients preferring an in-person visit (Supp figure 1-2) though this did not meet statistical significance. In multivariate analysis, speaking directly to their rheumatologist (p = 0.003; OR (95%CI) 5 In this study, we demonstrated that patients were overall satisfied with telephone visits, and over 50% stated they would prefer to have virtual visits after the COVID-19 period. Lower satisfaction was associated with poor capability using a telephone, requiring assistance of a second person at clinic visits, speaking to a resident, having a new consultation, and not being called on time. To our knowledge, this is the largest patient satisfaction study during the COVID-19 period, and showed a high satisfaction rate. Our findings also suggest that virtual care may not be ideal for specific populations such as patients with special needs. Patient satisfaction with virtual visits observed in our study was comparable to or slightly higher than other recent studies conducted during the COVID-19 pandemic. An international online survey study with 429 responses demonstrated 74% agreement with having visits virtually compared to in-person, and 71% were satisfied with the visit overall [11]-comparable to 72% and 89%, respectively, in our study. In another study, 175 connective tissue disease patients were invited to answer questions by phone; 78% reported openness to having some visits virtually following resolution of the pandemic, similar to 74% in our cohort [12] . In this study, patients with lower level of education preferred in-person visits. Finally, a study of 359 patients who had a virtual visit (48% video) reported that 74% were satisfied with the visit; satisfaction was correlated with having a video component and not requiring a language interpreter [13] . The aforementioned factors associated with lower satisfaction have identified avenues towards improving patient satisfaction with rheumatology care via virtual platforms. Providing a time window for the phone visit might help temper expectations. Patients could be asked by their provider about their capability using a telephone and whether they need assistance from a support person, and in-person visits could be scheduled for those who do. New consultations could be booked in-person by default. Additionally, we found that participants preferred to speak directly to a staff rheumatologist. Traditionally, when visits are in-person, staff rheumatologists see all patients after trainees complete their independent assessment; however, with virtual visits, 17% of patients did not see or speak directly with their rheumatologist. Despite the lower comparative satisfaction, satisfaction was still 86%. These findings align with a recent study demonstrating high satisfaction with residents in an outpatient surgical clinic (≥ 87% among different variables), albeit still lower compared to that with staff [14] . A similar trend was also observed in a study of 288 internal medicine ambulatory clinic patients [15] . In contrast, a Canadian study of 211 patients in an outpatient gastroenterology clinic reported no difference in patient satisfaction between those who saw a resident and attending and those who saw an attending alone, after adjustment in multivariate analysis [16] . Explanations that have been suggested for lower satisfaction with residents include residents' inferior bedside communication and clinical knowledge, patients' misunderstanding of the role of residents, and prolonged visits when seeing a resident followed by a staff [14, 15] . It is unclear whether this in turn could have a negative impact on trainee experience. Further studies are needed to evaluate this. Strengths of this study include the large sample size and the breadth of patient factors that were included in the survey. The single-center design allowed us to adapt the survey to our patient population (language considerations) and use the data to guide practical changes to the conduct of visits at our center; however, this may sacrifice generalizability. It is important to consider study limitations. The majority of the responders were > 60 years old, limiting the generalizability of our findings to younger patients. Apart from patient satisfaction, other outcomes from virtual care require investigation such as impact on clinical outcomes, utilization of healthcare resources, and physicians' perspectives. Thus, a second study is planned including > 400 participants at this same center that will evaluate long-term clinical outcomes and follow-up satisfaction after an extended period of virtual visits. Finally, the small number of patients who were dissatisfied inherently limited statistical analysis. In summary, patients were overall satisfied with phone visits. Lower satisfaction was associated with poor capability using a telephone, speaking to a resident instead of staff, not being called on time, having a new consultation, and requiring assistance of a second person at clinic visits. The results of this study provide insight on aspects of virtual care that can be improved in hopes of maximizing the patient experience and quality of care delivered. Table 2 Overall patient satisfaction, and the preference for future virtual visits following resolution of the pandemic, according to various subgroups * Patients who selected "strongly agree" or "agree" were combined into the "yes" category, and patients who selected "strongly disagree" or "disagree" were combined into the "no" category Learning from adversity: lessons from the COVID-19 crisis Virtual care is here to stay, but major challenges remain Electronic communication improves access, but barriers to its widespread adoption remain Social, organizational, and technological factors impacting clinicians' adoption of mobile health tools: systematic literature review Telerheumatology: a systematic review Could a low-cost audio-visual link be useful in rheumatology? Patients' own ability to assess activity of their rheumatoid arthritis Satisfaction with rural rheumatology telemedicine service Tele-health followup strategy for tight control of disease activity in rheumatoid arthritis: results of a randomized controlled trial Virtual rheumatology appointments during the COVID-19 pandemic: an international survey of perspectives of patients with rheumatic diseases Telemedicine in rheumatology: a reliable approach beyond the pandemic Rheumatology patient satisfaction with telemedicine during the COVID-19 pandemic in the United States The impact of residents on patient satisfaction Patient satisfaction in resident and attending ambulatory care clinics Resident trainees do not affect patient satisfaction in an outpatient gastroenterology clinic: a prospective study conducted in a Canadian gastroenterology clinic Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations Acknowledgements We acknowledge The Ottawa Hospital Division of Rheumatology for financial support for this study. We also acknowledge Dilek Solmaz for supporting the statistical analysis and Paula Patterson for supporting the data collection. Disclosures None. The online version contains supplementary material available at https:// doi. org/ 10. 1007/ s10067-022-06182-3.