key: cord-0741631-pl6bld4i
authors: Johnson, Bryan A.; Lindgren, Bruce R.; Blaes, Anne H.; Parsons, Helen M.; LaRocca, Christopher J.; Farah, Ronda; Hui, Jane Yuet Ching
title: The New Normal? Patient Satisfaction and Usability of Telemedicine in Breast Cancer Care
date: 2021-07-17
journal: Ann Surg Oncol
DOI: 10.1245/s10434-021-10448-6
sha: ab541cd50e2d7e4c604abb6294006d8f6e64d761
doc_id: 741631
cord_uid: pl6bld4i

BACKGROUND: Telemedicine was adopted to minimize exposure risks for patients and staff during the coronavirus disease 2019 pandemic. This study measured patient satisfaction and telemedicine usability in breast cancer care. METHODS: Adult breast cancer patients who had a telemedicine visit at a single academic institution (with surgical, radiation, or medical oncology) from 15 June 2020 to 4 September 2020 were surveyed anonymously. Patient and cancer characteristics were collected, and patient satisfaction and telemedicine usability were assessed using a modified Telehealth Usability Questionnaire with a 7-point Likert scale. Associations of satisfaction and usability with patient characteristics were analyzed using Wilcoxon rank-sum and Kruskal–Wallis tests. RESULTS: Of 203 patients who agreed to be contacted, 78 responded, yielding a response rate of 38%. The median age of the respondents was 63 years (range 25–83 years). The majority lived in an urban area (61%), were white (92%), and saw a medical oncologist (62%). The median patient satisfaction score was 5.5 (interquartile range [IQR] 4.25–6.25). The median telemedicine usability score was 5.6 (IQR 4.4–6.2). A strong positive correlation was seen between satisfaction and usability, with a Spearman correlation coefficient (ρ) of 0.80 (p < 0.001). Satisfaction and usability scores did not vary significantly according to patient age, race, location of residence, insurance status, previous visit commute time, oncology specialty seen, prior telemedicine visits, or whether patients were actively receiving cancer treatment. CONCLUSIONS: Breast cancer patients were satisfied with telemedicine and found it usable. Patient satisfaction and telemedicine usability should not limit the use of telemedicine in future post-pandemic breast cancer care. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1245/s10434-021-10448-6.

between satisfaction and usability, with a Spearman correlation coefficient (q) of 0.80 (p \ 0.001). Satisfaction and usability scores did not vary significantly according to patient age, race, location of residence, insurance status, previous visit commute time, oncology specialty seen, prior telemedicine visits, or whether patients were actively receiving cancer treatment. Conclusions. Breast cancer patients were satisfied with telemedicine and found it usable. Patient satisfaction and telemedicine usability should not limit the use of telemedicine in future post-pandemic breast cancer care.

Coronavirus disease-2019 (COVID-19) has prompted health systems to rethink how health care can be delivered in a safe and effective way. To mitigate the risk of COVID-19 transmission between patients, physicians, and nonphysician providers, many health systems have rapidly expanded their use of telemedicine. [1] [2] [3] Policy changes have further supported this transition in care delivery, namely, relaxation of technology requirements for virtual communication platforms, temporary expansion of recommended telemedicine use cases, and ability of health systems to bill telemedicine services as if they were performed in person. 4, 5 Accompanying this temporary expansion in virtual care has been a surge in the literature critically assessing the long-term utility of telemedicine within various care disciplines and patient populations. [6] [7] [8] [9] [10] [11] The use of telemedicine in oncologic care is of particular interest for two primary reasons. First, patients with cancer often are immunocompromised from their cancer or the treatments they receive, such as chemotherapy or corticosteroids. 12 Second, patients with cancer, by the nature of their care, have a high number of interactions with the health care system, increasing their risk of exposure. 13 Data suggest that patients with cancer may be at increased risk of SARS-CoV-2 infection and severe manifestations of COVID-19. [14] [15] [16] However, consideration of telemedicine as a long-term option in oncologic care extends beyond infection risk reduction. For a population in which 35-45% of all patients with cancer experience psychological distress secondary to their cancer diagnosis and course of care at baseline, additional distress caused by a new approach to care delivery may be unfavorable. [17] [18] [19] Thus, assessment of patient-centered metrics such as satisfaction and usability is of high importance.

Given the growing prevalence of telemedicine secondary to the COVID-19 pandemic and the importance of telemedicine in oncologic care, our study aimed to assess patient satisfaction and usability of telemedicine in the breast cancer patient population to determine the role of telemedicine in future post-pandemic breast cancer care.

A cross-sectional study of adult ambulatory patients with breast cancer was conducted using an anonymous survey to assess patient satisfaction and usability of telemedicine. The study participants were patients from a single academic institution in Minnesota. Eligible patients were informed of the survey study by their physician at the conclusion of their telemedicine appointment and given the opportunity to participate in the study. The patients opting to participate were sent a link to an electronic informed consent form and survey by email using the Research Electronic Data Capture (REDCap) system through the University of Minnesota within 2 days after their appointment. 20 If a participant did not complete the survey after the first email, no secondary attempts were made to prompt survey completion. Data collection occurred in a 12-week period during the COVID-19 pandemic, from 15 June 2020 to 4 September 2020.

The study enrolled adult English-speaking patients with a former or current breast cancer diagnosis who currently were using telemedicine for health care visits with a surgical oncologist, medical oncologist, and/or radiation oncologist consenting to participate in the survey study. Patients who had telemedicine appointments with physicians of different oncologic subspecialties during the study period were eligible to complete the survey multiple times.

The primary end point of the study was patient satisfaction with telemedicine, and the secondary end point was the usability of telemedicine. Both end points were assessed independently and in relation to patient demographic data (age, sex, race/ethnicity, urban vs urban cluster vs rural residence), health care coverage, telemedicine visit characteristics (first or subsequent visit with a physician, presence of an active health concern during the visit, presence of connectivity issues during the visit, subspecialty of the physician, telemedicine appointment frequency and type, technological barrier to first-time use of telemedicine), cancer and treatment characteristics (time since diagnosis, stage, completed/current/planned therapies), and prior cancer care delivery statistics (in-person appointment frequency and commute time).

We created an anonymous survey consisting of 40 questions divided into four sections: demographics (6 questions), visit history (11 questions), cancer history and treatment (6 questions), and telemedicine experience (17 questions) (see Supplementary File for the survey questions). The Telemedicine Experience section contained questions adapted from the Telehealth Usability Questionnaire (TUQ), a validated survey tool developed and designed by Parmanto et al. 21 to assess the primary and secondary end points. The survey items in the Telemedicine Experience section used a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree).

The participants selected their level of agreement with provided statements on usefulness, ease of use and learnability, interface quality, interaction quality, reliability, satisfaction, and future use. The primary end point was based on an overall score from the ''reliability'' and ''satisfaction and future use'' subcategories of our survey, and the secondary end point was based on an overall score from the ''usefulness,'' ''ease of use and learnability,'' ''interface quality,'' and ''interaction quality'' subcategories of our survey.

For each participant, a composite score representing the mean numeric score from the 7-point scale of the patient satisfaction (primary end point) survey items was calculated. The composite scores across multiple participants were summarized using the median and interquartile range (IQR). The same process was repeated for the telemedicine usability (secondary end point) survey items.

The statistical analysis used non-parametric methods to relate these scores to patient, visit, cancer, and treatment factors. Comparisons between two or more groups were performed using the Wilcoxon rank-sum test or the Kruskal-Wallis test. The Spearman rank correlation coefficient was used to assess the association between the primary and secondary end points.

All p values lower than or equal to 0.05 were considered statistically significant. The statistical analysis was performed using SAS (version 9.4) software. The study protocol was reviewed and approved by the University of Minnesota Institutional Review Board. All the survey participants provided written consent before survey participation. They could exit and close the survey at any time, although the responses already provided were included in the analysis.

Of 783 eligible patients, 310 were screened for participation. Of these 310 patients, 203 opted in to receive the survey, and 78 patients responded, yielding a response rate of 38.4%. The survey was completed by 75 respondents, and they were included in the final analysis ( Fig. 1 ).

The survey participants had a median age of 63 years. The participants were predominately white (91.9%), resided in an urban area (61.3%), and were insured privately and/or through Medicare (84.7%). Most of the participants had breast cancer diagnosed more than 12 months before their appointment (60.8%), and more than half of the participants (56.7%) had already completed all elements of therapy (Table 1) . Regarding specific treatments, most of the participants had already undergone surgical resection (85.3%) and had completed radiation therapy (62.7%), with many also having completed or still receiving chemotherapy (49.4%).

The prior experience of the participants with telemedicine was minimal. Most had attended fewer than two telemedicine visits in the past (58.1%). During the telemedicine visit, most of the patients did not report any connection trouble (61.3%). The majority of the patients had a specific health issue to discuss (56%), were seen at a return visit (93.3%), and had a visit with a medical oncologist (62.7%) ( Table 2) .

The median patient satisfaction scores were 5. . 2) . Furthermore, the patient satisfaction scores also showed no association with visit characteristics such as oncologist subspecialty (p = 0.129), history of care with the oncologist (p = 0.492), and presence of a problem to discuss at the telemedicine visit (p = 0.808). However, the presence of connection trouble was significantly related to a change in patient satisfaction (p = 0.048). Specifically, patients who encountered connection issues and were able to resolve them to continue the visit expressed lower satisfaction ( Table 4 ).

The median telemedicine usability scores were 5.6 (IQR 4.4-6.2) overall and 5.4 (IQR 3.2-5.8) among respondents seeing a surgical oncologist. Differences in telemedicine usability scores were not associated with time since cancer diagnosis ( (Fig. 3) . Furthermore, usability of telemedicine scores also were not associated with visit characteristics, including the number of previous telemedicine visits attended (p = 0.834), the frequency of telemedicine visits (p = 0.268), and the need for patients to upgrade their phone, tablet, or computer in order to attend telemedicine visits (p = 0.130). However, the presence of connection trouble, either resolved or requiring a transition to a different form of visit, was associated with lower usability scores than the absence of connection trouble (p = 0.001; Table 4 ).

The 1990s saw a surge in literature assessing patient satisfaction with telemedicine across many medical disciplines spanning psychiatry, dermatology, otolaryngology, hospice, and home nursing, among others. 22 A limited number of studies then were performed to evaluate patient satisfaction with video-conference-based physician consultations exclusively in the setting of oncologic care. 23 These studies generally reported that video-conferencing was favored by patients over in-person visits. However, small study sizes, no studies specific to breast cancer patients, and the absence of a scientifically validated satisfaction or usability survey to measure satisfaction outcomes highlight where such literature is lacking. Furthermore, some of these studies were conducted during a technologically different time in which patients required The sum of the responses for each characteristic may be \ 75 due to missing survey data.

hospital-provided video-capable hardware for video-conferencing to occur. [24] [25] [26] The current era provides a stark contrast, in which telemedicine is software-based, with patients using their own devices. Since the onset of the COVID-19 pandemic and the rapid shift to telemedicine by many health systems, literature assessing satisfaction of oncologic patients with telemedicine has expanded. However, recent studies have assessed patient satisfaction across all cancer types or within a specific oncologic subspecialty such as radiation oncology, and in many cases have done so without using a validated survey tool. [27] [28] [29] [30] Our study was unique in that it assessed satisfaction and usability specifically within the breast cancer population across all oncologic subspecialties using an adapted version of the TUQ, which consists of questions compiled The p value is based on the Wilcoxon rank-sum test or the Kruskal-Wallis test . For all treatment types, the p value was higher than 0.05 from various existing survey tools with proven content validity. [31] [32] [33] All the TUQ survey subsections demonstrated ''good'' or ''excellent'' reliability as measured by Cronbach's coefficient alpha. 21 In general, our study demonstrated agreement by breast cancer patients that they are satisfied with telemedicine and find it usable, with their perceptions of satisfaction tracking similarly with their perceptions of telemedicine usability. The absence of an association between satisfaction/ The p value is based on the Wilcoxon rank-sum test or the Kruskal-Wallis test. The bold values denote statistical significance (p \ 0.05) usability with various demographic, visit, and cancer characteristics suggests the possibility that satisfaction and usability of telemedicine are both relatively stable within varying circumstances. In particular, the majority of the survey respondents were well-established breast cancer patients who either were actively receiving cancer treatments or had already completed treatment. Thus, these survey results may be most applicable in the follow-up visit setting.

We also did not observe differences in the patient satisfaction or telemedicine usability scores of the patients who had a new or ongoing problem in particular to address at the visit. This suggests that established breast cancer patients found telemedicine to be an acceptable mode of communication with their oncology physician, even when an active issue was present. Although we did not evaluate this aspect of telemedicine specifically, our electronic health record had a feature that allowed patients to send in electronic photos of their concerns (e.g., postoperative wound), allowing the physician or surgeon to remotely assess the concern or ask the patient to come in for a physical examination. Future work should include evaluation of this additional technology to enrich the characterization of telemedicine use.

When patients experienced connection trouble during their telemedicine visit, patient satisfaction and telemedicine usability scores were lower, indicating that technical difficulty may be a significant factor contributing to poorer patient perceptions of telemedicine satisfaction and usability. However, the need for technological devices (i.e., phone, tablet, or computer) did not seem to correlate with patient satisfaction or telemedicine usability, at least among the survey respondents who likely were inherently more ''savvy'' technologically because they had to respond to an electronic survey invitation and were willing to complete the survey online.

This survey study had several limitations. The study was conducted during the COVID-19 pandemic when in-person visits largely had ceased. Thus, we did not have the opportunity to compare the survey results with a control group of in-person visits. Relatedly, our data represents patient satisfaction and usability of telemedicine at one point in time within the context of a pandemic, and therefore may not be representative of satisfaction and usability in non-pandemic conditions. Our study was conducted a few months after the onset of the pandemic and after the adoption of telemedicine, which hopefully minimizes some of the technological difficulties inherent in navigating a brand new system, making the results more applicable to a post-pandemic world. Because telemedicine likely will continue to be a part of health care delivery, even after the pandemic, future work should include a comparison between telemedicine and in-person visits.

The study was anonymized to improve respondent recruitment, but due to the anonymous nature of the survey, no second attempt for a survey invitation could be sent if the patient did not respond, nor could a follow-up survey be completed at a later time during the COVID-19 pandemic. Furthermore, because a given patient could be invited to participate in the survey through different subspecialities, some individuals may have completed the survey more than once. Due to the anonymity of the survey, it was not possible to detect or account for these individuals.

Study size also was a limitation. We observed a high attrition rate, with only 75 respondents completing the survey despite distribution of the survey to 203 of the 310 initially screened patients who had agreed to be contacted about the study.

The study participants represented a small sample of patients with breast cancer of limited diversity. The respondents were predominately white and from one geographic area within a single health system. Non-Englishspeaking patients were excluded, and by default, those without Internet access or possession of electronic devices capable of connecting to a telemedicine visit also were excluded. Thus, the study design itself likely introduced a selection bias of breast cancer patients who were inherently more likely to be satisfied with telemedicine and to find telemedicine usable. Furthermore, the effect of disparities among this sample of the breast cancer patient population is unknown. The absence of baseline data defining usage of telemedicine by various demographic groups introduced ambiguity surrounding whether the selection bias in our study was founded on inequity in telemedicine access, inequity in access to an online survey, reluctance to complete a survey, or any combination thereof. Our study measured telemedicine as either a video or a phone visit, and it did not examine the primary and secondary end points relative to visit, cancer, or treatment characteristics (i.e., postoperative visit vs preoperative visit, time since cancer diagnosis) within each oncologic subspecialty. This leaves the opportunity for future work to delineate the potential relationship of various telemedicine methods to patient satisfaction and usability. It also sets the stage for future work to explore how visit and treatment characteristics influence patients' perceptions of telemedicine across oncologic subspecialties in breast cancer care.

Finally, we recognize that oncology patients, particularly those with a new diagnosis, have unique psychosocial needs. We did not specifically evaluate patients' perceptions of telemedicine in this context. Additional study that includes anxiety and depression screening of in-person and telemedicine cohorts is needed to determine the usability of telemedicine in addressing the unique psychosocial needs of established and new oncology patients.

Despite the aforementioned limitations, the current study captured the adoption of telemedicine from the breast cancer patient perspective. Looking to the future, health care systems need to continue adjusting and normalizing operations to ensure the safety and well-being of patients, physicians, and non-physician providers while also prioritizing care delivery options that meet the needs of patients. In this light, we believe our study provides valuable context to such discussions, specifically within the realm of breast cancer care, bringing into focus what matters most in characterizing the role of telemedicine in health care moving forward. 

Telehealth transformation: COVID-19 and the rise of virtual care

COVID-19 and telemedicine: a revolution in healthcare delivery is at hand

Telemedicine and the COVID-19 pandemic: lessons for the future

Medicare telemedicine health care provider fact sheet

Department of Health and Human Services Office for Civil Rights. FAQs on telehealth and HIPAA during the COVID-19 nationwide public health emergency

Telemedicine in liver disease and beyond: can the COVID-19 crisis lead to action?

Virtual ophthalmology: telemedicine in a COVID-19 era

Mapping the evidence on the effectiveness of telemedicine interventions in diabetes, dyslipidemia, and hypertension: an umbrella review of systematic reviews and meta-analyses

Telemedicine to follow patients in a general surgery department. A randomized controlled trial

Telemedicine in orthopaedic surgery: challenges and opportunities

Surgical telemedicine here to stay: more support from a randomized controlled trial on postoperative surgery visits

Chemotherapy-induced immunosuppression and reconstitution of immune function

A war on two fronts: cancer care in the time of COVID-19

Clinical characteristics of COVID-19-infected cancer patients: a retrospective case study in three hospitals within Wuhan

SARS-CoV-2 transmission in patients with cancer at a tertiary care hospital in Wuhan, China

Cancer patients in SARS-CoV-2 infection: a nationwide analysis in China

High levels of untreated distress and fatigue in cancer patients

Cancer distress screening: needs, methods, and models

The prevalence of psychological distress by cancer site

Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support

Development of the telehealth usability questionnaire (TUQ)

Systematic review of studies of patient satisfaction with telemedicine

How effective is video consultation in clinical oncology? A systematic review

Patients' perceptions of a telemedicine specialty clinic

A pilot study of tele-oncology in Scotland

Patient satisfaction with teleoncology: a pilot study

Telemedicine in radiation oncology: is it here to stay? Impacts on patient care and resident education

Impact of telemedicine on patient satisfaction and perceptions of care quality in radiation oncology

Satisfaction among cancer patients undergoing radiotherapy during the COVID-19 pandemic: an institutional experience

Abstract SS2-09: telemedicine usability for cancer care during the COVID-19 pandemic

Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire

IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use

Development of the Telemedicine Satisfaction Questionnaire to evaluate patient satisfaction with telemedicine: a preliminary study

Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations