key: cord-0715514-6ui4sed6 authors: Lawford, Belinda J; Hinman, Rana S; Morello, Renata; Oliver, Kathryn; Spittle, Alicia; Bennell, Kim L title: Perceptions about the efficacy and acceptability of telephone and video-delivered allied healthcare for adults with disabilities during the COVID-19 pandemic: a cross-sectional national survey date: 2022-01-15 journal: Arch Phys Med Rehabil DOI: 10.1016/j.apmr.2021.12.017 sha: dbc831fec4985fe794903bef11fd7bb586d15c72 doc_id: 715514 cord_uid: 6ui4sed6 Objective Investigate and compare perceptions about the efficacy and acceptability of allied healthcare delivered via telephone and video call for adults with disabilities during the COVID-19 pandemic. Design Cross-sectional national survey. Setting Participants who accessed occupational therapy, physiotherapy, psychology, or speech pathology care via telephone or via video call in June – September 2020. Participants Adults with permanent or significant disabilities, or their carers/partners/family members, who were funded by the Australian National Disability Insurance Scheme. Interventions NOT applicable. Main outcome measures Experiences (e.g., safety, efficacy, and ease of use) with telephone and video-delivered care. Data were analysed by calculating response proportions and Chi-square tests to evaluate differences in experiences between allied health professions and between telephone and video modalities. Results Responses were obtained for 581 adults with disabilities. There was no evidence of differences between experiences with telephone or video-delivered services, or across allied health professions. Overall, between 47-56% of respondents found telehealth technology easy to use (versus 17-26% who found it difficult), 51-55% felt comfortable communicating (versus 24-27% who felt uncomfortable), 51-67% were happy with the privacy/security (versus 6-9% who were unhappy), 74% were happy with the safety (versus 5-7% who were unhappy), and 56-64% believed the care they received was effective (versus 17% who believed it was ineffective). Despite this, 48-51% were unlikely to choose to use telephone or video consultations in the future (versus 32-36% who were likely). Conclusion Adults with disabilities in Australia had generally positive experiences receiving allied healthcare via telehealth during the COVID-19 pandemic, though some experienced difficulties using, and communicating via, the technology. Findings indicated no differences between satisfaction with telephone or video modalities, or between physiotherapy, speech pathology, occupational therapy, or psychology services. Over the past decade, evidence to support the effectiveness of telehealth in allied healthcare has been growing, including in physiotherapy [6, 7] , speech pathology [8] [9] [10] , psychology [11, 12] , and occupational therapy [13] disciplines. There is also evidence to support the acceptability of telehealth within these professions [14] [15] [16] [17] [18] [19] . Due to their complex health needs, people with disabilities are among the highest users of allied healthcare [20] . There is some evidence that telehealth services are clinically equivalent to traditional in-person services amongst those with stroke [21] , traumatic brain injury [22] , neurodevelopmental disorders [23] , and autism [24] [25] [26] . However, most of these existing studies have been conducted in the research setting, often as part of a clinical trial. As such, it is not clear whether the existing evidence reflects user experiences with telehealth in 'real-world' settings. Prior to the COVID-19 pandemic, implementation of telehealth services by allied health professions was limited, primarily due to the lack of patient willingness and limited thirdparty funding for such services [27] . The rapid pivot to telehealth during the pandemic has thus provided a unique opportunity to evaluate experiences with telehealth outside of the research setting. Many studies have done so in the general population [5, [28] [29] [30] [31] [32] ], yet only two have done so in people with disabilities [33, 34] . Although these two studies examined experiences with telehealth across a range of allied health professions (including physiotherapists, occupational therapists, speech therapists, psychologists, physicians, and podiatrists), none compared experiences between different professions. As such, it is not clear whether there are some professions where healthcare is more suited to telehealth delivery than others within this population. In addition, to our knowledge, studies examining the use of telehealth for people with disabilities have focused exclusively on children and youths [33, 34] , and so it is not clear whether experiences among adults with disabilities may differ. The limited research evaluating the experiences of people with disabilities using telehealth during the pandemic has focused exclusively on video calls [33, 34] , and no studies have examined experiences with services delivered via telephone. People with disabilities have unique and complex needs, and they may experience more difficulty communicating or accessing/using more complex technologies (e.g. videoconferencing software) than the general population [35, 36] . There is also evidence that people with disabilities use internet services less often and are less likely to own computers, smart phones, or tablets than those without disabilities [35] . Therefore, the delivery of care via more simple non-internet modalities (e.g., telephone) might be more acceptable in this population, or, conversely, the lack of visual contact may make it harder to receive optimal care. However, to our knowledge, no previous studies have directly compared experiences between telephone and video-delivered services in people with disabilities, and no previous studies have evaluated differences in experiences based on demographic variables (e.g., age, geographical remoteness). This study aimed to investigate and compare perceptions about the efficacy and acceptability of different allied healthcare services delivered via telephone and via video call for adults with disabilities during the COVID-19 pandemic. We conducted a descriptive, cross-sectional online national survey. Survey participants were recruited from June 2020 and the survey was closed in September 2020. To be eligible, participants had to have a permanent or significant disability and be funded by the National Disability Insurance Scheme (NDIS) in 2020 , or be a family member, partner, or carer of a person with a disability who is funded by the NDIS. The NDIS is a government-funded scheme that supports more than 391,000 Australians with permanent and significant disabilities by providing access to support workers, assistive equipment/technology, and/or funding for disability-related allied healthcare services and supports [37] . Only data from adults (aged 19 years and over, based on the age categories included in the survey) who had received care via telehealth from a physiotherapist, occupational therapist, psychologist, or speech pathologist during from June to September 2020 were included in this manuscript. Complete data from the survey have been published The NDIS facilitated participant recruitment through advertisements on their website, social media, and newsletters, as well as through invitations sent to peak bodies and advocacy groups. Participants were also recruited via social media advertisements by the Centre for Health, Exercise and Sports Medicine. We aimed aimed to recruit as many participants as possible during the recruitment period of four months with a minimum recruitment target of 384 participants. There are approximately 400,000 NDIS participants in Australia, so this target (approximately 0.01% of 400,000) was deemed to be highly achievable. As this is a descriptive study, formal power calculations were not required. However, precision-based sample size calculations showed a target sample size of 384 provides a precision of +/-5% for the two-sided 95% confidence interval of the true underlying proportion of participants who report agreement with a particular statement when assuming a proportion of 50% (i.e., [45% to 55%]) and using the Wald method to measure the 95% confidence interval [39] . The study was approved by the University Human Research Ethics Committee. All participants provided informed consent by ticking a box at the start of the survey confirming that they had read the plain language statement and were willing to participate. Participants completed a customized online survey in Qualtrics (Provo, UT, USA) about their experiences accessing allied healthcare supports during the COVID-19 pandemic. Previous research on consumer and clinician attitudes towards telehealth [40, 41] informed the survey (Appendix 1) which was developed by members of the research team, representatives of the NDIS, and a steering committee comprising experienced researchers in occupational therapy, physiotherapy, psychology, and speech pathology. The survey underwent pilot testing with 10 NDIS participants. The survey gathered demographic data (e.g., age, sex, level of education) and information about the nature and severity of the NDIS participant's disability. The survey asked six questions, each rated on a 5-point Likert scale, about experiences with video or telephone-delivered care: i) ease of using the technology, ii) comfort communicating via the technology, iii) happiness with privacy/security, iv) safety, v) effectiveness, and vi) likeliness to use telephone/video consultations in the future. If participants had received care from more than one profession, and thus provided multiple data points, data for only one profession were randomly chosen (using Microsoft Excel "RAND" function) for inclusion in this manuscript. The same procedure was followed for those who received care via both telephone and video, in that only data relating to one modality was randomly chosen. Geographic residential locations of participants were categorised by postcodes into metropolitan, regional/rural, and remote areas [42] . Data analysis was performed with the Statistical Package for the Social Sciences (SPSS, IBM corp., Version 27, Armonk USA). Descriptive statistics (frequencies and proportions) were calculated for responses to survey questions. Data relating to telehealth experiences (e.g., ease of using technology, comfort communicating etc.) were grouped into negative (two most negative response options, e.g. "very difficult" and "difficult"), neutral (e.g. "neither easy nor difficult"), and positive (e.g., "easy" and "very easy") responses. Response distributions were described as n (%) with 95% confidence intervals (CI) calculated around proportions. To compare experiences across allied health professions, 4x3 Chi-square tests were performed in SPSS for both the telephone and video modalities across the six survey questions. To compare experiences across telephone and video (pooled across all allied health professions), 2x3 Chi-square tests were performed for each of the six survey questions for telephone and for video. Subgroup analyses were also performed using 2x3 Chi-square tests to investigate whether experiences differed by age, geographical remoteness, and by level of assistance needed to communicate. Responses to two survey questions for telephone and video services (pooled across all allied health professions) were used: 1. How effective for your problem was the care you received from the [allied healthcare profession] via telephone/video over the internet? 2. If you needed to see an [allied healthcare profession] once the COVID-19 pandemic has ended, how likely would you be to choose to see them via telephone/video over the internet? Responses to the two questions above were analysed according to age (grouped into 19-34 years, 35-55 years, 55+ years), geographical remoteness (grouped into metropolitan, regional/remote/rural), and whether assistance is needed to communicate (grouped into yes or no). Due to the number of Chi-square tests being performed, an alpha of 0.01 was used. For Chi-square tests that were significant (p<0.01), adjusted residuals were calculated to identify the cells of difference. Given the large range of disabilities included in our survey (17 different types), the very small numbers within each subgroup meant we were unable to complete subgroups analyses for type of disability. The survey was completed by 581 people, most (58%) of whom were the person with the disability, with the other 42% being carers/parents completing the survey on behalf of the person with the disability. Characteristics of participants are shown in Table 1 . More were female (65%), and lived in a metropolitan area of Australia (66%). The most common disability represented was autism (20%). Many participants required help from people or special equipment/assistive technology (or both) to move around (65%) and to communicate (52%). Around three-quarters (73%) had no previous experience with telehealth. Table 2 and Figure 1 and 2 show participant experiences with telehealth. Overall, across each allied health profession and across telephone and video, around three-quarters felt safe during the consultation (74%) and two-thirds were happy with the privacy/security of the consultation (61-67%). Around half found the technology easy to use (47-56%), were comfortable communicating via technology (51-55%), and believed the care they received was effective (56-64%). Around one-third (32-36%) were likely to choose to see their allied health profession via telehealth after the pandemic. A minority were unhappy with the privacy/security of the consultation (6-9%) and felt unsafe during the consultation (5-7%). Around one-fifth found it difficult to use the technology (17-26%) and believed the care that they received was ineffective (17%). Around one-quarter (24-27%) felt uncomfortable communicating via technology. Around half (48-51%) were unlikely to choose to see their allied health profession via telehealth after the pandemic. Table 2 and Figure 1 and 2 show participant experiences with telehealth delivered via telephone and video and across the four allied health professions. There were no differences in proportions of positive, neutral, and negative responses between telephone and video, or between each of the allied health professions (p>0.01 for all comparisons). Table 3 shows experiences with telehealth across subgroups of participants (by remoteness, age, and whether assistance is needed to communicate). Results of Chi-square tests indicated that those who did not need help communicating were more likely to be neutral about seeing their allied health profession via telephone after the pandemic, compared to those who did need help communicating (23% versus 9%, respectively [p=0.009]). There was no evidence of other differences in response proportions between subgroups (p>0.01 for all). This study aimed to investigate and compare experiences with different allied healthcare services delivered via telephone and via video for adults with disabilities during the COVID-19 pandemic. We found that most reported positive experiences using telehealth, though some experienced challenges using, and communicating via, the technology. There were no differences between experiences with telephone or video modalities or across the different allied health professions evaluated. To our knowledge, this is the first study in people with disabilities to compare experiences with telehealth via telephone and video. Our findings are broadly comparable to others that have focused solely on experiences with video. For example, previous studies have found that video-delivered services (including psychology, occupational therapy, speech pathology, and physiotherapy) were perceived by users to be effective and felt comfortable communicating [33, 43-48], though some technical difficulties were experienced, and users believed that telehealth should not replace in-person care [44, 46] . Our findings can also be compared to other studies investigating the experiences of people without disabilities who have accessed allied healthcare via telephone and video. In physiotherapy, a survey investigating perceptions towards telephone and video-delivered care amongst people with osteoarthritis found that respondents favoured video, particularly in terms of its perceived effectiveness, usefulness, and acceptability [41] . In contrast, however, a more recent study investigating the experiences of the general population (i.e. not specifically targeting those with disabilities) who consulted with occupational therapists and speech pathologists via telehealth during the COVID-19 pandemic found no differences in experiences with telephone and video-delivered services [31] . There is some evidence from general practice medicine that telephone and video consultations are similar in terms of consultation length, content, and quality [49] , and that there is little difference between the two modalities in terms of patient outcomes or satisfaction [50] . Collectively, these findings suggest that the telephone is an equally satisfactory telehealth modality as video, but likely depends on the individual preferences and requirements of each patient, as well as the availability of technology. However, despite the positive experiences that were reported, many still indicated an unwillingness to use telephone and video services in the future. From our survey alone, it is not clear why this is. Further qualitative research is needed to better understand why adults with disabilities may be unwilling to use telehealth services in the future, despite positive experiences. To our knowledge, this is the first study to compare experiences with telehealth across different allied health professions in adults with disabilities. A recent study investigating experiences with telehealth (not specifically targeting those with disabilities) compared experiences across different allied health professions (including occupational therapy and speech pathology), finding that experiences largely did not differ between professions [31]. Another recent COVID-19 survey of experiences of patients who consulted via telehealth with exercise physiologists, physiotherapists, psychologists, or speech pathologists found that there were no differences in experiences and satisfaction across professions [51] . Further research into the acceptability and efficacy of telehealth for adults with disabilities across different allied healthcare professions is needed to determine the suitability of such services in the longer term, and also to investigate experiences and perceptions from the perspective of the clinicians delivering the service [5] . It is somewhat surprising that we found telephone and video services to be equally acceptable to patients receiving care from traditionally 'hands-on' allied healthcare professions like physiotherapy, speech pathology, and occupational therapy. It might be assumed that video modalities may be more appropriate for these professions, given that care often involves prescription of an exercise program or observation of the body/mouth, though this is not what our findings indicated. In fact, around half of surveyed participants used telephone modalities for occupational therapy (55%) and physiotherapy (44%), though only one-fifth did so for speech pathology (21%). Given we did not collect data on the type of care that participants received via telehealth, it is not clear whether care was modified depending on the modality (e.g., whether exercise was only prescribed via video and not telephone). A recent study examining telehealth use by allied healthcare clinicians (predominantly physiotherapists, but also a small number of occupational therapists) for the general population during the pandemic found that the frequency of use of exercise, education, and physical activity did not differ from what is normally provided during in-person-person consultations [4] . However, as data were pooled, it is not clear whether there were differences between telephone and video modalities. Other research has found that exercise can be effectively provided by physiotherapists via telephone for people with osteoarthritis [52], and is also perceived to be acceptable by the patients and clinicians involved [17, 18] . Similarly, a scoping review of telehealth-delivered occupational therapy found that the modality used (telephone vs video) did not directly affect clinical outcomes of care [53], though, to our knowledge, no previous research has specifically evaluated telephone-delivered care in speech pathology. Although participants in our study had generally positive experiences with telehealth overall, comparison with studies involving the general population suggest that those with permanent and significant disabilities experience unique barriers to such models of service delivery. Our related survey in 388 people (not specifically targeting those with disabilities) who consulted with allied healthcare professions via telehealth during COVID-19 [31] utilised a very similar survey design to this study. Comparison between findings of the two studies indicates that those with permanent and significant disabilities appear to be less satisfied with telehealth than those in the general population. For example, less than 9% of participants within the general population study found the technology difficult to use, felt uncomfortable communicating, or believed that they care they received was ineffective. This contrasts with this study in people with disabilities, where between 19-27% of participants found the technology difficult to use, felt uncomfortable communicating, or believed the care they received was ineffective. One barrier to healthcare that already exists among people with disabilities is difficulties communicating [54, 55], which may become even more apparent when consulting with a clinician via technology. Some people with disabilities (e.g. vision, sensory/speech, or neurological impairments) may also experience difficulties operating the hardware or user interface or of telehealth software [36], with issues relating to screen readers, sign language, captions, magnification, colour, and contrast of displays. Many technical and accessibility issues with telehealth may improve with time as these technologies become better established, however the development of specialised interfaces may be required to ensure people with disabilities can easily, and effectively, use telehealth technologies. Our findings suggest that a range of adults with disabilities, including those of various ages and those living in metropolitan and regional areas, have positive experiences using telehealth to access their allied health professional. This reflects findings of a previous study investigating moderators of treatment outcomes after a telehealth self-management and education intervention from psychologists and social workers in people with multiple sclerosis, which found that demographic variables (including age, sex, and education) were not associated with perceived treatment effectiveness, concluding that the telehealth program was suitable for a broad range of people [56] . Given that almost half (42%) of our cohort were parents/carers of someone with a disability, it is possible that their experiences with telehealth differed from those who they were caring for with the disability. It is also unclear whether carers were assisting the person with the disability to complete the survey, or whether they were responding based on their own perceptions about operating or facilitating telehealth consultations for the person with the disability. Future research should examine whether parents/carers have different experiences with telehealth than the actual patient with the disability, and also evaluate whether there are differences in experiences between different types of disability (e.g., physical disability versus psychosocial disability). Our findings have implications for the future design and delivery of telehealth services for adults with disabilities. Findings suggested that participants had similar experiences using the telephone and video for their allied healthcare, suggesting that both modes of service delivery may be suitable for, and acceptable to, people with disabilities, depending on their individual needs and preferences. Our findings suggest that around one-third of adults with disabilities would be interested in using such services beyond the pandemic. Given that telehealth delivery is likely to become increasingly common beyond the pandemic, uptake of telehealth services will likely further increase as services become more mainstream. Although our findings suggest that telehealth services are broadly acceptable to most, further consideration regarding ease of use and communication issues is needed. In addition, our findings suggest that telehealth services are acceptable to people in metropolitan as well as regional/remote areas, which is an important finding, as it is often thought that telehealth is of most relevance to those who reside outside of metropolitan areas. Only those who were supported by the NDIS and were living in Australia were eligible to participate, so our findings may not be generalisable to those who are not part of the NDIS, those residing in other countries with other disability support schemes in place, or to people with mild disability. In addition, given our wide inclusion criteria (any NDIS participant who had received at least one allied healthcare consultation via telehealth during the pandemic), the individual circumstances of each participant, and the purpose of their telehealth consultation/s, likely varied, so our findings may not necessarily be generalisable to specific situations or scenarios. The fact that our survey was only available online means that our findings may be biased towards those who are already comfortable using technology, and therefore the perceptions of those with lower digital literacy may differ to those of our cohort. Our analysis involved a large number of Chi-square tests, increasing the chance for Type 1 error, though no significant differences were detected. Finally, the majority (77%) of our cohort had not used telehealth with an allied healthcare clinician before the pandemic, and their views may change with greater experience or better organised services. In conclusion, adults with disabilities in Australia had generally positive experiences receiving allied healthcare via telehealth during the COVID-19 pandemic, though some experienced difficulties using, and communicating via, the technology. Findings indicated that there were no differences in satisfaction between telephone and video modalities, or between physiotherapy, speech pathology, occupational therapy, or psychology services. Individual items may not add to totals due to missing data. State of telehealth United States Census Bureau, Computer and Internet Use in the United States It's not hands-on therapy, so it's very limited': Telehealth use and views among allied health clinicians during the coronavirus pandemic Influence of the COVID-19 pandemic on telepractice in speech-language pathology Effectiveness of an internet-delivered exercise and pain-coping skills training intervention for persons with chronic knee pain: A randomised trial Real-time telerehabilitation for the treatment of musculoskeletal conditions is effective and comparable to standard practice: A systematic review and meta-analysis International survey of audiologists' attitudes toward telehealth Randomized controlled trial of a multisite speech pathology telepractice service providing swallowing and communication intervention to patients with head and neck cancer: Evaluation of service outcomes The efficacy of telehealth-delivered speech and language intervention for primary school-age children: a systematic review Using videoconferencing to deliver individual therapy and pediatric psychology interventions with children and adolescents Telehealth and Depression: A meta-analysis, in University Presentation Showcase Event The use of telehealth in pediatric occupational therapy Systematic review of patient and caregivers' satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients' health Patient perceptions of telemental health: Systematic review of direct comparisons to in-person psychotherapeutic treatments Patient and clinician experiences with telehealth for patient (7) 6 (6) 0 (0) 0 (0)