key: cord-0865940-cp5iow9t authors: Perry, A.; Chitnis, A.; Chin, A.; Hoffmann, C.; Chang, L.; Robinson, M.; Maltas, G.; Munk, E.; Shah, M. title: Real-world implementation of video-observed therapy in an urban TB program in the United States date: 2021-08-01 journal: Int J Tuberc Lung Dis DOI: 10.5588/ijtld.21.0170 sha: bceae603c08d9029fa4e324a723c2667e6c18d0e doc_id: 865940 cord_uid: cp5iow9t BACKGROUND: Video directly observed therapy (vDOT) was introduced to increase flexibility and meet patient-specific needs for TB treatment. This study aimed to assess the reach and effectiveness of vDOT for TB treatment under routine conditions in Alameda County, CA, USA, a busy, urban setting, from 2018 to 2020. METHODS: We prospectively evaluated routinely collected data to estimate 1) reach (proportion of patients initiated on vDOT vs. in-person DOT); and 2) effectiveness (proportion of prescribed doses with verified administration by vDOT vs. in-person DOT). RESULTS: Among 163 TB patients, 94 (58%) utilized vDOT during treatment, of whom 54 (57%) received exclusively vDOT. Individuals receiving vDOT were on average younger than those receiving in-person therapy (46 vs. 61 years; P < 0.001). The median time to vDOT initiation was 2.2 weeks (IQR 1.1–10.0); patients were monitored for a median of 27.0 weeks (IQR 24.6–31.9). vDOT led to higher proportions of verified prescribed doses than in-person DOT (68% vs. 54%; P < 0.001). Unobserved self-administration occurred for all patients on weekends based on clinic instructions, but a larger proportion of doses were self-administered during periods of in-person DOT than of vDOT (45% vs. 24%; P < 0.001). CONCLUSION: A TB program successfully maintained vDOT, reaching the majority of patients and achieving greater medication verification than in-person DOT. (46 vs. 61 years; P , 0.001). The median time to vDOT initiation was 2.2 weeks (IQR 1.1-10.0); patients were monitored for a median of 27.0 weeks (IQR 24.6-31.9). vDOT led to higher proportions of verified prescribed doses than in-person DOT (68% vs. 54%; P , 0.001). Unobserved self-administration occurred for all patients on weekends based on clinic instructions, but a larger proportion of doses were self-administered during periods of in-person DOT than of vDOT (45% vs. 24%; P , 0.001). C O N C L U S I O N : A TB program successfully maintained vDOT, reaching the majority of patients and achieving greater medication verification than in-person DOT. K E Y W O R D S : medication adherence; telemedicine; tuberculosis; vDOT TB is the leading cause of infectious disease death globally and poses significant burden to individual and public health. 1, 2 While TB is treatable and curable, treatment requires taking several medications for extended durations. 1, 3, 4 Directly observed therapy (DOT) has become the standard of care and codified into law in parts of the United States. [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] Current Centers for Disease Control and Prevention/ Infectious Diseases Society of America/American Thoracic Society (CDC/IDSA/ATS) treatment guidelines recommend utilizing DOT as part of a comprehensive, patient-centered approach to TB case management; however, DOT may present challenges in scheduling and resources. [15] [16] [17] [18] [19] Thus, while TB guidelines recommend daily therapy for 7 days a week, many health departments dose or verify TB medications during business days or intermittently, given the typical logistical challenges. 19, 20 An emerging approach to provide patient-centered treatment verification is video DOT (vDOT). 7, 19, 21 vDOT utilizes technological advancements to facilitate DOT for patients remotely through computer or mobile devices, in real-time (synchronous) or recorded (asynchronous). 19, 22 Previous trials evaluating the effectiveness of vDOT have been promising, reporting high adherence rates as compared to in-person DOT. 16, 22, 23 vDOT has been adopted for routine use in the United States, with almost half of TB programs having used vDOT in some capacity in 2015, and 36% planning to implement a vDOT program in the following year. 24 A previous prospective study within five health jurisdictions in California measured treatment adherence for patients using vDOT vs. traditional DOT under study conditions. 22 This study observed a higher fraction of expected doses observed using vDOT than in-person DOT, along with high patient satisfaction and acceptability. 22 However, it has not been established whether such findings would be maintained under programmatic conditions. It is also unknown whether staff uptake and recommendations for vDOT might change with growing experience and comfort with technology. We sought to assess the reach and effectiveness of vDOT compared to in-person DOT under routine implementation in a busy, urban TB program at the Alameda County Public Health Department (ACPHD) in California, USA. We conducted a pragmatic, prospective observational evaluation of TB treatment monitoring measured by self-report, in-person DOT, and asynchronous vDOT under routine conditions at the ACPHD TB program. Our objective was to assess the reach and effectiveness of programmatic vDOT implementation utilizing the emocha Health Insurance Portability and Accountability Act-compliant mobile app (emocha Mobile Health Inc, Baltimore, MD, USA) for TB treatment monitoring under routine programmatic conditions. Protocols were approved by the ethics committees at Johns Hopkins University, Baltimore, MD, USA, and California Department of Health, Sacremento, CA, USA. We abstracted routinely collected data from patient medical records for patients receiving treatment for active TB through the ACPHD TB Control Program, who were 18 years of age and with 2 months of therapy remaining. We excluded pediatric patients as considerations for DOT and vDOT may be different in that population warranting a dedicated study; individuals with less than 2 months remaining were excluded to ensure that included participants had sufficient follow-up time to measure adherence. The program introduced vDOT as a pilot program in 2017 and officially licensed emocha software for routine usage in late 2018. We subsequently evaluated data on all patients who were in care from September 1 st , 2018 to August 31 st , 2019, with follow-up available until February 28 th , 2020. The determination of modality (i.e., self-report, vDOT, inperson DOT) was made exclusively by the health department and patient care team using locally developed protocols and in accordance with California Department of Health (CDPH) guidelines. 25, 26 The local practice, in accordance with CDPH guidance, was to consider vDOT for all patients in whom the program felt would benefit from observed therapy. 7,26. Individualized decisions on DOT modality were made by the program and the patient using a shared decision-making paradigm inclusive of patient considerations and preferences, including patient willingness and ability to participate in vDOT procedures. An initial assessment on DOT modality (in-person/field-based vs. vDOT) is made by the public health nurse (PHN), and includes factors such as willingness and interest in using technology for monitoring, degree of communication between patient and health care team, and patient preferences based on schedules, distance to clinic, and other individualized factors. There were no restrictions on timing of vDOT initiation or prerequisite demonstration of adherence prior to vDOT initiation. There were no a priori formal exclusion criteria for vDOT usage on the basis of alcohol or substance use, preferred language, or homelessness, or any other patient sociodemographic features, or microbiological criteria. After the initial PHN assessment, a Senior Program Specialist makes a secondary assessment during enrollment into TB care to determine feasibility of vDOT and in-person DOT. Patients and providers are free to switch DOT modalities (inperson to vDOT, and vice versa) at any time based on individual circumstances. All patients received case-management and treatment decisions per routine protocols irrespective of DOT modality; this included case-management phone calls or visits following missed doses or reported side effects. Treatment decisions were clinician-directed according to CDPH and CDC guidelines. 15, 25, 26 Drug regimens generally rely on daily dosing 7 days per week. The ACPHD defined treatment completion and success based on ingesting a set number of target doses. Any missed doses were added to the end of therapy, extending treatment duration. Existing management protocols were in place during the evaluation period and developed by the local health department for routine programmatic purposes. The ACPHD protocol combined DOT 5 days per week (i.e., Monday to Friday), irrespective of inperson or vDOT, with weekend and holiday selfadministration. Some patients submitted additional videos on weekends at their own discretion or at direction of staff in instances when weekday doses were missed; public health program staff 'accepted' or 'rejected' these additional video submissions according to local practice. Due to the focus on confirming observations only Monday to Friday, staff generally rejected any additional weekend video submissions unless there had been a missed weekday dose; consequently, local practice was focused on confirming adherence for 5 of 7 days of the week. Patients using vDOT were sent twice daily text message reminders in the absence of submitted videos and were prompted to document side effects prior to submissions. All patient data, servers, and transmissions were encrypted to protect patient privacy. At the time of study, the vDOT/DOT coordinator, and occasionally one other public health investigator, reviewed videos within 1 business day. We assessed the verified fraction, or proportion of total prescribed doses (inclusive of weekends, holiday, or other 'self-administered' doses) that were verified by observation (in-person or by video); 16, 22 time periods (e.g., weeks) were assessed as 'in-person' or 'vDOT' based on scheduled DOT modality. We also captured the proportion of prescribed doses that were self-administered during weeks monitored using vDOT vs. in-person DOT. We also measured maximum adherence, or the proportion of total prescribed doses taken under the assumption that all selfadministered doses were ingested (along with verified observed doses). Differences in clinical and demographic characteristics comparing in-person DOT and vDOT were evaluated using two-sample t-tests and v 2 tests. We used multivariable logistic regression to assess the association of a priori selected relevant clinical and demographic factors associated with receipt of vDOT. All analyses were conducted in STATA v14 (Stata Corp, College Station, TX, USA). A total of 163 patients were treated for active TB during the study period, of which 100 (61%) were male, with a median age of 52 years (interquartile range [IQR] 34-67). More than 93% of patients were non-US-born, and the most commonly reported languages were English (53%), Chinese (Mandarin and Cantonese) (11%), Spanish (9%), and Vietnamese (9%). The majority of patients had pulmonary TB (n ¼ 97, 60%), 42 patients (26%) had extrapulmonary TB, and the remainder had both pulmonary and extrapulmonary TB (n ¼ 24, 15%); more than one third of patients had acid-fast bacilli (AFB) smearpositive disease at the onset of treatment (n ¼ 59, 36%), and 22 patients (14%) had drug-resistant disease (17 had isoniazid monoresistance, while the rest had multidrug-resistant TB). Additional socioeconomic and demographic features are shown in Table 1 . Approximately 58% (94/163) of participants received vDOT to monitor therapy for some portion of their TB treatment. All patients receiving DOT also had some portion of self-administration (e.g., weekend/holiday). Among those receiving vDOT, the median time on vDOT was 27.0 weeks (IQR 24.6-31.9). The mean number of prescribed doses was significantly greater during periods monitored by vDOT than those with in-person DOT (192 for vDOT vs. 149 for in-person DOT; P , 0.001). The proportion of patients receiving vDOT did not differ across the period of observation (49% quarter 1, 63% quarter 2, 50% quarter 3, 50% quarter 4; P ¼ 0.737). Effectiveness of vDOT compared to in-person DOT When considering the proportion of prescribed doses verified through observation, use of vDOT (or selfadministration) led to an average 68.4% verified fraction vs. 53.9% using in-person DOT (or selfadministration) (P , 0.001) ( Table 2) . A larger proportion of prescribed doses were considered 'selfadministered' in the medical record during the time patients received in-person DOT (average 45.2%), compared to during the use of vDOT (average 23.8%; P , 0.001). By contrast, very few doses were documented as 'missed' during in-person DOT compared to periods using vDOT (average 1.3% vs. 3.4%, respectively; P , 0.001). Consequently, when considering self-administered doses as having been taken, the maximum adherence was considered to be higher when using in-person DOT than when using vDOT (98.6% vs. 90.3%, P , 0.001; Table 2 ). We found similar successful treatment outcomes among those receiving any vDOT (96% completion/ cure, 2% transferred to another program, and 2% death) and in-person DOT (90% completion/cure, 5% transferred to another program, and 4% deaths, P ¼ 0.326), as well as similar microbiological outcomes (average 48 days' time to culture conversion compared to 47 days among those receiving any vDOT and those receiving in-person DOT, respectively, P ¼ 0.8429). Individuals receiving some vDOT for treatment monitoring were younger than those that exclusively received in-person or self-administered therapy (average age, 46 years vs. 61 years; P , 0.001; Table 1 ). Adjusting for clinical and demographic factors, only age was significantly associated with vDOT use (adjusted odds ratio 0.05 comparing those .65 years to those ,30 years, P , 0.001; Table 3 ). Among individuals receiving vDOT, the majority (61/93, 66%) began vDOT during the intensive phase. The median time to start vDOT was 2.2 weeks (IQR 1.1-10.0). Among those using vDOT, it represented the primary means of adherence verification; among these individuals, the median proportion of all prescribed treatment monitored using vDOT was 100% (IQR 79-100; mean 85%, standard deviation 23%). In our prospective study of the implementation of vDOT under routine conditions in the United States, we found that a large, urban public health program (Alameda County, California) with a higher than average TB burden utilized vDOT for treatment monitoring in more than half of patients. These findings suggest shifting paradigms for adherence monitoring in TB control programs that traditionally relied more heavily on in-person DOT. Moreover, significantly more prescribed doses of TB treatment were verified utilizing vDOT vs. in-person DOT (68% vs. 54%; P , 0.001). Our study is unique in assessing programmatic vDOT implementation, rather than under controlled study conditions. Our findings were similar to those identified under study settings, where vDOT achieved greater medication verification than in-person DOT. 16, 22, [27] [28] [29] Among the goals of DOT is to verify prescribed TB treatment. However, our results indicated that under routine circumstances, only slightly more than half of all TB treatment doses are verified using in-person DOT. This finding reflects the logistical realities of restricting in-person DOT services to business days and is a growing concern as TB programs globally shift to daily (7 days/week) of therapy. 15, [30] [31] [32] Paradoxically, daily in-person DOT can have a negative impact on adherence for some and its implementation can be challenging, particularly in resource-constrained settings. 33, 34 While a larger proportion of prescribed doses were verified using vDOT, the potential for vDOT has not been fully realized. In Alameda, patients were given instructions to self-administer weekend doses, largely for programmatic reasons, including to be consistent with typical 'dose counting' for in-person DOT during days where self-administration (on weekends) was the norm. Furthermore, during the study period, a single healthcare worker was responsible for watching the majority of vDOT videos, which influenced local protocols for vDOT usage on weekends. In 2016, CDC/ATS/IDSA guidelines were updated to indicate a preference for daily treatment regimens over intermittent dosing regimens (i.e., twice per week or three times per week dosing) based on evidence for greater regimen effectiveness; 15 globally, WHO recommendations have similarly prioritized daily therapy. 35 This recommendation change has practical implications for public health TB programs regarding strategies for monitoring adherence, particularly those utilizing in-person DOT. Consequently, US guidelines included the option for dosing 5 days per week using DOT (e.g., 40 intensive phase doses and 90 continuation phase doses), while also acknowledging that ''there are no studies that compare 5 with 7 daily doses.'' 15 Our real-world data, however, highlights implementation challenges related to in-person DOT. In Alameda, medications were typically prescribed 7 days per week, with adherence monitoring restricted to only a subset of days. We found that 45% of treatment doses were selfadministered when utilizing in-person DOT. Prior data suggest that adherence reports with self-administration can be over-estimated. 36, 37 We found that maximum adherence could have been as high as 98.6% under the assumption that all self-administered doses were taken, but adherence estimates were as low as 53.8% when considering only verified ingestion by in-person DOT. On the other hand, while there were fewer selfadministered doses with vDOT, we found that less than three quarters of prescribed doses were confirmed by observation, attributable to implementation protocols. Recognizing the improved effectiveness of daily therapy in the treatment of active TB, our results suggest that additional guidance on assessing treatment adherence and completion may be warranted. vDOToffers the opportunity to verify treatment 7 days per week; future research is needed to assess whether this closer monitoring could improve clinical outcomes. 38 Our study had several important limitations. This study was limited to vDOT evaluation at one health department; vDOT usage may differ across areas or settings. Nonetheless, ACPHD is representative of many large, urban public health TB programs, particularly in the United States. This study was conducted in a program with prior pilot program vDOT experience; thus, we did not identify significant changes in vDOT usage across the first and last quarters of the study period. The reach and feasibility of vDOT implementation may differ for programs introducing vDOT for the first time. Finally, our study concluded before the onset of the COVID-19 pandemic. Whether vDOT uptake changed in the setting of public health restrictions and physical distancing mandates should be investigated. Our study is among the first to provide insights on key aspects of the real-world implementation of vDOT under routine (i.e., non-study) conditions for a program using daily TB therapy. We found that vDOT usage was high, with 58% (94/163) of patients utilizing vDOT at some point during treatment. Our data provide practical evidence to support programmatic paradigm shifts away from exclusive reliance on in-person DOT; 57% of vDOT recipients (54/94) received vDOT exclusively without any in-person DOT monitoring. Our results further highlight that vDOT implementation can be achieved early in patients' treatment, in contrast to prior studies in which verification of good adherence was required prior to vDOT initiation. The majority of patients in Alameda initiated vDOT during the intensive phase, with a median time to vDOT start of less than 2.5 weeks. While the CDC toolkit and California guidelines on implementation considerations for vDOT suggest that patients successfully complete initial weeks of in-person DOT, our data suggest vDOT can be used exclusively in selected patients and with a high degree of adherence. 7, 25, 26 This study provides important insights into selecting patients who routinely receive vDOT. We found that vDOT implementation by the ACPHD was more common among younger individuals. Our findings may reflect a greater comfort among younger individuals with technology usage, or a perception among healthcare workers that younger individuals are better suited for vDOT. Nonetheless, 10% of individuals over 65 years old also utilized vDOT, suggesting that this modality is also feasible among the elderly. Future studies should aim to understand how to increase vDOT reach in older populations. Alternatively, implementing vDOT in some patients, even those who are younger, can allow public health programs to focus in-person TB efforts on patients that require closer supervision or direct nursing care. Overall, our study contributes to the growing literature on the programmatic implementation of vDOT as an alternative to in-person DOT for TB treatment. We expand on prior efforts by reporting data from among the largest prospectively collected cohorts of routine, programmatic implementation of vDOT. Prior studies have suggested that vDOT may be a feasible, effective, and cost-effective approach to verification of treatment under study conditions. 16, 19, 23, 33, 39 Given the relatively recent adoption of vDOT within public health TB programs, the CDC and California State guidelines acknowledge the need for monitoring and evaluation to provide data on vDOT reach and effectiveness. 7, 25, 26 Our findings identified a high rate of real-world vDOT reach, adoption and effectiveness in a busy, urban setting, as well as the need for continued programmatic monitoring over time and across other settings to inform TB treatment guidelines, policy, and resource allocation in TB programs. World Health Organization Global epidemiology of tuberculosis and progress toward achieving global targets Digital adherence technologies for the management of tuberculosis therapy: mapping the landscape and research priorities Risk factors for recurrence of tuberculosis Menu of suggested provisions for state tuberculosis prevention and control laws Tuberculosis Coalition for Technical Assistance. International standards for tuberculosis care (ISTC) Implementing an electronic directly observed therapy (eDOT) program: a toolkit for tuberculosis (TB) programs World Health Organization. Companion handbook to the WHO guidelines for the programmatic management of drugresistant tuberculosis Patient adherence to tuberculosis treatment: a systematic review of qualitative research Treatment of tuberculosis: guidelines. 4 th Tuberculosis control laws and policies: a handbook for public health and legal practitioners California Code Health and Safety Code. HSC Division 105 -communicable disease prevention and control Official American Thoracic Society/Centers for Disease Control and Prevention/Infectious Diseases Society of America Advancing patient-centered care in tuberculosis management: a mixed-methods appraisal of video directly observed therapy Updating the International Standards for Tuberculosis Care Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis World Health Organization. Quick guide to video-supported treatment of tuberculosis Incentives and enablers to improve adherence in tuberculosis Synchronous and asynchronous video observed therapy (VOT) for tuberculosis treatment adherence monitoring and support Tuberculosis treatment monitoring by video directly observed therapy in 5 health districts Smartphone-enabled video-observed versus directly observed treatment for tuberculosis: a multicentre, analyst-blinded, randomised, controlled superiority trial A national survey on the use of electronic directly observed therapy for treatment of tuberculosis California Tuberculosis (TB) Controllers Association. Guidelines for electronic directly observed therapy (eDOT) program protocols in California Information for physicians regarding directly observed therapy (DOT) for active tuberculosis (TB) Enhancing management of tuberculosis treatment with video directly observed therapy in New York City Evaluation of recorded video-observed therapy for anti-tuberculosis treatment Video-observed therapy and medication adherence for tuberculosis patients: randomised controlled trial in Moldova Rapid assessment of facilitators and barriers related to the acceptance, challenges and community perception of daily regimen for treating tuberculosis in India Outcomes and implementation challenges of using daily treatment regimens with an innovative adherence support tool among HIV-infected tuberculosis patients in Karnataka, India: a mixed-methods study Treatment of tuberculosis: guidelines for treatment of drug-susceptible tuberculosis and patient care Use of smartphone-based video directly observed therapy (vDOT) in Tuberculosis care: single-arm, prospective feasibility study Humiliation or care? A qualitative study of patients' and health professionals' experiences with tuberculosis treatment in Norway World Health Organization. Guidelines for treatment of drugsusceptible tuberculosis and patient care Interventions to improve medication adherence in tuberculosis patients: a systematic review of randomized controlled studies The importance of adherence in tuberculosis treatment clinical trials and its relevance in explanatory and pragmatic trials A patient-level pooled analysis of treatment-shortening regimens for drug-susceptible pulmonary tuberculosis Feasibility of tuberculosis treatment monitoring by video directly observed therapy: a binational pilot study Real-world implementation of TB video-DOT Conflict of interests: MS and LC are among the inventors of the vDOT technology licensed to emocha Mobile Health Inc. Under a license agreement between emocha Mobile Health Inc. and the Johns Hopkins University (JHU; Baltimore, MD, USA), MS, LC, and JHU are entitled to royalties related to technology described in this study. Specific to this study, MS and LC did not and will not receive royalties or compensation from emocha Mobile Health Inc (Baltimore, MD, USA). Also, JHU owns equity in eMocha. This arrangement has been reviewed and approved by JHU in accordance with its conflict of interest policies. As per JHU IRB and Conflicts of Interest office (COI), conflicted study team members (MS, LC) were excluded from accessing the original data set. Oversight of data management, including primary analyses and audit of all data analyses, were done by non-conflicted designees (CH, MR, GM, EM), as approved by the JHU IRB and COI office. 1-10,0) . Les patients ontété suivis pendant une durée médiane de 27,0 semaines (IQR 24, 9) . La stratégie vDOT a permis d'accroître le pourcentage de doses prescrites contrôlées par rapportà la stratégie DOT en personne (68% vs. 54% ; P , 0,001). Une auto-administration non-observée du traitement, avec instructions cliniques, avaitété mise en place le weekend pour tous les patients, mais un pourcentage plus important de doses ontété autoadministrées pendant les périodes sous DOT en personne que pendant les périodes sous vDOT (45% vs. 24% ; P , 0,001). C O N C L U S I O N : Ce programme de lutte contre la TB a réussià appliquer la stratégie vDOT sur la durée, parvenantà inclure la majorité des patients età atteindre des taux de contrôle de traitement plusélevés qu'avec la stratégie DOT en personne.