key: cord-0743022-mi3vap2o authors: Gulati, Sheffali; Shruthi, NM; Panda, Prateek Kumar; Sharawat, Indar Kumar; Josey, Mable; Pandey, Ravindra M title: Telephone-based follow-up of children with epilepsy: comparison of accuracy between a specialty nurse and a pediatric neurology fellow date: 2020-10-06 journal: Seizure DOI: 10.1016/j.seizure.2020.10.002 sha: c9de5316b683bfe659df2b9123c50f3c564e71e5 doc_id: 743022 cord_uid: mi3vap2o BACKGROUND: Childhood epilepsy forms a significant burden on the health-care delivery system. Only a few pediatric neurologists available in most of the developing countries and caregivers face a lot of financial and logistic hardships, apart from a long waiting period for initial and follow up visits. Telemedicine is a proposed effective alternative in overcoming this burden. METHODS: Telephonic consultation by a pediatric neurology fellow was compared with that of a specialty nurse; both against face-to-face consultation (gold standard). Care-givers of children 4 months-18 years with epilepsy were telephonically consulted 24-48 hours before their scheduled hospital appointment by one specialty nurse and one pediatric neurology fellow at least 24 hours apart in a random sequence. During the hospital visit, another pediatric neurology fellow blinded to the telephonic consultation, documented the same after Face-to-Face interview. RESULTS: In 141 children with epilepsy, 504 critical clinical events were identified. Telephonic consultation by pediatric neurology fellow had a sensitivity of 99%, 97%, and 100% and specificity of 100% each in detecting whether the child had any breakthrough seizure, any adverse event and whether the drug compliance was adequate or poor respectively, as compared to face-to-face consultation. Telephonic consultation by specialty nurse had a sensitivity of 91%, 84%, and 98% and specificity of 97%, 99%, and 81% in detecting whether the child had any breakthrough seizure, adverse event and whether the drug compliance was adequate or poor respectively. But the specialty nurses fared poorly in identifying atypical seizure semiologies like atonic and myoclonic seizures and documenting an exact number of breakthrough seizures, as well as few subjective adverse effects like behavioral abnormality and scholastic worsening, which was performed excellently by the pediatric neurology fellow. CONCLUSIONS: Telephonic consultation in childhood epilepsy by pediatric neurology fellow has excellent sensitivity and specificity. A specialty nurse has also acceptable sensitivity and specificity in comparison with a face-to-face consultation. Telemedicine is the provision of health care services to a patient separated from the physician by a distance, with the help of information technologies and telecommunication [1] . In recent years, there is quick advancement of scope and usage of telemedicine in the field of neurology, also referred to as teleneurology. Beginning with acute stroke care, it is fast expanding to the care of persons with multiple sclerosis, Parkinson's disease, and epilepsy [2] [3] [4] [5] [6] . The two key factors driving the everincreasing demand for telemedicine in Neurology are limited access to specialists (Neurologists) and difficulties faced by these patients while attending for face-to-face consultation [6] . As there are few pediatric neurologists in India and they are only available in large cities, most of the caregivers face a long waiting time, have to travel a large distance, face a lot of logistic difficulties, and often a lot of financial hardship also. With nearly 5 million people living with epilepsy in India, the annual economic burden in our nation due to epilepsy amounts to 68.75 billion INR (1.7 billion USD). Out of the total cost incurred due to epilepsy in childhood, the parents have to bear the highest proportion in the first year after diagnosis, J o u r n a l P r e -p r o o f attributed to the hospital visit and diagnostic workup. The initial and follow up health care visit related costs account for approximately 80% of the total expenditure, especially when the patient is referred to a tertiary care center and needs to be evaluated frequently at regular time intervals. A cheaper alternative for the same is the review of the child with epilepsy by the general practitioner/Pediatrician for the follow-up health care visits and only those with drug-resistant epilepsy and complicated seizure semiologies being referred to the pediatric neurologist at frequent intervals [7] [8] [9] [10] . But it is often impossible in developing countries because of limited knowledge regarding standard treatment guidelines for epilepsy in general practitioners. Unlike the initial evaluation, during the follow-up visits most stable epilepsy patients do not require extensive clinical and diagnostic evaluation or major modification of antiepileptic drugs. In such scenarios, a tangible solution to reduce health care visit related time, and the cost is to employ telemedicine by specialty nurse trained in dealing with epilepsy cases. This has the potential to reduce the health care visit related costs of the patients, waiting period to get an appointment of a busy pediatric neurologist and also the workload on already over-burdened specialists. If successful, it has the potential to judiciously redistribute the working hours of epilepsy specialists towards the care of relatively more complicated cases. As the follow-up visits of children with epilepsy after the initial evaluation is predominantly based on parents' reporting of symptoms and drug compliance, they are also not likely to be compromised in the quality of care [3] [4] [5] [6] . However, diagnostic studies with adequate sample sizes are needed to determine whether telephone consultation by specialty nurse can be an equally effective alternative to face-to-face consultation (the gold standard for follow-up care) in stable childhood epilepsy patients. The present study was designed for similar motive to compare the diagnostic utility of telephone consultation by a trained specialty staff nurse with that of a pediatric neurology fellow; J o u r n a l P r e -p r o o f 6 both against the face to face consultation by another pediatric neurologist (gold standard) to accurately identify critical clinical events in children with epilepsy. This prospective follow up study to compare the diagnostic accuracy of telephonic consultation by specialty nurse and pediatric neurology fellow was carried out in the Department of Pediatrics, All India Institute of Medical Sciences, New Delhi, over two years from November 2016 to March 2018. All the patients were enrolled from pediatric neurology specialty clinics, run exclusively by qualified pediatric neurologists, after informed consent from the caregiver. Ethical approval was taken from the institutional ethical committee before the commencement of the study. The main objective of the study was to compare the diagnostic accuracy of telephone consultation between a trained specialty nurse and a pediatric neurology fellow to identify any critical clinical events as compared with the face-to-face consultation (gold standard), in children with epilepsy aged granuloma) or had completed cysticidal therapy. Children with West Syndrome before completion of 12 wks of ACTH/ Steroid/ Vigabatrin therapy, children with Lennox-Gastaut syndrome (LGS) who have not undergone initial etiological evaluation, complicated Neurocysticercosis cases (with >5 parenchymal lesions, intraocular and intraventricular) were excluded. If the primary caregiver was not available during the consultations in the initial visit, then the cases were also excluded. For the study, critical clinical events were defined as those related to the disease course or drug therapy occurring during epilepsy management. These included lack of compliance with AED dose/regimen, seizures, features of increased intracranial pressure, AED related, and other adverse events including excessive sleepiness, irritability, neurological deficits, and infections. Presence of one or more of the following was considered as the drug-related adverse event: skin rash not associated with fever, dizziness, and vertigo, recent-onset imbalance while walking, standing or sitting Drug non-compliance was defined as either not taking the prescribed anti-epileptic drug or taking drugs other than the prescribed drug, taking the amount of drug that is insufficient or excessive, or taking the drug at incorrect intervals than the prescribed frequency. Raised intracranial pressure was defined as the presence of any two of the following: headache, irritability, excessive drowsiness, blurred vision The children with epilepsy, aged 4 months to 18 years, of either sex with access to telephonic services attending the pediatric neurology clinic were assessed for eligibility and were enrolled. The partially filled disease-specific proformas (including demographic details, clinical diagnosis, and treatment details like name of AEDs, prescribed dose, and frequency) were handed over by the principal J o u r n a l P r e -p r o o f investigator to the trained specialty nurse, Doctor A (the Pediatric Neurology fellow) for independent telephone consultations and Doctor B (the Pediatric Neurology Faculty) for a face-to-face consultation. The Pediatric neurology nurse, doctor A, and doctor B were blinded to each other's assessment. Every week, the specialty staff nurse and the pediatric neurology fellow conducted telephone consultations on specified day and time (48-72 hours before scheduled hospital visit) which was intimated to the parents/guardians of the patients at the time of enrollment. Both the telephone consultation used to occur at a gap of 24 hours. One group of patients was called by trained specialty nurse followed by the pediatric neurology fellow and the reverse direction was followed in the other group. During the hospital visit, the enrolled patients were interviewed by doctor B (pediatric neurology faculty, gold standard). The consultation included a structured pre-designed questionnaire for documenting critical clinical events. This Questionnaire was disease-specific with separate proformas for children with the West syndrome and LGS, primary generalized epilepsy (PGE), and neurocysticercosis. After the telephone consultation, the specialty nurse used to write the summary of consultation as either "Needs face-to-face consultation" (if any of the critical clinical events were identified) or "Does not need face-to-face consultation" (if none of the critical clinical events were identified). At the end of the consultation, the parents were requested to attend the hospital as per the appointment. A similar telephone consultation was made by doctor A (pediatric neurology fellow). He/she also used to write the summary of consultation in the same way. The face-to-face consultation was conducted by the pediatric neurologist in the next visit. It was considered as the gold standard for evaluating the diagnostic accuracy of telephone consultation. This consultation used to be comprehensive and used to include parental interviews and detailed physical examination. The specialty staff nurse was trained for identifying various seizure forms, critical events, and comorbid problems in children with epilepsy before the commencement of the study. She was also trained regarding the technique for a telephone interview, contents of the predesigned study proforma, and instructions for filling the proforma during telephone consultations. The same nurse had prior experience of >10 years in dealing with children suffering from neurological disorders including epilepsy. She was a full-time nurse in the Child Neurology Division at the study site and used to dedicate the whole of working hours dedicatedly towards childhood neurological disorders only. The Doctors (pediatric neurology fellows) to be involved in the study were trained about the interview technique, contents of the proforma, and instructions for filling the pre-designed proforma for telephone consultations. Considering a maximum difference of 5% in the diagnostic accuracy of telephone consultation between trained specialty nurse and pediatric neurology fellow necessitating face-to-face consultation, the number of critical events diagnosed by the gold standard should be 455. However expecting a sensitivity of 90% for the telephonic consultation compared to face-to-face evaluation, the overall sample size in terms of critical events comes out to be 500. Absolute and individual J o u r n a l P r e -p r o o f specificity, sensitivity, positive and negative predictive values, and likelihood ratios of telephone consultation by a specialty nurse and a pediatric neurology fellow to identify any critical clinical events were calculated using SPSS software version 23.0 and were expressed in terms of percentage with 95% confidence interval. Likelihood ratio were expressed as the proportion with 95% confidence interval. Appropriate statistical tests were used to determine whether the difference between the two variables was statistically significant. A P-value of less than 0.05 was considered statistically significant. During the study period, a total of 141 children were enrolled and a total of 504 critical clinical events were identified. Baseline demographic characteristics of the sample population have been described in table 1. The epilepsy characteristics, including neuroimaging and EEG findings, have been But none of the children were found to have significant worsening of these co-morbidities to raise medical concern at the next follow-up visit, probably due to the small time interval between two visits (1-3 months). The pediatric neurology fellow performed excellently in all aspects, in diagnosing the children with breakthrough seizure, semiology and number of breakthrough seizures, children with adverse events, nature of the adverse event, and compliance, with sensitivity and specificity for all of these being >90%. The specialty nurse although lagged behind the pediatric neurology fellow in almost all of these prospects, probably because of difference in depth of knowledge between them, however, they were able to identify which of the children had a breakthrough seizure (p=0.53) or critical clinical events (p=0.10) and whether they are compliant with the drug therapy or not (p=0.46). Both the sensitivity and specificity of specialty nurse was >80% for detecting the above three parameters and also for detecting generalized/focal tonic/clonic seizures. But the specialty nurse fared poorly in identifying other semiology of seizures including myoclonic and atonic seizures and they also underestimated the number of breakthrough seizures, especially for myoclonic and atonic seizures, although it did not change the treatment decision in the majority of patients. The specificity of specialty nurse in identifying the nature of the adverse event was acceptable (81%), although they were not sensitive and missed some children with WHO grade 1 adverse effect. But they correctly diagnosed all the 6 children with relatively more severe WHO grade 2 adverse effects and only these adverse effects have therapeutic implications. Overall, in some areas of comparison, the telephonic evaluation by specialty nurse fell quite below that of the physician. It is the first study of its kind which has compared the efficacy of pediatric neurologist and specialty nurse in epilepsy telemedicine, as compared to face-to-face consultation. This is the first study in existing literature, which has identified critical areas in which specialty nurses fared poorly in telemedicine like atypical seizure Semiology and relatively mild subjective adverse effects. This study demonstrated that telephonic consultation by pediatric neurology fellow in well-controlled childhood epilepsy has excellent sensitivity and specificity to identify critical clinical events. Although the specialty nurse lagged behind the pediatric neurology fellow in the study, it can be explained by the level of training and knowledge difference between both the groups. It is noteworthy to mention that even the specialty nurse was able to identify most of the events requiring immediate medical concern like whether a breakthrough seizure or a severe adverse effect has occurred. Undeniably, they were not able to identify rare seizure semiologies like myoclonic and atonic seizures, the exact number of breakthrough seizures, and other highly precise information. But it can be explained because of the degree of command they have over epilepsy, which is less than the pediatric neurology fellow. Still, sensitivity and specificity of around 80% for the majority of clinically relevant parameters for the specialty nurse in resource-constrained settings can be accepted due to the limited availability of trained pediatric neurology fellows in a developing country like India. with the advent of short message services, WhatsApp audio, and video messages, and video calling facilities, these restrictions can be circumvented. In children, however, often the semiology of seizures is atypical such as epileptic spasms and myoclonic, atonic seizures, and many times children are unable to describe the aura symptoms. Thus, telephonic consultation for epilepsy in children poses additional challenges [8, 10] . Most children with epilepsy reside in low-or middle-income countries (LMICs) where there is the scarcity of doctors and the majority of epilepsy cases are inadequately managed or even remain undiagnosed and untreated altogether. In recent years many novel models like our study have been proposed to explore paramedical health care professionals as non-inferior alternatives for services not requiring complicated medical or surgical skills [11] [12] [13] . Bahrani et al [14] in a randomized controlled trial involving 465 stable epilepsy patients demonstrated that there was no difference between the proportion of patients with breakthrough seizures and the total number of breakthrough seizures between the patients with face-to-face consultation and who have been reviewed telephonically, like our study. Thus they concluded that neurologists may revert to telephonic review in selected stable epilepsy patients, without compromising the quality of care. In developing countries like India, the secondary treatment gap for epilepsy patients with remote access to doctors can be effectively reduced, as telephonic review required less time consumption on part of the patient (10 minutes vs 22 hours) and less expansive by INR 865. They recognized in their study the huge underlying potential of telephonic review to effectively reduce the secondary treatment gap for millions of patients with no easy access to doctors. The loss to follow up was more in the face-to-face consultation group. More than 90% of cases were satisfied with the telephonic review. At the current study site in 2011, Konanki et al [15] successfully evaluated the diagnostic accuracy of telephone consultation to accurately identify the critical clinical events in 228 children with Neurocysticercosis. The telephone consultation had a sensitivity of 92.7%, a specificity of 97.6%, an NPV of 99.6%, a PPV of 66.2%, a positive likelihood ratio of 38.6%, and a negative likelihood ratio of 0.07 to identify these critical clinical events. Previously also few clinical studies have been carried out to explore telephone nursing in children with epilepsy. The telephone nursing line has been shown to be an alternative for the shortage of subspecialists like pediatric neurologists in a study by Letourneau et al [16] . This study examined the use of a telephone nursing line for triage in a hospital-based pediatric neurology clinic. It concluded that most telephone calls and most long telephone calls were related to children with epilepsy. Nurses could manage more than half of all telephone calls without physician assistance. The authors concluded that the use of a nursing line can help the doctors to allot more time and better care to complicated patients. Bingham et al [17] in 2007 demonstrated the acceptability and sustainability of telemedicine-enabled nurse-led epilepsy service. In the model devised by them, the nurse specialist used to travel to the patient's local hospital in place of the neurologist. After assessing the case, if the nurse specialist used to contact the neurologist if problems were requiring his expertise. The neurologist again used a video link with the patient and nurse, when he was not able to resolve the issue by audio call. After five years of operating at maximum capacity, a patient satisfaction survey showed 72% of patients were satisfied with the telephonic consultation by the nurse and 90% opted to revisit the telephonic consultation service again in the future. After this study, the investigators switched two-third of their patient load to the nursing specialist, supplemented by telephonic consultation and there were obvious savings in cost-benefit analysis. [18] demonstrated the safety and efficacy of one such model aimed at training local residents in a rural district of Nepal as epilepsy health workers (EFWs) in 2018. In any person presenting with a paroxysmal event, the EFWs used to contact the epilepsy specialist telephonically, when the probability score of the event being epileptic in a smartphone-based application was above a cut-off. The EFWs subsequently used to arrange antiepileptic treatment if it was considered to be indicated by the specialist. Within 18 months study period, 112 persons with epilepsy were included in that study. There was 93% diagnostic agreement with face-to-face consultation, seizures stopped altogether in 33%, reduced in frequency in 57% and only 5% had adverse effects. Around 96% of patients were satisfied with this service rather than traveling for a conventional face-to-face visit with the doctor. In another novel combined Nurse Practitioner-physician team care model proposed in 2017 by Hill et al [19] in the USA, there was the increased availability of clinic appointment slots for epilepsy care, Telephone consultation by specialty nurse has acceptable sensitivity and specificity for diagnosing breakthrough seizure and drug-related adverse events as compared to pediatric neurology fellow and face-to-face consultation. J o u r n a l P r e -p r o o f J o u r n a l P r e -p r o o f Experiences from an international tele-epilepsy collaboration Feasibility of epilepsy follow-up care through telemedicine: a pilot study on the patient's perspective Telemedicine and epilepsy care -a Canada wide survey COVID-19 (SARS-CoV-2 Infection) and Children: Pediatric Neurologist's Perspective Feasibility and effectiveness of teleconsultation in children with epilepsy amidst the ongoing COVID-19 pandemic in a resource-limited country Cost-of-illness of epilepsy in Italy. Data from a multicentre observational study (Episcreen) The cost of epilepsy in the United Kingdom: an estimation based on the results of two population-based studies The contributing factors to medical cost of epilepsy: an estimation based on a French prospective cohort study of patients with newly diagnosed epileptic seizures (the CAROLE study) The management of epilepsy in children and adults Epidemiology of epilepsy in developing countries Epilepsy Care in Developing Countries: Part II of II Telephonic review for outpatients with epilepsy-A prospective randomized, parallel group study Comparison of telephone with face to face consultation for follow up of Neurocysticercosis Use of a telephone nursing line in a pediatric neurology clinic: one approach to the shortage of subspecialists A telemedicine-enabled nurse-led epilepsy service is acceptable and sustainable Epilepsy field workers, a smartphone application and telephone telemedicine: Safe and effective epilepsy care in rural Nepal Improved availability and quality of care with epilepsy nurse practitioners Supporting and empowering people with epilepsy: Contribution of the Epilepsy Specialist Nurses (SENsE study)