key: cord-0731103-shflyfqk
authors: Liao, Shu-Chen; Shao, Shih-Chieh; Lai, Edward Chia-Cheng; Lin, Swu-Jane; Huang, Wei-I; Hsieh, Cheng-Yang
title: Positive Predictive Value of ICD-10 Codes for Cerebral Venous Sinus Thrombosis in Taiwan’s National Health Insurance Claims Database
date: 2022-01-03
journal: Clin Epidemiol
DOI: 10.2147/clep.s335517
sha: 22296e5df4d0b0c327e3ad0abe76747083f4ac5e
doc_id: 731103
cord_uid: shflyfqk

OBJECTIVE: This study aims to determine the positive predictive value (PPV) of case definitions for cerebral venous sinus thrombosis (CVST) in Taiwan’s National Health Insurance claims database based on the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM) diagnostic codes. STUDY DESIGN AND SETTING: Inpatient records with ICD-10-CM codes of G08, I629, I636, or I676 were retrieved from the claims data of all hospital branches of Chang Gung Medical Foundation. Manual review of the medical records and images was performed in order to ascertain the diagnosis. The PPV of various case definitions for CVST was estimated. RESULTS: Of the 380 hospitalizations, 166 and 214 were determined to be true-positive and false-positive episodes of acute CVST, respectively. The PPV of the ICD-10-CM codes of G08, I629, I636, and I676 was 88.2%, 2.0%, 100.0%, and 91.3%, respectively. The PPV generally increased when acute CVST was defined as a primary diagnosis or as ICD-10-CM codes plus anticoagulant use. Miscoding in other conditions, tentative diagnosis, and remote episode of CVST were determined as the main reasons for false-positive diagnosis of acute CVST. CONCLUSION: This study determined the PPV of ICD-10-CM codes for identifying CVST, which may offer a reference for future claims-based research.

Massive administration of SARS-CoV2 vaccines has been identified as the mainstay in the control of the unprecedented coronavirus disease 2019 (Covid-19) pandemic. Cerebral venous sinus thrombosis (CVST) is a rare manifestation of cerebrovascular disease, accounting for 0.5%-1.0% of all stroke admissions. 1 However, in April 2021, three independent reports from Europe described a total of 39 cases of CVST after administration of ChAdOx1 nCoV-19 (AstraZeneca) vaccine containing adenovirus vectors. 2, 3 Moreover, CVST events were also reported in the United States following vaccination with Ad26.COV2.S (Janssen), another adenovirus vector vaccine. 4 An excess of about 1 CVST event per 40,000 vaccinations has been reported. 5 On the contrary, no increased risks of thromboembolic events were recorded following administration of mRNA SARS-CoV2 vaccines such as BNT162b2 (Pfizer-BioNTech). 6 Exploration of these results is needed in the Asian population, whose epidemiologic features of CVST at background are different from those of the Western population. 7 Administrative claims data, derived from electronic data reported by healthcare providers and insurers for the purposes of reimbursement, provide an affordable and efficient way to monitor vaccine safety. 8 For example, Taiwan's National Health Insurance Research Database (NHIRD) has been utilized for research on influenza vaccination. 9 Recently, researchers of Norway and Denmark also conducted a population-based cohort study on the risk of CVST after administration of ChAdOx1-S (AstraZeneca) vaccine. 5 However, the diagnostic code they chose to identify cases of CVST might not be representative enough. 10 This could lead to an underestimate of actual risk.

At the initiation of the nationwide SARS-CoV2 vaccination program, Taiwan Drug Relief Foundation, which operates the Taiwan National Adverse Drug Reaction Reporting Center, began to monitor the differences between the observed and the expected number of CVST for signal detection. Nevertheless, the diagnostic codes of CVST in Taiwan's NHIRD have not been validated. 11 It is unknown whether the degree of positive predictive value (PPV) of these diagnostic codes is sufficient to accurately estimate the excess risk of CVST. Hence, we carried out the current study to validate various case definitions of CVST based on the International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM) codes, using the National Health Insurance claims data from a large healthcare system in Taiwan.

This study was conducted in all hospital branches (Keelung, Linkou, Taipei, Taoyuan, Kaohsiung, Chiayi, Yunlin, and Fengshan) of the Chang Gung Medical Foundation (CGMF) in Taiwan. CGMF is the largest multi-institutional healthcare system in Taiwan, with more than 10% of inpatient coverage of the entire population. 12 This study has been approved by the Institutional Review Board of the CGMF (IRB No: 202100962B0) and was conducted in accordance with the Declaration of Helsinki. The requirement for informed consent was waived due to its retrospective design. In order to ensure patients' confidentiality, the study data were maintained in a secure system that only authorized personnel could access.

This study used administrative claims data from the CGMF hospitals. The hospitalization claims data reported to the National Health Insurance Administration were retrieved from the hospital information system. In each hospitalization episode of a patient, there can be at most five discharge diagnoses recorded. Between January 2017 and December 2020, patients hospitalized with a discharge diagnosis of possible CVST were identified. This refers to patients hospitalized during this period with an ICD-10-CM diagnostic code of G08 (intracranial and intraspinal phlebitis and thrombophlebitis), I629 (nontraumatic intracranial hemorrhage, unspecified), I636 (cerebral infarction due to cerebral venous thrombosis, non-pyogenic), or I676 (non-pyogenic thrombosis of intracranial venous system) in any field of their discharge diagnoses. We chose I629 to identify possible cases of CVST because some of them might present with intracerebral hemorrhage, according to our prior study. 13 If a patient had multiple hospitalization episodes with aforementioned discharge diagnoses during the study period, only the first hospitalization was retrieved for analysis.

We identified a CVST event according to the definition of the Taiwan Stroke Registry program, 14 which is "an infarct or/and intracerebral hemorrhage on computed tomography, and an evidence of a cerebral sinus or venous occlusion on magnetic resonance image and magnetic resonance angiography or on conventional angiography". Figure 1 shows the process of case ascertainment. In brief, physician 1, who is a specialist in emergency medicine with access to the CGMF electronic medical records, extracted the discharge notes and relevant image reports of each patient, and made the initial ascertainment of CVST. Thereafter, physician 2, a neurology specialist who was not involved in extracting data, also reviewed the extracted data, and made the second ascertainment of CVST independently. In case of disagreement, discussions were held between physicians 1 and 2 until consensus was reached for final ascertainment. If the two reviewers still failed to come to an agreement after discussion, then a third reviewer will be sought to adjudicate the cases.

For hospitalizations determined not to be true episodes of CVST, the reasons were documented and categorized into the following groups: 1) a tentative diagnosis of CVST, which was later excluded after clinical evaluation and imaging studies; 2) remote history of CVST; and 3) other diagnoses miscoded as CVST (e.g., congenital hypoplasia of the transverse sinus). 

This study examined various case definitions for identifying cases of CVST by including individual or combination of ICD-10-CM codes in the 1) primary diagnosis; 2) primary or secondary diagnosis; 3) primary, secondary, or tertiary diagnosis; and 4) any field of the diagnosis. We further tested whether adding in-hospital prescriptions of any anticoagulants (i.e., heparin, low-molecular-weight heparin, warfarin, and direct oral anticoagulants) can improve the identification of CVST cases. The positive predictive value (PPV) was computed as the proportion of hospitalizations with confirmed CVST among all possible CVST hospitalizations, and the 95% confidence interval (CI) of PPV was estimated using the Clopper-Pearson exact method. Data analyses were performed using SAS Enterprise Guide 7.13 (SAS Institute, Inc., Cary, NC, USA).

Between January 2017 and December 2020, we were able to identify 68, 201,15, and 103 hospitalizations from the hospitalization claims data with an ICD-10-CM code of G08, I629, I636, and I676 in any field of the discharge diagnoses, respectively. Seven hospitalizations were coded with more than one of these ICD-10-CM codes. Therefore, a total of 380 patients were reviewed. Physicians 1 and 2 reached agreement in 365 patients and were able to come to an agreement after discussion on cases that disagreed during the first-round of assessment ( Figure 1 ). No third reviewer was needed for adjudication of disputed cases. Table 1 shows the number of true-positive CVST hospitalizations and PPV under each diagnostic code. Using only the primary diagnosis, the PPV was >91% for G08, I636, and I676, but was extremely low for I629 (<2%). However, when expanding the case definition to the secondary, tertiary, or any field of diagnosis, the PPV of each ICD-10-CM code decreased, while the number of identified CVST cases increased.

For false-positive cases with ICD-10-CM code of G08 (n = 8), five were tentative diagnosis, one was remote CVST, and two were miscoding. For false-positive cases with I676 (n = 9), six were tentative diagnosis, while three were miscoding. All false-positive cases with I629 (n = 197) were miscoding. Table 2 shows the PPV for combination use of ICD-10-CM codes. PPV for G08, I636, or I676 in any field of diagnosis was 90.7% (95% CI, 85.5%-94.5%). However, the PPV reduced by half when I629 was added to the case definitions. Adding in-hospital exposure of any anticoagulants improved the PPV to almost 100%, including case definitions using only I629 (Table 3) or I629 in combination with G08, I636, or I676 (Table 4) . However, such improvements were all at the expense of a significant decrease in CVST case numbers.

We assessed the PPV of various case definitions using ICD-10-CM diagnostic codes for CVST. The PPVs of G08, I636, and I676 were found to be good to excellent when they were used alone or in combination with other relevant codes in any field of diagnosis, while the PPV of I629 was poor. Restricting ICD-10-CM codes to the primary diagnosis or adding anticoagulants in case definitions improved the PPV to almost 100%, but at the expense of much fewer cases of identified CVST. In contrast to acute ischemic stroke 15 and hemorrhagic stroke, 13 there were few prior studies on the PPV of ICD-10-CM codes for CVST. In a recent validation study conducted in the UK, most of the ascertained CVST cases (n = 60) were coded with G08 (90%), rather than I636 (1.7%) or I676 (1.7%). 10 In contrast, our ascertained CVST cases (n = 166) were more likely be coded with I676 (54.2), followed by G08 (41.0%) and I636 (9.0%) (The sum of percentages was greater than 100% due to coding with more than one ICD-10-CM code in 7 patients). Such a difference could be due to the different coding behaviors among different healthcare systems and databases. Additionally, Asian CVST patients were reported to have a higher frequency of underlying hypercoagulable state. 7 Such an etiological difference might also explain why more of our CVST cases were coded with I676 (non-pyogenic thrombosis of intracranial venous system), rather than G08 (intracranial and intraspinal phlebitis and thrombophlebitis). Based on the study results, we have the following suggestions when using Taiwan's NHIRD to conduct research on CVST. First, if the researchers aim to create a cohort of patients with CVST, we recommend the case definitions of "G08 or I636 or I676 as primary diagnosis," with or without anticoagulant use. These definitions will produce the highest PPVs (94.6% to 100%), ensuring that patients in this cohort are true cases of CVST. The trade-off is that such definitions might lead to a loss of true cases of CVST whose ICD-10-CM 

codes are in the secondary or other fields of discharge diagnosis. The trade-off might be tolerable given the large sample size of Taiwan's NHIRD. Second, if CVST itself is the main research outcome (e.g., the researchers aim to determine the incidence rate of CVST after vaccination), we recommend the case definition of "G08 or I636 or I676 in any field of diagnosis." Although this definition is associated with a little lower PPV, it will help researchers to identify more true cases of CVST and to avoid misclassification bias.

Our results demonstrated the importance of a validation study on the criteria for case selection/definition before using administrative claims data to conduct research on vaccine safety. For example, a CVST case was defined as having an ICD-10 code of I676 in a study in Norway and Denmark; 5 however, if this single criterion were to apply to the UK database employed in the Handley et al study, 10 it would fail to identify 98.3% of true CVST cases and lead to a significant underestimate of risks.

Our study has several limitations. First, due to the design of the study, we could not determine the falsenegative rate, negative predictive value, sensitivity, and specificity of those case definitions using ICD-10-CM codes for CVST. We did not know how many true CVST patients were miscoded as I61 (nontraumatic intracerebral hemorrhage) or I63 (cerebral infarction). Further studies using data linkage with stroke registry and claims data are needed to achieve this purpose. 12, 14 Second, we did not investigate the PPV of other similar codes such as O225 (cerebral venous thrombosis in pregnancy) and O873 (cerebral venous thrombosis in the puerperium). Currently, almost all pregnant women in Taiwan received mRNA-1273 SARS-CoV-2 vaccine (Moderna), which was considered to have lower risk of CVST. Third, 112 (56.9%) of the 197 patients with an ICD-10-CM diagnostic code I629 only received a plain computed tomography as their key image study modality. The diagnosis of CVST might be missed among these patients. Fourth, the CGMF healthcare system covers only a small fraction (10.2%) of the national inpatient population. However, it was a large healthcare system with academic medical centers and regional and district hospitals, and the results might be representative of the inpatient population in Taiwan.

The PPVs of ICD-10-CM codes of G08, I636, and I676 were generally high to identify cases of CVST, while that of I629 was not. Our results support the use of Taiwan's NHIRD to study CVST.

This work was supported by the Tainan Sin Lau Hospital (grant number SLH109-09).

Cerebral venous thrombosis: a practical guide

Thrombosis and thrombocytopenia after ChAdOx1 nCoV-19 vaccination

Pathologic antibodies to platelet factor 4 after ChAdOx1 nCoV-19 vaccination

US case reports of cerebral venous sinus thrombosis with thrombocytopenia after Ad26.COV2.S vaccination

Arterial events, venous thromboembolism, thrombocytopenia, and bleeding after vaccination with Oxford-AstraZeneca ChAdOx1-S in Denmark and Norway: population based cohort study

First-dose ChAdOx1 and BNT162b2 COVID-19 vaccines and thrombocytopenic, thromboembolic and hemorrhagic events in Scotland

Asian study of cerebral venous thrombosis

Suitability of databases in the Asia-Pacific for collaborative monitoring of vaccine safety

Two decades of research using Taiwan's National Health Insurance claims data: bibliometric and text mining analysis on PubMed

Validation of ICD-10 codes shows intracranial venous thrombosis incidence to be higher than previously reported

Taiwan's National Health Insurance Research Database: past and future

The Chang Gung Research Database-a multi-institutional electronic medical records database for real-world epidemiological studies in Taiwan

Validation of ICD-10-CM diagnosis codes for identification of patients with acute hemorrhagic stroke in a National Health Insurance claims database

Get With the Guidelines-Stroke performance indicators: surveillance of stroke care in the Taiwan Stroke Registry: get With the Guidelines-Stroke in Taiwan

Performance of ICD-10-CM diagnosis codes for identifying acute ischemic stroke in a National Health Insurance Claims Database

The authors report no conflicts of interest in this work.

Clinical Epidemiology is an international, peer-reviewed, open access, online journal focusing on disease and drug epidemiology, identification of risk factors and screening procedures to develop optimal preventative initiatives and programs. Specific topics include: diagnosis, prognosis, treatment, screening, prevention, risk factor modification, systematic reviews, risk & safety of medical interventions, epidemiology & biostatistical methods, and evaluation of guidelines, translational medicine, health policies & economic evaluations. The manuscript management system is completely online and includes a very quick and fair peer-review system, which is all easy to use.