key: cord-0883994-l7e7lgh0
authors: Wray, Charlie; Tang, Janet; Byers, Amy; Keyhani, Salomeh
title: Digital Health Skillsets and Digital Preparedness: Comparison of Veterans Health Administration Users and Other Veterans Nationally
date: 2022-01-28
journal: JMIR Form Res
DOI: 10.2196/32764
sha: 7ba37353a2b7ab668898d744bc1f57c2d1cb4091
doc_id: 883994
cord_uid: l7e7lgh0

BACKGROUND: As health care systems shift to greater use of telemedicine and digital tools, an individual’s digital health literacy has become an important skillset. The Veterans Health Administration (VA) has invested resources in providing digital health care; however, to date, no study has compared the digital health skills and preparedness of veterans receiving care in the VA to veterans receiving care outside the VA. OBJECTIVE: The goal of the research was to describe digital health skills and preparedness among veterans who receive care within and outside the VA health care system and examine whether receiving care in the VA is associated with digital preparedness (reporting more than 2 digital health skills) after accounting for demographic and social risk factors. METHODS: We used cross-sectional data from the 2016-2018 National Health Interview Survey to identify veterans (aged over 18 years) who obtain health care either within or outside the VA health care system. We used multivariable logistic regression models to examine the association of sociodemographic (age, sex, race, ethnicity), social risk factors (economic instability, disadvantaged neighborhood, low educational attainment, and social isolation), and health care delivery location (VA and non-VA) with digital preparedness. RESULTS: Those who received health care within the VA health care system (n=3188) were younger (age 18-49 years: 33.3% [95% CI 30.7-36.0] vs 24.2% [95% CI 21.9-26.5], P<.01), were more often female (34.7% [95% CI 32.0-37.3] vs 6.6% [95% CI 5.5-7.6], P<.01) and identified as Black (13.1% [95% CI 11.2-15.0] vs 10.2% [95% CI 8.7-11.8], P<.01), and reported greater economic instability (8.3% [95% CI 6.9-9.8] vs 5.5% [95% CI 4.6-6.5], P<.01) and social isolation (42.6% [95% CI 40.3-44.9] vs 35.4% [95% CI 33.4-37.5], P<.01) compared to veterans who received care outside the VA (n=3393). Veterans who obtained care within the VA reported more digital health skills than those who obtained care outside the VA, endorsing greater rates of looking up health information on the internet (51.8% [95% CI 49.2-54.4] vs 45.0% [95% CI 42.6-47.3], P<.01), filling a prescription using the internet (16.2% [95% CI 14.5-18.0] vs 11.3% [95% CI 9.6-13.0], P<.01), scheduling a health care appointment on the internet (14.1% [95% CI 12.4-15.8] vs 11.6% [95% CI 10.1-13.1], P=.02), and communicating with a health care provider by email (18.0% [95% CI 16.1-19.8] vs 13.3% [95% CI 11.6-14.9], P<.01). Following adjustment for sociodemographic and social risk factors, receiving health care from the VA was the only characteristic associated with higher odds (adjusted odds ratio [aOR] 1.36, 95% CI 1.12-1.65) of being digitally prepared. CONCLUSIONS: Despite these demographic disadvantages to digital uptake, veterans who receive care in the VA reported more digital health skills and appear more digitally prepared than veterans who do not receive care within the VA, suggesting a positive, system-level influence on this cohort.

In recent years, and further expedited by the COVID-19 pandemic, health systems have shifted greater amounts of health care from in-person to digital-based care. The gathering of online information, use of mobile apps, and virtual-based patient-provider interactions require greater digital knowledge and skills from health care consumers. These abilities, termed digital health literacy, refer to the "set of skills and knowledge that are essential for productive interactions with technology-based health tools" [1] . An individual's digital health skillset remains important as recent studies have shown that individuals' self-perceived skills to use online information may affect their health and quality of their health care and that a lack of such skills may lead to adverse clinical outcomes [1] [2] [3] . Prior work shows that multiple individual-level factors, including age, race/ethnicity, and social risk factors such as income, education, and marital status, influence one's overall digital health literacy [2, [4] [5] [6] . While digital health literacy frequently describes the individual skills or experiences a consumer may have, the degree to which an individual may be able to meaningfully engage digitally based (eg, digitally prepared) health care is lacking. Digital preparedness can be thought of as having sufficient digital skills and experiences using digital tools to support digital-based care. The health care system in which a person receives care may impact an individual's digital health skillset and, thus, their digital preparedness in important ways. For instance, the Veterans Health Administration (VA), which cares for more than 9 million individuals and is the largest integrated health care system in the United States, has used technology-based interventions to improve patient access and outcomes. Because many veterans who receive care from the VA reside in rural locations, telemedicine and other asynchronous digital modalities are commonly used to provide health care within the VA [7] . Even prior to the pandemic, the VA was seen as a leader in the implementation and use of digital health interventions [8] . While prior work has found that most veterans have basic digital access (ie, own a digital device) and digital literacy (ie, ability to use the internet) to engage in digital-based care [9, 10] , to our knowledge, no study has compared the digital health skillset and preparedness of consumers of different health systems, as well as individual-level factors such as age, sex, race, ethnicity, and social factors (eg, economic instability, education attainment, and social isolation). Due to the VA's history and focus on the use of digital care, we hypothesize that individuals who obtain their health care from the VA may have a greater digital health skillset and higher rates of digital preparedness (ie, reporting more than 2 digital health skills) than those who receive care outside the VA health care system.

To examine this, we used the National Health Interview Survey (NHIS) to first describe the digital health skillset and examine sociodemographic and social risk factors associated with digital preparedness among veterans who receive care from the VA in comparison with veterans who receive care outside the VA health care system. Then, we determined whether receiving care in the VA is associated with digital preparedness independent of these demographic and social risk factors.

We used cross-sectional data from the 2016-2018 NHIS, a nationally representative sample of noninstitutionalized individuals residing within the United States, conducted annually by the National Center for Health Statistics at the Centers for Disease Control and Prevention [11] . The NHIS uses computer-assisted personal interviewing to annually administer the survey and collect health-related information from respondents. During the assessed years, the unconditional final adult response rate ranged from 53.0% to 54.3%. This study used publicly available data and was exempt from institutional review board review.

After limiting the sample to respondents aged over 18 years and excluding individuals with missing data (<3%), our analytic samples included 3188 veterans who obtain care in the VA (which included VA, TRICARE [health insurance for active-duty military], and CHAMP-VA [Civilian Health and Medical Program of the Department of Veterans Affairs]) and 3393 veterans who received care outside the VA. To create these cohorts, we first used the question, "Have you ever served on active duty in the US Armed Forces, military reserves, or National Guard?" to identify veterans from nonveterans. Next, we used the question, "What kind of health insurance or health care coverage do you have?" and identified those who are receiving health care within the VA by those who answered, "military health care (TRICARE, VA, CHAMP-VA)" and those who received health care outside the VA by those who answered any type of insurance (ie, private, Medicare, Medicaid, Medigap) other than "military health care."

Because this identification method may lack specificity, we also performed a sensitivity analysis on a secondary cohort from a 2018 subpopulation who were given the question "Have you ever enrolled in or used VA health care?" We then performed the same analysis among individuals who responded "yes" to this question.

In our analysis of digital preparedness, we included age, sex, race, ethnicity, and 4 social risk factors (economic instability, disadvantaged neighborhood, low educational attainment, and social isolation) known to impact an individual's digital health skillset [2, [4] [5] [6] . The NHIS questionnaires were assessed for questions that addressed any of the 4 social risk factors (Multimedia Appendix 1). Respondents were considered to have a social risk factor if they answered positively (eg, yes) to any question pertaining to any of the 4 social risk factors.

We used the digital health questions available in the NHIS questionnaires. To assess an individual's digital health skillset, we used the following question, "During the past 12 months, have you ever used computers for any of the following...?" with the following 4 subquestions: "...to look up health information on the internet," "...to fill a prescription using the internet," "...to schedule an appointment with a health care provider on the internet," and "...to communicate with a health care provider by email." We then summed the total number of digital health skills questions in which an individual stated they had performed that particular task in the prior 12 months to present a digital health skills count. Based on clinical experience, we then defined digital preparedness as having 2 or more of any of the aforementioned digital health skills, chosen to create a reasonable dichotomization between those who may have only completed one of these tasks and those who potentially partake in several different aspects of digital-based health care, thus being labeled as digitally prepared.

First, we calculated descriptive statistics for veterans who obtained care within the VA and veterans who obtained care outside the VA and included estimated proportions and their 95% confidence intervals. Next, we calculated the estimated prevalence of digital preparedness based on age, sex, race, ethnicity, and social risk among the 2 cohorts. Finally, we used logistic regression to estimate unadjusted and multivariable model odds ratios and 95% confidence intervals for each characteristic, with adjusted analysis controlling for all previously described covariates. We performed this analysis on the primary cohort and on the secondary, 2018 cohort for the sensitivity analysis. All descriptive and regression estimates accounted for the complex sampling design, and sampling weights were used to produce estimates representative of the US population. Given the unknown and complex pathways between the social risk factors, we assessed for multicollinearity between all variables before final modeling using variance inflation factor (threshold: >10) and tolerance values (threshold: <0.1) and found no evidence of collinearity. Statistical analyses were performed using SAS statistical software (version 9.4, SAS Institute Inc).

The analytic samples consisted of 3188 veterans who received care within the VA, and 3393 veterans who received care outside the VA. Those who received health care within the VA health care system were younger (age 18 c Used a computer in the past 12 months for any of the following. d Calculated by summing the total number of "yes" responses to the digital literacy questions.

On average, veterans who received care in the VA were more digitally prepared (answering "yes" to more than 2 digital skills questions; mean 25.2%) than veterans who received care outside the VA (mean 20.8%). This difference was most pronounced among those who were middle aged (age 50-64 years; 33.7% vs 20%), males (24.8% vs 18.4%) and those who identified as Black (25.9% vs 15.5%). Among women, those who received care outside the VA reported more digital health skills than those who received care within the VA (32.4% vs 25.9%; Figure  1 ).

Veterans who received care within the VA and who also reported economic instability (19.6%, 95% CI 13.4-25.8) and low educational attainment (19.6%, 95% CI 17.2-22.0) had the lowest prevalence of digital preparedness. Among veterans who received care outside the VA, social risk factors appeared to have a larger impact on the prevalence of digital preparedness (mean 15.5%) compared to those who received care within the VA (mean 21.2%), with individuals who reported low educational attainment (14.5%, 95% CI 12.6-16.5) having the lowest preparedness levels (Figure 2 ). 

In unadjusted analysis, older age (over 75 years), low educational attainment, and social isolation were associated with significantly lower odds of being digitally prepared, while being female, identifying as a racial minority other than Black (eg, Asian, American Indian, Alaska Native, Native Hawaiian, or Pacific Islander), and receiving care at the VA were associated with higher odds of digital preparedness. In In the sensitivity analysis among those who answered "yes" to "Have you ever enrolled in or used VA health care?" we found similar results. In adjusted analysis, receiving health care from the VA (aOR 1.33, 95% CI 1.04-1.69) was associated with digital preparedness (Multimedia Appendix 2).

In this national survey assessment of US veterans, we found that despite demographic and social disadvantages to digital uptake, veterans who received care in the VA reported more digital health skills and were more likely to be digitally prepared (defined as having more than 2 digital literacy skills) compared to veterans who did not receive care within the VA. While previous work has highlighted individual-level factors that can affect digital skills, to our knowledge, this is the first study to assess how the health care system in which an individual receives care may influence an individual's preparedness to use digital-based care. There are several potential explanations for these findings.

First, we found that veterans' digital skillsets may be low regardless of where they obtained care (within or outside the VA health care system). These levels are similar to other national data which show that approximately one-fifth of all Americans may not have proper digital literacy skills [12] . We note that digital health skills may be low due to the sociodemographics associated with the veterans cared for by the VA, as it selectively cares for individuals who are older, less educated, more rural, and with lower socioeconomic status [13] -all factors known to be associated with lower digital health literacy [4, 14, 15] . Despite these demographic disadvantages to digital uptake, veterans who receive care in the VA appear to have more digital health skills and be more digitally prepared than veterans who do not receive care within the VA, suggesting a positive, system-level influence on these individuals. We highlight potential age and gender differences between our survey respondents, who appear to be younger than the general veteran population (median age 57.5 [SD 15.2] years) and disproportionately female (median 11.5% among VA users and 8.8% among non-VA users) when compared to known VA demographics [16, 17] .

We hypothesize that the differences in digital skillsets and preparedness may be a product of the VA's historical use of telemedicine and digital-based tools. Beginning in 1994, the VA began a progressive uptake and use of telemedicine, with early phases characterized by local innovations and pilot studies centered around telehealth delivery [18] . A second phase of the VA's dissemination and use of telehealth modalities began in 2004 and centered around systems approaches that supported early adoption of telemedicine and created national clinical, technological, and business foundations for the VA's developing telemedicine platforms [18] . The growth in telemedicine use over the subsequent two decades led the VA to report that in 2016, 12% of all veterans had received some of their care through telemedicine modalities [19] , while fewer than 1% of Medicaid and rural Medicare beneficiaries used telehealth services during the same time period [20, 21] . In recent years, other large, integrated health care systems such as Kaiser Permanente have placed a large emphasis on the use of telemedicine to provide access to care for its constituents, although it is unclear how such efforts have impacted their constituents' digital health skills [22] .

In addition to its early use of telemedicine, the VA was an early adopter in using on-demand tools, mobile apps, and other forms of digital outreach to connect with the individuals it serves [23] . For example, in 2010, the VA was the first health care system to institute the Blue Button program, an online health portal that allows users direct access to their health data [24] . Additionally, in 2016, the VA was one of the first health care systems to perform mass distribution of video-enabled tablets to at-risk populations as a means of improving access to care [25] . We note that the impact of telemedicine and these programs may be amplified by veterans' rural demographics (approximately 25% reside in rural areas) [26] , and thus encouraging and potentially requiring greater use of these digital resources than the general public.

The nature of the digital health skills questions used in this assessment may also offer further insight into the degree of digital connectedness among these cohorts. While previous work around digital health primarily focuses on basic digital access parameters such as owning a computer or smartphone, access to broadband internet, and use of email [9, 27, 28] , the questions used in this survey represent higher order or more active engagement of digital health services than simply having access to a digital device or internet. This component of our assessment is particularly interesting given that prior research has found that digital connectedness is more often associated with younger age, higher education, and better health status [29] . Our findings highlight that while veterans have access to digital tools (eg, on average 80% use the internet or own a private computer) [9] , only 1 in 6 veterans who received care within the VA (and only 1 in 8 who received care outside the VA) use these skills to meaningfully engage the health care system (eg, fill a prescription, schedule a health care appointment, or communicate with a health care provider through a computer or the internet). These findings suggest that simply relying on questions that assess access technology or internet use to estimate digital literacy may overestimate the actual degree of digital health literacy among this group [30] .

Improving digital skills and literacy will be an important topic for health care systems to address as use of digital-based technologies expands in the coming years. It is well known that to improve use of digital tools, health care must go beyond access alone and improve individuals' digital and health knowledge, numeracy, navigability, communication, and decision-making skills [31] . Several strategies have been used to improve digital literacy, including collaborative learning (ie, interacting with others to improve an individual's digital skillset), which was found to improve participants' computer and web knowledge, digital self-efficacy, and overall literacy skills [4] , whereas studies that provided tailored educational interventions significantly improved not just digital literacy skills but health outcomes such as blood pressure [32, 33] and medication adherence [34, 35] . Our findings along with a review of the literature [4] show that interventions targeted at older, more vulnerable populations may be highly impactful and needed as more care migrates to such modalities.

Our study has notable limitations. First, the categorization method used to classify respondents based on where they receive their health care could misclassify some individuals, as some veterans may have military health insurance but could be obtaining care outside the VA. We note that our findings did not change when we performed a sensitivity analysis on respondents who directly stated they had VA-based health care. Second, our definition of being digitally prepared may be overly strict and potentially overpenalizes our characterization of who is digitally prepared. Third, this study did not include other potential risk factors that may have direct or confounding effects on digital preparedness, such as secondary barriers to digital access-cognitive, psychosocial, or functional barriers (eg, visual impairment)-that may impede optimal uptake and use of digital resources. Fourth, our outcomes of interest (digital health skills and digital health preparedness) are based on self-report, which could be biased or incorrect, as prior work has shown that individuals can both over-and underestimate their digital skillset [2], although such misclassification would likely be similar for those who receive care within the VA and those who receive care outside the VA. Fifth, the use of the term computer in the survey question could be misleading and may underestimate the use of cellphones or other smart devices to accomplish the queried task. Finally, this survey was conducted in the years prior to the COVID-19 pandemic, after which health care systems rapidly adopted telemedicine and other digital care modalities, and thus our findings may not be representative of current digital health skillsets or preparedness levels.

Veterans who obtain services within the VA report greater digital health skills and appear more prepared to engage with health providers through digital means compared to veterans who receive their care outside the VA health care system, despite a higher prevalence of risk factors known to negatively impact digital literacy. These findings suggests that while individual-level barriers to digital care exist, there may be system-level factors or influences that moderate such barriers among at-risk populations such as those served by the VA. As digital-based care becomes more prominent, future work should focus on what system-based interventions or programs are improving individuals' digital skillsets and ability to engage through digital mechanisms.

CW had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

None declared.

Domains and specific questions of social risk.

[DOCX File , 13 KB-Multimedia Appendix 1] 

Medline: 16867972] 2. van der Vaart R, Drossaert C. Development of the digital health literacy instrument: measuring a broad spectrum of Health 1.0 and Health 2.0 skills

eHealth literacy: extending the digital divide to the realm of health information

eHealth literacy interventions for older adults: a systematic review of the literature

eHealth literacy and Web 2.0 health information seeking behaviors among baby boomers and older adults

Navigating the digital divide: a systematic review of eHealth literacy in underserved populations in the United States

Utilization of interactive clinical video telemedicine by rural and urban veterans in the Veterans Health Administration health care system

What it will take to achieve the as-yet-unfulfilled promises of health information technology

| iss. 1 | e32764 | p

Internet use and technology-related attitudes of veterans and informal caregivers of veterans

Do diabetic veterans use the Internet? Self-reported usage, skills, and interest in using My HealtheVet Web portal

NHIS: National Health Interview Survey

Patient characteristics associated with objective measures of digital health tool use in the United States: a literature review

The VA health care system: an unrecognized national safety net

Opportunities for engaging low-income, vulnerable populations in health care: a systematic review of homeless persons' access to and use of information technologies

Telehealth and the digital divide as a social determinant of health during the COVID-19 pandemic

US veterans who do and do not utilize Veterans Affairs health care services: demographic, military, medical, and psychosocial characteristics. Prim Care Companion CNS Disord

The growth of telehealth services in the Veterans Health Administration between 1994 and 2014: a study in the diffusion of innovation

Are state telehealth policies associated with the use of telehealth services among underserved populations?

Utilization of telemedicine among rural medicare beneficiaries

Permanente's efforts to identify and address digital health disparities. Kaiser Permanente Institute for Health Policy

VA Blue Button: download my data

Increasing mental health care access, continuity, and efficiency for veterans through telehealth with video tablets

VA Office of Rural Health: rural veterans

How veterans with post-traumatic stress disorder and comorbid health conditions utilize ehealth to manage their health care needs: a mixed-methods analysis

Access to and use of the internet by veterans with serious mental illness

Digital connectedness in the Framingham Heart Study

Trends in seniors' use of digital health technology in the United States

Best practices in digital health literacy

Beta testing of a network-based health literacy program tailored for older adults with hypertension

Two self-management interventions to improve hypertension control: a randomized trial

| iss. 1 | e32764 | p

Tailored information and automated reminding to improve medication adherence in Spanish-and English-speaking elders treated for memory impairment

Effect of health literacy on drug adherence in patients with heart failure

Sensitivity analysis among 2018 respondents who stated they have enrolled in or used VA-based health care. [ ©Charlie Wray, Janet Tang, Amy Byers, Salomeh Keyhani. Originally published in JMIR Formative Research (https://formative.jmir.org), 28.01.2022. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.