key: cord-0073246-khscaub9 authors: Paul, Surjit title: Accessibility analysis using WCAG 2.1: evidence from Indian e-government websites date: 2022-01-10 journal: Univers Access Inf Soc DOI: 10.1007/s10209-021-00861-9 sha: 02d3080ef82d1b17f0f7e750ad1a0cf75dc1f612 doc_id: 73246 cord_uid: khscaub9 E-government is a global phenomenon. Many governments throughout the world are using e-government websites to deliver government services to their stakeholders. Consequently, it is now quite crucial for the governments to make sure that e-government websites must be accessible to all stakeholders regardless of their visual, cognitive, and hearing ability. However, many prior studies have shown that most of the e-government websites in different countries do not meet the accessibility guidelines prescribed in the Web Content Accessibility Guidelines (WCAG) of the World Wide Web Consortium (W3C). In this article, we present the evaluation of the accessibility of Indian e-government websites using a sample of 65 websites of various ministries based on the WCAG 2.1 standard. We found that the majority of e-government websites do not meet Level A conformance with WCAG 2.1. Our findings suggest that designers and developers of e-government websites should pay due attention to the accessibility features during the design and development of these websites to achieve universal accessibility. In this information age, the internet plays a pivotal role in accessing various information and services. Today people frequently use information systems to communicate and access information ubiquitously. Due to this reason, many governments have introduced e-government websites to cater government information and services to their various stakeholders [16] [17] [18] [19] [20] [21] [22] . According to the US general accounting office, e-government services are categorized into four models, namely, (i) government-to-citizen (G2C), (ii) government-to-business (G2B), (iii) government-to-government (G2G), and (iv) government-to-employee (G2E) [30] . The key objective of e-government websites is to provide equal opportunity in accessing information and services. Furthermore, governments should make sure that e-government websites should be accessible to every citizen to achieve citizens' trust and adoption of these websites. Therefore, accessibility is one of the important factors that determine the quality of e-government websites [1] ; it measures how differently abled people access and interact with e-government sites. Accessibility is determined by certain parameters, such as color choice, page layout, readability, etc. Hence, it plays a key role in building trust and ensuring successful e-government execution and service delivery [29] . Though accessibility is an important aspect that determines the quality of an e-government website, earlier studies have reported accessibility issues present in e-government websites [16] [17] [18] [19] [20] [21] [22] . Most of the e-government websites of various countries need to improve the accessibility dimension [16, 17, [20] [21] [22] . Also, many prior studies used the Web Content Accessibility Guidelines 1.0 (WCAG 1.0) or WCAG 2.0 to assess the accessibility of e-government websites, while very few studies used both. In 2018, the World Wide Web Consortium (W3C) introduced WCAG 2.1 [29] . WCAG 2.1 consists of a wide range of accessibility guidelines and has backward compatibility with WCAG 2.0. However, there is barely any study that can be found in the literature which utilized the latest accessibility guidelines provided by WCAG 2.1 to evaluate e-government websites. Therefore, this study attempts to address the prevailing literature gap by examining the accessibility of e-government sites based on the latest website accessibility standard WCAG 2.1, in the context of India, a developing nation. Moreover, this study presents implications for practitioners to improve the accessibility of Indian e-government websites by addressing accessibility issues. The remainder of the paper is organized as follows. In the second section, we present related works. The third section deals with the methodology used to evaluate accessibility of e-government websites. In the fourth section, the results are described. In the fifth section, we discuss implications for practitioners and researchers. Finally, the sixth section concludes the paper. E-government has impacted significantly both developed and developing nations [35] . It uses similar tools and techniques as e-commerce to offer government services to their stakeholders [27] . Many countries have implemented e-government services to their citizens [13] [14] [15] [16] [17] [18] [19] [20] [21] [22] [32] [33] [34] . The key benefits of e-government include minimizing corruption, increasing efficiency, transparency, convenience, cost reductions, etc. [36] . However, there are three major issues, namely universal accessibility, citizen focus in government management, and privacy & confidentiality that governments should consider for the successful implementation of e-government services [28] . Like other nations, India has also taken major steps toward the development and wide implementation of e-government services. In 2015, the digital India campaign was launched by the Government of India (GoI) to ensure efficient and effective delivery of government services to citizens [26] . Ever since e-government has played a critical role in service delivery to various stakeholders. However, despite all efforts to improve the adoption of e-government websites, the United Nations E-Government Survey 2020 published by the United Nations Department of Economic and Social Affairs (UN DESA) ranked India 100th in e-government development index (EGDI) [11] . After analyzing the EGDI ranking of India based on all published United Nations E-Government Survey reports from 2003 to 2020, we conclude that the ranking has gradually declined (from 87th in 2003 to 100th in 2020) as shown in Table 1 [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] . This shows that e-government initiatives still have a scope to improve in. Accessibility refers to making websites accessible to all persons irrespective of their cognitive, visual, and hearing abilities. Websites should provide equal opportunity to everyone to access information [28] . The W3C accessibility standards provide widely recognized guidelines for the accessibility of any website. The WCAG 1.0 was the first standard introduced by the W3C in 1999 to test the accessibility of a website [25] . In 2008, WCAG 2.0 came into existence with backward compatibility having a more comprehensive set of accessibility guidelines [23] . Furthermore, in 2018, WCAG 2.1 was introduced by W3C, which extends WCAG 2.0 with a wide range of recommendations for making web content more accessible to a wider range of persons with disabilities [29] . The main objective of WCAG 2.1 was to improve accessibility for three major groups, i.e., users with low vision, cognitive disabilities, and disabilities on mobile devices. A number of earlier studies examined the accessibility of e-government websites in various developed and developing nations [13] [14] [15] [16] [17] [18] [19] [20] [21] [22] [32] [33] [34] . These studies have highlighted the presence of accessibility issues in e-government sites across various countries based on accessibility guidelines of WCAG 1.0 and WCAG 2.0 standards. Most of these websites failed to meet conformance levels specified by WCAG standards. The accessibility studies on e-government websites in different countries are shown in Table 2 . Moreover, most of the earlier studies have used either WCAG 1.0 or WCAG 2.0 to analyze the accessibility of e-government websites. However, few studies have also used both accessibility standards [21, 38, 40] . In 2018, W3C came up with a new accessibility standard WCAG 2.1, but there is barely any study in the literature, which has utilized accessibility guidelines specified by WCAG 2.1 to analyze the accessibility of e-government websites. Hence, the current study perform accessibility evaluation of Indian e-government sites using WCAG 2.1 standard. Previous works have used many automated accessibility testing tools, such as TAW, WAVE, AChecker, eXaminator, EvalAccess 2.0, TAW 1.0, TAW 2.0, SortSite, etc., for analyzing the accessibility of e-government websites [15] [16] [17] [18] [19] [20] [21] 37] . Most of these tools evaluate the accessibility of a website against WCAG 1.0, WCAG 2.0, and Sect. 508. However, WCAG 2.1 is the current accessibility standard published by the W3C in 2018. WCAG 2.1 provides three diverse conformance levels (Level "A", Level "AA", Level "AAA") for web content accessibility. Table 3 shows the different conformance levels of WCAG 2.1. In this study, an automated website accessibility testing tool, SortSite, was used [37] . This tool has been developed to evaluate whether a website adheres to WCAG 2.1 and Sect. 508 guidelines or not. The tool provides accessibility testing of first ten web pages of a site in the online version. In the present study, a total of 65 e-government websites were selected across various ministries, such as information and broadcasting, law and justice, finance, electronics and IT, external affairs, tourism, science and technology, communications, road transport and highways, and corporate affairs of GoI. Out of these 65 websites, 27 sites belong to G2C, four websites are of G2B, and 34 are G2G sites. All websites belong to central and state government agencies. The dataset consists of a representative sample of Indian e-government websites. Information about these websites is available at [12, 24] . These websites are available in English. We analyzed the accessibility of 65 e-government websites using the SortSite tool. We identified that the average accessibility checkpoints errors across all 65 websites for Level A and Level AA are 8.34 and 1.74, respectively, as shown in Table 4 . Our findings indicated the evidence of accessibility errors based on both Level A and Level AA of WCAG 2.1 in the Indian e-government websites. However, none of the websites had accessibility errors based on Level AAA. We also found that out of 65 e-government websites, seven sites satisfy conformance Level AAA. Most of the accessibility errors are Level A, which is the minimum conformance level that every e-government website must satisfy for essential website accessibility. Otherwise, some groups of users find it impossible to access information on the websites. Moreover, on average, 1.74 Level AA errors were found in the Indian e-government websites. The presence of such errors makes websites challenging to access for some groups. We found 655 accessibility errors across all checkpoints of Level A, AA, and AAA. The percentage of total accessibility issues at various accessibility levels of WCAG 2.1 is shown in Fig. 1 . We found a number of violated checkpoints, including WCAG 2. Table 5 ). Thus, the accessibility error rate for Level A was 89.23%, Level AA was 78.46%, and Level AAA was 0.00% in the e-government websites. E-government websites play a crucial role in delivering government services to different stakeholders. Moreover, the importance of these websites has grown significantly in India during the present COVID-19 situation since most government services are being provided through online mode. Therefore, the accessibility features of these websites play a critical role in delivering services to a wide range of users. The present study contributed to the web accessibility literature by analyzing the accessibility of the Indian e-government websites using a sample of 65 websites of different ministries. The results reveal accessibility checkpoints errors based on Level A and Level AA of WCAG 2.1. Only a few Indian e-government websites adhere to accessibility guidelines of the WCAG 2.1. Our findings are similar to the existing accessibility studies, which have used WCAG 1.0 and WCAG 2.0 standards [21, 38, 40] . The outcomes highlight that many Indian e-government websites do not have conformance to Level A and Level AA of WCAG 2.1. Since these conformance levels are vital to improving universal accessibility, e-government sites should be designed and developed based on the accessibility guidelines prescribed by WCAG 2.1. The most violated checkpoint was WCAG 2.1 AA 1.4.3 (45 websites), followed by WCAG 2.1 A F54 checkpoint (41 websites) and WCAG 2.1 AA F24 (39 websites). Outcomes indicate that there is scope to improve the accessibility of Indian e-government websites. The following improvement measures such as onmouseout handlers should have an equivalent onblur handler, onclick handlers should have an equivalent onkeyup or onkeydown handler, unique id should be used for all elements, setting lang attribute to identify the language of the page, adding span element instead of scrolling marquee text, text and background colors have enough contrast, text color on the body and background color must be set correctly due to browser defaults, etc. should be considered during the design and development of e-government sites. The National e-Governance Plan (NeGP) of GoI aims to make all e-government services available to their stakeholders [26] . Hence, every e-government website should be designed and developed according to accessibility standards to improve the quality of these websites and for better citizen participation. The present study has a number of implications for e-government policymakers, website designers, and developers. The accessibility analysis results highlight specific critical accessibility issues based on WCAG 2.1, due to which some groups may find it impossible or even difficult to access information on the Indian e-government websites. Thus, the results reveal that accessibility features have not been given due attention during the design and development of e-government sites. Therefore, designers and developers 83% 17% 0% A AA AAA Fig. 1 Percentage of total accessibility errors in different levels should pay due attention to resolve the accessibility issues present in e-government websites: they should consider necessary accessibility improvement measures, such as adding an equivalent keyboard event handler to help users who are unable to use a mouse; unique id should be used for every webpage element; the lang attribute should be set to identify the language of the page; the marquee element should be replaced by a static element like span to allow low vision users sufficient time to read the text; text and background colors should have adequate contrast, as some users find it hard to read text on a white background, dark gray text on a black background and white text on a red background; text and background color must be set correctly according to browser defaults, etc. The current study extends the accessibility literature of e-government websites in two ways. First, to the best of our knowledge, the present study is the first of its kind that evaluates the accessibility of Indian e-government websites using the WCAG 2.1 standard. This study can also be used to evaluate the accessibility of e-government websites in other countries. Second, this study highlights the accessibility problems and the necessary measures to improve the accessibility of e-government websites. Accessibility is one of the critical dimensions to determine the quality of e-government websites. India is the second largest country in the world in terms of population, and as per the Census 2011, about 2.68 crores of people are disabled. Therefore, this study attempts to analyze the accessibility of Indian e-government websites using online evaluation tools. The outcomes clearly illustrate accessibility issues based on Level A and Level AA checkpoints of WCAG 2.1. Thus, we can conclude that the accessibility aspect has not been given due attention during the design and development of e-government websites. Poor accessibility may lead to ineffective service delivery and poor adoption among differently abled users. Therefore, there is a necessity to improve the accessibility of e-government websites, and this may help to improve the EGDI ranking of India. Evaluation instrument for e-government websites United Nations: UN global E-government Survey United Nations division for public administration and development management United Nations division for public administration and development management United Nations: Global E-government Readiness Report 2005 from E-Government to E-Inclusion United Nations Division for Public Administration and Development Management United Nations: Global E-government readiness report 2008 from E-Government to connected governance United Nations division for public administration and development management Leveraging e-government at a time of financial and economic crisis United Nations: UN E-government survey (2012) E-government for the People E-government for the future we want E-Government in support of sustainable development E-Government in support of sustainable development Digital government in the decade of action for sustainable development e-Government website accessibility: in-depth evaluation of Saudi Arabia and Oman. The Electron The accessibility of Chinese local government Web sites: An exploratory study Global e-government web accessibility: an empirical examination of EU, Asian and African sites Assessing the usability and accessibility of Malaysia e-government website Evaluating the accessibility and usability of top Saudi e-government services Accessibility evaluation of Dubai e-government websites: Findings and implications Accessibility as an integral factor in e-government web site evaluation: the case of Dubai e-government Accessibility evaluation and performance analysis of e-government websites in Nigeria Web accessibility evaluation of government websites for people with disabilities in Turkey Web site accessibility, usability and security: a survey of government web sites in Kyrgyz Republic W3C: Overview of WCAG 2.0 Documents Projects -National Informatics Centre. www. nic. in/ projects Recommendation Transforming Information Security Governance in India (A SAP-LAP based Case Study of Security, IT Policy and e-Governance). Information & Computer Security e-Government across the globe: how will 'e' change government. e-Government Building citizen trust towards e-government services: do high quality websites matter E-government in digital era: concept, practice, and development W3C: Web Content Accessibility Guidelines (WCAG) 2.1. Recommendation Universities of the Kyrgyz republic on the web: accessibility and usability Website accessibility: a survey of local e-government websites and legislation in Northern Ireland Web accessibility in the Mid-Atlantic United States: a study of 50 homepages Web site accessibility and quality in use: a comparative study of government Web sites in Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey Comparative e-Government E-government and developing countries: an overview Accessibility and usability of government websites in Tanzania Accessibility and usability analysis of Indian e-government websites Egovernment and web accessibility in South America