key: cord-0253917-1q457kzl authors: Haque, Md Mahfuzul; Yousuf, Mohammad; Alam, Ahmed Shatil; Saha, Pratyasha; Ahmed, Syed Ishtiaque; Hassan, Naeemul title: Combating Misinformation in Bangladesh: Roles and Responsibilities as Perceived by Journalists, Fact-checkers, and Users date: 2020-07-25 journal: nan DOI: 10.1145/3415201 sha: 394986abcc7bb5df85aecf476885f295a7820ede doc_id: 253917 cord_uid: 1q457kzl There has been a growing interest within CSCW community in understanding the characteristics of misinformation propagated through computational media, and the devising techniques to address the associated challenges. However, most work in this area has been concentrated on the cases in the western world leaving a major portion of this problem unaddressed that is situated in the Global South. This paper aims to broaden the scope of this discourse by focusing on this problem in the context of Bangladesh, a country in the Global South. The spread of misinformation on Facebook in Bangladesh, a country with a population over 163 million, has resulted in chaos, hate attacks, and killings. By interviewing journalists, fact-checkers, in addition to surveying the general public, we analyzed the current state of verifying misinformation in Bangladesh. Our findings show that most people in the `news audience' want the news media to verify the authenticity of online information that they see online. However, the newspaper journalists say that fact-checking online information is not a part of their job, and it is also beyond their capacity given the amount of information being published online everyday. We further find that the voluntary fact-checkers in Bangladesh are not equipped with sufficient infrastructural support to fill in this gap. We show how our findings are connected to some of the core concerns of CSCW community around social media, collaboration, infrastructural politics, and information inequality. From our analysis, we also suggest several pathways to increase the impact of fact-checking efforts through collaboration, technology design, and infrastructure development. Online misinformation is considered a major challenge for democracies as exposure to it tends to mislead people. This interferes with making informed decisions [65] . Although misinformation is a global crisis, measures to combat it vary with respect to geographical location, culture, socioeconomic context, and political situation. CSCW (Computer-Supported Collaborative Work and Social Computing) researchers examined the spread of misinformation and offered possible solutions, mostly in the context of the Global North 1 (e.g., [12, 41, 70, 125] ). There is a gap in the literature on misinformation in the Global South 2 . To this end, this research focuses on Bangladesh to understand people's perception of misinformation, how it is being combated, and what else can be done to fight against misinformation. By focusing on Bangladesh, this research enriches misinformation scholarship by adding knowledge from a country, where online misinformation has become a growing concern. Bangladesh, a South Asian country with a population over 163 million, has experienced several incidents of mob lynching and hate attacks caused by the spread of inaccurate and misleading information on Facebook. For example, a series of mob attacks killed eight people in July 2019 after false rumors about child abduction spread online [18] . The victims were targeted over rumors that human sacrifices were needed to build the Padma Bridge, a $3 billion project to connect the southern region of Bangladesh to its capital Dhaka. The rumor was that a group of child abductors were kidnapping children across the country to sacrifice them to build the bridge. The victims of the mob attacks were suspected by ordinary citizens of having been on the lookout for abducting children [18] . Another instance of misinformation leading to violence took place in 2012, where a Facebook post of a local Buddhist youth included a photo of a burned copy of the Quran, the Muslim holy book, that triggered an angry mob to set fire to Buddhist temples, loot and vandalize more than a hundred homes in a Buddhist village at Ramu in Cox's Bazar [74] . It was later found that the image was photoshopped and someone else posted the image on the youth's Facebook page. Other Facebook users mistakenly thought that the youth posted the image to defame Islam [121] . Fake news has also been a growing concern in Bangladesh where duplicate websites mimicking some legacy news organizations were created to spread misleading political news during the country's parliamentary elections in 2018 [7] . During that period, Facebook and Twitter also suspended several pages and accounts to curtail the spread of misleading news [141] . Despite having such serious and widespread impact, the ecology of misinformation in Bangladesh has not been studied thoroughly. The problem of rumors and misleading information is not unique to Bangladesh; other developing countries have experienced damaging consequences. For example, a doctored video of child kidnapping in India went viral on WhatsApp which created confusion among the general public. The video triggered mob attacks to kill at least two dozen people across India in 2019 [114] . Other developing countries such as Indonesia, Sri Lanka, the Philippines, Taiwan, Singapore, Vietnam have also suffered from misinformation [72, 75] . Although the consequences have similarities across countries, resilience and preparation to combat misinformation differ from a country to another [65] . So knowledge about misinformation from local contexts would benefit CSCW researchers. In this research, we interviewed journalists and fact checkers, in addition to conducting a survey with the general public in Bangladesh to understand how misinformation is being combated and to suggest possible solutions. Thus, this research offers the following contributions to CSCW literature: • This work provides a thorough understanding of the spread of online misinformation in Bangladesh and associated complexities. The findings of this paper thus adds knowledge to the CSCW scholarship around the global perspective on the misuse of information and communication platforms. • This study offers lessons on the strategies for combating misinformation and associated challenges. This study shows how these challenges are connected to a wider set of political issues that often remain invisible to us. • Finally, this study offers recommendations about design of technology to advance factchecking practice in a resource-constrained context, like Bangladesh. The problem of misinformation has recently been an important topic for CSCW scholarship as this problem has become a pressing issue across the world [65] . The problem, however, is not new. Misinformation, rumors, and propaganda are attributes of human communication that can be traced back to the Roman times when Antony and Cleopatra met. A misinformation campaign was designed to besmirch Antony [103] . In 1493, when the Gutenberg printing press was invented, the spread of misinformation amplified significantly; one earlier example of large scale hoax is The New York Sun's 'Great Moon Hoax' in 1835 [136] . As The Guardian columnist Natalie Nougayrède has observed: "The use of propaganda is ancient, but never before has there been the technology to so effectively disseminate it" [95] . According to World Economic Forum [44] and Edelman Trust index [38] , the spread of misinformation through social networks is one of the key problems gripping the world. Misinformation efforts have targeted elections and policy issues of the countries in the Global North. Russian interference in the 2016 U.S. presidential elections generated widespread concerns. It is believed that the Russian government made concerted effort to meddle with the elections in the forms of online political propaganda, targeted advertisements to U.S. voters via social media [15] . Russia is also believed to have conducted strategic information operations against the U.S. targeting political discourses, such as the #BlackLivesMatter movement [125] . Starbird et al. [125] found that the Russian Internet Research Agency (IRA) targeted, infiltrated, and cultivated politically active communities on Twitter to interfere with the movement. During the 2018 U.S. midterm elections, misinformation efforts targeted Latino voters [42] . Analyzing Reddit posts, Flores-Saviaga and Savage [42] observed that those posts lacked neutral actors to engage Latinos in political topics. The posts included the rhetoric that President Trump is either anti or pro-Latinos. During the UK referendum on EU membership, known as the Brexit, the spread of misinformation caused much concerns. Howard and Kollanyi [63] found political bots on Twitter designed to strategically target the Brexit conversations. Humprecht et al. [65] found differences in terms of resilience and preparation to combat misinformation in North American and European countries. European countries are more resilient to combat misinformation. On the other hand, the situation in the U.S. is worse than the European countries due to political polarization and less trust in media [65] . Latin American countries also suffered from the spread of misinformation. For example, during the 2018 presidential elections in Brazil, false information favoring Jair Bolsonaro went viral on WhatsApp [13] . African countries also experienced damaging consequences from the spread of misinformation. For example, in South Africa, there were rumors that the coronavirus only affected white people. This led some residents to ignore warnings of getting infected. The South African government has criminalized the spread of misinformation about the virus [139] . In neighboring countries of Bangladesh, such as India, Myanmar, and Sri Lanka, misinformation efforts targeted religious sentiments [66, 102, 106] . In India where Hindus are the majority, misinformation targeted the minority Muslims. Fabricated images and news of cow slaughtering by Muslim men went viral on WhatsApp which resulted in killing of Muslim men [75] . Similarly, in Sri Lanka and Myanmar, where Buddhists are the majority, Muslims were targeted during the 2019 bombing in Sri Lanka and Rohingya crisis in Myanmar [75] . In sum, the literature review suggests some patterns across countries in the developed and developing countries. For example, in North American and European countries, misinformation efforts mostly targeted elections and political discourses. Misinformation efforts also targeted mostly elections in the countries in Latin America and Africa. However, in South Asian countries, such as Bangladesh, India, Myanmar, and Sri Lanka, misinformation efforts mostly targeted religious sentiments. In response to this pressing problem, countries have taken various measures to combat misinformation. Governments, journalists, fact-checkers, educators and other entities across the world have taken various steps and are following certain strategies to combat misinformation. Below, we cover various approaches currently employed to combat the problem. The practice of fact-checking began in the United States newspapers to verify claims of politicians as early as in 1980s [51] . The campaign of Ronald Reagan in 1979-1980 had been an impetus to the rise of fact-checking [37] . During the campaign for the presidential race, Reagan claimed that trees caused four times more pollution than automobiles. When Reagan became the president, reporters began verifying his press conferences and television statements, often adding a sidebar to the coverage of him, although the practice did not sustain [37] . Factchecking has also been seen in the 1990s when "Adwatch" reports verified claims made by political advertisements [45] . Later, fact-checking began to develop when the FactCheck.org was founded in 2003 with a pool of staff who were professional journalists. PolitiFact and the Washington Post's Fact Checker were established in 2007. PolitiFact and Factcheck.org played a key role in popularizing fact-checking when they got Pulitzer prize and some leading newspapers quoted their fact-checks. The organizations collaborated with newspapers so as to introduce fact-check in journalists' regular work [8] . The movement became transnational in the subsequent years. Fact-checkers around the world meet annually at the conference of the IFCN (International Fact-checking Network), a platform of the Poynter Institute, where they share their experience and challenges [51] . Currently, 188 fact-checking organizations in 60 countries have been working as per the Duke Reporters' Lab [126] . However, due to the lack of sustainable business model, many fact-checking organizations cannot sustain for long [56] . Making people media literate to combat the spread of misinformation is considered a way in which people are provided with a set of critical thinking skills to evaluate media content [29] . Media literacy refers to a set of knowledge, skills, and habits of mind required for full participation in a contemporary media-saturated society [60] . Although misinformation has affected people across the world, the initiatives on media literacy mostly confined to the developed nations. For example, in the United States, most of the media literacy efforts focus on teachers training and curricular development. The teacher training programs relating to media literacy include the Media Education Lab at the University of Rhode Island and the Project Look Sharp at Ithaca [29] . Some news organizations such as The New York Times and Washington Post offer curricular resources around information credibility, use of evidence, and news production [29] . As a way to combat misinformation, other developed nations such as Germany and Australia have introduced media literacy education at the school level [59, 132] . In the developing countries such as India or Bangladesh, the spread of misinformation has become a growing concern. It should be noted here that media literacy is also dependent on tech-literacy and literacy in general. Designing appropriate technologies for low-literate people still remains a challenge for researchers in HCI4D and ICTD areas [4, 5, 83, 84] . Despite these challenges, a few steps have been taken to make people aware about misinformation. In December 2018, ahead of the general elections, WhatsApp ran a television campaign to fight back circulation of fake news and asked users to check the integrity of the information they receive [16] . In another initiative, local police of Mahbubnagar district in the Telangana state in southern India used town criers and staged folk songs to fight misinformation and stop hate attacks caused by it [71] . Although Bangladesh has similarly been suffering from the spread of misinformation, to the best of the authors' knowledge no media literacy program is in effect to combat misinformation. As people across the world have suffered from misinformation, many countries have taken measures to combat it. For example, the counter-propaganda agency named the EU East StratCom Task Force was created in 2015 at the direction of the European Council to respond to Russia's disinformation campaigns. The agency debunked thousands of cases since it was established [127] . The Chinese government also took a policy of engaging the general public to combat misinformation. A 2014 report stated that two million people were involved in online content monitoring [127] . Some European countries such as Italy have criminalized sharing and posting of 'false, exaggerated or biased' information and imposed fines of up to 5,000 Euros [16] . Many other countries across North America, Europe, Asia, and Africa have also enacted laws and taken policy measures to combat misinformation [46] . Researchers across different disciplines have proposed computational, algorithmic approaches to combat misinformation. For instance, a group of researchers, primarily from the University of Texas at Arlington, developed ClaimBuster, an end-to-end factchecking system, that can automatically detect check-worthy factual claims and check with respect to already fact-checked claims or knowledge bases [57] . They leveraged machine learning, natural language processing, and database query techniques in designing the system. ClaimBuster is constantly monitoring factual claims from various sources including interview transcripts, social media, congressional records, etc. These claims are then sent to a political fact-checking organization, PolitiFact.com through email. The use of ClaimBuster demonstrated that automated reporting tools can handle important journalism tasks that reduce editorial workloads. However, a human touch is needed to increase the effectiveness of algorithms that alert editors of possible political falsehood [1] . Researchers from Indiana University has developed several tools to detect misinformation spread by social bots [81, 140] . For instance, Hoaxy [113] can monitor social networks and visualize how a fake claim and its related fact-checks spread on Twitter. The Botometer (formerly BotOrNot) [36] can detect whether a Twitter account is a bot or not. These tools use natural language processing and artificial intelligence to find patterns in text data. Some researchers proposed knowledge-based solutions. For example, Shu et al. [119, 120] analyzed the misinformation problem from data mining perspective and developed a benchmark dataset for misinformation detection. Others leveraged existing crowd based knowledge networks such as Wikipedia to detect misinformation [32, 115] . While the computational techniques are excellent as starting steps towards more robust misinformation combating systems, they need some facilities such as access to information, smart data infrastructures, freedom of press and so on, which might not be available in certain regions, particularly in many developing countries. There exists a knowledge gap regarding how computational solutions for combating misinformation should be designed where such facilities do not exist. Researchers have examined the affordances of social networking sites to detect misinformation. Metaxas et al. [86] examined the application of Twittertrails, an interactive, web-based tool (twittertrails.com) that allows users to investigate the origin and propagation characteristics of a rumor and its refutation on Twitter. The findings suggest that the tool can collect relevant tweets and detect its originator, when and how the story broke, and propagators. CSCW researchers also examined the roles crowd can play to detect and debunk misinformation [12, 47, 70, 78, 110] . This and many other such works demonstrate the the research on misinformation has been an active interest within CSCW community, but most of these studies lack the perspective of the Global South. Hence, many important infrastructural challenges and regional politics have been missing in this vein of CSCW work. This paper aims to fill in that gap. Academics and professional organizations proposed long lists of objective and subjective ethical criteria that constitute excellence in journalism [21, 30, 34, 85] . To mention a few, the subjective criteria include integrity, good writing, and professionalism while objective criteria include independence, and public welfare [85] . Bogart [21] offered a combined list of objective and subjective criteria that includes "integrity, fairness, balance, accuracy, comprehensiveness, diligence in discovery, authority, breadth of coverage, variety of content, reflection of the entire home community, vivid writing, attractive makeup, packaging or appearance, and easy navigability. " The Society of Professional Journalists (SPJ) listed four principles in its ethics code as "the foundation of ethical journalism": seeking truth, minimizing harm, acting independently, and being accountable and transparent [122] . Kovach and Rosenstiel identified truth and independence as journalismâĂŹs first obligations and verification as its essence [77] . They noted that journalism seeks a âĂIJpractical and functional form of truthâĂİ as âĂIJall truths -even the laws of science -are subject to revisionâĂİ. The journalistic process of seeking truth begins with gathering and verifying facts and then providing a logical conclusion of their meaning. Though some principles such as fairness, balance, and objectivity are considered universal journalistic values, they are not prominent in either the SPJ ethics code or the Kovach and RosenstielâĂŹs book, two key references for journalistic values. Kovach and Rosenstiel described fairness and balance as ideas âĂIJtoo vague to rise to the level of essential elementsâĂİ of journalism [77] . Objectivity is another such an idea that is often used by critics to make a case against fact-checking. As Kovach and Rosenstiel noted, âĂIJThe concept of objectivity has been so mangled it now is usually used to describe the very problem it was conceived to correctâĂİ p. 6 [77] . The ambiguity regarding objectivity led to disagreements in the journalism community over fact-checking. Many news outlets across the world embraced fact-checking while scholars described it as a âĂIJgenre of journalismâĂİ that serves some core journalistic duties such as monitoring power and providing accurate information [27, 33, 49, 61] . Meanwhile, critics argue that factchecking violates the traditional objectivity principle by adjudicating claims. Refraining from adjudicating claims had been part of news organizationsâĂŹ routines for decades, which were aimed at protecting journalists and news organizations from âĂIJoccupational hazards such as libel suitsâĂİ [117] . For example, the press carried U.S. Senator McCarthyâĂŹs false accusations against communists in the 1950s, although reporters knew those accusations were false. It was done to maintain âĂIJthe resilient objective routineâĂİ and keep reporting patterns intact [117] . The most sustained criticism of fact-checking is that it ignores the value-laden nature of political debates and seeks to recast discourses as lies and facts instead of differences in worldviews [50] . However, Kovach and RosenstielâĂŹs definition of truth as practical and function debunks this claim [77] . Graves added that âĂIJIn newswork routines, internal discourse, and public statements, fact checkers demonstrate constantly that they appreciate the ambiguous character of facts in politicsâĂİ [50] . Though fact-checking is rooted in journalism and many fact-checkers working in independent organizations are celebrated award-winning journalists, fact-checkers perceive their roles and contributions to society to be unique and different from the roles and contributions of journalists [53, 116] . Having a network (the International Fact-Checking Network at Poynter) and an ethics code of their own supports this argument. Lowrey [82] found that fact-checking organizations were developing sustainable new practices and showing signs of being institutionalized. Further analysis of the differences between journalism and fact-checking is beyond the scope of this study. Bangladesh got connected to the Internet in 1996, offering access to online content and e-mail communication [14] . However, Internet use was confined to urban areas due to its limited availability and higher price of internet data [54] , and is often cut off by the government [20] . The Internet use experienced a dramatic growth during the 2010s when mobile phones and internet data became affordable. As of August 2018, the total internet connections reached 90 million, among which around 85 million accessed the Internet through mobile phones [124] . The government of Bangladesh adopted the Information, Communication and Technology (ICT) policy in 2009 by coining the slogan "Digital Bangladesh" to bring about socioeconomic transformation through ICT. As part of its effort, the government has digitized some of its public services such as online submission of tax returns, online tender, registration for overseas jobs [104] . Bangladesh earned nearly $800 million in 2017, exporting locally made software and providing services like outsourcing and freelance work [123] . This connectivity has turned out to be a double-edged sword because the Internet has contributed to human and economic development, but at the same time, this has also often plunged people of Bangladesh into some other threats (see [3, 55, 89, 90, 96, 105] , for example), including this important one: exposure to online misinformation. Article 39 of the Constitution of Bangladesh guaranteed right to expression and freedom of the press; however, governments have enacted some laws that are conflicting with Article 39 [2] . To regulate digital communications, the government of Prime Minister Khaleda Zia enacted the Information and Communication Technology (ICT) Act in November 2006. Section 57 of the Act caused concerns about its ostensible goal to restrict freedom of expression [62] . The Section authorized prosecution of anyone who publishes, in electronic form, material deemed fake, obscene, defamatory, or any material that tends to deprave or corrupt its audience [108] . In 2013, Sheikh HasinaâĂŹs government toughened the ICT Act, eliminating the need for arrest warrants [108] . Between June 2016 and May 2017, 300 people were arrested under the ICT Act and 19 journalists were implicated. The government also blocked several messaging apps and blogs to curb the spread of misinformation. In August 2016, 35 news websites were blocked for publishing objectionable contents about the government [62] . The government of Prime Minister Sheikh Hasina nullified the 2006 ICT Act and passed a new law called the Digital Security Act in 2018 [97] . This Act also has sections that impose restrictions on freedom of expression. According to news reports and human rights organizations, this Act is used to suppress freedom of expression [31, 68] . The government charged or arrested 20 journalists on charge of violating this law in less than five weeks in April and May 2020 [31] . According to the Reporters Without Borders, the government âĂIJhas a custom-made judicial weapon for silencing troublesome journalists âĂŞ the 2018 digital security law, under which 'negative propaganda' is punishable by up to 14 years in prison. As a result, self-censorship has reached unprecedented levels because editors are reluctant to risk imprisonment or their media outletâĂŹs closureâĂİ [24] . Although this law was enacted to control the spread of online misinformation, the government has been criticized for using the law to control dissent voices [10, 39, 40, 118] . Governments have also used various laws to control the press [2] . The level of freedom Bangladeshi media enjoyed fluctuated over time. Media was under tight government control in the first two decades since Bangladesh had gotten independence from Pakistan in 1971. The media started enjoying some freedom and flourishing after a revolution that ousted the countryâĂŹs then autocratic ruler and installed a democratically-elected government in 1991 [11] . Mahfuz Anam, editor of The Daily Star, an English-language daily in Bangladesh, had once suggested that the best gift for BangladeshâĂŹs democracy was press freedom [11] . However, press freedom in the country kept worsening in the last decade. Organizations tracking press freedom across the world suggest the situation in Bangladesh has continued to worsen since 2009. On the World Press Freedom index, Bangladesh slid to 151 st position in 2020 -worse than Afghanistan, Pakistan, Russia, Venezuelafrom 121 st position in 2009 [22, 23] . This research aims to understand the roles and responsibilities perceived by the masses, journalists, and fact-checkers to combat misinformation in Bangladesh. We applied a multi-stakeholder approach in this research. There are both quantitative and qualitative research elements in this study. We gathered qualitative data from the semi-structured interviews with Bangladeshi journalists, fact-checkers, and users. The quantitative data were derived from a survey with the internet users. One rationale for using the mixed methods approach is that while the survey enabled us to reach a large number (N=500) of internet users, a closer look into the demographics revealed that most of the users were educated (78.8% having at least a bachelors degree). So, we conducted in-person interviews to gain the perspectives of other demographics such as house maids, drivers who traditionally don't have higher education and are also hard to reach through online-based surveys. Another reason is, an in-person interview enabled us to ask open-ended questions which gave us detailed views of their exposure to online misinformation. Below, we describe the questionnaire development, participant recruitment, interview and survey protocol, and data analysis methods in detail. We developed four separate sets of questionnaires to conduct the survey and interviews. While developing the questionnaires, we have taken into consideration the literature related to journalism practices [9, 51] , fact-checking mission and process [50, 137] , perceived credibility of news [43, 87] and crowd-source fact-checking [56, 79, 94] . Four authors of this paper collaboratively developed the questionnaires. First, the questionnaire for fact-checkers was designed to understand their work, verification process, and challenges. To develop the questionnaire, we reviewed literature relating to fact-checkers' work in the context of North America, Europe, Latin America, Africa, and Asia (e.g., [51, 52] ). We piloted the questionnaire with two fact-checkers in Bangladesh. Based on their feedback, we revised some questions and then finalized the questionnaire. Second, to develop the questionnaire for journalists, we reviewed related literature about fact-checking practice in journalism (e.g., [49, 82] ). We piloted the questionnaire with two journalists to finalize it. Third, the survey questionnaire that included a mix of multiple choices, Likert items [73] , and some open-ended questions was designed to gather data about how internet users in Bangladesh confront misinformation. The survey was reviewed by survey experts so as to ensure the best practices were followed for obtaining valid, high-quality data [107] . After piloting the survey, we modified the language of some questions and answer choices. Fourth, we developed another questionnaire for semi-structured interviews with users. The survey questionnaire guided us to develop the interview questionnaire that allowed interviewees to offer detailed viewpoints about their exposure to misinformation. The Institutional Review Board (IRB) of the authors' institutions examined and approved the questionnaires. In the appendix section, we have included the interview protocols. The survey questionnaire can be found to this link 3 . There are three active fact-checking organizations in Bangladesh-BDFactCheck (www.bdfactcheck.com), Jaachai (https://www.jaachai.com/), and Fact-Watch (http://www.factwatch.org/). Both BDFactCheck and Jaachai have three fact-checkers respectively. Fact-Watch has nine fact-checkers. These organizations have fact-checked 542, 110, and 60 claims between 2017 and 2019 respectively. We reached out to these organizations through their Facebook Messenger account for interviews. We also contacted them via email. Seven of them responded and agreed to give interviews. Three fact-checkers were from BDFactCheck, three from Fact-Watch, and one from Jaachai. All the interviewees were male. There are print, broadcast, and online-only news organizations in Bangladesh. The print and broadcast media also offer their online versions. We confined this study to print media because newspapers are the oldest news media in Bangladesh compared to broadcast and online-only media. To recruit participants in this research, we identified 15 of the most circulated print newspapers in Bangladesh [100] . Then we reached out to 30 journalists of these outlets (two from each) via emails and phone calls. We recruited editors and journalists covering political beats. Political beat journalists were recruited because mostly political misinformation spreads to a greater amount [49] . As a result, political journalists need to fact-check beside their regular verification. We also recruited editors because they make editorial decisions. In total, 12 journalists from nine newspapers-five Bengali-language and four English-language dailies -agreed to give interviews. The Bengali-language newspapers include-Prothom Alo (https://www.prothomalo.com), Kaler Kantho (https://www.kalerkantho.com/), Ittefaq (https://www.ittefaq.com.bd/), Jugantor (https://www.jugantor.com), and Manab Zamin (https://www.mzamin.com/). The English-language dailies include-The Daily Star (https://www.thedailystar.net/), Dhaka Tribune (https://www.dhakatribune.com/), The Independent (http://www.theindependentbd.com/), and New Age (http://www.newagebd.net/). Among the 12 interviewees, five were editors, one special correspondent, four chief reporters, and two junior reporters. Among them, two were female and 10 were male. 40 19 Ph.D. 14 Other 16 We conducted an online survey and in-person interviews to understand how Bangladeshi internet users confront, perceive, and combat online misinformation. We designed the survey instrument and interview questionnaire following the findings from existing research on perceived credibility of news and crowd-source fact-checking. The survey included four demography questions, seven multiple choice questions, and one open-ended question. To recruit participant for the survey, we shared the survey link on Facebook. Researchers of this study also requested their friends and families to participate in the survey and share the survey link with others. In addition, the authors shared the survey link to an assorted set of general interest Facebook groups. In total, we received 500 responses. The participation was voluntary and anonymous. Table 1 shows demographic (age, education, occupation) information of the participants. About 74% of the participants were from the 21 − 30 age range, 78.8% completed Bachelors or a higher degree, and 64% were students. About 63% of the participants were from the capital, Dhaka. To recruit participants for in-person interviews, we followed convenience sampling [69] method to reach out to the respondents. To cover different user groups, we interviewed housemaids, drivers, and elderly citizens in addition to students and service holders. In total, there were 29 participants. They included 13 males and 16 females. They belong to a diverse set of groups-10 of them were students, 3 car drivers, 4 maids, 5 housewives, 4 service holders, and 3 retired citizens. The distribution of their highest level of education is-3 with no education, 1 up to 5 th grade, 5 in high school, 14 with a Bachelors degree, and 6 with a Masters or above. Table 2 presents details of the interviewees. We understand the risks involved with convenience sampling such as bias and insufficient power [25] . However, we argue that our online survey and in-person interview methods complement each other and help reduce the bias involved in each method. Moreover, convenience sampling allows to gather rich qualitative data [64] . We followed a mix of structured and unstructured interview questions. Interviewers followed the predefined questionnaires (see Appendix) to conduct the interviews. Supplementary questions were also asked for more details. After the initial round of the interviews, we reached out to the fact-checkers and journalists again to follow up with some additional questions. Interviews with fact-checkers were conducted via Skype. The interviews were recorded. The average length of the interviews was 80 minutes. Among the interviews with journalists, seven were conducted via Skype and five were in-person, with an average length of 33 minutes. We recorded the interviews. Interviews with internet users were in-person with an average length of 30 minutes. Consents were taken from the participants following the IRB guidelines. The interviews and the survey were conducted in the native language, Bengali. Two authors of this paper, who also have journalistic experience of an average of 5 years, conducted the interviews, then transcribed, and translated into English. The two interviewers are native Bengali speakers and proficient in English. We applied thematic analysis method to analyze the interview data. Following the methodological lessons of Bryman [28] on thematic analysis, two authors coded the interview transcripts of journalists, fact-checkers, and users. The two authors first separately read the transcripts several times to find out themes and its supporting evidence. Specifically, first, the two coders transformed the raw interview data into brief codes. Then, we found connections among these codes following axial coding principles [111] . For example, we identified the internet users' responses that were related to misinformation perception. After that, we analyzed the codes, identified patterns among them, and developed an initial set of themes covering the underlying structure of experiences or processes that were evident in the raw data. We conducted within-narrative and between-narrative comparisons [58] while developing the themes. Then the two coders together discussed the themes until consensus was reached. To report on interview findings, we kept interviewees anonymous considering their safety. The top editors and senior reporters in Bangladesh, interviewed for this study, agreed unanimously that misinformation spreading on the Internet was causing harm to society. But their organizations did not have the capabilities and resources to contain them. Almost none of these news organizations has a fact-checking unit meant to debunk false information floating on the web. Some have social media units that monitor the internet primarily to find news tips. Only two journalists -one from daily Prothom Alo and the other from The Daily Star -were able to recall a few stories their newspapers had published about some viral photographs. The photos were falsely associated with events and got published in some leading newspapers. Only a few interviewees knew about the fact-checking organizations in Bangladesh, and no one ever cited them in their stories. However, these journalists suggested that fact-checking by independent organizations would supplement and improve journalism and hold professional journalists more accountable. In summary, three major themes emerged from the interviews with the journalists in Bangladesh. • Hands of news organizations are tied as misinformation spreads on the Internet. • News organizations monitor social media to find news tips, not to counter misinformation. • Fact-checking by independent organizations supplements journalism. Hands Tied As Misinformation Spread. Although journalists routinely perform verification and possess the skills required for fact-checking, the mainstream news organizations in Bangladesh follow traditional routines and gatekeeping processes. Journalists select stories based on newsworthiness and verify claims made by people with authorities (e.g., government officials and politicians) before adding them to stories. Some interviewees said they would welcome a separate fact-checking unit in their newsrooms, but the objective of such a unit would be to strengthen the verification process as government sources and politicians often make false or misleading claims. For example, journalist 1 of Dhaka Tribune noted: Political leaders often provide inaccurate information and, in some cases, lies. Recently, we have heard that a conspiracy to kill our prime minister was going on. Political leaders from her party repeatedly said it. But later it was found out to be incorrect. But an additional fact-checking unit would require additional resources and funding that most organizations cannot afford. Journalist 2 of New Age said: It would have been great if we had such a research unit, but it requires human resources and funding. We are facing a crisis in both cases. However, the interviewees said fact-checking information floating online was not part of a journalist's job. It is beyond their ability given the amount of information being published online and the complexity of the situation. Some suggested that some viral misleading stories drew their attention and they were willing to publish a response to help their readers, but they were unable to do it. Citing the suspension of several Facebook and Twitter accounts that were allegedly run by people with links to the government to spread misinformation, journalist 3 of a Bengali-language daily said intelligence agencies are often behind the spread of misinformation. The journalist noted, The government started spreading fake news in Bangladesh. We have seen such activities during the recent national election when a bunch of fake or duplicate websites of national and international news outlets were made to spread fake news. Journalist 4 of an English-language daily also noted that intelligence agencies were a major source of misleading information. While other journalists refrained from accusing any government agency of spreading false information, they unanimously agreed that journalists in Bangladesh lack freedom to tell stories in a neutral manner. Social Media Usage Not Meant to Counter Misinformation. It is evident in the interviews that journalists in Bangladesh keep an eye on social media. While a few news organizations have teams designated for social media only, others rely mostly on reporters. However, the main objective of monitoring social media is to find news tips. Journalist 5 of The Daily Star said, I think social media help us by providing clues to news items, especially when something happens in remote areas of the country. These clues often materialize into news stories and get published if the reporters are able to verify the authenticity of related information. Most of the journalists interviewed echoed this sentiment. Journalist 2 of New Age said, In some cases we find something newsworthy on verified pages of socially, culturally, politically or nationally important persons...we consider them news. For most news organizations, uses of social media are not generally meant to fact-check misinformation or write pieces debunking misleading news. However, some journalists said they occasionally write stories about misleading photos if they get the necessary evidence to prove they are misleading. The examples they provided indicate that they would write such stories if those stories get published in some mainstream news media. For example, journalist 5 of The Daily Star recalled running a fact-checking story. During Rohingya crisis, a mainstream newspaper in Bangladesh published some pictures which were fake. Some of the pictures were from Nigeria. We published a counter piece describing that content the newspaper published was fake. We did it because we thought such fake items would interrupt social and religious harmony in Bangladesh. One key concern that emerged from interviews with journalists in Bangladesh is that misinformation often gets published in known newspapers as they rely on social media for news. Most editors, however, claim that they do not publish unverified claims or information from social media. Journalist 6 of Jugantor explained the process of dealing with misleading information online. When something viral appeared to be a rumor, our news management team works on the issue and verifies credibility of the information. Me and a few other news editors, joint news editors, associate editors, chief reporter and shift in-charges work in the team. Yet, some rumors get published and journalists agree that misinformation published in newspapers can be more damaging than misinformation spreading on the internet. Journalist 7 of Prothom Alo claimed: We have seen some online news outlets publish news in a hurry without proper verification. People share these pieces on social media. Mainstream newspapers sometimes publish the same items without further verification. However, journalist 7, whose organization is one of the few that does fact-checking, said the goal of his social media team is to make sure that misleading information does not get published in his newspaper, but not to counter misinformation on social media. Independent Fact-checking A Growing Avenue of Journalism. Most of the interviewees agree that fact-checking by independent organizations would improve the quality of journalism given that they follow the accuracy standards of journalism. For instance, journalist 8 of Kaler Kantho said, I think fact-checkers will make journalists and news media more accountable... Their critical eyes on our work would make us more responsible. Journalist 9 of Manab Zamin strongly emphasized on the need for independent and unbiased fact-checking organizations. Journalist 2 agreed: Fact findings supplement journalism... I would have welcomed them. But it is hard to assess their reliability and integrity. If they maintain these, they are welcome. They might make journalists' work easy. Some argue that fact-checkers perform only a part of journalism. In other words, fact-checkers are carving out a niche within the field of journalism. Journalist 10 of Dhaka Tribune suggested that fact-checkers take on some tasks that journalists working for mainstream news organizations find hard to do. For instance, reporters are not well equipped with technology and technical issues, in which factcheckers are doing well. A few other journalists such as journalist 7 echoed the sentiment. Journalist 10 also suggested that fact-checkers may deal with rumors and misinformation floating online while news organizations can stick to their typical news routines. However, journalists in Bangladesh are divided on whether they need a separate fact-checking unit in their own organizations. Some said a specialized fact-checking unit would help them while others think reporters are already doing fact-checking. Fact-checkers in Bangladesh, interviewed for this study, noted that they started verification in response to the increasing amount of misinformation and rumors on social media. Most of these initiatives such as Jaachai and BDFactCheck were started voluntarily by some university students and some young journalists. By contrast, Fact Watch began as an initiative of the Media Studies and Journalism department of the University of Liberal Arts Bangladesh, receiving a grant from the American Center in Bangladesh. Overall, the motivation for setting up fact-checking initiatives in Bangladesh was to debunk misinformation that went viral on the web and to offer facts to the general public who is most likely susceptible to misinformation. Despite various constraints such as unavailability of data archives, political pressure, and scarce human and technological resources, these initiatives have been verifying claims relating to politics, health, religion, and consumer services. The following themes emerged from interviews with seven fact-checkers from three organizations. • Working voluntarily interferes with paying full attention to fact-checking. • Political pressure and scarce resource lead to biased selection of topics for verification. • Fact-checkers mostly use information available in open sources to verify claims. • Fact-checkers are lagging behind due to the lack of technological support. Working Voluntarily Interferes With Fact-checkers' Work. The fact-checkers in Bangladesh have started the work of fact-checking from their motivation to offer facts to the general public, without having any prior training and institutional infrastructure such as an office space and payment for work. Most of them perform this work in addition to their full-time job and studentship. This results in interfering with paying full attention to their work. For instance, fact-checker 1 of BDFactCheck said, "I wish I could take it as my main profession. But I have to do my main job to earn my living. I am doing fact-checking from my passion. " The team of Jaachai paused their work in December 2018 because the members could not put in enough time to do verification in addition to their regular jobs. These initiatives have been functioning voluntarily because they cannot apply for any grant. They would need accreditation from the government to apply for a grant; however, the government of Bangladesh does not have any procedure to offer an accreditation to fact-checking organizations. Fact-checker 1 noted: The primary requirement to apply for any grant is to have registration, which we do not have. We also cannot apply to be registered as a fact-checking organization with IFCN for that. The only exception was Fact Watch that started its work as a platform of the University of Liberal Arts Bangladesh, receiving a ten-month grant from the American Center. During that period, its fact-checkers got paid. However, with the expiration of the grant, Fact Watch was in transition to be introduced as a co-curricular activity of the university. It is evident in the interviews that fact-checkers in Bangladesh started the work of verification without having any prior training. The work of western fact-checkers has been an inspiration for them. For example, given the growing amount of misleading claims on social media fact-checkers with Jaachai started verification of those claims and then published those on its Facebook page named "Share content with utmost care". Fact-checker 2 of Jaachai said: We had little idea about the term "fact-checking" when we first started debunking claims. Later, we got to know about this practice looking through the work of Snopes which inspired us to turn our Facebook page to "Jaachai" with its own website. Political Pressure And Scarce Resource Lead To Biased Selection Of Topics For Verification. One key concern that emerged from the interviews was that political pressure interferes with fact-checkers' selection of topics for verification. Fact Watch has decided to verify claims relating to public health and environment only, not political claims, fearing political backlash, ramifications, etc. Fact-checker 3 of Fact Watch explained: Some misinformation goes against the government; some, on the other hand, support and praise the government. Although the government wants to combat misinformation, but not always when the items support its activities. This practice creates a problem for independent fact-checkers. We cannot choose all the claims for verification with absolute freedom. Such situations lead us to be self-censored. Fact-checker 4 of BDFactCheck echoed similar concerns. The fact-checker said, "When we choose political claims for verification, we have to keep in mind whether or not it would be very critical of the government. " Fact-checker 1 provided an example: We were worried when we chose to verify the claim whether the prime minister of Bangladesh was enlisted as the second most honest leader across the world. The claim went viral on social media. We took the risk and verified the claim and found that it was false. Later, an official of a government agency warned us not to do such report; otherwise our website will be blocked. Scarce resources and lack of expertise on certain topics interfere with topic selection. For example, fact-checkers at BDFactCheck cannot always verify claims relating to health. Fact-checker 4 said: A reader requested us to verify whether piercing any part of body with a needle can save a person suffering from a heart stroke. But we could not do it because we do not have enough knowledge of medical science. We also could not reach out to any doctors. Doctors usually do not respond to our queries. However, Jaachai team got assistance from its readers in its Facebook group to verify healthrelated claims. "There are some doctors in our group. They help us with medical explanations, " said fact-checker 2. Although due to the resource constraint the fact-checkers of three organizations cannot put enough time to monitor social media for locating viral claims, readers of these organizations' Facebook groups help them locate viral claims on the web and provide evidence relating to those claims. Fact-checkers Mostly Use Information Found In Open Sources For Verifying Claims. It is evident in the interviews that fact-checkers in Bangladesh mostly used information available online. Several reasons such as fear of disclosing identity and not having access to the primary sources are responsible for this practice. Since the beginning Jaachai's editorial policy was not to disclose identity of its team members. This policy interferes with topic and source selection. Fact-checker 2 of Jaachai said, "As we maintain anonymity, we use information available online. " The interviewees said they google to find relevant information. Fact-checker 5 of BDFact-Check said: I checked a photo published in a Bengali-language newspaper that said a flock of birds died due to radio waves emitting from mobile phone towers in the Netherlands. First, I checked the photo in Google image and found that the context was different: the birds died of chemical contamination. Then I checked where else the piece was published and found that it was published in some fake news sites. I did not find the piece in any reliable media in the Netherlands. So, I decided the photo was fake. The team members of Fact Watch are university students. They face problems with access to both primary and secondary sources. To resolve this issue, Fact Watch recently has signed an MoU (Memorandum of Understanding) with an English-language newspaper in Bangladesh, in which its fact-checkers would seek help from the journalists of the newspaper to get access to the public offices. However, fact-checkers with BDFactCheck contact primary sources when needed. For example, fact-checker 4 said, An online news portal in Bangladesh published a report claiming the prime minister of Bangladesh as the Asian Mandela. The portal quoted an Australian professor. We emailed the professor to find out whether he said this. Two days later, he replied that he did not say anything like that. Fact-checkers Are Lagging Behind Due To The Lack Of Technological Support. It is found in the interviews that lack of technological support is lagging behind the fact-checkers in Bangladesh. For example, fact-checker 2 said, An image of floating dead bodies in a lake during safe road movement in Bangladesh went viral on Facebook. We applied keyword search on Facebook, a time-consuming approach to find out the original source. It took several hours to find its original source using the keyword "lake". In the meantime, the fake post might have reached millions of users. The fact-checker also noted, "When we do searches on Google, fake sites also pop up. It is really difficult which sites we would consider as authentic, a big challenge for us. " Lack of any data archive in Bangladesh has been a persistent problem for fact-checkers to do verification. Fact-checker 4 noted, When we collect data for checking a claim, we can't find it because Bangladesh does not have any data storage facility. We depend on crowd source to gather information; for example, we have a Facebook group where we put some topic to gather ideas and facts from them. Moreover, most of the fact-checkers in Bangladesh are not aware of the software they can use to do verification. Fact-checker 6 of Fact Watch said, "Although my university is willing to pay money to buy software, but I do not have knowledge about the tools we could use. " However, fact-checker 4 said, Fact-checkers in the West are using automated tools for verification. But there is no such tool in Bengali language. Western fact-checking organizations are also using machine learning and artificial intelligence to identify whether a statement is fake or real. We do not have such technological support. To understand how internet users in Bangladesh are combating misinformation, we interviewed a group of 29 diverse people in-person and conducted an online survey where 500 individuals participated. When we put the findings from these two studies side by side, some patterns become apparent. Below, we describe i) the extent of misinformation experienced by the internet users, ii) different combating strategies taken by them, and iii) what measures may work in limiting misinformation according to their perspectives. Fake News is Everywhere. Or is it? First, we wanted to understand in what ways internet users of Bangladesh consume news in their daily life. Figure 1 shows different sources of getting news. In the survey, we asked the users to select the sources from which they consume news. If they consume news from multiple sources, they can select multiple options. They can also add sources which are not provided as an option. Figure 1 shows that about 400 survey participants (25.13%) selected "News Website" as their news source. People also follow popular Facebook users/celebrities to get news. About 100 participants (20.61%) selected that they consume news from Facebook pages which don't belong to a news portal. The common sources which were not in our provided options but later added by the users are-YouTube (2) and Twitter (3). We asked two boolean questions in the survey-i) whether or not the participants saw any misinformation in their social news feed and ii) they ever found a piece of news to be false which they initially thought to be true. 96.2% and 90.6% of the participants responded YES to the first question and second question, respectively. The first number indicates the prevalence of the misinformation problem. The second number says something more. It indicates that a large number of people don't realize if a news story is false in their first encounter but later found the news to be false. When we control for the age factor with these questions, we see that all participants below 21 reported to have seen misinformation in their social media feed. Fact-checking Strategies. One survey question asks what users do if they have any doubt about the credibility of a news story. Figure 2 shows the distribution of measures the users generally take if they are in doubt about the credibility of a news story. If a user generally considers multiple measures, she/he could select multiple options. That is why, the sum of all percentages is more than 100. Overall, the most common step the users take is they go to Google.com to check other resources. This is particularly common among users with age below 21. About 40% of them search Google.com. The third most common step, about 10%, taken by this age group is checking other news media. On the other hand, among the respondents with age more than 40 years, 33% of them reported to check other news media when they are in doubt; this is the most common strategy among this age group. The fact-checking organizations have had some limited success in gaining popularity among the users. About 15% of the overall survey participants mentioned that they seek information from one of the fact-checking organizations when they have doubt about a news story. Another common strategy is asking friends and family members for further verification. This strategy is more common among young users with age below 21 (32%, second most common strategy) compared to respondents with age above 40 (7%, least common strategy). Responsibility of Fact-checking. Users have a difference in opinion about who should be responsible for keeping the online (environment, landscape, etc) safe from misinformation. 62.0% of all the 500 survey participants think that it is the responsibility of the Social Media Platforms (e.g, Facebook, Twitter) to combat online misinformation. 57% think Journalists are responsible, 46% think of Fact-checkers. 43% of the users think that people should be informed about online misinformation and educated about how to identify them (Train People). Table 3 shows users perception, from different age groups, about who should be responsible for combating online misinformation. We find that 26.1% of the users (the most) with age below 21 think Social Media Platforms are responsible and only 15.9% (the least) think people should be trained. We observe a completely opposite view from the users with age above 40. Most of them (22.4%) think people should be trained and 17.2% (the least) put the responsibility on Social Media Platforms. The in-depth interviews with 29 users that included people from various socio-economic status provide further understanding about their perception of misinformation and how they deal with such information online. These users are aware that misinformation is being spread through the Internet, and each user has her/his own set of mechanisms to counter what they perceive to be misinformation. Of them, four mechanisms appeared to be more prominent than others. Rely on Higher Authority. The majority of the users said they would trust information if it had come from or been shared by certain individuals. In other words, these individuals play the role of opinion leaders. For example, the interviewee D3, who is a chauffeur by profession said: Yes, fake news may exist, but I don't really know which ones are fake. So if I see my boss (owner of the car) sharing any news, I think it's credible and I follow it. Similarly, we observe that users depend on the more experienced online users for the news verification process. For instance, an elderly retired interviewee R2 noted: My granddaughter is efficient about the Facebook stuff and all these. She is an educated person. So whenever I doubt anything, I just ask her whether I should share/believe that or not. A housewife H1 noted that she had shared posts coming from her husband and her sister. As she pointed out: ...also, I trust my sister who is a government official and much educated, so I re-share her posts too. They cannot share anything bad. Several other interviewees said they usually follow social media pages of the news organizations which they trust. Share Harmless Information Some users believe that a piece of news with a humor tone, even if false or misleading, is mostly harmless and think that it is okay to share them with people for fun. Sometimes, when these users see posts containing funny information, they share them without hesitation. For instance, one user D3 mentioned: If something is funny, then I share it with my friends on messenger, sometimes post on my page. We don't know if they're fake, even if it be, we don't recheck. We find that there is a lack of knowledge among some users about the consequences of misinformation. Some users say that they do not believe that misinformation even relating to serious issues can cause much harm to society. One user, D1 noted: When a violence occurs, it's because of some internal conflicts between people. Only a fake piece of information alone cannot create it. Users, especially the elderly ones and the ones in a lower income group, appeared to be naive about the intention of the people who spread misinformation when it comes to topics such as health and religion. They find it hard to believe that people can share news related to health and religion with a bad intention. So, when they find such posts, they share with others without any hesitation. For instance, one user, M3 said: How can people share misleading information about health issues? This is so sensitive and people who share these types of news, cannot be so bad to do that. Another user H4 noted, Well, I don't care if it's fake or real when I'm clear to myself that I have no bad intention. Like, sharing health tips is not bad, since I'm doing for others' betterment and no one would get harmed for this. Some of these users also believe that religious posts cannot be fake either. The following response from D2, for example, suggests that it is imperative to believe anything religious without doubt: Religious news is hard to believe as fake. I regularly post these on my Facebook page and our group. If you put any doubt on these religious issues, that means you're doubting our religion. right? Confirmation Bias Many of the interviewed users indicated that one key mechanism which they use to verify misinformation is their own perception and understanding of various issues and events. People with strong religious and political views are more likely to use this mechanism. Some users suggested that they would never share anything that goes against their religious and political views. On the other hand, they would follow and share anything if it supports her or his views. For instance, one user H2 pointed out: Personally This phenomenon often goes beyond politics and religion. It is also embroiled in local culture or lack of knowledge. There are cases in which users would consider proven facts as misleading. It is evident in one comment of D2: I saw a post many years ago on Facebook, people from earth has landed on the moon. Well, that's never ever possible. We do not have the power to do it, and even if we do, how can you take a picture on the moon and then send it to earth? Another response that is associated with local culture is as follows: DBC News [a television station] has shared a piece of news about the marriage of two girls. It cannot be real. A girl cannot get married with another girl! This is absurd. There is a small number of users, most of them are students at local universities, who say they verify information that they find on social media. One student S3 explained how he verifies information: When I see any political post and have doubt on that, I check who shared this. If it's from a fake account, then I don't trust it. If it's from a locked account, then I check the mutual friends. If I have no mutual friends, then the doubt gets stronger. But if the mutual friends are whom I trust, then the doubt weakens. According to this student, accounts spreading false information usually use photos that are downloaded from the Internet. Such accounts also have little information about themselves in their profile page. Another student S8 suggested that it is important to develop analytical ability and think logically to be able to stay protected from misinformation. Although these mechanisms appeared to be dominant in the interviews with users, a few other important points emerged from the interviews. For example, some users say that they avoid sharing posts on controversial topics. Most of them emphasized that they would welcome sites that would verify facts for them. Finally, students seemed to be better aware and prepared to deal with misinformation than users in other groups. In this study, we have examined how multiple entities -journalists, fact-checkers, and internet users -in Bangladesh have experienced and confronted online misinformation with limited resource, freedom of press, and access to information. We have reported the communication gap between journalists and fact-checkers that resulted in a lack of defined responsibility of who should factcheck online misinformation. We also have identified several verification strategies of regular users. Our findings provide several design and policy implications, and suggest the need for development of computational tools and increasing cooperative work to combat misinformation in the developing world. Below, we discuss the findings in light of the context of Bangladesh, suggest several broader implications in terms of design and policy in the context of similar socioeconomic regions and beyond, and recommend several research directions for the CSCW/CHI community. 6.1.1 Free the Press. Our interviews with journalists and fact-checkers suggest that freedom of the press needs to be increased to facilitate the fact-checking practice. The Bangladesh government has enacted laws to curtail misinformation (see section 3.2); however, our findings suggest that these laws are not enforced equally. Any verification that goes against the government might put journalists and fact-checkers in danger. As a result, they cannot verify all misinformation freely. Political pressure is leading to a biased selection of fact-checks (see section 5.1 and 5.2). Moreover, intelligence agencies are also suggested by our interviewees to be spreading misinformation. The government also has a custom-made judicial weapon for silencing troublesome journalists âĂŞ the 2018 digital security law, under which "negative propaganda" is punishable by up to 14 years in prison. As a result, self-censorship has reached unprecedented levels because editors are reluctant to risk imprisonment or their media outletâĂŹs closure [24] . The government of Bangladesh needs to enforce laws equally, take measures to free the press so that mass people get accurate information. CSCW researchers have long been studying the use, appropriation, and and manipulations of media platform by powerful entities like the government [26, 131] . Several recent studies in this area have also shown how political leaders are abusing social media platform by spreading misinformation and hate speeches. Hence, there needs to be a more strict guidelines and democratic checking on social media to regulate the misinformation related campaigns [48, 101, 102] . The key objective of this study was to have a deep understanding of people's perception regarding whose responsibility it is to combat misinformation in Bangladesh. Findings from in-depth interviews with editors and senior journalists suggest that the journalists at mainstream news media are not equipped to take on this responsibility. This results from the lack of resources and fear of repercussions from the government which often benefits from the spread of misinformation. A majority of the interviewees suggested that the task of combating misinformation should be performed by independent fact-checking organizations. On the other hand, fact-checkers suggested that they had to take on this moral responsibility because no one was responding to the growing amount of misinformation online. As they do not have any institutional structure, journalists from the mainstream media do not know about them. Fact-checkers also cannot collaborate with the journalists due mainly to two reasons. First, most of the journalists do not know about their work. As a result, fact-checkers' work do not circulate through mainstream news media. Second, the journalists who know about fact-checkers' work do not cite or publish in their newspapers because they cannot rely on their verification. While in the U.S. independent fact-checkers, such as FactCheck.org and PolitiFact have collaborated with national and local news organizations to spread their work and assist journalists with fact-checking [8] , such practice is absent in Bangladesh. Fact-checkers in Bangladesh could consider the collaboration with mainstream news organizations to share their work with a broader audience. Our findings from the users indicate that they want the mainstream news organizations to verify online misinformation and present to them. As journalists with mainstream newspapers in Bangladesh cannot do that due in part to resource constraint, they could also consider collaboration with independent fact-checkers, which eventually would address the problem of misinformation in Bangladesh. CSCW researchers have long been interested in scientific collaboration, and a version of that might be applied to develop a global network of fact-checking. We argue that such transnational collaboration is important for limiting the spread of misinformation over social media, because of the ubiquitous nature of the platform [134, 135] . Our findings show that users in Bangladesh tend to believe in online religious content. While social media platforms such as Facebook have been developing computation (based on natural language processing and machine learning) techniques to detect religious fake news and hate posts, we suggest a Human Computer Interaction (HCI) approach involving the faith-based institutions. Bangladesh is a Muslim-majority country with at least 90% Muslim population. It has 250,000 mosques, about 4 mosques per square mile [19] . The local Imams (religious leaders) are usually very respected in the community and they often play the role of opinion leaders. These Imams are also connected with each other through an online platform which is made available by the government [98] . Facebook and other social media platforms can collaborate with these institutions to detect and correct locally generated religious misinformation. Bangladeshi fact-checkers also could interview religious leaders in their verification process to make people aware that what they see online are not always necessarily true. The relationship between faith and computing is getting growing interest in CSCW and related disciplines (see [88, 109, 128] , for example). While most of the work in this area is highlighting the differences between the core assumptions between mainstream computing and traditional religions, and associated challenges, we argue that a right combination of these two is both possible and necessary. A growing body of work in the Global South has shown how motivation for social good can be harnessed through the help of religious institutions [17, 109] . We believe that much more research is needed in CSCW and related disciplines to find the right method to engage religious values to address societal problems like misinformation [67, 92, 128, 129] . 6.1.4 Access to Information. The interview results showed that fact-checkers do not have adequate access to information. This is mainly due to the cultural reasons and lack of digital archives. Official secrecy acts of British era are still in effect in Bangladesh [99] , which resulted in a culture of secrecy. Although Bangladesh has enacted the Right to Information Act in 2008 which enables people to seek public information, in many cases, the Act does not help journalists due to the long period of time it takes to get information [6] . As the Bangladesh government envisions to offer public services digitally and develop the country incorporating digital technologies, the government needs to take an open data policy in which they could offer information through digital archives. The government also could take initiatives of making people media literate by introducing media literacy curriculum at schools and colleges. In addition, the government could use mass media and folk media to spread messages relating to media literacy. 6.1.5 Technology Design. We observe that most of the automated fact-checking efforts depend on advanced technologies such as knowledge base, computational linguistic resources, and computation and data experts in the newsrooms. We suggest that development of linguistic resources for Bengali language such as parts-of-speech tagger, entity recognition system would facilitate automated factchecking for news in Bengali language. Making computing more accessible for all by incorporating non-English languages has been a long demand of CSCW community, and a plethora of crosscultural communication research has supported this cause by providing various computational and human-mediated tools and techniques [112, 130, 138] . Additionally, the Global South research within CSCW is also focusing on such cultural adaptation of western technologies for a long time. This paper joins that thread of CSCW research, and calls for developing computing technologies that can understand local languages with their cultural nuances and thus help fact-checking in non-English contexts [76, 80] . Our findings have several broader implications in terms of design and policy recommendations for geographical regions that are similar to Bangladesh with respect to socioeconomic structure and ideological belief systems. For instance, we discussed religious misinformation that is prevalent in countries like India and Myanmar (see section 2.1). One of the common dimensions among these countries and Bangladesh is-single major religion. At least 80% of their citizens follow a single religion-Bangladesh: Islam 90%, India: Hinduism 80%, Myanmar: Buddhism 88%. In all these countries, religious minorities are often being the target of religious misinformation. We argue that effective and persuasive misinformation combating strategies can be developed in these countries and similar other regions with single major religion (e.g., middle east) by designing close collaborative communication between fact-checkers and faith-based institutions. These countries also have similar socio-economic structure (developing economies) [93] , literacy rate [133] (rank within 126 -129) , and press freedom index (rank within 139 -151 ). An increased effort through policy changes and conscious actions to advance press freedom and access to information by the governments of these countries and other regions with similar attributes (e.g., Africa) can facilitate nonpartisan fact-checking and thereby reduce misinformation. This research has some limitations. First, the survey samples were not nationally representative as it was conducted through Facebook. The samples included mostly educated, young Facebook users. As a result, those who were not on Facebook were excluded in the survey. To fill this gap, we conducted in-depth interviews with 29 ordinary citizens to include participants from different age groups and education levels. These respondents were included using convenience sampling. Thus, these samples were not nationally representative. Overall, this exploratory study reveals new ways to examine this problem for further insights. Clearly, this can be studied from the media management and economic perspectives as fact-checking organizations all over the world have been struggling to find sustainable business models. From the normative perspective, the spread of misinformation and efforts to contain it raise countless new questions about the roles of news media in developing democracies, which need to be answered. We believe that our study makes important contribution to advance CSCW scholarship in infrastructural politics, global development, and post-secular and postcolonial computing to address these issues. The human touch in automated fact-checking Media, politics and the emergence of democracy in Bangladesh Privacy, security, and surveillance in the Global South: A study of biometric mobile SIM registration in Bangladesh Ecologies of use and design: individual and social practices of mobile phone use within low-literate rickshawpuller communities in urban Bangladesh Suhrid: A collaborative mobile phone interface for low literate people Bangladesh Right to information (RTI) Survey Fake news hits Bangladeshi news sites before polls Making a difference: A critical assessment of fact-checking in 2012 Journalistic interventions: The structural factors affecting the global emergence of fact-checking Bangladesh: New Digital Security Act imposes dangerous restrictions on freedom of expression The right to tell: the role of mass media in economic development. The World Bank A closer look at the self-correcting crowd: Examining corrections in online rumors WhatsApp fake news during Brazil election âĂŸfavoured BolsonaroâĂŹ. The Guardian Overview of Internet access in Bangladesh: Impact, barriers, and solutions Analyzing the digital traces of political manipulation: the 2016 Russian interference Twitter campaign Money matters: exploring opportunities in digital donation to mosques in Pakistan Bangladesh lynchings: Eight killed by mobs over false child abduction rumours Country has 250,399 mosques: minister When the internet goes down in bangladesh World Press Freedom Index Reporters Without Borders. 2020. 2020 World Press Freedom Index Reporters Without Borders. 2020. Bangladesh. Retrieved Sampling in developmental science: Situations, shortcomings, solutions, and standards Troops, trolls and troublemakers: A global inventory of organized social media manipulation How journalists and social media users perceive online fact-checking and verification services Social research methods The promises, challenges, and futures of media literacy The world of the working journalist Bangladesh using controversial law to 'gag media, free speech Computational fact checking from knowledge networks Fact Checking the Campaign: How Political Reporters Use Twitter to Set the Record Straight (or Not) Excellence in online journalism: Exploring current practices in an evolving environment The global south Botornot: A system to evaluate social bots The Rise of Political Fact-checking, How Reagan Inspired a Journalistic Movement Bangladeshi Digital Security Act Draws Fire From EU Bangladesh editors protest 'chilling Falling for fake news: investigating the consumption of news via social media The 2018 Elections and Latinos Prominence-interpretation theory: Explaining how people assess credibility online Watching the watchers: The nature and content of campaign ad watches A guide to anti-misinformation actions around the world Catching Zika fever: Application of crowdsourcing and machine learning for tracking health misinformation on Twitter The politics of âĂŸplatformsâĂŹ Deciding whatâĂŹs true: The rise of political fact-checking in American journalism Anatomy of a fact check: Objective practice and the contested epistemology of fact checking. Communication Boundaries not drawn: Mapping the institutional roots of the global fact-checking movement Understanding innovations in journalistic practice: A field experiment examining motivations for fact-checking Why do journalists fact-check Internet use in Bangladesh: problems and prospects Nonparticipation of bangladeshi women in# MeToo movement Examining the Roles of Automation, Crowds and Professionals Towards Sustainable Fact-checking ClaimBuster: the first-ever end-to-end fact-checking system From thematic analysis to grounded theory. Lecture notes available atwww Media Literacy in Austria Media Literacy Foundations Freedom on the Net Bots,# StrongerIn, and# Brexit: computational propaganda during the UK-EU referendum Generalizability of causal inference in observational studies under retrospective convenience sampling Resilience to online disinformation: A framework for cross-national comparative research Infrastructuring Hope: Solidarity, Leadership, Negotiation, and ICT among the Rohingya Refugees in Bangladesh The Role of Family in Women's Technological Inclusion in Islamic Culture Amnesty International More than just convenient: The scientific merits of homogeneous convenience samples. Monographs of the Society for Research Linguistic signals under misinformation and fact-checking: Evidence from user comments on social media One police officer's unique approach to fighting deadly 'fake news' rumors spread on WhatsApp in India: Police are using town criers and folk songs to prevent attacks In Sri Lanka, Facebook's dominance has cost lives Likert scale: Explored and explained Bangladesh vows to protect Buddhists after Facebook photo attacks Information Disorder in Asia and the Pacific: Overview of Misinformation Ecosystem in Australia Cultural differences in the use of instant messaging in Asia and North America The elements of journalism: What newspeople should know and the public should expect Integrating on-demand fact-checking with public dialogue Maater: Crowdsourcing to improve online journalism Making sense of foreign language posts in social media Information Pollution by Social Bots The emergence and development of news fact-checking sites: Institutional logics and population ecology Designing mobile interfaces for novice and low-literacy users Text-free user interfaces for illiterate and semi-literate users The elite press: Great newspapers of the world Using twittertrails. com to investigate rumor propagation Credibility and trust of information in online environments: The use of cognitive heuristics Others' Images: Online Social Media, Architectural Improvisations, and Spatial Marginalization in Bangladesh Silencing the Minority through Domination in Social Media Platform: Impact on the Pluralistic Bangladeshi Society Understanding the Challenges for Bangladeshi Women to Participate in# MeToo Movement In search of the global east: Thinking between north and south IslamicHCI: Designing with and within Muslim Populations World Economic Situation and Prospects Believe it or not: Designing a human-AI partnership for mixed-initiative fact-checking In this age of propaganda, we must defend ourselves. HereâĂŹs how Online sexual harassment over anonymous social media in Bangladesh Laws of Bangladesh Statistics of the Country's Media Listed Newspapers Banalities turned viral: Narendra Modi and the political tweet Twitter and the rebranding of A short guide to the history of 'fake news' and disinformation Digital Bangladesh: Dreams and reality Syed Ishtiaque Ahmed, and Bogdan Carbunar. 2019. The Art and Craft of Fraudulent App Promotion in Google Play Leader or Party? Personalization in Twitter Political Campaigns during the 2019 Indian Elections A summary of survey methodology best practices for security and privacy researchers Factbox: Bangladesh's broad media laws Money, God, and SMS: Explorations in Supporting Social Action Through a Bangladeshi Mosque How many truth levels? six? one hundred? even more? validating truthfulness of statements via crowdsourcing Axial Coding. The International Encyclopedia of Taking It out of Context: Collaborating within and across Cultures in Face-to-Face Settings and via Instant Messaging Hoaxy: A platform for tracking online misinformation How WhatsApp is battling misinformation in India, where 'fake news is part of our culture Discriminative predicate path mining for fact checking in knowledge graphs. Knowledge-based systems Partisan selective sharing: The biased diffusion of fact-checking messages on social media Mediating the message: Theories of influences on mass media content How Section 57 morphed into Digital Security Act provisions FakeNewsNet: A Data Repository with News Content, Social Context and Dynamic Information for Studying Fake News on Social Media Implication of 'innocent' people irks Ramu arson victims SPJ Code of Ethics ICT export fetches $800m in 2017 Active internet connections 9cr Disinformation as collaborative work: Surfacing the participatory nature of strategic information operations Number of fact-checking outlets surges to 188 in more than 60 countries Institutional Counter-disinformation Strategies in a Networked Democracy Witchcraft and HCI: Morality, Modernity, and Postcolonial Computing in Rural Bangladesh Parareligious-HCI: Designing for'Alternative'Rationality in Rural Wellbeing in Bangladesh Cross-Cultural Communication Protocol Analysis Social media, politics and the state: protests, revolutions, riots, crime and policing in the age of Facebook Media Literacy in Germany Data for the Sustainable Development Goals Explaining field differences in openness and sharing in scientific communities Sharing, re-use and circulation of resources in cooperative scientific work Great Moon Hoax" of 1835 Fact-Checking: A Meta-Analysis of What Works and for Whom Cultural Difference and Adaptation of Communication Styles in Computer-Mediated Group Brainstorming Citing Virus Misinformation, South Africa Tests Speech Limits Arming the public with artificial intelligence to counter social bots Facebook, Twitter remove fake news sites in Bangladesh ahead of election 1 Interview Questionnaire for Users (1) Which media do you use to get news? (2) Have you ever seen any fake news in your news feed? (3) When in doubt about the authenticity of any of the information From which source did you get that news? Did you see that in a group? Which one? Can you please elaborate? (7) Has it ever happened to you that at first, you shared the news/post and then it came out to be false? How did other people react to that incident? What can be done to prevent the spread of false news, especially in Bangladesh? Are you aware of any fact-checking organization in Bangladesh? Who are they? (11) According to your opinion Demographic Information: We will collect some demographic information about you, which will not include any identifiable information. This information will give us a better understanding of general demography of the respondents. Can you please answer these questions: What is your age range? How do you identify yourself gender-wise? When did you run the organization? (2) Does your organization have own website and/or social media pages? How many members do you have in your team? (2) How did you find the team members? (3) What did motivate you and your team members in fact-checking? Please share any stories behind your motivation If no, how do you communicate with team members? If yes, how do you pay rent? Do your team members get paid or do they work voluntarily? If team members work voluntarily, what are their actual professions? (9) Do you and team members have any prior training/experience on fact-checking? If yes, where did you get it? (10) How do you distribute work responsibilities among team members? Can team members give full attention to their job, if working voluntarily? How many years of journalistic experience do you have? How about other members? Does your organization have government accreditation? (2) If no, have you ever applied for an approval? (3) Does the Government of Bangladesh have any mechanism to give an approval to a factchecking initiative? If you do not have government accreditation, what types of problems do you face in doing your job? Please give examples Follow up with specific job type-gather info from govt. or non-govt. entity? Gather info from other media entities? Contact donors for fund? Does your organization have any funding? If yes, who offered the funding? Does the donor give any instructions what to cover and what not? Please give examples If you do not have funding, have you ever applied for a funding? Do you think fact-checking initiatives should run for profit or non-profit? Why? Which topics do you verify? (2) How do you select a topic for verification? Please describe the process with examples. (3) Do you feel that you are free to choose any topic for verification? Why do you choose certain topics? For example What are the topics you cannot choose and why? Please give examples Do you have prior and adequate expertise on the topics you verify? For example, when you verify a science or health related topic (1) What are the sources you use to verify a claim? Please give examples of using both primary and secondary sources How do you find the sources? How do you find relevant sources (both primary and secondary Do you have any database of sources? What are the secondary sources you use? How do you get access to it? Please give examples Do you mainly use the documents available on the Internet or you visit in person the offices where information can potentially be found? How do you get access to it? How do you introduce yourselves while contacting sources? Do you experience any constraints in reaching out the sources since the idea of fact-checking is relatively new in Bangladesh? Do they respond when asked for cross-checking information? How do you get access to government officials? Do you get your required information from them? Please share any examples Do you take help from journalists to reach out to a source? Please share examples A source might spoon-feed you. How do you assess source credibility? A.2.6 Verification How do you verify a claim? Please give an example. (2) What are the principles do you follow in verifying a claim? For example, accuracy, nonpartisanship Do you follow any established guidelines for fact-checking? How do you ensure accuracy and fairness in verifying a claim? Please share an example How do you ensure transparency of sources? Do you use anonymous sources? Any example? (6) How do you ensure transparency of your methodology? For example, select, research, write, edit Which experts do you contact for getting verification? What makes you think that they are expert in that area? Do you select experts from your known circle? Have you considered getting opinion from experts who are not in your known circle? Did they provide information? On average, how many people (of your organization) work on verifying a claim? A.2.7 Challenges/Constraints What kind of challenges you face while doing your job? (2) Challenges while selecting what to check? Challenges to check a claim? (4) Challenges in connecting to a source? Getting experts of a topic? Challenges in dissemination? Challenges in sustaining? (7) What technological challenges do you face? For example, unavailability of software, tools, etc What political challenges do you face? Please give examples Curtailed freedom of expression often makes a person to be self-censored. Have you faced such satiation while selecting and verifying a claim? What economic challenges do you face? Examples What is your duty with your news organization? What issues do you cover? (2) How long are you working in journalism? If no, do you think politicians always say correct things? (5) If yes, what can journalists do in such instances? (6) Does your news organization have a separate fact-checking section? (7) If no, do you think your newspaper should have to combat the flood of fake information? (8) As a political/investigative journalist, whose and which claims do you verify How do you address selection bias in choosing your sources for verifying a claim? (11) What steps do you take to provide enough details, sources and data to prove veracity of a claim? How do you assure that your verification process is nonpartisan and fair? ) Are you aware of any fact-checking organizations in Bangladesh? Do you follow their fact checks? (2) Have you cited their fact checks in your reports? If yes, please give examples; if no, why not? (3) Do you know any fact-checkers in Bangladesh? Do you consider their fact checks reliable? Why or why not? Do you consider their job as journalistic? Why or why not? (6) Sometimes fact-checkers verify claims published in mainstream media. Do you consider their work as friend or foe? Why or why not? We constantly come across various claims, especially on social media. Do you think there is a need of independent fact-checking organizations beside news media to verify the claims?