key: cord-0603875-eahvsajt authors: Wagner, Caroline S.; Cai, Xiaojing; Zhang, Yi; Fry, Caroline V. title: One-Year In: COVID-19 Research at the International Level in CORD-19 Data date: 2022-02-01 journal: nan DOI: nan sha: eac33a42cc64e9eb3f3b86b790ef2bdfa2ecd89c doc_id: 603875 cord_uid: eahvsajt The appearance of a novel coronavirus in late 2019 radically changed the community of researchers working on coronaviruses since the 2002 SARS epidemic. In 2020, coronavirus-related publications grew by 20 times over the previous two years, with 130,000 more researchers publishing on related topics. The United States, the United Kingdom and China led dozens of nations working on coronavirus prior to the pandemic, but leadership consolidated among these three nations in 2020, which collectively accounted for 50% of all papers, garnering well more than 60% of citations. China took an early lead on COVID-19 research, but dropped rapidly in production and international participation through the year. Europe showed an opposite pattern, beginning slowly in publications but growing in contributions during the year. The share of internationally collaborative publications dropped from pre-pandemic rates; single-authored publications grew. For all nations, including China, the number of publications about COVID track closely with the outbreak of COVID-19 cases. Lower-income nations participate very little in COVID-19 research in 2020. Topic maps of internationally collaborative work show the rise of patient care and public health clusters, two topics that were largely absent from coronavirus research in the two years prior to 2020. Findings are consistent with global science as a self-organizing system operating on a reputation-based dynamic. The COVID-19 pandemic upended many normal practices around the conduct of research and development (R&D); the extent of disruption is revealed across measures of scientific research output [1] [2] [3] . This paper revisits the extent to which patterns of international collaboration in coronavirus research during the COVID-19 pandemic depart from 'normal' times. We present publication patterns using one full year of publications data from the CORD-19 database, and observations on non-COVID peerreviewed publications using the Web of Science, to examine national and international publication rates and network patterns. We examine topics of research on COVID-19, and reflect on lessons learned about international collaboration from the disruption. The analysis may be useful to research administrators, international affairs professionals and science studies scholars. We study the international collaborative linkages as a network. In the absence of a global governing body, international collaborations operate by network dynamics. Network dynamics emerge from interplay of these factors, although there is little research on how a disaster, such as a pandemic, will affect productivity, collaboration, and topic focus. Moreover, it is difficult to determine expectations of network dynamics in a pandemic because global exogenous disruptions are rare and studies about science in a disaster are sparse. This paper seeks to fill some of these gaps. This paper is organized to describe the literature supporting our inquiries, and to present hypotheses derived from the literature. We then describe coronavirus research prior to the pandemic, and early policy responses to the crisis. A section on data and methodology presents approaches designed to answer the questions emerging from the hypotheses. A results section describes outcomes of the analyses, followed by limitations of the data and approaches presented here. A discussion section details responses to the hypotheses as well as observations about the research project and avenues for further research. An appendix provides additional technical details. In the decades preceding the pandemic, R&D spending and output grew rapidly. OECD data shows that, among member nations, R&D spending was 25% higher in 2017 than a decade earlier. The US National Science Foundation (NSF) reports that from 2008-2018 the annual number of citable publications (articles, notes and letters, hereafter, "publications") worldwide grew by 3.83% per year from 1.8 million to 2.6 million [4] . Increases in spending, trained practitioners, and publications contributed to an overall growth of the research enterprise in natural sciences and engineering, social sciences, and arts and humanities. Within the research enterprise, among scientifically advanced nations, international collaborative publications grew at a faster rate than national publications, accounting for as much as one-quarter of all publications in 2018, with variations observed across fields, according to the National Science Foundation [4] . Those fields that rely on large-scale equipment are more highly globalized, but increases in international linkages is observed in most fields, tied, not to funding or equipment, but to the interests of researchers to work together. The size of these teams has grown larger over time [5] . International collaborative patterns have been dominated by scientifically advanced nations, although, over time, many low-income, emerging and developing nations have become more active, and have partnered with more advanced nations [6] . Some tendency to collaborate among nations with former colonial ties is observed [7] , but this is likely due to incentivized funding provided by the former colonial power. Political differences do not appear to hinder collaboration, evidenced most notably by the rise of China to be the number one collaborating nation with the United States. Abramo et al. [8] added to literature on tendency of neighbors to work together, but Choi [6] shows this tendency to be decreasing over time. Prior research into collaboration around viral disease events found that, during the 2014 West African Ebola epidemic, collaboration grew between scientists from scientifically advanced nations and the most affected nations [9] , suggesting that connections were made based upon disease location. Ebola outbreaks brought in researchers from scientifically advanced nations to work with local researchers on specific events. Collaborative ties did not persist past the disease event. A global community of coronavirus researchers predated the advent of the 2019 novel coronavirus; this community formed after the 2002 SARS coronavirus epidemic [1] . As the new threat emerged in 2019, governments provided emergency R&D funding to encourage targeted research on the novel coronavirus. Most of these funds were committed by governments in scientifically advanced countries and were allocated to national institutions, although the European Union (EU) and the US National Institutes of Health (NIH) fund both national and foreign applicants. National actors receiving funds may then choose, in some instances, to connect to foreign collaborators, creating an international connection. The resulting connections can be studied through coauthorship attributions on paper and interpreted as a self-organizing network of connectivity [10] . In Fry et al. [1] , we showed that, during the early months of the COVID-19 pandemic, international collaborations in coronavirus research emerged among just a few nations, and, on average, publications had fewer coauthors per paper than pre-pandemic levels. Most nations did not publish on the novel coronavirus in early pandemic research. We expect that, as funds became available to researchers, and as more knowledge was generated through the first year of the pandemic, cross-national collaborative ties will grow. That said, because of travel limitations and a need for urgent results, we expect the rate of international collaboration and network ties to remain lower than pre-pandemic levels. This expectation is also informed by the research of Rotolo and Frickel [11] who found that there were fewer ties and smaller teams among researchers just after a hurricane disaster. Further, based upon findings in the wake of the Fukushima disaster [12] and a survey by Myers et al. [2] we expect that attention to pandemic-related R&D (including basic science, patient care, and public health) has lessened the output of other scientific research as well as reduced the rate of international collaborations in other fields. In addition to changed collaborative patterns, we expect to see changes in topics throughout the first year of the pandemic with topics becoming more focused as knowledge about events grows, which we explore in a separate article. In Zhang et al. [3] , we showed that, at the beginning of the pandemic, the disrupted knowledge system exhibited very little topic focus. As the pandemic progresses, we expect to see greater topic focus. We further expect to see international collaboration focus on basic science and less on patient care and public health which may have a local, regional, or national characteristics. We expect continued consolidation among leading nations and elite institutions through the pandemic year due to pressures for rapid results and the lack of mobility to begin new collaborations. Further, we expect that geographic distance will mean less during the pandemic because remote collaborators will rely on communications technologies rather than face-to-face consultations. Coronavirus research predated the COVID-19 crisis, but it was a community of 22,000 researchers working on SARs, MERs, and the porcine diarrhea epidemic [1, 3] . Coronavirus research output doubled in number over the decade between 2008-2018, in keeping with numbers in the biological sciences. As the new threat of a novel coronavirus emerged in 2019, governments provided emergency R&D funding to encourage targeted research, which attracted many new researchers from a wide range of fields. More than 156,000 researchers published on COVID-19 in 2020, growing the original community that had worked on coronaviruses by over 130,000. The United States Government committed the largest amount of funds to the novel coronavirus, through the CARES Act and other legislation, allocating at least $5 billion to basic research, applied research, and development of vaccines, diagnostics, mapping of disease occurrence, analytics, public health, and medicine. The bulk of funds were appropriated by the US Congress to the U.S. National Institutes of Health (NIH), and through them to BARDA, the Biomedical Advanced Research and Development Authority. Other agencies also received additional R&D funds over and above their annual appropriations, including the National Science Foundation ($74 million) and the Department of Energy ($99.5 million). The U.S. government also provided funds to private companies to aid in vaccine development and procurement. For example, Moderna, a pharmaceutical company headquartered in Massachusetts, received $1 billion of R&D funds and in $1.5 billion in advanced purchase agreements. Germany provided $891 million in R&D funds into coronavirus as well as to vaccine development. The European Commission provided €469 million in R&D funds, along with permission to recipients to reallocate funds originally slotted for other topics. The UK government reports spending £554 million on 3,600 initiatives related to COVID- 19 . In China, the Ministry of Science and Technology invested $100 million for emergency projects and unknown millions of funds for vaccine development, and the National Natural Science Foundation of China also reallocated approximately $15 million for projects related to COVID-19. Many research organizations and researchers from various disciplines shifted to focus on aspects of the pandemic and received grant funds to do so. Just as with any other R&D funding, the expectation is that funded research will result in published works, enhanced equipment, and medicines and vaccines. Very early in the pandemic, preprints [13] (non-peer-reviewed articles) and peer reviewed articles began flooding into publishing venues. The number of scholarly publications related to the crisis grew spectacularly in the early months of the pandemic [1] . The rush to publish is expected: Zhang et al. [14] note that historical patterns show that researchers have, in previous cases, responded quickly to public health emergencies with publications, which is the same pattern we see with COVID-19 research. In updating our earlier work [15] , we found that the number of coronavirus publications in CORD-19 grew considerably in the early days of the novel coronavirus, rising at a spectacular rate from a total of 4,875 articles produced on the topic (preprint and peer reviewed) between January and mid-April to an overall sum of 44,013 by mid-July, and accumulated to 87,515 by the start of October 2020. (In comparison, nanoscale science was a rapidly growing field in the 1990s, but it took more than 19 years to go from 4,000 to 90,000 articles [16] ). Similarly, CORD-19 (the database which provided data for this article) through Semantic Scholar, made relevant research (including historical work) rapidly and readily available and allowed researchers to deposit work they viewed as relevant. Researchers from China and the USA increased the rate of collaborative publications on coronavirus in the earliest days of the pandemic Fry et al. [1] . Liu et al. [18] showed a surge of what they call 'parachuting collaborations' -new connections not seen prior to the pandemic -which dramatically increased during the pandemic. Together with the findings in Fry et al. [1] , these findings suggests that search and team formation changed to adapt to the needs of COVID-19 research, a finding also reported by Lee & Haupt [19] . Liu et al. [18] found that COVID-19 research papers were less likely to involve international collaboration than non-COVID-19 papers during the same time period, a finding reported by Aviv-Reuven & Rosenfeld [20] as well, a finding we can confirm. Several research articles note the absence of emerging and developing nations in early COVID-19 research. Fry et al. [1] and Lee & Haupt [19] showed that very few developing nations were involved in the earliest day of the crisis. Zhang et al. [3] confirmed Fry et al. in finding that the USA, China, and the UK were the three countries with the largest number of articles by mid-year. Several articles report that fewer coauthors appear on article bylines [1, 20] . This is likely due to the need for rapidity in responding to the crisis: fewer coauthors reduces the time needed to communicate, synthesize and submit results. To maintain consistency across our studies, we applied the same search terms as used in Fry et al. [1] , Cai et al., [15] , and Zhang et al. [3] and limited the search to the dates January 2020 to December 2020 and citation data to March 2021. The following search terms were applied to titles and abstracts to obtain an initial dataset of coronavirus publications: The initial dataset was cleaned to remove the following artifacts: conference papers, To test for change in the number of participants in research groups between pre-COVID-19 and COVID-19 periods, we use double-tailed T-tests to compare the average "team" structure between periods. (We employ the word "team" for convenience to describe coauthor groups even though we do not know the mechanism of cooperation among the group.) Statistical significance is assessed at 0.05 level. Team structure is measured as average number of authors per publication, average number of nations per publication, and the percentage share of internationally collaborated articles. We also use regression models to test the relationship between team structure and citation impact. Since the dependent variable, i.e., citations, is a non-negative integer, we apply count-data regression models (i.e., negative binomial regression) that can account for the nature of the data. In order to compare network structures of nations between pre-COVID-19 and during COVID-19, we construct global collaboration networks based on coauthorships in publications for the subset of data at the international level. Collaboration links among nations are established based on author affiliations using a full counting method. For example, for an article with authors from the USA, Italy, and China, there is a single collaboration link between the USA and Italy, the USA and China, and Italy and China. We aggregate the number of ties over the publications in each period, and then use the R package "igraph" to compute the network metrics of global network and each node and visualize the collaboration networks using VOSviewer developed by van Eck and Waltman [21] . Measures taken are density-to examine the growth of interconnections across nations-and betweenness centrality-to assess the power relationships across countries in providing and sharing knowledge. Betweenness centrality measures the importance of a node in determining the flow of a network [22] , and thus, in this study a high value of betweenness centrality indicates a crucial role in leading international collaborations. We particularly exploit a weighted betweenness centrality [23] to highlight the weight of edges (i.e., the frequency of collaboration) when calculating the shortest distance between two nodes. The equation for calculating betweenness centrality ( ) for node is given as follows: where denotes the total number of nodes in a network, and are two different nodes in this network, then, , represents the number of weighted shortest paths between the two nodes, and ( ) , particularly measures the number of the weighted shortest paths between the two nodes and crossing node . To test the relationship between geographic distance and international collaboration among nations, we calculate the geographic distance and collaboration strength between country pairs. The geographic distance between nations is defined as distance between capitals of each nation, based on geographic data about world cities in the R package "map". Following the normalization approach used in previous research [6, 24, 25] , we apply Salton's cosine measure of international collaboration strength, which takes the publication size of nations into account. It is calculated as the number of collaborative publications divided by the square root of the product of the number of publications of the two collaborating nations. (See Appendix Table 2 .) The process of collecting and cleaning the CORD-19 database produced a set of and psychiatry and mental health. We can assume that the COVID-19 articles were written in 2020, since they are topical-"COVID" was not a keyword in 2019. Moreover, journal editors greatly sped up the processing time for COVID-related review and publication [26, 27] . Conversely, the non-COVID articles may represent work conducted years prior, since it takes time to write, review and publish research results [28] . In fact, peer review in non-COVID related disciplines was delayed in 2020 due to the pandemic [26] so there may be insufficient time to fully assess the impact of the crisis on non-COVID research of publication output. Data in 2021 will be more telling of the impact of the pandemic year on non-COVID research publication patterns. COVID-19 publishing numbers differ considerably by regions of the world. Figure 2 shows regionally aggregated contributions on COVID-19. Asian countries contributed over one-third of world publications in early 2020, but this percentage share dropped Table 3 . As of early 2021, their publications accumulated around 68% of citations made to global publications supporting the expectation of consolidation around expertise and reputation. In the earliest days of the pandemic, three articles from Chinese authors [29] [30] [31] contributed key findings that guided much of the ensuing research; each of these articles garnered thousands of citations. Italy, UK, India, and Spain were slower to begin publishing but became more prolific through 2020, and particularly so in the final quarter. Figure 3 shows the rapid growth of monthly publications for selected countries, which also tracks with the trend in national COVID-19 cases; this finding is similar to one found in the 2014 West African Ebola epidemic [9] . International collaborative publication rates in coronavirus research took six months to recover to pre-COVID levels. Collaborative research projects take longer to publish results, so the 'recovery' time may simply reflect more communication and production time needed due to the physical distances and time zone differences. As expected, during 2020, international collaborative papers showed fewer nations per paper in the early days, but this number increased through the year. This number stabilizes in the fourth quarter to pre-pandemic levels. Supporting other findings [18] , about 65% of internationally coauthored papers include only two nations-this is a drop from usual patterns. Brazil 127 (2.5%) 2736 (3%) 68 (4.2%) 919 (4.5%) * Percentage share of articles with at least one article from the focal country in total global articles. Top 10 producers in pre-COVID-19 and COVID-19 (11 countries in total) are shown. In earlier work, we noted that developing nations were largely absent from the publication records in the early COVID-19 period. We explored the participation of Terms retrieved from titles and abstracts of research articles provide useable clues to understand topic focus ii . The co-occurrence between terms and entities (e.g., funding agencies), and among terms, reveals their semantic connections in research, and may answer questions such as which agencies support which topics. The connection is measured by how many times two terms appear in proximity in the entire dataset, within and across articles. We identified 4,865 terms from a raw set of 1.2 million terms retrieved from titles and abstracts of the 106,993 articles published in 2020 via natural language processing techniques and a term clumping process [34] , with the aid of VantagePoint iii . Specifically, the term clumping process facilitated a set of thesauri to remove meaningless terms (e.g., conjunctions, pronouns, and prepositions) and common terms in academic articles (e.g., "method" and "conclusion"), and it then consolidated terms with the same stem (e.g., terms in singular and plural forms). Figure 5 analyzes the co-occurrence between the top 20 high-frequency terms and the major funding sources, visualized by Circos [35] . The Chinese agency, National Science Foundation of China (NSFC), was much more likely to fund research related to "Wuhan" while the United States' National Institutes of Health (NIH) is much more likely to fund research with the term "United States." Small differences can be observed for "clinical characteristics" (proportionately more from NSFC), and "hospitalization" (proportionately more from NIH) but these two terms are quite similar, so differences may be due to semantics only. Aside from these two differences, it appears that each of the agencies fund similar term portfolios differentiated only in proportion to their contribution, so more focused on basic research, which was our expectation. To assess whether international collaborations had different topic focus from domestic Forthcoming, PLoS One 24 collaborations-which we expected-we analyzed co-terms at both levels. Figure 6 shows the co-term network for the internationally collaborative research, and Figure 7 shows the co-term network for domestic-only collaborations. In both networks, one sees the topics that are shown in Figure 5 as focus areas for government funders. With data extracted using Vantagepoint's Natural Language Processing function ported into VOSViewer, Figure 6 shows international collaboration dominated by three clusters: 1) Interactive version accessible at https://app.vosviewer.com/?json=https://drive.google.com/uc?id=1RraBpIYbLY5_DfOMC0YJ7IZoq3_s RiKa Figure 7 shows domestic topics, highlighting greater emphasis on patient care and disease characteristics (gold, top center) than seen in Figure 6 . Moreover, a fourth cluster emerges (blue, center) with details about outbreaks, effects, viral loads, and other aspects of health are seen that are not as prevalent at the international level. A table in the appendix provides more details about the topics. As expected, the domestic publications focus on public health and patient care more than is seen at the international level, where basic science dominates the topics. Collaboration rate Table 5 compares collaboration rates in coronavirus publications before the COVID-19 pandemic and in four quarters of 2020. As expected, and in comparison to the number of co-authors in pre-COVID-19 coronavirus research, publications in 2020 show fewer authors, fewer nations per paper, and less frequent international collaboration overall. Team size--represented by the number of authors on a publication--shrank shortly after the outbreak of COVID-19, a finding we highlighted in Fry et al. [1] , but by the end of the year, the number had recovered and risen to just above levels seen in pre-COVID-19 coronavirus research. As expected, the average number of nations per international publication remained at lower levels than pre-COVID-19 levels for USA articles; there was no significant difference in numbers of international partners for Chinese articles in pre-COVID-19 and COVID-19 periods. [15] article. * denotes statistical significance at p values of 0.05 in a difference of means test comparing pre-COVID-19 and COVID-19 outcomes. Comparisons are between pre-COVID-19 outcomes and outcomes in different COVID-19 quarters. Data source: We explored the relationship between team structure as represented by coauthors on papers and the number of citations to COVID-19 publications for publications produced in 2020 (looking at citation records up until March 2021). Table 5 shows the regression results that explore the relationship between citations to publications and international collaborative team structure, for publications with authors from USA, China, and the UK respectively. As expected, a positive correlation is shown between numbers of citations and international collaboration. Further, also meeting expectations, there is a correlation between number of authors and citations, which may reflect an audience affect due to a larger reader network. Also as expected, international teams attracted more citations than domestic-only teams, again, with a possible audience affect. These findings held for all nations except the USA, where international articles are not cited more than domestic-only research when holding constant the number of authors (Table 6 , column 6). Table 6 . Negative binomial regression analysis of the relationship between team structure and citation impact of coronavirus publications in 2020. Table 2 ). However, during COVID-19 period, the negative impact of geographic distance on collaboration strength was weakened as demonstrated by positive and significant coefficient of interaction of COVID and geographic distance. As expected, physical distance was less of a barrier to collaboration than in other scientific research. The result reveals that the pandemic weakened the role of geographic distance in international collaboration the endnote iv . Table 7 shows the network metrics for the above networks and for four quarters of Table 8 research trends in a timely manner, which meant we worked with data available at the time (in Spring 2021) rather than waiting until data has been expanded, cleaned or validated. Elsevier and Clarivate databases were also examined; these databases are more carefully curated for quality. We tapped them for comparisons to CORD-19, and especially for non-COVID research. We had planned to test whether the pandemic had an impact on non-COVID research but we were unable to show this outcome: During 2020, peer reviews were delayed [36] , researchers were not able to access labs or other resources, and scholarship was interrupted, but these obstacles are not yet evident in the data. Disruptions to 2020 research activities likely will not be seen in publication data until 2022 and after. We also exclude preprint publications from this analysis, which could present a limitation, given the important role of preprints during the pandemic. Further, a limitation of this analysis is the reliance on nations as 'super-nodes' in a network that consists of individuals with associated cultural contexts that are not captured in network data. This reliance on nations is partly justified in that nations represent the underlying political and social systems that support scientific activities by offering funding, infrastructure, training, and dissemination of results. We acknowledge that the reliance on nations as a unit of measurement is a limitation, imposed on the analyst based upon the ways in which data are collected. Future research will need to ensure cleaner data to validate comparisons presented here. None of these datasets can truly represent the scope of activities that contributed to what is known about COVID-19, and mechanisms to assess knowledge flows are quite limited and time consuming to collect. in number in early 2020, and these publications were much more likely to be shared on open-access platforms or formats to enable rapid knowledge diffusion than is the norm in scholarly publishing [17] . The earlist COVID-19 research efforts were conducted by China, the USA, and the UK, and these three nations constitute close to 50% of all COVID publications on the subject in 2020. European nations started off slowly in research publications, but these nations continued to grow their output throughout 2020, as China's output dropped. As expected, international collaborations accounted for a smaller percentage of publications than is generally seen in 'normal' times, where internationally coauthored articles often account for more than one-quarter of articles [put new footnote here that was added on page 4 and delete this note] We expected the drop-off in international publications because a lack of mobility meant that people were unable to meet and discuss shared insights, or to devise, carry out or compare research results. Remote collaborations involve higher transaction costs and could be expected to slow progress. This possibly explains why international teams were smaller: to cut down on the time needed for communication. Further, the lower rate of international collaboration may be due to topics related to patient care and public health specific to particular regions or nations rendering them less suited to international collaboration [3] . We also noted that distance was less of a barrier to collaboration than is shown in other studies in times before the COVID-19 crisis. Interestingly, the number of papers per nation tracks closely with the outbreak of COVID-19 cases in that nation. We expected to find numbers of publications to be more closely correlated to research funding. This may still be the case, but the data is too variable and incomparable to elicit a correlation between funding and output. We surmise that researchers were motived by a desire to be helpful to those suffering with the disease. It may also be the case that local COVID cases provided observational opportunities for researchers, and thus publication opportunities, as well, which produced data that resulted in more national publications. The low rate of participation by lower-income nations was somewhat unexpected. Lower-income nations had a very low rate of participation in the early days of COVID, and only slowly joined the global publication counts. This may be due to a number of factors, including the need to publish locally to address the crisis, the inability of researchers to access laboratories or data during lock-down periods, the lack of access to one's office, or the inability of national ministries to provide emergency research funds. People may not have had access to the Internet at home. The lower showing for developing nations is a concern, since these nations need the scientific knowledge to battle viral events just as much or more than advanced nations. This finding clearly requires more research and perhaps policy action. We expected that the combined rush to work on COVID and the pandemic lock-downs would reduce non-COVID research activities. This may still be the case (reported in a survey by Myer et al. [2] ), but it could not be detected in publication numbers at this writing. Publications in life and health sciences in non-COVID topics increased in number over 2019. As researchers become more comfortable with remote work, they may have persisted in publishing earlier results, however, this does not comport with the findings of Myer et al. [2] . As the pipeline catches up these activities, it will be worth revisiting the impact on productivity again at the end of 2021. The stratification and consolidation comport with a model of global science as a reputation-based system creating a social hierarchy: the global network reverts to scientifically advanced nations and elite institutions in a crisis. We expected that the number of papers would align with reputation and resources. The role of reputation is confirmed by the consolidation of actors to fewer, elite institutions in scientifically advanced nations cooperating together more so than prior to the pandemic. The role played by access to resources is unclear--we observe that national output is closely tied to number of COVID-19, which could be due to a desire of scientists to help the effort. This requires more inquiry. The influence of geopolitical factors also appears to play some role in research output, partnership and productivity. Arguably, Chinese publications initiated most of the COVID-19 research into the nature of the SARS-CoV-2 virus itself [29] [30] [31] . Nevertheless, in April 2020, the Chinese government changed requirements for review of articles Interactive version accessible at https://app.vosviewer.com/?json=https://drive.google.com/uc?id=1xF4G-NSwQqP937s9bGlf3CzOIjF9AA0D Figure A3 . Global Network of international collaborative relationships between July and September 2020. Interactive version accessible at https://app.vosviewer.com/?json=https://drive.google.com/uc?id=1kk2sQvrWCB1xfFuGepzaDqc6cyyr 3MvH Figure A4 . Global Network of international collaborative relationships between October to December 2020. 3593 Standard robust errors in parentheses * p < 0.1, ** p < 0.05, *** p < 0.01 Note: Regressions are run with a model at the country pair level for pre-COVID and COVID-19 collaborative publications. We apply a square root transformation to Salton's measure and the geographic distance. Consolidation in a crisis: Patterns of international collaboration in early COVID-19 research Unequal effects of the COVID-19 pandemic on scientists Topic evolution, disruption and resilience in early COVID-19 research National Science Board. The state of U.S. science and engineering Growth of international collaboration in science: revisiting six specialties Core-periphery, new clusters, or rising stars?: International scientific collaboration among 'advanced' countries in the era of globalization Analysing scientific networks through co-authorship. In Handbook of quantitative science and technology research: The Use of Publication and Patent Statistics in Studies of S&T Systems Does the geographic proximity effect on knowledge spillovers vary across research fields? Crisis and the trajectory of science: Evidence from the 2014 Ebola outbreak. The Review of Economics and Statistics Network structure, self-organization, and the growth of international collaboration in science When disasters strike environmental science: a case-control study of changes in scientific collaboration networks Knowledge generation in the wake of the Fukushima Daiichi nuclear power plant disaster Preprints contain the results of research activities, but they have not yet been subject to peer review How scientific research reacts to international public health emergencies: A global analysis of response patterns International collaboration during the COVID-19 crisis: autumn 2020 developments Nanoscience and nanotechnology: Evolving definitions and growing footprint on the scientific landscape Drinking from the firehose: Preprints, Chinese researchers, and the diffusion of knowledge in COVID-19 Can pandemics transform scientific novelty? Evidence from COVID-19 Opinion: Scientists in the US and China collaborating on COVID-19. The Scientist Publication patterns' changes due to the COVID-19 pandemic: A longitudinal and short-term scientometric analysis Software survey: VOSviewer, a computer program for bibliometric mapping A measure of betweenness centrality based on random walks Bi-layer network analytics: A methodology for characterizing emerging general-purpose technologies A bibliometric analysis of international scientific cooperation of the European Union (1985-1995) Mapping the network of global science: comparing international co-authorships from 1990 to 2000 No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic Pandemic publishing poses a new COVID-19 challenge The publishing delay in scholarly peer-reviewed journals Clinical features of patients infected with 2019 novel coronavirus in Wuhan Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia A novel coronavirus from patients with pneumonia in China Low-income countries (LIS) as defined by Department for International Development (DFID) of UK Do firms publish? A multi-sectoral analysis Term clumping" for technical intelligence: A case study on dye-sensitized solar cells Circos: An information aesthetic for comparative genomics Publication non grata: The challenge of publishing non-COVID-19 research in the COVID era Thanks go to Clayton E. Tillman and Thomas Collins for help with data collection and formatting.Forthcoming, PLoS One Figure A1 . Global Network of international collaborative relationships between January and March 2020.Interactive version accessible at https://app.vosviewer.com/?json=https://drive.google.com/uc?id=15Tm65Or1n2OYvxOR3nlrhh1fKu_ MC1uvAppendix Table 1 Numbers of coronavirus researchers, before and during the COVID-19 pandemic Table 2 Geographical distance across countries in COVID research (1)