key: cord-0023329-1n3w06o9 authors: Fujii, Erika; Takata, Takuya; Yamano, Hiroko; Honma, Masashi; Shimokawa, Masafumi; Sasaki, Hajime; Shikano, Mayumi title: Study on Horizon Scanning by Citation Network Analysis and Text Mining: A Focus on Drug Development Related to T Cell Immune Response date: 2021-11-22 journal: Ther Innov Regul Sci DOI: 10.1007/s43441-021-00351-3 sha: bc88089ea37fe32c4f13b5c036c6f517ed09a11a doc_id: 23329 cord_uid: 1n3w06o9 Certain innovative technologies applied to medical product development require novel evaluation approaches and/or regulations. Horizon scanning for such technologies will help regulators prepare, allowing earlier access to the product for patients and an improved benefit/risk ratio. This study investigates whether citation network analysis and text mining of scientific papers could be a tool for horizon scanning in the field of immunology, which has developed over a long period, and attempts to grasp the latest research trends. As the result of the analysis, the academic landscape of the immunology field was identified by classifying 90,450 papers (obtained from PubMED) containing the keyword “immune* and t lymph*” into 38 clusters. The clustering was indicative of the research landscape of the immunology field. To confirm this, immune checkpoint inhibitors were used as a retrospective test topic of therapeutics with new mechanisms of action. Retrospective clustering around immune checkpoint inhibitors was found, supporting this approach. The analysis of the research trends over the last 3 to 5 years in this field revealed several candidate topics, including ARID1A gene mutation, CD300e, and tissue resident memory T cells, which shows notable progress and should be monitored for future possible product development. Our results have demonstrated the possibility that citation network analysis and text mining of scientific papers can be a useful objective tool for horizon scanning of life science fields such as immunology. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s43441-021-00351-3. The application of innovative technologies that would lead to a product of novel modality or mechanism of action is expected to be a potential new therapeutic or diagnostic tool for diseases. However, there may be cases where the application of conventional development and evaluation concepts, regulatory frameworks, or both to innovative technologies are inappropriate. Therefore, early identification of innovative technologies with potential applications to medical products through horizon scanning would encourage regulatory authorities to establish new approaches to assess their quality, efficacy, and safety to advise developers and revise their regulations as needed. This could also contribute to timely patient access and improve the benefit-to-risk ratio of the product [1] . Traditionally, horizon scanning has been predominantly conducted in Europe for policy-making, scientific research funding, and healthcare budgeting purposes, by surveying the Internet, government, international organizations and companies, databases, and journals using the Delphi method [2, 3] . The IHSI, a regulatory entity with participation from eight European countries developed the IHSI Joint Horizon Scanning Database to promote fair and transparent pharmaceutical prices to drive price reduction, mitigate the impact of disruptive innovation, support effective budgetary policy and support HTA and regulatory preparation [4] . One of its recent activity is IHSI's agreement with Emergency Care Research Institute (ECRI), an independent healthcare service organization that provides technical solutions and evidence-based guidance to healthcare decision makers worldwide, to build the International Horizon Scanning Database [5] . The agreement will enable suppliers including government to develop a database of upcoming drug launches and IHSI high-impact reports, which may help level the playing field for stakeholders. In the field of medical product regulation, the International Coalition of Medicines Regulatory Authorities (ICMRA), a group of regulatory authorities from 30 countries and regions, recognized the need to respond quickly to innovative technologies and agreed on the importance of 'horizon-scanning' to identify such technologies [6] . Hines et al. reported that in the medical and healthcare field, most horizon scanning methods used were manual or semi-automated, with relatively few automated aspects. It is difficult to understand the whole picture of the extremely large and fragmented results of research and technological development. It might also be inappropriate to narrow the scope of consideration based solely on experts' opinions, since information from experts might be subjective and the outcome depends on the choice of the expert. To solve this challenge, a computer-based approach can be used to complement the expert-based approach, as it fits the scale of the information [7, 8] . In particular, the citation-based approach assumes that the papers on which a paper is based and the papers it cites are similar. Analyzing this citation network allows us to understand the structure of the research areas constituting the large volume of papers that we can read. These methods have been widely used as powerful tools for visualizing and understanding the structure of a research field to identify new trends and research directions; they have been proven effective in various studies [9] [10] [11] . It has been reported that a citation network analysis can effectively and efficiently track emerging research areas in the field of sustainable science [12] , including energy research [13] , regenerative medicine [14] , robotics [15] , and gerontology [15] . Sakata et al. [16] proposed a meta-structure of academic knowledge on patent and innovation research to effectively assist policy discussions on intellectual property system reform. They has shown that network analysis and machine learning methods are useful for understanding and predicting the development of technologies such as solar cells [17] and nanocarbons [18] suggesting their approach is useful tools for R&D strategists and policymakers in various fields to understand the broad scope of scientific and technological research and make decisions for worthwhile investments in promising technologies. In this study, we focused on T cell immunity, because the research and the market has grown rapidly to be one of the major fields for developing pharmaceuticals, but the research history of the field shows an unexpected complexity which is considered to be a feature significantly different from other scientific fields such as artificial intelligence and nanocarbon. We explored if Sakata's method is able to apply to immunology field focusing on immune checkpoint inhibitors as a retrospective example with new mechanisms of action and identified new topics in this field optimizing the horizon scanning method according to the target field. To select queries for citation network analysis and extract key articles to track the R&D history of immune checkpoint inhibitors, we selected the six key articles [19] [20] [21] [22] [23] [24] shown in Table 1 , which are milestones in the research history of immune checkpoint inhibitors, based on relevant reviews [25, 26] and the descriptions on the official page for the Nobel Prize in Physiology or Medicine 2018 awarded to Dr. James P. Allison and Dr. Tasuku Honjo [27] . The keywords appearing in the key articles were used as search queries for paper titles, abstracts, author keywords, and keywords to extract papers, which included citation information for citation network analysis in the Web of Science literature database Web of Science Core Correction (WoS, Thomson Reuters) and PubMed (MEDLINE [Medical Literature Analysis and Retrieval System Online]). To avoid subjectively narrowing down the papers for analysis and to include as many key articles as possible, we used "immune*" AND "t lymph*" as queries for both PubMED and Web of Science. We obtained 132,433 papers from the PubMed search, of which 90,450 papers (68.3%) formed a citation network containing five of six key articles. From the WoS search, 41,880 papers were obtained, of which 37,297 papers (89.1%) formed a citation network, but only one key article was included. We used only papers obtained from PubMed, which are considered to cover more papers than WoS on the targeted immune checkpoint inhibitors for the following analysis of citation networks and text mining. In this study, a citation network was converted into an unweighted network with papers as nodes and citation relationships as links. Papers with no citations as the largest component were considered digressional and were ignored in this study (Step 2 in Fig. 1 ). The core paper with the highest number of citations is located at the center of the citation relations. The network is then divided into several clusters using the topological clustering method. Topological clustering is a clustering method based on the graph structure of a network, and modularity maximization is used in the present scenario. Here, a cluster is a module in a citation network and a group of papers in which the citation relations are divided using a modularity (Q value) maximization method and are densely aggregated (Louvain method) [18, 28] . The modularity maximization method appreciates network partitioning such that the intracluster is dense and the intercluster is sparse. The modularity maximization method determines an optimal partitioning pattern by extracting the partitioning pattern that maximizes the modularity using a greedy algorithm. Q is an evaluation function of the degree of coupling within a cluster and between clusters, and is given as follows: Table 1 Key articles and the clusters in which they are contained The key articles considered to be important milestones in the history of research and development of immune checkpoint inhibitors as well as the clusters obtained by citation network analysis of papers obtained from PubMed (see Table 2 ). The key article B was not included in the clusters formed Fig. 1 Steps of clustering and making academic landscape based on citation network [29, 30] . This Figure has been published in reference [18] . The procedure of the citation network is as follows: extraction dataset of academic papers for analysis (Step1). For the extracted dataset, the citation network was converted into an unweighted network with papers as nodes and citation relationships as links ( Step 2). The network was then divided into several clusters using the topological clustering method (Step 3). In addition, a large graph layout (LGL) that is based on a force-direct layout algorithm displayed the largest connected component of the network to generate coordinates for the nodes in two dimensions, visualizing the citation network by expressing inter-cluster links with the same color (Step 4) where A ij represents the weight of the edge between i and j , k i = ∑ j A ij is the sum of the weights of the edges attached to the vertex i, ci is the community to which vertex i is assigned, δ-function δ(u, v) is 1 if u = v and 0 otherwise, and m = 1∕2 ∑ ij A ij . The cluster No. labels are assigned numbers based on the number of papers included in the cluster. The characteristics of each cluster were confirmed by extracting a summary/ abstract of frequently cited academic papers in the cluster and the characteristic keywords in the cluster. In addition, we computed the term frequency-inverse cluster frequency (TF-ICF) to extract the characteristic keywords that were mechanically extracted by text mining with high TFCIF ( Table 2 ) of each cluster. TF provides a measure of the importance of a term in a particular sentence. The inverse cluster frequency (ICF) provides a measure of the general importance of a term. The TF-ICF of a given term i in a given cluster j is given by where N is the total number of sentences. Based on the keywords with high TF-ICF of each cluster, we can infer the topic of each cluster. To confirm the trends in the research field, the mean and median year of publication of papers in each cluster were extracted, as well as information on journals, authors, and affiliated institutions. After clustering the network, visualization was converted to intuitively infer relationships among these clusters. We use a large graph layout (LGL), which is based on a forcedirect layout algorithm [29, 30] . This layout can display the largest connected component of the network to generate coordinates for nodes in two dimensions. We visualized a citation network by expressing inter-cluster links with the same color (Step 4 in Fig. 1 ). However, the position of the clusters and the distance between clusters do not indicate an approximation of the content. An overview of the diagram is presented in Fig. 1 . We analyzed a citation network of papers obtained from PubMed, and 38 clusters were formed. Table 2 shows the information on these clusters. The topic of each cluster can be inferred based on the characteristic keywords with high TF-ICF of each cluster, and the title and abstract of several papers that are most cited within each cluster. Summary of top 10 clusters, which contain 80% of the papers in all clusters, were suggested based on Table 2 as follows; Cluster 1 is assumed to be a group of papers on regulatory T cells, as the top keywords include "tregs" and "foxp3." Cluster 2 includes "tumors" and "immunotherapy" in the top keywords, suggesting that it consists of papers related to cancer immunity. These two clusters have the most recent average year of publication, suggesting that they are topics that have been extensively discussed in recent times. Cluster 3 is assumed to be a group of papers on the immune response to HIV and SIV infection because the top keywords include "HIV", "virus", and "infection." Cluster 4 is assumed to be a group of papers on immunosuppression because the top keywords include "suppressor" and "suppressor cells". The average publication year of cluster 4 (1984) is the earliest among the top 10 clusters, indicating that this topic has been discussed over a long period. Cluster 5 is associated with infection, particularly hepatitis virus and influenza, as its top keywords include "HCV", "HBV" and "influenza." Cluster 6 is presumed to be related to the role of dendritic cells in the immune response, because its top keywords include "dendritic" and "tumor". Cluster 7 is considered to be related to immunotolerance because its top keyword is "tolerant." "Ebv" and "cmv" in its top keywords of Cluster 8 indicate that it is a group of papers on viral infection, transplantation, and Tcell responses. Cluster 9 includes "tuberculosis" and "mycobacterium" in the top keywords, suggesting that it is a group of papers related to bacterial infection and immunity. Cluster 10 might be associated with the role of helper T cells in the immune response, as the top keywords include "tfh" and "tcr." Table 2 also shows the variation in the median publication year of the papers in each cluster: 1984 for Cluster 4, 1997 for Cluster 7, and 2008-2012 for others. The distribution of publication years over a long period of time is supposed to represent a characteristic of immunology field that research progress requires accumulation of a lot of research. We selected the six key articles shown in Table 1 as studies that contributed to the research and development (R&D) of immune checkpoint inhibitors. By examining the clusters which contain these articles, we assessed whether clusters represent the contents of these articles: article A [24] on the discovery of PD-1, article B [23] on the function of CTLA-4, article C [22] that showed antitumor activity of anti-CTLA-4 antibody in mice, article D [21] on the involvement of PD-1 in autoimmunity; article E [20] on PD-1 and immunosuppression, and article F [19] on the antitumor effect of PD-L1 inhibitors in mice. Articles A, D, and E, all of which are related to immunotolerance were included in Cluster 5, which is associated with immune checkpoints in viral infection. The hub paper [31] of the cluster is on the functional recovery of CD8 + T cells by PD-1/PD-L1, with possible Information on 38 clusters was obtained from the citation network analysis of papers published up until the end of 2020. The median publication year of constituent papers, characteristic keywords based on the term frequency-inverse cluster frequency (TF-ICF, see Methods), and the titles of hub papers with the highest number of citations in each cluster are listed involvement in chronic viral infection. All of the key articles A, D, and E were included probably because all are related to immunotolerance. Subclusters obtained by reanalysis of Cluster 5 also shows the cluster contains papers on the function of immune checkpoints in restoring the function of T cells (Supplement 3) . Key articles C and F were included in cluster 2, which is related to cancer therapy. These results suggested that the papers with similar content are classified in the same cluster. Article B was excluded from the analysis probably because CTLA-4 did not receive much attention until the anti-tumor effects of anti-CTLA-4 antibodies were demonstrated. It is suggested that Cluster 2 might be related to cancer immunity. In order to validate the method by confirming whether it can visualize the research progress and demonstrate the overall research landscape of the immune field, we assessed the transition of research on immune checkpoint inhibitors by analyzing papers published up to each year and identified the cluster containing the key articles in Table 1 as well as the number of citations within the cluster. As shown in Fig. 2 In this method, clusters are constructed based on papers with related citations; therefore, papers with several common citations, that is, papers that are likely to have similar content, are placed in the same cluster. The key articles in Table 1 were detected in either of two clusters according to the content of each paper indicates that the papers with similar content into the relevant clusters. It was also observed that the number of citations accumulated up to the analysis year indicating that interest in the research of immune checkpoint inhibitor increased annually. Lowering the cluster ranking, which represents the ranking of the number of papers in the cluster, was often observed (2007, 2008, 2009, 2010, 2012 , and 2017 in Fig. 2 ). This is because the papers on a particular topic among related studies formed a new independent cluster, and we observed that the number of papers in clusters increased and the cluster numbers rose afterward (2013, 2014 in Fig. 2 ). To detect the latest research trends in T lymphocyte immunology in this area, we reanalyzed 'young' clusters, which contains more papers published recently. The cluster often includes papers with broadly related topics, and sub-clustering may reveal individual topics; therefore, we reanalyzed clusters 1 to 5, which are the top five clusters with the most papers included as well as clusters 15, 16, 17, and 19 , which were the top five in terms of the percentage of papers published in the last 3 or 5 years among the papers in each cluster (Table 3) . Research trends were analyzed over 3 and 5 years because based on the results of the analyses described above, Table 1 were plotted, and the size of the circles represents the approximate number of citations in the cluster for each paper. The table of clusters containing each key article and its citation within the cluster is shown in Supplement 1 the median year of publication of the papers included in the cluster was over 10 years ago (Table 2) , it is supposed to be necessary to analyze trends over several years to capture the progress of research at a certain level. In addition, it may take up to a year from the date of publication before a paper is included in PubMed. Therefore, considering a short period of one to 2 years could lead to overlooking new research trends. We examined subclusters formed by the re-analysis with more than 100 papers and median publication year of 2016 or later (Table 4) , since clusters with a small number of papers are considered to have relatively low research activity. Cluster 5 is related to immune tolerance to viral infections, and its subclusters 5-14 are related to TIGIT and CD155, which are considered to be the third molecules [32] for immune checkpoints following PD-1/PDL-1 and CTLA4/CD80/86, whose inhibitors have already been used in pharmaceuticals. Cluster 15 is related to immune responses to viral infections, and its subclusters 15-1 and 15-4 had a median publication year of 2020 for the constituent papers. Sub-cluster 15-1 was inferred to be related to T cell immunity against SARS-CoV2 infection and COVID-19. Sub-cluster 15-4 is likely to be related to the function of monocyte CD300e [33] and cancer ARID1A genes [34] , which have recently attracted much attention. Cluster 16 is related to cellular immune responses to infection, and its sub-cluster 16-1 is presumably related to the function of tissue resident memory T cells and their application in vaccines and therapy. Cluster 19 is presumed to be related to the therapeutic application of cancer immunity, and its sub-cluster 19-1 includes papers on iRGD [35] , an RGD peptide derivative that is expected to promote anticancer drug uptake by tumor cells. All subclusters obtained by reanalysis is demonstrated in Supplement 3. In this study, we applied citation network analysis and citation network analysis of bibliographic information in the field of immunology, which takes a rather long period to progress research due to the complexity of in vivo molecular interactions. For the immune checkpoints, CTLA-4 and PD-1 were identified in 1987 [36] and 1992 [24] , respectively. It took more than 20 years for the approval of their inhibitors as pharmaceuticals in 2011 and 2014. We were able to grasp the academic landscape of the field of immunology thorough the analysis as shown in Table 2 and Supplement 2. We then examined whether the development history of immune checkpoint inhibitors, which were developed as anti-cancer drugs with novel mechanisms of action, could be reproduced by this method. The following is a summary of the development history of immune checkpoint inhibitors and the relevant key articles: CTLA-4 was identified as an immunoglobulin superfamily molecule in 1987 [36] and PD-1 as an apoptosis-related immunoglobulin superfamily molecule by in 1992 [24] , and research on their functions has continued. In 1995 [23] , CTLA-4 was reported to be associated with T cells, and in 2000 [20] , PD-1 was reported to be involved in autoimmune diseases. Inhibitory antibodies against CTLA-4 and PD-1 were first reported to have anti-tumor effects in preclinical studies in 1996 [22] and 2002 [19] , respectively. Clinical trials for ipilimumab, an anti-CTLA-4 antibody, were first started in the US in 2001 [37] and it was first approved in the US in 2011. Clinical trials for nivolumab, an anti-PD-1 Table 3 The six clusters with top 5% of papers in either the last 3 or 5 years As an indicator for clusters with more new papers, the ratio of papers published in the last 3 or 5 years versus all papers in each cluster was calculated, and the top five clusters in either category are shown. Clusters 1 and 17 were included in either 3 or 5 years, so a total of six clusters were targeted. The top five in either category are underlined Table 4 Clusters with candidate new topics for horizon scanning The information on subclusters obtained from reanalysis of the top 10 clusters is shown in Table 3 , with a median publication year of 2016 or later and with more than 100 papers Cluster name antibody, were first started in the US in 2006 [38] and was first approved in Japan in 2014 [39] . Clinical trials for pembrolizumab, another anti-PD-1 antibody, were first conducted in the US in 2010 [40] and it was first approved in the US in 2014 [41] . In this study, we did not focus on anti-PD-L1 antibodies, which were developed later than anti-PD-1 antibodies because our purpose was to understand early research trends before the establishment of anti-cancer drugs based on the inhibition of immune checkpoints. The results of our analysis during this period are shown in Fig. 2 . From this figure, it can be seen that the cluster containing most of the key articles fluctuated significantly from 2002 to 2010, (2002, 1, 2003, 4, 2004, 22, 2005, 12, 2006, 1, 2007, 3, 2008, 9, 2009, 13, and 2010, 16 in Fig. 2 ). Such fluctuations may be accompanied by a decrease in the number of constituent papers and an increase in the citation number of key articles in the cluster when the number of papers on a particular topic in the cluster increases and, forming a new, independent cluster (2007, 2008, 2009, 2010, 2012, 2017 , and 2020 in Fig. 2 ) (Fig. 2 2013, 2014) . We confirmed that the fluctuations in Fig. 2 were caused due to the aforementioned reason by examining specific keywords and papers with a high number of citations in each cluster. Thus, the fluctuations in cluster number with increasing citation suggest a rapid progress of the topic, and the results shown in Fig. 2 suggest an increase in research activity several years prior to the commencement of the clinical trials of nivolumab and pembrolizumab in 2006 [38] and 2010 [40] , respectively. Figure 2 shows no significant changes for the number of citations of key article A on PD-1 prior to the clinical trial of ipilimumab, an ant-CTLA-4 antibody in 2000 [20] . One of the possible reasons is that the idea of using immune checkpoint inhibitors for cancer treatment was rather dubious at that time, because few research reports supported this idea. Significant activation of relevant research was not observed even after the clinical trial, since the efficacy of ipilimumab alone was not great enough to attract attention [42] . Tremendous research efforts over a long period were also required until the establishment of the concept of immune checkpoints [43] , which is common to both CTLA-4 and PD-1. These results suggest that the analysis could reproduce the research progress of immune checkpoints and that the potential for product development could have been predicted several years before their clinical trials. Next, we investigated recent research trends in this field (Table 4 ). Owing to the huge amount of funding for COVID-19-related research since early 2020, some of the 'young' subclusters were related to immune responses to coronavirus infection and COVID-19: sub15-1 (median publication year of constituent papers is 2020), sub15-7 (2018), which is excluded in Table 4 because it contains less than 100 papers, and sub19-1 (2020). Progress in research has been observed not only in the immunological response to SARS-CoV2 infection, but also in peripheral fields, including iRGD [35] , an RGD peptide derivative that is expected to promote selective uptake of antitumor or antiviral drugs into tumor or infected cells (sub19-1). Research on immune checkpoint inhibitors seems to be still active, as suggested by sub5-14 (2016) related to TIGIT [32] , another immune checkpoint molecule following CTLA-4 and PD-1, which is in clinical development. It is also suggested that monocyte CD300e [33] and cancer ARID1A gene [34] in sub15-4 (2020) may also be candidate topics that continue to follow. Monocyte CD300e [33] is a leukocyte mono-immunoglobulin-like receptor that recognizes lipids and is involved in allergy or inflammation. The ARID1A gene mutation is detected in some types of cancer in the ovary, stomach, or bile tract and is of interest as a target for anti-cancer drug development [34] . The function of resident memory T cells [44] and their application to vaccines and therapeutics [45] is also a possible new topic found in sub16-1 (2017). Recently, interest in the relationship between immune checkpoint molecules and predictive tumor biomarkers has recently attracted attention, and the accumulation of TILs in the tumor parenchyma [46] was observed in Cluster2, suggesting a candidate topic to follow up in the future. It is conceivable that these candidate topics should continue to be followed by periodical analysis, every several months, for example, because they might be applied to new drugs with novel mechanisms of action. Thus, this study shows that citation network analysis and text mining using the methods of Sakata et al. [16] can be used to understand new research trends not only in fundamental technologies applicable to various fields such as nanocarbon and AI [18, 47] , but also in biological fields elucidated over a long period, such as immunology. This study is the first to show that this method can be used appropriately as a tool for horizon scanning in the medical field. Because it is difficult to extract a limited number of novel topics that may affect pharmaceutical regulations from a vast amount of information on a human basis, it is reasonable and appropriate to use a computer-based method such as the method used in this study as a primary screening [47] . We assume regulators as the end users of this method, which offers a new tool for horizon scanning to extract new topics from a huge database leading to the development of guidance and revisions to pharmaceutical regulations. This method might be applied to other government activities, such as HTA, research funding, and the business field. There may be limitations to our approach. One is the time delay until the publication of the research results, because most recently published papers without citation relationships cannot be included in this analysis method. However, we consider its impact on horizon scanning, targeting the stage before clinical development. Since it generally takes a few years from when the data have a high possibility of product development, non-clinical proof of concept, for example, to the start of clinical trials, we consider that our method can predict technologies that may lead to clinical development based on mid-to long-term research trends, even taking into account the time delay for publication. Another limitation is the necessity of the evaluation by experts in multiple aspects, such as expected medical positioning and patent information in order to achieve the purpose of horizon scanning, because our proposed method is based on the analysis of bibliographic information. In addition, we have not confirmed whether this method can be applied to all research domains. Hence, it may be necessary to consider an appropriate strategy for the utilization of this method in each field. We also suggest that selection of a bibliographic database is critical. We extracted scientific papers for citation network analysis from PubMed, which consists of more than 30 million citations to biomedical papers from MEDLINE, life science journals, and online books [48] .We also tried to analyze papers extracted from WoS, which consists of 161 million citations across 254 disciplines beyond science, but the obtained papers contained only one of the six key articles, suggesting that the papers that represent the research trends in this field were not extracted as described in METHODS. When we applied this analysis method to the artificial intelligence (AI) field to investigate the R&D of AI-equipped medical devices, we obtained more useful information from WoS than from PubMed [47] . In the study of three-dimensional cell layering using this method, WoS provided information more information on the base material for adhesive culture and bioprinting equipment, while PubMed provided more information on cell functions (data not shown). This suggests that the bibliographic database for analysis needs to be chosen according to the target field. Other methods are being explored to predict the future research activity of a certain topic. For example, in addition to cluster analysis, budding prediction was proposed to predict the growth of identified high-profile papers in the fields of solar cells and nanocarbons [17, 18] . Most of the other horizon scanning activities in the health science field have been limited to HTA including IHSI activity focus on post-clinical and pre-marketing technologies. Our study is new in that it focuses on technologies that would be in clinical development in a relatively short period of time, with the aim of identifying novel technologies that could have regulatory implications at an early stage. Mechanical analysis using citation networks and text mining is used in the science map reported by the Japanese National Institute of Science and Technology Policy (NISTEP). However, they aim to obtain a bird's eye view of the entire scientific field by the top 1% of papers in terms of citations using "co-citation". Sakata's method seems to be more suitable for our purpose since the method applies 'direct citation', which has been reported to be the most appropriate for obtaining leadingedge information on trends, to all papers extracted from the database [47] . Thus, this study demonstrates that the proposed method of horizon scanning targeting technologies prior to clinical development based on citation network analysis and text mining is unique. This study showed that the citation network analysis and text mining of scientific papers by the methods of Sakata et al. can objectively identify the emergence of new topics and their development through periodic analysis. We identified several candidate topics such as iRGD, ARID1A, and CD300e, for which tracking future research progress and potential applications to pharmaceuticals are recommended. The obtained results establish an efficient primary screening tool for horizon scanning procedure that enables regulators to prepare for new technologies, potentially benefiting patients through earlier access to the innovative products. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/. Innovation strategic priority project report Overview of methodologies Scanning the horizon: a systematic literature review of methodologies International horizon scanning initiative International horizon scanning initiative ICMRA. Innovation | International coalition of medicines regulatory authorities (ICMRA) Visualizing knowledge domains Mapping the backbone of science Visualising semantic spaces and author co-citation networks in digital libraries Visualizing and tracking the growth of competing paradigms: two case studies Visualizing science by citation mapping Creating an academic landscape of sustainability science: an analysis of the citation network Tracking emerging technologies in energy research: toward a roadmap for sustainable energy Detecting emerging research fronts in regenerative medicine by citation network analysis of scientific publications. PICMET'09-2009 Portland International Conference on Management of Engineering & Technology Finding linkage between technology and social issue: a literature based discovery approach Identifying knowledge structure of patent and innovation research Identifying emerging research related to solar cells field using a machine learning approach Emerging scientific field detection using citation networks and topic models-A case study of the nanocarbon field Involvement of PD-L1 on tumor cells in the escape from host immune system and tumor immunotherapy by PD-L1 blockade Engagement of the PD-1 immunoinhibitory receptor by a novel B7 family member leads to negative regulation of lymphocyte activation Development of lupuslike autoimmune diseases by disruption of the PD-1 gene encoding an ITIM motif-carrying immunoreceptor Enhancement of antitumor immunity by CTLA-4 blockade CD28 and CTLA-4 have opposing effects on the response of T cells to stimulation Induced expression of PD-1, a novel member of the immunoglobulin gene superfamily, upon programmed cell death Basics of immune checkpoints and their development for cancer immunotherapy Prospects and challenges for immune checkpoint inhibitors The nobel prize organization. The nobel prize in physiology or medicine Fast unfolding of communities in large networks LGL: creating a map of protein function with an algorithm for visualizing very large biological networks Academic landscape of hydropower: citation-analysis-based method and its application Restoring function in exhausted CD8 T cells during chronic viral infection TIGIT as an emerging immune checkpoint The immune receptor CD300e negatively regulates T cell activation by impairing the STAT1-dependent antigen presentation The impact of ARID1A mutation on molecular characteristics in colorectal cancer An iRGD peptide fused superantigen mutant induced tumor-targeting and T lymphocyte infiltrating in cancer immunotherapy A new member of the immunoglobulin superfamily-CTLA-4 Novel adjuvants for peptide-based melanoma vaccines A study of MDX-1106 in patients with selected refractory or relapsed malignancies (MDX1106-01) Information for approved products Immunotherapy using tumor infiltrating lymphocytes for patients with metastatic cancer Administration FaD. Drug approvals and databases Anti-CTLA-4 antibody ipilimumab: case studies of clinical response and immune-related adverse events. Oncologist Checkpoint blockade in cancer immunotherapy Tissue-resident memory T cells: local specialists in immune defence Skin infection generates nonmigratory memory CD8(+) T-RM cells providing global skin immunity Molecular biomarkers of primary and acquired resistance to t-cell-mediated immunotherapy in cancer: landscape, clinical implications, and future directions Study on horizon-scanning with a focus on the development of AI-based medical products: citation network analysis We would like to thank Dr. Shigehisa Kitano for his advice and suggestions on the research history of immune checkpoints. We also thank Dr. Rika Wakao and Ms. Ai Fukaya for their help. Shikano developed the research design and interpreted the results. EF and TT analyzed the data and interpreted the results. EF and M. Shimokawa investigated the literature and interviewed experts at immune checkpoints. HS and HY designed the methodology and software and interpreted the results. MH designed the data-editing process. TT and M. Shikano drafted the manuscript. All authors have read and approved the final manuscript. The authors declare no conflicts of interest associated with this manuscript. The online version contains supplementary material available at https:// doi. org/ 10. 1007/ s43441-021-00351-3.