key: cord-0151229-wud0yzp3 authors: Abramo, Giovanni; D'Angelo, Ciriaco Andrea; Costa, Flavia Di title: The relative impact of private research on scientific advancement date: 2020-12-09 journal: nan DOI: nan sha: 0f571e10cd263871d17c6382a18effdda315ce9f doc_id: 151229 cord_uid: wud0yzp3 Literature about the scholarly impact of scientific research offers very few contributions on private sector research, and the comparison with public sector. In this work, we try to fill this gap examining the citation-based impact of Italian 2010-2017 publications distinguishing authorship by the private sector from the public sector. In particular, we investigate the relation between different forms of collaboration and impact: how intra-sector private publications compare to public, and how private-public joint publications compare to intra-sector extramural collaborations. Finally, we assess the different effect of international collaboration on private and public research impact, and whether there occur differences across research fields. This work tries to assess the impact of Italian private research on scientific advancement, with a particular focus on private-public research collaboration, whose results represent the largest share of private-sector publications. Research-based innovation is a source of competitive advantage in an increasing number of economic sectors. In most OECD countries, private R&D expenditures are higher than public (OECD, 2020a) . In order to appropriate the benefits of their R&D investments, private corporations remain very wary of making their R&D results public. They often recur to industrial property protection to prevent competitors from benefiting of knowledge spillovers. On the contrary, universities and public research organizations (U&PROs) tend to encode their research results in written form and favor their rapid and spread diffusion, responding to incentive systems based on the evaluation of the impact of their research production. As a result, in every country we witness the private sector holding a disproportionate share of the country's overall intellectual property. Conversely, we have U&PROs authoring the larger share of a country's publications. While there is ample literature on the assessment of the scholarly impact of U&PROs' research, studies on private research tend to focus on research impact on technological and economic development (the former generally hold publications in scientific journals as the basic unit of analysis, while the latter patents). In theory, there could be two reasons for paucity of studies on the scholarly impact of private research. One is that such investigation is considered as not worth it, because the share of scientific research vis-àvis applied research and technological development by the private sector is negligible. The other reason is that a critical step of the scholarly impact assessment process requires manual identification and name reconciliation of all organizations authoring publications, to distinguish private sector from public research. For large-scale studies, this reveals a formidable task, and requires a profound knowledge of the research systems and languages of countries under observation. We propend for the latter reason. This work intends to contribute to fill in the gap, trying to answer a number of questions on the scientific impact of private research. The first question that comes to mind is: What is the average impact on scientific advancement of private-sector publications as compared to public-sector ones? And, strictly related to that: What is the share of highly cited publications by the private sector as compared to the public sector? The increasing complexity and cost of research to solve global societal problems (the current COVID-19 pandemic emergency is a case in point), mostly interdisciplinary in nature, and ad hoc incentive systems and science policies and initiatives towards collaborative research, has led scientists to increasingly rely on research collaboration (Wuchty, Jones, & Uzzi, 2007; Larivière, Gingras, Sugimoto, & Tsou, 2015) . Furthermore, since public and private organizations are stimulated to collaborate more and more to promote knowledge transfer not only ex post, but already in its production steps (Perkmann et al., 2013; Etzkowitz & Leydesdorff, 2000) , what one finds is that most publications by private (public) organizations are actually fruit of collaboration, within the private (public) sector or with the public (private) sector. Another question then is: How do different forms of collaboration relate to the impact of private-sector publications? Are there differences from those of their public counterparts? And how do private-public joint publications compare to other types of extramural collaborations? Looking at collaboration from the perspective of the public scientist, subject to assessment based on the impact of its scientific production, all other motivations being equal, is she worth cooperating with colleagues in the private sector? Another phenomenon that has been taking place for decades, but had a burst with the advent of the internet, is that research activities are increasingly globalizing. The rate of international research collaboration, as shown in the authorships of papers, is increasing (National Science Board, 2020) . Because it is known that international publications have higher scientific impact (Goldfinch, Dale & DeRouen Jr, 2003; Schmoch & Schubert, 2008; , another question follows: in presence of coauthors affiliated to foreign institutions, is there an impact increase for private domestic publications similar to that of their public counterparts? Finally, we investigate whether there occur differences in the above, across research fields. To the best of our knowledge, two other studies only tried to assess the scientific impact of private research, in particular of private-public research collaborations. The first one by Lebeau, Laframboise, Larivière, and Gingras (2008) shows that Canadian publications fruit of private-public research collaborations are generally published in less prestigious journals (i.e. with a lower impact factor, IF), but are on average more cited than those by university only, in the same field and year of publication (Lebeau, Laframboise, Larivière, & Gingras, 2008) . Unfortunately, the analysis is purely descriptive, as the authors do not control for such covariates as the number and nationality of co-authors and type of publication. It is known in fact that citation rates are positively correlated with the number of authors (Persson, Glänzel, & Danell, 2004; Wuchty, Jones, & Uzzi, 2007; Larivière, Gingras, Sugimoto, & Tsou, 2015) , and it is so for Italian publications as well (Abramo & D'Angelo, 2015) . Furthermore, internationally coauthored publications are more highly cited than domestic (van Raan, 1998; Adams, 2013; Kumar, Rohani, & Ratnavelu, 2014) , and it is definitely so in Italy as well (Abramo, D'Angelo, & Murgia, 2017) , even when including Italian self-citations (Abramo, D'Angelo, & Di Costa, 2020) . Finally, citation rates vary across document types, i.e. articles, reviews, conference proceedings, etc. (Tahamtan, Safipour Afshar, & Ahamdzadeh, 2016) . Private research activities stress that the knowledge is kept in-house, and pursue its commercial exploitation. Therefore, it is expected that, as compared to U&PROs, private corporations tend to engage less in international and multi-institution collaborations, and the share of their papers published in conference proceedings is larger than that of U&PROs, while the share of reviews is lower. When comparing then the publication impact of private vs public research, one needs to control for such variables as the above ones. The other study by Bloch, Ryan, and Andersen (2019) , partly overcomes the above limits, conducting an inferential analysis with reference to the Danish case. The authors show that there are no significant differences in citation impact between public-private joint publications and publications authored by exclusively public authors. Rather, among publications resulting from international collaboration, there is a higher citation impact for public-private publications than for public-only publications. In this work, we will evaluate the impact of the scientific production of the private sector, in its different types (single-and multi-authored, fruit of intra-or extramural collaboration, domestic or international, with other private and/or public organizations), comparing it with that of the corresponding publications by U&PROs. We will adopt a bibliometric approach, based on the analysis of Italian scientific publications indexed in Web of Science (WoS) in the period 2010-2017. The authors' affiliations will be analyzed to distinguish private from publicly authored publications. The restriction of the analysis to our home country only is due to the formidable task of manually disambiguating and unifying U&PROs and private organizations names, which requires profound knowledge of the context and language. Each publication will be assigned to the WoS subject category (SC) of the hosting journal, to carry out the analysis also at field level. The work is structured as follows. The next section presents a literature review on private-public research collaboration motivations and effects. The third section deals with the theoretical base for the assessment of the scholarly impact of research The fourth section presents the dataset used and describes the methodology adopted. In the fifth section, the results of the analysis are shown and commented. Finally, the sixth concludes the work discussing the relevant findings and their implications for research policies. Most of private R&D leading to results encoded in publications is conducted in Joint research between U&PROs and industry produces effects that positively influence economic growth, social value, and competitiveness. In recent years, policy makers have therefore increased their actions to promote public-private collaboration by acting on both partners through: i) research policies aiming at promoting the so-called third mission of universities (protection, licensing and commercialisation of research results and entrepreneurship in general); ii) innovation policies to encourage companies to interact with public research organisations (Perkmann et al., 2013; Guimón & Paunov, 2019) . Beyond the incentive schemes, the motivations underlying public-private cooperation are different for the two partners. The private sector has an interest in collaborating with the public to have access to skills with which to create new knowledge to exploit for commercial purposes (Bekkers & Freitas, 2008; Perkmann et al., 2013) . The public researcher benefits from accessing instrumental assets not in his or her possession, but accesses also economic and financial benefits of various kinds (Garcia, Araújo, Mascarini, Santos, & Costa, 2020) . However, public-private collaboration remains an important means by which public and industrial researchers can share knowledge in synergy (Cohen, Nelson, & Walsh, 2002; Mowery & Sampat, 2004) . Public-private collaboration also involves costs, so the intensity of the collaboration depends on the balance between costs and benefits arising from these relationships. The pressure from national research evaluation exercises, undertaken in an increasing number of countries, certainly leads public researchers to pay particular attention when selecting research projects to be included in their agenda, due to the probability of reaching outcomes (and resulting publications) with a high impact on the international community. Empirical evidence on the effects of public-private partnerships on scientific performance is not fully aligned. Many scholars suggest that academics and PROs' scientists collaborating with private companies may experience lower publication rates because of the industry's restrictions due to intellectual property protection through confidentiality requirements (Louis, Jones, Anderson, Blumenthal, & Campbell, 2001; Thursby & Thursby, 2002; Evans, 2010; Shibayama, Walsh, & Baba, 2012) . Even the mere financial support and sponsorship by industry increases the expected probability of publication delay, as compared to other forms of funding (Czarnitzki, Grimpe, & Toole, 2014) . Patenting a scientific discovery resulting from a public-private joint project, may decrease the probability for a scholar to be involved in follow-on research based on that discovery (Murray & Stern 2007 , Williams, 2013 . Overall, therefore, it seems that academics and PROS's scientists collaborating with industry are likely to find it more difficult on average to publish the results of their research. In contrast, Garcia, Araújo, Mascarini, Santos, and Costa (2020) in their recent study on university-industry scientific collaborations in Brazil in the period 2002-2008 provide empirical evidence that long-term collaborative research projects positively influence the scientific output of the involved groups as compared to that of non-cooperating control groups. The long-term commitment clearly strengthens trust and reduces the barriers related to conflicts over intellectual property and contract management. A similar conclusion is reached by Bikard, Vakili, & Teodoridis (2019) , who claim that academics collaborating with the industry produce more publications and fewer patents than their colleagues who do not. Zhang and Wang (2017) Generally speaking, the objective of research activity is to produce new knowledge. The new knowledge has a complex character of both tangible nature (different types of publications, patents, databases, etc.) and intangible nature (tacit knowledge, consulting activity, etc.). Large scale studies, such as ours, can only try to assess what is measurable, i.e. knowledge encoded in written form, and embed a number of assumptions and limitations. In their seminal work on assessing scientific research, Martin and Irvine (1983) state that "the impact of a publication describes its actual influence on surrounding research activities at a given time", and further on "it is the impact of a publication that is most closely linked to the notion of scientific progress -a paper creating a great impact represents a major contribution to knowledge at that time". Along the same lines, Moravcsik (1977) holds that the impact of a publication lies in its influence on subsequent publications, and that such influence will manifest itself by the influenced paper citing the influencing paper. Scientometricians recur to citation-based metrics to assess the scholarly impact of research. The underlying rationale is that, in order for a research result (as any good and service) to have an impact, it has to be "used". The question is whether and to what extent citations are certifications of real use and representative of all uses. This point is critical. It is about whether one believes that the norm is that scientists cite papers to recognize their influence, being aware that exceptions (uncitedness, undercitation, and overcitation) occur (Mertonian or normative theory of citing - Merton, 1973) , or that the opposite is true, i.e. that citing to give credit is the exception, while persuasion is the major motivation for citing (social constructivism - Mulkay, 1976; Bloor, 1976) . Should the latter school of thought be right, the only other possible way to assess the scientific impact of publications would be by peer judgement, which is costly, time-consuming, subjective, and unsuitable for large-scale investigations. 1 Citation-based measurement of impact embeds a tradeoff between the level of accuracy and timeliness in measurement. One of the critical issues in the reliability of citation indicators of impact concerns the rapidity with which citations accumulate: citations accrue with time, and no one can know for sure for how much time. Therefore, citation count can serve as a reliable proxy of the scholarly impact of a work if observed at a sufficient distance from the date of publication, or applying what is called a "citation time window" of adequate length. Yet, given an impact assessment aimed at informing policy and management decisions, no reasonable decision-maker could wait the necessary decades for completion of the citation life cycle. In searching to improve the predictive power of early citations, scientometricians have proposed combining citation counts with other independent variables (Levitt & Thelwall, 2011; Stegehuis, Litvak, & Waltman, 2015) . The latest contribution to the subject is by Abramo, D'Angelo, and Felici (2019) . Differently from previous contributions in the literature, the authors provide: i) the weighted combinations of citations and IF, as a function of the citation time window and field of research, which best predict future impact; and ii) the predictive power of each combination. A brief overview of the Italian research system will help the reader to better The Italian industrial structure is characterized by a disproportionate number of micro and small enterprises and a few large corporations, mainly competing in low and middlelow-tech sectors (OECD, 2020b). Therefore, R&TD conducted in the private sector is definitely tilted towards technology development and applied research. Publications emerging from applied research in middle-and low-tech fields tend to be more responsive to local needs, and therefore less appealing to the world scholarly community, who generally prefer to engage in frontier research in emerging fields. To answer the research questions, we will use a bibliometric approach based on the taxonomy shown in Table 1 . Each publication is classified according to the affiliation of the authors and the type of collaboration. Along the first dimension we can have publications tagged as "Italian U&PROs only", "Italian Industry only", or "Italian Industry+U&PROs". We add the suffix Italian here (but we drop it from now onward, for simplicity) because in case of publications in collaboration with foreign organizations, we are not able to decipher the latter's legal nature. Thus "U&PROs only" means that the author(s) are Italian universities and/or public research organizations, but not Italian private corporations; the same is true for "Italian Industry only". Along the second dimension, we name single-authored publications "Type 0". Those in collaboration can be either "Intramural" if all co-authors have the same affiliation, or extramural if they do not. The latter can be further distinguished in "Extramural -National only", if all co-authors belong to domestic organizations; "Extramural -International only" if all co-authors (of Italian publications) belong to foreign organizations only; and "Extramural -National + International" if the three or more organizations in the address list, at least two are domestic and at least one is foreign. The bibliometric dataset is drawn from the Italian Observatory of Public Research (ORP), a database developed and maintained by Research Value, S.r.l. and derived under license from the WoS. Beginning from the raw data of Italian publications indexed in the WoS core collection, we apply a complex algorithm for unification of institutional affiliations. Such algorithm, mainly based on manual classification of all Italian addresses of U&PROs and private organizations, allows us to assign a specific collaboration type to each publication, 2 721812 in all for the 2010-2017 period, as shown in Table 2 . Publications by industry represent 3.6 percent of total, of which 2.5 percent in collaboration with U&PROs. To assess possible impact differences across fields, we assign each publication to the SC of the hosting source and group the SCs into macro-areas. 3 Table 3 In this section, we first provide descriptive statistics of two indicators: i) the average impact on scientific advancement of private-sector publications; and ii) the incidence of private sector highly cited articles (HCAs), both as compared to the public ones. HCAs are those falling in the top x% of the reference distribution, i.e. as compared to all WoS publications of the same year and subject category, for citations accrued. Then, we will implement an OLS regression model to answer the research questions, while controlling for covariates which can affect citation rates. As for the measurement of impact, we will use a weighted combination of field-normalized citations (counted at 31/12/2019) and field-normalized IF (measured at year of publication) of the hosting journal, as proposed by Abramo, D'Angelo, and Felici (2019) . This weighted combination is the one which best predicts the overall impact of a publication. Moreover, because both citations and IF are field normalized, we do not need to control for different citation rates across fields. Because of the skeweness of citation distributions, we apply a log transformation of the article impact and add one to allow for the inclusion of uncited publications (Y = ln(Article impact +1)). In other words, the scholarly impact of publications grows with the complexity of the collaboration featuring the publication byline, but it is systematically lower for private authored publications than for public ones. The same conclusion can be reached considering the incidence of HCAs (columns 5-8 of Table 4 ). Only 0.1% of single-author private publications reach the status of Top1% for accrued citations, against 0.4% for single-author public publications. The comparison is always in favor of public publications, for any collaboration types and thresholds. 30.1% of total scientific public only publications deriving from extramural national and international collaboration is in the Top20% tail, vs 16.3% for private only publications, i.e. 51% higher and 19% lower than the expected value, respectively. The only exception is represented by the top1% publications resulting from extramural national collaboration: they represent 1.1% of the total private portfolio, against 0.4% of public. In order to answer the research questions, while controlling for covariates which can affect citation rates, we will use an article level OLS regression model, specified from time to time according to the type of analysis to be carried out. Since, as shown above, statistics for the average impact and the incidence of HCAs are closely aligned, we will consider the former as a response variable. We control for the number of authors in the byline, and for different document types through dummy variables (assuming as baseline the document type "article"). The combination of a set of other dummies allows for estimating the effect of various collaboration types (intramural, extramural, domestic, international) on impact of the resulting publication. Estimation is performed with the vce(robust) option of Stata, which uses the sandwich estimator of variance, robust to some types of misspecification as long as the observations are independent. The average values of the dependent variable and the covariates of the article level OLS regression model are shown in Table 5 , by collaboration type. The number of authors of a publication varies according to the type of collaboration: for Industry only publications, the average value increases from 4.4 of intramural to 4.7 of national extramural, 7.5 of international and 7.9 of national+international collaborations. A similar pattern can be observed for U&PROs only publications, for which the average value of 52.5 authors for extramural collaborations with both national and internatonal co-authors is due to outliers, publications characterized by mega-authorship (bylines with thousands of authors), typical of large research collaborations, especially in some fields of experimental physics. As for document types, reviews represent less than 5% of total publications with relatively lower values for Industry only publications (2.2%-3.8%, depending on collaboration type) compared to U&PROs only (3.8%-8.3%). Conversely, conference proceedings represent a large share of Industry only publications (even 59.6% for intramural publications) while they are much less frequent among U&PROs only publications (26.9%). To answer the first research question, we use the following OLS regression model: Y = b0 + b1 X1 + b2 X2 + b3 X3 + b4 X4 + b5 X5 + b6 X6 + b7 X7 The results shown in Table 6 indicate a negative effect on impact (-7.4%, i.e. e -0.077 ) 4 for Industry only publications versus U&PROs only ones. The coefficient for Industry + U&PROs joint publications, on the other hand, is positive (+4.2%, i.e. e 0.041 ), meaning that collaboration with the private sector increases the impact of U&PROs publications, other things being equal. Note that publications with at least one foreign affiliation show a greater impact (+22.8, i.e. e 0.205 ). Not always the control variables do act in the expected direction: as for document type, reviews show a higher average impact (+27.0%, i.e. e 0.239 ) than articles, while proceedings and other document types show a lower impact (-26.7% and -31.2%, respectively) . Differently from previous studies (Tahamtan, Safipour Afshar, & Ahamdzadeh, 2016) , the variable "number of authors" shows a nihil coefficient, indicating the absence of effect on publication impact, when considering the other model covariates. The set of dummies X5-X8 represents the type of collaboration characterizing the publication, based on the relative byline and address list, assuming as baseline the "singleauthor paper" type. Table 7 shows the results of the OLS regression applied to Industry only publications. The coefficient b5, relative to the dummy "Intramural", equal to 0.069, indicates a positive and statistically significant effect of this type of collaboration on the impact of the resulting publications, compared to single-author ones. Then, with respect to singleauthor research projects, the collaborative work of researchers belonging to the same organization (intramural) has a greater impact, on average, of 7.1% (e 0.069 ). For publications resulting from national extramural collaboration, this effect is not significant, while the international openness of collaboration leads to a very evident increase in impact: +21.2% and +13.9% respectively, for extramural international and extramural both national and international. Table 8 shows the comparison between the results of this OLS regression and those obtained by applying the same model to the dataset of U&PROs only publications. It can be noted that the increase in the impact of publications resulting from intramural collaborations compared to single-author papers has almost tripled for the latter set compared to the former (+19%, i.e. e 0.175 vs +7%, i.e. e 0.069 ). The increase in impact for national extramural collaborations for U&PROs only publications is in this case significant and rather relevant (+20%, i.e. e 0.184 ). Finally, the significant effect of international collaboration is confirmed and revealed to be higher for U&PROs only publications (+42% and +45%, i.e. e 0.348 and e 0.371 respectively) as compared to Industry only publications (+21% and +14%). In order to understand how private-public collaboration affects the resulting publications' impact, in Table 9 we show the results of an OLS regression applied to all and only the publications resulting from national extramural collaboration. In particular, we consider a simplified model compared to [2], namely: Y = c0 + c1 X1 + c2 X2 + c3 X3 + c4 X4 + c5 X5 This model will be applied, according to the taxonomy of Table 1 , in a dual way to:  the 12876 Type 5 and Type 8 publications, to measure the impact of collaboration with PROs, for Italian private companies;  the 180087 Type 2 and Type 5 publications; to measure the impact of collaboration with private companies, for Italian PROs. As for the first subset (upper part of Table 9 ), the coefficient c5 (0.139) reveals a significant and quite high effect (+14.8%), indicating that in national extramural collaborations industry researchers benefit significantly from collaboration with colleagues affiliated to U&PROs, in terms of the impact of the resulting publications. The dual analysis (in the lower part of Table 9 ), instead, shows a very small coefficient (0.023), although significant, to indicate that even for public researchers, collaborations with colleagues affiliated to private companies determines a positive impact differential (+2%, i.e. e0.023), but not so remarkable as for private researchers. Finally, in Table 10 we show the results of the OLS regression [3] applied to the set of publications resulting from both national and international extramural collaboration. The upper part shows the results of the regression carried out on the set of publications authored by Industry (Type 6 + Type 10), the lower part on the set of publications authored by U&PROs (Type 4 + Type 6). For private sector publications, the effect of collaboration with the public in publications including also a foreign author is positive. The coefficient of the covariate of interest indicates a marginal effect (+7%, i.e. e0.066) positive and significant on publications of this type, compared to those without the involvement of public co-authors. On the contrary, for U&PROs publications the coefficient of the interest variable (-0.004) indicates a negative but not significant effect (p-value 0.530). In other words, in international research collaborations, U&PROs do not benefit from the co-occurrence of private Italian researchers also, at least in terms of impact of the resulting publications. Still referring to U&PROs publications but, in this case, resulting from extramural national and international collaboration, Table 12 indicates a significant effect of the collaboration with Industry in only 4 macro-areas. This is in any case a negative effect on the impact of the resulting publications and, more precisely: -11% in Mathematics; -7% in Earth and Space Sciences; -4% in Chemistry and Biomedical Research. There are no enough studies from other countries to reach a robust conclusion that the underperformance of private scientific research is physiological, as can be expected given the different publication incentive systems at work in the private and public (publish or perish) sectors. As for the case of Italy, the results can be partly explained considering the structure of the industrial system, a system composed mostly by micro-, small-and medium-sized enterprises, specialized in middle-low and low tech sectors. In such sectors, private research tends to be geared to respond to local needs, therefore resulting less appealing to the international scientific community. Furthermore, prevalently smallsized enterprises are not likely to reach a critical mass of R&D spending to conduct high-quality scientific research, which in general is catch-up rather than frontier research. We can infer that, for public researchers, the incentive to collaborate with private companies exists but is extremely reduced compared to that observed for colleagues in the private sector. The analysis by macro-area reveals, however, that the positive effect is only visible in Physics, Biomedical Research, and Clinical Medicine. In other fields, it is either not significant or even negative. In essence, it would seem that in public-private mixed teams it is the presence of public researchers to give the research results a greater relevance. It could be because of their higher contribution in terms of knowledge needed for solution of the faced problem, or because of their better skills and experience in writing research manuscripts and finding the right journals for submission. Looking at collaboration from the perspective of the public scientist, increasingly subject to assessments based on the impact of their scientific activity, all other motivations being equal, the collaboration with colleagues in the private sector does not seem so crucial. Considering the existence of transaction costs inherent in any collaboration, especially in cross-sector collaboration, this result highlights a trade-off between policies aimed at increasing public researchers' productivity and those aimed at encouraging their involvement in technology transfer activities, among which, joint research collaboration with industry is a relevant one. This result partially confirms the conclusions of Bloch, Ryan, and Andersen (2019) who, observing the Danish scientific production, find little difference in citation impact for public-only and public-private collaborations. Our findings also align with Bloch et al., in confirming that the largest predictor of publication impact is the presence of international collaboration, both for private and for public sector publications. Compared to the Danish study, a very different conclusion emerges regarding the effect of public-private collaboration in internationally co-authored publications. While Bloch, Ryan, and Andersen (2019) found a much higher citation impact for such papers than public only publications, for the Italian case, the impact of publications resulting from international collaboration of U&PROs is negatively related to the presence of private sector co-authors. This is statistically evident both at overall level and in four specific macro-areas and more precisely in Mathematics, Earth and Space Sciences, Chemistry and Biomedical Research. These differences might be partly explained by the structure of the industrial system in the two countries, the Danish one being much smaller but featured by a very significant presence of large global corporations. Finally, we remark the value of a byproduct of our work, of interest for the literature on the determinants of the impact of a publication emerges: among the factors affecting the number of citations received by a publication, contrary to what claimed by other scholars, the number of authors in the byline seems to have no effect when considering other covariates associated to the byline itself, including the type of collaboration (international vs national; extramural vs intramural). This reinforces what also Bloch, Ryan, and Andersen (2019) stated saying that "The number of co-authors does not fully explain differences in citation impact across types of collaboration". In concluding this study, we cannot help reminding the reader of the main limits embedded in our analyses. First of all, our statistical model assumes that team composition has a causal impact on the outcomes of research activities. In practice, team composition and research agendas tend to be reciprocally determinated, and both are affected by a set of additional factors (e.g. team leader's network and experience, funding conditions, etc.) that should be controlled for. Because of the lack of data in practice, this is not possible at the level of individual publications for large-scale datasets. Moreover, all assumptions and limits of the bibliometric analysis apply. First, the new knowledge produced is not only those embedded in publications, and the bibliographic repertories (such as WoS, used here) do not register all publications. Furthermore, the measurement of the value of publications using citation-based indicators is a prediction, not definitive. Finally, citations can also be negative or inappropriate, and in any case they certify only scholarly impact, forgoing other types of impact. These limitations are particularly relevant when the analysis refers to private R&D and should induce caution in interpreting findings arising from bibliometric techniques. The relationship between the number of authors of a publication, its citations and the impact factor of the publishing journal: Evidence from Italy On the relation between the degree of internationalization of cited and citing publications: A field level analysis, including and excluding self-citations Predicting long-term publication impact through a combination of early citations and journal impact factor The relationship among research productivity, research collaboration, and their determinants Peer review vs bibliometrics: which method better predicts the scholarly impact of publications? The relationship between scientists' research performance and the degree of internationalization of their research University-industry collaboration in Italy: a bibliometric examination The role of information asymmetry in the market for university-industry research collaboration Collaborations: The fourth age of research The double-edged sword of industry collaboration: Evidence from engineering academics in the UK Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter? When collaboration bridges institutions: The impact of industry collaboration on academic productivity. Organization science Public-private collaboration and scientific impact: An analysis based on Danish publication data for 1995-2013 Knowledge and Social Imagery. London: Routledge Links and impacts: The influence of public research on industrial R&D Relazione sulla ricerca e l'innovazione in Italia Delay and secrecy: Does industry sponsorship jeopardize disclosure of academic research? The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations Industry collaboration, scientific sharing, and the dissemination of knowledge How longterm university-industry collaboration shapes the academic productivity of research groups Science from the periphery: collaboration, networks and 'periphery effects' in the citation of New Zealand Crown Research Institutes articles Science-industry knowledge exchange: A mapping of policy instruments and their interactions International research collaborations of ASEAN Nations in economics Team size matters: Collaboration and scientific impact since 1900 The effect of university-industry collaboration on the scientific impact of publications: The Canadian case A combined bibliometric indicator to predict article impact. Information Processing and Management A comparison of clinical and nonclinical life sciences faculty Assessing basic research -some partial indicators of scientific progress in radio astronomy The sociology of science: Theoretical and empirical investigations A progress report on the quantification of science The Bayh-Dole Act of 1980 and universityindustry technology transfer: a model for other OECD governments Norms and ideology in science Do formal intellectual property rights hinder the free flow of scientific knowledge? An empirical test of the anti-commons hypothesis Science and Engineering Indicators 2020 Main Science and Technology Indicators Enterprises by business size (indicator) Academic engagement and commercialisation: A review of the literature on university-industry relations Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies Are international co-publications an indicator for quality of scientific research? Academic entrepreneurship and exchange of scientific resources: Material transfer in life and materials sciences in japanese universities Predicting the long-term citation impact of recent publications Factors affecting number of citations: A comprehensive review of the literature Who is selling the ivory tower? Sources of growth in university licensing Intellectual property rights and innovation: Evidence from the human genome The increasing dominance of teams in production of knowledge Empirical study on influence of university-industry collaboration on research performance and moderating effect of social capital: evidence from engineering academics in China