key: cord-0914840-mc7pifep authors: Rowhani-Farid, Anisa; Allen, Michelle; Barnett, Adrian G. title: What incentives increase data sharing in health and medical research? A systematic review date: 2017-05-05 journal: Res Integr Peer Rev DOI: 10.1186/s41073-017-0028-9 sha: 6275144a4a4a08d1c72f3c52109ac757c72e6424 doc_id: 914840 cord_uid: mc7pifep BACKGROUND: The foundation of health and medical research is data. Data sharing facilitates the progress of research and strengthens science. Data sharing in research is widely discussed in the literature; however, there are seemingly no evidence-based incentives that promote data sharing. METHODS: A systematic review (registration: 10.17605/OSF.IO/6PZ5E) of the health and medical research literature was used to uncover any evidence-based incentives, with pre- and post-empirical data that examined data sharing rates. We were also interested in quantifying and classifying the number of opinion pieces on the importance of incentives, the number observational studies that analysed data sharing rates and practices, and strategies aimed at increasing data sharing rates. RESULTS: Only one incentive (using open data badges) has been tested in health and medical research that examined data sharing rates. The number of opinion pieces (n = 85) out-weighed the number of article-testing strategies (n = 76), and the number of observational studies exceeded them both (n = 106). CONCLUSIONS: Given that data is the foundation of evidence-based health and medical research, it is paradoxical that there is only one evidence-based incentive to promote data sharing. More well-designed studies are needed in order to increase the currently low rates of data sharing. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s41073-017-0028-9) contains supplementary material, which is available to authorized users. Research waste: hidden data, irreproducible research The foundation of health and medical research is data-its generation, analysis, re-analysis, verification, and sharing [1] . Data sharing is a key part of the movement towards science that is open, where data is easily accessible, intelligible, reproducible, replicable, and verifiable [2] . Data sharing is defined here as making raw research data available in an open data depository, and includes controlled access where data is made available upon request which may be required due to legal or ethical reasons. Despite the wide-scale benefits of data sharing such as addressing global public health emergencies, it is yet to become common research practice. For instance, the severe acute respiratory syndrome (SARS) disease was controlled only 4 months after its emergence by a World Health Organization-coordinated effort based on extensive data sharing [3] . Likewise, the researchers working on the Ebola outbreak have recently committed to work openly in outbreaks to honour the memory of their colleagues who died at the forefront of the Ebola outbreak, and to ensure that no future epidemic is as devastating [4] . Notwithstanding these benefits, numerous studies have demonstrated low rates of data sharing in health and medical research, with the leading journal the British Medical Journal (BMJ) having a rate as low as 4.5% [5] and biomedical journal articles 0% [6] . There are of course legitimate reasons to withhold data, such as the concern about patient privacy, and the requirement for patient consent for sharing [7] . With 85% of the world's spending on health and medical research, an estimated $170 billion, wasted every year, it is clear that the scientific community is in crisis, leading to questions about the veracity of scientific knowledge [8] . Data sharing and openness in scientific research should be fundamental to the philosophy of how scientific knowledge is generated. Thomas Kuhn introduced the concept of paradigm shifts that arise from a scientific crisis. The paradigm shift before us today is from closed, hidden science to open science and data sharing [9] . Sharing scientific data will allow for data verification and re-analysis, and for testing new hypotheses. Open data reduces research waste in terms of time, costs, and participant burden, and in turn, strengthens scientific knowledge by ensuring research integrity [5, 10] . The many current problems in health and medical research have led to the emergence of a new field, metaresearch, which is concerned with improving research practices [2] . Meta-research has five sub-themes with 'reproducibility' and 'incentives' as two of the themes [2] . Reproducibility is concerned with the verification of research findings, which can be achieved through the sharing of data and methods [2] . Incentives is concerned with rewarding researchers, which includes incentives to share their data and methods [2] . We were interested in how researchers are incentivised to openly share their raw data, thus combining two sub-themes of meta-research. Historically, it has not been common practice for the content of a research article to include access to the raw data from scientific experiments [11] . This flaw, created by technological limitations among others, has hindered the progress of scientific knowledge [5] . However, we can no longer blame technology for outdated research practices. There are many data depositories which allow researchers to easily share their data using a citable DOI. There have also been many recent policies and frameworks to encourage openness in research [7] . Yet, uptake in health and medicine is low and what is lacking, it appears, are rewards that incentivize researchers to share their data [11] . Incentives are defined here as rewards that are given to researchers if they participate in sharing their raw scientific data [12] . The Queensland University of Technology (QUT) Library staff assisted in developing a rigorous and clearly documented methodology for both the search strategy and the selection of studies. The aim was to minimise bias by documenting the search process and the decisions made to allow the review to be reproduced and updated. The Cochrane Handbook for Systematic Reviews was used as a guide for this systematic review: http://handbook.cochrane.org/. The EQUATOR Network Additional file 1: PRISMA (2009) Checklist [13] was used to ensure good practice as well as accurate reporting. Three systematic review registries (Prospero, Joanna Briggs Institute, and Cochrane) were checked to ensure our proposed systematic review had not already been done. Our systematic review protocol was registered at the Open Science Framework on 1 August 2016 (doi.org/10.17605/OSF.IO/6PZ5E). This review considered published journal articles with empirical data that trialed any incentive to increase data sharing in health and medical research. Articles must have tested an incentive that could increase data sharing in health and medical research. For the purposes of this review, health and medical research data is defined as any raw data that has been generated through research from a health and medical facility, institute or organisation. Incentives are defined here as 'a benefit, reward, or cost that motivates an […] action'. This was based on the definition of incentives in economics, which groups incentives into four categories: financial, moral, natural, and coercive [14] . The review included any paper with empirical data on sharing that compared an intervention and control, which used a clear research design (including randomised and non-randomised designs). The types of measures included are the percent of datasets shared, or the number of datasets shared, or the relative ratio of data sharing. This review excluded the following, but still classified these excluded papers by field: all editorial and opinion pieces that only discuss strategies to increase data sharing without trialling them. strategies that do not involve incentives, e.g., education seminars, change in a data sharing policy or some other policy, access to data management tools and managers. observational studies that describe data sharing patterns. This search strategy was designed to access published articles through the following steps: 1) ((("open science" OR "open data" OR "data sharing") AND (incentive* OR motivation* OR reward* OR barrier*))) 2) 3) Relevant articles that did not appear in the database search but were known to the reviewers were handpicked and extracted into EndNote. Two reviewers, ARF and MA, screened the titles of the articles and based on the inclusion and exclusion criteria, extracted them into EndNote. Duplicates were removed. The reviewers independently screened the extracted article titles and abstracts based on the inclusion and exclusion criteria and categorised them into five groups: ARF read the titles and abstracts of all extracted articles and MA verified her findings by reading a random sample of 30%. Discrepancies between the two reviewers were approximately 10%, however these were relatively minor and resolved through discussion of the scope of each of the categories. For instance, a research paper outlined the introduction of a data system, one reviewer classified it as an observational study, but after discussion it was agreed that it was a strategy article as its objective was to increase data sharing rates rather than observing data sharing patterns. The two reviewers independently read eligible documents and extracted data sharing incentives in health and medical research. Both reviewers were agnostic regarding the types of incentives to look for. The final list of incentives was determined and agreed on by all authors [11] . Individual incentives were grouped into research fields. A qualitative description of each incentive was presented. Based on our prior experience of the literature, the research fields and sub-fields for classification were: a. Health and medical research i. Psychology ii. Genetics iii. Other (health/medical) b. Non-health and medical research i. Information technology ii. Ecology iii. Astronomy iv. Other (non-health/medical) The other article-strategies, opinion pieces, and observational studies were also grouped into the same research fields. The database searches found 1415 articles, 1039 of which met the inclusion criteria based on assessment of titles and abstracts and were exported into EndNote. After automatically removing duplicates, 670 articles remained and after manually removing the remainder of the duplicates, 586 articles remained. 586 titles and abstracts were read and categorised based on the above inclusion and exclusion criteria. One study was hand-picked as it met the inclusion criteria, bringing the total number of extracted articles to 587. After screening titles and abstracts, nine articles were classified under incentives in health and medical research. These articles were then read in full, and one of them was judged as an incentive that satisfied the inclusion criteria. The PRISMA [13] flow chart that outlines the journey of the articles from identification to inclusion is in Fig. 1 . The categorisation of all 587 articles into the sub-fields and article type is in Table 1 . A review of the reference list for the one included intervention was undertaken [15] . The titles and abstracts of the full reference list of this study (23 papers) and those that cited the study (5 papers) were read, but none met the inclusion criteria of this systematic review. 17 articles were irrelevant, bringing the total number of screened articles to 570. The distribution of articles across type of study was similar for both health and medical research and non-health and medical research ( Table 1) . Observational studies were the most common type (n = 106, n = 124), then opinion pieces (n = 85, n = 89), then articles testing strategies (n = 76, n = 89), and articles testing incentives were uncommon (n = 1, n = 0). These articles did not fit the inclusion criteria, but based on the abstracts they were mostly concerned with observing data sharing patterns in the health and medical research community, using quantitative and qualitative methods. The motivation behind these studies was often to identify the barriers and benefits to data sharing in health and medical research. For instance, Federer et al. (2015) conducted a survey to investigate the differences in experiences with and perceptions about sharing data, as well as barriers to sharing among clinical and basic science researchers [16] . These articles also did not fit the inclusion criteria, but based on the abstracts they were opinion and editorial pieces that discussed the importance and benefits of data sharing and also outlined the lack of incentives for researchers to share data. Open data and open material badges were created by the Center of Open Science and were tested at the journal Psychological Science [15] . [15] . A limitation of the badge study was that it did not use a randomized parallel group design; notwithstanding, it was the only incentive that was tested in the health and medical research community, with pre-and postincentive empirical data [15] . The pre-and post-design of the study makes it vulnerable to other policy changes over time, such as a change from a government funding agency like the recent Statement on Data Sharing from the Australian National Health and Medical Research Council [17] . However, the Kidwell et al. study addressed this concern with contemporary control journals. A limitation of the badge scheme was that even with badges, the accessibility, correctness, usability, and completeness of the shared data and materials was not 100%, which was attributable to gaps in specifications for earning badges. In late 2015, the Center for Open Science Badges Committee considered provisions for situations in which the data or materials for which a badge was issued somehow disappear from public view and how adherence to badge specifications can be improved by providing easy procedures for editors/journal staff to validate data and material availability before issuing a badge, and by providing community guidelines for validation and enforcement [15] . Of the non-health/medical incentives, seven were categorised as information technology, and nine as other. Upon reading the full text, all the 16 non-health/medical incentives were proposed incentives or strategies as opposed to tested incentives with comparative data. Given that the systematic review found only one incentive, we classified the data sharing strategies tested in the health and medical research community. Seventy-six articles were classified under 'strategies' and Table 2 shows the further classification into categories based on a secondary screening of titles and abstracts. The articles are grouped by whether they presented any data, descriptive, or empirical. The majority, 57/76, of strategies were technological strategies such as the introduction of a data system to manage and store scientific data. Seven of the 76 strategies concerned encouraging collaboration among research bodies to increase data sharing. Eight were a combination of collaboration across consortia and the introduction of a technological system. Three had a data sharing policy as the strategy but did not test the effectiveness of the policy, but two of them reported descriptive data from their experience in implementing the policy. One strategy was an open data campaign. Below we give some examples of the strategies used to promote data sharing. Two articles discussed an incentive system for human genomic data and data from rare diseases, namely, microattribution and nanopublication-the linkage of data to their contributors. However, the articles only discussed the models and did not present empirical data [18, 19] . Another article discussed the OpenfMRI project that aims to provide the neuroimaging community with a resource to support open sharing of fMRI data [20] . In 2013, the OpenfMRI database had 18 full datasets from seven different laboratories and in October 2016, the database had 55 datasets openly available (https://openfmri.org/dataset/). The authors identified credit as a barrier towards sharing data and so incorporated attribution into the OpenfMRI website where a dataset is linked to the publication and the list of investigators involved in collecting the data [20] . An article discussed open source drug discovery and outlined its experience with two projects, the praziquantel (PZG) project and the Open Source Malaria project [21] . The article did not have pre-and post-strategy data. The authors discussed the constituent elements of an open research approach to drug discovery, such as the introduction of an electronic lab notebook that allows the deposition of all primary data as well as data management and coordination tools that enhances community input [21] . The article describes the benefits and successes of the open projects and outlines how their uptake needs to be incentivised in the scientific community [21] . An article discussed the development of the Collaboratory for MS3D (C-MS3D), an integrated knowledge environment that unites structural biologists working in the area of mass spectrometric-based methods for the analysis of tertiary and quaternary macromolecular structures (MS3D) [22] . C-MS3D is a web-portal designed to provide collaborators with a shared work environment that integrates data storage and management with data analysis tools [22] . The goal is not only to provide a common data sharing and archiving system, but also to assist in the building of new collaborations and to spur the development of new tools and technologies [22] . One article outlined the collaborative efforts of the Global Alzheimer's Association Interactive Network (GAAIN) to consolidate the efforts of independent Alzheimer's disease data repositories around the world with the goals of revealing more insights into the causes of Alzheimer's disease, improving treatments, and designing preventative measures that delay the onset of physical symptoms [23] . In 2016, they had registered 55 data repositories from around the world with over 25,000 subjects using GAAIN's search interfaces [23] . The methodology employed by GAAIN to motivate participants to voluntarily join its federation is by providing incentives: data collected by its data partners are advertised, as well as the identity of the data partners, including their logos and URL links, on each GAAIN search page [23] . GAIIN attributes its success in registering 55 data repositories to date to these incentives which provide opportunities for groups to increase their public visibility while retaining control of their data, making the relationship between GAIIN and its partners mutually beneficial [23] . This study did not have pre-and post-strategy empirical data, but described the importance of incentives in motivating researchers to share their data with others [23] . An article described how data sharing in computational neuroscience was fostered through a collaborative workshop that brought together experimental and theoretical neuroscientists, computer scientists, legal experts, and governmental observers [24] . This workshop guided the development of new funding to support data sharing in computational neuroscience, and considered a conceptual framework that would direct the data sharing movement in computational neuroscience [24] . The workshop also unveiled the impediments to data sharing and outlined the lack of an established mechanism to provide credit for data sharing as a concern [24] . A recommendation was that dataset usage statistics and other user feedback be used as important measures of credit [24] . One article addressed the need to facilitate a culture of responsible and effective sharing of cancer genome data through the establishment of the Global Alliance for Genomic Health (GA4GH) in 2013 [25] . The collaborative body unpacked the challenges with sharing cancer Campaign (1) 1 [27] genomic data as well as the potential solutions [25] . The GA4GH developed an ethical and legal framework for action with the successful fostering of an international 'coalition of the willing' to deliver a powerful, globally accessible clinic-genomic platform that supports datadriven advances for patients and societies [25] . An article discussed the efforts of the Wellcome Trust Sanger Institute to develop and implement an institutewide data sharing policy [26] . The article outlined that successful policy implementation depends on working out detailed requirements (guidance), devoting efforts and resources to alleviate disincentives (facilitation), instituting monitoring processes (oversight), and leadership [26] . The topic of disincentives (facilitation) included concerns about lack of credit [26] . They propose that cultural barriers to data sharing continue to exist and that it is important to align the reward system to ensure that scientists sharing data are acknowledged/cited and that data sharing is credited in research assessment exercises and grant career reviews [26] . One intervention was an open data campaign which was included in the review via an open letter in June 2014 from the AllTrials campaign to the director of the European Medicines Agency to remove barriers to accessing clinical trial data [27] . The AllTrials campaign is supported by more than 78,000 people and 470 organisations worldwide [27] . This letter contributed to the European Medicines Agency publishing the clinical reports underpinning market authorization requests for new drugs, which was part of a more proactive policy on transparency that applied to all centralized marketing authorisations submitted after 1 January 2015 [27] . The adoption of this policy was a significant step in ensuring transparency of health and medical research in Europe [27] . This systematic review verified that there are few evidence-based incentives for data sharing in health and medical research. The irony is that we live in an evidence-based world, which is built upon the availability of raw data, but we hardly have any evidence to demonstrate what will motivate researchers to share data. [15] . It is interesting to note the great number of opinion pieces (n = 85) on the importance of developing incentives for researchers, which outnumbered the number of articles that tested strategies to increase data sharing rates (n = 76). 'Opinion pieces' are mutually exclusive from 'strategies' as the former is concerned with discussing possible strategies and incentives and the latter tests the ideas and strategies and provides evidence of what works or does not work. These strategies included: the introduction of data systems such as electronic laboratory notebooks and databases for data deposition that incorporated a system of credit through data linkage; collaboration across consortia that also introduce data systems that also use data attribution as an incentive; collaboration across consortia through workshops and development of frameworks for data sharing; implementation of data sharing policies; and campaigns to promote data sharing. These strategies discussed the requirement of introducing rewards to increase data sharing rates and the only form of incentive used was via data attribution and advertising on websites. Studies that test the effectiveness of attribution and advertising as a form of credit are necessary. In light of the small number of studies, we see a clear need for studies to design and test incentives that would motivate researchers to share data. Organisations are promoting the development of incentives to reduce research waste. In late 2016, the Cochrane and the REWARD alliance combined to create the annual Cochrane-REWARD prize for reducing waste in research. The monetary prize is awarded to 'any person or organisation that has tested and implemented strategies to reduce waste in one of the five stages of research production [question selection, study design, research conduct, publication, and reporting] in the area of health'. This prize is an example of an incentive for researchers to design studies or implement policies that reduce research waste; it will be interesting to see the impact of this initiative [28] . Another endeavour in the area of developing incentives and rewards for researchers is the convening in early 2017 of a group of leaders from the USA and Europe from academia, government, journals, funders, and the press to help develop new models for academic promotion and professional incentives that would promote the highest quality science, organised by the Meta-Research Innovation Center at Stanford (MET-RICS). The focus will be on designing practical actions that embody principles that this community has embraced, while also recognizing that the effect of any such policies will need empirical evaluation. While the systematic barriers to widespread data sharing are being addressed through the general shift towards more openness in research, the conversation on data sharing includes an alternative view where users of shared data are called 'research parasites' who 'steal from research productivity' and who are 'taking over' [29, 30] . There is also some questioning of whether data sharing is worth the effort [30] . These points, however, are contrary to the purpose of sharing data, which is to progress science as a body of knowledge and to make the research process more robust and verifiable [5, 30] . A limitation of this systematic review is that we did not search the grey literature (materials and research produced by organizations outside of the traditional commercial or academic publishing and distribution channels). This review could be perceived as having a narrow design, given that we anticipated a lack of evidence-based incentives for data sharing in health and medical research, hence making the topic of this systematic review too simple. However, we could not be sure that there were no incentives and the recent paper by Lund and colleagues (2016) emphasises the importance of conducting systematic reviews prior to designing interventions in order to avoid adding to the already large issue of research waste [31] . The current meta-research discourse outlines the numerous benefits of openness in research: verification of research findings, progressing health and medicine, gaining new insights from re-analyses, reducing research waste, increasing research value, and promoting research transparency. However, this systematic review of the literature has uncovered a lack of evidencebased incentives for researchers to share data, which is ironic in an evidence-based world. The open data badge is the only tested incentive that motivated researchers to share data [15] . This low-cost incentive could be adopted by journals and added to the reward system to promote reproducible and sharable research [15, 32] . Other incentives like attribution require empirical data. Instead of evidence-based incentives, the literature is full of opinion pieces that emphasize the lack of incentives for researchers to share data, outweighing the number of strategies that aim to increase data sharing rates in health and medicine. Observational studies that identify data sharing patterns and barriers are also plentiful, and whilst these studies can provide useful background knowledge, they do not provide good evidence of what can be done to increase data sharing. The Open Knowledge Foundation: Open Data Means Better Science Meta-research: Evaluation and Improvement of Research Methods and Practices Perspectives on Open Science and scientific data sharing:an interdisciplinary workshop Data sharing: Make outbreak research open access Reproducible Research Practices and Transparency across the Biomedical Literature A systematic review of barriers to data sharing in public health Avoidable waste in the production and reporting of research evidence The Structure of Scientific Revolutions Increasing value and reducing waste in biomedical research regulation and management Open science: Many good resolutions, very few incentives, yet. In: Incentives and Performance: Governance of Research Organizations Reproducing Statistical Results Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement Accessed 21 Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency Biomedical data sharing and reuse: Attitudes and practices of clinical and scientific research staff Accessed 3 Microattribution and nanopublication as means to incentivize the placement of human genome variation data into the public domain Speeding up research with the Semantic Web Towards open sharing of task-based fMRI data: The OpenfMRI project Open source drug discovery -A limited tutorial The Collaboratory for MS3D: A New Cyberinfrastructure for the Structural Elucidation of Biological Macromolecules and Their Assemblies Using Mass Spectrometry-Based Approaches The Global Alzheimer's Association Interactive Network Data sharing for computational neuroscience Facilitating a culture of responsible and effective sharing of cancer genome data Developing and implementing an institute-wide data sharing policy OPEN DATA CAMPAIGN Open letter: European Medicines Agency should remove barriers to access clinical trial data The Cochrane-REWARD prize for reducing waste in research Accessed 12 Data Sharing Data Sharing -Is the Juice Worth the Squeeze? Towards evidence based research Assessing value in biomedical research: The pqrst of appraisal and reward Northwestern University Schizophrenia Data and Software Tool (NUSDAST). Frontiers in Neuroinformatics0 Schizconnect: A one-stop web-based resource for large-scale schizophrenia neuroimaging data integration Coding rare diseases in health information systems: A tool for visualizing classifications and integrating phenotypic and genetic data Universal Syntax Solutions for the Integration, Search, and Exchange of Phenotype And Genotype Information A web-portal for interactive data exploration, visualization, and hypothesis testing LORD: a phenotype-genotype semantically integrated biomedical data tool to support rare disease diagnosis coding in health information systems Proteomics FASTA archive and reference resource Using the wiki paradigm as crowd sourcing environment for bioinformatics protocols DisGeNET-RDF: harnessing the innovative power of the Semantic Web to explore the genetic basis of diseases BRISK-research-oriented storage kit for biologyrelated data ISA-TAB-Nano: A Specification for Sharing Nanomaterial Research Data in Spreadsheet-based Format USAGE: a web-based approach towards the analysis of SAGE data. Serial Analysis of Gene Expression A universal open-source Electronic Laboratory Notebook GRIN-Global: An international project to develop a global plant genebank information management system PADMA database: Pathogen associated drosophila microarray database All the World's a Stage: Facilitating Discovery Science and Improved Cancer Care through the Global Alliance for Genomics and Health SCENS: A system for the mediated sharing of sensitive data The US-Mexico border infectious disease surveillance project: Establishing binational border surveillance MeDetect: Domain entity annotation in biomedical references using linked open data Open Science CBS Neuroimaging Repository: Sharing ultra-high-field MR images of the brain Race by hearts: Using technology to facilitate enjoyable and social workouts Using a database/repository structure to facilitate multi-institution utilization management data sharing Real-time data streaming for functionally improved eHealth solutions Real-time clinical information exchange between EMS and the emergency department Integration of a mobile-integrated therapy with electronic health records: Lessons learned LONI MiND: Metadata in NIfTI for DWI Application of FOSS4G and open data to support polio eradication, vaccine delivery and ebola emergency response in West Africa Improving HIV Surveillance Data for Public Health Action in Washington, DC: A Novel Multiorganizational Data-Sharing Method An i2b2-based, generalizable, open source, self-scaling chronic disease registry Next generation cancer data discovery, access, and integration using Prizms and nanopublications OWLing Clinical Data Repositories With the Ontology Web Language Design and generation of linked clinical data cubes The current and potential role of satellite remote sensing in the campaign against malaria The EBI RDF platform: Linked open data for the life sciences A digital repository with an extensible data model for biobanking and genomic analysis management Catalyzer: A novel tool for integrating, managing and publishing heterogeneous bioscience data. Concurrency Computation Pract Experience A simple tool for neuroimaging data sharing E-Health systems for management of MDR-TB in resource-poor environments: A decade of experience and recommendations for future work The Cardiac Atlas Project-an imaging database for computational modeling and statistical atlases of the heart American college of rheumatology's rheumatology informatics system for effectiveness registry pilot The rheumatology informatics system for effectiveness (RISE): Enabling data access across disparate sites for quality improvement and research The preprocessed connectomes project: An open science repository of preprocessed data KiMoSys: A web-based repository of experimental data for KInetic MOdels of biological SYStems The NIH 3D Print Exchange: A Public Resource for Bioscientific and Biomedical 3D Prints. 3d Printing Addit Manuf Implementation of chemotherapy treatment plans (CTP) in a large comprehensive cancer center (CCC): The key roles of infrastructure and data sharing Implementing standards for the interoperability among healthcare providers in the public regionalized Healthcare Information System of the Lombardy Region Rapid growth in use of personal health records Software breakthrough makes data sharing easy. Hospital peer review Preventing, controlling, and sharing data of arsenicosis in China Possibilities and Implications of Using the ICF and Other Vocabulary Standards in Electronic Health Records The Functional Magnetic Resonance Imaging Data Center (fMRIDC): The challenges and rewards of large-scale databasing of neuroimaging studies One Health surveillance -More than a buzz word? XNAT Central: Open sourcing imaging research data Flexible specification of data models for neuroscience databases Health care provider quality improvement organization Medicare data-sharing: a diabetes quality improvement initiative The global Alzheimer's association interactive network (GAAIN) Pediatric patients in the track TBI trial-testing common data elements in children Rapid learning in practice: Validation of an EU population-based prediction model in USA trial data for H&N cancer Developing the foundation for syndromic surveillance and health information exchange for yolo county, california. Online journal of public health informatics The National Academies Collection: Reports funded by National Institutes of Health New models of open innovation to rejuvenate the biopharmaceutical ecosystem, a proposal by the ACNP liaison committee The preclinical data forum network: A new ECNP initiative to improve data quality and robustness for (preclinical) neuroscience Data sharing in neuroimaging research Sharing data with physicians helps break down barriers. Data strategies & benchmarks : the monthly advisory for health care executives Sharing overdose data across state agencies to inform public health strategies: A case study Act levels the playing field on healthcare performance The QUT Librarians assisted in designing the search strategy for this review. No monetary assistance was provided for this systematic review; however, support was provided in kind by the Australian Centre for Health Services Innovation at the Institute of Health and Biomedical Innovation at QUT. The datasets generated and analysed during the current study are available at the Open Science Framework repository (DOI 10.17605/OSF.IO/DSPU8). Authors' contributions ARF collected and analysed all the data for the study and wrote the manuscript. MA collected the data and analysed (30%) for the study and edited the manuscript. AGB provided close student mentorship for this research, which is a part of ARF's PhD under his primary supervision, and was a major contributor for the writing of this manuscript. All authors read and approved the final manuscript. The authors declare that they have no competing interests. Not applicable.Ethics approval and consent to participate Not applicable.