key: cord-0711853-41hjajw3 authors: Rosenberg, Andrew L.; Tripathi, Ravi S.; Blum, James title: The most influential articles in critical care medicine() date: 2009-03-27 journal: J Crit Care DOI: 10.1016/j.jcrc.2008.12.010 sha: 83938e7a72820e7de7655d2b9cc7c728e335b1b2 doc_id: 711853 cord_uid: 41hjajw3 PURPOSE: The study aimed to examine query strategies that would provide an exhaustive search method to retrieve the most referenced articles within specific categories of critical care. MATERIAL AND METHODS: A comprehensive list of the most cited critical care medicine articles was generated by searching the Science Citation Index Expanded data set using general critical care terms keywords such as “critical care,” critical care journal titles, and keywords for subsubjects of critical care. RESULTS: The final database included 1187 articles published between 1905 and 2006. The most cited article was referenced 4909 times. The most productive search term was intensive care. However, this term only retrieved 25% of the top 100 articles. Furthermore, 662 of the top 1000 articles could not be found using any of the basic critical care search terms. Sepsis, acute lung injury, and mechanical ventilation were the most common areas of focus for the articles retrieved. CONCLUSION: Retrieving frequently cited, influential articles in critical care requires using multiple search terms and manuscript sources. Periodic compilations of most cited articles may be useful for critical care practitioners and researches to keep abreast of important information. Modern methods to search for important medial literature have recently flourished with the dissemination and near ubiquity of Internet-based search engines (eg, PubMed, MEDLINE, OVID). Articles that have been cited most often, referred to as "citation classics," are frequently important sources of both detailed information that has changed clinical/research practices as well as of useful connectors to other relevant literature that cites these articles. Finding landmarks or classic articles still requires an understanding of the literature and how articles are referenced. Different databases may categorize disciplines and journals from the same clinical areas under different terms and yield different results when using the same search term. These referencing differences as well as other conceptual arguments have led to some debate regarding attributing the number of times an article is cited to its quality [1] [2] [3] [4] However, there is general agreement that the number of times an article is cited does reflect the "impact of that article on the scientific market" [5] . Garfield [6] first published citation classics of the Journal of the American Medical Association in 1987. Similar studies (citations classic or impact factors) have been published with respect to various clinical specialties [7] [8] [9] [10] [11] [12] [13] [14] [15] . In 2004, Baltussen and Kindler [16] published citation classics of the critical care literature and enumerated the 71 top-cited articles in critical care journals and the 45 top-cited critical care articles in non-critical care journals. This article was somewhat limited by the number of citations referenced as well as the absence of specific critical care topic citations groups. The first and primary aim of this study was to expand on Baltussen's earlier work and provide an updated and more comprehensive catalogue of the most influential articles pertaining to critical care medicine and within specific categories of critical care, something not done in previous studies of this type. We also examined the methods used to retrieve articles to provide an exhaustive search method that future researchers may use in modern electronic databases to find frequently cited critical care articles. To develop the most comprehensive master list of most often cited critical care medicine-related articles, we first focused on querying the ISI Web of Knowledge (2008 Thompson Corporation) using the Science Citation Index Expanded (SCI Expanded) data set. The SCI Expanded is a database that provides bibliographic information, abstracts, references, and citations counts for more than 6650 scholarly science and technology journals. The SCI Expanded search was limited to articles published from 1900 to December 31, 2007. To find any article among the broadest selection of scientific journals related to critical care, we searched for any article that contained the keywords "critical-care," "intensive-care," "ICU," or "critically-ill OR critical-illness" and that had been cited more than 100 times. A total of 472 articles were retrieved with this technique after duplicates were removed (see Fig. 1A ). Because many critical care articles found in the SCI Expanded were not tagged by the general keywords noted above, we also searched within critical care journals. To do this, we used the Journal Citation Report (JCR) 2006 to identify journals specializing in critical care medicine from more than 7500 scholarly journals. We first reduced the target list to 16 English-language journals of 18 critical care journals identified by the JCR. We reviewed any article that had been cited more than 100 times and saved articles pertaining to critical care medicine (Fig. 1B) . This search resulted in 470 hits; however, we removed 159 duplicate articles that were already found by keyword searches to bring the total database to 783 articles ( Fig. 1 ). A representative list of most cited articles for each of the specific critical care topics was created from the existing database and by searching each topic individually using the terms in Table 1 . Using these search terms, articles pertinent to critical care and referenced more than 100 times were added to the database. These searches by specific disease or conditions added 404 articles to the master database as 194 articles were already in the database from either the initial search or from the journal search. From this master database of 1187 articles, we then generated a list of all articles cited more than 150 times (Table 2) . We organized this table by topics particularly relevant to critical care. Within each category we listed both the most cited articles within that topic as well as that article's ranking within the top 200 most cited articles. Finally, we also listed the absolute number of citations for each article. The final database included 1187 articles (Fig. 1) . The articles collated in this study came from almost 100 different journals with publication years ranging from 1905 (#149) to 2006 (average publication year = 1991). Surprisingly, of the top 1000 most cited critical care articles, 662 were not found using any of the basic critical care search terms-critical care, intensive care, ICU, or critically ill/critical illness. These articles were discovered only after searching within a specific critical care journal (n = 227) or by specific critical care topics (Table 1 ) (n = 373). In fact, only 4 of the top 1000 articles could be found using any 1 of the 4 basic critical care terms listed above. Of these search terms, the most productive was "intensive care" (25 of top 100 articles), then "critically ill" or "critical illness" (19/100), "ICU" (11/ 100), and finally "critical care" (5/100). Sepsis/systemic inflammatory response syndrome was the most common topic (193 articles), followed by acute lung injury and mechanical ventilation (177 articles). Overall, 41% of the most cited articles came from critical care journals as designated by the JCR. The most articles were from Critical Care Medicine (23%) followed by American Journal of Respiratory and Critical Care (7%), Journal of Trauma (5%), Intensive Care Medicine (4%), and Shock (1%). Among the non-critical care journals, the New England Journal of Medicine (11%) followed by JAMA (9%) provided the most articles. One method to quickly retrieve scholarly articles related to critical care medicine is by using readily available, Internet-based, bibliographic database search tools supported by most medical libraries. We have found, however, that commonly used basic search terms retrieve under only 50% of the most cited and therefore arguably most influential articles in critical care. Therefore, although searches may have become much faster and easier, they may not be sufficient to retrieve a comprehensive list of articles. We found that there is no single term that exhaustively retrieves all critical care medicine articles. The best generic search term, "intensive care," only retrieved 25% of what one would consider the 100 of the most influential articles in critical care. Furthermore, the search term "critical care" was linked to only 5 of the top 100 articles, although it is a common keyword used by many search engines. Not to mention the fact that it is in the title of 8 of the 18 "critical care" journals. One goal of this study was to determine the most efficient search terms for future literature searches. The capriciousness of how efficient a search term is perhaps no better illustrated than with our experience retrieving articles on ICU mortality prediction models. That not one of the basic critical care search terms in the Science Citation Index was tagged to these most influential articles highlights some of the difficulties in finding the most cited studies in critical care. It is clear that even for other types of articles, the best yield of Sepsis and infectious disease "sepsis" "septic*" "nosocomial" "blood stream" Mechanical ventilation and lung injury "ventilation" "respiratory failure" "pulmonary failure" "weaning" "extubation" "ventilator" "PEEP" "positive end expiratory pressure" "noninvasive" "ARDS" "respiratorydistress" "lung injury" Monitors "hemodynamic-monitor" "CVC" "physiologic-monitor" "noninvasivemonitor" "catheter*" "central venous" "pulmonary-artery-catheter" "Swan-Ganz" "ultrasound" "Doppler" "pressure variation" Mental status "coma" "brain-damage" "brain-injury" "ICU AND delirium" "ICU AND sedation" Physiologic predictors "physiology score" "severity of illness" "severity of disease" "mortalitypredict" "severity-score" Organ dysfunction "organ-failure" "organ-dysfunction" "MODS" "MSOF" Resource utilization "intensivist" "leap frog" "ICUadministration" "critical care management" "ICU management" Kidney injury "kidney-injury" "renal-failure" "dialysis" "renal-replacement-therapy" "CVVH*" "CRRT" Resuscitation "life-support" "cardiac-arrest" "cpr" "resuscitation" "cardiac massage" "cardiac-life-support" "fluid" "saline" "lactated" "albumin" "colloid" "crystalloid" Shock (excluding infectious causes) "shock" "hypoperfusion" "CHF" "heart-failure" Transfusions "transfusion" "fluid-therapy" ⁎ Denotes any form of the word preceding the symbol, i.e., septic shock, septic. only 25% indicates the need for a comprehensive search strategy such as the one used in this study. Although this is a problem for those looking for research articles, it can also be an issue for the way published research becomes cited by others. For example, articles without abstracts or very brief abstracts were often found only after using exact topic words found in the article's title or by starting a search from within a specific critical care journal itself. Our experience has been previously demonstrated where the choice of keywords and abstract construction significantly impacts the likelihood that an article will be found using modern electronic searches [17] . This study does highlight the importance of sepsis and infectious disease as well as respiratory physiology in critical care with more than half the articles falling into 1 of these 2 broad categories. On the other hand, the most cited article was related to physiologic predictors of morbidity and mortality and the next 3 articles were related to mental status. This study, like previous ones focusing on citations, has several limitations. Perhaps the most relevant is the debate as to what constitutes the most influential articles within a professional discipline [1, 4, 18] . Citation data found in all bibliographic databases rely not only on correctly acquiring cited references but also on the assumption that a primary study cites other references that are most relevant to the published article. It is likely that this study captured many of the classic articles in critical care as each article in our list of the top 200 articles was cited at least 300 times. Considering that 46% of articles published in medicine are never even cited, this is a remarkable observation [19] . Certainly, these articles deserve attention and must have made an indelible impact. However, this is not always the case. Authors may preferentially cite their or their colleagues' previous works both because of familiarity or to increase the citation of that article. Recent scholarship on social networks, especially in the age of accelerated knowledge transmission, suggests that there may be an enhanced level of "connectedness" related to these networks [20, 21] . It is not known whether, or how, this connectedness may be influencing the dissemination and therefore the pattern of references within the critical care community or among specific critical care topics. However, it is possible that the pattern of some citations may reflect the influence of an individual, as some have referred to as the "ceremonial citation," rather than the specific findings within an article [16, 22, 23] . In addition, authors are more likely to cite articles of their own language [8, 24] or articles that come from a highly cited journal. Not surprisingly, Baltussen found that among the most cited 45 articles, most of them came from non-critical care-focused journals [16] . Nevertheless, using citations as a proxy for influence and importance has both face validity and is supported by empiric data demonstrating that citation analyses correlate with articles with the highest quality hierarchies of evidence and research design [25] . Most importantly, the use of citations is also confounded by the effect of time from the year of publication [26] with peak of citations differing for different journals and areas of research. Once citations do peak, they eventually become part of common knowledge and are no longer cited. Previous studies suggest that articles peak 7 to 10 years after publication [15, 26] . It has been suggested that "classic" articles are relevant to only a few decades and many important articles are lost to the passage of time [15] . These findings may be supported by the fact that among the top 200 articles in this study, 158 were published during or after 2000. It is probably too early to tell how electronic databases will change the epidemiology of citation classics because it is easier to retrieve and perhaps cite influential articles than before the age of the Internet. In conclusion, although Web-based search engines can produce lists of references within seconds to minutes, the utility of these searches can be quite limited as a complete end effective literature search remains an art. Periodic reviews of the literature may prove helpful to trainees mastering the most influential literature of our field as well as more established professionals searching for starting points for new investigations. Assessment of coma and impaired consciousness-practical scale. Lancet 1974. (3749) 2. (#3) Jennett, B et al. Assessment of outcome after severe brain-damage-practical scale The role of secondary brain injury in determining outcome from severe head-injury Role of oxidants in ischemic brain damage Persistent vegetative state after braindamage-syndrome in search of a name Adverse-effects of prolonged hyperventilation in patients with severe head-injury-a randomized clinical-trial Daily interruption of sedative infusions in critically ill patients undergoing mechanical ventilation Lithium-carbonate, haloperidol, and irreversible brain-damage Cerebral perfusion-pressuremanagement protocol and clinical results Reversibility of ischemic braindamage Volume of intracerebral hemorrhage-a powerful and easy-to-use predictor of 30-day mortality Mechanisms of ischemic brain-damage Neurologic and sedation articles (no. of times cited) Predicting outcome from hypoxic-ischemic coma Propofol-an update on its clinical use Persistent paralysis in critically ill patients after long-term administration of vecuronium A phase-II study of moderate hypothermia in severe brain injury Clinical practice guidelines for the sustained use of sedatives and analgesics in the critically ill adult Free radical pathways in CNS injury Prognosis in non-traumatic coma Influence of sedation on mortality in critically ill multiple trauma patients Early hemicraniectomy in patients with complete middle cerebral artery infarction Early hemorrhage growth in patients with intracerebral hemorrhage Assessment and prognosis of coma after head-injury Cerebral perfusion-pressure management in head-injury ICU management/resource utilization articles (no. of times cited) Pharmacist participation on physician rounds and adverse drug events in the intensive care unit Nurse-staffing levels and the quality of care in hospitals A prospective-study of advance directives for life-sustaining care Withholding and withdrawal of life support from the critically ill Hand-washing patterns in medical intensivecare units The performance of intensive-care unitsdoes good management make a difference Lower Medicare mortality among a set of hospitals known for good nursing-care Survival, hospitalization charges and follow-up results in critically ill patients Medical intensive-careindications, interventions, and outcomes Increasing incidence of withholding and withdrawal of life support from the critically ill ICU management/resource utilization articles (no. of times cited) Organizational characteristics of intensive care units related to outcomes of abdominal aortic surgery Current and projected workforce requirements for care of the critically ill and patients with pulmonary disease-can we meet the requirements of an aging population Physician staffing patterns and clinical outcomes in critically ill patients-a systematic review Effect of reducing interns' work hours on serious medical errors in intensive care units Confidential inquiry into quality of care before admission to intensive care Determinants in Canadian health-care workers of the decision to withdraw life-support from the critically ill A look into the nature and causes of human errors in the intensive-care unit Decisions to limit or continue life-sustaining treatment by critical care physicians in the United Statesconflicts between physicians practices and patients wishes Impact of critical care physician staffing on patients with septic shock in a university hospital medical intensive-care unit Effects of organizational change in the medical intensive care unit of a teaching hospital-a comparison of "open" and "closed" formats Acute kidney injury articles (no. of times cited) Medical progress-acute renal failure Effects of different doses in continuous veno-venous haemofiltration on outcomes of acute renal failure: a prospective randomised trial Acute renal failure in intensive care units-causes, outcome, and prognostic factors of hospital mortality: a prospective, multicenter study The effect of acute renal failure on mortality-a cohort analysis Mechanisms of ischemic acute-renal-failure Non-oliguric acute renal-failure Effect of the dialysis membrane in the treatment of patients with acute-renal-failure Renal dysfunction after myocardial revascularization: risk factors, adverse outcomes, and hospital resource utilization Table 2 (continued) Acute kidney injury articles (no. of times cited) Acute renal-failure due to nontraumatic rhabdomyolysis Plasma endothelin levels in patients with acute renal-failure Radio contrast-induced acute renal-failure -clinical and pathophysiologic review Urinary diagnostic indexes in acute renalfailure Early management of shock and prophylaxis of acute-renal-failure in traumatic rhabdomyolysis Epidemiology of acute renal failure: a prospective, multicenter, community-based study Biocompatible membranes in acute-renalfailure-prospective case-controlled study Endothelin-an important factor in acute renal-failure Current concepts on pathophysiology of acute renal-failure Rhabdomyolysis and myohemoglobinuric acute renal failure Daily hemodialysis and the outcome of acute renal failure Treatment of acute renal failure Acute renal success-unexpected logic of oliguria in acute renal-failure Low-dose dopamine in patients with early renal dysfunction: a placebo-controlled randomised trial Risk-factors and outcome of hospitalacquired acute-renal-failure-clinical epidemiologic-study Continuous arteriovenous hemofiltration in the critically ill patient-clinical use and operational characteristics Continuous venovenous hemofiltration with dialysis removes cytokines from the circulation of septic patients Closed-chest cardiac massage Mild therapeutic hypothermia to improve the neurologic outcome after cardiac arrest Treatment of comatose survivors of out-of-hospital cardiac arrest with induced hypothermia Out-of-hospital cardiac-arrestelectrophysiologic observations and selection of long-term anti-arrhythmic therapy Survival after cardiopulmonary resuscitation in the hospital Resuscitation and cardiac arrest articles (no. of times cited) 6. (#118) Zoll, PM et al. Resuscitation of the heart in ventricular standstill by external electric stimulation Cardiac-arrest and resuscitation -a tale of 29 cities Improving survival from sudden cardiac-arrest-the chain of survival concept-a statement for health-professionals from the Advanced Cardiac Life-Support Subcommittee and the Emergency Cardiac Care Committee Out-of-hospital cardiac-arrest-use of electrophysiologic testing in the prediction of long-term outcome Lack of effect of induction of hypothermia after acute brain injury Survival after resuscitation from out-of-hospital ventricular-fibrillation The incidence of primary cardiacarrest during vigorous exercise Randomized comparison of antiarrhythmic drug therapy with implantable defibrillators in patients resuscitated from cardiac arrest-the Cardiac Arrest Study Hamburg (CASH) Outcomes of rapid defibrillation by security officers after cardiac arrest in casinos Outcome of CPR in a large metropolitanarea-where are the survivors Recommended guidelines for uniform reporting of data from out-of-hospital cardiac-arrest-the Utstein style-a statement for health-professionals from a task-force of the American-Heart-Association, the European-Resuscitation-Council, the Heart-and-Stroke-Foundation-of-Canada, and the Australian-Resuscitation-Council Difference in acid-base state between venous and arterial blood during cardiopulmonary-resuscitation Outcomes of cardiopulmonary resuscitation in the elderly Diverse mechanisms of unexpected cardiac-arrest in advanced heart-failure Mechanisms of blood-flow during cardiopulmonary resuscitation The influence of the probability of survival on patients preferences regarding cardiopulmonaryresuscitation Clinical, electrophysiologic and hemodynamic profile of patients resuscitated from prehospital cardiac-arrest In-hospital cardiopulmonary resuscitation Must we always use CPR Resuscitation and fluid therapy articles (no. of times cited) 1. (#74) Bickell, WH et al. Immediate versus delayed fluid resuscitation for hypotensive patients with penetrating torso injuries Human albumin administration in critically ill patients: systematic review of randomised controlled trials Incidence and severity of anaphylactoid reactions to colloid volume substitutes A comparison of albumin and saline for fluid resuscitation in the intensive care unit Effect of intravenous albumin on renal impairment and mortality in patients with cirrhosis and spontaneous bacterial peritonitis Prehospital hypertonic saline dextran infusion for posttraumatic hypotension-the USA multicenter trial Fluid resuscitation with colloid or crystalloid solutions in critically ill patients: a systematic review of randomised trials Crystalloid vs colloid resuscitation-is one better-randomized clinical-study A comparison of albumin and saline for fluid resuscitation in the intensive care unit Small-volume resuscitation with hypertonic saline dextran solution Small-volume resuscitation with hypertonic saline (2,400 mosm/liter) during hemorrhagicshock 3-percent NaCl and 7.5-percent NaCl/ dextran 70 in the resuscitation of severely injured patients Crystalloids vs. colloids in fluid resuscitation: a systematic review A multicenter trial for resuscitation of injured patients with 7.5-percent sodium-chloride-the effect of added dextran-70 Oxygen-transport responses to colloids and crystalloids in critically ill surgical patients Comparison of two fluidmanagement strategies in acute lung injury Patient survival after human albumin administration-a meta-analysis of randomized, controlled trials Physiological response to crystalloid resuscitation of severe burns Table 2 (continued) 5-percent sodium-chloride dextran for resuscitation of trauma patients undergoing helicopter transport Dynamic fluid redistribution in hyperosmotic resuscitation of hypovolemic hemorrhage Effects of hydroxyethylstarch and gelatin on renal function in severe sepsis: a multicentre randomised study Crystalloid versus colloid fluid resuscitation -a meta-analysis of mortality Is hypertonic saline resuscitation safe in uncontrolled hemorrhagic-shock An international view of hydroxyethyl starches. Intens Care Med 1999 Efficacy of hypertonic 7.5% saline and 6% dextran-70 in treating trauma: a meta-analysis of controlled clinical studies A prospective, randomized, and controlled study of fluid management in children with severe head injury: lactated ringer's solution versus hypertonic saline Transfusion medicine/hematology/bleeding articles (no. of times cited) A multicenter, randomized, controlled clinical trial of transfusion requirements in critical care The effects of normal as compared with low hematocrit values in patients with cardiac disease who are receiving hemodialysis and epoetin A comparison of enoxaparin with placebo for the prevention of venous thromboembolism in acutely ill medical patients Antacid titration in prevention of acute gastrointestinal bleeding-controlled randomized trial in 100 critically ill patients Antacid versus cimetidine in preventing acute gastrointestinal-bleeding-randomized trial in 75 critically ill patients Effect of stored-blood transfusion on oxygen delivery in patients with sepsis Anemia and blood transfusion in critically ill patients Blood transfusion in elderly patients with acute myocardial infarction Beneficial effects of leukocyte depletion of transfused blood on postoperative complications in patients undergoing cardiac surgery-a randomized clinical trial Effect of hypothermia on the coagulation cascade Anemia is associated with worse symptoms, greater impairment in functional capacity and a significant increase in mortality in patients with advanced heart failure Is a low transfusion threshold safe in critically ill patients with cardiovascular diseases? Blood transfusion-an independent risk factor for postinjury multiple organ failure The CRIT study: anemia and blood transfusion in the critically ill-current clinical practice in the United States Efficacy of recombinant human erythropoietin in critically ill patients-a randomized controlled trial Hypothermia and acidosis worsen coagulopathy in the patient requiring massive transfusion Relationship of blood transfusion and clinical outcomes in patients with acute coronary syndromes Efficacy of recombinant human erythropoietin in the critically ill patient: a randomized, double-blind, placebo-controlled trial Recombinant factor VIIa as adjunctive therapy for bleeding control in severely injured trauma patients: two parallel randomized, placebo-controlled, doubleblind clinical trials Does transfusion practice affect mortality in critically ill patients? Predicting life-threatening coagulopathy in the massively transfused trauma patient: hypothermia and acidoses revisited RBC transfusion in the ICU-is there a reason Transfusing red blood cells stored in citrate phosphate dextrose adenine-1 for 28 days fails to improve tissue oxygenation in rats Article The impact-factors debate: the ISI's uses and limits Citation rates and journal impact factors are not suitable for evaluation of research Impact factors can mislead The role of a journal in a scientific controversy Citation analysis and journal impact factors-is the tail wagging the dog? Plastic surgery classics: characteristics of 50 top-cited articles in four plastic surgery journals since 1946 One hundred citation classics in general surgical journals A century of citation classics in otolaryngology-head and neck surgery journals The 100 most-cited articles from JMB BJA citation classics 1945-1992 Toward a canon of the pain and analgesia literature: a citation analysis Citation classics in anaesthesia and pain journals: a literature review in the era of the internet Citation classics in anesthetic journals Identifying the classics: an examination of articles published in the journal of pediatric psychology from 1976-2006 Citation classics in critical care medicine The "impact factor": what it means to the impact of applied physiology Why the impact factor of journals should not be used for evaluating research Publication, citations, and impact factors of leading investigators in critical care medicine Social network analysis: methods and applications Proceedings of 12th International Conference on Knowledge Discovery in Data Mining Citation analysis and the science policy arena Citations and the evaluation of individual scientists Factors associated with citation rates in the orthopedic literature Relative citation impact of various study designs in the health sciences Citation analysis using online databases: feasibilities and shortcomings