Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management Kulhavy, D. L., et al. (2020). Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management. Journal of Altmetrics, 3(1): 6. DOI: https:// doi.org/10.29024/joa.33 RESEARCH Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management David L. Kulhavy1, R. P. Reynolds2, D. R. Unger1, M. W. McBroom1, I-Kuai Hung1 and Yanli Zhang1 1 Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University, Nacogdoches, Texas, US 2 Ralph W. Steen Library, Stephen F. Austin State University, Nacogdoches, Texas, US Corresponding author: David L. Kulhavy (dkulhavy@sfasu.edu) Digital preservation of library materials has increased the need for methods to access the documents and contents maintained in digital archives. The use of altmetrics to quantify the impact of scholarly works, including PlumX, is increasing readership by listing articles in reference services. The outreach from the digital repository ScholarWorks at Stephen F. Austin State University (SFASU) highlights the impact within the natural resources community from Digital Commons, Forest Sciences Commons; and from the Natural Products Chemistry and Pharmacognosy Commons. The use of PlumX altmetrics was examined to evaluate usage, impact, and digital audience downloads for the Arthur Temple College of Forestry and Agriculture (ATCOFA) at SFASU. Keywords: Natural resources; PlumX; Digital Commons; ScholarWorks Introduction Digital preservation of library materials is increasing, and proactive institutional organization and response are criti- cal for developing comprehensive procedures and oversight in both securing and cataloging digital library resources (Wilson 2017). This includes acquiring needed rights and permissions to store and disseminate the materials and to continue adding to the collection. Kulhavy et al. (2017) reviewed digital preservation of natural resource docu- ments from the Arthur Temple College of Forestry and Agriculture (ATCOFA) for ScholarWorks at Stephen F. Austin State University (SFASU) as part of Forest Sciences Commons™, a subset of Life Sciences Commons™ of the Digital Commons Network™ (DCN) for bepress™. Documents archived included research articles, eBooks, digital journals, theses and dissertations, monographs, bulletins, and documents produced by research centers on the SFASU campus. Digital records give greater access to material downloads, as the scanned documents are archived at the online SFASU ScholarWorks. The DCN software is used to build institutional repositories and publish peer-reviewed journals, and increases the visibility of the institution and its research (Erway 2012; Enis 2013). Once entered into the ScholarWorks database, altmetrics are available to assess the access and usability of the docu- ments archived in the system. A team of library archivists is generally responsible for scanning digital records to ensure accuracy and consistency of records (Lapinski et al. 2013). Choice of the altmetrics for measurement of digital record use is a function of cost and the intended recordkeeping for the institutional records. The use of altmetrics to quantify scholarly communication promotes the impact of the SFASU academic community (Roemer and Borchardt 2013, 2015). The use of ScholarWorks at SFASU supports the mission of ATCOFA to produce society-ready natural resources man- agers who deal effectively with complex ecological, economic, and social issues associated with contemporary natural resources challenges. Maintaining excellence in teaching, research, and service to enhance the environment through sus- tainable management, conservation, and protection of natural resources is ATCOFA’s strategic guiding principle (Bullard et al. 2014). The development of the ScholarWorks natural resources repository at SFASU reflects the faculty research and teaching emphasis (Kulhavy et al. 2017). The research is primarily funded by the McIntire-Stennis Cooperative Forestry Program, which was established during the Kennedy Administration by PL 87–788. McIntire-Stennis addressing the need to acquire new knowledge, understanding, and technologies and apply these to complex, transdisciplinary social and bio- logical issues and problems (Bullard & Straka, 1986; Thompson & Bullard, 2004; Bullard et al., 2011; Bullard et al., 2014). This program was designed to impact society by providing forestry institutions with the capacity funding needed not only to address forestry issues but also to disseminate findings to key audiences, including forestry professionals, the forest industry, and forest landowners, as well as to train new forestry professionals from the undergraduate through doctoral levels. Tools like ScholarWorks are often overlooked as a necessary means of reaching these audiences in the digital age. https://doi.org/10.29024/joa.33 https://doi.org/10.29024/joa.33 mailto:dkulhavy@sfasu.edu Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource ManagementArt. 6, page 2 of 7 PlumX is an aggregator that offers more metrics, including citation and usage metrics (i.e., views and downloads). It covers more than 52.6 million artifacts, being the largest altmetrics aggregator (Ortega 2018a; Plum Analytics 2018). Altmetrics can be used to measure the impact that scientific articles have on society (Holmberg et al. 2019a). PlumX is the primary altmetrics source for analysis of downloads and use of the natural resources materials from the SFASU ScholarWorks. In addition, the downloads and articles available are retrieved from the Digital Open Network from bepress. This information provides a basis for evaluation of the impact in the natural resource digital-retrieval user community including top academic scholars with archives stratified by institution to compare the impact of different academic institutions. PlumX altmetrics use downloads over time and referrals to the digital preservation system (Collier & Deliyannides 2016; Wong & Vital 2017; Bar-Ilan et al. 2019). Altmetrics data are the aggregated views, mentions, downloads, shares, discussions, and recommendations of research outputs across the scholarly web (Fenner 2014). More emphasis is being placed on the use and availability of research findings (Vanclay et al. 2015; Holmberg et al. 2019a, b). The impact of research can be viewed as all the different ways in which research can benefit individuals, organizations, and nations (ESRC 2016). In 2017, Plum Analytics was acquired by Elsevier (www.elsevier.com), and its altmetrics information was added to the Scopus database (Elsevier 2017; Michalek 2017). Methods Natural resource articles were scanned into ScholarWorks and archived in the Ralph W. Steen Library at SFASU. These articles were evaluated for use and distribution using the Forest Sciences DCN for bepress from February 13, 2013 to June 11, 2020. Data extracted and posted from bepress included number of institutional records by country compared across natural resource digital archives, impact by authors in the forest sciences, downloads of articles from Scholar- Works, referrers to search engines for ScholarWorks, downloads of articles by country, downloads of articles by month, and examples of PlumX altmetrics. Results ATCOFA had five of the top eight authors in the country representing total number of downloads for the For- est Sciences DCN in bepress as of June 11, 2020 (Table 1) and ATCOFA was fourth out of 144 institutions in the United States, with 744 works in the Forest Sciences Commons (Figure 1). All-time downloads for ATCOFA in the SFASU ScholarWorks were 118,205 from 198 countries. There were 8,111 full-text articles with 9,167 authors and Table 1: Top eight scholar citations for Forest Sciences Commons, May 2020. Steven Bullard, Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University Jerome Vanclay, Southern Cross University David Kulhavy, Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University Daniel Unger, Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University I-Kuai Hung, Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University Yanli Zhang, Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University Richard Schultz, Iowa State University Jake Delwiche, US Forest Service Figure 1: Institutions in Forest Commons by number of articles cataloged. http://www.elsevier.com Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management Art. 6, page 3 of 7 1,140,202 downloads in the Forest Sciences Commons. There were 7,648 institutions downloading information, with 59% from education, 27% commercial, 8% government, and 3% organizations. The most accessed institution was SFASU, with 2,142 downloads. The highest country total was for the United States (52,692), followed by India, China, the Philippines, Canada, the United Kingdom, Indonesia, Malaysia, Vietnam, and Germany (Figure 2). The major referrers (3,435) for retrieval of information from the SFASU ScholarWorks site were Google, Google Scholar, and ScholarWorks at SFASU (Figure 3). Total downloads from February 13, 2013 to June 11, 2020, were 118,205 (Figure 4). Figure 3: Referrers to search engines for articles in ScholarWorks, Stephen F. Austin State University. Figure 4: Downloads from February 2013 to June 2020, Stephen F. Austin State University ScholarWorks. Figure 2: Downloads of articles from ScholarWorks, Stephen F. Austin State University. Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource ManagementArt. 6, page 4 of 7 The most downloads for a paper were for Li et al. (2011), with 20,872 usages (18,489 downloads and 2,383 abstract views), captures by 696 readers, and 52 citations (Figure 5), determined using PlumX altmetrics. This article is listed under the Natural Products Chemistry and Pharmacognosy Commons, with SFASU third out of 50 institutions repre- sented in the United States; there are 159 articles, 490 authors, and 104,457 downloads. Three of the top four authors are from SFASU: Shiyou Li, Wei Yuan, and Ping Wang. The research articles are published from the National Center for Pharmaceutical Crops established at ATCOFA in 2004 to improve human health by discovering novel anti-tumor and antiviral agents from native and invasive plant species (Li et al. 2010; Kulhavy et al. 2017). The center publishes the international peer-reviewed journal Pharmaceutical Crops (http://www.bentham.org/open/topharmcj/index.htm) to investigate cultivated species used for extraction or preparation of therapeutic substances used in pharmaceutical formulations, vaccines, and antibodies and therapeutic proteins (Li et al. 2010). The center is currently investigating endocide-induced abnormal growth forms of giant salvania (Salvinia molesta) (Li et al. 2018). Endocides (endogenous biocides) are metabolites that can poison or inhibit the parent via induced biosynthesis or external applications (Li et al. 2016). Discussion As much of the research is funded by the McIntire-Stennis Cooperative Research Program, which is federal funding provided to increase forestry research in the production, utilization, and protection of forestland, increased reader- ship and downloads of natural resources articles in the SFASU ScholarWorks enhance the flow of information to users in educational, government, commercial, and organizational entities. The number of downloads indicates a measure of societal impact, as more downloads across a variety of user groups and countries expands the range of the arti- cles (Holmberg 2019a). The purpose of the McIntire-Stennis program is to increase research on forest productivity, utilization, and protection; to train future forestry scientists; and to cooperate with other states in forestry research (Thompson & Bullard 2004; Bullard et al. 2011; Rickenbach et al. 2013; Allen 2017). The development of ScholarWorks for natural resources at SFASU increases the expanding role of libraries in archiving and dissemination of scholarly writing in an open access environment (American Association of College and Research Libraries 2000). At SFASU, ScholarWorks is supported and maintained by the Ralph W. Steen Library and librarians, which provides worldwide visibility of research in a single location with a stable URL and open access to all faculty research at SFASU. A stable platform is essential to increase the use and reliability of research material that is produced (Gracy & Kahn 2012). PlumX Altmetrics Work is uploaded to ScholarWorks in the Center for Digital Scholarship, including metadata for information retrieval using PlumX altmetrics. PlumX is an aggregator that offers more metrics for citation and usage (i.e. views and downloads) for over 52.6 million artifacts (Ortega 2018b; Plum Analytics 2018). PlumX provides alternative metrics (altmetrics) to view reader impact from an academic institution, individual programs, or individual faculty members (Collier & Deliyannides 2016). Account administrators create profiles in PlumX for individual researchers or groups, including images and biographical and contact information (Champieux 2015). PlumX Metrics can be used to provide information on interaction with research, including articles, conference proceedings, book chapters, and books, in an online environment (Wong & Vital, 2017). The five categories of PlumX Metrics include Usage, Captures, Mentions, Social Media, and Citations. These five metrics are color coded: usage (green), captures (magenta), mentions (yellow), social media (blue), and citations by others (orange). The size of the circle (e.g., usage, Figure 5) indicates the impor- tance of this metric for each article in ScholarWorks. Usage includes downloads, views, clicks on the work, and library holdings. The most important usage metric accord- ing to a Taylor & Francis Open Access Survey in 2014 (Frass et al. 2014) is citations of articles (81% of respondents), followed by article downloads (60%). Next is captures, which includes blog posts, reviews, Wikipedia, and news refer- ences; social media includes Facebook, tweets, and shares (Lindsay 2016). PlumX implementation by libraries raises the academic profile and adds to the altmetrics for faculty by adding information on authors across social media, mentions, and citation counts (Wong & Vital 2017). The University of Pittsburgh created an extensive digital library and used PlumX altmetrics to measure usage with the PlumX artifact widget (Collister et al. 2017). As digital resources and library services expand, altmetrics for tracking user information for articles is increasing, including blogs, social media, and users. Librarians serve as the conduit to the altmetrics that acquire and provide access to resources for east of tracking and to evaluate the scholarly impact of an academic institution. Altmetrics like PlumX have a cost structure tied to Figure 5: Published paper most downloaded from Stephen F. Austin State University ScholarWorks. http://www.bentham.org/open/topharmcj/index.htm Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management Art. 6, page 5 of 7 ScholarWorks, the institutional repository for digital preservation at SFASU. PlumX altmetrics provide data for DOIs or other digital identifiers (Roemer & Borchardt 2013, 2015; Peters et al. 2016), and use with ScholarWorks provides user information in connection with the DCN and bepress. Altmetrics by themselves may not express societal impact but reflect both individual and institutional use of records. The actual use of the information is determined in further exploration of citation uses in scientific search engines. Altmetrics also promote new forms of scholarly communication, with the goal of assessing the societal impact of research to identify and measure how a specific research document has been used and what kind of influence it has had, not just within academia but also beyond (Holmberg et al. 2019a). Altmetrics are currently being investigated to determine if they could be used to assess societal impact of research. The rapid development of the use of altmetrics (or alternative metrics) provides guidance on how research is being used, viewed, and moved. The electronic transfer of information can be tracked to provide data on the use and distribution of research findings (Penfield et al. 2014). For PlumX, tweets and blog mentions had the earliest views but were not persistent. Bookmarking (Mendeley read- ers), usage metrics (downloads and views) and bibliographic indicators (citations) increased over time and were persis- tent (Ortega 2018a). PlumX altmetrics identified the highest numbers of Mendeley readers of an article compared to Crossref Event Data (CED) and Altmetric.com (Ortega 2018b, 2019). Wong & Vital (2017) highlight the effectiveness of PlumX to showcase the reader impact and academic profile of Saint Mary’s College of California. Nuzzolese et al. (2019) used PlumX altmetrics to analyze the National Scientific Qualification for scholars in Italy as a method of measuring the impact of their research. The altmetrics led to an assessment at the product level of scholarly products. (Lapinski et al. 2013). Bar-Ilan et al. (2019) and Brigham (2014) reviewed the use of altmetrics to expand the use of this tool for researchers to showcase impact metrics. PlumX Dashboards integrates the DCN as an institutional repository, with Selected Works as a profile system leading to Repository Harvesting through web crawling. Use includes articles, book chapters, books, conference papers, discussion papers, presentations, posters, reports, and theses and dissertations. With the expanded role of digital measures for libraries, increased use of altmetrics enhances the availability of research materials across a variety of platforms. The primary use of altmetrics at SFASU is currently usage (for download and abstracts). However, expansion on the use of social media, blogs, and mentions expands the potential readership and use. The use of PlumX altmetrics at SFASU reflects the major audience with usage, followed by captures and cita- tions, with very little use of mentions or social media. For ScholarWorks at SFASU, the primary search engine for finding articles is Google, followed by Google Scholar and ScholarWorks. As ScholarWorks expands the number of articles listed, the usage will increase, expanding the importance of download statistics as a measure of societal impact. Acknowledgements This research was supported by the National Institute of Food and Agriculture, U.S. Department of Agriculture, McIntire-Stennis project under TEXY146 1001874 administered by the Arthur Temple College of Forestry and Agriculture, Stephen F. Austin State University. Competing Interests The authors have no competing interests to declare. References Allen, J. A. (2017). Sustaining healthy and productive forests, McIntire Stennis Strategic Plan: Investing in America’s competitive position in the global marketplace. The McIntire-Stennis Cooperative Forestry Research Program 2017 strategic plan. Retrieved August 9, 2020 from https://www.fs.fed.us/research/docs/forestry-research-council/ articles/mcintire-stennis-strategic-plan-update.pdf. American Association of Colleges and Research Libraries. (2000). Information literacy competency standards for higher education. American Library Association, Chicago, Illinois, USA. Bar-Ilan, J., Halevi, G., & Milojević, S. (2019). Differences between altmetric data sources – A case study. Journal of Altmetrics, 2(1), 1. DOI: https://doi.org/10.29024/joa.4 Brigham, T. (2014). An introduction to altmetrics. Medical References Services Quarterly, 33, 438–477. DOI: https://doi. org/10.1080/02763869.2014.957093 Bullard, S. H., & Straka, T. J. (1986). Continuing education needs of natural resource professionals. Resource Management and Optimization, 3, 281–290. Bullard, S. H., Brown, P. J., Blanche, C. A., Brinker, R. W., & Thompson, D. H. (2011). A “Driving Force” in developing the nation’s forests: The McIntire-Stennis Cooperative Research Program. Journal of Forestry, 109, 141–148. Bullard, S. H., Stephens Williams, P., Coble, T., Coble, D., Darville, R., & Rogers, L. (2014). Producing “society-ready” foresters: A research-related process to revise the bachelor of science in forestry curriculum at Stephen F. Austin State University. Journal of Forestry 112, 354–360. DOI: https://doi.org/10.5849/jof.13-098 Champieux, R. (2015). PlumX. Journal of the Medical Library Association, 103(1), 63–64. DOI: https://doi. org/10.3163/1536-5050.103.1.019 Collier, L. B., & Deliyannides, T. S. (2016). Altmetrics: Documenting the story of research. Against the Grain, 28(1), Article 9. DOI: https://doi.org/10.7771/2380-176X.7267 http://Altmetric.com https://www.fs.fed.us/research/docs/forestry-research-council/articles/mcintire-stennis-strategic-plan-update.pdf https://www.fs.fed.us/research/docs/forestry-research-council/articles/mcintire-stennis-strategic-plan-update.pdf https://doi.org/10.29024/joa.4 https://doi.org/10.1080/02763869.2014.957093 https://doi.org/10.1080/02763869.2014.957093 https://doi.org/10.5849/jof.13-098 https://doi.org/10.3163/1536-5050.103.1.019 https://doi.org/10.3163/1536-5050.103.1.019 https://doi.org/10.7771/2380-176X.7267 Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource ManagementArt. 6, page 6 of 7 Collister, L. B., Kirschner, J., Bradbury, M., Deliyannides, T. S., & Kear, R. (2017). Altmetrics and library publishing. IFLA WLIC, Wroclaw, Poland. http://library.ifla.org/id/eprint/1787 7 p. Economic and Social Research Council (ESRC). (2016). What is Impact? Retrieved August 9, 2020 from https://esrc. ukri.org/research/impact-toolkit/what-is-impact/. Elsevier. (2017). Elsevier acquires leading ‘altmetrics’ provider plum analytics. Retrieved May 23, 2019 from https://www. elsevier. com/about/press-releases/corporate/elsevier-acquires-leading-altmetrics-provider-plum-analytics. Enis, M. (2013). Uncommonly open: The new digital commons network. The Digital Shift, Library Journal. http://www. thedigitalshift.com/2013/06/discovery/uncommonly-open/. Erway, R. (2012). Last impact: Sustainability of disciplinary repositories. Online Computer Library Center, Inc., Dublin, Ohio. Fenner, M. (2014). Altmetrics and their novel Measures for Scientific Impact. In S. Bartling & S. Friesike (Eds.), Opening Science (pp. 179–189). Cham: Springer International Publishing. DOI: https://doi.org/10.1007/ 978-3-319-00026-8_12 Frass, W., Cross, J., & Gardner, V. (2014). Taylor and Francis Open Access Survey, June 2014. Taylor and Francis/ Routledge. 35 pp. https://www.tandf.co.uk//journals/explore/open-access-survey-june2014.pdf. Gracy, K. F., & Kahn, M. B. (2012). Preservation in the digital age. Library Resources & Technical Services, 56(1), 25–43. DOI: https://doi.org/10.5860/lrts.56n1.25 Holmberg, K., Bowman, S., Bowman, T., Didegah, F., & Kortelainen, T. (2019a). What is societal impact and where do altmetrics fit into the equation? Journal of Altmetrics, 2(1), 6. DOI: https://doi.org/10.29024/joa.21 Holmberg, K., Bowman, T., Didegah, F., & Lehtimäki, J., (2019b). The relationship between institutional factors, citation and altmetric counts of publications from Finnish universities. Journal of Altmetrics, 2(1), 5. DOI: https:// doi.org/10.29024/joa.20 Kulhavy, D. L., Reynolds, R. P., Unger, D. R., Bullard, S. H., & McBroom, M. W. (2017). Digital preservation and access of natural resource documents. Journal of Education and Practice, 8, 121–128. Lapinski, S., Piwowar, H., & Priem, J. (2013). Riding the crest of the altmetrics wave: How librarians can help prepare faculty for the next generation of research impact metrics. arXIV:1305.3328, 4 p. Li, S., Wang, P., Su, Z., Lozano, E., LaMaster, O., Grogan, J. B., Weng, Y. Decker, T., Findeisen, J., & Garrity, M. (2018). Endocide-induced abnormal growth forms of invasive giant salvania (Salvania molesta). Scientific Reports, 8, Article Number 8006. DOI: https://doi.org/10.1038/s41598-018-25986-5 Li, S., Wang, P., Yuan, W., Su, Z., & Bullard, S. H. (2016). Endocidal regulation of secondary metabolites in the producing organisms. Scientific Reports, 6, Article Number 29315. DOI: https://doi.org/10.1038/srep29315 Li, S., Yuan, W., Deng, G., Wang, P., Yang, P. & Aggarwal, B. B. (2011). Chemical composition and product quality of turmeric (Curcuma longa L.). Pharmaceutical Crops, 2, 28–54. DOI: https://doi.org/10.2174/2210290601102010028 Li, S., Yuan, W., Yang, P., Antoun, M. D., Balick, M. J., & Cragg, G. M. (2010). Pharmaceutical crops: An overview. Pharmaceutical Crops, 1, 1–17. DOI: https://doi.org/10.2174/2210290601001010001 Lindsay, J. M. (2016). PlumX from Plum Analytics: Not just altmetrics, Journal of Electronic Resources in Medical Libraries, 13(1), 8–17, DOI: https://doi.org/10.1080/15424065.2016.1142836 Michalek, A. (2017). Plum Analytics joins Elsevier. Retrieved from: https://plumanalytics.com/ plum-analytics-joins-elsevier/. Nuzzolese, A. G., Ciancarina, P., Gangemi, A., Peroni, S., Poggi, F., & Presutti, V. (2019). Do altmetrics work for assessing research quality? Scientometrics, 118, 539–562. DOI: https://doi.org/10.1007/s11192-018-2988-z Ortega, J. L. (2018a). Reliability and accuracy of altmetric providers: A comparison among Altmetric.com, PlumX and Crossref Event Data. Scientometrics, 116, 2123–2138. DOI: https://doi.org/10.1087/20130103 Ortega, J. L. (2018b). The life cycle of altmetric impact: A longitudinal study of six metrics from PlumX. Journal of Informetrics, 13, 579–589. DOI: https://doi.org/10.1016/j.joi.2018.06.001 Ortega, J. L. (2019). Availability and audit of links in altmetric data providers: Link checking of blogs and news in Altmetric.com, Crossref Event Data and PlumX. Journal of Altmetrics, 2(1), 4. DOI: https://doi.org/10.29024/joa.14 Penfield, T., Baker, M. J., Scoble, R., & Wykes, M. C. (2014). Assessment, evaluations and definitions of research impact: A review. Research Evaluation, 23(1), 21–32. DOI: https://doi.org/10.1093/reseval/rvt021 Peters, I., Kraker, P., Lex, E., Gumpenberger, C., & Gorraiz, J. (2016). Research data explored: An extended analysis of citations and altmetrics. Scientometrics, 107, 723–744. DOI: https://doi.org/10.1007/s11192-016-1887-4 Plum Analytics. (2018). Coverage: Expanding the world of altmetrics. DOI: https://plumanalytics.com/learn/ about-metrics/coverage/. Rickenbach, M., Mohamed, A., Blanche, C., & Norland, E. (2013). Final report: Review of the McIntire-Stennis Cooperative Forestry Research Program. USDA National Institute of Food and Agriculture Institute of Climate, Bioenergy, and the Environment final report to USDA Forest Research Advisory Council. 22 p. Roemer, R. C., & Borchardt, R. (2013). Institutional altmetrics and academic libraries. Information Quality Standards, 25(2), 14–19. DOI: https://doi.org/10.3789/isqv25no2.2013.03 Roemer, R. C., & Borchardt, R. (2015). Chapter 4. Altmetrics and the role of librarians. Library Technical Reports, 51(5), 31–38. http://library.ifla.org/id/eprint/1787 https://esrc.ukri.org/research/impact-toolkit/what-is-impact/ https://esrc.ukri.org/research/impact-toolkit/what-is-impact/ https://www.elsevier. com/about/press-releases/corporate/elsevier-acquires-leading-altmetrics-provider-plum-analytics https://www.elsevier. com/about/press-releases/corporate/elsevier-acquires-leading-altmetrics-provider-plum-analytics http://www.thedigitalshift.com/2013/06/discovery/uncommonly-open/ http://www.thedigitalshift.com/2013/06/discovery/uncommonly-open/ https://doi.org/10.1007/978-3-319-00026-8_12 https://doi.org/10.1007/978-3-319-00026-8_12 https://www.tandf.co.uk//journals/explore/open-access-survey-june2014.pdf https://doi.org/10.5860/lrts.56n1.25 https://doi.org/10.29024/joa.21 https://doi.org/10.29024/joa.20 https://doi.org/10.29024/joa.20 https://doi.org/10.1038/s41598-018-25986-5 https://doi.org/10.1038/srep29315 https://doi.org/10.2174/2210290601102010028 https://doi.org/10.2174/2210290601001010001 https://doi.org/10.1080/15424065.2016.1142836 https://plumanalytics.com/ plum-analytics-joins-elsevier/ https://plumanalytics.com/ plum-analytics-joins-elsevier/ https://doi.org/10.1007/s11192-018-2988-z http://Altmetric.com https://doi.org/10.1087/20130103 https://doi.org/10.1016/j.joi.2018.06.001 http://Altmetric.com https://doi.org/10.29024/joa.14 https://doi.org/10.1093/reseval/rvt021 https://doi.org/10.1007/s11192-016-1887-4 https://plumanalytics.com/learn/about-metrics/coverage/ https://plumanalytics.com/learn/about-metrics/coverage/ https://doi.org/10.3789/isqv25no2.2013.03 Kulhavy et al: Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management Art. 6, page 7 of 7 Thompson, D. H., & Bullard, S. H. (2004). History and evaluation of the McIntire-Stennis Cooperative Forestry Research Program. Forestry and Wildlife Research Center, Research Bulletin FO 269, Mississippi State University, Starkville, Mississippi. Vanclay, F., Esteves, A. M., Aucamp, I., & Franks, D. M. (2015). Social impact assessment: Guidance for assessing and managing the social impacts of projects. Fargo ND: International Association for Impact Assessment (p. 170). Retrieved June 9, 2020 from http://espace.library.uq.edu.au/view/UQ:355365/UQ355365.pdf. Wilson, T. C. (2017). Rethinking digital preservation: definitions, models, and requirements. Digital Library Perspectives, 33(2), 128–136. DOI: https://doi.org/10.1108/DLP-08-2016-0029 Wong, E. Y., & Vital, S. M. (2017). PlumX: a tool to showcase academic profile and distinction. Digital Library Perspectives, 33(4), 305–313. DOI: https://doi.org/10.1108/DLP-12-2016-0047 How to cite this article: Kulhavy, D. L., Reynolds, R. P., Unger, D. R., McBroom, M. W., Hung, I-K., & Zhang, Y. (2020). Use of Altmetrics to Analyze ScholarWorks in Natural Resource Management. Journal of Altmetrics, 3(1): 6. DOI: https://doi. org/10.29024/joa.33 Submitted: 13 August 2020 Accepted: 21 September 2020 Published: 16 October 2020 Copyright: © 2020 The Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See http://creativecommons.org/licenses/by/4.0/. Journal of Altmetrics is a peer-reviewed open access journal published by Levy Library Press. OPEN ACCESS http://espace.library.uq.edu.au/view/UQ:355365/UQ355365.pdf https://doi.org/10.1108/DLP-08-2016-0029 https://doi.org/10.1108/DLP-12-2016-0047 https://doi.org/10.29024/joa.33 https://doi.org/10.29024/joa.33 http://creativecommons.org/licenses/by/4.0/ Introduction Methods Results Discussion PlumX Altmetrics Acknowledgements Competing Interests References Figure 1 Figure 2 Figure 3 Figure 4 Figure 5 Table 1