262 joseph a. jones et al. Critical Reflection or Existential Trap: Are We Making Too Much of Scientific Rigor in a Dynamic Business World? Joseph A. Jones, Ashley A. Miller, Michael J. Sarette, Rachael M. Johnson-Murray, and Alex Alonso Society for Human Resource Management Ralph Waldo Emerson is known to have said, “the greatest wonder is that we can see these trees and not wonder more.” As industrial and organiza- tional (I-O) psychologists, we often encounter this very dilemma when we examine how numerous professions rise and fall in relevance. More recently, however, we have encountered this dilemma from an existential perspective as we strive to understand the evolution of our own profession and the situa- tional characteristics making change inevitable. We have fallen into a trap— we, too, now look at all of our practices, aiming to reconfigure the makeup of our profession while losing sight of the macrotrends affecting more than just our evolved existence. Rather than focusing on the smaller issue first, we need to start by examining the broader issues affecting it. This is not to say that I-O psychologists should avoid concerning them- selves with poor-quality and unsubstantiated approaches to solving organi- zational and individual employee challenges. I-O psychologists should natu- rally be concerned with these potential limiters of professional success. How- ever, are we missing the forest for the trees in focusing too heavily on the neg- ative effects of potentially bad practices on our profession—and not on how the rapid changes in the broader external environment are influencing our approach to these practices? We suggest the answer here is yes, and in doing this, we are missing opportunities to make a real impact in shaping effective talent management practices today—and, more importantly, tomorrow. A Matter of Perspective? Talent management practices that do not work as well as they should, or as well as they are professed to work, can certainly have a negative side. They can harm business performance, restrict employment opportunities Joseph A. Jones, Society for Human Resource Management; Ashley A. Miller, Society for Human Resource Management; Michael J. Sarette, Society for Human Resource Management; Rachael M. Johnson-Murray, Society for Human Resource Management; Alex Alonso, Society for Human Resource Management. Correspondence concerning this article should be addressed to Joseph A. Jones, Soci- ety for Human Resource Management, 1800 Duke Street, 2nd Floor, Alexandria, VA 22314. E-mail: josephandrewjones@gmail.com https://www.cambridge.org/core/terms. https://doi.org/10.1017/iop.2018.16 Downloaded from https://www.cambridge.org/core. Carnegie Mellon University, on 06 Apr 2021 at 00:59:11, subject to the Cambridge Core terms of use, available at mailto:josephandrewjones@gmail.com https://www.cambridge.org/core/terms https://doi.org/10.1017/iop.2018.16 https://www.cambridge.org/core too much scientific rigor in business? 263 for workers, and lead to on-the-job mistakes and safety issues, to name a few (Sheehan & Anderson, 2015). These risks can increase substantially as the stakes of the work being performed rise. That said, approaching new and changing business practices (or inno- vations in other fields) primarily from the perspective of the dangers they pose, as opposed to opportunities for growth, advancement, or refinement of long-standing theories, limits our ability to build off these practices. Yes, some things are new and untested (and sometimes strange in the eyes of I-O). Our job is not, however, to stop the bus and say “wait, we first must test the engine and the wheels and the brakes to make sure it is all safe to go forward.” For buses, that makes sense. Unfortunately, such deliberation is often not an option in today’s fast-paced and highly competitive busi- ness environment. We must frequently test what we are doing while we are doing it. The good news is, we already have been doing this testing for decades— with concurrent and predictive validation, for example. This is critical for situations where the potential negative impact is significant, where the need for and availability of large samples exist, and where time and resources are adequate. We just need to get better at leveraging our previous work to de- velop new solutions for today’s challenges through a new lens. The existence of new talent management fads and trends claiming to be the next best thing without the empirical evidence backing them up is nothing new in the business world. Rather, it can be argued that it is more of an artifact of the need for organizations and business professionals to remain competitive in an increasingly crowded global marketplace and keep up with the rapid pace of innovation and new technologies (Dyer & Shafer, 1998). There will always be problems with talent management. We cannot put an end to bad talent management, however, any more than we can get people to stop self-diagnosing and treating medical issues with home remedies they read about on the internet. Instead of embarking on a singular mission to eradicate bad talent management, we suggest we are better off by addressing what we can do to build on these frontier and emerg- ing practices and use their often-innovative foundations to create more ef- fective and less costly practices. Further, we as a profession need to become better at understanding and addressing the bigger issues—the macrolevel trends within which these practices emerge. What “Bigger Issues”? Shifting our attention from a narrow issue like bad talent management prac- tices to broader issues like how societal and macrolevel trends change the way we must approach these practices redirects the issue from the threats in our work itself (on which we are fixating) to the threats from outside our https://www.cambridge.org/core/terms. https://doi.org/10.1017/iop.2018.16 Downloaded from https://www.cambridge.org/core. Carnegie Mellon University, on 06 Apr 2021 at 00:59:11, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms https://doi.org/10.1017/iop.2018.16 https://www.cambridge.org/core 264 joseph a. jones et al. work for which we need to account. Doing so provides a better vantage point of the sources of “the bad” and allows us to step away from our “professional ego.” This is critical for individual and collective success in today’s mod- ern and global workforce in which societies trend away from professional structuralization toward a more self-organizing network of work roles and responsibilities (Susskind & Susskind, 2015). This new perspective also pro- vides us with a broader view of what we can do for business, society, and our profession (Ryan & Ford, 2010). Such a perspective also better positions us for identifying how we train future I-O psychologists (and others) to perform such work. To shift our mindset, we must refrain from looking at talent manage- ment practices—and our approach to those practices—as if they are the key to solving our profession’s existential crisis. We agree with Rotolo et al. (2018) that we need to stop thinking and behaving like either scientists or practi- tioners. Rather, we should be thinking like scientist-practitioners in every- thing that we do (Kurtessis et al., 2017; Lefkowitz, 2008), regardless of what context and setting we find ourselves in. Of key importance to this point is that no matter what we do as I-O psychologists, we must think not only in terms of evidence-based validity of inferences from and about our practices, but of their business and social contexts. This means we should continue building and applying approaches that are scientifically justified, while also increasing our focus on addressing issues of utility (i.e., efficiency) and human impact (Macan & Highhouse, 1994). These are not new issues for I-O psychology, but our profession con- tinues to underassess them. Before we can focus on selective issues relevant to our profession (e.g., bad talent management practices), we must first un- derstand the broader contributing issues, so that we can account for them when approaching the issues so salient to us. It is only through this under- standing that we can begin to focus on how we, individually and as a pro- fession, can ensure the organizations, people, and societies we serve do not struggle or fail. Consider talent acquisition practices as an example. Emerging societal and macrolevel trends like the gig economy, reframing of the employment contract, and the impact of the war for talent have drastically changed the way we source talent today. Perhaps the problem at hand is not “bad” tal- ent management practices, but how these societal and macrolevel trends require a radical change in the way we approach talent acquisition prac- tices. Practices that were effective in yesterday’s world of work might not be today; and if forecasters (e.g., economists, data scientists) continue to be correct in even some of their predictions, they certainly will not be effec- tive tomorrow. Rather, tomorrow’s workplace will continue to be drastically and rapidly changed by macrotrends such as innovations in technology and https://www.cambridge.org/core/terms. https://doi.org/10.1017/iop.2018.16 Downloaded from https://www.cambridge.org/core. Carnegie Mellon University, on 06 Apr 2021 at 00:59:11, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms https://doi.org/10.1017/iop.2018.16 https://www.cambridge.org/core too much scientific rigor in business? 265 artificial intelligence, shifts in the demographic composition of the work- force and global economic power, and increases in urbanization and natural resource scarcity (PricewaterhouseCooper, 2017). What Can We Do? Today’s business landscape demands organizations be both judicious and effective with their time, human capital, and monetary investments. As such, organizations will continually search for and consider new ways of achieving greater return on investment despite the lack of empiri- cal evidence or the I-O profession’s endorsement. To increase I-O psy- chology’s contributions to the business world and to the broader soci- ety, we suggest some additional ideas for each of us to consider as I-O scientist-practitioners. We can continue to reinforce the effectiveness of established prac- tices, support the emergence and expansion of new practices, and serve as the scientist-practitioners who pave the way for practices that are still on the frontier of tomorrow. To do this, we must also validate, debunk, and modify theory and practice, learning throughout the process and ad- vocating for doing things in more effective ways. I-O psychologists must work to enable organizations to separate the “wheat from the chaff,” as Rotolo et al. (2018) argue. We believe a key to doing this successfully is by assessing the effects of macrolevel trends on how organizations and people engage in talent management practices. We suggest that many of these “AIO” talent management practices have evolved out of business’s and society’s need to keep up with and adapt in the face of these soci- etal and macrolevel trends we are still trying to grasp. Consider this our signal that we must evolve and adapt in alignment with the organiza- tions, employees, and stakeholders we serve and the demands they now face. We can leverage Rotolo et al.’s (2018) four-quadrant taxonomy of talent management practices as a guideline from which to identify specific, prac- tical, efficient approaches that I-O psychologists can use in advancing the organizations, people, and societies they serve. Identifying and acting upon ways to help advance organizations within each of the four quadrants is a good foundation, but only with an understanding of how each of those mi- crolevel practices fits in a broader macrolevel framework. It may be useful to view these practices as three continuums—(1) from idea to evidence-based, (2) from frontier to established, and (3) from low value-adding to high value- adding—rather than as four mutually exclusive quadrants. Further, focusing on one place in the continuum does not mean we should stop focusing on others (even if temporarily). We recognize the need for I-O psychology to better “keep up with the Joneses”; however, we must also be careful not to https://www.cambridge.org/core/terms. https://doi.org/10.1017/iop.2018.16 Downloaded from https://www.cambridge.org/core. Carnegie Mellon University, on 06 Apr 2021 at 00:59:11, subject to the Cambridge Core terms of use, available at https://www.cambridge.org/core/terms https://doi.org/10.1017/iop.2018.16 https://www.cambridge.org/core 266 joseph a. jones et al. stagnate progress in other practices that might be more or well-established already. We can accept that I-O psychology is not the only profession capable of conducting sound work and research in the practices we focus on as I- O psychologists. Rather than defaulting to skepticism regarding AIO and “popularist science,” we should adopt a mindset of learning and innova- tion. Maybe some of these practices are not perfect, but can we not in- stead learn what is known thus far, dig in, and find ways to make them better? Organizations are not forced to pursue only one of two mutu- ally exclusive paths in addressing talent management issues. Management does not always oversimplify, underappreciate, or lack understanding. Other professions are not indisputably deficient in expertise compared with I- O psychology. To think that any of these statements is always the case is to miss opportunities to advance talent management practices, organiza- tions, and, by default, the I-O psychology profession. With this in mind, now is the time to seize these opportunities and start collaborating with others. References Dyer, L., & Shafer, R. A. (1998). From human resource strategy to organizational effectiveness: Lessons from research on organizational agility. CAHRS Working Paper Series, 125. Ithaca, NY: Cornell University ILR School. Retrieved from https://digitalcommons.ilr.cornell.edu/cgi/viewcontent. cgi?article=1124&context=cahrswp. Kurtessis, J. N., Waters, S. D., Alonso, A., Jones, J. A., & Oppler, S. H. (2017). Traditional science– practice research in IO: Are we missing the trees for the forest? Industrial and Organizational Psychology: Perspectives on Science and Practice, 10(4), 570–576. Lefkowitz, J. (2008). To prosper, organizational psychology should ... expand the values of organiza- tional psychology to match the quality of its ethics. Journal of Organizational Behavior, 29(4), 439–453. Macan, T. H., & Highhouse, S. (1994). Communicating the utility of human resource activities: A survey of I/O and HR professionals. Journal of Business & Psychology, 8(4), 425–436. Ones, D. S., Kaiser, R. B., Chamorro-Premuzic, T., & Svensson, C. (2017). Has industrial- organizational psychology lost its way? The Industrial-Organizational Psychologist, 55(2). Re- trieved from http://www.siop.org/tip/april17/lostio.aspx. PricewaterhouseCooper (PwC). (2017). Workforce of the future: The competing forces shap- ing 2030. Retrieved from https://www.pwc.com/gx/en/services/people-organisation/ workforce-of-the-future/workforce-of-the-future-the-competing-forces-shaping-2030-pwc. pdf Rotolo, C. T., Church, A. H., Adler, S., Smither, J. W. Colquitt, A. L., Shull, A. C., … & Foster, G. (2018). Putting an end to bad talent management: A call to action for the field of I-O psychology. Industrial and Organizational Psychology: Perspectives on Science and Practice, 11(2), 176–219. Ryan, A. M., & Ford, J. K. (2010). Organizational psychology. Industrial & Organizational Psychology, 3(3), 241–258. doi:10.1111/j.1754-9434.2010.01233.x Sheehan, M., & Anderson, V. (2015, Winter). Talent management and organizational diversity: A call for research. Human Resource Development Quarterly, 26(4), 349–358. doi:10.1002/hrdq.21247. Susskind, R., & Susskind, D. (2015). The future of the professions: How technology will transform the work of human experts. Oxford, UK: Oxford University Press. https://www.cambridge.org/core/terms. https://doi.org/10.1017/iop.2018.16 Downloaded from https://www.cambridge.org/core. Carnegie Mellon University, on 06 Apr 2021 at 00:59:11, subject to the Cambridge Core terms of use, available at https://digitalcommons.ilr.cornell.edu/cgi/viewcontent.cgi?article=1124&context=cahrswp http://www.siop.org/tip/april17/lostio.aspx https://www.pwc.com/gx/en/services/people-organisation/workforce-of-the-future/workforce-of-the-future-the-competing-forces-shaping-2030-pwc.pdf https://doi.org/10.1111/j.1754-9434.2010.01233.x https://doi.org/10.1002/hrdq.21247 https://www.cambridge.org/core/terms https://doi.org/10.1017/iop.2018.16 https://www.cambridge.org/core A Typology of Organizational Psychologists The Pure Scientist The Scientist-Practitioner The Practitioner-Scientist The Pure Practitioner Systemic Pressures Other Barriers to the Scientist-Practitioner Ideal Overreliance on Theory Temporal Mismatch Recommendations 1. Reduce Our Reliance on Theory 2. Improve the Speed of Our Pipelines to Production 3. Change Incentive Structures to Reward a Wider Range of Work Conclusion References References On Loving Theory Organizations as the Needed Level of Analysis On Organizations as Reciprocating Systems Summary References Reference Empathy for Consumers of TM-Related Communication Toward More Leader-Friendly Communication Recommended Actions References Adopt More Action Research Selling I-O Psychology: If You Can’t Beat Them, Join Them For the Sake of What? Humanitarian I-O Psychology Conclusion References References References A Matter of Perspective? What “Bigger Issues”? What Can We Do? References