http://gom.sagepub.com/ Group & Organization Management http://gom.sagepub.com/content/28/4/502 The online version of this article can be found at: DOI: 10.1177/1059601103251234 2003 28: 502Group & Organization Management Maureen L. Ambrose and Joseph G. Rosse Procedural Justice and Personality Testing : An Examination of Concern and Typical Published by: http://www.sagepublications.com can be found at:Group & Organization ManagementAdditional services and information for http://gom.sagepub.com/cgi/alertsEmail Alerts: http://gom.sagepub.com/subscriptionsSubscriptions: http://www.sagepub.com/journalsReprints.navReprints: http://www.sagepub.com/journalsPermissions.navPermissions: http://gom.sagepub.com/content/28/4/502.refs.htmlCitations: at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ http://gom.sagepub.com/content/28/4/502 http://www.sagepublications.com http://gom.sagepub.com/cgi/alerts http://gom.sagepub.com/subscriptions http://www.sagepub.com/journalsReprints.nav http://www.sagepub.com/journalsPermissions.nav http://gom.sagepub.com/content/28/4/502.refs.html http://gom.sagepub.com/ 10.1177/1059601103251234 ArticleGROUP & ORGANIZATION MANAGEMENTAmbrose, Rosse / PROCEDURAL JUSTICE Procedural Justice and Personality Testing AN EXAMINATION OF CONCERN AND TYPICALITY MAUREEN L. AMBROSE University of Central Florida JOSEPH G. ROSSE University of Colorado, Boulder Research in selection examines how organizational justice principles may influence applicants’ reactions to selection procedures. This article extends this research by examining how two aspects of procedures—interpersonal treatment and social comparison information—affect reactions to a personality testing. The results of two studies demonstrate that interpersonal treat- ment (expression of concern for applicants’ feelings) and social comparison information (description of testing as either typical or experimental) interact to affect test-takers’ reactions. When concern was expressed and personality testing was described as typical, individuals responded less positively. However, when no concern was expressed, evaluations were more positive when testing was described as typical. The implications for organizational justice research and selection research are discussed. Keywords: organizational justice; selection; applicant reactions; social comparisons In the past several years, research has examined how justice principles may affect applicant responses to selection procedures (Gilliland, 1993, 1994; Ployhart & Ryan, 1997, 1998; Ployhart, Ryan, & Bennett, 1999; Singer, 1993). This research is particularly relevant in the area of personality testing. The use of personality inventories reveals that applicants often respond nega- tively to such testing. In this study, we examine how perceptions of proce- dural fairness might influence individuals’ affective responses to the use of personality tests for selection purposes. In recent years, organizational researchers have reconsidered the role of personality in employee selection. Reviews and meta-analyses by Barrick and Mount (1991a), Hogan, Hogan, and Roberts (1996), Hough, Dunnette, Group & Organization Management, Vol. 28 No. 4, December 2003 502-526 DOI: 10.1177/1059601103251234 © 2003 Sage Publications 502 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Eaton, and Kamp (1990), Schneider, Hough, & Dunnette (1996), Tett, Jack- son, and Rothstein (1991), and Viswesvaran, Ones, and Schmidt (1992) have established the job-relatedness of various personality facets for various dimensions of job performance. Additionally, several studies have shown that personality inventories provide unique predictive ability independent of other selection methods such as cognitive ability measures (Day & Silverman, 1989; Rosse, Miller, & Barnes, 1991; Schippmann & Prien, 1989) and assessment centers (Goffin, Rothstein, & Johnston, 1996). Despite this body of evidence, a number of obstacles to wider use of per- sonality testing remain. One of the most serious is a lack of acceptance by job applicants. Smither, Reilly, Millsap, Pearlman, and Stoffey (1993) report that managers perceived personality testing to be among the least job related of selection techniques. Research consistently demonstrates that applicants respond less favorably to personality testing than other forms of selection (Jones, 1991; Rosse, Miller, & Stecher, 1994; Rynes & Connerly, 1993; Stone, Stone, & Hyatt, 1989). For example, Stone et al. (1989) found that personality tests were perceived as more invasive of privacy than most typi- cal selection procedures (i.e., application blanks, interviews, work samples, physical and mental ability tests); only background checks, medical exams, drug tests, and honesty tests were seen as more invasive. In a similar study, Jones (1991) found only voice stress analysis, urinalysis, blood tests, polygraphy, and genetic testing to be more unpopular. Paramount among applicants’ concerns is a sense that standardized personality tests are an inva- sion of privacy and that they depersonalize the selection process by reducing one’s complex personal nature to a set of objective scores. It was just this kind of concern that led to the frequently cited Soroka v. Dayton-Hudson case in which the plaintiffs argued that a personality inventory was an undue invasion of privacy. These negative reactions to personality testing are important because research indicates that applicants’ reactions to recruitment and selection pro- cedures influence a variety of important outcomes, including applicants’ atti- tudes toward prospective employers (Macan, Avedon, Paese, & Smith, 1994; Ployhart et al., 1999; Rynes, 1991; Rynes, Bretz, & Gerhart, 1991; Smither et al., 1993, Smither, Millsap, Stoffey, & Reilly, 1996), applicants’ motivation to do well (Arvey, Strickland, Drauden, & Martin, 1990), with- drawal from the applicant pool (Rynes et al., 1991), applicants’ self-efficacy (Gilliland, 1994; Ployhart & Ryan, 1997), lawsuits (Bible, 1990), job choice intentions (Liden & Parsons, 1986; Macan et al., 1994; Schmitt & Coyle, 1976; Turban & Keon, 1993), and loyalty to the employer after having been hired (Crant & Bateman, 1989, 1990; Smither et al., 1996). These negative Ambrose, Rosse / PROCEDURAL JUSTICE 503 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ reactions can be a particular concern for personality inventories because they generally have less face validity than other personnel selection tools. These findings pose a dilemma for proponents of pre-employment per- sonality assessment. Personality tests may provide relevant information that benefits the organization yet may be poorly received by applicants, thereby causing negative organizational consequences. Cropanzano (1994) has described this predicament as the “justice dilemma”—a general trend in which valid personnel selection tools are perceived to violate principles of fairness. Finding a way to enhance applicants’ reactions to personality test- ing could not only reduce the problems we have described but could also pro- vide direct benefits. If applicants feel the selection process is fair, they are more likely to feel good about the organization even if they are not hired (Gilliland, 1994; Ployhart & Ryan, 1998). Because the applicant may be a consumer of the organization’s goods or services, or may be in a position to recommend the firm to other consumers or job searchers, having applicants finish the job search process with a positive impression is a desirable end in itself. Given the importance of perceived justice in a wide variety of other orga- nizational domains (see Cropanzano & Greenberg, 1997, for a review), it is not surprising that researchers have examined the effects of perceived fair- ness in a selection context. Although this selection research replicates many of the justice effects found in other areas, it also reveals some differences. For example, replicating the typical process-by-outcome interaction found in justice literature, Gilliland (1994) found that procedural justice mattered when individuals received unfavorable outcomes, that is, when applicants were rejected. Also consistent with previous justice research, Gilliland found that providing applicants with explanations for their rejection increased posi- tive outcomes, in this case the likelihood that they would recommend the pro- ject to others or apply for a similar project in the future. However, explana- tions did not affect perceptions of procedural fairness and had a negative effect on performance quality for successful applicants—both findings con- trary to justice predictions. In a study of graduate program applicants, Ployhart and Ryan (1997) found that applicants evaluated the selection experience more favorably when they believed the procedures were fair. However, unlike Gilliland (1994) and most justice research, the results were stronger when the appli- cants received a fair outcome than when they received an unfair outcome. In a subsequent longitudinal study, Ployhart and Ryan (1998) examined the effect of positive rule violation (i.e., procedural violations that were advanta- geous to applicants) and perceptions of fairness. They found positive rule 504 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ violation and rule satisfaction (i.e., adherence to procedures) were perceived as equally fair (and more fair than procedural violations that were disadvan- tageous to the applicant). Additionally, positive rule violation and rule satis- faction have similar effects on outcome variables (intentions to recommend the job to others, intention to participate in similar selection procedures in the future). However, Ployhart and Ryan (1998) did not find the traditional pro- cess-by-outcome interaction in this study, either. Rather, applicants’ inten- tions were lowest and their self-perceptions were least favorable when the process was perceived as unfair and the outcome was perceived as fair. Most recently, Ployhart et al. (1999) examined the effect of explanations on individuals’ reactions to selection decisions. They found that explana- tions generally enhanced perceptions of fairness and perceptions of the orga- nization, but the type of information provided and the sensitivity of the expla- nation influenced the magnitude of that effect. Procedural explanations that focused on how the decision was made (e.g., consideration of test scores, work sample) and personal explanations that provided information about the individual’s relative performance on these dimensions were evaluated more favorably than an explanation that focused on the organization’s desire to select a diverse workforce. Sensitivity increased the perceived fairness of all explanations and enhanced perceptions of the organization. However, the diverse workforce justification alone (without a sensitive presentation) resulted in the lowest evaluations—lower than a control group that received no explanation. In general, the research on organizational justice and selection procedures suggests that although justice may provide useful principles for improving the perceived fairness of the selection experience, the application of justice principles to selection procedures is not a straightforward process. In this article, we continue to examine the relationship between selection proce- dures and justice and attempt to understand the complexity of this relation- ship. Specifically, we examine how two variables from the organizational justice literature—interpersonal treatment by the administrator and how typ- ical test use is—may affect applicants’ reactions to personality testing. As described below, we believe that both of these variables play an important role in individuals’ assessments of the fairness of personality testing. The first, interpersonal treatment, has been examined in some previous empirical research on selection and justice (Ployhart & Ryan, 1998). The second, typi- cality, has only received theoretical attention. Our study considers both the independent and interactive effects of these constructs. In addition to increasing our understanding of the perceived fairness of selection, the study also seeks to extend work on interactional justice. Ambrose, Rosse / PROCEDURAL JUSTICE 505 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Previous research on interactional justice has examined the boundary condi- tions for one interactional justice component—the effectiveness of explana- tions (Conlon & Murray, 1996; Conlon & Ross, 1997; Ployhart et al., 1999; Shapiro, Buttner, & Barry, 1994). In this study, we consider boundary condi- tions for interpersonal sensitivity, the other component of interactional jus- tice, and develop competing hypotheses for the effects of interpersonal treat- ment and social comparisons on reactions to personality testing. ORGANIZATIONAL JUSTICE AND PERSONALITY TESTING Early procedural justice research focused on the structural aspects of pro- cedures (e.g., voice opportunities, consistency, opportunity for appeals). Recent research has focused on the “social side” of procedural justice. The distinction between structural and social aspects of procedural justice was first made by Bies and Moag (1986), who used the term interactional justice to capture the quality of interpersonal treatment the target receives from the decision maker. Although there is debate about whether interactional justice is an independent form of organizational justice (Bies, 2001; Cropanzano & Prehar, 1999; Malatesta & Byrne, 1997; Masterson, Lewis, Goldman, & Taylor, 2000; Moye, Masterson, & Bartol, 1997) or if it can be subsumed under the procedural justice umbrella (Brockner & Wiesenfeld, 1996; Cropanzano & Greenberg, 1997; Greenberg, 1993b), researchers agree that interactional justice has two components: procedural explanations (i.e., pro- viding a rationale for why a decision was made) and interpersonal sensitivity (i.e., demonstrating concern for the individual, treating individuals with respect). There is substantial empirical support for the effect of interpersonal treat- ment on individuals’ reactions to procedures. Brockner and Greenberg (1990) found that interpersonal treatment can influence the procedural fair- ness judgments of “survivors” regarding how employees were laid off. Tyler (1988) found interpersonal treatment to be among the most important attrib- utes individuals listed in describing the fairness of their interactions with police. Lind (1992) asked attorneys and litigants to rate the fairness of arbi- tration awards and found that “relational” factors were substantially more important than either structural factors (i.e., decision and process control) or the outcome of the hearing. Greenberg (1993a, 1994) demonstrates that sen- sitive interpersonal treatment increases perceptions of fairness and reduces organizationally dysfunctional behavior (e.g., theft). In the area of selection, interpersonal treatment has also received atten- tion. Gilliland (1993) suggests that interpersonal treatment will directly influence individuals’ perceptions of the fairness of a selection procedure. 506 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Ployhart et al. (1999) varied sensitivity through the personalization and the concern expressed in employment decision letters. They found that increased sensitivity increased the perceived fairness of the selection decision. We sug- gest that these results also apply to personality testing. If the person who administers the test expresses concern about applicants’ feelings that some of the questions may seem very personal, applicants’ concerns may be allevi- ated and their sense of fairness enhanced. Based on this logic, we suggest the following hypothesis: Hypothesis 1: Individuals will react more positively to the use of personality tests for selection when the test administrator expresses concern about the individ- ual’s feelings when the personality inventory is administered than when no concern is expressed. A second feature of the social context that may influence how an individ- ual reacts to personality testing involves social comparison processes. Mastrangelo (1997) suggests that negative applicant reactions to invasive selection procedures may dissipate as these procedures become more com- mon in organizations. Under these conditions, individuals will come to expect the use of these techniques and will view them as acceptable. Thus, social comparisons are expected to affect the perceived fairness of personal- ity testing. Substantial research demonstrates the importance of social comparisons for distributive justice judgments (Adams, 1965; Goodman, 1974; Green- berg, 1988). However, only two studies have directly tested the impact of social comparisons on judgments of procedural justice. Both demonstrate that individuals use social comparisons to determine the fairness of the pro- cedures to which they are subjected (Ambrose, Harland, & Kulik, 1991; Grienberger, Rutte, & van Knippenberg, 1997). Ambrose et al. (1991) suggest that social comparisons are particularly important when there is ambiguity about the appropriate evaluation of a pro- cedure (e.g., the procedure is novel or multiple alternative procedures exist). For most individuals, the use of personality tests as part of selection is a novel experience. Therefore, applicants may use information regarding whether or not other individuals in similar settings are subject to such testing in deter- mining the fairness of the procedure. Therefore, we suggest the following hypothesis: Hypothesis 2: Individuals will react more positively to the use of personality tests for selection when they are told that personality testing is typical than when it is presented as experimental. Ambrose, Rosse / PROCEDURAL JUSTICE 507 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ It is tempting to suggest that all an organization need do to overcome per- ceptions of unfairness during the selection process is to show applicants that they are concerned about them or to defend the personality testing as a com- mon practice that many applicants experience. However, interpersonal sen- sitivity is a complex construct. For example, in the Greenberg (1993a, 1994) studies, the decision maker both acknowledged that the decision will cause or has caused the target discomfort and expressed concern or sympathy about the discomfort. In Greenberg’s (1993a, 1994) cases, there was little ambigu- ity in individuals’ minds about the favorableness of the decisions (either to reduce pay or to impose a ban on smoking). In contrast, with personality test- ing there is considerably more ambiguity inasmuch as most applicants have limited knowledge of what a personality test involves. In this circumstance, having an organizational representative express concern prior to taking the test could backfire by implying that the test administrator believes there is a reason to be concerned. How individuals react to an expression of concern may be influenced by other information they have about the testing procedure. There is a possibil- ity that expressions of concern and social comparison information may inter- act. If testing is described as typical and the administrator demonstrates that he or she is concerned about the applicant’s feelings prior to administering the test, this may be perceived as an acknowledgment that he or she knows that the test will make applicants uncomfortable but requires them to take the test anyway. The administrator may be perceived as disregarding the inter- ests of the applicants. Thus, concern in conjunction with social comparison information may cause individuals to respond more negatively. Rather than main effects, we may see an interaction between concern and typicality. We suggest as an alternative to Hypothesis 1 and Hypothesis 2 the following: Hypothesis 3: Individuals will respond more negatively when the test administra- tor expresses concern and testing is described as typical than when the admin- istrator expresses concern and the testing is described as experimental. Our final hypothesis stems from Lind’s (1995; Lind, Kulik, Ambrose, & deVera, 1993) proposal that the manner in which a person is treated creates a global impression about the person or organization administering the treatment—a fairness heuristic. This global impression operates as a cogni- tive shortcut for individuals to form opinions and expectations about how the decision maker will treat one in the future. Based on this work, we predict the following: 508 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Hypothesis 4: Individuals’ reactions to the personality testing procedure will gen- eralize to reactions to the organization in general. In designing a study to test these hypotheses, we sought to overcome two disadvantages of many studies of applicant reactions to personality tests. The first limitation is asking respondents to describe their reactions to a proce- dure they have never actually experienced, such as asking people how they think they’d react if asked to complete a personality inventory. Kravitz, Stinson, and Chavez (1994) found that reactions of individuals who had not experienced various selection procedures were significantly different from those who had. The second design factor was to create a situation in which respondents believe that the results of the personality inventory would actu- ally be used as part of a decision that is important to them. STUDY 1 METHOD Participants. Seventy students in an MBA program at a large western uni- versity participated in the study. Except for students who were absent, this constituted the entire 1st-year class. Forty-nine of the students were male. On average, the participants were 27 years old and had 4.3 years of full-time work experience. Design. The study was a 2 (typicality: typical vs. experimental) × 2 (con- cern: concern vs. no concern) factorial design. Both manipulations were between-subjects factors. Stimulus materials and procedures. An important consideration in designing this experiment was to ensure that participants took seriously the process of completing the personality inventory. Unless the process seemed realistic and included salient consequences, the generalizability of our results to job applicants would be suspect. To accomplish this objective, a representative of the MBA program office administered all questionnaires. The 35-year-old male representative told the participants that their scores on the personality inventory would be one of the factors that would decide who would receive summer internships. Internships were regarded as extremely valuable. The MBA program was designed such that students would do a summer internship after their 1st year. Ambrose, Rosse / PROCEDURAL JUSTICE 509 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ At the time of this study, there were substantially more students seeking internships than there were internships available. Additionally, as the MBA program was a full-time, lock-step day program, none of the students were currently employed on a full-time basis. Part-time work was also dis- couraged while students were in the program. This increased the importance of obtaining a summer internship. The personality inventory was administered during class time in one of the required MBA courses. (The MBA program is lock-stepped, so that all students were randomly assigned to one of two sections of the course.) At the end of the session, the students were completely debriefed; comments by stu- dents during the debriefing confirmed that they believed that their scores on the personality measure would affect their chances of receiving an intern- ship. Because internships are regarded as valuable and difficult to obtain, their test performance was salient to them. The personality measure used was the Personal Characteristics Inventory (PCI). This inventory has been developed as a measure of the Big 5 personal- ity dimensions that is well suited for employment selection purposes. It con- sists of 172 agree/disagree questions; test items were specifically designed to enhance face validity for employment decisions. Information on its develop- ment and psychometric properties can be found in Barrick and Mount (1991b). The concern manipulation occurred during the introduction of the PCI. Our manipulation is similar to that used by Greenberg (1993a, 1994) and Ployhart et al. (1999). It both acknowledged a (potential) problem and expressed sympathy for the test takers. In the concerned condition, in one of the two sections of the course, the individual administering the PCI acknowl- edged that some of the questions might seem personal and expressed concern about causing the participants to feel uncomfortable. The other course sec- tion served as the no concern condition. In the no concern condition, no acknowledgment or concern was expressed. Typicality was manipulated in the written instructions to the PCI. In the typical condition, the cover sheet to the PCI informed participants that the MBA program was “following the lead of other Big Twelve and Big Ten institutions by using a personality inventory as part of the internship screen- ing process.” In the experimental condition, participants were told that the use of the personality inventory as part of the internship screening process was experimental. The typicality manipulation was randomly distributed in each class. Thus, the participants were nearly equally distributed across con- ditions (n = 18, 14, 19, 19 for the concern-typical, concern-experimental, no concern-typical, no concern-experimental conditions, respectively). 510 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ After students completed the PCI (and before they were debriefed), the representative from the MBA office asked them to complete a second ques- tionnaire. This questionnaire was described as an opinion survey that assessed attitudes about a wide range of topics related to the MBA program. Because they were the first class in a radically revised MBA curriculum, being asked to complete such a survey did not seem unusual to them; in fact, they had completed a similar survey a few months earlier. In addition to “filler” items intended to disguise its purpose, the survey contained several 7- point Likert-type scales that served as dependent measures for this study. After completing the survey, students were debriefed. Dependent measures and manipulation checks. To assess reactions to testing, we assessed three aspects of the procedure: perceptions of interper- sonal treatment (how fairly they were treated by the test administrator and how satisfied they were with the test administrator’s treatment), perceptions of the internship selection procedure (how fair the internship selection proce- dure was and how satisfied they were with the procedure by which intern- ships are determined), and perceptions of the test (how fair the personality test was). Participants rated each of these items on a 7-point Likert-type scale (1 = very unfair or very dissatisfied; 7 = very fair or very satisfied). We com- bined these three aspects to form a scale that assessed reactions to the testing procedure (coefficient alpha = .64). The participants also responded to 11 items that rated their satisfaction with features of the MBA program (e.g., orientation, program administra- tion, faculty, courses, student groups). These items were combined to form the satisfaction with the MBA program scale (coefficient alpha = .78). The opinion survey also contained a manipulation check for concern. Par- ticipants rated whether the administrator had acknowledged the personal nature of the inventory and how concerned about them the test administrator had been. RESULTS Descriptive statistics are reported in Table 1. The correlation between reactions to testing and satisfaction with the MBA program was significant (r = .46, p < .01). T tests were conducted on the acknowledgment and concern items designed to assess the concern manipulation. An examination of the means for the acknowledgment item indicates that participants noted that the test Ambrose, Rosse / PROCEDURAL JUSTICE 511 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ administrator acknowledged the personal nature of the test items. In the con- cern condition, the mean (M = 6.63) was significantly higher than in the no concern condition (M = 1.95), t(65) = –17.32, p < .001. The second manipu- lation check item, asking if the test administrator had seemed concerned about them, also showed significant differences between the two groups, t(64) = –2.22, p < .05. Respondents in the concern condition rated the test administrator as significantly more concerned (M = 3.90) than respondents in the no concern condition (M = 3.00). Hypotheses 1 and 2 predicted main effects for the concern and typicality variables on reactions to the personality testing. Hypothesis 3 suggested these variables would interact. Analysis of variance revealed no main effects for either of the independent variables. (For reactions to the procedure, F[1,37] = 1.60 and 1.27 for concern and typicality, respectively. For satisfaction with the MBA program, F[1,57] = .60 and .25 for concern and typicality.) However, a consistent and meaningful pattern of interactions did emerge, supporting both Hypothesis 3 and Hypothesis 4. Significant interactions were found for participants’ reactions to the procedure, F(1,37) = 4.20, p < .05, and satisfaction with the MBA program, F(1,57) = 4.84, p < .05. Cell means for the interactions are in Table 2 and the interactions are plot- ted in Figure 1. The pattern of ratings for the interactions was the same for each variable. As predicted in Hypothesis 3, when the administrator 512 GROUP & ORGANIZATION MANAGEMENT TABLE 1 Descriptive Statistics for Study 1 and Study 2 Study 1 Study 2 M SD M SD Reactions to testing 4.42 1.11 5.02 0.77 Satisfaction with MBA program 5.05 0.69 5.40 0.60 TABLE 2 Study 1: Cell Means for Significant Interactions Typical Experimental Reaction to testing process Neutral 4.85 4.51 Concern 3.63 4.80 Satisfaction with MBA program Neutral 5.27 4.97 Concern 4.75 5.22 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ expressed concern and the personality inventory was described as typical, applicants perceived the procedure as less fair than when the administrator expressed concern and the testing was described as experimental. In the no concern condition, testing described as typical was judged more favorably for reactions to testing than testing described as experimental. A similar pat- tern emerged for satisfaction with the MBA program. DISCUSSION These results suggest that concern and information about typicality do affect individuals’ reactions to the use of a personality test in selection. Ambrose, Rosse / PROCEDURAL JUSTICE 513 Figure 1: Mean Levels of Participants’ Reactions for No Concern and Concerned Con- ditions (Study 1) at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ However, rather than main effects, the analyses revealed a consistent pattern of interactions in which expressions of concern had no effects when testing was described as experimental but negatively affected reactions when the testing was described as typical. Previous research in organizational justice demonstrates that the expres- sion of concern increases the perceived fairness of the procedure (Greenberg, 1993a, 1994). However, when paired with information that suggested the administrator knew the likely effect of the procedure, expressions of concern appear to send a message that the test administrator is actually less sensitive to applicants, requiring them to complete the personality inventory despite the awareness that its content will make them uncomfortable. These results are consistent with the Ambrose et al. (1991) study, in which participants seemed to use the procedural information and social comparison information together to make attributions about the decision maker’s behav- ior. These attributions then colored their perceptions of fairness. A similar process appears to occur in the current study. When both pieces of informa- tion suggest the administrator is disregarding the participants’ interests (acknowledges the potential problem [concern], has information demon- strating there is a problem [typicality], and ignores it), participants respond negatively. When the information suggests the administrator is sensitive to their interests (acknowledges the potential problem [concern] but may not have sufficient information to be sure [experimental]), participants respond more positively. Results of Study 1 support our suggested interactive effect of concern and typicality. However, an examination of the absolute magnitude of the con- cern manipulation suggests that although statistically significant, respon- dents may not have perceived the MBA representative as having been very concerned about them. Individuals in the concern condition reported the rep- resentative was more concerned than in the no concern condition (M = 3.9 and 3.0, respectively). However, the representative was rated at about the midpoint on the scale. Thus, Study 1 may represent a weak expression of concern. It may be that a stronger expression of concern would eliminate the interactive effect we predict. To assess this possibility, we replicated the study strengthening our manipulation of concern. STUDY 2 The method for Study 2 was essentially the same as that used in Study 1, except that we employed a stronger manipulation of concern. The results 514 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ from Study 1 suggest our speculation about the interactive effects of concern and typicality was correct. Thus, in Study 2 we predict only an interaction for typicality and concern. We suggest the following hypothesis: Hypothesis 1: Individuals will respond more negatively when the test administra- tor expresses concern, and the testing is described as typical than when the administrator expresses concern and the testing is described as experimental. When the administrator expresses no concern, individuals will respond more positively when the testing is described as typical than when it is described as experimental. Additionally, based on the work by Lind (1995; Lind et al., 1993) on the fairness heuristic and the results of Study 1, we suggest the following: Hypothesis 2: Individuals’ responses to the personality testing procedure will gen- eralize to perceptions of fairness and to judgments of satisfaction with the employer in general. METHOD Participants. Sixty-nine students in an MBA program at a large western university participated in the study. Forty-six of the students were male. On average, the participants were 27 years old and had 4.3 years of full-time work experience. Except for students who were absent, this comprised the 1st-year MBA class for the year following Study 1. Design. The study was a 2 (typicality: typical vs. experimental) × 2 (concern: concern vs. no concern) factorial design. Both manipulations were between- subjects factors. Stimulus materials and procedures. As in Study 1, participants were told that the personality test would be used in selecting individuals for summer internships. A representative of the MBA office administered all question- naires 2 days before a widely publicized session for the 1st-year MBAs on the summer internship program. Once again, the personality inventory was administered during class time in one of the required MBA courses. As in Study 1, the students were completely debriefed at the end of the session. Because of the lock-step nature of the MBA program, there is very limited interaction between the 1st- and 2nd-year students; thus, there is little chance that the MBA class in Study 1 discussed their previous experience with the new class. Comments by students during the debriefing confirmed that they believed that their scores on the personality measure would affect their Ambrose, Rosse / PROCEDURAL JUSTICE 515 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ chances of receiving an internship and that they had no prior knowledge about the study. The concern manipulation occurred during the introduction of the PCI. In one of the two course sections, the individual administering the PCI acknowledged that some of the questions might seem personal and apolo- gized about causing the participants to feel uncomfortable. Although the wording of the acknowledgment was similar to Study 1, for this study the test administrator repeated the apology and stressed concern for the students. This course section served as the concern condition. The other course section served as the no concern condition. In the no concern condition, no acknowl- edgment or concern was expressed. The typicality manipulation was identi- cal to that in Study 1. Again, the participants were nearly equally distributed across conditions (n = 18, 16, 16, 19 for the concern-typical, concern-experi- mental, no concern-typical, no concern-experimental conditions, respec- tively). After students completed the PCI, the representative from the MBA office asked them to complete a second questionnaire. This questionnaire was described as an opinion survey that assessed attitudes about a wide range of topics related to the MBA program. This MBA class was the second class of the new MBA program. This class was not as widely surveyed as the first class, but they had completed several similar surveys. None of the students expressed any suspicion about the opinion survey. Dependent measures and manipulation checks. The questionnaire con- tained the same items used in Study 1. Respondents rated their reactions to testing (coefficient alpha = .58) and satisfaction with the MBA program (coefficient alpha = .67). RESULTS Descriptive statistics are reported in Table 1. The correlation between reactions to testing and satisfaction with the MBA program was significant (r = .49, p < .01). T tests were conducted on the acknowledgment and concern items designed to assess the concern manipulation. An examination of the means for the acknowledgment item indicates that participants did note that the test administrator acknowledged the personal nature of the test items. In the con- cern condition the mean (M = 6.74) was significantly higher than in the no concern condition (M = 2.63) , t(65) = –12.10, p < .001. The second manipulation check item, asking if the test administrator had seemed concerned about them, also showed significant differences between the two groups, t(63) = –5.80, p < .001. Unlike Study 1, participants in the 516 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ concern condition had substantially higher mean scores (M = 5.47) than those in the no concern condition (M = 3.20).1 We expected the concern and typicality variables to interact to affect reac- tions to the personality testing and that these effects would generalize to the measure of satisfaction with the MBA program. As predicted, ANOVAs revealed a consistent pattern of interactions. Additionally, an unexpected main effect was found. Typicality had a main effect for satisfaction with the MBA program, F(1,58) = 3.81, p < .05. Participants were more satisfied with the MBA program when testing was described as typical (M = 5.57) than when it was described as experimental (M = 5.26). However, these main effects must be considered in the context of the significant interactions. The analyses revealed significant interactions for reactions to testing, F(1,58) = 4.67, and satisfaction with the MBA program, F(1,58) = 4.95, p < .05. Cell means for the interactions are shown in Table 3. The interactions are depicted graphically in Figure 2. The pattern of means is as predicted. Indi- viduals in the concern-typical condition provided lower ratings than individ- uals in the concern-experimental condition. Individuals in the no concern- typical condition provided higher ratings than individuals in the no concern- experimental condition. However, although the pattern is as predicted, planned comparisons revealed that the means in the concern conditions were only marginally significantly different from one another for reaction to test- ing and not significantly different from one another for satisfaction with the MBA program. In contrast, the means in the no concern condition were sig- nificantly different for satisfaction with the MBA program but not for reac- tions to testing. DISCUSSION Study 2 was designed to examine if the interactive effect of concern and typicality that were revealed in Study 1 persisted when there was a stronger Ambrose, Rosse / PROCEDURAL JUSTICE 517 TABLE 3 Study 2: Cell Means for Significant Interactions Typical Experimental Reaction to testing process No concern 5.17 4.85 Concern 4.73 5.50 Satisfaction with MBA program No concern 5.63 5.03 Concern 5.50 5.54 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ expression of concern. A clear pattern of interactions was found in both studies. Consistent with our predictions, individuals in the concern-typical condition generally reported more negative reactions than individuals in the concern-experimental condition. Individuals in the no concern-typical condition reported more positive reactions than individuals in the no concern- experimental condition. An examination of these interactions across both studies shows mostly similarities. For both the weak and strong expressions of concern, the typical condition received less positive ratings than the experimental condition. The 518 GROUP & ORGANIZATION MANAGEMENT Figure 2: Mean Levels of Participants’ Reactions for No Concern and Concerned Con- ditions (Study 2) at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ primary difference lies in the interactions for satisfaction with the MBA pro- gram. Here there is little difference between the concern-typical and con- cern-experimental condition. Thus, we might speculate that with a stronger expression of concern, the negative affect associated with a specific proce- dure is less likely to generalize to other aspects of the organization. In general, these results are consistent with Greenberg and McCarty’s (1990) and Conlon and Ross’s (1997) findings. Individuals respond more negatively when a decision maker acknowledges a problem but apparently intends to take no action to change the situation. CONCLUSION We began doing research in this area because we were interested in how justice principles might affect applicants’ reactions to personality testing. Our results show that application of procedural justice theories may be useful in this regard, but they also underscore the complexity involved in under- standing individuals’ reactions to procedures. Much research to date sug- gests a straightforward relationship between concern and positive reactions to procedures. Our results suggest that the manner and context in which con- cern is conveyed plays an important role in how it is received. The consistent pattern of interactions suggests that under some condi- tions, concern may result in lower ratings of fairness than no expression of concern. Study 2 revealed that a strong expression of concern can increase the relative perceptions of fairness (M = 4.42 for Study 1, 5.02 for Study 2). However, in both studies, when the procedure is described as typical, acknowledging and apologizing for the invasiveness of the test led to less favorable reactions to testing. Most of the research on applicant responses to personality testing has not studied reactions of actual applicants who complete a personality inventory they believe will be used to make selection decisions. One of the strengths of our studies is that they assess the reactions of individuals who have both com- pleted the personality inventory and believe it will be used for selection pur- poses. This is particularly important because research on applicant reaction demonstrates that responses differ between individuals who have had experi- ence with the procedures used in selection and those who have not experi- enced the procedures (Kravitz et al., 1994). We also assessed perceptions of fairness prior to any information about outcomes being provided. Much research on selection assesses perceived fairness following selection deci- sions. However, as Ployhart and Ryan (1998) demonstrate, the relationship between procedural fairness and distributive fairness in selection is complex Ambrose, Rosse / PROCEDURAL JUSTICE 519 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ and it is useful to consider perceptions of fairness at multiple times in the selection process. Prehire procedural fairness can affect applicants’ decision to remain in the applicant pool. Of course, there are a number of limitations to this study. First, for each experiment we collected our data in a single session. Lind’s (1992) discus- sion of the fairness heuristic describes an ongoing effect on organizational interactions. We were unable to assess the long-term impact of the effect we see in our study. Additionally, our sample size is relatively small and although our participants believed their scores would be used as part of the internship selection procedure, the process was not the same as it would be in job selection. We also note that the reliability for our reaction to testing mea- sure is somewhat lower than is desirable. Low reliabilities can make effects more difficult to detect; they also indicate the measure is less precise than it might be. We also did not have a manipulation check for typicality. The results suggest that this manipulation was effective, as a coherent pattern of differences exists. But we do not know for certain that all individuals were cognizant of this manipulation. Again, this could affect the strength of our results. Finally, although a strong and consistent pattern of interactions was demonstrated in Study 1, the differences between the means were not always significant. We have speculated about the patterns. However, caution is required in the interpretation of the effects. Nonetheless, we believe these studies make two important contributions. First, in terms of organizational justice, the studies suggest important bound- ary conditions for the effectiveness of expressions of concern. One boundary condition may have to do with the evaluative ambiguity of a procedure or decision about to be experienced. Being told that you are being laid off or given a pay cut is pretty clearly unfavorable for most employees, and prior studies show that expressions of concern by the decision maker seem to soften the blow of such outcomes. But our results show that expressions of concern may have the opposite effect when outcome favorability is ambigu- ous. This is a finding deserving of replication in other settings. A second boundary condition for concern suggested by our data relates to weak expressions of concern. Across all conditions in both studies, the most negative reactions by far occurred when the test administrator acknowledged that people might not like the test but was perceived as not really caring that they felt that way (i.e., the concern-typical condition in Study 1). Procedural justice researchers have noted that the decision maker’s consideration and concern must be perceived as sincere to enhance the perceived fairness of procedures (Bies, 1987; Bies & Moag, 1986; Greenberg & Ornstein, 1983; Tyler & Bies, 1989). Our results are also consistent with those of Baron (1985, 1988), who demonstrated that when individuals perceived an 520 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ opponent’s external attributions to be insincere, they respond more nega- tively to their opponent and intend to behave less constructively in future interactions with their opponent than when a sincere attribution is made. Similarly, Greenberg and McCarty (1990) note that apologies may actu- ally serve to anger individuals when there is no indication that the individual apologizing plans to take action to change the situation for which he or she is apologizing. This is consistent with our results and the situation our partici- pants experienced. The pairing of typicality with our manipulation of con- cern created a condition in which it was clear individuals were expected to endure personality testing even though the administrator knew it might make them uncomfortable. A “hollow” apology with no attempt to remedy the situ- ation served to increase dissatisfaction with the process. As Greenberg (1995) noted, applications of organizational justice to dif- ferent contexts help us to refine the theory and learn about its generality. Pre- vious research has identified some of the boundary conditions for explana- tions; we recommend more consideration of these boundary conditions for expressions of concern. What is particularly challenging about research on concern is that individuals’ perceptions are likely to be influenced not only by what an individual says or does but by the manner in which the statement or action is made. Vocal tone, facial expressions, posture, and other para- linguistic cues may be subtle yet important influences on individuals’ per- ceptions of concern. From a selection perspective, the results demonstrate the importance of considering how individuals’ perceptions of the fairness of personality test- ing may influence their reactions to organizations. Both studies demon- strated that attributes of the testing procedure not only affected reactions to the procedure itself but also generalized to perceptions of other aspects of the organization. As recent legal action demonstrates, the use of personality tests can create dissatisfaction in applicants. Moreover, both selection research (Bible, 1990) and justice research (Bies & Tyler, 1993; Lind, 1997) demon- strates that individuals’ reactions to procedures influences the likelihood that they will undertake litigation. If the perceived unfairness of personality test- ing generalizes to other aspects of the organization, it raises the possibility that the problem may be doubly explosive, perhaps influencing individuals’ propensity to sue for other organizational actions. Our finding that individuals’ perceptions of fairness generalize to the organization may be particularly important in the context of selection because individuals’ views have both short-term (e.g., acceptance of a job offer) and long-term (e.g., commitment) implications. Organizational researchers have only begun to explore the range of procedural, contextual, Ambrose, Rosse / PROCEDURAL JUSTICE 521 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ and interactional factors that may affect reactions to personality testing and other employment procedures. For selection research, as evidence accumu- lates that personality assessment and other controversial procedures can play an important role in personnel selection, it becomes essential to isolate the key factors that influence their acceptability to applicants. This study is one step in increasing our understanding of how principles of justice can improve the acceptability of such procedures. NOTE 1. The means for the manipulation checks and dependent measures are slightly higher in Study 2 than Study 1. For the dependent measures, this is not surprising if the stronger manipula- tion of concern resulted in higher perceptions of fairness and satisfaction. However, to ensure that the participants in Study 2 were not simply more favorable than those in Study 1, we con- ducted t tests between the no concern conditions for the manipulations and dependent measures. These conditions should be equivalent. The t tests indicate that there are not significant differ- ences for acknowledging the personal nature of the items, t(53) = 1.77, for concern, t(64) = .54, reactions to testing, t(41) = 1.39, or satisfaction with the MBA program, t(68) = –.19). This find- ing, combined with the other similarities between the samples for the two studies suggests the groups are comparable. REFERENCES Adams, J. S. (1965). Inequity in social exchanges. In L. Berkowitz (Ed.), Advances in experi- mental social psychology (Vol. 2, pp. 267-300). New York: Academic Press. Ambrose, M. L., Harland, L. K., & Kulik, C. T. (1991). Influence of social comparisons on per- ceptions of organizational fairness. Journal of Applied Psychology, 76, 239-246. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test taking. Personnel Psychology, 43, 695-716. Baron, R. A. (1985). Reducing organizational conflict. Journal of Applied Psychology, 70, 434- 441. Baron, R. A. (1988). Attributions and organizational conflict: The mediating role of apparent sincerity. Organizational Behavior and Human Decision Processes, 41, 111-127. Barrick, M. A., & Mount, M. K. (1991a). The big five personality dimensions and job perfor- mance: A meta-analysis. Personnel Psychology, 44, 1-26. Barrick, M. R., & Mount, M. K. (1991b). The Personal Characteristics Inventory. Unpublished manuscript. Bible, J. D. (1990). When employers look for things other than drugs: The legality of AIDS, genetic, intelligence, and honesty testing in the workplace. Labor Law Journal, 41, 195-213. Bies, R. J. (1987). Beyond “voice”: The influence of decision-maker justification and sincerity on procedural fairness judgments. Representative Research in Social Psychology, 17, 3-14. Bies, R. J. (2001). Interactional (in)justice: The sacred and the profane. In J. Greenberg & R. Cropanzano (Eds.), Advances in organizational justice (pp. 89-118). Lexington, MA: New Lexington Press. 522 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Bies, R. J., & Moag, J. (1986). Interactional justice: Communication criteria of effectiveness. In R. Lewicki, B. Sheppard & M.Bazerman (Eds.), Research on negotiation in organizations (Vol. 1, pp. 43-55). Greenwich, CT: JAI Press. Bies, R. J., & Tyler, T. R. (1993). The “litigation mentality” in organizations: A test if alternative psychological explanations. Organization Science, 4, 352-366. Brockner, J., & Greenberg, J. (1990). The impact of layoffs on survivors: An organizational jus- tice perspective. In J.S. Carroll (Ed.), Applied social psychology and organizational settings (pp.45-74). Hillsdale, NJ: Lawrence Erlbaum. Brockner, J., & Wiesenfeld, B. M. (1996). An integrative framework for explaining reactions to decisions: The interactive effects of outcomes and procedures. Psychological Bulletin, 120, 189-208. Conlon, D. E., & Murray, N. M. (1996). Customer perceptions of corporate responses to product complaints: The role of explanations. Academy of Management Journal, 39, 1040-1056. Conlon, D. E., & Ross, W. H. (1997). Appearances do count: The effects of outcomes and expla- nations on disputant fairness judgments and supervisory evaluations. International Journal of Conflict Management, 8, 5-31. Crant, J. M., & Bateman, T. S. (1989). A model of employee responses to drug-testing programs. Employee Responsibilities and Rights Journal, 2, 173-190. Crant, J. M., & Bateman, T. S. (1990). An experimental test of the impact of drug-testing pro- grams on potential job applicants’ attitudes and intentions. Journal of Applied Psychology, 75, 127-131. Cropanzano, R. (1994). The justice dilemma in employee selection: Some reflections on the trade-offs between fairness and validity. Industrial/Organizational Psychologist, 31, 90-93. Cropanzano, R., & Greenberg, J. (1997). Progress in organizational justice: Tunneling through the maze. In L. T. Robertson & C. L. Cooper (Eds.), International review of industrial and organizational psychology (pp. 317-372). New York: John Wiley. Cropanzano, R., & Prehar, C. A. (1999, April). Using social exchange theory to distinguish pro- cedural and interactional justice. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, Atlanta, GA. Day, D. V., & Silverman, S. B. (1989). Personality and job performance: Evidence of incremen- tal validity. Personnel Psychology, 42, 25-36. Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18, 694-734. Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691-701. Goffin, R. D., Rothstein, M. G., & Johnston, N. G. (1996). Personality testing and the assessment center: Incremental validity for managerial selection. Journal of Applied Psychology, 81, 746-756. Goodman, P. S. (1974). An examination of referents used in the evaluation of pay. Organiza- tional Behavior and Human Decision Processes, 12, 170-195. Greenberg, J. (1988). Equity and workplace status: A field experiment. Journal of Applied Psy- chology, 73, 606-613. Greenberg, J. (1993a). Stealing in the name of justice: Informational and interpersonal modera- tors of theft reactions to underpayment inequity. Organizational Behavior and Human Deci- sion Processes, 54, 81-103. Greenberg, J. (1993b). The social side of fairness: Interpersonal and informational classes of organizational justice. In R. Cropanzano (Ed.), Justice in the workplace: Approaching fair- ness in human resource management (pp. 79-103). Hillsdale, NJ: Lawrence Erlbaum. Ambrose, Rosse / PROCEDURAL JUSTICE 523 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Greenberg, J. (1994). Using socially fair treatment to promote acceptance of a work site smoking ban. Journal of Applied Psychology, 79, 288-297. Greenberg, J. (1995). The quest for justice on the job. Thousand Oaks, CA: Sage. Greenberg, J., & McCarty, C. L. (1990). Comparable worth: A matter of justice. In G. R. Ferris & K. M. Rowland (Eds.), Research in personnel and human resources management (Vol. 8, pp. 265-301). Greenwich, CT: JAI. Greenberg, J., & Ornstein, S. (1983). High status job title as compensation for underpayment: A test of equity theory. Journal of Applied Psychology, 68, 285-297. Grienberger, I. V., Rutte, C. G., & van Knippenberg, A. F. M. (1997). Influence of social compar- isons of outcomes and procedures on fairness judgments. Journal of Applied Psychology, 82, 913-919. Hogan, R., Hogan, J., & Roberts, B. W. (1996). Personality measurement and employment deci- sions: Questions and answers. American Psychologist, 51, 469-477. Hough, L. M., Dunnette, M. D., Eaton, N. K., & Kamp, J. D. (1990). Criterion-related validities of personality constructs and the effect of response distortions on those validities. Journal of Applied Psychology, 75, 581-595. Jones, J. (1991, April). Protecting job applicants’ and employees’ privacy rights: The employee’s perspective. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, St. Louis, MO. Kravitz, D. A., Stinson, V., & Chavez, T. L. (1994, April). Perceived fairness of tests used in making selection and promotion decisions. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, Nashville, TN. Liden, R. C., & Parsons, C. K. (1986). A field study of job applicant interview perceptions, alter- native opportunities, and demographic characteristics. Personnel Psychology, 39, 109-122. Lind, E. A. (1992, March). The fairness heuristic: Rationality and “relationality” in procedural evaluations. Paper presented at the 4th International Conference of the Society for the Advancement of Socio-Economics, Irvine, CA. Lind, E. A. (1995). Justice and authority relations in organizations. In R. S. Cropanzano & K. M. Kacmar (Eds.), Organizational politics, justice, and support (pp. 83-96). Westport, CT: Quorum. Lind, E. A. (1997). Litigation and claiming in organizations: Antisocial behavior or quest for jus- tice? In R. A. Giacalone & J. Greenberg (Eds.), Antisocial behavior in organizations (150- 171). Thousand Oaks, CA: Sage. Lind, E. A., Kulik, C. T., Ambrose, M. L., & deVera, M. V. (1993). Individual and corporate dis- pute resolution: Using procedural fairness as a decision heuristic. Administrative Science Quarterly, 38, 224-251. Macan, T. H., Avedon, M. J., Paese, M., & Smith, D. E. (1994). The effects of applicants’ reac- tions to cognitive ability tests and an assessment center. Personnel Psychology, 47, 715-738. Malatesta, R. M., & Byrne, Z. S. (1997, April). The impact of formal and interactional justice on organizational outcomes. Poster session presented for the 12th annual conference of the Society for Industrial and Organizational Psychology, St. Louis, MO. Masterson, S. S., Lewis, K., Goldman, B. M., & Taylor, M. S. (2000). Integrating justice and social exchange: The differing effects of fair procedures and treatment on work relation- ships. Academy of Management Journal, 43, 738-748. Mastrangelo, P. M. (1997). Do college students still prefer companies without employment drug testing? Journal of Business and Psychology, 11, 325-337. Moye, N. A., Masterson, S. S., & Bartol, K. M. (1997, August). Differentiating antecedents and consequences of procedural and interactional justice: Empirical evidence in support of 524 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ separate constructs. Paper presented at the National Academy of Management Meetings, Boston, MA. Ployhart, R. E., & Ryan, A. M. (1997). Toward an explanation of applicant reactions: An exami- nation of organizational justice and attribution frameworks. Organizational Behavior and Human Decision Processes, 72, 308-335. Ployhart, R. E., & Ryan, A. M. (1998). Applicants’ reactions to the fairness of selection proce- dures: The effects of positive rule violations and time of measurement. Journal of Applied Psychology, 83, 3-16. Ployhart, R. E., Ryan, A. M., & Bennett, M. (1999). Explanations for selection decisions: Appli- cants’ reactions to informational and sensitivity features of explanations. Journal of Applied Psychology, 84, 87-106. Rosse, J., Miller, H. E., & Barnes, L. (1991). Combining personality and cognitive ability predic- tors for hiring service-oriented employees. Journal of Business and Psychology, 5, 431-445. Rosse, J., Miller, J. L., & Stecher, M. D. (1994). A field study of job applicants’ reactions to per- sonality and cognitive ability testing. Journal of Applied Psychology, 79, 987-992. Rynes, S. (1991). Recruitment, job choice and post-hire consequences: A call for new research directions. In M. Dunnette & L. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 2, 2nd ed.). Palo Alto, CA: Consulting Psychologists Press. Rynes, S., Bretz, R., & Gerhart, B. (1991). The importance of recruitment in job choice: A differ- ent way of looking. Personnel Psychology, 44, 487-521. Rynes, S., & Connerly, M. L. (1993). Applicant reactions to alternative selection procedures. Journal of Business and Psychology, 7, 261-277. Schippmann, J. S., & Prien, E. P. (1989). An assessment of the contributions of general mental ability and personality characteristics to management success. Journal of Business and Psy- chology, 3, 423-437. Schmitt, N., & Coyle, B. W. (1976). Applicant decisions in the employment interview. Journal of Applied Psychology, 61, 184-192. Schneider, R. J., Hough, L. M., & Dunnette, M. D. (1996). Broadsided by broad traits: How to sink science in five dimensions or less. Journal of Organizational Behavior, 17, 639-655. Shapiro, D. L., Buttner, E. H., & Barry, B. R. (1994). Explanations: What factors enhance their perceived adequacy? Organizational Behavior and Human Decision Processes, 58, 345- 368. Singer, M. (1993). Determinants of perceived fairness in selection practices: An organizational justice perspective. Genetic, Social, and General Psychology Monographs, 116, 477-494. Smither, J. W., Millsap, R. E., Stoffey, R. W., & Reilly, R. R. (1996). An experimental test of the influence of selection procedures on fairness perceptions, attitudes about the organization, and job pursuit intentions. Journal of Business and Psychology, 10, 297-318. Smither, J. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R. W. (1993). Applicant reactions to selection procedures. Personnel Psychology, 46, 49-76. Stone, E., Stone, D., & Hyatt, D. (1989, April). Personnel selection procedures and invasion of privacy. Paper presented at the annual meetings of the Society for Industrial and Organiza- tional Psychology, Boston, MA. Tett, R. P., Jackson, D. N., & Rothstein, M. (1991). Personality measures as predictors of job per- formance: A meta-analytic review. Personnel Psychology, 44, 703-742. Turban, D. B., & Keon, T. L. (1993). Organizational attractiveness: An interactionist perspec- tive. Journal of Applied Psychology, pp. 184-193. Tyler, T. (1988). What is procedural justice? Criteria used by citizens to assess the fairness of legal procedures. Law and Society Review, 22, 301-355. Ambrose, Rosse / PROCEDURAL JUSTICE 525 at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/ Tyler, T., & Bies, R. (1989). Beyond formal procedures: The interpersonal context of procedural justice. In J. Carroll (Ed.), Advances in social psychology: Business settings (pp. 77-98). Hillsdale, NJ: Lawrence Erlbaum. Viswesvaran, C., Ones, D., & Schmidt, F. (1992, August). Integrity tests predict drug and alco- hol abuse on the job. Paper presented at the annual meeting of the American Psychological Society, San Diego, CA. Maureen L. Ambrose (Ph.D., University of Illinois) is a professor of management in the College of Business Administration at the University of Central Florida. Her research interests include organizational fairness, computer monitoring, and ethics. Joseph G. Rosse (Ph.D., University of Illinois) is a professor of management and direc- tor of the Center for the Integrative Study of Work at the University of Colorado at Boul- der. His research on workplace attitudes and behavior, employee selection, and employee retention has appeared in numerous management journals and two books. 526 GROUP & ORGANIZATION MANAGEMENT at UNIVERSITY COLORADO on July 29, 2010gom.sagepub.comDownloaded from http://gom.sagepub.com/