Confirmatory Factor Analysis and Validity of the Sexual Harassment Scale in Football Refereeing International Journal of Environmental Research and Public Health Article Confirmatory Factor Analysis and Validity of the Sexual Harassment Scale in Football Refereeing Josefa Sánchez 1,* , Sara Serrat 1, Estefanía Castillo 1 and Alberto Nuviala 2 ���������� ������� Citation: Sánchez, J.; Serrat, S.; Castillo, E.; Nuviala, A. Confirmatory Factor Analysis and Validity of the Sexual Harassment Scale in Football Refereeing. Int. J. Environ. Res. Public Health 2021, 18, 1374. https:// doi.org/10.3390/ijerph18041374 Academic Editor: Andreas Holtermann Received: 6 November 2020 Accepted: 28 January 2021 Published: 3 February 2021 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affil- iations. Copyright: © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). 1 Department of Integrated Didactics, Area of Body Expression, School of Sport Education, Psychology and Sciences, University of Huelva, El Carmen Campus, Avenida de las Fuerzas Armadas s/n, 21007 Huelva, Spain; sara.serrat@alu.uhu.es (S.S.); estefania.castillo@dempc.uhu.es (E.C.) 2 Department of Sport Informatics, Area of Physical and Sport Education, School of Sport Sciences, Pablo de Olavide University, Ctra. De Utrera, km 1, 41013 Seville, Spain; anuvnuv@upo.es * Correspondence: josefa.sanchez@ddi.uhu.es; Tel.: +34-959219272 Abstract: Inequalities between men and women in the workplace are reflected in professional sports, specifically football refereeing. This phenomenon sometimes becomes sexual harassment since it is a stereotypically considered male profession in which women are a minority. To measure that behavior, it is necessary to count on valid and reliable tools. Therefore, the goal of this study was to determine the factorial structure and the discriminant and convergent validity of the ‘sexual experiences questionnaire’, version of the Department of Defence (SEQ-DoD). Eighty-nine male football referees and ninety-four female football referees, with a mean age of 23.30 ± 4.85 years, participated in this studio conducted questionnaire in Andalusia, Spain. A confirmatory factor analysis was performed using the robust maximum-likelihood estimation method. The goodness of fit was assessed, and the factorial invariance was calculated to determine the stability of the model. Subsequently, the validity was confirmed. The results corroborated the validity and reliability of the questionnaire adapted to the population studied. Therefore, it can be used as a research instrument. Keywords: sexual harassment; mobbing; football referee; gender inequality; sport 1. Introduction The MeToo Movement has contributed to raising awareness about the sexual harass- ment to which women are subjected. This harassment can occur in different environments, such as work, transportation, or public spaces, at home, at educational environments, or sports, among others [1–5]. Thousands of women have broken their silence and have shed light on sexual ha- rassment in the workplace and public spaces [6]. Nonetheless, most incidents of sexual harassment seem to go unreported because of fear of retaliation [7], becoming an important social issue that prevents achieving gender equality in certain professions that have been considered to be masculine [8]. Sexual harassment is both an aggression against women and a form of gender discrim- ination [6]. Sexual harassment is defined as “any behavior, verbal or physical, of sexual nature that has the purpose or has the effect of undermining the dignity of a person, espe- cially when an intimidating, degrading, or offensive environment is created” [9] (p. 12). Sexual harassment can be divided into three dimensions that feature differences in their concepts, although they are related to each other [10]. These dimensions are sexual coercion; unwanted sexual attention, and gender-based harassment. Sexual coercion is sexual cooperation in exchange for certain considerations, making itself visible through bribes, threats, and sexual blackmail. Unwanted sexual attention refers to verbal and non-verbal unwanted, offensive behaviors, without being reciprocal, such as invitations to dates despite saying no, inappropriate touching, or non-consensual sex. Gender-based Int. J. Environ. Res. Public Health 2021, 18, 1374. https://doi.org/10.3390/ijerph18041374 https://www.mdpi.com/journal/ijerph https://www.mdpi.com/journal/ijerph https://www.mdpi.com https://orcid.org/0000-0001-7479-1018 https://orcid.org/0000-0002-6599-4996 https://doi.org/10.3390/ijerph18041374 https://doi.org/10.3390/ijerph18041374 https://creativecommons.org/ https://creativecommons.org/licenses/by/4.0/ https://creativecommons.org/licenses/by/4.0/ https://doi.org/10.3390/ijerph18041374 https://www.mdpi.com/journal/ijerph https://www.mdpi.com/1660-4601/18/4/1374?type=check_update&version=2 Int. J. Environ. Res. Public Health 2021, 18, 1374 2 of 10 harassment refers to verbal and non-verbal behaviors with the purpose of insulting, harass- ing, and degrading through disrespect, sexist comments, distinctive treatment, comments about the body, debate about their sexual life, gestures, and inappropriate exhibitions [11]. Sexual harassment victims suffer a violation of their dignity. They lose the right to enjoy their jobs and may have negative consequences on their physical and mental health. In addition, their performance and productivity may decrease [12–14]. Different forms of sexual harassment occur in all sports and at all levels [15], and although prevalence rates have not been systematically estimated, it appears to be higher on the elite level of sports [16]. Traditionally, the figure of the bully has been the coach, but today it is also considered that there is sexual abuse between equals and that it is independent of their sexual orientation [16]. In the world of sports, there have been numerous studies on violence in soccer [17–22]. Although few studies address sexual violence, they are not always focused on the female population [23,24]. These studies often focus on the female population as victims of domestic violence after soccer games, but not as professional athletes [25,26]. In relation to previous studies on sexual harassment, research has been carried out on sports in general [27,28] or on university sports [7]. On the other hand, studies on individual sports, such as athletics [29–31], in sports teams, such as American football [23], or soccer [32]. These studies show, among other findings, that this type of behavior on athletes can cause serious consequences on the physical and mental health of the victims [16,29,33]. In relation to soccer, studies on refereeing reveal the stress to which the referees are exposed in their professional work, and on occasions, the abuse they suffer from players, coaches, and spectators [34–37]. Although some studies have been carried out in relation to the refereeing figure in soccer, research lacks in this regard [38]. Refereeing work is one of the least valued professions in the soccer world [39–41], and it is a highly masculinized context [42,43], with the number of women being considerably lower than men [44,45]. On the other hand, studies show that female referees suffer greater pressure during matches and less recognition of their work, thus hindering their professional development and suffering double discrimination for being a referee and for being a woman [44,46,47]. To study sexual harassment in sports, qualitative instruments, such as interviews or life history, have been used [23,28,30,31,46,48]. Timpka et al. [31], designed a protocol for the prevention of sexual abuse in sports. After reviewing the literature, the SEQ-DoD questionnaire was considered more accessible and easy to translate and, therefore, to apply to this study. This questionnaire has been widely used. It has also been subjected to different reviews and critics that conclude that it is an adequate instrument due to the scarcity of quantitative measures that exist to this topic of sexual harassment [49]. Another of the main reasons to use this questionnaire is the similarity between the sports and the military fields. One of the characteristics of these work environments is the presence of women and men in a context historically understood for men [46]. The military and sports worlds also coincide in the minimum presence of women and the traditional social thought that both are reserved for male practice only [44,50,51]. This questionnaire has been widely used in different countries and populations, especially those related to the military field, but it has also been applied in other popula- tions [10,52]. In the absence of a sexual harassment investigation in the football refereeing world, the purpose of the present study was to adapt the ‘sexual experiences questionnaire’ version of the Department of Defense (SEQ-DoD) [11]. The goals were to determine the factorial structure and the discriminant and convergent validity of the SEQ-DoD. The most relevant contribution of this paper is to adapt an instrument to collect useful information in the sports context, specifically in football refereeing. It may be used in future studies, adapting it to other sports or other figures, such as female and male players, or technical team, among other future lines of research. Int. J. Environ. Res. Public Health 2021, 18, 1374 3 of 10 2. Materials and Methods 2.1. Participants One hundred and eighty-three183 football referees from different categories partici- pated in the present study, of which 51.4% were women. The mean age was 23.30 ± 4.85 years, and the average experience in refereeing was 5.32 ± 4.80 years. 2.2. Instrument The SEQ-DoD (the ‘sexual experiences questionnaire’ version of the Department of Defense) [11] was the instrument used in the present study. It is a measurement tool used to determine offensive sexual experiences. This questionnaire was reviewed and adapted to the football refereeing environment. The SEQ-DoD, in its original version, consisted of four factors, namely: sexist hostility, sexual hostility, unwanted sexual attention, and sexual coercion. All the questions shared a common root: “In the last 12 months, have you observed or been a victim of some type of behavior described below, perpetrated by others in your work as a football referee?” The body of each element described behaviors that the interviewee might have experienced. The reliability of the instrument, after fieldwork, measured with Cronbach’s alpha, was 0.934. Responses were given on a Likert-type scale, ranging from 1 (never) to 5 (very often). Various sociodemographic questions were added to the questionnaire, such as sex, age, experience in football refereeing, and refereeing category. 2.3. Procedure First, the organization responsible for the football refereeing that participated in the study was informed about it. Participating referees were asked for permission to request their informed consent. The study was conducted after approval. The design took into account the principles established in the Declaration of Helsinki [53]. In the same way, we took into consideration the current Spanish legal regulations that normalize the protection of personal data [54]. The fieldwork was carried out by means of a self-administered questionnaire with the presence of an interviewer, which lasted about ten minutes. 2.4. Statistical Analysis First, we performed a confirmatory factor analysis. The method used was the robust maximum-likelihood estimation. To determine the goodness of fit, we reviewed the indicators, namely: the Chi-square value divided by the degrees of freedom (χ2/gl), values below 5.00 were considered acceptable; root mean square error of approximation (RMSEA), the model would show an acceptable adjustment if the value were <0.07; and comparative fit index (CFI), values above 0.90 are considered acceptable [55,56]. In addition, in order to follow Byrne’s indications [57], we added the Akaike information criterion and the expected cross-validation index. Subsequently, the factorial invariance was calculated to determine the stability of the model in different populations. Convergent validity tests were performed by calculating correlations between factors and composite reliability. Finally, we determined the discriminant validity using three different procedures: calculation of correlations between factors and comparison with the square root of the average variance extracted (AVE); estimation of alternative models; and construction of confidence intervals for factors correlation with 95% confidence interval. The statistical analyses were performed using the statistical packages SPSS (Statistical Package for the Social Sciences, version 23.0 (SPSS, IBM, Armonk, NY, USA)) and AMOS v23 (Analysis of Moment Structure (AMOS, IBM, Armonk, NY, USA), version 23.0) Int. J. Environ. Res. Public Health 2021, 18, 1374 4 of 10 3. Results To confirm whether or not the scale met the expected factorial structure, we performed a confirmatory factor analysis (Figure 1). The adequacy of the model under test (model 0), which consisted of four factors and twenty-four items, was carried out through a joint as- sessment of a group of indices. Table 1 contains the information provided by the adjustment indices, and it can be concluded that it was a correct model. Int. J. Environ. Res. Public Health 2021, 18, x FOR PEER REVIEW 4 of 9 a joint assessment of a group of indices. Table 1 contains the information provided by the adjustment indices, and it can be concluded that it was a correct model. Figure 1. Structural model of ‘sexual experiences questionnaire’, Department of Defence (SEQ- DoD). Table 1. Statistics adjustment for the ‘sexual experiences questionnaire’, Department of Defence (SEQ-DoD) scale model; comparison between models using Model 1 as correct. Goodness-of-Fit Indices and Model Comparisons of the Tested Models Model CMIN DF p CMIN/DF CFI RMSEA ECVI AIC Model 0 332.997 238 <0.001 1.399 0.930 0.063 4.570 456.997 Model 1 596.642 476 <0.001 1.253 0.913 0.051 8.532 844.642 Model 2 630.864 496 <0.001 1.272 0.903 0.052 8.473 838.864 Model 3 640.836 506 <0.001 1.266 0.903 0.052 8.372 828.836 Comparisons of Conditions Using Measurement Invariance Procedures Model Dif. DF Dif. CMIN p Assuming that model 1 is correct 2 20 34.222 0.025 3 30 44.194 0.046 Assuming that model 2 is correct 3 10 9.972 0.443 Note. CMIN: minimum discrepancy; DF: degrees of freedom; CFI: comparative fit index; RMSEA: root mean square error of approximation; ECVI: expected cross-validation index; AIC: Akaike information criterion; Model 1 had no restrictions; Sexist hostility Sexual hostility Sexual attention Sexual coercion E1 I1 K1 H1 O4 P4 S4 T4 U4 0.81 0.87 0.84 0.74 0.71 0.84 0.76 0.65 0.71 0.54 0.50 A2 C2 D2 B2 F2 L2 M2 G2 J3 N3 V3 P3 W3 X3 R3 0.85 0.76 0.85 0.66 0.57 0.43 0.73 0.72 0.62 0.50 0.83 0.56 0.73 0.70 0.56 0.84 0.84 0.84 0.84 0.84 0.79 0.71 0.91 0.84 0.76 0.86 0.75 0.84 0.84 0.86 0.89 0.78 0.74 0.82 0.92 0.69 0.57 0.87 0.90 0.75 0.70 0.80 0.94 Figure 1. Structural model of ‘sexual experiences questionnaire’, Department of Defence (SEQ-DoD). The factorial invariance of the model was contrasted by comparing two groups of football referees, which were selected at random among the population object of the present study. We considered the differences in χ2 between the models without restrictions (Model 1), Model 2 (had restrictions relating to the weight measurement), and Model 3 (had weight measurement and covariance restricted), observing differences between models 1 vs. 2 and 2 vs. 3 (Table 1) The CFI value of the models indicated that all had very similar values, with a difference between them equal to −0.01. Similarly, the Akaike information criterion and the expected cross-validation index indicated that the differences in the adjustments were minimal; therefore, the different models exhibited very similar values. These results suggest the factorial invariance of the model. The convergent validity was confirmed by the calculation of the correlations between the factors of the SEQ-DoD. The results indicated positive and significant correlations between the factors of the scale. Similarly, the composite reliability values obtained for each Int. J. Environ. Res. Public Health 2021, 18, 1374 5 of 10 dimension suggested the existence of this type of validity.To determine the discriminant validity, the square root of the AVE was compared with the correlation between both constructs. Table 2 shows this correlation and, in the diagonal, the square root of the AVE, which was superior to the correlation between the different constructs of the questionnaire. Considering these results, it can be affirmed that there was discriminant validity. Table 1. Statistics adjustment for the ‘sexual experiences questionnaire’, Department of Defence (SEQ-DoD) scale model; comparison between models using Model 1 as correct. Goodness-of-Fit Indices and Model Comparisons of the Tested Models Model CMIN DF p CMIN/DFCFI RMSEA ECVI AIC Model 0 332.997 238 <0.001 1.399 0.930 0.063 4.570 456.997 Model 1 596.642 476 <0.001 1.253 0.913 0.051 8.532 844.642 Model 2 630.864 496 <0.001 1.272 0.903 0.052 8.473 838.864 Model 3 640.836 506 <0.001 1.266 0.903 0.052 8.372 828.836 Comparisons of Conditions Using Measurement Invariance Procedures Model Dif. DF Dif. CMIN p Assuming that model 1 is correct 2 20 34.222 0.025 3 30 44.194 0.046 Assuming that model 2 is correct 3 10 9.972 0.443 Note. CMIN: minimum discrepancy; DF: degrees of freedom; CFI: comparative fit index; RMSEA: root mean square error of approximation; ECVI: expected cross-validation index; AIC: Akaike information criterion; Model 1 had no restrictions; Model 2 had restrictions relating to the weight measurement; Model 3 had weight measurement and covariance restricted; Dif. CMIN: difference between model 1 and the rest of the models; Dif. DF: difference between model 1 and the rest of the models; p: significance level between models. Table 2. Means, correlations between factors, and square roots of average variance extracted (In the diagonal); Cronbach’s Alpha; composite reliability. Total Mean Sexist Hostility Sexual Hostility Unwanted Sexual Attention Sexual Coercion α CR Sexist hostility 2.46 ± 1.04 (0.716) 0.612 ** 0.485 ** 0.427 ** 0.803 0.806 Sexual hostility 2.23 ± 0.95 (0.735) 0.602 ** 0.525 ** 0.899 0.901 Unwanted sexual attention 1.44 ± 0.60 (0.629) 0.599 ** 0.825 0.817 Sexual coercion 1.22 ± 0.54 (0.714) 0.830 0.837 Note. ** p < 0.01; CR: composite reliability. As a second discriminant validity test, alternative models were estimated in such a way that a restriction in all of them, i.e., the correlation between each pair of dimensions, should be equal to 1. In addition, the chi-square test was performed with each one to compare the models to assess whether or not they were significantly different. Table 3 shows how the difference between the chi-square test values was always significant. This way, the dimensions of the scale were significantly different from each other, thus confirming the discriminant validity. As a third way to confirm this type of validity, we calculated the possible correlations between the factors. This procedure allowed the construction of the confidence interval relating to the correlations between the dimensions. Table 3 shows that the discriminant validity of the scale could be confirmed, since none of the confidence intervals of these correlations contained value 1 at 95% confidence. Int. J. Environ. Res. Public Health 2021, 18, 1374 6 of 10 Table 3. Test of χ2 differences; confidence intervals of correlations between dimensions. χ2 Differences (gL) p Confidence Interval Sexist Hostility/Sexual Hostility 334.129 (239) − 332.997 (238) = 1.132 (1) <0.001 (0.679–0.815) Sexist Hostility/Unwanted Sexual Attention 351.000 (239) − 332.997 (238) = 18.003 (1) <0.001 (0.351–0.600) Sexist Hostility/Sexual Coercion 360.712 (239) − 332.997 (238) = 27.715 (1) <0.001 (0.286–0.553) Sexual Hostility/Unwanted Sexual Attention 344.250 (239) − 332.997 (238) = 11.253 (1) <0.001 (0.577–0.750) Sexual Hostility/ Sexual Coercion 355.737 (239) − 332.997 (238) = 22.74 (1) <0.001 (0.400–0.631) Unwanted Sexual Attention/Sexual Coercion 367.236 (239) − 332.997 (238) = 34.239 (1) <0.001 (0.503–0.828) 4. Discussion The goals of the present study were to determine the factorial structure and the discriminant and convergent validity of the SEQ-DoD [11] in Spanish football referees. The results confirmed the validity and reliability of the adaptation of the questionnaire to the population under study. The resulting latent variables were the same as those in the original questionnaire. The purpose of our study was to determine the fit of the original model to the data obtained from a sample of Spanish football referees. To that end, we performed a confir- matory factor analysis. The parameters were estimated using the maximum likelihood method [58]. To assess the adequacy of the model under test, we performed a joint as- sessment of a group of indices. Some of the most used adjustment indices were selected considering values above 0.90 acceptable in the case of the CFI. In the case of RMSEA, the model would exhibit an acceptable fit if the value was <0.07 [59], and values ≤ 0.06 would indicate a good fit [60]. Regarding the values of the quotient between χ2 and gL, in a model considered perfect, the value would be 1.00, and ratios below 2.00 would be considered a very good fit of the model, whereas values below 5.00 would be considered acceptable [60–62]. Finally, due to the convenience of comparing the fit of the model, we added two specially developed indices, namely: the Akaike information criterion, i.e., a comparative index between models, having to choose the model that presents a lower value [63] (values closer to zero indicate a better fit); and the expected cross-validation index, which measures the discrepancy between the covariance matrix involved in the analyzed sample and the expected covariance matrix of another sample of the same size. When models are being compared, a lower expected cross-validation index value indicates the model with the best fit [63]. The results of the different fit indices of the original model can be considered accept- able. Therefore, the model can be considered correct for the population of football referees assessed in the present study. Furthermore, the reliability of the resulting instrument measured with Cronbach’s alpha was 0.934, which indicated good internal consistency. Subsequently, we assessed the invariance of the factorial structure through multi- group analysis [64]. To that end, the group was divided into two subgroups at random. The aim was to confirm that there were no significant differences between a model without invariance and different models with invariance in some parameters. We found significant differences in chi-square values between the unrestricted model (Model 1) and the rest of the models. However, given that the chi-square coefficient is sensitive to sample size, we also used the criterion proposed by Cheung and Rensvold [65] with respect to ∆CFI. According to these authors, ∆CFI values lower than or equal to −0.01 indicate that the null hypothesis of invariance cannot be rejected. The ∆CFI values found in the present study, Int. J. Environ. Res. Public Health 2021, 18, 1374 7 of 10 in the comparison of the unrestricted model with the rest of the models, suggest that the factorial structure of the scale was invariant. The convergent validity was determined by the correlations between the SEQ-DoD factors using Pearson’s correlation coefficient. The correlations between them were positive, being high in some cases, which can give an idea of the similarity of the constructs. The results of the correlations demonstrated this type of validity since the results were within the criteria proposed by Devon et al. [66] for this type of validity. The second test of convergent validity of the instrument was determined by composite reliability. Acceptable values are >0.6 [67,68]. Both tests indicated the existence of this type of validity. The discriminant validity of the scale was expressed by the contrast between the different factors that composed it. This type of validity occurs if the concepts that comprise it are really different and, at the same time, related to each other [69]. To confirm this validity, these concepts were assessed in various ways. The first consisted of comparing the square root of the AVE with the correlation between the constructs of the scale [67]. The square root of the AVE should be higher than the correlation between the constructs so that there is discriminant validity between them. Considering the results of the correlations and the AVE values, it can be affirmed that there was discriminant validity. This type of validity can also be confirmed in two other ways. The first has been proposed by Burnkrant and Page [70]. It attempts to estimate alternative models in such a way that a restriction is included in all of them, i.e., the correlation between each pair of dimensions should be equal to 1. In the other, each model should be subject to a chi-square test to compare them and assess whether they are significantly different. Our results have proven that the difference between the chi-squared values was always significant. Therefore, the dimensions of the SEQ-DoD were different from each other, thus confirming the discriminant validity. The third way consists of calculating the possible correlations between the factors and constructing the confidence intervals of the correlations between all the dimensions. The results of the present study also indicated the occurrence of this type of validity since none of the confidence intervals of these correlations contained the value 1 at 95% confidence [71]. 5. Conclusions In conclusion, the SEQ-DoD has proven to be valid and reliable. However, it is still in an early stage. The limitations related to the number of football referees assessed in the fieldwork and the lack of bibliography on the subject makes it necessary to conduct further studies in-depth and improve, if possible, this instrument. Author Contributions: Conceptualization, S.S.; methodology, J.S.; validation, S.S.; formal analysis, A.N.; investigation, E.C.; resources, J.S.; data curation, A.N.; writing—original draft preparation, S.S.; writing—review and editing, E.C.; visualization, E.C.; supervision, A.N.; project administration, J.S. All authors have read and agreed to the published version of the manuscript. Funding: This research received no external funding. Institutional Review Board Statement: The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Junta de Andalucía (protocol code 1363-N-20 and date of approval 4/12/2020). Informed Consent Statement: Informed consent was obtained from all subjects involved in the study. Data Availability Statement: Data is contained within the article; there is no supplementary material. Conflicts of Interest: The authors declare no conflict of interest. Int. J. Environ. Res. Public Health 2021, 18, 1374 8 of 10 References 1. Corredoira, L. The Right of One’s Own Image in the Recent Cases of Sexual Harassment in Film Industry: Applying the European Theory of Concentric Circles to Celebrities (In Particular, Women). J. Inf. Policy 2018, 8, 381–400. [CrossRef] 2. Hamilton, K.M.; Snoeyink, M.J.; Martinez, L.R. Blurred lines: How to approach sexual harassment training when sexual harassment isn’t always about sex. Ind. Organ. Psychol. 2019, 12, 345–349. [CrossRef] 3. Keplinger, K.; Johnson, S.K.; Kirk, J.F.; Barnes, L.Y. Women at work: Changes in sexual harassment between September 2016 and September 2018. PLoS ONE 2019, 14, e0218313. [CrossRef] [PubMed] 4. Talone, V.; Araújo, A.B. A evitação do assédio sexual no transporte público: Uma leitura pragmatista das práticas de desconfiança de mulheres na cidade do. Contemporânea 2019, 9, 989–1006. [CrossRef] 5. Tester, G. An intersectional analysis of sexual harassment in housing. Gend. Soc. 2008, 22, 349–366. [CrossRef] 6. Stop Street Harassment. The Facts behind the #MeToo Movement: 2018 Study on Sexual Harassment and Assault; Stop Street Harassment: Reston, VA, USA, 2019. 7. Martín, M.; Juncà, A. Sexual harassment in sport: The case of student-athletes reading for a degree in physical activity and sport science in catalonia. Apunt. Educ. Fis. Deportes 2014, 115, 72–81. [CrossRef] 8. Carballo, L.; Kitada, M. Sexual harassment and women seafarers: The role of laws and policies to ensure occupational safety & health. Mar. Policy 2020, 117, 103938. 9. Ley Orgánica 3/2007 del 22 de Marzo Para la Igualdad Efectiva de Mujeres y Hombres. Boletín Oficial del Estado, Madrid, 23 de Marzo de 2007, Núm. 7, 1–66. Available online: https://www.boe.es/buscar/pdf/2007/BOE-A-2007-6115-consolidado.pdf (accessed on 31 January 2021). 10. Gelfand, M.J.; Fitzgerald, L.F.; Drasgow, F. The structure of sexual harassment: A confirmatory analysis across cultures and settings. J. Vocat. Behav. 1995, 47, 164–177. [CrossRef] 11. Fitzgerald, L.F.; Magley, V.J.; Drasgow, F.; Waldo, C.R. Measuring sexual harassment in the military: The sexual experiences questionnaire (SEQ—DoD). Mil. Psychol. 1999, 11, 243–263. [CrossRef] 12. Dias, I. Violência contra as mulheres no trabalho: O caso do assédio sexual. Sociol. Probl. e Práticas 2008, 57, 11–23. 13. Campbell, J.C. Health consequences of intimate partner violence. Lancet 2002, 359, 1331–1336. [CrossRef] 14. Willness, C.R.; Steel, P.; Lee, K. A meta-analysis of the antecedents and consequences of workplace sexual harassment. Pers. Psychol. 2007, 60, 127–162. [CrossRef] 15. Mountjoy, M.; Brackenridge, C.; Arrington, M.; Blauwet, C.; Carska-Sheppard, A.; Fasting, K.; Kirby, S.; Leahy, T.; Marks, S.; Martin, K.; et al. International olympic committee consensus statement: Harassment and abuse (non-accidental violence) in sport. Br. J. Sports Med. 2016, 50, 1019–1029. [CrossRef] [PubMed] 16. Marks, S.; Mountjoy, M.; Marcus, M. Sexual harassment and abuse in sport: The role of the team doctor. Br. J. Sports Med. 2012, 46, 905–908. [CrossRef] [PubMed] 17. Acuña, A.; Acuña, G.E. Manifestaciones de violencia en el estadio de fútbol: El caso de Granada Club de Fútbol. Cult. Cienc. Deporte 2018, 13, 231–242. [CrossRef] 18. Brandao, T.; Murad, M.; Belmont, R.; Ferreira, R. Álcool e violência: Torcidas organizadas de futebol no Brasil. Movimento 2020, 25, e26001. [CrossRef] 19. Garcia-Marti, C.; Duran-Gonzalez, J.; Gomez-Lopez, M. Sporting violence curving in spanish professional football (1985–1995). Ricyde Rev. Int. Cienc. Deporte 2017, 13, 314–330. [CrossRef] 20. Segura, F.; Murzi, D.; Nassar, B. Violence and death in Argentinean soccer in the new Millennium: Who is involved and what is at stake? Int. Rev. Sociol. Sport 2019, 54, 837–854. [CrossRef] 21. Salinas, N.A. Encrucijada de la violencia asociada al fútbol: Entre el desagrado y la complacencia. Trab. Soc. 2018, 20, 49–68. [CrossRef] 22. Uribe, N.I.; Castaño, G.A. Barras de fútbol, consumo de drogas y violencia. Psicol. Desde El Caribe 2014, 31, 243–279. 23. Hills, S.; Walker, M. Sport and social development evaluating a professional sport league’s domestic violence and sexual abuse camp. J. Appl. Sport Manag. 2017, 9, 39–49. [CrossRef] 24. Matthews, C.R.; Channon, A. Understanding sports violence: Revisiting foundational explorations. Sport Soc. 2017, 20, 751–767. [CrossRef] 25. Dickson, A.; Jennings, C.; Koop, G. Domestic violence and football in glasgow: Are reference points relevant? Oxf. Bull. Econ. Stat. 2016, 78, 1–21. [CrossRef] 26. Williams, D.J.; Neville, F.G.; House, K.; Donnelly, P.D. Association between old firm football matches and reported domestic (violence) incidents in strathclyde, scotland. SAGE Open 2013, 3, 2158244013504207. [CrossRef] 27. Fasting, K. Assessing the sociology of sport: On sexual harassment research and policy. Int. Rev. Sociol. Sport 2015, 50, 437–441. [CrossRef] 28. Vveinhardt, J.; Bite, V.; Andriukaitiene, R. “Omerta” in organized sport: Bullying and harassment as determinants of threats of social sustainability at the individual level. Sustainability 2019, 11, 2474. [CrossRef] 29. Timpka, T.; Spreco, A.; Dahlstrom, O.; Jacobsson, J.; Kowalski, J.; Bargoria, V.; Svedin, C.G. Suicidal thoughts (ideation) among elite athletics (track and field) athletes: Associations with sports participation, psychological resourcefulness and having been a victim of sexual and/or physical abuse. Br. J. Sports Med. 2020. [CrossRef] 30. Owton, H.; Sparkes, A.C. Sexual abuse and the grooming process in sport: Learning from Bella’s story. Sport Educ. Soc. 2017, 22, 732–743. [CrossRef] http://doi.org/10.5325/jinfopoli.8.2018.0381 http://doi.org/10.1017/iop.2019.64 http://doi.org/10.1371/journal.pone.0218313 http://www.ncbi.nlm.nih.gov/pubmed/31314792 http://doi.org/10.4322/2316-1329.122 http://doi.org/10.1177/0891243208317827 http://doi.org/10.5672/apunts.2014-0983.es.(2014/1).115.07 https://www.boe.es/buscar/pdf/2007/BOE-A-2007-6115-consolidado.pdf http://doi.org/10.1006/jvbe.1995.1033 http://doi.org/10.1207/s15327876mp1103_3 http://doi.org/10.1016/S0140-6736(02)08336-8 http://doi.org/10.1111/j.1744-6570.2007.00067.x http://doi.org/10.1136/bjsports-2016-096121 http://www.ncbi.nlm.nih.gov/pubmed/27118273 http://doi.org/10.1136/bjsports-2011-090345 http://www.ncbi.nlm.nih.gov/pubmed/22171340 http://doi.org/10.12800/ccd.v1i1.1145 http://doi.org/10.22456/1982-8918.90431 http://doi.org/10.5232/ricyde2017.05001 http://doi.org/10.1177/1012690217748929 http://doi.org/10.15446/ts.v20n1.71562 http://doi.org/10.18666/JASM-2017-V9-I4-8448 http://doi.org/10.1080/17430437.2016.1179735 http://doi.org/10.1111/obes.12105 http://doi.org/10.1177/2158244013504207 http://doi.org/10.1177/1012690214554272 http://doi.org/10.3390/su11092474 http://doi.org/10.1136/bjsports-2019-101386 http://doi.org/10.1080/13573322.2015.1063484 Int. J. Environ. Res. Public Health 2021, 18, 1374 9 of 10 31. Timpka, T.; Janson, S.; Jacobsson, J.; Ekberg, J.; Dahlström, Ö.; Kowalski, J.; Svedin, C.G. Protocol design for large-scale cross- sectional studies of sexual abuse and associated factors in individual sports: Feasibility study in Swedish athletics. J. Sports Sci. Med. 2015, 14, 179. 32. De Albuquerque, E.; Mendes, A. Experiências indesejáveis: Alguns casos de assédio sexual no futebol. Movimento 2019, 25, e25080. [CrossRef] 33. Jeckell, A.S.; Copenhaver, E.A.; Diamond, A.B. The spectrum of hazing and peer sexual abuse in sports: A current perspective. Sports Health 2018, 10, 558–564. [CrossRef] [PubMed] 34. Fuente, D.; Cantón, E.; Montes, F.; Sanruperto, M.A. Aggression towards Referees in Amateur Football in Spain: A Loglinear Approach. Univ. Psychol. 2019, 18, 1–13. [CrossRef] 35. Soriano, G.; Ramis, Y.; Torregrosa, M.; Cruz, J. Apoyo contra el estrés: Cómo podemos ayudar a los árbitros? Kronos 2017, 16, 1–10. 36. Vela, D.; Arbinaga, F. Application of the list of stressful situations for arbitration (Lisea) in football referees. Rev. Iberoam. Psicol. Ejerc. Deporte 2018, 13, 281–287. 37. Kellett, P.; Shilbury, D. Umpire participation: Is abuse really the issue? Sport Manag. Rev. 2007, 10, 209–229. [CrossRef] 38. Marrero, G.; Gutiérrez, C. Las motivaciones de los árbitros de fútbol. Rev. Psicol. Deporte 2002, 11, 69–82. 39. González-Oya, J. Aproximación a la violencia en el fútbol y en el arbitraje. Rev. Iberoam. Psicol. Ejerc. Deporte 2006, 1, 29–44. 40. Moriconi, M.; Teixeira-Diniz, R. Mitos, percepciones y actitudes frente a los resultados combinados en Portugal: Un estudio con énfasis en los árbitros y los hinchas. Sociol. Probl. Práticas 2016, 82, 145–164. [CrossRef] 41. Parsons, T.; Bairner, A. You want the buzz of having done well in a game that wasn’t easy: A sociological examination of the job commitment of English football referees. Mov. Sport Sci. Sci. Mot. 2015, 87, 41–52. [CrossRef] 42. Cuenca-Piqueras, C. Factores precipitantes del acoso sexual laboral en España. Rev. Mex. Sociol. 2015, 77, 525–554. 43. Fink, J.S. Gender and sex diversity in sport organizations: Concluding comments. Sex Roles 2008, 58, 146–147. [CrossRef] 44. Santillán, M.; Gantús, F. Transgresiones femeninas: Futbol. Una mirada desde la caricatura de la prensa, México 1970–1971. Tzintzun Rev. Estud. Históricos 2010, 52, 143–176. 45. Federación Internacional de Fútbol Asociado. Professional Football Report 2019. 2019. Available online: https://img.fifa.com/ image/upload/jlr5corccbsef4n4brde.pdf (accessed on 31 January 2021). 46. Forbes, A.; Edwards, L.; Fleming, S. ‘Women can’t referee’: Exploring the experiences of female football officials within UK football culture. Soccer Soc. 2015, 16, 521–539. [CrossRef] 47. González, M.D.; Selva, C.; Torregrosa, M. Mujeres y árbitras: Historias de vida de una doble minoría en el deporte. Rev. Psicol. Deporte 2018, 27, 23–30. 48. Timpka, T.; Janson, S.; Jacobsson, J.; Dahlström, O.; Spreco, A.; Kowalski, J.; Bargoria, V.; Mountjoy, M.; Svedin, C.G. Lifetime history of sexual and physical abuse among competitive athletics (track and field) athletes: Cross sectional study of associations with sports and nonsports injury. Sports Med. 2018, 53, 1412–1417. [CrossRef] 49. Gutek, B.A.; Murphy, R.O.; Douma, B. A review and critique of the Sexual Experiences Questionnaire (SEQ). Law Hum. Behav. 2004, 28, 457–482. [CrossRef] 50. Messner, M. Boyhood, organized sports and the construction of masculinities. J. Contemp. Ethnogr. 1990, 18, 416–444. [CrossRef] 51. Selva, C.; Pallarès, S.; González, M.D. Una mirada a la conciliación a través de las mujeres deportistas. Rev. Psicol. Deporte 2013, 22, 69–76. 52. Folke, O.; Rickne, J.; Tanaka, S.; Tateishi, Y. Sexual harassment of women leaders. Daedalus 2020, 149, 180–197. [CrossRef] 53. World Medical Association. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA 2013, 310, 2191–2194. [CrossRef] 54. Ley Orgánica 3/2018, de 5 de Diciembre, de Protección de Datos Personales y Garantía de los Derechos Digitales. Boletín Oficial del Estado, 294, de 06/12/2018. Available online: https://www.boe.es/buscar/act.php?id=BOE-A-2018-16673 (accessed on 31 January 2021). 55. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E.; Tatham, R.L. Multivariate Data Analysis, 6th ed.; Pearson-Prentice-Hall: Upper Saddle River, NJ, USA, 2006. 56. Marôco, J. Análise de Equações Estructurais. Fundamentos Teóricos, Software & Aplicações; Rolo y Filhos II, SA: Pero Pinheiro, Portugal, 2010. 57. Byrne, B.M. Structural Equation Modeling with AMOS. Basic Concepts, Applications, and Programmin; LEA: London, UK, 2001. 58. Thompson, B. Exploratory and Confirmatory Factor Analysis. Understanding Concepts and Applications; American Psychological Association: Washington, DC, USA, 2004. 59. Steiger, J.H. Understanding the limitations of global fit assessment in structural equation modeling. Personal. Individ. Differ. 2007, 42, 893–898. [CrossRef] 60. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Modeling Multidiscip. J. 1999, 6, 1–55. [CrossRef] 61. MacCallum, R.C.; Widaman, K.F.; Preacher, K.J.; Hong, S. Sample size in factor analysis: The role of model error. Multivar. Behav. Res. 2001, 36, 611–637. [CrossRef] 62. Yuan, K.H. Fit indices versus test statistics. Multivar. Behav. Res. 2005, 40, 115–148. [CrossRef] [PubMed] 63. Schermelleh-Engel, K.; Moosbrugger, H.; Müller, H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 2003, 8, 23–74. http://doi.org/10.22456/1982-8918.85215 http://doi.org/10.1177/1941738118797322 http://www.ncbi.nlm.nih.gov/pubmed/30192709 http://doi.org/10.11144/Javeriana.upsy18-3.araf http://doi.org/10.1016/S1441-3523(07)70012-8 http://doi.org/10.7458/SPP2016827159 http://doi.org/10.3917/sm.087.0041 http://doi.org/10.1007/s11199-007-9364-4 https://img.fifa.com/image/upload/jlr5corccbsef4n4brde.pdf https://img.fifa.com/image/upload/jlr5corccbsef4n4brde.pdf http://doi.org/10.1080/14660970.2014.882829 http://doi.org/10.1136/bjsports-2018-099335 http://doi.org/10.1023/B:LAHU.0000039335.96042.26 http://doi.org/10.1177/089124190018004003 http://doi.org/10.1162/daed_a_01781 http://doi.org/10.1001/jama.2013.281053 https://www.boe.es/buscar/act.php?id=BOE-A-2018-16673 http://doi.org/10.1016/j.paid.2006.09.017 http://doi.org/10.1080/10705519909540118 http://doi.org/10.1207/S15327906MBR3604_06 http://doi.org/10.1207/s15327906mbr4001_5 http://www.ncbi.nlm.nih.gov/pubmed/26822275 Int. J. Environ. Res. Public Health 2021, 18, 1374 10 of 10 64. Abalo, J.; Lévy, J.; Rial, A.; Varela, J. Invarianza factorial con muestras múltiples. In Modelización con Estructuras de Covarianzas en Ciencias Sociales; Lévy, E.J., Ed.; Netbiblo: Madrid, Spain, 2006; pp. 259–278. 65. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 2002, 9, 233–255. [CrossRef] 66. Devon, H.A.; Block, M.E.; Moyle-Wright, P.; Ernst, D.M.; Hayden, S.J.; Lazzara, D.J.; Savoy, S.M.; Kostas-Polston, E. A psychomet- ric toolbox for testing validity and reliability. J. Nurs. Scholarsh. 2007, 39, 155–164. [CrossRef] [PubMed] 67. Fornell, C.; Larcker, D.F. Evaluating structural model with unobserved variables and measurement errors. J. Mark. Res. 1981, 18, 39–50. [CrossRef] 68. Bagozzi, R.; Yi, Y. On the Evaluation of Structural Equation Models. J. Acad. Mark. Sci. 1988, 16, 74–94. [CrossRef] 69. Lehmann, D.R.; Gupta, S.; Steckel, J.H. Marketing Research; Addison-Wesley: New York, NY, USA, 1999. 70. Burnkrant, R.E.; Page, T.J. An examination of the convergent, discriminant and predictive validity of Fishbein’s behavioral intention model. J. Mark. Res. 1982, 19, 526–550. [CrossRef] 71. Anderson, J.C.; Gerbing, D.W. Structural Equation Modeling in Practice: A Review and Recommended Two-Step Approach. Psychol. Bull. 1988, 103, 411–423. [CrossRef] http://doi.org/10.1207/S15328007SEM0902_5 http://doi.org/10.1111/j.1547-5069.2007.00161.x http://www.ncbi.nlm.nih.gov/pubmed/17535316 http://doi.org/10.1177/002224378101800104 http://doi.org/10.1007/BF02723327 http://doi.org/10.1177/002224378201900414 http://doi.org/10.1037/0033-2909.103.3.411 Introduction Materials and Methods Participants Instrument Procedure Statistical Analysis Results Discussion Conclusions References