id sid tid token lemma pos hx11xd10s04 1 1 evaluating evaluate VERB hx11xd10s04 1 2 subpopulation subpopulation NOUN hx11xd10s04 1 3 invariance invariance NOUN hx11xd10s04 1 4 in in ADP hx11xd10s04 1 5 test test NOUN hx11xd10s04 1 6 equating equating NOUN hx11xd10s04 1 7 is be AUX hx11xd10s04 1 8 crucial crucial ADJ hx11xd10s04 1 9 to to ADP hx11xd10s04 1 10 establishing establish VERB hx11xd10s04 1 11 the the DET hx11xd10s04 1 12 fairness fairness NOUN hx11xd10s04 1 13 and and CCONJ hx11xd10s04 1 14 interchangeability interchangeability NOUN hx11xd10s04 1 15 of of ADP hx11xd10s04 1 16 scores score NOUN hx11xd10s04 1 17 that that PRON hx11xd10s04 1 18 arise arise VERB hx11xd10s04 1 19 from from ADP hx11xd10s04 1 20 multiple multiple ADJ hx11xd10s04 1 21 forms form NOUN hx11xd10s04 1 22 . . PUNCT hx11xd10s04 2 1 tests test NOUN hx11xd10s04 2 2 that that PRON hx11xd10s04 2 3 are be AUX hx11xd10s04 2 4 administered administer VERB hx11xd10s04 2 5 in in ADP hx11xd10s04 2 6 multiple multiple ADJ hx11xd10s04 2 7 forms form NOUN hx11xd10s04 2 8 , , PUNCT hx11xd10s04 2 9 including include VERB hx11xd10s04 2 10 many many ADJ hx11xd10s04 2 11 high high ADJ hx11xd10s04 2 12 - - PUNCT hx11xd10s04 2 13 stakes stake NOUN hx11xd10s04 2 14 educational educational ADJ hx11xd10s04 2 15 tests test NOUN hx11xd10s04 2 16 , , PUNCT hx11xd10s04 2 17 often often ADV hx11xd10s04 2 18 rely rely VERB hx11xd10s04 2 19 on on ADP hx11xd10s04 2 20 test test NOUN hx11xd10s04 2 21 equating equating NOUN hx11xd10s04 2 22 to to PART hx11xd10s04 2 23 produce produce VERB hx11xd10s04 2 24 directly directly ADV hx11xd10s04 2 25 comparable comparable ADJ hx11xd10s04 2 26 scores score NOUN hx11xd10s04 2 27 . . PUNCT hx11xd10s04 3 1 if if SCONJ hx11xd10s04 3 2 the the DET hx11xd10s04 3 3 test test NOUN hx11xd10s04 3 4 equating equating NOUN hx11xd10s04 3 5 function function NOUN hx11xd10s04 3 6 exhibits exhibit NOUN hx11xd10s04 3 7 subpopulation subpopulation NOUN hx11xd10s04 3 8 dependency dependency NOUN hx11xd10s04 3 9 , , PUNCT hx11xd10s04 3 10 then then ADV hx11xd10s04 3 11 at at ADV hx11xd10s04 3 12 least least ADV hx11xd10s04 3 13 one one NUM hx11xd10s04 3 14 subgroup subgroup NOUN hx11xd10s04 3 15 of of ADP hx11xd10s04 3 16 test test NOUN hx11xd10s04 3 17 takers taker NOUN hx11xd10s04 3 18 is be AUX hx11xd10s04 3 19 unfairly unfairly ADV hx11xd10s04 3 20 disadvantaged disadvantaged ADJ hx11xd10s04 3 21 and and CCONJ hx11xd10s04 3 22 the the DET hx11xd10s04 3 23 scores score NOUN hx11xd10s04 3 24 are be AUX hx11xd10s04 3 25 not not PART hx11xd10s04 3 26 truly truly ADV hx11xd10s04 3 27 interchangeable interchangeable ADJ hx11xd10s04 3 28 . . PUNCT hx11xd10s04 4 1 however however ADV hx11xd10s04 4 2 , , PUNCT hx11xd10s04 4 3 it it PRON hx11xd10s04 4 4 is be AUX hx11xd10s04 4 5 unlikely unlikely ADJ hx11xd10s04 4 6 the the DET hx11xd10s04 4 7 equating equating NOUN hx11xd10s04 4 8 will will AUX hx11xd10s04 4 9 be be AUX hx11xd10s04 4 10 perfectly perfectly ADV hx11xd10s04 4 11 invariant invariant ADJ hx11xd10s04 4 12 . . PUNCT hx11xd10s04 5 1 in in ADP hx11xd10s04 5 2 practice practice NOUN hx11xd10s04 5 3 , , PUNCT hx11xd10s04 5 4 some some DET hx11xd10s04 5 5 non non ADJ hx11xd10s04 5 6 - - ADJ hx11xd10s04 5 7 zero zero NUM hx11xd10s04 5 8 level level NOUN hx11xd10s04 5 9 of of ADP hx11xd10s04 5 10 subgroup subgroup NOUN hx11xd10s04 5 11 dependency dependency NOUN hx11xd10s04 5 12 tends tend VERB hx11xd10s04 5 13 to to PART hx11xd10s04 5 14 exist exist VERB hx11xd10s04 5 15 . . PUNCT hx11xd10s04 6 1 determining determine VERB hx11xd10s04 6 2 if if SCONJ hx11xd10s04 6 3 low low ADJ hx11xd10s04 6 4 levels level NOUN hx11xd10s04 6 5 of of ADP hx11xd10s04 6 6 dependency dependency NOUN hx11xd10s04 6 7 amount amount NOUN hx11xd10s04 6 8 to to ADP hx11xd10s04 6 9 a a DET hx11xd10s04 6 10 meaningful meaningful ADJ hx11xd10s04 6 11 departure departure NOUN hx11xd10s04 6 12 from from ADP hx11xd10s04 6 13 invariance invariance NOUN hx11xd10s04 6 14 or or CCONJ hx11xd10s04 6 15 are be AUX hx11xd10s04 6 16 " " PUNCT hx11xd10s04 6 17 close close ADJ hx11xd10s04 6 18 enough enough ADV hx11xd10s04 6 19 " " PUNCT hx11xd10s04 6 20 to to ADP hx11xd10s04 6 21 zero zero NUM hx11xd10s04 6 22 to to PART hx11xd10s04 6 23 ignore ignore VERB hx11xd10s04 6 24 is be AUX hx11xd10s04 6 25 fundamental fundamental ADJ hx11xd10s04 6 26 to to ADP hx11xd10s04 6 27 validating validate VERB hx11xd10s04 6 28 the the DET hx11xd10s04 6 29 interchangeability interchangeability NOUN hx11xd10s04 6 30 of of ADP hx11xd10s04 6 31 equated equated ADJ hx11xd10s04 6 32 scores.this scores.this NOUN hx11xd10s04 6 33 dissertation dissertation NOUN hx11xd10s04 6 34 applies apply VERB hx11xd10s04 6 35 equivalence equivalence NOUN hx11xd10s04 6 36 testing testing NOUN hx11xd10s04 6 37 ( ( PUNCT hx11xd10s04 6 38 et et X hx11xd10s04 6 39 ) ) PUNCT hx11xd10s04 6 40 to to PART hx11xd10s04 6 41 determine determine VERB hx11xd10s04 6 42 if if SCONJ hx11xd10s04 6 43 the the DET hx11xd10s04 6 44 observed observed ADJ hx11xd10s04 6 45 dependency dependency NOUN hx11xd10s04 6 46 is be AUX hx11xd10s04 6 47 too too ADV hx11xd10s04 6 48 much much ADJ hx11xd10s04 6 49 for for ADP hx11xd10s04 6 50 invariance invariance NOUN hx11xd10s04 6 51 to to PART hx11xd10s04 6 52 hold hold VERB hx11xd10s04 6 53 . . PUNCT hx11xd10s04 7 1 et et PROPN hx11xd10s04 7 2 is be AUX hx11xd10s04 7 3 a a DET hx11xd10s04 7 4 statistical statistical ADJ hx11xd10s04 7 5 framework framework NOUN hx11xd10s04 7 6 that that PRON hx11xd10s04 7 7 assesses assess VERB hx11xd10s04 7 8 if if SCONJ hx11xd10s04 7 9 a a DET hx11xd10s04 7 10 quantity quantity NOUN hx11xd10s04 7 11 is be AUX hx11xd10s04 7 12 small small ADJ hx11xd10s04 7 13 enough enough ADV hx11xd10s04 7 14 to to PART hx11xd10s04 7 15 ignore ignore VERB hx11xd10s04 7 16 and and CCONJ hx11xd10s04 7 17 accounts account VERB hx11xd10s04 7 18 for for ADP hx11xd10s04 7 19 sampling sample VERB hx11xd10s04 7 20 error error NOUN hx11xd10s04 7 21 . . PUNCT hx11xd10s04 8 1 et et PROPN hx11xd10s04 8 2 requires require VERB hx11xd10s04 8 3 that that SCONJ hx11xd10s04 8 4 an an DET hx11xd10s04 8 5 indifference indifference NOUN hx11xd10s04 8 6 threshold threshold NOUN hx11xd10s04 8 7 be be AUX hx11xd10s04 8 8 established establish VERB hx11xd10s04 8 9 . . PUNCT hx11xd10s04 9 1 we we PRON hx11xd10s04 9 2 conducted conduct VERB hx11xd10s04 9 3 a a DET hx11xd10s04 9 4 simulation simulation NOUN hx11xd10s04 9 5 to to PART hx11xd10s04 9 6 study study VERB hx11xd10s04 9 7 the the DET hx11xd10s04 9 8 behavior behavior NOUN hx11xd10s04 9 9 of of ADP hx11xd10s04 9 10 six six NUM hx11xd10s04 9 11 invariance invariance NOUN hx11xd10s04 9 12 statistics statistic NOUN hx11xd10s04 9 13 , , PUNCT hx11xd10s04 9 14 focusing focus VERB hx11xd10s04 9 15 on on ADP hx11xd10s04 9 16 traits trait NOUN hx11xd10s04 9 17 that that PRON hx11xd10s04 9 18 might might AUX hx11xd10s04 9 19 affect affect VERB hx11xd10s04 9 20 their their PRON hx11xd10s04 9 21 indifference indifference NOUN hx11xd10s04 9 22 thresholds threshold NOUN hx11xd10s04 9 23 . . PUNCT hx11xd10s04 10 1 among among ADP hx11xd10s04 10 2 the the DET hx11xd10s04 10 3 results result NOUN hx11xd10s04 10 4 , , PUNCT hx11xd10s04 10 5 subgroup subgroup PROPN hx11xd10s04 10 6 relative relative ADJ hx11xd10s04 10 7 size size NOUN hx11xd10s04 10 8 was be AUX hx11xd10s04 10 9 found find VERB hx11xd10s04 10 10 to to PART hx11xd10s04 10 11 have have VERB hx11xd10s04 10 12 a a DET hx11xd10s04 10 13 large large ADJ hx11xd10s04 10 14 impact impact NOUN hx11xd10s04 10 15 on on ADP hx11xd10s04 10 16 focal focal ADJ hx11xd10s04 10 17 - - PUNCT hx11xd10s04 10 18 vs vs ADP hx11xd10s04 10 19 - - PUNCT hx11xd10s04 10 20 total total ADJ hx11xd10s04 10 21 invariance invariance NOUN hx11xd10s04 10 22 statistics statistic NOUN hx11xd10s04 10 23 . . PUNCT hx11xd10s04 11 1 pairwise pairwise NOUN hx11xd10s04 11 2 statistics statistic NOUN hx11xd10s04 11 3 were be AUX hx11xd10s04 11 4 less less ADV hx11xd10s04 11 5 sensitive sensitive ADJ hx11xd10s04 11 6 to to ADP hx11xd10s04 11 7 subgroup subgroup PROPN hx11xd10s04 11 8 relative relative ADJ hx11xd10s04 11 9 size size NOUN hx11xd10s04 11 10 and and CCONJ hx11xd10s04 11 11 often often ADV hx11xd10s04 11 12 acted act VERB hx11xd10s04 11 13 as as ADP hx11xd10s04 11 14 an an DET hx11xd10s04 11 15 estimate estimate NOUN hx11xd10s04 11 16 of of ADP hx11xd10s04 11 17 the the DET hx11xd10s04 11 18 upper upper ADJ hx11xd10s04 11 19 bound bind VERB hx11xd10s04 11 20 for for ADP hx11xd10s04 11 21 its its PRON hx11xd10s04 11 22 effect effect NOUN hx11xd10s04 11 23 . . PUNCT hx11xd10s04 12 1 next next ADV hx11xd10s04 12 2 , , PUNCT hx11xd10s04 12 3 an an DET hx11xd10s04 12 4 illustrative illustrative ADJ hx11xd10s04 12 5 data datum NOUN hx11xd10s04 12 6 analysis analysis NOUN hx11xd10s04 12 7 demonstrates demonstrate VERB hx11xd10s04 12 8 how how SCONJ hx11xd10s04 12 9 et et NOUN hx11xd10s04 12 10 of of ADP hx11xd10s04 12 11 subpopulation subpopulation NOUN hx11xd10s04 12 12 dependency dependency NOUN hx11xd10s04 12 13 can can AUX hx11xd10s04 12 14 be be AUX hx11xd10s04 12 15 performed perform VERB hx11xd10s04 12 16 and and CCONJ hx11xd10s04 12 17 applies apply VERB hx11xd10s04 12 18 the the DET hx11xd10s04 12 19 simulation simulation NOUN hx11xd10s04 12 20 results result VERB hx11xd10s04 12 21 to to PART hx11xd10s04 12 22 help help VERB hx11xd10s04 12 23 interpret interpret VERB hx11xd10s04 12 24 its its PRON hx11xd10s04 12 25 findings finding NOUN hx11xd10s04 12 26 . . PUNCT hx11xd10s04 13 1 finally finally ADV hx11xd10s04 13 2 , , PUNCT hx11xd10s04 13 3 we we PRON hx11xd10s04 13 4 conclude conclude VERB hx11xd10s04 13 5 by by ADP hx11xd10s04 13 6 summarizing summarizing NOUN hx11xd10s04 13 7 and and CCONJ hx11xd10s04 13 8 contextualizing contextualize VERB hx11xd10s04 13 9 the the DET hx11xd10s04 13 10 results result NOUN hx11xd10s04 13 11 and and CCONJ hx11xd10s04 13 12 discussing discuss VERB hx11xd10s04 13 13 what what PRON hx11xd10s04 13 14 can can AUX hx11xd10s04 13 15 be be AUX hx11xd10s04 13 16 done do VERB hx11xd10s04 13 17 if if SCONJ hx11xd10s04 13 18 subpopulation subpopulation NOUN hx11xd10s04 13 19 dependency dependency NOUN hx11xd10s04 13 20 is be AUX hx11xd10s04 13 21 found find VERB hx11xd10s04 13 22 . . PUNCT