id sid tid token lemma pos crl-13774 1 1 college college NOUN crl-13774 1 2 and and CCONJ crl-13774 1 3 research research NOUN crl-13774 1 4 libraries library NOUN crl-13774 1 5 larry larry PROPN crl-13774 1 6 hardesty hardesty PROPN crl-13774 1 7 , , PUNCT crl-13774 1 8 nicholas nicholas PROPN crl-13774 1 9 p. p. PROPN crl-13774 1 10 lovrich lovrich PROPN crl-13774 1 11 , , PUNCT crl-13774 1 12 jr jr PROPN crl-13774 1 13 . . PROPN crl-13774 1 14 , , PUNCT crl-13774 1 15 and and CCONJ crl-13774 1 16 james james PROPN crl-13774 1 17 mannon mannon PROPN crl-13774 1 18 library library PROPN crl-13774 1 19 - - PUNCT crl-13774 1 20 use use NOUN crl-13774 1 21 instruction instruction NOUN crl-13774 1 22 : : PUNCT crl-13774 1 23 assessment assessment NOUN crl-13774 1 24 of of ADP crl-13774 1 25 the the DET crl-13774 1 26 long long ADJ crl-13774 1 27 - - PUNCT crl-13774 1 28 term term NOUN crl-13774 1 29 effects effect NOUN crl-13774 1 30 the the DET crl-13774 1 31 recognition recognition NOUN crl-13774 1 32 by by ADP crl-13774 1 33 librarians librarians PROPN crl-13774 1 34 of of ADP crl-13774 1 35 the the DET crl-13774 1 36 growing grow VERB crl-13774 1 37 importance importance NOUN crl-13774 1 38 of of ADP crl-13774 1 39 evaluating evaluate VERB crl-13774 1 40 library library NOUN crl-13774 1 41 - - PUNCT crl-13774 1 42 use use NOUN crl-13774 1 43 instruction instruction NOUN crl-13774 1 44 is be AUX crl-13774 1 45 steadily steadily ADV crl-13774 1 46 increasing increase VERB crl-13774 1 47 , , PUNCT crl-13774 1 48 as as SCONJ crl-13774 1 49 evidenced evidence VERB crl-13774 1 50 by by ADP crl-13774 1 51 reports report NOUN crl-13774 1 52 in in ADP crl-13774 1 53 the the DET crl-13774 1 54 literature literature NOUN crl-13774 1 55 . . PUNCT crl-13774 2 1 however however ADV crl-13774 2 2 , , PUNCT crl-13774 2 3 much much ADJ crl-13774 2 4 work work NOUN crl-13774 2 5 has have VERB crl-13774 2 6 yet yet ADV crl-13774 2 7 to to PART crl-13774 2 8 be be AUX crl-13774 2 9 done do VERB crl-13774 2 10 which which PRON crl-13774 2 11 uses use VERB crl-13774 2 12 sophisticated sophisticated ADJ crl-13774 2 13 evaluation evaluation NOUN crl-13774 2 14 techniques technique NOUN crl-13774 2 15 . . PUNCT crl-13774 3 1 t]j t]j ADV crl-13774 3 2 , , PUNCT crl-13774 3 3 is be AUX crl-13774 3 4 paper paper NOUN crl-13774 3 5 reports report NOUN crl-13774 3 6 the the DET crl-13774 3 7 follow follow NOUN crl-13774 3 8 - - PUNCT crl-13774 3 9 up up NOUN crl-13774 3 10 of of ADP crl-13774 3 11 an an DET crl-13774 3 12 earlier early ADJ crl-13774 3 13 study study NOUN crl-13774 3 14 by by ADP crl-13774 3 15 examining examine VERB crl-13774 3 16 the the DET crl-13774 3 17 long long ADJ crl-13774 3 18 - - PUNCT crl-13774 3 19 term term NOUN crl-13774 3 20 retention retention NOUN crl-13774 3 21 of of ADP crl-13774 3 22 library library NOUN crl-13774 3 23 - - PUNCT crl-13774 3 24 use use NOUN crl-13774 3 25 skills skill NOUN crl-13774 3 26 . . PUNCT crl-13774 4 1 through through ADP crl-13774 4 2 use use NOUN crl-13774 4 3 of of ADP crl-13774 4 4 pretesting preteste VERB crl-13774 4 5 and and CCONJ crl-13774 4 6 posttesting posttesting ADJ crl-13774 4 7 , , PUNCT crl-13774 4 8 control control NOUN crl-13774 4 9 and and CCONJ crl-13774 4 10 experimental experimental ADJ crl-13774 4 11 gro~72s gro~72s ADJ crl-13774 4 12 , , PUNCT crl-13774 4 13 aggregate aggregate ADJ crl-13774 4 14 and and CCONJ crl-13774 4 15 individual individual ADJ crl-13774 4 16 comparisons comparison NOUN crl-13774 4 17 , , PUNCT crl-13774 4 18 multiple multiple ADJ crl-13774 4 19 regression regression NOUN crl-13774 4 20 , , PUNCT crl-13774 4 21 and and CCONJ crl-13774 4 22 other other ADJ crl-13774 4 23 techniques technique NOUN crl-13774 4 24 , , PUNCT crl-13774 4 25 the the DET crl-13774 4 26 authors author NOUN crl-13774 4 27 concluded conclude VERB crl-13774 4 28 that that SCONJ crl-13774 4 29 long long ADJ crl-13774 4 30 - - PUNCT crl-13774 4 31 term term NOUN crl-13774 4 32 possession possession NOUN crl-13774 4 33 of of ADP crl-13774 4 34 library library NOUN crl-13774 4 35 - - PUNCT crl-13774 4 36 use use NOUN crl-13774 4 37 skills skill NOUN crl-13774 4 38 is be AUX crl-13774 4 39 more more ADV crl-13774 4 40 highly highly ADV crl-13774 4 41 related related ADJ crl-13774 4 42 to to ADP crl-13774 4 43 library library NOUN crl-13774 4 44 - - PUNCT crl-13774 4 45 use use NOUN crl-13774 4 46 instruction instruction NOUN crl-13774 4 47 than than ADP crl-13774 4 48 to to ADP crl-13774 4 49 either either CCONJ crl-13774 4 50 inherent inherent ADJ crl-13774 4 51 intellectual intellectual ADJ crl-13774 4 52 ability ability NOUN crl-13774 4 53 or or CCONJ crl-13774 4 54 academic academic ADJ crl-13774 4 55 diligence diligence NOUN crl-13774 4 56 . . PUNCT crl-13774 5 1 in in ADP crl-13774 5 2 addition addition NOUN crl-13774 5 3 , , PUNCT crl-13774 5 4 the the DET crl-13774 5 5 authors author NOUN crl-13774 5 6 discuss discuss VERB crl-13774 5 7 the the DET crl-13774 5 8 appropriateness appropriateness NOUN crl-13774 5 9 of of ADP crl-13774 5 10 quantitative quantitative ADJ crl-13774 5 11 and and CCONJ crl-13774 5 12 qualitative qualitative ADJ crl-13774 5 13 methods method NOUN crl-13774 5 14 of of ADP crl-13774 5 15 evaluation evaluation NOUN crl-13774 5 16 and and CCONJ crl-13774 5 17 caution caution NOUN crl-13774 5 18 against against ADP crl-13774 5 19 taking take VERB crl-13774 5 20 for for ADP crl-13774 5 21 granted grant VERB crl-13774 5 22 the the DET crl-13774 5 23 effective effective ADJ crl-13774 5 24 use use NOUN crl-13774 5 25 of of ADP crl-13774 5 26 evaluation evaluation NOUN crl-13774 5 27 . . PUNCT crl-13774 6 1 the the DET crl-13774 6 2 offen offen ADJ crl-13774 6 3 quoted quote VERB crl-13774 6 4 remark remark NOUN crl-13774 6 5 about about ADP crl-13774 6 6 the the DET crl-13774 6 7 weather weather NOUN crl-13774 6 8 , , PUNCT crl-13774 6 9 which which PRON crl-13774 6 10 is be AUX crl-13774 6 11 typically typically ADV crl-13774 6 12 but but CCONJ crl-13774 6 13 erroneously erroneously ADV crl-13774 6 14 attributed attribute VERB crl-13774 6 15 to to ADP crl-13774 6 16 mark mark NOUN crl-13774 6 17 twain twain PROPN crl-13774 6 18 , , PUNCT crl-13774 6 19 1 1 NUM crl-13774 6 20 can can AUX crl-13774 6 21 be be AUX crl-13774 6 22 applied apply VERB crl-13774 6 23 to to ADP crl-13774 6 24 academic academic ADJ crl-13774 6 25 librarians librarian NOUN crl-13774 6 26 involved involve VERB crl-13774 6 27 in in ADP crl-13774 6 28 library library NOUN crl-13774 6 29 - - PUNCT crl-13774 6 30 use use NOUN crl-13774 6 31 instruction instruction NOUN crl-13774 6 32 : : PUNCT crl-13774 6 33 that that PRON crl-13774 6 34 is be AUX crl-13774 6 35 , , PUNCT crl-13774 6 36 there there PRON crl-13774 6 37 is be VERB crl-13774 6 38 a a DET crl-13774 6 39 good good ADJ crl-13774 6 40 deal deal NOUN crl-13774 6 41 of of ADP crl-13774 6 42 talking talk VERB crl-13774 6 43 about about ADP crl-13774 6 44 evaluation evaluation NOUN crl-13774 6 45 , , PUNCT crl-13774 6 46 but but CCONJ crl-13774 6 47 few few ADJ crl-13774 6 48 seem seem VERB crl-13774 6 49 to to PART crl-13774 6 50 be be AUX crl-13774 6 51 doing do VERB crl-13774 6 52 anything anything PRON crl-13774 6 53 about about ADP crl-13774 6 54 it it PRON crl-13774 6 55 . . PUNCT crl-13774 7 1 richard richard PROPN crl-13774 7 2 werking werking PROPN crl-13774 7 3 , , PUNCT crl-13774 7 4 in in ADP crl-13774 7 5 his his PRON crl-13774 7 6 excellent excellent ADJ crl-13774 7 7 review review NOUN crl-13774 7 8 and and CCONJ crl-13774 7 9 critique critique NOUN crl-13774 7 10 of of ADP crl-13774 7 11 the the DET crl-13774 7 12 literature literature NOUN crl-13774 7 13 evaluating evaluate VERB crl-13774 7 14 library library NOUN crl-13774 7 15 - - PUNCT crl-13774 7 16 use use NOUN crl-13774 7 17 instruction instruction NOUN crl-13774 7 18 , , PUNCT crl-13774 7 19 found find VERB crl-13774 7 20 published publish VERB crl-13774 7 21 evidence evidence NOUN crl-13774 7 22 of of ADP crl-13774 7 23 only only ADV crl-13774 7 24 a a DET crl-13774 7 25 handful handful NOUN crl-13774 7 26 of of ADP crl-13774 7 27 examples example NOUN crl-13774 7 28 . . PUNCT crl-13774 8 1 2 2 X crl-13774 8 2 he he PRON crl-13774 8 3 did do AUX crl-13774 8 4 note note VERB crl-13774 8 5 , , PUNCT crl-13774 8 6 however however ADV crl-13774 8 7 , , PUNCT crl-13774 8 8 a a DET crl-13774 8 9 growing grow VERB crl-13774 8 10 number number NOUN crl-13774 8 11 of of ADP crl-13774 8 12 articles article NOUN crl-13774 8 13 pertaining pertain VERB crl-13774 8 14 to to ADP crl-13774 8 15 the the DET crl-13774 8 16 evaluation evaluation NOUN crl-13774 8 17 of of ADP crl-13774 8 18 library library NOUN crl-13774 8 19 - - PUNCT crl-13774 8 20 use use NOUN crl-13774 8 21 instruction instruction NOUN crl-13774 8 22 programs program NOUN crl-13774 8 23 and and CCONJ crl-13774 8 24 techniques technique NOUN crl-13774 8 25 , , PUNCT crl-13774 8 26 including include VERB crl-13774 8 27 a a DET crl-13774 8 28 previous previous ADJ crl-13774 8 29 article article NOUN crl-13774 8 30 by by ADP crl-13774 8 31 the the DET crl-13774 8 32 authors author NOUN crl-13774 8 33 . . PUNCT crl-13774 9 1 3 3 NUM crl-13774 9 2 these these DET crl-13774 9 3 articles article NOUN crl-13774 9 4 play play VERB crl-13774 9 5 an an DET crl-13774 9 6 important important ADJ crl-13774 9 7 role role NOUN crl-13774 9 8 in in ADP crl-13774 9 9 demonstrating demonstrate VERB crl-13774 9 10 to to ADP crl-13774 9 11 academic academic ADJ crl-13774 9 12 lilarry lilarry NOUN crl-13774 9 13 hardesty hardesty NOUN crl-13774 9 14 is be AUX crl-13774 9 15 head head NOUN crl-13774 9 16 of of ADP crl-13774 9 17 the the DET crl-13774 9 18 reference reference NOUN crl-13774 9 19 department department PROPN crl-13774 9 20 , , PUNCT crl-13774 9 21 roy roy PROPN crl-13774 9 22 0 0 NUM crl-13774 9 23 . . PUNCT crl-13774 10 1 west west PROPN crl-13774 10 2 library library PROPN crl-13774 10 3 , , PUNCT crl-13774 10 4 depauw depauw PROPN crl-13774 10 5 university university PROPN crl-13774 10 6 , , PUNCT crl-13774 10 7 greencastle greencastle PROPN crl-13774 10 8 , , PUNCT crl-13774 10 9 indiana indiana PROPN crl-13774 10 10 . . PUNCT crl-13774 11 1 nicholas nicholas PROPN crl-13774 11 2 p. p. PROPN crl-13774 11 3 lovrich lovrich PROPN crl-13774 11 4 , , PUNCT crl-13774 11 5 ] ] PUNCT crl-13774 11 6 r. r. PROPN crl-13774 11 7 , , PUNCT crl-13774 11 8 is be AUX crl-13774 11 9 director director NOUN crl-13774 11 10 , , PUNCT crl-13774 11 11 division division NOUN crl-13774 11 12 of of ADP crl-13774 11 13 governmental governmental ADJ crl-13774 11 14 studies study NOUN crl-13774 11 15 & & CCONJ crl-13774 11 16 services service NOUN crl-13774 11 17 , , PUNCT crl-13774 11 18 washington washington PROPN crl-13774 11 19 state state PROPN crl-13774 11 20 university university PROPN crl-13774 11 21 , , PUNCT crl-13774 11 22 pullman pullman NOUN crl-13774 11 23 . . PUNCT crl-13774 12 1 ] ] PUNCT crl-13774 12 2 ames ames PROPN crl-13774 12 3 mannon mannon PROPN crl-13774 12 4 is be AUX crl-13774 12 5 assistant assistant ADJ crl-13774 12 6 professor professor NOUN crl-13774 12 7 of of ADP crl-13774 12 8 sociology sociology PROPN crl-13774 12 9 , , PUNCT crl-13774 12 10 depauw depauw PROPN crl-13774 12 11 university university PROPN crl-13774 12 12 . . PUNCT crl-13774 13 1 the the DET crl-13774 13 2 authors author NOUN crl-13774 13 3 acknowledge acknowledge VERB crl-13774 13 4 the the DET crl-13774 13 5 support support NOUN crl-13774 13 6 of of ADP crl-13774 13 7 the the DET crl-13774 13 8 council council NOUN crl-13774 13 9 on on ADP crl-13774 13 10 library library NOUN crl-13774 13 11 resources resource NOUN crl-13774 13 12 and and CCONJ crl-13774 13 13 the the DET crl-13774 13 14 national national ADJ crl-13774 13 15 endowment endowment NOUN crl-13774 13 16 for for ADP crl-13774 13 17 the the DET crl-13774 13 18 humanities humanity NOUN crl-13774 13 19 through through ADP crl-13774 13 20 their their PRON crl-13774 13 21 joint joint ADJ crl-13774 13 22 college college NOUN crl-13774 13 23 library library NOUN crl-13774 13 24 program program NOUN crl-13774 13 25 grant grant NOUN crl-13774 13 26 to to ADP crl-13774 13 27 depauw depauw PROPN crl-13774 13 28 university university PROPN crl-13774 13 29 for for ADP crl-13774 13 30 1977 1977 NUM crl-13774 13 31 - - SYM crl-13774 13 32 1982 1982 NUM crl-13774 13 33 , , PUNCT crl-13774 13 34 a a DET crl-13774 13 35 grant grant NOUN crl-13774 13 36 that that PRON crl-13774 13 37 made make VERB crl-13774 13 38 possible possible ADJ crl-13774 13 39 the the DET crl-13774 13 40 library library NOUN crl-13774 13 41 - - PUNCT crl-13774 13 42 use use NOUN crl-13774 13 43 instruction instruction NOUN crl-13774 13 44 program program NOUN crl-13774 13 45 and and CCONJ crl-13774 13 46 the the DET crl-13774 13 47 evaluation evaluation NOUN crl-13774 13 48 described describe VERB crl-13774 13 49 here here ADV crl-13774 13 50 . . PUNCT crl-13774 14 1 38 38 NUM crl-13774 15 1 i i PRON crl-13774 15 2 brarians brarian VERB crl-13774 15 3 the the DET crl-13774 15 4 various various ADJ crl-13774 15 5 techniques technique NOUN crl-13774 15 6 that that PRON crl-13774 15 7 can can AUX crl-13774 15 8 be be AUX crl-13774 15 9 used use VERB crl-13774 15 10 in in ADP crl-13774 15 11 library library PROPN crl-13774 15 12 program program NOUN crl-13774 15 13 evaluation evaluation NOUN crl-13774 15 14 , , PUNCT crl-13774 15 15 and and CCONJ crl-13774 15 16 in in ADP crl-13774 15 17 adding add VERB crl-13774 15 18 to to ADP crl-13774 15 19 the the DET crl-13774 15 20 developing develop VERB crl-13774 15 21 body body NOUN crl-13774 15 22 of of ADP crl-13774 15 23 knowledge knowledge NOUN crl-13774 15 24 concerning concern VERB crl-13774 15 25 the the DET crl-13774 15 26 effectiveness effectiveness NOUN crl-13774 15 27 of of ADP crl-13774 15 28 library library NOUN crl-13774 15 29 - - PUNCT crl-13774 15 30 use use NOUN crl-13774 15 31 instruction instruction NOUN crl-13774 15 32 . . PUNCT crl-13774 16 1 the the DET crl-13774 16 2 earlier early ADJ crl-13774 16 3 article article NOUN crl-13774 16 4 by by ADP crl-13774 16 5 the the DET crl-13774 16 6 authors author NOUN crl-13774 16 7 focused focus VERB crl-13774 16 8 on on ADP crl-13774 16 9 two two NUM crl-13774 16 10 particular particular ADJ crl-13774 16 11 goals goal NOUN crl-13774 16 12 : : PUNCT crl-13774 16 13 ( ( PUNCT crl-13774 16 14 1 1 X crl-13774 16 15 ) ) PUNCT crl-13774 16 16 documenting document VERB crl-13774 16 17 the the DET crl-13774 16 18 effects effect NOUN crl-13774 16 19 of of ADP crl-13774 16 20 library library NOUN crl-13774 16 21 - - PUNCT crl-13774 16 22 use use NOUN crl-13774 16 23 instruction instruction NOUN crl-13774 16 24 on on ADP crl-13774 16 25 the the DET crl-13774 16 26 shortterm shortterm ADJ crl-13774 16 27 acquisition acquisition NOUN crl-13774 16 28 of of ADP crl-13774 16 29 library library NOUN crl-13774 16 30 - - PUNCT crl-13774 16 31 use use NOUN crl-13774 16 32 skills skill NOUN crl-13774 16 33 ; ; PUNCT crl-13774 16 34 and and CCONJ crl-13774 16 35 ( ( PUNCT crl-13774 16 36 2 2 X crl-13774 16 37 ) ) PUNCT crl-13774 16 38 demonstrating demonstrate VERB crl-13774 16 39 a a DET crl-13774 16 40 methodology methodology NOUN crl-13774 16 41 that that PRON crl-13774 16 42 could could AUX crl-13774 16 43 be be AUX crl-13774 16 44 used use VERB crl-13774 16 45 successfully successfully ADV crl-13774 16 46 in in ADP crl-13774 16 47 such such DET crl-13774 16 48 an an DET crl-13774 16 49 evaluation evaluation NOUN crl-13774 16 50 . . PUNCT crl-13774 17 1 4 4 NUM crl-13774 17 2 the the DET crl-13774 17 3 authors author NOUN crl-13774 17 4 found find VERB crl-13774 17 5 that that SCONJ crl-13774 17 6 a a DET crl-13774 17 7 sample sample NOUN crl-13774 17 8 of of ADP crl-13774 17 9 depauw depauw PROPN crl-13774 17 10 university university PROPN crl-13774 17 11 students student NOUN crl-13774 17 12 exposed expose VERB crl-13774 17 13 to to ADP crl-13774 17 14 library library NOUN crl-13774 17 15 - - PUNCT crl-13774 17 16 use use NOUN crl-13774 17 17 instruction instruction NOUN crl-13774 17 18 programs program NOUN crl-13774 17 19 in in ADP crl-13774 17 20 their their PRON crl-13774 17 21 freshman freshman NOUN crl-13774 17 22 year year NOUN crl-13774 17 23 tended tend VERB crl-13774 17 24 to to PART crl-13774 17 25 score score VERB crl-13774 17 26 higherto higherto PROPN crl-13774 17 27 a a DET crl-13774 17 28 statistically statistically ADV crl-13774 17 29 significant significant ADJ crl-13774 17 30 degreeon degreeon NOUN crl-13774 17 31 a a DET crl-13774 17 32 paper paper NOUN crl-13774 17 33 and and CCONJ crl-13774 17 34 pencil pencil NOUN crl-13774 17 35 test test NOUN crl-13774 17 36 developed develop VERB crl-13774 17 37 by by ADP crl-13774 17 38 the the DET crl-13774 17 39 authors author NOUN crl-13774 17 40 to to PART crl-13774 17 41 measure measure VERB crl-13774 17 42 library library NOUN crl-13774 17 43 utilization utilization NOUN crl-13774 17 44 skills skill NOUN crl-13774 17 45 than than SCONJ crl-13774 17 46 did do VERB crl-13774 17 47 a a DET crl-13774 17 48 comparable comparable ADJ crl-13774 17 49 group group NOUN crl-13774 17 50 · · PUNCT crl-13774 17 51 of of ADP crl-13774 17 52 students student NOUN crl-13774 17 53 not not PART crl-13774 17 54 exposed expose VERB crl-13774 17 55 to to ADP crl-13774 17 56 library library NOUN crl-13774 17 57 - - PUNCT crl-13774 17 58 use use NOUN crl-13774 17 59 instruction instruction NOUN crl-13774 17 60 . . PUNCT crl-13774 18 1 in in ADP crl-13774 18 2 fact fact NOUN crl-13774 18 3 , , PUNCT crl-13774 18 4 as as SCONJ crl-13774 18 5 measured measure VERB crl-13774 18 6 by by ADP crl-13774 18 7 the the DET crl-13774 18 8 test test NOUN crl-13774 18 9 , , PUNCT crl-13774 18 10 the the DET crl-13774 18 11 short short ADJ crl-13774 18 12 - - PUNCT crl-13774 18 13 term term NOUN crl-13774 18 14 gains gain NOUN crl-13774 18 15 of of ADP crl-13774 18 16 the the DET crl-13774 18 17 freshmen freshman NOUN crl-13774 18 18 were be AUX crl-13774 18 19 comparable comparable ADJ crl-13774 18 20 to to ADP crl-13774 18 21 the the DET crl-13774 18 22 library library NOUN crl-13774 18 23 - - PUNCT crl-13774 18 24 use use NOUN crl-13774 18 25 skills skill NOUN crl-13774 18 26 of of ADP crl-13774 18 27 graduating graduate VERB crl-13774 18 28 seniors senior NOUN crl-13774 18 29 . . PUNCT crl-13774 19 1 werking werking NOUN crl-13774 19 2 , , PUNCT crl-13774 19 3 in in ADP crl-13774 19 4 citing cite VERB crl-13774 19 5 a a DET crl-13774 19 6 number number NOUN crl-13774 19 7 of of ADP crl-13774 19 8 librarians librarian NOUN crl-13774 19 9 associated associate VERB crl-13774 19 10 with with ADP crl-13774 19 11 library library NOUN crl-13774 19 12 - - PUNCT crl-13774 19 13 use use NOUN crl-13774 19 14 instruction instruction NOUN crl-13774 19 15 , , PUNCT crl-13774 19 16 reported report VERB crl-13774 19 17 that that SCONJ crl-13774 19 18 a a DET crl-13774 19 19 common common ADJ crl-13774 19 20 complaint complaint NOUN crl-13774 19 21 about about ADP crl-13774 19 22 such such ADJ crl-13774 19 23 tests test NOUN crl-13774 19 24 is be AUX crl-13774 19 25 " " PUNCT crl-13774 19 26 the the DET crl-13774 19 27 significance significance NOUN crl-13774 19 28 of of ADP crl-13774 19 29 such such ADJ crl-13774 19 30 short short ADJ crl-13774 19 31 - - PUNCT crl-13774 19 32 term term NOUN crl-13774 19 33 gains gain NOUN crl-13774 19 34 is be AUX crl-13774 19 35 not not PART crl-13774 19 36 likely likely ADJ crl-13774 19 37 to to PART crl-13774 19 38 be be AUX crl-13774 19 39 great great ADJ crl-13774 19 40 . . PUNCT crl-13774 19 41 "5 "5 PUNCT crl-13774 20 1 as as ADP crl-13774 20 2 werking werking NOUN crl-13774 20 3 · · PUNCT crl-13774 20 4 correctly correctly ADV crl-13774 20 5 observes observe VERB crl-13774 20 6 , , PUNCT crl-13774 20 7 the the DET crl-13774 20 8 question question NOUN crl-13774 20 9 of of ADP crl-13774 20 10 long long ADJ crl-13774 20 11 - - PUNCT crl-13774 20 12 term term NOUN crl-13774 20 13 retention retention NOUN crl-13774 20 14 of of ADP crl-13774 20 15 skills skill NOUN crl-13774 20 16 is be AUX crl-13774 20 17 a a DET crl-13774 20 18 very very ADV crl-13774 20 19 important important ADJ crl-13774 20 20 educational educational ADJ crl-13774 20 21 concern concern NOUN crl-13774 20 22 . . PUNCT crl-13774 21 1 in in ADP crl-13774 21 2 order order NOUN crl-13774 21 3 to to PART crl-13774 21 4 assess assess VERB crl-13774 21 5 the the DET crl-13774 21 6 question question NOUN crl-13774 21 7 of of ADP crl-13774 21 8 long long ADJ crl-13774 21 9 - - PUNCT crl-13774 21 10 term term NOUN crl-13774 21 11 retention retention NOUN crl-13774 21 12 of of ADP crl-13774 21 13 library library NOUN crl-13774 21 14 - - PUNCT crl-13774 21 15 use use NOUN crl-13774 21 16 skills skill NOUN crl-13774 21 17 , , PUNCT crl-13774 21 18 the the DET crl-13774 21 19 authors author NOUN crl-13774 21 20 have have AUX crl-13774 21 21 conducted conduct VERB crl-13774 21 22 a a DET crl-13774 21 23 follow follow NOUN crl-13774 21 24 - - PUNCT crl-13774 21 25 up up NOUN crl-13774 21 26 of of ADP crl-13774 21 27 the the DET crl-13774 21 28 earlier early ADJ crl-13774 21 29 depauw depauw PROPN crl-13774 21 30 university university PROPN crl-13774 21 31 study study NOUN crl-13774 21 32 . . PUNCT crl-13774 22 1 the the DET crl-13774 22 2 purpose purpose NOUN crl-13774 22 3 of of ADP crl-13774 22 4 this this DET crl-13774 22 5 article article NOUN crl-13774 22 6 is be AUX crl-13774 22 7 both both PRON crl-13774 22 8 to to PART crl-13774 22 9 report report VERB crl-13774 22 10 the the DET crl-13774 22 11 results result NOUN crl-13774 22 12 of of ADP crl-13774 22 13 this this DET crl-13774 22 14 follow follow VERB crl-13774 22 15 - - PUNCT crl-13774 22 16 up up ADP crl-13774 22 17 study study NOUN crl-13774 22 18 and and CCONJ crl-13774 22 19 to to PART crl-13774 22 20 explain explain VERB crl-13774 22 21 the the DET crl-13774 22 22 methodology methodology NOUN crl-13774 22 23 employed employ VERB crl-13774 22 24 so so SCONJ crl-13774 22 25 that that SCONJ crl-13774 22 26 other other ADJ crl-13774 22 27 librarians librarian NOUN crl-13774 22 28 may may AUX crl-13774 22 29 use use VERB crl-13774 22 30 it it PRON crl-13774 22 31 in in ADP crl-13774 22 32 conducting conduct VERB crl-13774 22 33 similar similar ADJ crl-13774 22 34 evaluations evaluation NOUN crl-13774 22 35 of of ADP crl-13774 22 36 library library NOUN crl-13774 22 37 - - PUNCT crl-13774 22 38 use use NOUN crl-13774 22 39 instruction instruction NOUN crl-13774 22 40 programs program NOUN crl-13774 22 41 . . PUNCT crl-13774 23 1 sampling sample VERB crl-13774 23 2 groups group NOUN crl-13774 23 3 the the DET crl-13774 23 4 present present ADJ crl-13774 23 5 study study NOUN crl-13774 23 6 analyzes analyze VERB crl-13774 23 7 data datum NOUN crl-13774 23 8 on on ADP crl-13774 23 9 several several ADJ crl-13774 23 10 samples sample NOUN crl-13774 23 11 of of ADP crl-13774 23 12 depauw depauw PROPN crl-13774 23 13 university university NOUN crl-13774 23 14 students student NOUN crl-13774 23 15 . . PUNCT crl-13774 24 1 for for ADP crl-13774 24 2 comparative comparative ADJ crl-13774 24 3 purposes purpose NOUN crl-13774 24 4 the the DET crl-13774 24 5 authors author NOUN crl-13774 24 6 included include VERB crl-13774 24 7 a a DET crl-13774 24 8 base base NOUN crl-13774 24 9 - - PUNCT crl-13774 24 10 line line NOUN crl-13774 24 11 group group NOUN crl-13774 24 12 of of ADP crl-13774 24 13 ninety ninety NUM crl-13774 24 14 - - PUNCT crl-13774 24 15 one one NUM crl-13774 24 16 depauw depauw PROPN crl-13774 24 17 university university NOUN crl-13774 24 18 seniors senior NOUN crl-13774 24 19 in in ADP crl-13774 24 20 the the DET crl-13774 24 21 1977 1977 NUM crl-13774 24 22 graduating graduating NOUN crl-13774 24 23 class class NOUN crl-13774 24 24 who who PRON crl-13774 24 25 reeeived reeeive VERB crl-13774 24 26 no no DET crl-13774 24 27 formal formal ADJ crl-13774 24 28 library library NOUN crl-13774 24 29 - - PUNCT crl-13774 24 30 use use NOUN crl-13774 24 31 instruction instruction NOUN crl-13774 24 32 from from ADP crl-13774 24 33 a a DET crl-13774 24 34 librarian librarian NOUN crl-13774 24 35 while while SCONJ crl-13774 24 36 attending attend VERB crl-13774 24 37 depauw depauw PROPN crl-13774 24 38 university university PROPN crl-13774 24 39 . . PUNCT crl-13774 25 1 a a DET crl-13774 25 2 second second ADJ crl-13774 25 3 major major ADJ crl-13774 25 4 sample sample NOUN crl-13774 25 5 group group NOUN crl-13774 25 6 consists consist VERB crl-13774 25 7 of of ADP crl-13774 25 8 312 312 NUM crl-13774 25 9 seniors senior NOUN crl-13774 25 10 in in ADP crl-13774 25 11 the the DET crl-13774 25 12 1980 1980 NUM crl-13774 25 13 graduating graduating NOUN crl-13774 25 14 class class NOUN crl-13774 25 15 who who PRON crl-13774 25 16 agreed agree VERB crl-13774 25 17 to to PART crl-13774 25 18 complete complete VERB crl-13774 25 19 a a DET crl-13774 25 20 questionnaire questionnaire NOUN crl-13774 25 21 containing contain VERB crl-13774 25 22 the the DET crl-13774 25 23 library library NOUN crl-13774 25 24 - - PUNCT crl-13774 25 25 use use NOUN crl-13774 25 26 skills skill NOUN crl-13774 25 27 test test NOUN crl-13774 25 28 reported report VERB crl-13774 25 29 in in ADP crl-13774 25 30 the the DET crl-13774 25 31 earlier early ADJ crl-13774 25 32 article article NOUN crl-13774 25 33 . . PUNCT crl-13774 26 1 these these DET crl-13774 26 2 312 312 NUM crl-13774 26 3 students student NOUN crl-13774 26 4 represent represent VERB crl-13774 26 5 a a DET crl-13774 26 6 sampling sample VERB crl-13774 26 7 return return NOUN crl-13774 26 8 rate rate NOUN crl-13774 26 9 of of ADP crl-13774 26 10 70 70 NUM crl-13774 26 11 percent percent NOUN crl-13774 26 12 of of ADP crl-13774 26 13 the the DET crl-13774 26 14 entire entire ADJ crl-13774 26 15 1980 1980 NUM crl-13774 26 16 depauw depauw PROPN crl-13774 26 17 university university PROPN crl-13774 26 18 graduating graduating NOUN crl-13774 26 19 class class NOUN crl-13774 26 20 , , PUNCT crl-13774 26 21 which which PRON crl-13774 26 22 was be AUX crl-13774 26 23 surveyed survey VERB crl-13774 26 24 in in ADP crl-13774 26 25 the the DET crl-13774 26 26 spring spring NOUN crl-13774 26 27 of of ADP crl-13774 26 28 1980 1980 NUM crl-13774 26 29 . . PUNCT crl-13774 27 1 the the DET crl-13774 27 2 third third ADJ crl-13774 27 3 sample sample NOUN crl-13774 27 4 group group NOUN crl-13774 27 5 consists consist VERB crl-13774 27 6 of of ADP crl-13774 27 7 a a DET crl-13774 27 8 panel panel NOUN crl-13774 27 9 of of ADP crl-13774 27 10 1980 1980 NUM crl-13774 27 11 seniors senior NOUN crl-13774 27 12 ( ( PUNCT crl-13774 27 13 eighty eighty NUM crl-13774 27 14 - - PUNCT crl-13774 27 15 two two NUM crl-13774 27 16 students student NOUN crl-13774 27 17 ) ) PUNCT crl-13774 27 18 who who PRON crl-13774 27 19 received receive VERB crl-13774 27 20 formal formal ADJ crl-13774 27 21 library library NOUN crl-13774 27 22 - - PUNCT crl-13774 27 23 use use NOUN crl-13774 27 24 in in ADP crl-13774 27 25 . . PUNCT crl-13774 28 1 struction struction NOUN crl-13774 28 2 as as ADP crl-13774 28 3 freshmen freshman NOUN crl-13774 28 4 in in ADP crl-13774 28 5 1977 1977 NUM crl-13774 28 6 and and CCONJ crl-13774 28 7 whose whose DET crl-13774 28 8 scores score NOUN crl-13774 28 9 were be AUX crl-13774 28 10 reported report VERB crl-13774 28 11 as as ADP crl-13774 28 12 part part NOUN crl-13774 28 13 of of ADP crl-13774 28 14 the the DET crl-13774 28 15 earlier early ADJ crl-13774 28 16 study study NOUN crl-13774 28 17 . . PUNCT crl-13774 29 1 they they PRON crl-13774 29 2 are be AUX crl-13774 29 3 a a DET crl-13774 29 4 subset subset NOUN crl-13774 29 5 of of ADP crl-13774 29 6 the the DET crl-13774 29 7 312 312 NUM crl-13774 29 8 seniors senior NOUN crl-13774 29 9 responding respond VERB crl-13774 29 10 to to ADP crl-13774 29 11 the the DET crl-13774 29 12 1980 1980 NUM crl-13774 29 13 survey survey NOUN crl-13774 29 14 . . PUNCT crl-13774 30 1 the the DET crl-13774 30 2 availability availability NOUN crl-13774 30 3 of of ADP crl-13774 30 4 information information NOUN crl-13774 30 5 gathered gather VERB crl-13774 30 6 over over ADP crl-13774 30 7 approximately approximately ADV crl-13774 30 8 a a DET crl-13774 30 9 three three NUM crl-13774 30 10 - - PUNCT crl-13774 30 11 year year NOUN crl-13774 30 12 period period NOUN crl-13774 30 13 makes make VERB crl-13774 30 14 the the DET crl-13774 30 15 evaluation evaluation NOUN crl-13774 30 16 of of ADP crl-13774 30 17 the the DET crl-13774 30 18 depauw depauw PROPN crl-13774 30 19 libraryuse libraryuse NOUN crl-13774 30 20 instruction instruction NOUN crl-13774 30 21 program program NOUN crl-13774 30 22 interesting interesting ADJ crl-13774 30 23 in in ADP crl-13774 30 24 anumber anumber NOUN crl-13774 30 25 of of ADP crl-13774 30 26 ways way NOUN crl-13774 30 27 . . PUNCT crl-13774 31 1 at at ADP crl-13774 31 2 the the DET crl-13774 31 3 most most ADV crl-13774 31 4 elemental elemental ADJ crl-13774 31 5 level level NOUN crl-13774 31 6 , , PUNCT crl-13774 31 7 the the DET crl-13774 31 8 skill skill NOUN crl-13774 31 9 - - PUNCT crl-13774 31 10 possession possession NOUN crl-13774 31 11 scores score NOUN crl-13774 31 12 of of ADP crl-13774 31 13 the the DET crl-13774 31 14 1980 1980 NUM crl-13774 31 15 seniors senior NOUN crl-13774 31 16 can can AUX crl-13774 31 17 be be AUX crl-13774 31 18 compared compare VERB crl-13774 31 19 with with ADP crl-13774 31 20 those those PRON crl-13774 31 21 of of ADP crl-13774 31 22 their their PRON crl-13774 31 23 1977 1977 NUM crl-13774 31 24 counterparts counterpart NOUN crl-13774 31 25 , , PUNCT crl-13774 31 26 the the DET crl-13774 31 27 students student NOUN crl-13774 31 28 who who PRON crl-13774 31 29 had have VERB crl-13774 31 30 no no DET crl-13774 31 31 formal formal ADJ crl-13774 31 32 library library NOUN crl-13774 31 33 - - PUNCT crl-13774 31 34 use use NOUN crl-13774 31 35 instruction instruction NOUN crl-13774 31 36 . . PUNCT crl-13774 32 1 second second ADJ crl-13774 32 2 , , PUNCT crl-13774 32 3 such such ADJ crl-13774 32 4 data datum NOUN crl-13774 32 5 can can AUX crl-13774 32 6 be be AUX crl-13774 32 7 employed employ VERB crl-13774 32 8 to to PART crl-13774 32 9 address address VERB crl-13774 32 10 the the DET crl-13774 32 11 question question NOUN crl-13774 32 12 of of ADP crl-13774 32 13 whether whether SCONJ crl-13774 32 14 the the DET crl-13774 32 15 degree degree NOUN crl-13774 32 16 of of ADP crl-13774 32 17 exposure exposure NOUN crl-13774 32 18 to to ADP crl-13774 32 19 formal formal ADJ crl-13774 32 20 library library NOUN crl-13774 32 21 - - PUNCT crl-13774 32 22 use use NOUN crl-13774 32 23 instruction instruction NOUN crl-13774 32 24 is be AUX crl-13774 32 25 associated associate VERB crl-13774 32 26 with with ADP crl-13774 32 27 the the DET crl-13774 32 28 level level NOUN crl-13774 32 29 of of ADP crl-13774 32 30 library library NOUN crl-13774 32 31 - - PUNCT crl-13774 32 32 use use NOUN crl-13774 32 33 skills skill NOUN crl-13774 32 34 . . PUNCT crl-13774 33 1 in in ADP crl-13774 33 2 this this DET crl-13774 33 3 connection connection NOUN crl-13774 33 4 , , PUNCT crl-13774 33 5 it it PRON crl-13774 33 6 can can AUX crl-13774 33 7 be be AUX crl-13774 33 8 determined determine VERB crl-13774 33 9 whether whether SCONJ crl-13774 33 10 library library NOUN crl-13774 33 11 - - PUNCT crl-13774 33 12 use use NOUN crl-13774 33 13 skills skill NOUN crl-13774 33 14 are be AUX crl-13774 33 15 more more ADV crl-13774 33 16 closely closely ADV crl-13774 33 17 related related ADJ crl-13774 33 18 to to ADP crl-13774 33 19 library library NOUN crl-13774 33 20 - - PUNCT crl-13774 33 21 use use NOUN crl-13774 33 22 instruction instruction NOUN crl-13774 33 23 than than ADP crl-13774 33 24 to to ADP crl-13774 33 25 other other ADJ crl-13774 33 26 plausible plausible ADJ crl-13774 33 27 predictors predictor NOUN crl-13774 33 28 of of ADP crl-13774 33 29 skills skill NOUN crl-13774 33 30 possession possession NOUN crl-13774 33 31 such such ADJ crl-13774 33 32 as as ADP crl-13774 33 33 basic basic ADJ crl-13774 33 34 intellectual intellectual ADJ crl-13774 33 35 ' ' PUNCT crl-13774 33 36 capacity capacity NOUN crl-13774 33 37 or or CCONJ crl-13774 33 38 academic academic ADJ crl-13774 33 39 diligence diligence NOUN crl-13774 33 40 . . PUNCT crl-13774 34 1 in in ADP crl-13774 34 2 addition addition NOUN crl-13774 34 3 to to ADP crl-13774 34 4 determining determine VERB crl-13774 34 5 the the DET crl-13774 34 6 relative relative ADJ crl-13774 34 7 degrees degree NOUN crl-13774 34 8 of of ADP crl-13774 34 9 association association NOUN crl-13774 34 10 between between ADP crl-13774 34 11 skills skill NOUN crl-13774 34 12 possession possession PROPN crl-13774 34 13 library library NOUN crl-13774 34 14 - - PUNCT crl-13774 34 15 use use NOUN crl-13774 34 16 instruction instruction NOUN crl-13774 34 17 i i NOUN crl-13774 34 18 39 39 NUM crl-13774 34 19 and and CCONJ crl-13774 34 20 academic academic ADJ crl-13774 34 21 background background NOUN crl-13774 34 22 and and CCONJ crl-13774 34 23 instructional instructional ADJ crl-13774 34 24 exposure exposure NOUN crl-13774 34 25 among among ADP crl-13774 34 26 1980 1980 NUM crl-13774 34 27 graduating graduating NOUN crl-13774 34 28 seniors senior NOUN crl-13774 34 29 , , PUNCT crl-13774 34 30 multiple multiple ADJ crl-13774 34 31 regression regression NOUN crl-13774 34 32 analysis analysis NOUN crl-13774 34 33 can can AUX crl-13774 34 34 be be AUX crl-13774 34 35 utilized utilize VERB crl-13774 34 36 to to PART crl-13774 34 37 determine determine VERB crl-13774 34 38 how how SCONJ crl-13774 34 39 much much ADJ crl-13774 34 40 variation variation NOUN crl-13774 34 41 in in ADP crl-13774 34 42 skill skill NOUN crl-13774 34 43 possession possession NOUN crl-13774 34 44 can can AUX crl-13774 34 45 be be AUX crl-13774 34 46 explained explain VERB crl-13774 34 47 by by ADP crl-13774 34 48 each each PRON crl-13774 34 49 of of ADP crl-13774 34 50 the the DET crl-13774 34 51 predictors predictor NOUN crl-13774 34 52 while while SCONJ crl-13774 34 53 controlling control VERB crl-13774 34 54 the the DET crl-13774 34 55 effects effect NOUN crl-13774 34 56 of of ADP crl-13774 34 57 the the DET crl-13774 34 58 remaining remain VERB crl-13774 34 59 determinants determinant NOUN crl-13774 34 60 . . PUNCT crl-13774 35 1 finally finally ADV crl-13774 35 2 , , PUNCT crl-13774 35 3 the the DET crl-13774 35 4 availability availability NOUN crl-13774 35 5 of of ADP crl-13774 35 6 panel panel NOUN crl-13774 35 7 data datum NOUN crl-13774 35 8 for for ADP crl-13774 35 9 more more ADJ crl-13774 35 10 than than ADP crl-13774 35 11 eighty eighty NUM crl-13774 35 12 of of ADP crl-13774 35 13 the the DET crl-13774 35 14 1980 1980 NUM crl-13774 35 15 graduating graduating NOUN crl-13774 35 16 seniors senior NOUN crl-13774 35 17 - - PUNCT crl-13774 35 18 data datum NOUN crl-13774 35 19 that that PRON crl-13774 35 20 include include VERB crl-13774 35 21 preinstructional preinstructional ADJ crl-13774 35 22 , , PUNCT crl-13774 35 23 short short ADJ crl-13774 35 24 - - PUNCT crl-13774 35 25 term term NOUN crl-13774 35 26 postinstructional postinstructional NOUN crl-13774 35 27 , , PUNCT crl-13774 35 28 and and CCONJ crl-13774 35 29 long long ADJ crl-13774 35 30 - - PUNCT crl-13774 35 31 term term NOUN crl-13774 35 32 postinstructional postinstructional ADJ crl-13774 35 33 assessments assessment NOUN crl-13774 35 34 of of ADP crl-13774 35 35 library library NOUN crl-13774 35 36 - - PUNCT crl-13774 35 37 use use NOUN crl-13774 35 38 skillsallows skillsallow VERB crl-13774 35 39 the the DET crl-13774 35 40 direct direct ADJ crl-13774 35 41 testing testing NOUN crl-13774 35 42 of of ADP crl-13774 35 43 short short ADJ crl-13774 35 44 - - PUNCT crl-13774 35 45 term term NOUN crl-13774 35 46 and and CCONJ crl-13774 35 47 long long ADJ crl-13774 35 48 - - PUNCT crl-13774 35 49 term term NOUN crl-13774 35 50 library library NOUN crl-13774 35 51 - - PUNCT crl-13774 35 52 use use NOUN crl-13774 35 53 skills skill NOUN crl-13774 35 54 resulting result VERB crl-13774 35 55 from from ADP crl-13774 35 56 library library NOUN crl-13774 35 57 - - PUNCT crl-13774 35 58 use use NOUN crl-13774 35 59 instruction instruction NOUN crl-13774 35 60 and and CCONJ crl-13774 35 61 the the DET crl-13774 35 62 other other ADJ crl-13774 35 63 predictors predictor NOUN crl-13774 35 64 . . PUNCT crl-13774 36 1 because because SCONJ crl-13774 36 2 the the DET crl-13774 36 3 central central ADJ crl-13774 36 4 question question NOUN crl-13774 36 5 of of ADP crl-13774 36 6 this this DET crl-13774 36 7 evaluation evaluation NOUN crl-13774 36 8 pertains pertain VERB crl-13774 36 9 to to ADP crl-13774 36 10 the the DET crl-13774 36 11 long long ADJ crl-13774 36 12 - - PUNCT crl-13774 36 13 term term NOUN crl-13774 36 14 effects effect NOUN crl-13774 36 15 of of ADP crl-13774 36 16 the the DET crl-13774 36 17 library library NOUN crl-13774 36 18 - - PUNCT crl-13774 36 19 use use NOUN crl-13774 36 20 instruction instruction NOUN crl-13774 36 21 , , PUNCT crl-13774 36 22 a a DET crl-13774 36 23 brief brief ADJ crl-13774 36 24 explanation explanation NOUN crl-13774 36 25 of of ADP crl-13774 36 26 the the DET crl-13774 36 27 efficacy efficacy NOUN crl-13774 36 28 of of ADP crl-13774 36 29 a a DET crl-13774 36 30 panel panel NOUN crl-13774 36 31 study study NOUN crl-13774 36 32 is be AUX crl-13774 36 33 in in ADP crl-13774 36 34 order order NOUN crl-13774 36 35 . . PUNCT crl-13774 37 1 a a DET crl-13774 37 2 panel panel NOUN crl-13774 37 3 is be AUX crl-13774 37 4 a a DET crl-13774 37 5 " " PUNCT crl-13774 37 6 special special ADJ crl-13774 37 7 type type NOUN crl-13774 37 8 of of ADP crl-13774 37 9 time time NOUN crl-13774 37 10 - - PUNCT crl-13774 37 11 series series NOUN crl-13774 37 12 technique technique NOUN crl-13774 37 13 ; ; PUNCT crl-13774 37 14 it it PRON crl-13774 37 15 measures measure VERB crl-13774 37 16 some some DET crl-13774 37 17 attributes attribute NOUN crl-13774 37 18 of of ADP crl-13774 37 19 a a DET crl-13774 37 20 given give VERB crl-13774 37 21 sample sample NOUN crl-13774 37 22 of of ADP crl-13774 37 23 people people NOUN crl-13774 37 24 at at ADP crl-13774 37 25 several several ADJ crl-13774 37 26 moments moment NOUN crl-13774 37 27 . . PUNCT crl-13774 38 1 " " PUNCT crl-13774 38 2 6 6 NUM crl-13774 38 3 in in ADP crl-13774 38 4 other other ADJ crl-13774 38 5 words word NOUN crl-13774 38 6 , , PUNCT crl-13774 38 7 panel panel NOUN crl-13774 38 8 studies study NOUN crl-13774 38 9 involve involve VERB crl-13774 38 10 repeated repeat VERB crl-13774 38 11 observations observation NOUN crl-13774 38 12 of of ADP crl-13774 38 13 a a DET crl-13774 38 14 sample sample NOUN crl-13774 38 15 of of ADP crl-13774 38 16 persons person NOUN crl-13774 38 17 in in ADP crl-13774 38 18 order order NOUN crl-13774 38 19 to to PART crl-13774 38 20 assess assess VERB crl-13774 38 21 changes change NOUN crl-13774 38 22 over over ADP crl-13774 38 23 time time NOUN crl-13774 38 24 . . PUNCT crl-13774 39 1 panel panel NOUN crl-13774 39 2 studies study NOUN crl-13774 39 3 are be AUX crl-13774 39 4 considered consider VERB crl-13774 39 5 to to PART crl-13774 39 6 have have VERB crl-13774 39 7 great great ADJ crl-13774 39 8 statistical statistical ADJ crl-13774 39 9 efficiency efficiency NOUN crl-13774 39 10 because because SCONJ crl-13774 39 11 individuals individual NOUN crl-13774 39 12 in in ADP crl-13774 39 13 the the DET crl-13774 39 14 sample sample NOUN crl-13774 39 15 can can AUX crl-13774 39 16 be be AUX crl-13774 39 17 compared compare VERB crl-13774 39 18 with with ADP crl-13774 39 19 themselves themselves PRON crl-13774 39 20 at at ADP crl-13774 39 21 various various ADJ crl-13774 39 22 points point NOUN crl-13774 39 23 in in ADP crl-13774 39 24 time time NOUN crl-13774 39 25 , , PUNCT crl-13774 39 26 thereby thereby ADV crl-13774 39 27 reducing reduce VERB crl-13774 39 28 extraneous extraneous ADJ crl-13774 39 29 variability variability NOUN crl-13774 39 30 , , PUNCT crl-13774 39 31 and and CCONJ crl-13774 39 32 allowing allow VERB crl-13774 39 33 for for ADP crl-13774 39 34 direct direct ADJ crl-13774 39 35 individual individual ADJ crl-13774 39 36 comparison comparison NOUN crl-13774 39 37 . . PUNCT crl-13774 40 1 in in ADP crl-13774 40 2 short short ADJ crl-13774 40 3 , , PUNCT crl-13774 40 4 panelg panelg NOUN crl-13774 40 5 .. .. PUNCT crl-13774 40 6 are be AUX crl-13774 40 7 " " PUNCT crl-13774 40 8 useful useful ADJ crl-13774 40 9 for for ADP crl-13774 40 10 studying study VERB crl-13774 40 11 the the DET crl-13774 40 12 effects effect NOUN crl-13774 40 13 of of ADP crl-13774 40 14 specifically specifically ADV crl-13774 40 15 introduced introduce VERB crl-13774 40 16 measures measure NOUN crl-13774 40 17 . . PUNCT crl-13774 41 1 " " PUNCT crl-13774 41 2 7 7 NUM crl-13774 41 3 this this DET crl-13774 41 4 method method NOUN crl-13774 41 5 enabled enable VERB crl-13774 41 6 the the DET crl-13774 41 7 authors author NOUN crl-13774 41 8 to to PART crl-13774 41 9 select select VERB crl-13774 41 10 a a DET crl-13774 41 11 sample sample NOUN crl-13774 41 12 of of ADP crl-13774 41 13 freshmen freshmen ADJ crl-13774 41 14 students student NOUN crl-13774 41 15 in in ADP crl-13774 41 16 1977 1977 NUM crl-13774 41 17 , , PUNCT crl-13774 41 18 provide provide VERB crl-13774 41 19 some some PRON crl-13774 41 20 of of ADP crl-13774 41 21 them they PRON crl-13774 41 22 with with ADP crl-13774 41 23 a a DET crl-13774 41 24 series series NOUN crl-13774 41 25 of of ADP crl-13774 41 26 library library NOUN crl-13774 41 27 - - PUNCT crl-13774 41 28 use use NOUN crl-13774 41 29 instruction instruction NOUN crl-13774 41 30 sessions session NOUN crl-13774 41 31 , , PUNCT crl-13774 41 32 and and CCONJ crl-13774 41 33 compare compare VERB crl-13774 41 34 their their PRON crl-13774 41 35 scores score NOUN crl-13774 41 36 on on ADP crl-13774 41 37 the the DET crl-13774 41 38 skills skill NOUN crl-13774 41 39 test test NOUN crl-13774 41 40 at at ADP crl-13774 41 41 three three NUM crl-13774 41 42 points point NOUN crl-13774 41 43 in in ADP crl-13774 41 44 timeprior timeprior NOUN crl-13774 41 45 to to ADP crl-13774 41 46 the the DET crl-13774 41 47 original original ADJ crl-13774 41 48 instruction instruction NOUN crl-13774 41 49 ( ( PUNCT crl-13774 41 50 1977 1977 NUM crl-13774 41 51 ) ) PUNCT crl-13774 41 52 , , PUNCT crl-13774 41 53 eight eight NUM crl-13774 41 54 weeks week NOUN crl-13774 41 55 after after ADP crl-13774 41 56 the the DET crl-13774 41 57 instruction instruction NOUN crl-13774 41 58 ( ( PUNCT crl-13774 41 59 1977 1977 NUM crl-13774 41 60 ) ) PUNCT crl-13774 41 61 , , PUNCT crl-13774 41 62 and and CCONJ crl-13774 41 63 as as ADP crl-13774 41 64 seniors senior NOUN crl-13774 41 65 in in ADP crl-13774 41 66 1980 1980 NUM crl-13774 41 67 . . PUNCT crl-13774 42 1 quantitative quantitative ADJ crl-13774 42 2 versus versus ADP crl-13774 42 3 qualitative qualitative ADJ crl-13774 42 4 evaluation evaluation NOUN crl-13774 42 5 what what PRON crl-13774 42 6 follows follow VERB crl-13774 42 7 is be AUX crl-13774 42 8 largely largely ADV crl-13774 42 9 a a DET crl-13774 42 10 quantitative quantitative ADJ crl-13774 42 11 analysis analysis NOUN crl-13774 42 12 that that PRON crl-13774 42 13 utilizes utilize VERB crl-13774 42 14 statistical statistical ADJ crl-13774 42 15 methods method NOUN crl-13774 42 16 to to PART crl-13774 42 17 investigate investigate VERB crl-13774 42 18 the the DET crl-13774 42 19 subject subject NOUN crl-13774 42 20 of of ADP crl-13774 42 21 evaluation evaluation NOUN crl-13774 42 22 . . PUNCT crl-13774 43 1 werking werking NOUN crl-13774 43 2 , , PUNCT crl-13774 43 3 in in ADP crl-13774 43 4 his his PRON crl-13774 43 5 1980 1980 NUM crl-13774 43 6 article article NOUN crl-13774 43 7 , , PUNCT crl-13774 43 8 is be AUX crl-13774 43 9 critical critical ADJ crl-13774 43 10 of of ADP crl-13774 43 11 such such DET crl-13774 43 12 an an DET crl-13774 43 13 approach approach NOUN crl-13774 43 14 for for ADP crl-13774 43 15 determining determine VERB crl-13774 43 16 " " PUNCT crl-13774 43 17 proof proof NOUN crl-13774 43 18 ' ' PUNCT crl-13774 43 19 of of ADP crl-13774 43 20 effectiveness effectiveness NOUN crl-13774 43 21 in in ADP crl-13774 43 22 the the DET crl-13774 43 23 evaluation evaluation NOUN crl-13774 43 24 of of ADP crl-13774 43 25 library library NOUN crl-13774 43 26 - - PUNCT crl-13774 43 27 use use NOUN crl-13774 43 28 instruction instruction NOUN crl-13774 43 29 . . PUNCT crl-13774 44 1 8 8 NUM crl-13774 44 2 without without ADP crl-13774 44 3 denying deny VERB crl-13774 44 4 the the DET crl-13774 44 5 value value NOUN crl-13774 44 6 of of ADP crl-13774 44 7 werking werking NOUN crl-13774 44 8 's 's PART crl-13774 44 9 observations observation NOUN crl-13774 44 10 , , PUNCT crl-13774 44 11 the the DET crl-13774 44 12 authors author NOUN crl-13774 44 13 nevertheless nevertheless ADV crl-13774 44 14 believe believe VERB crl-13774 44 15 they they PRON crl-13774 44 16 are be AUX crl-13774 44 17 justified justify VERB crl-13774 44 18 on on ADP crl-13774 44 19 several several ADJ crl-13774 44 20 sound sound ADJ crl-13774 44 21 grounds ground NOUN crl-13774 44 22 in in ADP crl-13774 44 23 using use VERB crl-13774 44 24 a a DET crl-13774 44 25 quantitative quantitative ADJ crl-13774 44 26 ap40 ap40 NOUN crl-13774 44 27 i i PROPN crl-13774 44 28 college college PROPN crl-13774 44 29 & & CCONJ crl-13774 44 30 research research PROPN crl-13774 44 31 libraries library NOUN crl-13774 44 32 • • ADJ crl-13774 44 33 january january PROPN crl-13774 44 34 1982 1982 NUM crl-13774 44 35 proach proach NOUN crl-13774 44 36 . . PUNCT crl-13774 45 1 while while SCONJ crl-13774 45 2 qualitative qualitative ADJ crl-13774 45 3 evaluation evaluation NOUN crl-13774 45 4 is be AUX crl-13774 45 5 certainly certainly ADV crl-13774 45 6 legitimate legitimate ADJ crl-13774 45 7 in in ADP crl-13774 45 8 many many ADJ crl-13774 45 9 evaluation evaluation NOUN crl-13774 45 10 contexts context NOUN crl-13774 45 11 , , PUNCT crl-13774 45 12 quantitative quantitative ADJ crl-13774 45 13 evaluation evaluation NOUN crl-13774 45 14 is be AUX crl-13774 45 15 no no PRON crl-13774 45 16 less less ADV crl-13774 45 17 praiseworthy praiseworthy NOUN crl-13774 45 18 . . PUNCT crl-13774 46 1 quantitative quantitative ADJ crl-13774 46 2 evaluation evaluation NOUN crl-13774 46 3 has have AUX crl-13774 46 4 come come VERB crl-13774 46 5 under under ADP crl-13774 46 6 severe severe ADJ crl-13774 46 7 criticism criticism NOUN crl-13774 46 8 , , PUNCT crl-13774 46 9 in in ADP crl-13774 46 10 part part NOUN crl-13774 46 11 as as ADP crl-13774 46 12 an an DET crl-13774 46 13 outgrowth outgrowth NOUN crl-13774 46 14 of of ADP crl-13774 46 15 the the DET crl-13774 46 16 results result NOUN crl-13774 46 17 of of ADP crl-13774 46 18 the the DET crl-13774 46 19 westinghouse westinghouse PROPN crl-13774 46 20 learning learning PROPN crl-13774 46 21 corporation corporation NOUN crl-13774 46 22 's 's PART crl-13774 46 23 evaluation evaluation NOUN crl-13774 46 24 of of ADP crl-13774 46 25 the the DET crl-13774 46 26 head head NOUN crl-13774 46 27 start start VERB crl-13774 46 28 program program NOUN crl-13774 46 29 . . PUNCT crl-13774 47 1 9 9 NUM crl-13774 47 2 westinghouse westinghouse PROPN crl-13774 47 3 's 's PART crl-13774 47 4 evaluators evaluator NOUN crl-13774 47 5 found find VERB crl-13774 47 6 , , PUNCT crl-13774 47 7 through through ADP crl-13774 47 8 using use VERB crl-13774 47 9 largely largely ADV crl-13774 47 10 quantitative quantitative ADJ crl-13774 47 11 methods method NOUN crl-13774 47 12 , , PUNCT crl-13774 47 13 that that SCONJ crl-13774 47 14 the the DET crl-13774 47 15 effects effect NOUN crl-13774 47 16 of of ADP crl-13774 47 17 head head NOUN crl-13774 47 18 start start AUX crl-13774 47 19 tended tend VERB crl-13774 47 20 to to PART crl-13774 47 21 fade fade VERB crl-13774 47 22 when when SCONJ crl-13774 47 23 the the DET crl-13774 47 24 children child NOUN crl-13774 47 25 returned return VERB crl-13774 47 26 to to ADP crl-13774 47 27 poverty poverty NOUN crl-13774 47 28 homes home NOUN crl-13774 47 29 and and CCONJ crl-13774 47 30 ghetto ghetto NOUN crl-13774 47 31 schools school NOUN crl-13774 47 32 , , PUNCT crl-13774 47 33 and and CCONJ crl-13774 47 34 this this DET crl-13774 47 35 evaluation evaluation NOUN crl-13774 47 36 of of ADP crl-13774 47 37 a a DET crl-13774 47 38 programpopular programpopular NOUN crl-13774 47 39 both both CCONJ crl-13774 47 40 in in ADP crl-13774 47 41 congress congress PROPN crl-13774 47 42 and and CCONJ crl-13774 47 43 urban urban PROPN crl-13774 47 44 communitiesmet communitiesmet NOUN crl-13774 47 45 with with ADP crl-13774 47 46 sharp sharp ADJ crl-13774 47 47 criticism criticism NOUN crl-13774 47 48 , , PUNCT crl-13774 47 49 particularly particularly ADV crl-13774 47 50 with with ADP crl-13774 47 51 respect respect NOUN crl-13774 47 52 to to ADP crl-13774 47 53 the the DET crl-13774 47 54 methodology methodology NOUN crl-13774 47 55 used use VERB crl-13774 47 56 . . PUNCT crl-13774 48 1 the the DET crl-13774 48 2 result result NOUN crl-13774 48 3 has have AUX crl-13774 48 4 been be AUX crl-13774 48 5 that that SCONJ crl-13774 48 6 many many ADJ crl-13774 48 7 educational educational ADJ crl-13774 48 8 - - PUNCT crl-13774 48 9 program program NOUN crl-13774 48 10 evaluators evaluator NOUN crl-13774 48 11 now now ADV crl-13774 48 12 look look VERB crl-13774 48 13 to to PART crl-13774 48 14 alternate alternate VERB crl-13774 48 15 methodologies methodology NOUN crl-13774 48 16 , , PUNCT crl-13774 48 17 to to ADP crl-13774 48 18 techniques technique NOUN crl-13774 48 19 such such ADJ crl-13774 48 20 as as ADP crl-13774 48 21 the the DET crl-13774 48 22 qualitative qualitative ADJ crl-13774 48 23 assessments assessment NOUN crl-13774 48 24 used use VERB crl-13774 48 25 in in ADP crl-13774 48 26 anthropology anthropology NOUN crl-13774 48 27 and and CCONJ crl-13774 48 28 sociology sociology NOUN crl-13774 48 29 .10 .10 NUM crl-13774 48 30 at at ADV crl-13774 48 31 least least ADV crl-13774 48 32 one one NUM crl-13774 48 33 observer observer NOUN crl-13774 48 34 has have AUX crl-13774 48 35 suggested suggest VERB crl-13774 48 36 that that PRON crl-13774 48 37 had have AUX crl-13774 48 38 the the DET crl-13774 48 39 westinghouse westinghouse PROPN crl-13774 48 40 study study NOUN crl-13774 48 41 found find VERB crl-13774 48 42 positive positive ADJ crl-13774 48 43 effects effect NOUN crl-13774 48 44 for for ADP crl-13774 48 45 head head NOUN crl-13774 48 46 start start NOUN crl-13774 48 47 , , PUNCT crl-13774 48 48 there there PRON crl-13774 48 49 would would AUX crl-13774 48 50 have have AUX crl-13774 48 51 been be AUX crl-13774 48 52 few few ADJ crl-13774 48 53 questions question NOUN crl-13774 48 54 raised raise VERB crl-13774 48 55 about about ADP crl-13774 48 56 the the DET crl-13774 48 57 adequacy adequacy NOUN crl-13774 48 58 of of ADP crl-13774 48 59 the the DET crl-13774 48 60 quantitative quantitative ADJ crl-13774 48 61 methodology.11 methodology.11 NOUN crl-13774 48 62 no no DET crl-13774 48 63 belittlement belittlement ADJ crl-13774 48 64 of of ADP crl-13774 48 65 the the DET crl-13774 48 66 positive positive ADJ crl-13774 48 67 dimensions dimension NOUN crl-13774 48 68 that that PRON crl-13774 48 69 qualitative qualitative ADJ crl-13774 48 70 methodology methodology NOUN crl-13774 48 71 has have AUX crl-13774 48 72 brought bring VERB crl-13774 48 73 to to ADP crl-13774 48 74 evaluation evaluation NOUN crl-13774 48 75 is be AUX crl-13774 48 76 intended intend VERB crl-13774 48 77 ; ; PUNCT crl-13774 48 78 little little ADJ crl-13774 48 79 is be AUX crl-13774 48 80 to to PART crl-13774 48 81 be be AUX crl-13774 48 82 gained gain VERB crl-13774 48 83 by by ADP crl-13774 48 84 a a DET crl-13774 48 85 time time NOUN crl-13774 48 86 - - PUNCT crl-13774 48 87 consuming consume VERB crl-13774 48 88 and and CCONJ crl-13774 48 89 unproductive unproductive ADJ crl-13774 48 90 debate debate NOUN crl-13774 48 91 over over ADP crl-13774 48 92 qualitative qualitative NOUN crl-13774 48 93 versus versus ADP crl-13774 48 94 quantitative quantitative ADJ crl-13774 48 95 methodology methodology NOUN crl-13774 48 96 in in ADP crl-13774 48 97 the the DET crl-13774 48 98 evaluation evaluation NOUN crl-13774 48 99 of of ADP crl-13774 48 100 library library NOUN crl-13774 48 101 - - PUNCT crl-13774 48 102 use use NOUN crl-13774 48 103 instruction instruction NOUN crl-13774 48 104 . . PUNCT crl-13774 49 1 reichardt reichardt NOUN crl-13774 49 2 and and CCONJ crl-13774 49 3 cook cook NOUN crl-13774 49 4 , , PUNCT crl-13774 49 5 in in ADP crl-13774 49 6 their their PRON crl-13774 49 7 carefully carefully ADV crl-13774 49 8 reasoned reason VERB crl-13774 49 9 examination examination NOUN crl-13774 49 10 of of ADP crl-13774 49 11 both both DET crl-13774 49 12 methods method NOUN crl-13774 49 13 , , PUNCT crl-13774 49 14 concluded conclude VERB crl-13774 49 15 that that SCONJ crl-13774 49 16 there there PRON crl-13774 49 17 was be VERB crl-13774 49 18 little little ADJ crl-13774 49 19 reason reason NOUN crl-13774 49 20 to to PART crl-13774 49 21 choose choose VERB crl-13774 49 22 between between ADP crl-13774 49 23 them they PRON crl-13774 49 24 . . PUNCT crl-13774 50 1 they they PRON crl-13774 50 2 recommended recommend VERB crl-13774 50 3 that that SCONJ crl-13774 50 4 the the DET crl-13774 50 5 researcher researcher NOUN crl-13774 50 6 freely freely ADV crl-13774 50 7 choose choose VERB crl-13774 50 8 a a DET crl-13774 50 9 mix mix NOUN crl-13774 50 10 of of ADP crl-13774 50 11 attributes attribute NOUN crl-13774 50 12 from from ADP crl-13774 50 13 both both DET crl-13774 50 14 types type NOUN crl-13774 50 15 of of ADP crl-13774 50 16 methodological methodological ADJ crl-13774 50 17 approaches approach NOUN crl-13774 50 18 so so SCONJ crl-13774 50 19 as as SCONJ crl-13774 50 20 to to PART crl-13774 50 21 best well ADV crl-13774 50 22 fit fit VERB crl-13774 50 23 the the DET crl-13774 50 24 demands demand NOUN crl-13774 50 25 of of ADP crl-13774 50 26 the the DET crl-13774 50 27 problems problem NOUN crl-13774 50 28 at at ADP crl-13774 50 29 hand hand NOUN crl-13774 50 30 . . PUNCT crl-13774 51 1 12 12 NUM crl-13774 51 2 in in ADP crl-13774 51 3 their their PRON crl-13774 51 4 view view NOUN crl-13774 51 5 , , PUNCT crl-13774 51 6 the the DET crl-13774 51 7 most most ADV crl-13774 51 8 telling telling NOUN crl-13774 51 9 and and CCONJ crl-13774 51 10 fundamental fundamental ADJ crl-13774 51 11 distinction distinction NOUN crl-13774 51 12 between between ADP crl-13774 51 13 the the DET crl-13774 51 14 two two NUM crl-13774 51 15 types type NOUN crl-13774 51 16 of of ADP crl-13774 51 17 evaluative evaluative ADJ crl-13774 51 18 approaches approach NOUN crl-13774 51 19 lies lie VERB crl-13774 51 20 along along ADP crl-13774 51 21 a a DET crl-13774 51 22 continuum continuum NOUN crl-13774 51 23 tanging tanging NOUN crl-13774 51 24 from from ADP crl-13774 51 25 verification verification NOUN crl-13774 51 26 on on ADP crl-13774 51 27 one one NUM crl-13774 51 28 end end NOUN crl-13774 51 29 to to ADP crl-13774 51 30 discovery discovery NOUN crl-13774 51 31 on on ADP crl-13774 51 32 the the DET crl-13774 51 33 other other ADJ crl-13774 51 34 . . PUNCT crl-13774 52 1 according accord VERB crl-13774 52 2 to to ADP crl-13774 52 3 reichardt reichardt NOUN crl-13774 52 4 and and CCONJ crl-13774 52 5 cook cook VERB crl-13774 52 6 , , PUNCT crl-13774 52 7 quantitative quantitative ADJ crl-13774 52 8 · · PUNCT crl-13774 52 9 methods method NOUN crl-13774 52 10 have have AUX crl-13774 52 11 been be AUX crl-13774 52 12 developed develop VERB crl-13774 52 13 most most ADV crl-13774 52 14 directly directly ADV crl-13774 52 15 for for ADP crl-13774 52 16 the the DET crl-13774 52 17 task task NOUN crl-13774 52 18 of of ADP crl-13774 52 19 verifying verifying NOUN crl-13774 52 20 or or CCONJ crl-13774 52 21 confirming confirm VERB crl-13774 52 22 established establish VERB crl-13774 52 23 theories theory NOUN crl-13774 52 24 , , PUNCT crl-13774 52 25 while while SCONJ crl-13774 52 26 to to ADP crl-13774 52 27 a a DET crl-13774 52 28 rather rather ADV crl-13774 52 29 large large ADJ crl-13774 52 30 extent extent NOUN crl-13774 52 31 qualitative qualitative ADJ crl-13774 52 32 methods method NOUN crl-13774 52 33 have have AUX crl-13774 52 34 been be AUX crl-13774 52 35 developed develop VERB crl-13774 52 36 primarily primarily ADV crl-13774 52 37 for for ADP crl-13774 52 38 the the DET crl-13774 52 39 task task NOUN crl-13774 52 40 of of ADP crl-13774 52 41 discovering discover VERB crl-13774 52 42 or or CCONJ crl-13774 52 43 generating generate VERB crl-13774 52 44 theories theory NOUN crl-13774 52 45 . . PUNCT crl-13774 53 1 13 13 NUM crl-13774 53 2 as as ADP crl-13774 53 3 part part NOUN crl-13774 53 4 of of ADP crl-13774 53 5 the the DET crl-13774 53 6 overall overall ADJ crl-13774 53 7 evaluation evaluation NOUN crl-13774 53 8 of of ADP crl-13774 53 9 the the DET crl-13774 53 10 library library NOUN crl-13774 53 11 - - PUNCT crl-13774 53 12 use use NOUN crl-13774 53 13 instruction instruction NOUN crl-13774 53 14 program program NOUN crl-13774 53 15 at at ADP crl-13774 53 16 depauw depauw PROPN crl-13774 53 17 university university PROPN crl-13774 53 18 , , PUNCT crl-13774 53 19 both both CCONJ crl-13774 53 20 quantitative quantitative ADJ crl-13774 53 21 and and CCONJ crl-13774 53 22 qualitative qualitative ADJ crl-13774 53 23 methods method NOUN crl-13774 53 24 were be AUX crl-13774 53 25 used use VERB crl-13774 53 26 . . PUNCT crl-13774 54 1 jerry jerry PROPN crl-13774 54 2 bakker bakker PROPN crl-13774 54 3 , , PUNCT crl-13774 54 4 professor professor NOUN crl-13774 54 5 of of ADP crl-13774 54 6 chemistry chemistry NOUN crl-13774 54 7 at at ADP crl-13774 54 8 earlham earlham PROPN crl-13774 54 9 college college PROPN crl-13774 54 10 and and CCONJ crl-13774 54 11 formerly formerly ADV crl-13774 54 12 the the DET crl-13774 54 13 teaching teaching NOUN crl-13774 54 14 - - PUNCT crl-13774 54 15 learning learn VERB crl-13774 54 16 consultant consultant NOUN crl-13774 54 17 at at ADP crl-13774 54 18 that that DET crl-13774 54 19 school school NOUN crl-13774 54 20 , , PUNCT crl-13774 54 21 well well ADV crl-13774 54 22 known know VERB crl-13774 54 23 for for ADP crl-13774 54 24 its its PRON crl-13774 54 25 library library NOUN crl-13774 54 26 - - PUNCT crl-13774 54 27 use use NOUN crl-13774 54 28 instruction instruction NOUN crl-13774 54 29 program program NOUN crl-13774 54 30 , , PUNCT crl-13774 54 31 conducted conduct VERB crl-13774 54 32 the the DET crl-13774 54 33 qualitative qualitative ADJ crl-13774 54 34 part part NOUN crl-13774 54 35 of of ADP crl-13774 54 36 the the DET crl-13774 54 37 evaluation evaluation NOUN crl-13774 54 38 . . PUNCT crl-13774 55 1 the the DET crl-13774 55 2 results result NOUN crl-13774 55 3 of of ADP crl-13774 55 4 his his PRON crl-13774 55 5 evaluation evaluation NOUN crl-13774 55 6 , , PUNCT crl-13774 55 7 however however ADV crl-13774 55 8 useful useful ADJ crl-13774 55 9 , , PUNCT crl-13774 55 10 addressed address VERB crl-13774 55 11 primarily primarily ADV crl-13774 55 12 loeal loeal ADJ crl-13774 55 13 concerns concern NOUN crl-13774 55 14 and and CCONJ crl-13774 55 15 are be AUX crl-13774 55 16 not not PART crl-13774 55 17 included include VERB crl-13774 55 18 in in ADP crl-13774 55 19 any any DET crl-13774 55 20 detail detail NOUN crl-13774 55 21 in in ADP crl-13774 55 22 this this DET crl-13774 55 23 article article NOUN crl-13774 55 24 . . PUNCT crl-13774 56 1 for for ADP crl-13774 56 2 this this DET crl-13774 56 3 public public ADJ crl-13774 56 4 assessment assessment NOUN crl-13774 56 5 of of ADP crl-13774 56 6 the the DET crl-13774 56 7 impact impact NOUN crl-13774 56 8 of of ADP crl-13774 56 9 depauw depauw PROPN crl-13774 56 10 's 's PART crl-13774 56 11 library library NOUN crl-13774 56 12 - - PUNCT crl-13774 56 13 use use NOUN crl-13774 56 14 instruction instruction NOUN crl-13774 56 15 program program NOUN crl-13774 56 16 , , PUNCT crl-13774 56 17 quantitative quantitative ADJ crl-13774 56 18 analytical analytical ADJ crl-13774 56 19 approach approach NOUN crl-13774 56 20 has have VERB crl-13774 56 21 a a DET crl-13774 56 22 de de ADJ crl-13774 56 23 ' ' PUNCT crl-13774 56 24 cided cided ADJ crl-13774 56 25 advantage advantage NOUN crl-13774 56 26 . . PUNCT crl-13774 57 1 by by ADP crl-13774 57 2 employing employ VERB crl-13774 57 3 statistics statistic NOUN crl-13774 57 4 in in ADP crl-13774 57 5 . . PUNCT crl-13774 58 1 the the DET crl-13774 58 2 analysis analysis NOUN crl-13774 58 3 of of ADP crl-13774 58 4 the the DET crl-13774 58 5 effects effect NOUN crl-13774 58 6 of of ADP crl-13774 58 7 instruction instruction NOUN crl-13774 58 8 and and CCONJ crl-13774 58 9 other other ADJ crl-13774 58 10 factors factor NOUN crl-13774 58 11 upon upon SCONJ crl-13774 58 12 library library NOUN crl-13774 58 13 - - PUNCT crl-13774 58 14 use use NOUN crl-13774 58 15 skills skill NOUN crl-13774 58 16 , , PUNCT crl-13774 58 17 we we PRON crl-13774 58 18 can can AUX crl-13774 58 19 communicate communicate VERB crl-13774 58 20 a a DET crl-13774 58 21 good good ADJ crl-13774 58 22 deal deal NOUN crl-13774 58 23 of of ADP crl-13774 58 24 information information NOUN crl-13774 58 25 beyond beyond ADP crl-13774 58 26 our our PRON crl-13774 58 27 immediate immediate ADJ crl-13774 58 28 setting setting NOUN crl-13774 58 29 . . PUNCT crl-13774 59 1 as as SCONJ crl-13774 59 2 mueller mueller NOUN crl-13774 59 3 has have AUX crl-13774 59 4 argued argue VERB crl-13774 59 5 , , PUNCT crl-13774 59 6 " " PUNCT crl-13774 59 7 there there PRON crl-13774 59 8 is be VERB crl-13774 59 9 a a DET crl-13774 59 10 continuity continuity NOUN crl-13774 59 11 between between ADP crl-13774 59 12 common common ADJ crl-13774 59 13 sense sense NOUN crl-13774 59 14 , , PUNCT crl-13774 59 15 which which PRON crl-13774 59 16 informally informally ADV crl-13774 59 17 makes make VERB crl-13774 59 18 rough rough ADJ crl-13774 59 19 quantitative quantitative ADJ crl-13774 59 20 judgments judgment NOUN crl-13774 59 21 , , PUNCT crl-13774 59 22 and and CCONJ crl-13774 59 23 statistics statistic NOUN crl-13774 59 24 , , PUNCT crl-13774 59 25 which which PRON crl-13774 59 26 is be AUX crl-13774 59 27 not not PART crl-13774 59 28 only only ADV crl-13774 59 29 a a DET crl-13774 59 30 more more ADV crl-13774 59 31 formal formal ADJ crl-13774 59 32 and and CCONJ crl-13774 59 33 precise precise ADJ crl-13774 59 34 version version NOUN crl-13774 59 35 of of ADP crl-13774 59 36 such such ADJ crl-13774 59 37 knowledge knowledge NOUN crl-13774 59 38 , , PUNCT crl-13774 59 39 but but CCONJ crl-13774 59 40 also also ADV crl-13774 59 41 of of ADP crl-13774 59 42 more more ADV crl-13774 59 43 extended extended ADJ crl-13774 59 44 scope scope NOUN crl-13774 59 45 . . PUNCT crl-13774 59 46 " " PUNCT crl-13774 60 1 14 14 NUM crl-13774 60 2 more more ADV crl-13774 60 3 specifically specifically ADV crl-13774 60 4 , , PUNCT crl-13774 60 5 while while SCONJ crl-13774 60 6 many many ADJ crl-13774 60 7 in in ADP crl-13774 60 8 academic academic ADJ crl-13774 60 9 librarianship librarianship NOUN crl-13774 60 10 intuitively intuitively ADV crl-13774 60 11 feel feel VERB crl-13774 60 12 that that SCONJ crl-13774 60 13 library library NOUN crl-13774 60 14 - - PUNCT crl-13774 60 15 use use NOUN crl-13774 60 16 instruction instruction NOUN crl-13774 60 17 is be AUX crl-13774 60 18 of of ADP crl-13774 60 19 considerable considerable ADJ crl-13774 60 20 value value NOUN crl-13774 60 21 in in ADP crl-13774 60 22 increasing increase VERB crl-13774 60 23 library library NOUN crl-13774 60 24 : : PUNCT crl-13774 60 25 use use NOUN crl-13774 60 26 skills skill NOUN crl-13774 60 27 , , PUNCT crl-13774 60 28 quantitative quantitative ADJ crl-13774 60 29 measures measure NOUN crl-13774 60 30 can can AUX crl-13774 60 31 add add VERB crl-13774 60 32 precision precision NOUN crl-13774 60 33 and and CCONJ crl-13774 60 34 scope scope NOUN crl-13774 60 35 to to ADP crl-13774 60 36 such such ADJ crl-13774 60 37 arguments argument NOUN crl-13774 60 38 . . PUNCT crl-13774 61 1 if if SCONJ crl-13774 61 2 one one PRON crl-13774 61 3 is be AUX crl-13774 61 4 particularly particularly ADV crl-13774 61 5 interested interested ADJ crl-13774 61 6 in in ADP crl-13774 61 7 sorting sort VERB crl-13774 61 8 out out ADP crl-13774 61 9 the the DET crl-13774 61 10 influence influence NOUN crl-13774 61 11 of of ADP crl-13774 61 12 other other ADJ crl-13774 61 13 factorssuch factorssuch NOUN crl-13774 61 14 as as ADP crl-13774 61 15 student student NOUN crl-13774 61 16 intellectual intellectual ADJ crl-13774 61 17 capacity capacity NOUN crl-13774 61 18 , , PUNCT crl-13774 61 19 academic academic ADJ crl-13774 61 20 diligence diligence NOUN crl-13774 61 21 or or CCONJ crl-13774 61 22 major major ADJ crl-13774 61 23 field field NOUN crl-13774 61 24 of of ADP crl-13774 61 25 studystatistical studystatistical ADJ crl-13774 61 26 techniques technique NOUN crl-13774 61 27 can can AUX crl-13774 61 28 be be AUX crl-13774 61 29 indispensible indispensible ADJ crl-13774 61 30 in in ADP crl-13774 61 31 determining determine VERB crl-13774 61 32 the the DET crl-13774 61 33 direct direct ADJ crl-13774 61 34 effect effect NOUN crl-13774 61 35 of of ADP crl-13774 61 36 library library NOUN crl-13774 61 37 - - PUNCT crl-13774 61 38 use use NOUN crl-13774 61 39 instruction instruction NOUN crl-13774 61 40 . . PUNCT crl-13774 62 1 a a DET crl-13774 62 2 three three NUM crl-13774 62 3 - - PUNCT crl-13774 62 4 year year NOUN crl-13774 62 5 assessment assessment NOUN crl-13774 62 6 in in ADP crl-13774 62 7 an an DET crl-13774 62 8 earlier early ADJ crl-13774 62 9 report report NOUN crl-13774 62 10 on on ADP crl-13774 62 11 the the DET crl-13774 62 12 library library NOUN crl-13774 62 13 - - PUNCT crl-13774 62 14 use use NOUN crl-13774 62 15 instruction instruction NOUN crl-13774 62 16 evaluation evaluation NOUN crl-13774 62 17 program program NOUN crl-13774 62 18 at at ADP crl-13774 62 19 depauw depauw PROPN crl-13774 62 20 university university PROPN crl-13774 62 21 , , PUNCT crl-13774 62 22 it it PRON crl-13774 62 23 was be AUX crl-13774 62 24 shown show VERB crl-13774 62 25 that that SCONJ crl-13774 62 26 an an DET crl-13774 62 27 important important ADJ crl-13774 62 28 amount amount NOUN crl-13774 62 29 of of ADP crl-13774 62 30 short short ADJ crl-13774 62 31 - - PUNCT crl-13774 62 32 term term NOUN crl-13774 62 33 gain gain NOUN crl-13774 62 34 in in ADP crl-13774 62 35 library library NOUN crl-13774 62 36 - - PUNCT crl-13774 62 37 use use NOUN crl-13774 62 38 skills skill NOUN crl-13774 62 39 was be AUX crl-13774 62 40 associated associate VERB crl-13774 62 41 with with ADP crl-13774 62 42 that that DET crl-13774 62 43 school school NOUN crl-13774 62 44 's 's PART crl-13774 62 45 library library NOUN crl-13774 62 46 - - PUNCT crl-13774 62 47 use use NOUN crl-13774 62 48 instruction instruction NOUN crl-13774 62 49 . . PUNCT crl-13774 63 1 in in ADP crl-13774 63 2 comparisons comparison NOUN crl-13774 63 3 contrasting contrast VERB crl-13774 63 4 instructed instruct VERB crl-13774 63 5 freshmen freshman NOUN crl-13774 63 6 with with ADP crl-13774 63 7 both both CCONJ crl-13774 63 8 senior senior ADJ crl-13774 63 9 students student NOUN crl-13774 63 10 of of ADP crl-13774 63 11 the the DET crl-13774 63 12 1977 1977 NUM crl-13774 63 13 class class NOUN crl-13774 63 14 and and CCONJ crl-13774 63 15 noninstructed noninstructed ADJ crl-13774 63 16 freshmen freshman NOUN crl-13774 63 17 ( ( PUNCT crl-13774 63 18 as as ADP crl-13774 63 19 a a DET crl-13774 63 20 control control NOUN crl-13774 63 21 group group NOUN crl-13774 63 22 ) ) PUNCT crl-13774 63 23 , , PUNCT crl-13774 63 24 those those DET crl-13774 63 25 students student NOUN crl-13774 63 26 who who PRON crl-13774 63 27 were be AUX crl-13774 63 28 exposed expose VERB crl-13774 63 29 to to ADP crl-13774 63 30 library library NOUN crl-13774 63 31 - - PUNCT crl-13774 63 32 use use NOUN crl-13774 63 33 instruction instruction NOUN crl-13774 63 34 showed show VERB crl-13774 63 35 evidence evidence NOUN crl-13774 63 36 of of ADP crl-13774 63 37 the the DET crl-13774 63 38 positive positive ADJ crl-13774 63 39 effects effect NOUN crl-13774 63 40 of of ADP crl-13774 63 41 that that DET crl-13774 63 42 instruction instruction NOUN crl-13774 63 43 . . PUNCT crl-13774 64 1 15 15 NUM crl-13774 64 2 although although SCONJ crl-13774 64 3 these these DET crl-13774 64 4 results result NOUN crl-13774 64 5 were be AUX crl-13774 64 6 important important ADJ crl-13774 64 7 to to PART crl-13774 64 8 note note VERB crl-13774 64 9 and and CCONJ crl-13774 64 10 document document NOUN crl-13774 64 11 , , PUNCT crl-13774 64 12 they they PRON crl-13774 64 13 represent represent VERB crl-13774 64 14 only only ADV crl-13774 64 15 the the DET crl-13774 64 16 first first ADJ crl-13774 64 17 step step NOUN crl-13774 64 18 in in ADP crl-13774 64 19 understanding understand VERB crl-13774 64 20 the the DET crl-13774 64 21 possible possible ADJ crl-13774 64 22 effects effect NOUN crl-13774 64 23 of of ADP crl-13774 64 24 library library NOUN crl-13774 64 25 - - PUNCT crl-13774 64 26 use use NOUN crl-13774 64 27 instruction instruction NOUN crl-13774 64 28 . . PUNCT crl-13774 65 1 more more ADV crl-13774 65 2 important important ADJ crl-13774 65 3 than than ADP crl-13774 65 4 the the DET crl-13774 65 5 question question NOUN crl-13774 65 6 of of ADP crl-13774 65 7 short short ADJ crl-13774 65 8 - - PUNCT crl-13774 65 9 term term NOUN crl-13774 65 10 gain gain NOUN crl-13774 65 11 in in ADP crl-13774 65 12 skills skill NOUN crl-13774 65 13 , , PUNCT crl-13774 65 14 of of ADP crl-13774 65 15 course course NOUN crl-13774 65 16 , , PUNCT crl-13774 65 17 is be AUX crl-13774 65 18 the the DET crl-13774 65 19 question question NOUN crl-13774 65 20 of of ADP crl-13774 65 21 the the DET crl-13774 65 22 lasting last VERB crl-13774 65 23 effects effect NOUN crl-13774 65 24 of of ADP crl-13774 65 25 instruction instruction NOUN crl-13774 65 26 . . PUNCT crl-13774 66 1 moreover moreover ADV crl-13774 66 2 , , PUNCT crl-13774 66 3 can can AUX crl-13774 66 4 we we PRON crl-13774 66 5 associate associate VERB crl-13774 66 6 higher high ADJ crl-13774 66 7 levels level NOUN crl-13774 66 8 of of ADP crl-13774 66 9 individual individual ADJ crl-13774 66 10 skills skill NOUN crl-13774 66 11 in in ADP crl-13774 66 12 library library NOUN crl-13774 66 13 - - PUNCT crl-13774 66 14 use use NOUN crl-13774 66 15 with with ADP crl-13774 66 16 higher high ADJ crl-13774 66 17 degrees degree NOUN crl-13774 66 18 of of ADP crl-13774 66 19 exposure exposure NOUN crl-13774 66 20 · · PUNCT crl-13774 66 21 to to ADP crl-13774 66 22 library library NOUN crl-13774 66 23 - - PUNCT crl-13774 66 24 use use NOUN crl-13774 66 25 instruction instruction NOUN crl-13774 66 26 ? ? PUNCT crl-13774 67 1 similarly similarly ADV crl-13774 67 2 , , PUNCT crl-13774 67 3 over over ADP crl-13774 67 4 the the DET crl-13774 67 5 long long ADJ crl-13774 67 6 run run NOUN crl-13774 67 7 , , PUNCT crl-13774 67 8 are be AUX crl-13774 67 9 factors factor NOUN crl-13774 67 10 other other ADJ crl-13774 67 11 than than ADP crl-13774 67 12 library library NOUN crl-13774 67 13 - - PUNCT crl-13774 67 14 use use NOUN crl-13774 67 15 instruction instruction NOUN crl-13774 67 16 better well ADJ crl-13774 67 17 predictors predictor NOUN crl-13774 67 18 of of ADP crl-13774 67 19 the the DET crl-13774 67 20 acquisition acquisition NOUN crl-13774 67 21 of of ADP crl-13774 67 22 library library NOUN crl-13774 67 23 - - PUNCT crl-13774 67 24 use use NOUN crl-13774 67 25 skills skill NOUN crl-13774 67 26 ? ? PUNCT crl-13774 68 1 in in ADP crl-13774 68 2 order order NOUN crl-13774 68 3 to to PART crl-13774 68 4 investigate investigate VERB crl-13774 68 5 these these DET crl-13774 68 6 and and CCONJ crl-13774 68 7 related related ADJ crl-13774 68 8 questions question NOUN crl-13774 68 9 , , PUNCT crl-13774 68 10 the the DET crl-13774 68 11 data datum NOUN crl-13774 68 12 collected collect VERB crl-13774 68 13 in in ADP crl-13774 68 14 the the DET crl-13774 68 15 original original ADJ crl-13774 68 16 study study NOUN crl-13774 68 17 was be AUX crl-13774 68 18 supplemented supplement VERB crl-13774 68 19 with with ADP crl-13774 68 20 additional additional ADJ crl-13774 68 21 follow follow VERB crl-13774 68 22 - - PUNCT crl-13774 68 23 up up ADP crl-13774 68 24 library library NOUN crl-13774 68 25 - - PUNCT crl-13774 68 26 use use NOUN crl-13774 68 27 skills skill NOUN crl-13774 68 28 information information NOUN crl-13774 68 29 collected collect VERB crl-13774 68 30 in in ADP crl-13774 68 31 a a DET crl-13774 68 32 survey survey NOUN crl-13774 68 33 of of ADP crl-13774 68 34 the the DET crl-13774 68 35 1980 1980 NUM crl-13774 68 36 senior senior ADJ crl-13774 68 37 class class NOUN crl-13774 68 38 at at ADP crl-13774 68 39 depauw depauw PROPN crl-13774 68 40 university university PROPN crl-13774 68 41 . . PUNCT crl-13774 68 42 . . PUNCT crl-13774 68 43 . . PUNCT crl-13774 69 1 taken take VERB crl-13774 69 2 together together ADV crl-13774 69 3 , , PUNCT crl-13774 69 4 the the DET crl-13774 69 5 survey survey NOUN crl-13774 69 6 data datum NOUN crl-13774 69 7 collected collect VERB crl-13774 69 8 at at ADP crl-13774 69 9 two two NUM crl-13774 69 10 points point NOUN crl-13774 69 11 in in ADP crl-13774 69 12 time time NOUN crl-13774 69 13 in in ADP crl-13774 69 14 1977 1977 NUM crl-13774 69 15 among among ADP crl-13774 69 16 freshmen freshman NOUN crl-13774 69 17 and and CCONJ crl-13774 69 18 the the DET crl-13774 69 19 senior senior ADJ crl-13774 69 20 class class NOUN crl-13774 69 21 , , PUNCT crl-13774 69 22 and and CCONJ crl-13774 69 23 the the DET crl-13774 69 24 data datum NOUN crl-13774 69 25 collected collect VERB crl-13774 69 26 among among ADP crl-13774 69 27 the the DET crl-13774 69 28 seniors senior NOUN crl-13774 69 29 of of ADP crl-13774 69 30 the the DET crl-13774 69 31 1980 1980 NUM crl-13774 69 32 class class NOUN crl-13774 69 33 , , PUNCT crl-13774 69 34 provide provide VERB crl-13774 69 35 the the DET crl-13774 69 36 basis basis NOUN crl-13774 69 37 for for ADP crl-13774 69 38 two two NUM crl-13774 69 39 kinds kind NOUN crl-13774 69 40 of of ADP crl-13774 69 41 analyses analysis NOUN crl-13774 69 42 of of ADP crl-13774 69 43 longterm longterm NOUN crl-13774 69 44 skills skill NOUN crl-13774 69 45 - - PUNCT crl-13774 69 46 acquisition acquisition NOUN crl-13774 69 47 effects effect NOUN crl-13774 69 48 of of ADP crl-13774 69 49 library library NOUN crl-13774 69 50 - - PUNCT crl-13774 69 51 use use NOUN crl-13774 69 52 instruction instruction NOUN crl-13774 69 53 . . PUNCT crl-13774 70 1 first first ADV crl-13774 70 2 , , PUNCT crl-13774 70 3 such such ADJ crl-13774 70 4 data datum NOUN crl-13774 70 5 allow allow VERB crl-13774 70 6 the the DET crl-13774 70 7 comparison comparison NOUN crl-13774 70 8 of of ADP crl-13774 70 9 aggregate aggregate ADJ crl-13774 70 10 levels level NOUN crl-13774 70 11 of of ADP crl-13774 70 12 skills skill NOUN crl-13774 70 13 possession possession NOUN crl-13774 70 14 among among ADP crl-13774 70 15 various various ADJ crl-13774 70 16 groups group NOUN crl-13774 70 17 of of ADP crl-13774 70 18 interest interest NOUN crl-13774 70 19 ( ( PUNCT crl-13774 70 20 e.g. e.g. ADV crl-13774 70 21 , , PUNCT crl-13774 70 22 1977 1977 NUM crl-13774 70 23 seniors senior NOUN crl-13774 70 24 versus versus ADP crl-13774 70 25 1980 1980 NUM crl-13774 70 26 seniors senior NOUN crl-13774 70 27 , , PUNCT crl-13774 70 28 those those PRON crl-13774 70 29 in in ADP crl-13774 70 30 the the DET crl-13774 70 31 1980 1980 NUM crl-13774 70 32 senior senior ADJ crl-13774 70 33 class class NOUN crl-13774 70 34 who who PRON crl-13774 70 35 received receive VERB crl-13774 70 36 library library NOUN crl-13774 70 37 - - PUNCT crl-13774 70 38 use use NOUN crl-13774 70 39 instruction instruction NOUN crl-13774 70 40 versus versus ADP crl-13774 70 41 those those PRON crl-13774 70 42 who who PRON crl-13774 70 43 did do VERB crl-13774 70 44 npt npt PROPN crl-13774 70 45 , , PUNCT crl-13774 70 46 etc etc X crl-13774 70 47 . . X crl-13774 70 48 ) ) PUNCT crl-13774 70 49 . . PUNCT crl-13774 71 1 secondly secondly ADV crl-13774 71 2 , , PUNCT crl-13774 71 3 the the DET crl-13774 71 4 existence existence NOUN crl-13774 71 5 of of ADP crl-13774 71 6 three three NUM crl-13774 71 7 measures measure NOUN crl-13774 71 8 of of ADP crl-13774 71 9 library library NOUN crl-13774 71 10 - - PUNCT crl-13774 71 11 use use NOUN crl-13774 71 12 skills skill NOUN crl-13774 71 13 taken take VERB crl-13774 71 14 at at ADP crl-13774 71 15 three three NUM crl-13774 71 16 points point NOUN crl-13774 71 17 in in ADP crl-13774 71 18 time time NOUN crl-13774 71 19 for for ADP crl-13774 71 20 a a DET crl-13774 71 21 substantial substantial ADJ crl-13774 71 22 group group NOUN crl-13774 71 23 of of ADP crl-13774 71 24 1980 1980 NUM crl-13774 71 25 seniorsconstituting seniorsconstitute VERB crl-13774 71 26 a a DET crl-13774 71 27 panel panel NOUN crl-13774 71 28 studyallows studyallow VERB crl-13774 71 29 the the DET crl-13774 71 30 verification verification NOUN crl-13774 71 31 of of ADP crl-13774 71 32 hypotheses hypothesis NOUN crl-13774 71 33 suggested suggest VERB crl-13774 71 34 by by ADP crl-13774 71 35 aggregate aggregate ADJ crl-13774 71 36 patterns pattern NOUN crl-13774 71 37 of of ADP crl-13774 71 38 comparison comparison NOUN crl-13774 71 39 at at ADP crl-13774 71 40 the the DET crl-13774 71 41 individual individual ADJ crl-13774 71 42 level level NOUN crl-13774 71 43 of of ADP crl-13774 71 44 analysis analysis NOUN crl-13774 71 45 . . PUNCT crl-13774 72 1 16 16 NUM crl-13774 72 2 in in ADP crl-13774 72 3 the the DET crl-13774 72 4 area area NOUN crl-13774 72 5 of of ADP crl-13774 72 6 aggregate aggregate ADJ crl-13774 72 7 comparison comparison NOUN crl-13774 72 8 , , PUNCT crl-13774 72 9 perhaps perhaps ADV crl-13774 72 10 the the DET crl-13774 72 11 most most ADV crl-13774 72 12 basic basic ADJ crl-13774 72 13 question question NOUN crl-13774 72 14 is be AUX crl-13774 72 15 that that PRON crl-13774 72 16 of of ADP crl-13774 72 17 overall overall ADJ crl-13774 72 18 effects effect NOUN crl-13774 72 19 : : PUNCT crl-13774 72 20 that that ADV crl-13774 72 21 is be AUX crl-13774 72 22 , , PUNCT crl-13774 72 23 did do VERB crl-13774 72 24 the the DET crl-13774 72 25 library library NOUN crl-13774 72 26 - - PUNCT crl-13774 72 27 use use NOUN crl-13774 72 28 instruction instruction NOUN crl-13774 72 29 given give VERB crl-13774 72 30 to to ADP crl-13774 72 31 some some DET crl-13774 72 32 students student NOUN crl-13774 72 33 in in ADP crl-13774 72 34 the the DET crl-13774 72 35 1977 1977 NUM crl-13774 72 36 freshman freshman NOUN crl-13774 72 37 class class NOUN crl-13774 72 38 result result NOUN crl-13774 72 39 in in ADP crl-13774 72 40 raising raise VERB crl-13774 72 41 the the DET crl-13774 72 42 overall overall ADJ crl-13774 72 43 level level NOUN crl-13774 72 44 of of ADP crl-13774 72 45 library library NOUN crl-13774 72 46 - - PUNCT crl-13774 72 47 use use NOUN crl-13774 72 48 skills skill NOUN crl-13774 72 49 of of ADP crl-13774 72 50 that that DET crl-13774 72 51 class class NOUN crl-13774 72 52 ? ? PUNCT crl-13774 73 1 if if SCONJ crl-13774 73 2 library library NOUN crl-13774 73 3 - - PUNCT crl-13774 73 4 use use NOUN crl-13774 73 5 instruction instruction NOUN crl-13774 73 6 given give VERB crl-13774 73 7 to to ADP crl-13774 73 8 1977 1977 NUM crl-13774 73 9 freshmen freshman NOUN crl-13774 73 10 did do AUX crl-13774 73 11 result result VERB crl-13774 73 12 in in ADP crl-13774 73 13 the the DET crl-13774 73 14 improvement improvement NOUN crl-13774 73 15 of of ADP crl-13774 73 16 the the DET crl-13774 73 17 aggregate aggregate ADJ crl-13774 73 18 level level NOUN crl-13774 73 19 of of ADP crl-13774 73 20 skill skill NOUN crl-13774 73 21 possession possession NOUN crl-13774 73 22 of of ADP crl-13774 73 23 students student NOUN crl-13774 73 24 in in ADP crl-13774 73 25 that that DET crl-13774 73 26 class class NOUN crl-13774 73 27 , , PUNCT crl-13774 73 28 it it PRON crl-13774 73 29 should should AUX crl-13774 73 30 be be AUX crl-13774 73 31 possible possible ADJ crl-13774 73 32 to to PART crl-13774 73 33 show show VERB crl-13774 73 34 that that SCONJ crl-13774 73 35 the the DET crl-13774 73 36 skill skill NOUN crl-13774 73 37 levels level NOUN crl-13774 73 38 of of ADP crl-13774 73 39 1980 1980 NUM crl-13774 73 40 seniors senior NOUN crl-13774 73 41 ( ( PUNCT crl-13774 73 42 the the DET crl-13774 73 43 1977 1977 NUM crl-13774 73 44 freshmen freshman NOUN crl-13774 73 45 ) ) PUNCT crl-13774 73 46 are be AUX crl-13774 73 47 superior superior ADJ crl-13774 73 48 to to ADP crl-13774 73 49 - - PUNCT crl-13774 73 50 those those PRON crl-13774 73 51 of of ADP crl-13774 73 52 1977 1977 NUM crl-13774 73 53 seniors senior NOUN crl-13774 73 54 . . PUNCT crl-13774 74 1 table table NOUN crl-13774 74 2 1 1 NUM crl-13774 74 3 reports report VERB crl-13774 74 4 the the DET crl-13774 74 5 results result NOUN crl-13774 74 6 of of ADP crl-13774 74 7 such such DET crl-13774 74 8 a a DET crl-13774 74 9 comparison comparison NOUN crl-13774 74 10 . . PUNCT crl-13774 75 1 table table NOUN crl-13774 75 2 1 1 NUM crl-13774 75 3 reveals reveal VERB crl-13774 75 4 findings finding NOUN crl-13774 75 5 that that PRON crl-13774 75 6 fall fall VERB crl-13774 75 7 in in ADP crl-13774 75 8 the the DET crl-13774 75 9 predicted predict VERB crl-13774 75 10 pattern pattern NOUN crl-13774 75 11 . . PUNCT crl-13774 76 1 while while SCONJ crl-13774 76 2 the the DET crl-13774 76 3 relatively relatively ADV crl-13774 76 4 small small ADJ crl-13774 76 5 number number NOUN crl-13774 76 6 of of ADP crl-13774 76 7 1977 1977 NUM crl-13774 76 8 seniors senior NOUN crl-13774 76 9 , , PUNCT crl-13774 76 10 the the DET crl-13774 76 11 differential differential ADJ crl-13774 76 12 effects effect NOUN crl-13774 76 13 of of ADP crl-13774 76 14 selectivity selectivity NOUN crl-13774 76 15 in in ADP crl-13774 76 16 return return NOUN crl-13774 76 17 rates rate NOUN crl-13774 76 18 in in ADP crl-13774 76 19 the the DET crl-13774 76 20 1977 1977 NUM crl-13774 76 21 and and CCONJ crl-13774 76 22 1980 1980 NUM crl-13774 76 23 surveys survey NOUN crl-13774 76 24 of of ADP crl-13774 76 25 senior senior ADJ crl-13774 76 26 students student NOUN crl-13774 76 27 , , PUNCT crl-13774 76 28 and and CCONJ crl-13774 76 29 the the DET crl-13774 76 30 disproportionality disproportionality NOUN crl-13774 76 31 of of ADP crl-13774 76 32 cases case NOUN crl-13774 76 33 in in ADP crl-13774 76 34 the the DET crl-13774 76 35 three three NUM crl-13774 76 36 major major ADJ crl-13774 76 37 areas area NOUN crl-13774 76 38 of of ADP crl-13774 76 39 study study NOUN crl-13774 76 40 make make VERB crl-13774 76 41 the the DET crl-13774 76 42 use use NOUN crl-13774 76 43 of of ADP crl-13774 76 44 inferential inferential ADJ crl-13774 76 45 statistics statistic NOUN crl-13774 76 46 inappropriate inappropriate ADJ crl-13774 76 47 , , PUNCT crl-13774 76 48 it it PRON crl-13774 76 49 is be AUX crl-13774 76 50 informative informative ADJ crl-13774 76 51 to to PART crl-13774 76 52 note note VERB crl-13774 76 53 that that SCONJ crl-13774 76 54 the the DET crl-13774 76 55 direction direction NOUN crl-13774 76 56 of of ADP crl-13774 76 57 differences difference NOUN crl-13774 76 58 observed observe VERB crl-13774 76 59 coincides coincide NOUN crl-13774 76 60 with with ADP crl-13774 76 61 predicted predict VERB crl-13774 76 62 differences difference NOUN crl-13774 76 63 , , PUNCT crl-13774 76 64 and and CCONJ crl-13774 76 65 that that SCONJ crl-13774 76 66 the the DET crl-13774 76 67 areas area NOUN crl-13774 76 68 where where SCONJ crl-13774 76 69 most most ADJ crl-13774 76 70 use use NOUN crl-13774 76 71 is be AUX crl-13774 76 72 made make VERB crl-13774 76 73 of of ADP crl-13774 76 74 library library PROPN crl-13774 76 75 library library NOUN crl-13774 76 76 - - PUNCT crl-13774 76 77 use use NOUN crl-13774 76 78 instruction instruction NOUN crl-13774 76 79 i i NOUN crl-13774 76 80 41 41 NUM crl-13774 76 81 table table NOUN crl-13774 76 82 1 1 NUM crl-13774 76 83 comparison comparison NOUN crl-13774 76 84 of of ADP crl-13774 76 85 library library NOUN crl-13774 76 86 - - PUNCT crl-13774 76 87 use use NOUN crl-13774 76 88 skills skill NOUN crl-13774 76 89 among among ADP crl-13774 76 90 1977 1977 NUM crl-13774 76 91 and and CCONJ crl-13774 76 92 1980 1980 NUM crl-13774 76 93 seniors senior NOUN crl-13774 76 94 major major ADJ crl-13774 76 95 area area NOUN crl-13774 76 96 of of ADP crl-13774 76 97 study study NOUN crl-13774 76 98 humanities humanity NOUN crl-13774 76 99 social social ADJ crl-13774 76 100 science science NOUN crl-13774 76 101 natural natural ADJ crl-13774 76 102 science science NOUN crl-13774 76 103 mean mean VERB crl-13774 76 104 scores• scores• PROPN crl-13774 76 105 1977 1977 NUM crl-13774 76 106 seniors senior NOUN crl-13774 76 107 1980 1980 NUM crl-13774 76 108 seniors senior NOUN crl-13774 76 109 x x PROPN crl-13774 76 110 no no INTJ crl-13774 76 111 . . PUNCT crl-13774 77 1 x x PUNCT crl-13774 77 2 no no NOUN crl-13774 77 3 . . PROPN crl-13774 77 4 14.62 14.62 NUM crl-13774 77 5 ( ( PUNCT crl-13774 77 6 29 29 NUM crl-13774 77 7 ) ) PUNCT crl-13774 77 8 15.80 15.80 NUM crl-13774 77 9 ( ( PUNCT crl-13774 77 10 74 74 NUM crl-13774 77 11 ) ) PUNCT crl-13774 77 12 14.91 14.91 NUM crl-13774 77 13 ( ( PUNCT crl-13774 77 14 47 47 NUM crl-13774 77 15 ) ) PUNCT crl-13774 77 16 16.34 16.34 NUM crl-13774 77 17 ( ( PUNCT crl-13774 77 18 92 92 NUM crl-13774 77 19 ) ) PUNCT crl-13774 77 20 15.03 15.03 NUM crl-13774 77 21 ( ( PUNCT crl-13774 77 22 15 15 NUM crl-13774 77 23 ) ) PUNCT crl-13774 77 24 15.08 15.08 NUM crl-13774 77 25 ( ( PUNCT crl-13774 77 26 64 64 NUM crl-13774 77 27 ) ) PUNCT crl-13774 77 28 •mean •mean ADJ crl-13774 77 29 scores score NOUN crl-13774 77 30 on on ADP crl-13774 77 31 identical identical ADJ crl-13774 77 32 , , PUNCT crl-13774 77 33 twenty twenty NUM crl-13774 77 34 - - PUNCT crl-13774 77 35 item item NOUN crl-13774 77 36 skills skill NOUN crl-13774 77 37 test test NOUN crl-13774 77 38 by by ADP crl-13774 77 39 major major ADJ crl-13774 77 40 area area NOUN crl-13774 77 41 of of ADP crl-13774 77 42 study study NOUN crl-13774 77 43 . . PUNCT crl-13774 78 1 resourcesthe resourcesthe PROPN crl-13774 78 2 humanities humanity NOUN crl-13774 78 3 and and CCONJ crl-13774 78 4 social social ADJ crl-13774 78 5 sciencesare sciencesare NOUN crl-13774 78 6 precisely precisely ADV crl-13774 78 7 those those PRON crl-13774 78 8 where where SCONJ crl-13774 78 9 the the DET crl-13774 78 10 greatest great ADJ crl-13774 78 11 differences difference NOUN crl-13774 78 12 are be AUX crl-13774 78 13 observed observe VERB crl-13774 78 14 . . PUNCT crl-13774 79 1 any any DET crl-13774 79 2 such such ADJ crl-13774 79 3 aggregate aggregate ADJ crl-13774 79 4 comparisons comparison NOUN crl-13774 79 5 are be AUX crl-13774 79 6 subject subject ADJ crl-13774 79 7 , , PUNCT crl-13774 79 8 of of ADP crl-13774 79 9 course course NOUN crl-13774 79 10 , , PUNCT crl-13774 79 11 to to ADP crl-13774 79 12 the the DET crl-13774 79 13 criticism criticism NOUN crl-13774 79 14 that that PRON crl-13774 79 15 factors factor VERB crl-13774 79 16 other other ADJ crl-13774 79 17 than than ADP crl-13774 79 18 library library NOUN crl-13774 79 19 - - PUNCT crl-13774 79 20 use use NOUN crl-13774 79 21 instruction instruction NOUN crl-13774 79 22 account account NOUN crl-13774 79 23 for for ADP crl-13774 79 24 the the DET crl-13774 79 25 observed observed ADJ crl-13774 79 26 effects effect NOUN crl-13774 79 27 . . PUNCT crl-13774 80 1 perhaps perhaps ADV crl-13774 80 2 other other ADJ crl-13774 80 3 campuswide campuswide NOUN crl-13774 80 4 influences influence NOUN crl-13774 80 5 or or CCONJ crl-13774 80 6 national national ADJ crl-13774 80 7 student student NOUN crl-13774 80 8 trends trend NOUN crl-13774 80 9 intervened intervene VERB crl-13774 80 10 between between ADP crl-13774 80 11 1977 1977 NUM crl-13774 80 12 and and CCONJ crl-13774 80 13 1980 1980 NUM crl-13774 80 14 to to PART crl-13774 80 15 cause cause VERB crl-13774 80 16 the the DET crl-13774 80 17 1980 1980 NUM crl-13774 80 18 seniors senior NOUN crl-13774 80 19 of of ADP crl-13774 80 20 depauw depauw PROPN crl-13774 80 21 university university PROPN crl-13774 80 22 to to PART crl-13774 80 23 have have VERB crl-13774 80 24 higher high ADJ crl-13774 80 25 library library NOUN crl-13774 80 26 - - PUNCT crl-13774 80 27 use use NOUN crl-13774 80 28 skills skill NOUN crl-13774 80 29 than than ADP crl-13774 80 30 their their PRON crl-13774 80 31 1977 1977 NUM crl-13774 80 32 predecessorsirrespective predecessorsirrespective NOUN crl-13774 80 33 of of ADP crl-13774 80 34 any any DET crl-13774 80 35 contact contact NOUN crl-13774 80 36 with with ADP crl-13774 80 37 library library NOUN crl-13774 80 38 - - PUNCT crl-13774 80 39 use use NOUN crl-13774 80 40 instruction instruction NOUN crl-13774 80 41 . . PUNCT crl-13774 81 1 similarly similarly ADV crl-13774 81 2 , , PUNCT crl-13774 81 3 it it PRON crl-13774 81 4 is be AUX crl-13774 81 5 · · PUNCT crl-13774 81 6 possible possible ADJ crl-13774 81 7 that that SCONJ crl-13774 81 8 the the DET crl-13774 81 9 1977 1977 NUM crl-13774 81 10 and and CCONJ crl-13774 81 11 1980 1980 NUM crl-13774 81 12 senior senior ADJ crl-13774 81 13 classes class NOUN crl-13774 81 14 differ differ VERB crl-13774 81 15 with with ADP crl-13774 81 16 respect respect NOUN crl-13774 81 17 to to ADP crl-13774 81 18 intellectual intellectual ADJ crl-13774 81 19 capacity capacity NOUN crl-13774 81 20 and/or and/or CCONJ crl-13774 81 21 academic academic ADJ crl-13774 81 22 diligence diligence NOUN crl-13774 81 23 , , PUNCT crl-13774 81 24 hence hence ADV crl-13774 81 25 any any DET crl-13774 81 26 difference difference NOUN crl-13774 81 27 in in ADP crl-13774 81 28 library library NOUN crl-13774 81 29 skills skill VERB crl-13774 81 30 scores score NOUN crl-13774 81 31 in in ADP crl-13774 81 32 the the DET crl-13774 81 33 aggregate aggregate NOUN crl-13774 81 34 are be AUX crl-13774 81 35 the the DET crl-13774 81 36 result result NOUN crl-13774 81 37 of of ADP crl-13774 81 38 such such ADJ crl-13774 81 39 background background NOUN crl-13774 81 40 differences difference NOUN crl-13774 81 41 rather rather ADV crl-13774 81 42 than than ADP crl-13774 81 43 selective selective ADJ crl-13774 81 44 exposure exposure NOUN crl-13774 81 45 to to ADP crl-13774 81 46 library library NOUN crl-13774 81 47 - - PUNCT crl-13774 81 48 use use NOUN crl-13774 81 49 instruction instruction NOUN crl-13774 81 50 . . PUNCT crl-13774 82 1 in in ADP crl-13774 82 2 order order NOUN crl-13774 82 3 to to PART crl-13774 82 4 determine determine VERB crl-13774 82 5 whether whether SCONJ crl-13774 82 6 exposure exposure NOUN crl-13774 82 7 to to ADP crl-13774 82 8 library library NOUN crl-13774 82 9 - - PUNCT crl-13774 82 10 use use NOUN crl-13774 82 11 instruction instruction NOUN crl-13774 82 12 has have VERB crl-13774 82 13 the the DET crl-13774 82 14 predicted predict VERB crl-13774 82 15 effect effect NOUN crl-13774 82 16 upon upon SCONJ crl-13774 82 17 library library NOUN crl-13774 82 18 - - PUNCT crl-13774 82 19 use use NOUN crl-13774 82 20 skills skill NOUN crl-13774 82 21 , , PUNCT crl-13774 82 22 it it PRON crl-13774 82 23 is be AUX crl-13774 82 24 possible possible ADJ crl-13774 82 25 to to PART crl-13774 82 26 analyze analyze VERB crl-13774 82 27 the the DET crl-13774 82 28 findings finding NOUN crl-13774 82 29 of of ADP crl-13774 82 30 the the DET crl-13774 82 31 1980 1980 NUM crl-13774 82 32 senior senior ADJ crl-13774 82 33 survey survey NOUN crl-13774 82 34 to to PART crl-13774 82 35 discover discover VERB crl-13774 82 36 if if SCONJ crl-13774 82 37 ( ( PUNCT crl-13774 82 38 1 1 X crl-13774 82 39 ) ) PUNCT crl-13774 82 40 the the DET crl-13774 82 41 degree degree NOUN crl-13774 82 42 of of ADP crl-13774 82 43 exposure exposure NOUN crl-13774 82 44 to to ADP crl-13774 82 45 library library NOUN crl-13774 82 46 - - PUNCT crl-13774 82 47 use use NOUN crl-13774 82 48 instruction instruction NOUN crl-13774 82 49 is be AUX crl-13774 82 50 directly directly ADV crl-13774 82 51 associated associate VERB crl-13774 82 52 with with ADP crl-13774 82 53 level level NOUN crl-13774 82 54 of of ADP crl-13774 82 55 library library NOUN crl-13774 82 56 - - PUNCT crl-13774 82 57 use use NOUN crl-13774 82 58 skills skill NOUN crl-13774 82 59 possession possession NOUN crl-13774 82 60 ; ; PUNCT crl-13774 82 61 and and CCONJ crl-13774 82 62 ( ( PUNCT crl-13774 82 63 2 2 X crl-13774 82 64 ) ) PUNCT crl-13774 82 65 the the DET crl-13774 82 66 association association NOUN crl-13774 82 67 between between ADP crl-13774 82 68 library library NOUN crl-13774 82 69 - - PUNCT crl-13774 82 70 use use NOUN crl-13774 82 71 instruction instruction NOUN crl-13774 82 72 and and CCONJ crl-13774 82 73 skills skill NOUN crl-13774 82 74 possession possession NOUN crl-13774 82 75 is be AUX crl-13774 82 76 stronger strong ADJ crl-13774 82 77 than than ADP crl-13774 82 78 that that PRON crl-13774 82 79 between between ADP crl-13774 82 80 skills skill NOUN crl-13774 82 81 possession possession NOUN crl-13774 82 82 and and CCONJ crl-13774 82 83 other other ADJ crl-13774 82 84 relevant relevant ADJ crl-13774 82 85 dimensions dimension NOUN crl-13774 82 86 of of ADP crl-13774 82 87 difference difference NOUN crl-13774 82 88 among among ADP crl-13774 82 89 studentssuch studentssuch PROPN crl-13774 82 90 as as ADP crl-13774 82 91 intellectual intellectual ADJ crl-13774 82 92 capacity capacity NOUN crl-13774 82 93 ( ( PUNCT crl-13774 82 94 as as SCONJ crl-13774 82 95 measured measure VERB crl-13774 82 96 by by ADP crl-13774 82 97 the the DET crl-13774 82 98 verbal verbal ADJ crl-13774 82 99 portion portion NOUN crl-13774 82 100 of of ADP crl-13774 82 101 the the DET crl-13774 82 102 scholastic scholastic ADJ crl-13774 82 103 aptitude aptitude NOUN crl-13774 82 104 test test NOUN crl-13774 82 105 ) ) PUNCT crl-13774 82 106 and and CCONJ crl-13774 82 107 academic academic ADJ crl-13774 82 108 diligence diligence NOUN crl-13774 82 109 ( ( PUNCT crl-13774 82 110 as as SCONJ crl-13774 82 111 determined determine VERB crl-13774 82 112 by by ADP crl-13774 82 113 grade grade NOUN crl-13774 82 114 point point NOUN crl-13774 82 115 average average NOUN crl-13774 82 116 ) ) PUNCT crl-13774 82 117 . . PUNCT crl-13774 83 1 table table NOUN crl-13774 83 2 2 2 NUM crl-13774 83 3 sets set NOUN crl-13774 83 4 forth forth ADV crl-13774 83 5 the the DET crl-13774 83 6 findings finding NOUN crl-13774 83 7 of of ADP crl-13774 83 8 the the DET crl-13774 83 9 1980 1980 NUM crl-13774 83 10 senior senior ADJ crl-13774 83 11 survey survey NOUN crl-13774 83 12 with with ADP crl-13774 83 13 respect respect NOUN crl-13774 83 14 to to ADP crl-13774 83 15 these these DET crl-13774 83 16 two two NUM crl-13774 83 17 dimensions dimension NOUN crl-13774 83 18 of of ADP crl-13774 83 19 comparison comparison NOUN crl-13774 83 20 . . PUNCT crl-13774 84 1 the the DET crl-13774 84 2 results result NOUN crl-13774 84 3 reported report VERB crl-13774 84 4 in in ADP crl-13774 84 5 table table NOUN crl-13774 84 6 2 2 NUM crl-13774 84 7 once once ADV crl-13774 84 8 more more ADV crl-13774 84 9 indicate indicate VERB crl-13774 84 10 the the DET crl-13774 84 11 presence presence NOUN crl-13774 84 12 of of ADP crl-13774 84 13 a a DET crl-13774 84 14 significant significant ADJ crl-13774 84 15 effect effect NOUN crl-13774 84 16 upon upon SCONJ crl-13774 84 17 library library NOUN crl-13774 84 18 - - PUNCT crl-13774 84 19 use use NOUN crl-13774 84 20 skills skill NOUN crl-13774 84 21 of of ADP crl-13774 84 22 library library NOUN crl-13774 84 23 - - PUNCT crl-13774 84 24 use use NOUN crl-13774 84 25 instruction instruction NOUN crl-13774 84 26 . . PUNCT crl-13774 85 1 the the DET crl-13774 85 2 use use NOUN crl-13774 85 3 of of ADP crl-13774 85 4 two two NUM crl-13774 85 5 measures measure NOUN crl-13774 85 6 of of ADP crl-13774 85 7 degree degree NOUN crl-13774 85 8 of of ADP crl-13774 85 9 exposure exposure NOUN crl-13774 85 10 to to ADP crl-13774 85 11 library library NOUN crl-13774 85 12 - - PUNCT crl-13774 85 13 use use NOUN crl-13774 85 14 instruction instruction NOUN crl-13774 85 15 to to ADP crl-13774 85 16 estitable2 estitable2 NOUN crl-13774 85 17 library library NOUN crl-13774 85 18 use use NOUN crl-13774 85 19 skills skill NOUN crl-13774 85 20 , , PUNCT crl-13774 85 21 library library NOUN crl-13774 85 22 - - PUNCT crl-13774 85 23 use use NOUN crl-13774 85 24 instruction instruction NOUN crl-13774 85 25 , , PUNCT crl-13774 85 26 and and CCONJ crl-13774 85 27 academic academic ADJ crl-13774 85 28 background background NOUN crl-13774 85 29 characteristics characteristic NOUN crl-13774 85 30 : : PUNCT crl-13774 85 31 a a DET crl-13774 85 32 comparison comparison NOUN crl-13774 85 33 of of ADP crl-13774 85 34 degree degree NOUN crl-13774 85 35 of of ADP crl-13774 85 36 association association NOUN crl-13774 85 37 among among ADP crl-13774 85 38 1980 1980 NUM crl-13774 85 39 seniors senior NOUN crl-13774 85 40 ( ( PUNCT crl-13774 85 41 gamma gamma NOUN crl-13774 85 42 ) ) PUNCT crl-13774 85 43 * * PUNCT crl-13774 85 44 measures measure NOUN crl-13774 85 45 of of ADP crl-13774 85 46 exposure exposure NOUN crl-13774 85 47 to to ADP crl-13774 85 48 library library NOUN crl-13774 85 49 - - PUNCT crl-13774 85 50 use use NOUN crl-13774 85 51 instruction instruction NOUN crl-13774 85 52 number number NOUN crl-13774 85 53 of of ADP crl-13774 85 54 courses course NOUN crl-13774 85 55 taken take VERB crl-13774 85 56 at at ADP crl-13774 85 57 upper upper ADJ crl-13774 85 58 division division NOUN crl-13774 85 59 level level NOUN crl-13774 85 60 where where SCONJ crl-13774 85 61 library library NOUN crl-13774 85 62 instruction instruction NOUN crl-13774 85 63 was be AUX crl-13774 85 64 given give VERB crl-13774 85 65 skill skill NOUN crl-13774 85 66 test test NOUN crl-13774 85 67 two two NUM crl-13774 85 68 or or CCONJ crl-13774 85 69 scorer scor ADJ crl-13774 85 70 none none NOUN crl-13774 85 71 one one NUM crl-13774 85 72 more more ADV crl-13774 85 73 low low ADJ crl-13774 85 74 77 77 NUM crl-13774 85 75 18 18 NUM crl-13774 85 76 1 1 NUM crl-13774 85 77 medium medium NOUN crl-13774 85 78 33 33 NUM crl-13774 85 79 26 26 NUM crl-13774 85 80 7 7 NUM crl-13774 85 81 high high ADJ crl-13774 85 82 18 18 NUM crl-13774 85 83 32 32 NUM crl-13774 85 84 18 18 NUM crl-13774 85 85 gamma= gamma= NUM crl-13774 85 86 .658 .658 NUM crl-13774 85 87 total total ADJ crl-13774 85 88 number number NOUN crl-13774 85 89 of of ADP crl-13774 85 90 courses course NOUN crl-13774 85 91 in in ADP crl-13774 85 92 which which PRON crl-13774 85 93 library library NOUN crl-13774 85 94 - - PUNCT crl-13774 85 95 use use NOUN crl-13774 85 96 instruction instruction NOUN crl-13774 85 97 was be AUX crl-13774 85 98 encountered encounter VERB crl-13774 85 99 ( ( PUNCT crl-13774 85 100 freshman freshman NOUN crl-13774 85 101 year year NOUN crl-13774 85 102 and and CCONJ crl-13774 85 103 upper upper ADJ crl-13774 85 104 - - PUNCT crl-13774 85 105 division division NOUN crl-13774 85 106 courses course NOUN crl-13774 85 107 ) ) PUNCT crl-13774 85 108 skill skill NOUN crl-13774 85 109 test test VERB crl-13774 85 110 no no DET crl-13774 85 111 . . PROPN crl-13774 85 112 freshman freshman NOUN crl-13774 85 113 freshman freshman NOUN crl-13774 85 114 and and CCONJ crl-13774 85 115 score score NOUN crl-13774 85 116 courses course NOUN crl-13774 85 117 only only ADV crl-13774 85 118 upper upper ADJ crl-13774 85 119 - - PUNCT crl-13774 85 120 division division NOUN crl-13774 85 121 low low ADJ crl-13774 85 122 24 24 NUM crl-13774 85 123 61 61 NUM crl-13774 85 124 11 11 NUM crl-13774 85 125 medium medium NOUN crl-13774 85 126 4 4 NUM crl-13774 85 127 33 33 NUM crl-13774 85 128 29 29 NUM crl-13774 85 129 high high ADJ crl-13774 85 130 6 6 NUM crl-13774 85 131 17 17 NUM crl-13774 85 132 45 45 NUM crl-13774 85 133 gamma= gamma= NUM crl-13774 85 134 .624 .624 NUM crl-13774 85 135 measures measure NOUN crl-13774 85 136 of of ADP crl-13774 85 137 academic academic ADJ crl-13774 85 138 background background NOUN crl-13774 85 139 scholastic scholastic ADJ crl-13774 85 140 aptitude aptitude NOUN crl-13774 85 141 testverbal testverbal NOUN crl-13774 85 142 grade grade NOUN crl-13774 85 143 point point NOUN crl-13774 85 144 average average NOUN crl-13774 85 145 ~440 ~440 DET crl-13774 85 146 low low ADJ crl-13774 85 147 32 32 NUM crl-13774 85 148 medium medium ADJ crl-13774 85 149 28 28 NUM crl-13774 85 150 high high ADJ crl-13774 85 151 11 11 NUM crl-13774 85 152 gamma= gamma= NUM crl-13774 85 153 .279 .279 NUM crl-13774 85 154 grade grade NOUN crl-13774 85 155 point point NOUN crl-13774 85 156 average average NOUN crl-13774 85 157 ~2.7 ~2.7 PUNCT crl-13774 85 158 low low ADJ crl-13774 85 159 44 44 NUM crl-13774 85 160 medium medium ADJ crl-13774 85 161 25 25 NUM crl-13774 85 162 high high ADJ crl-13774 85 163 13 13 NUM crl-13774 85 164 gamma= gamma= NUM crl-13774 85 165 .310 .310 NUM crl-13774 85 166 450 450 NUM crl-13774 85 167 - - SYM crl-13774 85 168 530 530 NUM crl-13774 85 169 33 33 NUM crl-13774 85 170 15 15 NUM crl-13774 85 171 16 16 NUM crl-13774 85 172 2.8 2.8 NUM crl-13774 85 173 - - SYM crl-13774 85 174 3.2 3.2 NUM crl-13774 85 175 27 27 NUM crl-13774 85 176 26 26 NUM crl-13774 85 177 22 22 NUM crl-13774 85 178 ~540 ~540 SYM crl-13774 85 179 21 21 NUM crl-13774 85 180 17 17 NUM crl-13774 85 181 32 32 NUM crl-13774 85 182 ~3 ~3 NOUN crl-13774 85 183 . . PUNCT crl-13774 86 1 3 3 NUM crl-13774 86 2 24 24 NUM crl-13774 86 3 15 15 NUM crl-13774 86 4 31 31 NUM crl-13774 86 5 •gamma •gamma NOUN crl-13774 86 6 is be AUX crl-13774 86 7 an an DET crl-13774 86 8 ordinal ordinal ADJ crl-13774 86 9 measure measure NOUN crl-13774 86 10 of of ADP crl-13774 86 11 statistical statistical ADJ crl-13774 86 12 association association NOUN crl-13774 86 13 measuring measure VERB crl-13774 86 14 one one NUM crl-13774 86 15 - - PUNCT crl-13774 86 16 way way NOUN crl-13774 86 17 association association NOUN crl-13774 86 18 . . PUNCT crl-13774 87 1 it it PRON crl-13774 87 2 utilizes utilize VERB crl-13774 87 3 information information NOUN crl-13774 87 4 about about ADP crl-13774 87 5 one one NUM crl-13774 87 6 variable variable NOUN crl-13774 87 7 to to PART crl-13774 87 8 tell tell VERB crl-13774 87 9 something something PRON crl-13774 87 10 about about ADP crl-13774 87 11 a a DET crl-13774 87 12 second second ADJ crl-13774 87 13 variable variable NOUN crl-13774 87 14 . . PUNCT crl-13774 88 1 the the PRON crl-13774 88 2 higher high ADJ crl-13774 88 3 the the DET crl-13774 88 4 gamma gamma NOUN crl-13774 88 5 score score NOUN crl-13774 88 6 the the PRON crl-13774 88 7 stronger strong ADJ crl-13774 88 8 the the DET crl-13774 88 9 association association NOUN crl-13774 88 10 between between ADP crl-13774 88 11 two two NUM crl-13774 88 12 variables variable NOUN crl-13774 88 13 . . PUNCT crl-13774 89 1 see see VERB crl-13774 89 2 michael michael PROPN crl-13774 89 3 malec malec PROPN crl-13774 89 4 , , PUNCT crl-13774 89 5 essential essential ADJ crl-13774 89 6 statistics statistic NOUN crl-13774 89 7 for for ADP crl-13774 89 8 social social ADJ crl-13774 89 9 research research NOUN crl-13774 89 10 ( ( PUNCT crl-13774 89 11 philadelphia philadelphia PROPN crl-13774 89 12 : : PUNCT crl-13774 89 13 lippincott lippincott PROPN crl-13774 89 14 , , PUNCT crl-13774 89 15 1977 1977 NUM crl-13774 89 16 ) ) PUNCT crl-13774 89 17 , , PUNCT crl-13774 89 18 p.137 p.137 NOUN crl-13774 89 19 - - SYM crl-13774 89 20 46 46 NUM crl-13774 89 21 . . PUNCT crl-13774 90 1 rscores rscore NOUN crl-13774 90 2 on on ADP crl-13774 90 3 the the DET crl-13774 90 4 skills skill NOUN crl-13774 90 5 tests test NOUN crl-13774 90 6 have have AUX crl-13774 90 7 been be AUX crl-13774 90 8 trichotomized trichotomize VERB crl-13774 90 9 into into ADP crl-13774 90 10 low low ADJ crl-13774 90 11 ( ( PUNCT crl-13774 90 12 15 15 NUM crl-13774 90 13 or or CCONJ crl-13774 90 14 less less ADJ crl-13774 90 15 ) ) PUNCT crl-13774 90 16 , , PUNCT crl-13774 90 17 medium medium NOUN crl-13774 90 18 ( ( PUNCT crl-13774 90 19 16 16 NUM crl-13774 90 20 or or CCONJ crl-13774 90 21 17 17 NUM crl-13774 90 22 ) ) PUNCT crl-13774 90 23 , , PUNCT crl-13774 90 24 and and CCONJ crl-13774 90 25 high high ADJ crl-13774 90 26 ( ( PUNCT crl-13774 90 27 18 18 NUM crl-13774 90 28 or or CCONJ crl-13774 90 29 more more ADJ crl-13774 90 30 ) ) PUNCT crl-13774 90 31 categories category NOUN crl-13774 90 32 . . PUNCT crl-13774 91 1 mate mate VERB crl-13774 91 2 the the DET crl-13774 91 3 effects effect NOUN crl-13774 91 4 of of ADP crl-13774 91 5 differential differential ADJ crl-13774 91 6 experience experience NOUN crl-13774 91 7 with with ADP crl-13774 91 8 library library NOUN crl-13774 91 9 - - PUNCT crl-13774 91 10 use use NOUN crl-13774 91 11 instruction instruction NOUN crl-13774 91 12 results result NOUN crl-13774 91 13 in in ADP crl-13774 91 14 virtually virtually ADV crl-13774 91 15 identical identical ADJ crl-13774 91 16 findings finding NOUN crl-13774 91 17 with with ADP crl-13774 91 18 respect respect NOUN crl-13774 91 19 to to ADP crl-13774 91 20 the the DET crl-13774 91 21 predicted predict VERB crl-13774 91 22 effect effect NOUN crl-13774 91 23 of of ADP crl-13774 91 24 library library NOUN crl-13774 91 25 - - PUNCT crl-13774 91 26 use use NOUN crl-13774 91 27 instruction instruction NOUN crl-13774 91 28 . . PUNCT crl-13774 92 1 whether whether SCONJ crl-13774 92 2 one one PRON crl-13774 92 3 considers consider VERB crl-13774 92 4 the the DET crl-13774 92 5 total total ADJ crl-13774 92 6 number number NOUN crl-13774 92 7 of of ADP crl-13774 92 8 courses course NOUN crl-13774 92 9 taken take VERB crl-13774 92 10 in in ADP crl-13774 92 11 which which PRON crl-13774 92 12 library library NOUN crl-13774 92 13 - - PUNCT crl-13774 92 14 use use NOUN crl-13774 92 15 instruction instruction NOUN crl-13774 92 16 was be AUX crl-13774 92 17 provided provide VERB crl-13774 92 18 , , PUNCT crl-13774 92 19 or or CCONJ crl-13774 92 20 whether whether SCONJ crl-13774 92 21 one one PRON crl-13774 92 22 focuses focus VERB crl-13774 92 23 only only ADV crl-13774 92 24 upon upon SCONJ crl-13774 92 25 upper upper ADJ crl-13774 92 26 division division NOUN crl-13774 92 27 courses course NOUN crl-13774 92 28 wherein wherein SCONJ crl-13774 92 29 special special ADJ crl-13774 92 30 bibliographical bibliographical ADJ crl-13774 92 31 instruction instruction NOUN crl-13774 92 32 by by ADP crl-13774 92 33 a a DET crl-13774 92 34 librarian librarian NOUN crl-13774 92 35 was be AUX crl-13774 92 36 part part NOUN crl-13774 92 37 of of ADP crl-13774 92 38 the the DET crl-13774 92 39 course course NOUN crl-13774 92 40 of of ADP crl-13774 92 41 instruction instruction NOUN crl-13774 92 42 , , PUNCT crl-13774 92 43 it it PRON crl-13774 92 44 is be AUX crl-13774 92 45 clear clear ADJ crl-13774 92 46 that that DET crl-13774 92 47 degree degree NOUN crl-13774 92 48 of of ADP crl-13774 92 49 exposure exposure NOUN crl-13774 92 50 to to ADP crl-13774 92 51 instruction instruction NOUN crl-13774 92 52 is be AUX crl-13774 92 53 positively positively ADV crl-13774 92 54 associated associate VERB crl-13774 92 55 with with ADP crl-13774 92 56 possession possession NOUN crl-13774 92 57 of of ADP crl-13774 92 58 library library NOUN crl-13774 92 59 - - PUNCT crl-13774 92 60 use use NOUN crl-13774 92 61 skills skill NOUN crl-13774 92 62 . . PUNCT crl-13774 93 1 when when SCONJ crl-13774 93 2 a a DET crl-13774 93 3 comparison comparison NOUN crl-13774 93 4 is be AUX crl-13774 93 5 made make VERB crl-13774 93 6 of of ADP crl-13774 93 7 the the DET crl-13774 93 8 degree degree NOUN crl-13774 93 9 of of ADP crl-13774 93 10 association association NOUN crl-13774 93 11 ( ( PUNCT crl-13774 93 12 the the DET crl-13774 93 13 gamma gamma NOUN crl-13774 93 14 coefficients coefficient NOUN crl-13774 93 15 ) ) PUNCT crl-13774 93 16 obtained obtain VERB crl-13774 93 17 between between ADP crl-13774 93 18 instruction instruction NOUN crl-13774 93 19 and and CCONJ crl-13774 93 20 skill skill NOUN crl-13774 93 21 possession possession NOUN crl-13774 93 22 and and CCONJ crl-13774 93 23 the the DET crl-13774 93 24 background background NOUN crl-13774 93 25 characteristics characteristic NOUN crl-13774 93 26 ( ( PUNCT crl-13774 93 27 sat sit VERB crl-13774 93 28 verbal verbal ADJ crl-13774 93 29 and and CCONJ crl-13774 93 30 cpa cpa NOUN crl-13774 93 31 ) ) PUNCT crl-13774 93 32 and and CCONJ crl-13774 93 33 skill skill NOUN crl-13774 93 34 possession possession NOUN crl-13774 93 35 , , PUNCT crl-13774 93 36 it it PRON crl-13774 93 37 is be AUX crl-13774 93 38 clear clear ADJ crl-13774 93 39 that that SCONJ crl-13774 93 40 library library NOUN crl-13774 93 41 - - PUNCT crl-13774 93 42 use use NOUN crl-13774 93 43 instruction instruction NOUN crl-13774 93 44 is be AUX crl-13774 93 45 much much ADV crl-13774 93 46 more more ADV crl-13774 93 47 highly highly ADV crl-13774 93 48 correlated correlate VERB crl-13774 93 49 with with ADP crl-13774 93 50 skill skill NOUN crl-13774 93 51 possession possession NOUN crl-13774 93 52 than than ADP crl-13774 93 53 either either CCONJ crl-13774 93 54 inherent inherent ADJ crl-13774 93 55 intellectual intellectual ADJ crl-13774 93 56 ability ability NOUN crl-13774 93 57 or or CCONJ crl-13774 93 58 academic academic ADJ crl-13774 93 59 diligence diligence NOUN crl-13774 93 60 . . PUNCT crl-13774 94 1 it it PRON crl-13774 94 2 is be AUX crl-13774 94 3 possible possible ADJ crl-13774 94 4 , , PUNCT crl-13774 94 5 of of ADP crl-13774 94 6 course course NOUN crl-13774 94 7 , , PUNCT crl-13774 94 8 that that SCONJ crl-13774 94 9 the the DET crl-13774 94 10 relationship relationship NOUN crl-13774 94 11 between between ADP crl-13774 94 12 exposure exposure NOUN crl-13774 94 13 to to ADP crl-13774 94 14 library library NOUN crl-13774 94 15 - - PUNCT crl-13774 94 16 use use NOUN crl-13774 94 17 instruction instruction NOUN crl-13774 94 18 and and CCONJ crl-13774 94 19 these these DET crl-13774 94 20 background background NOUN crl-13774 94 21 factors factor NOUN crl-13774 94 22 is be AUX crl-13774 94 23 biasing bias VERB crl-13774 94 24 the the DET crl-13774 94 25 observed observe VERB crl-13774 94 26 results result NOUN crl-13774 94 27 ; ; PUNCT crl-13774 94 28 that that PRON crl-13774 94 29 is is ADV crl-13774 94 30 , , PUNCT crl-13774 94 31 it it PRON crl-13774 94 32 coj.ild coj.ild X crl-13774 94 33 be be VERB crl-13774 94 34 that that SCONJ crl-13774 94 35 the the DET crl-13774 94 36 likelihood likelihood NOUN crl-13774 94 37 of of ADP crl-13774 94 38 taking take VERB crl-13774 94 39 additional additional ADJ crl-13774 94 40 course course NOUN crl-13774 94 41 work work NOUN crl-13774 94 42 in in ADP crl-13774 94 43 areas area NOUN crl-13774 94 44 where where SCONJ crl-13774 94 45 library library NOUN crl-13774 94 46 - - PUNCT crl-13774 94 47 use use NOUN crl-13774 94 48 instruction instruction NOUN crl-13774 94 49 is be AUX crl-13774 94 50 likely likely ADJ crl-13774 94 51 to to PART crl-13774 94 52 occur occur VERB crl-13774 94 53 is be AUX crl-13774 94 54 correlated correlate VERB crl-13774 94 55 with with ADP crl-13774 94 56 intellectual intellectual ADJ crl-13774 94 57 capacity capacity NOUN crl-13774 94 58 and/or and/or CCONJ crl-13774 94 59 academic academic ADJ crl-13774 94 60 diligence diligence NOUN crl-13774 94 61 , , PUNCT crl-13774 94 62 hence hence ADV crl-13774 94 63 indicating indicate VERB crl-13774 94 64 a a DET crl-13774 94 65 spuriously spuriously ADV crl-13774 94 66 high high ADJ crl-13774 94 67 association association NOUN crl-13774 94 68 between between ADP crl-13774 94 69 library library NOUN crl-13774 94 70 - - PUNCT crl-13774 94 71 use use NOUN crl-13774 94 72 instruction instruction NOUN crl-13774 94 73 and and CCONJ crl-13774 94 74 possession possession NOUN crl-13774 94 75 of of ADP crl-13774 94 76 library library NOUN crl-13774 94 77 - - PUNCT crl-13774 94 78 use use NOUN crl-13774 94 79 skills skill NOUN crl-13774 94 80 . . PUNCT crl-13774 95 1 in in ADP crl-13774 95 2 order order NOUN crl-13774 95 3 to to PART crl-13774 95 4 check check VERB crl-13774 95 5 against against ADP crl-13774 95 6 this this DET crl-13774 95 7 possibility possibility NOUN crl-13774 95 8 , , PUNCT crl-13774 95 9 it it PRON crl-13774 95 10 is be AUX crl-13774 95 11 necessary necessary ADJ crl-13774 95 12 to to PART crl-13774 95 13 employ employ VERB crl-13774 95 14 multiple multiple ADJ crl-13774 95 15 regression regression NOUN crl-13774 95 16 analysis analysis NOUN crl-13774 95 17 , , PUNCT crl-13774 95 18 a a DET crl-13774 95 19 statistical statistical ADJ crl-13774 95 20 process process NOUN crl-13774 95 21 wherein wherein SCONJ crl-13774 95 22 the the DET crl-13774 95 23 simultaneous simultaneous ADJ crl-13774 95 24 consideration consideration NOUN crl-13774 95 25 of of ADP crl-13774 95 26 instructional instructional ADJ crl-13774 95 27 exposure exposure NOUN crl-13774 95 28 and and CCONJ crl-13774 95 29 background background NOUN crl-13774 95 30 factors factor NOUN crl-13774 95 31 can can AUX crl-13774 95 32 be be AUX crl-13774 95 33 accomplished accomplish VERB crl-13774 95 34 and and CCONJ crl-13774 95 35 results result NOUN crl-13774 95 36 can can AUX crl-13774 95 37 be be AUX crl-13774 95 38 obtained obtain VERB crl-13774 95 39 that that PRON crl-13774 95 40 indicate indicate VERB crl-13774 95 41 . . PUNCT crl-13774 96 1 the the DET crl-13774 96 2 relative relative ADJ crl-13774 96 3 importance importance NOUN crl-13774 96 4 of of ADP crl-13774 96 5 each each DET crl-13774 96 6 factor factor NOUN crl-13774 96 7 in in ADP crl-13774 96 8 the the DET crl-13774 96 9 determination determination NOUN crl-13774 96 10 of of ADP crl-13774 96 11 variation variation NOUN crl-13774 96 12 in in ADP crl-13774 96 13 library library NOUN crl-13774 96 14 - - PUNCT crl-13774 96 15 use use NOUN crl-13774 96 16 skills skill NOUN crl-13774 96 17 possession possession NOUN crl-13774 96 18 . . PUNCT crl-13774 97 1 17 17 NUM crl-13774 97 2 table table NOUN crl-13774 97 3 3 3 NUM crl-13774 97 4 reports report VERB crl-13774 97 5 the the DET crl-13774 97 6 results result NOUN crl-13774 97 7 of of ADP crl-13774 97 8 a a DET crl-13774 97 9 multiple multiple ADJ crl-13774 97 10 regression regression NOUN crl-13774 97 11 analysis analysis NOUN crl-13774 97 12 that that PRON crl-13774 97 13 employs employ VERB crl-13774 97 14 sat sit VERB crl-13774 97 15 verbal verbal ADJ crl-13774 97 16 test test NOUN crl-13774 97 17 scores score NOUN crl-13774 97 18 , , PUNCT crl-13774 97 19 grade grade NOUN crl-13774 97 20 point point NOUN crl-13774 97 21 average average NOUN crl-13774 97 22 , , PUNCT crl-13774 97 23 number number NOUN crl-13774 97 24 of of ADP crl-13774 97 25 upper upper ADJ crl-13774 97 26 division division NOUN crl-13774 97 27 courses course NOUN crl-13774 97 28 taken take VERB crl-13774 97 29 wherein wherein SCONJ crl-13774 97 30 libraryuse libraryuse NOUN crl-13774 97 31 instruction instruction NOUN crl-13774 97 32 occurred occur VERB crl-13774 97 33 , , PUNCT crl-13774 97 34 and and CCONJ crl-13774 97 35 total total ADJ crl-13774 97 36 number number NOUN crl-13774 97 37 of of ADP crl-13774 97 38 library library NOUN crl-13774 97 39 - - PUNCT crl-13774 97 40 use use NOUN crl-13774 97 41 instruction instruction NOUN crl-13774 97 42 courses course NOUN crl-13774 97 43 experienced experience VERB crl-13774 97 44 to to PART crl-13774 97 45 predict predict VERB crl-13774 97 46 library library NOUN crl-13774 97 47 - - PUNCT crl-13774 97 48 use use NOUN crl-13774 97 49 skill skill NOUN crl-13774 97 50 scores score NOUN crl-13774 97 51 among among ADP crl-13774 97 52 1980 1980 NUM crl-13774 97 53 seniors senior NOUN crl-13774 97 54 . . PUNCT crl-13774 98 1 the the DET crl-13774 98 2 results result NOUN crl-13774 98 3 displayed display VERB crl-13774 98 4 in in ADP crl-13774 98 5 table table NOUN crl-13774 98 6 3 3 NUM crl-13774 98 7 indicate indicate VERB crl-13774 98 8 clearly clearly ADV crl-13774 98 9 that that DET crl-13774 98 10 experience experience NOUN crl-13774 98 11 with with ADP crl-13774 98 12 library library NOUN crl-13774 98 13 - - PUNCT crl-13774 98 14 use use NOUN crl-13774 98 15 instruction instruction NOUN crl-13774 98 16 is be AUX crl-13774 98 17 the the DET crl-13774 98 18 most most ADV crl-13774 98 19 important important ADJ crl-13774 98 20 source source NOUN crl-13774 98 21 of of ADP crl-13774 98 22 variation variation NOUN crl-13774 98 23 in in ADP crl-13774 98 24 library library NOUN crl-13774 98 25 - - PUNCT crl-13774 98 26 use use NOUN crl-13774 98 27 skills skill NOUN crl-13774 98 28 possession possession NOUN crl-13774 98 29 . . PUNCT crl-13774 99 1 in in ADP crl-13774 99 2 terms term NOUN crl-13774 99 3 of of ADP crl-13774 99 4 relative relative ADJ crl-13774 99 5 effects effect NOUN crl-13774 99 6 , , PUNCT crl-13774 99 7 the the DET crl-13774 99 8 two two NUM crl-13774 99 9 indicators indicator NOUN crl-13774 99 10 of of ADP crl-13774 99 11 exposure exposure NOUN crl-13774 99 12 to to ADP crl-13774 99 13 library library NOUN crl-13774 99 14 - - PUNCT crl-13774 99 15 use use NOUN crl-13774 99 16 instruction instruction NOUN crl-13774 99 17 rank rank NOUN crl-13774 99 18 highest high ADJ crl-13774 99 19 library library NOUN crl-13774 99 20 - - PUNCT crl-13774 99 21 use use NOUN crl-13774 99 22 instruction instruction NOUN crl-13774 99 23 i i NOUN crl-13774 99 24 43 43 NUM crl-13774 99 25 table3 table3 NOUN crl-13774 99 26 results result NOUN crl-13774 99 27 of of ADP crl-13774 99 28 multiple multiple ADJ crl-13774 99 29 regression regression NOUN crl-13774 99 30 analysis analysis NOUN crl-13774 99 31 * * PUNCT crl-13774 99 32 resultst resultst PROPN crl-13774 99 33 multiple multiple PROPN crl-13774 99 34 r r NOUN crl-13774 99 35 .623 .623 NUM crl-13774 99 36 r r NOUN crl-13774 99 37 square square ADJ crl-13774 99 38 .389 .389 NUM crl-13774 99 39 standardized standardize VERB crl-13774 99 40 regression regression NOUN crl-13774 99 41 coefficients coefficient NOUN crl-13774 99 42 ! ! PUNCT crl-13774 100 1 statistical statistical ADJ crl-13774 100 2 beta beta ADJ crl-13774 100 3 significance significance NOUN crl-13774 100 4 total total ADJ crl-13774 100 5 number number NOUN crl-13774 100 6 of of ADP crl-13774 100 7 courses course NOUN crl-13774 100 8 number number NOUN crl-13774 100 9 of of ADP crl-13774 100 10 upper upper ADJ crl-13774 100 11 , , PUNCT crl-13774 100 12 division division NOUN crl-13774 100 13 courses course NOUN crl-13774 100 14 sat sit VERB crl-13774 100 15 verbal verbal ADJ crl-13774 100 16 cpa cpa NOUN crl-13774 100 17 .367 .367 NUM crl-13774 100 18 .262 .262 NUM crl-13774 100 19 .162 .162 NUM crl-13774 100 20 .159 .159 NUM crl-13774 100 21 .001 .001 NUM crl-13774 101 1 .001 .001 NUM crl-13774 101 2 .05 .05 NUM crl-13774 101 3 .05 .05 NUM crl-13774 102 1 •relative •relative ADJ crl-13774 102 2 effects effect NOUN crl-13774 102 3 upon upon SCONJ crl-13774 102 4 level level NOUN crl-13774 102 5 of of ADP crl-13774 102 6 libraryuse libraryuse NOUN crl-13774 102 7 skills skill NOUN crl-13774 102 8 for for ADP crl-13774 102 9 1980 1980 NUM crl-13774 102 10 seniors senior NOUN crl-13774 102 11 produced produce VERB crl-13774 102 12 by by ADP crl-13774 102 13 exposure exposure NOUN crl-13774 102 14 to to ADP crl-13774 102 15 instruction instruction NOUN crl-13774 102 16 and and CCONJ crl-13774 102 17 academic academic ADJ crl-13774 102 18 background background NOUN crl-13774 102 19 . . PUNCT crl-13774 103 1 roependent roependent NOUN crl-13774 103 2 variable variable ADJ crl-13774 103 3 = = PROPN crl-13774 103 4 library library NOUN crl-13774 103 5 - - PUNCT crl-13774 103 6 use use NOUN crl-13774 103 7 skill skill NOUN crl-13774 103 8 score score VERB crl-13774 103 9 independent independent ADJ crl-13774 103 10 variables variable NOUN crl-13774 103 11 = = PUNCT crl-13774 103 12 sat sit VERB crl-13774 103 13 verb verb ADJ crl-13774 103 14 i i NOUN crl-13774 103 15 , , PUNCT crl-13774 103 16 cpa cpa NOUN crl-13774 103 17 , , PUNCT crl-13774 103 18 number number NOUN crl-13774 103 19 of of ADP crl-13774 103 20 upperdivision upperdivision NOUN crl-13774 103 21 courses course NOUN crl-13774 103 22 wherein wherein SCONJ crl-13774 103 23 library library NOUN crl-13774 103 24 - - PUNCT crl-13774 103 25 use use NOUN crl-13774 103 26 instruction instruction NOUN crl-13774 103 27 occurred occur VERB crl-13774 103 28 , , PUNCT crl-13774 103 29 and and CCONJ crl-13774 103 30 total total ADJ crl-13774 103 31 number number NOUN crl-13774 103 32 of of ADP crl-13774 103 33 courses course NOUN crl-13774 103 34 since since SCONJ crl-13774 103 35 freshman freshman NOUN crl-13774 103 36 year year NOUN crl-13774 103 37 wherein wherein SCONJ crl-13774 103 38 library library NOUN crl-13774 103 39 - - PUNCT crl-13774 103 40 use use NOUN crl-13774 103 41 instruction instruction NOUN crl-13774 103 42 occurred occur VERB crl-13774 103 43 . . PUNCT crl-13774 104 1 ! ! PUNCT crl-13774 105 1 relative relative ADJ crl-13774 105 2 predictive predictive ADJ crl-13774 105 3 power power NOUN crl-13774 105 4 of of ADP crl-13774 105 5 independent independent ADJ crl-13774 105 6 variables variable NOUN crl-13774 105 7 . . PUNCT crl-13774 106 1 and and CCONJ crl-13774 106 2 next next ADV crl-13774 106 3 highest high ADJ crl-13774 106 4 in in ADP crl-13774 106 5 the the DET crl-13774 106 6 ordering ordering NOUN crl-13774 106 7 of of ADP crl-13774 106 8 standardized standardized ADJ crl-13774 106 9 regression regression NOUN crl-13774 106 10 coefficients coefficient NOUN crl-13774 106 11 ( ( PUNCT crl-13774 106 12 indicators indicator NOUN crl-13774 106 13 of of ADP crl-13774 106 14 degree degree NOUN crl-13774 106 15 of of ADP crl-13774 106 16 impact impact NOUN crl-13774 106 17 upon upon SCONJ crl-13774 106 18 the the DET crl-13774 106 19 dependent dependent ADJ crl-13774 106 20 variable variable NOUN crl-13774 106 21 of of ADP crl-13774 106 22 one one NUM crl-13774 106 23 predictor predictor NOUN crl-13774 106 24 after after SCONJ crl-13774 106 25 the the DET crl-13774 106 26 intervening intervene VERB crl-13774 106 27 contributory contributory NOUN crl-13774 106 28 effects effect NOUN crl-13774 106 29 of of ADP crl-13774 106 30 all all DET crl-13774 106 31 other other ADJ crl-13774 106 32 predictors predictor NOUN crl-13774 106 33 have have AUX crl-13774 106 34 been be AUX crl-13774 106 35 controlled control VERB crl-13774 106 36 ) ) PUNCT crl-13774 106 37 for for ADP crl-13774 106 38 the the DET crl-13774 106 39 four four NUM crl-13774 106 40 variables variable NOUN crl-13774 106 41 entered enter VERB crl-13774 106 42 into into ADP crl-13774 106 43 the the DET crl-13774 106 44 regression regression NOUN crl-13774 106 45 analysis analysis NOUN crl-13774 106 46 . . PUNCT crl-13774 107 1 sat sit VERB crl-13774 107 2 verbal verbal ADJ crl-13774 107 3 scores score NOUN crl-13774 107 4 and and CCONJ crl-13774 107 5 grade grade NOUN crl-13774 107 6 point point NOUN crl-13774 107 7 average average NOUN crl-13774 107 8 do do AUX crl-13774 107 9 not not PART crl-13774 107 10 rival rival VERB crl-13774 107 11 the the DET crl-13774 107 12 effects effect NOUN crl-13774 107 13 of of ADP crl-13774 107 14 total total ADJ crl-13774 107 15 number number NOUN crl-13774 107 16 of of ADP crl-13774 107 17 courses course NOUN crl-13774 107 18 taken take VERB crl-13774 107 19 in in ADP crl-13774 107 20 which which PRON crl-13774 107 21 library library NOUN crl-13774 107 22 - - PUNCT crl-13774 107 23 use use NOUN crl-13774 107 24 instruction instruction NOUN crl-13774 107 25 is be AUX crl-13774 107 26 obtained obtain VERB crl-13774 107 27 as as ADP crl-13774 107 28 a a DET crl-13774 107 29 predictor predictor NOUN crl-13774 107 30 of of ADP crl-13774 107 31 leve~ leve~ NOUN crl-13774 107 32 of of ADP crl-13774 107 33 library library NOUN crl-13774 107 34 - - PUNCT crl-13774 107 35 use use NOUN crl-13774 107 36 skills skill NOUN crl-13774 107 37 possession possession NOUN crl-13774 107 38 . . PUNCT crl-13774 108 1 the the DET crl-13774 108 2 analyses analysis NOUN crl-13774 108 3 developed develop VERB crl-13774 108 4 up up ADP crl-13774 108 5 to to ADP crl-13774 108 6 this this DET crl-13774 108 7 point point NOUN crl-13774 108 8 indicate indicate VERB crl-13774 108 9 very very ADV crl-13774 108 10 clearly clearly ADV crl-13774 108 11 the the DET crl-13774 108 12 possibility possibility NOUN crl-13774 108 13 that that SCONJ crl-13774 108 14 important important ADJ crl-13774 108 15 effects effect NOUN crl-13774 108 16 are be AUX crl-13774 108 17 associated associate VERB crl-13774 108 18 with with ADP crl-13774 108 19 library library NOUN crl-13774 108 20 - - PUNCT crl-13774 108 21 use use NOUN crl-13774 108 22 instruction instruction NOUN crl-13774 108 23 . . PUNCT crl-13774 109 1 however however ADV crl-13774 109 2 , , PUNCT crl-13774 109 3 the the DET crl-13774 109 4 possibility possibility NOUN crl-13774 109 5 persists persist VERB crl-13774 109 6 that that SCONJ crl-13774 109 7 an an DET crl-13774 109 8 ecological ecological ADJ crl-13774 109 9 fallacy fallacy NOUN crl-13774 109 10 may may AUX crl-13774 109 11 be be AUX crl-13774 109 12 associated associate VERB crl-13774 109 13 with with ADP crl-13774 109 14 the the DET crl-13774 109 15 exclusive exclusive ADJ crl-13774 109 16 use use NOUN crl-13774 109 17 of of ADP crl-13774 109 18 aggregate aggregate ADJ crl-13774 109 19 data datum NOUN crl-13774 109 20 and and CCONJ crl-13774 109 21 collective collective ADJ crl-13774 109 22 comparisons comparison NOUN crl-13774 109 23 . . PUNCT crl-13774 110 1 that that PRON crl-13774 110 2 is be AUX crl-13774 110 3 to to PART crl-13774 110 4 say say VERB crl-13774 110 5 , , PUNCT crl-13774 110 6 the the DET crl-13774 110 7 aggregate aggregate NOUN crl-13774 110 8 association association NOUN crl-13774 110 9 between between ADP crl-13774 110 10 instruction instruction NOUN crl-13774 110 11 and and CCONJ crl-13774 110 12 skills skill NOUN crl-13774 110 13 possession possession NOUN crl-13774 110 14 may may AUX crl-13774 110 15 not not PART crl-13774 110 16 derive derive VERB crl-13774 110 17 from from ADP crl-13774 110 18 individual individual ADJ crl-13774 110 19 effects effect NOUN crl-13774 110 20 . . PUNCT crl-13774 111 1 18 18 NUM crl-13774 111 2 in in ADP crl-13774 111 3 comparing compare VERB crl-13774 111 4 various various ADJ crl-13774 111 5 subgroups subgroup NOUN crl-13774 111 6 ( ( PUNCT crl-13774 111 7 e.g. e.g. ADV crl-13774 111 8 , , PUNCT crl-13774 111 9 highly highly ADV crl-13774 111 10 exposed expose VERB crl-13774 111 11 versus versus ADP crl-13774 111 12 freshmaninstructed freshmaninstructe VERB crl-13774 111 13 only only ADV crl-13774 111 14 , , PUNCT crl-13774 111 15 high high ADJ crl-13774 111 16 grade grade NOUN crl-13774 111 17 point point NOUN crl-13774 111 18 average average NOUN crl-13774 111 19 versus versus ADP crl-13774 111 20 modest modest ADJ crl-13774 111 21 grades grade NOUN crl-13774 111 22 , , PUNCT crl-13774 111 23 etc etc X crl-13774 111 24 . . X crl-13774 111 25 ) ) PUNCT crl-13774 111 26 to to PART crl-13774 111 27 determine determine VERB crl-13774 111 28 the the DET crl-13774 111 29 degree degree NOUN crl-13774 111 30 of of ADP crl-13774 111 31 association association NOUN crl-13774 111 32 with with ADP crl-13774 111 33 skills skill NOUN crl-13774 111 34 possession possession NOUN crl-13774 111 35 demonstrated demonstrate VERB crl-13774 111 36 by by ADP crl-13774 111 37 one one NUM crl-13774 111 38 or or CCONJ crl-13774 111 39 another another DET crl-13774 111 40 factor factor NOUN crl-13774 111 41 , , PUNCT crl-13774 111 42 it it PRON crl-13774 111 43 is be AUX crl-13774 111 44 always always ADV crl-13774 111 45 possible possible ADJ crl-13774 111 46 that that SCONJ crl-13774 111 47 the the DET crl-13774 111 48 groups group NOUN crl-13774 111 49 being be AUX crl-13774 111 50 compared compare VERB crl-13774 111 51 are be AUX crl-13774 111 52 dissimilar dissimilar ADJ crl-13774 111 53 with with ADP crl-13774 111 54 respect respect NOUN crl-13774 111 55 to to ADP crl-13774 111 56 one one NUM crl-13774 111 57 or or CCONJ crl-13774 111 58 more more ADV crl-13774 111 59 important important ADJ crl-13774 111 60 factors factor NOUN crl-13774 111 61 . . PUNCT crl-13774 112 1 one one NUM crl-13774 112 2 way way NOUN crl-13774 112 3 to to PART crl-13774 112 4 remedy remedy VERB crl-13774 112 5 this this DET crl-13774 112 6 problem problem NOUN crl-13774 112 7 in in ADP crl-13774 112 8 the the DET crl-13774 112 9 study study NOUN crl-13774 112 10 of of ADP crl-13774 112 11 factors factor NOUN crl-13774 112 12 associated associate VERB crl-13774 112 13 with with ADP crl-13774 112 14 change change NOUN crl-13774 112 15 due due ADP crl-13774 112 16 to to ADP crl-13774 112 17 instructional instructional ADJ crl-13774 112 18 effects effect NOUN crl-13774 112 19 is be AUX crl-13774 112 20 to to PART crl-13774 112 21 study study VERB crl-13774 112 22 the the DET crl-13774 112 23 same same ADJ crl-13774 112 24 persons person NOUN crl-13774 112 25 ( ( PUNCT crl-13774 112 26 as as SCONJ crl-13774 112 27 opposed oppose VERB crl-13774 112 28 to to ADP crl-13774 112 29 differ44 differ44 VERB crl-13774 112 30 i i PROPN crl-13774 112 31 college college PROPN crl-13774 112 32 & & CCONJ crl-13774 112 33 research research PROPN crl-13774 112 34 libraries library NOUN crl-13774 112 35 • • ADJ crl-13774 112 36 january january PROPN crl-13774 112 37 1982 1982 NUM crl-13774 112 38 ent ent NOUN crl-13774 112 39 groups group NOUN crl-13774 112 40 of of ADP crl-13774 112 41 persons person NOUN crl-13774 112 42 ) ) PUNCT crl-13774 112 43 over over ADP crl-13774 112 44 time time NOUN crl-13774 112 45 . . PUNCT crl-13774 113 1 this this DET crl-13774 113 2 panel panel NOUN crl-13774 113 3 study study NOUN crl-13774 113 4 technique technique NOUN crl-13774 113 5 is be AUX crl-13774 113 6 often often ADV crl-13774 113 7 employed employ VERB crl-13774 113 8 to to PART crl-13774 113 9 determine determine VERB crl-13774 113 10 both both CCONJ crl-13774 113 11 the the DET crl-13774 113 12 direction direction NOUN crl-13774 113 13 of of ADP crl-13774 113 14 effects effect NOUN crl-13774 113 15 due due ADJ crl-13774 113 16 to to ADP crl-13774 113 17 in~ in~ PROPN crl-13774 113 18 struction struction NOUN crl-13774 113 19 and and CCONJ crl-13774 113 20 to to PART crl-13774 113 21 assess assess VERB crl-13774 113 22 the the DET crl-13774 113 23 absolute absolute ADJ crl-13774 113 24 amount amount NOUN crl-13774 113 25 of of ADP crl-13774 113 26 change change NOUN crl-13774 113 27 occurring occur VERB crl-13774 113 28 where where SCONJ crl-13774 113 29 it it PRON crl-13774 113 30 is be AUX crl-13774 113 31 possible possible ADJ crl-13774 113 32 that that SCONJ crl-13774 113 33 students student NOUN crl-13774 113 34 might might AUX crl-13774 113 35 both both PRON crl-13774 113 36 gain gain VERB crl-13774 113 37 and and CCONJ crl-13774 113 38 lose lose VERB crl-13774 113 39 skills skill NOUN crl-13774 113 40 or or CCONJ crl-13774 113 41 information information NOUN crl-13774 113 42 at at ADP crl-13774 113 43 varying vary VERB crl-13774 113 44 rates rate NOUN crl-13774 113 45 . . PUNCT crl-13774 114 1 not not PART crl-13774 114 2 only only ADV crl-13774 114 3 does do AUX crl-13774 114 4 the the DET crl-13774 114 5 use use NOUN crl-13774 114 6 of of ADP crl-13774 114 7 a a DET crl-13774 114 8 panel panel NOUN crl-13774 114 9 study study NOUN crl-13774 114 10 technique technique NOUN crl-13774 114 11 allow allow VERB crl-13774 114 12 one one PRON crl-13774 114 13 to to PART crl-13774 114 14 check check VERB crl-13774 114 15 for for ADP crl-13774 114 16 the the DET crl-13774 114 17 hidden hide VERB crl-13774 114 18 effects effect NOUN crl-13774 114 19 of of ADP crl-13774 114 20 intervening intervene VERB crl-13774 114 21 factors factor NOUN crl-13774 114 22 , , PUNCT crl-13774 114 23 but but CCONJ crl-13774 114 24 it it PRON crl-13774 114 25 also also ADV crl-13774 114 26 allows allow VERB crl-13774 114 27 the the DET crl-13774 114 28 researcher researcher NOUN crl-13774 114 29 to to PART crl-13774 114 30 distinguish distinguish VERB crl-13774 114 31 between between ADP crl-13774 114 32 shortterm shortterm NOUN crl-13774 114 33 and and CCONJ crl-13774 114 34 long long ADJ crl-13774 114 35 - - PUNCT crl-13774 114 36 term term NOUN crl-13774 114 37 gains gain NOUN crl-13774 114 38 in in ADP crl-13774 114 39 skills skill NOUN crl-13774 114 40 or or CCONJ crl-13774 114 41 information information NOUN crl-13774 114 42 . . PUNCT crl-13774 115 1 by by ADP crl-13774 115 2 taking take VERB crl-13774 115 3 measurements measurement NOUN crl-13774 115 4 of of ADP crl-13774 115 5 skills skill NOUN crl-13774 115 6 possessed possess VERB crl-13774 115 7 before before ADP crl-13774 115 8 instruction instruction NOUN crl-13774 115 9 , , PUNCT crl-13774 115 10 shortly shortly ADV crl-13774 115 11 after after ADP crl-13774 115 12 the the DET crl-13774 115 13 conclusion conclusion NOUN crl-13774 115 14 of of ADP crl-13774 115 15 instruction instruction NOUN crl-13774 115 16 ( ( PUNCT crl-13774 115 17 eight eight NUM crl-13774 115 18 weeks week NOUN crl-13774 115 19 ) ) PUNCT crl-13774 115 20 , , PUNCT crl-13774 115 21 and and CCONJ crl-13774 115 22 a a DET crl-13774 115 23 considerable considerable ADJ crl-13774 115 24 time time NOUN crl-13774 115 25 after after ADP crl-13774 115 26 instruction instruction NOUN crl-13774 115 27 ( ( PUNCT crl-13774 115 28 three three NUM crl-13774 115 29 years year NOUN crl-13774 115 30 ) ) PUNCT crl-13774 115 31 , , PUNCT crl-13774 115 32 it it PRON crl-13774 115 33 is be AUX crl-13774 115 34 possible possible ADJ crl-13774 115 35 to to PART crl-13774 115 36 identify identify VERB crl-13774 115 37 both both PRON crl-13774 115 38 shortterm shortterm ADJ crl-13774 115 39 and and CCONJ crl-13774 115 40 long long ADJ crl-13774 115 41 - - PUNCT crl-13774 115 42 term term NOUN crl-13774 115 43 effects effect NOUN crl-13774 115 44 of of ADP crl-13774 115 45 instruction instruction NOUN crl-13774 115 46 , , PUNCT crl-13774 115 47 and and CCONJ crl-13774 115 48 it it PRON crl-13774 115 49 is be AUX crl-13774 115 50 possible possible ADJ crl-13774 115 51 to to PART crl-13774 115 52 determine determine VERB crl-13774 115 53 what what PRON crl-13774 115 54 factors factor NOUN crl-13774 115 55 are be AUX crl-13774 115 56 associated associate VERB crl-13774 115 57 with with ADP crl-13774 115 58 both both CCONJ crl-13774 115 59 short short ADJ crl-13774 115 60 - - PUNCT crl-13774 115 61 term term NOUN crl-13774 115 62 and and CCONJ crl-13774 115 63 longterm longterm NOUN crl-13774 115 64 changes change NOUN crl-13774 115 65 in in ADP crl-13774 115 66 skills skill NOUN crl-13774 115 67 possession possession NOUN crl-13774 115 68 levels level NOUN crl-13774 115 69 . . PUNCT crl-13774 116 1 table table NOUN crl-13774 116 2 4 4 NUM crl-13774 116 3 reports report VERB crl-13774 116 4 the the DET crl-13774 116 5 results result NOUN crl-13774 116 6 of of ADP crl-13774 116 7 such such DET crl-13774 116 8 an an DET crl-13774 116 9 analysis analysis NOUN crl-13774 116 10 . . PUNCT crl-13774 117 1 it it PRON crl-13774 117 2 includes include VERB crl-13774 117 3 a a DET crl-13774 117 4 listing listing NOUN crl-13774 117 5 of of ADP crl-13774 117 6 measures measure NOUN crl-13774 117 7 of of ADP crl-13774 117 8 association association NOUN crl-13774 117 9 ( ( PUNCT crl-13774 117 10 pearson pearson NOUN crl-13774 117 11 correlation correlation NOUN crl-13774 117 12 coefficients coefficient NOUN crl-13774 117 13 ) ) PUNCT crl-13774 117 14 for for ADP crl-13774 117 15 the the DET crl-13774 117 16 four four NUM crl-13774 117 17 major major ADJ crl-13774 117 18 factors factor NOUN crl-13774 117 19 investigated investigate VERB crl-13774 117 20 abovetwo abovetwo ADJ crl-13774 117 21 measures measure NOUN crl-13774 117 22 of of ADP crl-13774 117 23 exposure exposure NOUN crl-13774 117 24 to to ADP crl-13774 117 25 library library NOUN crl-13774 117 26 instruction instruction NOUN crl-13774 117 27 , , PUNCT crl-13774 117 28 a a DET crl-13774 117 29 measure measure NOUN crl-13774 117 30 of of ADP crl-13774 117 31 intellectual intellectual ADJ crl-13774 117 32 capacity capacity NOUN crl-13774 117 33 , , PUNCT crl-13774 117 34 and and CCONJ crl-13774 117 35 a a DET crl-13774 117 36 measure measure NOUN crl-13774 117 37 of of ADP crl-13774 117 38 academic academic ADJ crl-13774 117 39 diligence diligence NOUN crl-13774 117 40 . . PUNCT crl-13774 118 1 table table NOUN crl-13774 118 2 4 4 NUM crl-13774 118 3 adds add VERB crl-13774 118 4 further further ADJ crl-13774 118 5 evidence evidence NOUN crl-13774 118 6 to to ADP crl-13774 118 7 the the DET crl-13774 118 8 argument argument NOUN crl-13774 118 9 that that SCONJ crl-13774 118 10 library library NOUN crl-13774 118 11 - - PUNCT crl-13774 118 12 use use NOUN crl-13774 118 13 instruction instruction NOUN crl-13774 118 14 is be AUX crl-13774 118 15 an an DET crl-13774 118 16 effective effective ADJ crl-13774 118 17 means mean NOUN crl-13774 118 18 of of ADP crl-13774 118 19 enhancing enhance VERB crl-13774 118 20 library library NOUN crl-13774 118 21 - - PUNCT crl-13774 118 22 use use NOUN crl-13774 118 23 skills skill NOUN crl-13774 118 24 . . PUNCT crl-13774 119 1 in in ADP crl-13774 119 2 the the DET crl-13774 119 3 area area NOUN crl-13774 119 4 of of ADP crl-13774 119 5 academic academic ADJ crl-13774 119 6 background background NOUN crl-13774 119 7 factors factor NOUN crl-13774 119 8 it it PRON crl-13774 119 9 can can AUX crl-13774 119 10 be be AUX crl-13774 119 11 seen see VERB crl-13774 119 12 that that SCONJ crl-13774 119 13 there there PRON crl-13774 119 14 is be VERB crl-13774 119 15 a a DET crl-13774 119 16 modest modest ADJ crl-13774 119 17 degree degree NOUN crl-13774 119 18 of of ADP crl-13774 119 19 association association NOUN crl-13774 119 20 between between ADP crl-13774 119 21 both both DET crl-13774 119 22 grade grade NOUN crl-13774 119 23 point point NOUN crl-13774 119 24 average average NOUN crl-13774 119 25 and and CCONJ crl-13774 119 26 sat sit VERB crl-13774 119 27 verbal verbal ADJ crl-13774 119 28 test test NOUN crl-13774 119 29 scores score NOUN crl-13774 119 30 and and CCONJ crl-13774 119 31 short short ADJ crl-13774 119 32 - - PUNCT crl-13774 119 33 term term NOUN crl-13774 119 34 changes change NOUN crl-13774 119 35 in in ADP crl-13774 119 36 library library NOUN crl-13774 119 37 - - PUNCT crl-13774 119 38 use use NOUN crl-13774 119 39 skills skill NOUN crl-13774 119 40 , , PUNCT crl-13774 119 41 but but CCONJ crl-13774 119 42 that that SCONJ crl-13774 119 43 neither neither DET crl-13774 119 44 factor factor NOUN crl-13774 119 45 is be AUX crl-13774 119 46 associated associate VERB crl-13774 119 47 with with ADP crl-13774 119 48 long long ADJ crl-13774 119 49 - - PUNCT crl-13774 119 50 term term NOUN crl-13774 119 51 libraryuse libraryuse NOUN crl-13774 119 52 skill skill NOUN crl-13774 119 53 scores score NOUN crl-13774 119 54 to to ADP crl-13774 119 55 a a DET crl-13774 119 56 statistically statistically ADV crl-13774 119 57 significant significant ADJ crl-13774 119 58 degree degree NOUN crl-13774 119 59 . . PUNCT crl-13774 120 1 in in ADP crl-13774 120 2 contrast contrast NOUN crl-13774 120 3 , , PUNCT crl-13774 120 4 long long ADJ crl-13774 120 5 - - PUNCT crl-13774 120 6 term term NOUN crl-13774 120 7 changes change NOUN crl-13774 120 8 in in ADP crl-13774 120 9 library library NOUN crl-13774 120 10 - - PUNCT crl-13774 120 11 use use NOUN crl-13774 120 12 skills skill NOUN crl-13774 120 13 are be AUX crl-13774 120 14 highly highly ADV crl-13774 120 15 associated associate VERB crl-13774 120 16 with with ADP crl-13774 120 17 both both DET crl-13774 120 18 measures measure NOUN crl-13774 120 19 of of ADP crl-13774 120 20 exposure exposure NOUN crl-13774 120 21 to to ADP crl-13774 120 22 library library NOUN crl-13774 120 23 - - PUNCT crl-13774 120 24 use use NOUN crl-13774 120 25 instruction instruction NOUN crl-13774 120 26 . . PUNCT crl-13774 121 1 these these DET crl-13774 121 2 findings finding NOUN crl-13774 121 3 indicate indicate VERB crl-13774 121 4 that that SCONJ crl-13774 121 5 neither neither DET crl-13774 121 6 intellectual intellectual ADJ crl-13774 121 7 capacity capacity NOUN crl-13774 121 8 per per ADP crl-13774 121 9 senor senor NOUN crl-13774 121 10 diligence diligence NOUN crl-13774 121 11 in in ADP crl-13774 121 12 the the DET crl-13774 121 13 pursuit pursuit NOUN crl-13774 121 14 of of ADP crl-13774 121 15 good good ADJ crl-13774 121 16 grades grade NOUN crl-13774 121 17 will will AUX crl-13774 121 18 produce produce VERB crl-13774 121 19 a a DET crl-13774 121 20 degree degree NOUN crl-13774 121 21 of of ADP crl-13774 121 22 learning learn VERB crl-13774 121 23 of of ADP crl-13774 121 24 library library NOUN crl-13774 121 25 - - PUNCT crl-13774 121 26 use use NOUN crl-13774 121 27 skills skill NOUN crl-13774 121 28 that that PRON crl-13774 121 29 can can AUX crl-13774 121 30 rival rival VERB crl-13774 121 31 the the DET crl-13774 121 32 amount amount NOUN crl-13774 121 33 of of ADP crl-13774 121 34 skills skill NOUN crl-13774 121 35 acquisition acquisition NOUN crl-13774 121 36 that that PRON crl-13774 121 37 is be AUX crl-13774 121 38 provided provide VERB crl-13774 121 39 in in ADP crl-13774 121 40 library library NOUN crl-13774 121 41 - - PUNCT crl-13774 121 42 use use NOUN crl-13774 121 43 instruction instruction NOUN crl-13774 121 44 . . PUNCT crl-13774 122 1 it it PRON crl-13774 122 2 is be AUX crl-13774 122 3 important important ADJ crl-13774 122 4 to to PART crl-13774 122 5 note note VERB crl-13774 122 6 that that SCONJ crl-13774 122 7 library library NOUN crl-13774 122 8 - - PUNCT crl-13774 122 9 use use NOUN crl-13774 122 10 instruction instruction NOUN crl-13774 122 11 can can AUX crl-13774 122 12 be be AUX crl-13774 122 13 shown show VERB crl-13774 122 14 to to PART crl-13774 122 15 have have VERB crl-13774 122 16 effects effect NOUN crl-13774 122 17 superior superior ADJ crl-13774 122 18 to to ADP crl-13774 122 19 those those PRON crl-13774 122 20 of of ADP crl-13774 122 21 academic academic ADJ crl-13774 122 22 background background NOUN crl-13774 122 23 in in ADP crl-13774 122 24 both both DET crl-13774 122 25 aggregate aggregate ADJ crl-13774 122 26 comparisons comparison NOUN crl-13774 122 27 and and CCONJ crl-13774 122 28 the the DET crl-13774 122 29 panel panel NOUN crl-13774 122 30 study study NOUN crl-13774 122 31 setting setting NOUN crl-13774 122 32 , , PUNCT crl-13774 122 33 a a DET crl-13774 122 34 fact fact NOUN crl-13774 122 35 that that PRON crl-13774 122 36 adds add VERB crl-13774 122 37 greatly greatly ADV crl-13774 122 38 to to ADP crl-13774 122 39 the the DET crl-13774 122 40 contention contention NOUN crl-13774 122 41 that that SCONJ crl-13774 122 42 library library NOUN crl-13774 122 43 - - PUNCT crl-13774 122 44 use use NOUN crl-13774 122 45 instruction instruction NOUN crl-13774 122 46 has have AUX crl-13774 122 47 firm firm ADJ crl-13774 122 48 value value NOUN crl-13774 122 49 and and CCONJ crl-13774 122 50 lasting lasting ADJ crl-13774 122 51 effects effect NOUN crl-13774 122 52 . . PUNCT crl-13774 123 1 use use NOUN crl-13774 123 2 of of ADP crl-13774 123 3 evaluation evaluation NOUN crl-13774 123 4 results result NOUN crl-13774 123 5 : : PUNCT crl-13774 123 6 a a DET crl-13774 123 7 cautionary cautionary ADJ crl-13774 123 8 note note NOUN crl-13774 123 9 werking werking NOUN crl-13774 123 10 has have AUX crl-13774 123 11 expressed express VERB crl-13774 123 12 particular particular ADJ crl-13774 123 13 concern concern NOUN crl-13774 123 14 with with ADP crl-13774 123 15 respect respect NOUN crl-13774 123 16 to to ADP crl-13774 123 17 the the DET crl-13774 123 18 use use NOUN crl-13774 123 19 of of ADP crl-13774 123 20 quantitative quantitative ADJ crl-13774 123 21 evaluation evaluation NOUN crl-13774 123 22 results result NOUN crl-13774 123 23 as as ADP crl-13774 123 24 " " PUNCT crl-13774 123 25 proof proof NOUN crl-13774 123 26 ' ' PUNCT crl-13774 123 27 of of ADP crl-13774 123 28 a a DET crl-13774 123 29 library library NOUN crl-13774 123 30 - - PUNCT crl-13774 123 31 use use NOUN crl-13774 123 32 instruction instruction NOUN crl-13774 123 33 program program NOUN crl-13774 123 34 's 's PART crl-13774 123 35 success success NOUN crl-13774 123 36 . . PUNCT crl-13774 124 1 19 19 NUM crl-13774 124 2 this this PRON crl-13774 124 3 is be AUX crl-13774 124 4 certainly certainly ADV crl-13774 124 5 a a DET crl-13774 124 6 legitimate legitimate ADJ crl-13774 124 7 concern concern NOUN crl-13774 124 8 , , PUNCT crl-13774 124 9 and and CCONJ crl-13774 124 10 the the DET crl-13774 124 11 authors author NOUN crl-13774 124 12 want want VERB crl-13774 124 13 to to PART crl-13774 124 14 insert insert VERB crl-13774 124 15 a a DET crl-13774 124 16 cautionary cautionary ADJ crl-13774 124 17 note note NOUN crl-13774 124 18 into into ADP crl-13774 124 19 this this DET crl-13774 124 20 article article NOUN crl-13774 124 21 for for ADP crl-13774 124 22 those those PRON crl-13774 124 23 planning plan VERB crl-13774 124 24 to to PART crl-13774 124 25 conduct conduct VERB crl-13774 124 26 evaluations evaluation NOUN crl-13774 124 27 in in ADP crl-13774 124 28 order order NOUN crl-13774 124 29 to to PART crl-13774 124 30 gain gain VERB crl-13774 124 31 support support NOUN crl-13774 124 32 for for ADP crl-13774 124 33 their their PRON crl-13774 124 34 programs program NOUN crl-13774 124 35 . . PUNCT crl-13774 125 1 in in ADP crl-13774 125 2 their their PRON crl-13774 125 3 previous previous ADJ crl-13774 125 4 article article NOUN crl-13774 125 5 on on ADP crl-13774 125 6 the the DET crl-13774 125 7 depauw depauw PROPN crl-13774 125 8 university university PROPN crl-13774 125 9 library library NOUN crl-13774 125 10 instruction instruction NOUN crl-13774 125 11 program program NOUN crl-13774 125 12 , , PUNCT crl-13774 125 13 the the DET crl-13774 125 14 authors author NOUN crl-13774 125 15 reported report VERB crl-13774 125 16 use use NOUN crl-13774 125 17 of of ADP crl-13774 125 18 the the DET crl-13774 125 19 results result NOUN crl-13774 125 20 of of ADP crl-13774 125 21 their their PRON crl-13774 125 22 evaluation evaluation NOUN crl-13774 125 23 to to PART crl-13774 125 24 successfully successfully ADV crl-13774 125 25 gain gain VERB crl-13774 125 26 administrative administrative ADJ crl-13774 125 27 support support NOUN crl-13774 125 28 for for ADP crl-13774 125 29 a a DET crl-13774 125 30 grant grant NOUN crl-13774 125 31 proposal proposal NOUN crl-13774 125 32 to to PART crl-13774 125 33 continue continue VERB crl-13774 125 34 the the DET crl-13774 125 35 libraryuse libraryuse NOUN crl-13774 125 36 instruction instruction NOUN crl-13774 125 37 program program NOUN crl-13774 125 38 . . PUNCT crl-13774 126 1 20 20 NUM crl-13774 126 2 such such ADJ crl-13774 126 3 use use NOUN crl-13774 126 4 of of ADP crl-13774 126 5 evalutable evalutable ADJ crl-13774 126 6 4 4 NUM crl-13774 126 7 factors factor NOUN crl-13774 126 8 associated associate VERB crl-13774 126 9 with with ADP crl-13774 126 10 short short ADJ crl-13774 126 11 - - PUNCT crl-13774 126 12 term term NOUN crl-13774 126 13 and and CCONJ crl-13774 126 14 long long ADJ crl-13774 126 15 - - PUNCT crl-13774 126 16 term term NOUN crl-13774 126 17 changes change NOUN crl-13774 126 18 in in ADP crl-13774 126 19 library library PROPN crl-13774 126 20 -use -use PROPN crl-13774 126 21 skills skill NOUN crl-13774 126 22 * * PUNCT crl-13774 126 23 short short ADJ crl-13774 126 24 - - PUNCT crl-13774 126 25 term term NOUN crl-13774 126 26 chan chan PROPN crl-13774 126 27 ges ges PROPN crl-13774 126 28 corr corr PROPN crl-13774 126 29 . . PUNCT crl-13774 127 1 no no DET crl-13774 127 2 . . PROPN crl-13774 127 3 stat stat PROPN crl-13774 127 4 . . PUNCT crl-13774 128 1 coeff coeff PROPN crl-13774 128 2 . . PUNCT crl-13774 129 1 cases case NOUN crl-13774 129 2 sig sig PROPN crl-13774 129 3 . . PUNCT crl-13774 130 1 measures measure NOUN crl-13774 130 2 of of ADP crl-13774 130 3 a a DET crl-13774 130 4 cademic cademic ADJ crl-13774 130 5 background background NOUN crl-13774 130 6 sat sit VERB crl-13774 130 7 , , PUNCT crl-13774 130 8 verbal verbal ADJ crl-13774 130 9 .19 .19 PROPN crl-13774 130 10 77 77 NUM crl-13774 130 11 .05 .05 PROPN crl-13774 130 12 cpa cpa NOUN crl-13774 130 13 .19 .19 PROPN crl-13774 130 14 82 82 NUM crl-13774 130 15 .04 .04 PROPN crl-13774 130 16 measures measure NOUN crl-13774 130 17 of of ADP crl-13774 130 18 exposure exposure NOUN crl-13774 130 19 to to ADP crl-13774 130 20 l l PRON crl-13774 130 21 ibrary ibrary ADJ crl-13774 130 22 - - PUNCT crl-13774 130 23 use use NOUN crl-13774 130 24 instruction instruction NOUN crl-13774 130 25 number number NOUN crl-13774 130 26 of of ADP crl-13774 130 27 upper upper ADJ crl-13774 130 28 - - PUNCT crl-13774 130 29 division division NOUN crl-13774 130 30 courses course NOUN crl-13774 130 31 .11 .11 NUM crl-13774 130 32 82 82 NUM crl-13774 131 1 not not PART crl-13774 131 2 sig sig NOUN crl-13774 131 3 . . PUNCT crl-13774 132 1 total total ADJ crl-13774 132 2 exposure exposure NOUN crl-13774 132 3 to to ADP crl-13774 132 4 instruction instruction NOUN crl-13774 132 5 , , PUNCT crl-13774 132 6 .30 .30 PROPN crl-13774 132 7 82 82 NUM crl-13774 132 8 .003 .003 NUM crl-13774 132 9 freshmen freshman NOUN crl-13774 132 10 through through ADP crl-13774 132 11 graduation graduation NOUN crl-13774 132 12 corr corr PROPN crl-13774 132 13 . . PUNCT crl-13774 133 1 coeff coeff PROPN crl-13774 133 2 . . PUNCT crl-13774 134 1 .16 .16 PROPN crl-13774 134 2 .08 .08 PROPN crl-13774 135 1 .38 .38 PROPN crl-13774 135 2 .41 .41 NUM crl-13774 136 1 lo lo PROPN crl-13774 136 2 ng ng ADJ crl-13774 136 3 - - PUNCT crl-13774 136 4 term term NOUN crl-13774 136 5 cha cha NOUN crl-13774 136 6 nges nge VERB crl-13774 136 7 no no ADV crl-13774 136 8 . . PUNCT crl-13774 137 1 stat.t stat.t PROPN crl-13774 137 2 cases case VERB crl-13774 137 3 sig sig NOUN crl-13774 137 4 . . PUNCT crl-13774 138 1 77 77 NUM crl-13774 138 2 not not PART crl-13774 138 3 sig sig NOUN crl-13774 138 4 . . PUNCT crl-13774 139 1 82 82 NUM crl-13774 139 2 not not PART crl-13774 139 3 sig sig NOUN crl-13774 139 4 . . PUNCT crl-13774 140 1 82 82 NUM crl-13774 140 2 .0002 .0002 PUNCT crl-13774 141 1 82 82 NUM crl-13774 141 2 .0001 .0001 X crl-13774 142 1 •panel •panel PROPN crl-13774 142 2 st st PROPN crl-13774 142 3 udy udy PROPN crl-13774 142 4 res re VERB crl-13774 142 5 ults ult NOUN crl-13774 142 6 of of ADP crl-13774 142 7 correlations correlation NOUN crl-13774 142 8 between between ADP crl-13774 142 9 cha cha NOUN crl-13774 142 10 nges nge NOUN crl-13774 142 11 in in ADP crl-13774 142 12 skill skill NOUN crl-13774 142 13 level level NOUN crl-13774 142 14 , , PUNCT crl-13774 142 15 exposu exposu PROPN crl-13774 142 16 re re ADP crl-13774 142 17 to to ADP crl-13774 142 18 li li PROPN crl-13774 142 19 bra bra PROPN crl-13774 142 20 ryuse ryuse PROPN crl-13774 142 21 inst inst ADP crl-13774 142 22 ructi ructi NOUN crl-13774 142 23 on on ADP crl-13774 142 24 , , PUNCT crl-13774 142 25 a a DET crl-13774 142 26 nd nd NOUN crl-13774 142 27 academic academic ADJ crl-13774 142 28 background background NOUN crl-13774 142 29 ( ( PUNCT crl-13774 142 30 pearson pearson PROPN crl-13774 142 31 correlati correlati PROPN crl-13774 142 32 on on ADP crl-13774 142 33 coeffi coeffi PROPN crl-13774 142 34 cients cient NOUN crl-13774 142 35 ) ) PUNCT crl-13774 142 36 . . PUNCT crl-13774 143 1 f f PROPN crl-13774 143 2 result result VERB crl-13774 143 3 listed list VERB crl-13774 143 4 as as ADP crl-13774 143 5 not not PART crl-13774 143 6 statistically statistically ADV crl-13774 143 7 significan significan ADJ crl-13774 143 8 t t PROPN crl-13774 143 9 if if SCONJ crl-13774 143 10 pis pis PROPN crl-13774 143 11 grea grea PROPN crl-13774 143 12 ter ter PROPN crl-13774 144 1 th th X crl-13774 144 2 an an DET crl-13774 144 3 .05 .05 PROPN crl-13774 144 4 . . PUNCT crl-13774 144 5 note note NOUN crl-13774 144 6 : : PUNCT crl-13774 144 7 short short ADJ crl-13774 144 8 - - PUNCT crl-13774 144 9 term term NOUN crl-13774 144 10 and and CCONJ crl-13774 144 11 longterm longterm NOUN crl-13774 144 12 change change NOUN crl-13774 144 13 scores score NOUN crl-13774 144 14 are be AUX crl-13774 144 15 calcul calcul PROPN crl-13774 144 16 ated ate VERB crl-13774 144 17 on on ADP crl-13774 144 18 th th DET crl-13774 144 19 e e NOUN crl-13774 144 20 basis basis NOUN crl-13774 144 21 of of ADP crl-13774 144 22 the the DET crl-13774 144 23 difference difference NOUN crl-13774 144 24 ( ( PUNCT crl-13774 144 25 positive positive ADJ crl-13774 144 26 or or CCONJ crl-13774 144 27 negative negative ADJ crl-13774 144 28 ) ) PUNCT crl-13774 144 29 between between ADP crl-13774 144 30 t t PROPN crl-13774 144 31 he he X crl-13774 144 32 p p ADJ crl-13774 144 33 reinstruction reinstruction NOUN crl-13774 144 34 skills skill VERB crl-13774 144 35 score score NOUN crl-13774 144 36 and and CCONJ crl-13774 144 37 the the DET crl-13774 144 38 first first ADJ crl-13774 144 39 a a DET crl-13774 144 40 nd nd X crl-13774 144 41 second second ADJ crl-13774 144 42 skills skill NOUN crl-13774 144 43 tests test NOUN crl-13774 144 44 for for ADP crl-13774 144 45 each each DET crl-13774 144 46 respondent respondent NOUN crl-13774 144 47 . . PUNCT crl-13774 145 1 ation ation NOUN crl-13774 145 2 in in ADP crl-13774 145 3 decision decision NOUN crl-13774 145 4 making making NOUN crl-13774 145 5 is be AUX crl-13774 145 6 neither neither CCONJ crl-13774 145 7 automatic automatic ADJ crl-13774 145 8 nor nor CCONJ crl-13774 145 9 common common ADJ crl-13774 145 10 . . PUNCT crl-13774 146 1 some some DET crl-13774 146 2 evaluators evaluator NOUN crl-13774 146 3 contend contend VERB crl-13774 146 4 that that SCONJ crl-13774 146 5 the the DET crl-13774 146 6 main main ADJ crl-13774 146 7 i i PROPN crl-13774 146 8 purpose purpose NOUN crl-13774 146 9 of of ADP crl-13774 146 10 evaluation evaluation NOUN crl-13774 146 11 is be AUX crl-13774 146 12 simply simply ADV crl-13774 146 13 to to PART crl-13774 146 14 improve improve VERB crl-13774 146 15 learning learning NOUN crl-13774 146 16 and and CCONJ crl-13774 146 17 instruction instruction NOUN crl-13774 146 18 , , PUNCT crl-13774 146 19 and and CCONJ crl-13774 146 20 that that SCONJ crl-13774 146 21 all all DET crl-13774 146 22 other other ADJ crl-13774 146 23 uses use NOUN crl-13774 146 24 are be AUX crl-13774 146 25 secondary secondary ADJ crl-13774 146 26 or or CCONJ crl-13774 146 27 supplementary supplementary ADJ crl-13774 146 28 to to ADP crl-13774 146 29 this this DET crl-13774 146 30 purpose purpose NOUN crl-13774 146 31 . . PUNCT crl-13774 147 1 21 21 NUM crl-13774 148 1 however however ADV crl-13774 148 2 , , PUNCT crl-13774 148 3 if if SCONJ crl-13774 148 4 the the DET crl-13774 148 5 ultimate ultimate ADJ crl-13774 148 6 purpose purpose NOUN crl-13774 148 7 of of ADP crl-13774 148 8 evaluation evaluation NOUN crl-13774 148 9 is be AUX crl-13774 148 10 to to PART crl-13774 148 11 contribute contribute VERB crl-13774 148 12 to to ADP crl-13774 148 13 decision decision NOUN crl-13774 148 14 making making NOUN crl-13774 148 15 pertaining pertain VERB crl-13774 148 16 to to ADP crl-13774 148 17 the the DET crl-13774 148 18 improvement improvement NOUN crl-13774 148 19 of of ADP crl-13774 148 20 the the DET crl-13774 148 21 effectiveness effectiveness NOUN crl-13774 148 22 of of ADP crl-13774 148 23 library library NOUN crl-13774 148 24 programs program NOUN crl-13774 148 25 , , PUNCT crl-13774 148 26 the the DET crl-13774 148 27 implementation implementation NOUN crl-13774 148 28 of of ADP crl-13774 148 29 evaluation evaluation NOUN crl-13774 148 30 results result NOUN crl-13774 148 31 is be AUX crl-13774 148 32 a a DET crl-13774 148 33 critical critical ADJ crl-13774 148 34 consideration consideration NOUN crl-13774 148 35 . . PUNCT crl-13774 149 1 22 22 NUM crl-13774 149 2 carol carol NOUN crl-13774 149 3 weiss weiss NOUN crl-13774 149 4 has have AUX crl-13774 149 5 noted note VERB crl-13774 149 6 that that SCONJ crl-13774 149 7 while while SCONJ crl-13774 149 8 careful careful ADJ crl-13774 149 9 and and CCONJ crl-13774 149 10 unbiased unbiased ADJ crl-13774 149 11 evaluations evaluation NOUN crl-13774 149 12 should should AUX crl-13774 149 13 ideally ideally ADV crl-13774 149 14 improve improve VERB crl-13774 149 15 decision decision NOUN crl-13774 149 16 making making NOUN crl-13774 149 17 in in ADP crl-13774 149 18 a a DET crl-13774 149 19 rather rather ADV crl-13774 149 20 automatic automatic ADJ crl-13774 149 21 fashion fashion NOUN crl-13774 149 22 , , PUNCT crl-13774 149 23 evaluation evaluation NOUN crl-13774 149 24 is be AUX crl-13774 149 25 always always ADV crl-13774 149 26 a a DET crl-13774 149 27 rational rational ADJ crl-13774 149 28 enterprise enterprise NOUN crl-13774 149 29 that that PRON crl-13774 149 30 takes take VERB crl-13774 149 31 place place NOUN crl-13774 149 32 in in ADP crl-13774 149 33 a a DET crl-13774 149 34 political political ADJ crl-13774 149 35 context context NOUN crl-13774 149 36 . . PUNCT crl-13774 150 1 the the DET crl-13774 150 2 evaluator evaluator NOUN crl-13774 150 3 who who PRON crl-13774 150 4 fails fail VERB crl-13774 150 5 to to PART crl-13774 150 6 recognize recognize VERB crl-13774 150 7 political political ADJ crl-13774 150 8 considerations consideration NOUN crl-13774 150 9 " " PUNCT crl-13774 150 10 is be AUX crl-13774 150 11 in in ADP crl-13774 150 12 for for ADP crl-13774 150 13 a a DET crl-13774 150 14 series series NOUN crl-13774 150 15 of of ADP crl-13774 150 16 shocks shock NOUN crl-13774 150 17 and and CCONJ crl-13774 150 18 frustrations frustration NOUN crl-13774 150 19 . . PUNCT crl-13774 150 20 " " PUNCT crl-13774 151 1 23 23 NUM crl-13774 151 2 · · NUM crl-13774 151 3 additionally additionally ADV crl-13774 151 4 , , PUNCT crl-13774 151 5 werking werking NOUN crl-13774 151 6 , , PUNCT crl-13774 151 7 in in ADP crl-13774 151 8 citing cite VERB crl-13774 151 9 the the DET crl-13774 151 10 example example NOUN crl-13774 151 11 of of ADP crl-13774 151 12 the the DET crl-13774 151 13 abandonment abandonment NOUN crl-13774 151 14 of of ADP crl-13774 151 15 a a DET crl-13774 151 16 teaching teaching NOUN crl-13774 151 17 method method NOUN crl-13774 151 18 not not PART crl-13774 151 19 because because SCONJ crl-13774 151 20 it it PRON crl-13774 151 21 was be AUX crl-13774 151 22 ineffective ineffective ADJ crl-13774 151 23 , , PUNCT crl-13774 151 24 but but CCONJ crl-13774 151 25 because because SCONJ crl-13774 151 26 it it PRON crl-13774 151 27 was be AUX crl-13774 151 28 believed believe VERB crl-13774 151 29 to to PART crl-13774 151 30 be be AUX crl-13774 151 31 nonessential nonessential ADJ crl-13774 151 32 , , PUNCT crl-13774 151 33 points point NOUN crl-13774 151 34 to to ADP crl-13774 151 35 an an DET crl-13774 151 36 ever ever ADV crl-13774 151 37 - - PUNCT crl-13774 151 38 present present ADJ crl-13774 151 39 problem problem NOUN crl-13774 151 40 in in ADP crl-13774 151 41 using use VERB crl-13774 151 42 quantitative quantitative ADJ crl-13774 151 43 evaluation evaluation NOUN crl-13774 151 44 techniques technique NOUN crl-13774 151 45 to to PART crl-13774 151 46 gain gain VERB crl-13774 151 47 support support NOUN crl-13774 151 48 for for ADP crl-13774 151 49 a a DET crl-13774 151 50 library library NOUN crl-13774 151 51 - - PUNCT crl-13774 151 52 use use NOUN crl-13774 151 53 instruction instruction NOUN crl-13774 151 54 program program NOUN crl-13774 151 55 . . PUNCT crl-13774 152 1 24 24 NUM crl-13774 152 2 libraryuse libraryuse NOUN crl-13774 152 3 instruction instruction NOUN crl-13774 152 4 programs program NOUN crl-13774 152 5 are be AUX crl-13774 152 6 sometimes sometimes ADV crl-13774 152 7 considered consider VERB crl-13774 152 8 to to PART crl-13774 152 9 be be AUX crl-13774 152 10 " " PUNCT crl-13774 152 11 amenities amenity NOUN crl-13774 152 12 " " PUNCT crl-13774 152 13 by by ADP crl-13774 152 14 decision decision NOUN crl-13774 152 15 makers maker NOUN crl-13774 152 16 such such ADJ crl-13774 152 17 as as ADP crl-13774 152 18 college college NOUN crl-13774 152 19 administrators administrator NOUN crl-13774 152 20 , , PUNCT crl-13774 152 21 classroom classroom NOUN crl-13774 152 22 instructors instructor NOUN crl-13774 152 23 , , PUNCT crl-13774 152 24 and and CCONJ crl-13774 152 25 library library NOUN crl-13774 152 26 directors director NOUN crl-13774 152 27 . . PUNCT crl-13774 153 1 according accord VERB crl-13774 153 2 to to ADP crl-13774 153 3 benjamin benjamin PROPN crl-13774 153 4 bloom bloom NOUN crl-13774 153 5 , , PUNCT crl-13774 153 6 however however ADV crl-13774 153 7 sophisticated sophisticated ADJ crl-13774 153 8 and and CCONJ crl-13774 153 9 library library NOUN crl-13774 153 10 - - PUNCT crl-13774 153 11 use use NOUN crl-13774 153 12 instruction instruction NOUN crl-13774 153 13 i i PROPN crl-13774 153 14 45 45 NUM crl-13774 153 15 elegant elegant ADJ crl-13774 153 16 quantitative quantitative ADJ crl-13774 153 17 evaluations evaluation NOUN crl-13774 153 18 might might AUX crl-13774 153 19 be be AUX crl-13774 153 20 , , PUNCT crl-13774 153 21 they they PRON crl-13774 153 22 " " PUNCT crl-13774 153 23 are be AUX crl-13774 153 24 likely likely ADJ crl-13774 153 25 to to PART crl-13774 153 26 have have VERB crl-13774 153 27 little little ADJ crl-13774 153 28 effect effect NOUN crl-13774 153 29 if if SCONJ crl-13774 153 30 they they PRON crl-13774 153 31 are be AUX crl-13774 153 32 considered consider VERB crl-13774 153 33 to to PART crl-13774 153 34 be be AUX crl-13774 153 35 measuring measure VERB crl-13774 153 36 trivial trivial ADJ crl-13774 153 37 things thing NOUN crl-13774 153 38 which which PRON crl-13774 153 39 are be AUX crl-13774 153 40 not not PART crl-13774 153 41 regarded regard VERB crl-13774 153 42 as as ADP crl-13774 153 43 important important ADJ crl-13774 153 44 by by ADP crl-13774 153 45 the the DET crl-13774 153 46 students student NOUN crl-13774 153 47 , , PUNCT crl-13774 153 48 teachers teacher NOUN crl-13774 153 49 , , PUNCT crl-13774 153 50 patrons patron NOUN crl-13774 153 51 , , PUNCT crl-13774 153 52 and and CCONJ crl-13774 153 53 others other NOUN crl-13774 153 54 . . PUNCT crl-13774 154 1 "25 "25 PUNCT crl-13774 155 1 a a DET crl-13774 155 2 certain certain ADJ crl-13774 155 3 amount amount NOUN crl-13774 155 4 of of ADP crl-13774 155 5 groundwork groundwork NOUN crl-13774 155 6 is be AUX crl-13774 155 7 necessary necessary ADJ crl-13774 155 8 before before SCONJ crl-13774 155 9 any any DET crl-13774 155 10 type type NOUN crl-13774 155 11 of of ADP crl-13774 155 12 formal formal ADJ crl-13774 155 13 evaluation evaluation NOUN crl-13774 155 14 of of ADP crl-13774 155 15 a a DET crl-13774 155 16 program program NOUN crl-13774 155 17 is be AUX crl-13774 155 18 attempted attempt VERB crl-13774 155 19 . . PUNCT crl-13774 156 1 as as SCONJ crl-13774 156 2 noted note VERB crl-13774 156 3 by by ADP crl-13774 156 4 howard howard PROPN crl-13774 156 5 davis davis PROPN crl-13774 156 6 and and CCONJ crl-13774 156 7 susan susan PROPN crl-13774 156 8 salasin salasin PROPN crl-13774 156 9 , , PUNCT crl-13774 156 10 newcomers newcomer NOUN crl-13774 156 11 to to AUX crl-13774 156 12 evaluation evaluation NOUN crl-13774 156 13 too too ADV crl-13774 156 14 often often ADV crl-13774 156 15 take take VERB crl-13774 156 16 effective effective ADJ crl-13774 156 17 use use NOUN crl-13774 156 18 of of ADP crl-13774 156 19 evaluation evaluation NOUN crl-13774 156 20 for for ADP crl-13774 156 21 granted grant VERB crl-13774 156 22 , , PUNCT crl-13774 156 23 with with ADP crl-13774 156 24 the the DET crl-13774 156 25 result result NOUN crl-13774 156 26 that that SCONJ crl-13774 156 27 evaluation evaluation NOUN crl-13774 156 28 results result NOUN crl-13774 156 29 often often ADV crl-13774 156 30 end end VERB crl-13774 156 31 up up ADP crl-13774 156 32 being be AUX crl-13774 156 33 ignored ignore VERB crl-13774 156 34 . . PUNCT crl-13774 157 1 26 26 NUM crl-13774 157 2 librarians librarian NOUN crl-13774 157 3 interested interested ADJ crl-13774 157 4 in in ADP crl-13774 157 5 evaluating evaluate VERB crl-13774 157 6 their their PRON crl-13774 157 7 library library NOUN crl-13774 157 8 - - PUNCT crl-13774 157 9 use use NOUN crl-13774 157 10 instruction instruction NOUN crl-13774 157 11 programs program NOUN crl-13774 157 12 would would AUX crl-13774 157 13 do do VERB crl-13774 157 14 well well ADV crl-13774 157 15 to to PART crl-13774 157 16 recall recall VERB crl-13774 157 17 the the DET crl-13774 157 18 wise wise ADJ crl-13774 157 19 observation observation NOUN crl-13774 157 20 of of ADP crl-13774 157 21 suchman suchman NOUN crl-13774 157 22 : : PUNCT crl-13774 157 23 " " PUNCT crl-13774 157 24 both both CCONJ crl-13774 157 25 the the DET crl-13774 157 26 demand demand NOUN crl-13774 157 27 for for ADP crl-13774 157 28 and and CCONJ crl-13774 157 29 the the DET crl-13774 157 30 type type NOUN crl-13774 157 31 of of ADP crl-13774 157 32 acceptable acceptable ADJ crl-13774 157 33 ' ' PUNCT crl-13774 157 34 proof proof NOUN crl-13774 157 35 ( ( PUNCT crl-13774 157 36 of of ADP crl-13774 157 37 program program NOUN crl-13774 157 38 effectiveness effectiveness NOUN crl-13774 157 39 ) ) PUNCT crl-13774 157 40 will will AUX crl-13774 157 41 depend depend VERB crl-13774 157 42 upon upon SCONJ crl-13774 157 43 the the DET crl-13774 157 44 nature nature NOUN crl-13774 157 45 of of ADP crl-13774 157 46 the the DET crl-13774 157 47 relationship relationship NOUN crl-13774 157 48 between between ADP crl-13774 157 49 the the DET crl-13774 157 50 social social ADJ crl-13774 157 51 institution institution NOUN crl-13774 157 52 and and CCONJ crl-13774 157 53 the the DET crl-13774 157 54 public public NOUN crl-13774 157 55 . . PUNCT crl-13774 158 1 in in ADP crl-13774 158 2 general general ADJ crl-13774 158 3 , , PUNCT crl-13774 158 4 a a DET crl-13774 158 5 balance balance NOUN crl-13774 158 6 will will AUX crl-13774 158 7 be be AUX crl-13774 158 8 struck strike VERB crl-13774 158 9 between between ADP crl-13774 158 10 faith faith NOUN crl-13774 158 11 and and CCONJ crl-13774 158 12 fact fact NOUN crl-13774 158 13 . . PUNCT crl-13774 159 1 " " PUNCT crl-13774 159 2 27 27 NUM crl-13774 159 3 any any DET crl-13774 159 4 librarian librarian NOUN crl-13774 159 5 seriously seriously ADV crl-13774 159 6 considering consider VERB crl-13774 159 7 the the DET crl-13774 159 8 formal formal ADJ crl-13774 159 9 evaluation evaluation NOUN crl-13774 159 10 of of ADP crl-13774 159 11 his his PRON crl-13774 159 12 or or CCONJ crl-13774 159 13 her her PRON crl-13774 159 14 instructional instructional ADJ crl-13774 159 15 program program NOUN crl-13774 159 16 would would AUX crl-13774 159 17 be be AUX crl-13774 159 18 well well ADV crl-13774 159 19 advised advise VERB crl-13774 159 20 to to PART crl-13774 159 21 respect respect VERB crl-13774 159 22 the the DET crl-13774 159 23 limitations limitation NOUN crl-13774 159 24 of of ADP crl-13774 159 25 both both PRON crl-13774 159 26 methodology methodology NOUN crl-13774 159 27 and and CCONJ crl-13774 159 28 practical practical ADJ crl-13774 159 29 politics politic NOUN crl-13774 159 30 involved involve VERB crl-13774 159 31 , , PUNCT crl-13774 159 32 28 28 NUM crl-13774 159 33 and and CCONJ crl-13774 159 34 take take VERB crl-13774 159 35 heart heart NOUN crl-13774 159 36 that that SCONJ crl-13774 159 37 in in ADP crl-13774 159 38 time time NOUN crl-13774 159 39 wellconceived wellconceive VERB crl-13774 159 40 and and CCONJ crl-13774 159 41 rigorously rigorously ADV crl-13774 159 42 conducted conduct VERB crl-13774 159 43 evaluations evaluation NOUN crl-13774 159 44 of of ADP crl-13774 159 45 program program NOUN crl-13774 159 46 effects effect NOUN crl-13774 159 47 will will AUX crl-13774 159 48 have have VERB crl-13774 159 49 an an DET crl-13774 159 50 increasingly increasingly ADV crl-13774 159 51 important important ADJ crl-13774 159 52 role role NOUN crl-13774 159 53 in in ADP crl-13774 159 54 the the DET crl-13774 159 55 management management NOUN crl-13774 159 56 of of ADP crl-13774 159 57 college college NOUN crl-13774 159 58 and and CCONJ crl-13774 159 59 university university NOUN crl-13774 159 60 instructional instructional ADJ crl-13774 159 61 resources resource NOUN crl-13774 159 62 . . PUNCT crl-13774 160 1 references reference NOUN crl-13774 160 2 1 1 NUM crl-13774 160 3 . . PROPN crl-13774 160 4 charles charles PROPN crl-13774 160 5 dudley dudley PROPN crl-13774 160 6 warner warner PROPN crl-13774 160 7 first first PROPN crl-13774 160 8 wrote write VERB crl-13774 160 9 in in ADP crl-13774 160 10 an an DET crl-13774 160 11 editorial editorial NOUN crl-13774 160 12 in in ADP crl-13774 160 13 the the DET crl-13774 160 14 hartford hartford NOUN crl-13774 160 15 courant courant NOUN crl-13774 160 16 in in ADP crl-13774 160 17 1890 1890 NUM crl-13774 160 18 that that SCONJ crl-13774 160 19 " " PUNCT crl-13774 160 20 everybody everybody PRON crl-13774 160 21 talks talk VERB crl-13774 160 22 about about ADP crl-13774 160 23 the the DET crl-13774 160 24 weather weather NOUN crl-13774 160 25 , , PUNCT crl-13774 160 26 but but CCONJ crl-13774 160 27 nobody nobody PRON crl-13774 160 28 does do VERB crl-13774 160 29 anything anything PRON crl-13774 160 30 about about ADP crl-13774 160 31 it it PRON crl-13774 160 32 . . PUNCT crl-13774 160 33 " " PUNCT crl-13774 161 1 even even ADV crl-13774 161 2 back back ADV crl-13774 161 3 then then ADV crl-13774 161 4 it it PRON crl-13774 161 5 was be AUX crl-13774 161 6 so so ADV crl-13774 161 7 often often ADV crl-13774 161 8 attributed attribute VERB crl-13774 161 9 to to PART crl-13774 161 10 mark mark VERB crl-13774 161 11 twain twain PRON crl-13774 161 12 that that SCONJ crl-13774 161 13 charles charle VERB crl-13774 161 14 hopkins hopkins PROPN crl-13774 161 15 clark clark PROPN crl-13774 161 16 , , PUNCT crl-13774 161 17 editor editor NOUN crl-13774 161 18 of of ADP crl-13774 161 19 the the DET crl-13774 161 20 courant courant NOUN crl-13774 161 21 wrote write VERB crl-13774 161 22 : : PUNCT crl-13774 161 23 " " PUNCT crl-13774 161 24 i i PRON crl-13774 161 25 guess guess VERB crl-13774 161 26 it it PRON crl-13774 161 27 's be AUX crl-13774 161 28 no no DET crl-13774 161 29 use use NOUN crl-13774 161 30 ; ; PUNCT crl-13774 161 31 they they PRON crl-13774 161 32 still still ADV crl-13774 161 33 believe believe VERB crl-13774 161 34 mark mark PROPN crl-13774 161 35 twain twain PROPN crl-13774 161 36 said say VERB crl-13774 161 37 it it PRON crl-13774 161 38 , , PUNCT crl-13774 161 39 despite despite SCONJ crl-13774 161 40 all all DET crl-13774 161 41 my my PRON crl-13774 161 42 assurances assurance NOUN crl-13774 161 43 that that SCONJ crl-13774 161 44 it it PRON crl-13774 161 45 was be AUX crl-13774 161 46 warner warner PROPN crl-13774 161 47 . . PUNCT crl-13774 161 48 " " PUNCT crl-13774 162 1 2 2 X crl-13774 162 2 . . PROPN crl-13774 162 3 richard richard PROPN crl-13774 162 4 hume hume PROPN crl-13774 162 5 werking werking PROPN crl-13774 162 6 , , PUNCT crl-13774 162 7 " " PUNCT crl-13774 162 8 evaluating evaluate VERB crl-13774 162 9 bibliographic bibliographic ADJ crl-13774 162 10 education education NOUN crl-13774 162 11 : : PUNCT crl-13774 162 12 a a DET crl-13774 162 13 review review NOUN crl-13774 162 14 and and CCONJ crl-13774 162 15 critique critique NOUN crl-13774 162 16 , , PUNCT crl-13774 162 17 " " PUNCT crl-13774 162 18 library library NOUN crl-13774 162 19 trends trend NOUN crl-13774 162 20 29:153 29:153 NUM crl-13774 162 21 - - SYM crl-13774 162 22 72 72 NUM crl-13774 162 23 ( ( PUNCT crl-13774 162 24 summer summer NOUN crl-13774 162 25 1980 1980 NUM crl-13774 162 26 ) ) PUNCT crl-13774 162 27 . . PUNCT crl-13774 163 1 3 3 X crl-13774 163 2 . . PUNCT crl-13774 164 1 larry larry PROPN crl-13774 164 2 hardesty hardesty PROPN crl-13774 164 3 , , PUNCT crl-13774 164 4 nicholas nicholas PROPN crl-13774 164 5 p. p. PROPN crl-13774 164 6 lovrich lovrich PROPN crl-13774 164 7 , , PUNCT crl-13774 164 8 jr jr PROPN crl-13774 164 9 . . PROPN crl-13774 164 10 , , PUNCT crl-13774 164 11 and and CCONJ crl-13774 164 12 james james PROPN crl-13774 164 13 mannon mannon PROPN crl-13774 164 14 , , PUNCT crl-13774 164 15 " " PUNCT crl-13774 164 16 evaluating evaluate VERB crl-13774 164 17 library library NOUN crl-13774 164 18 - - PUNCT crl-13774 164 19 use use NOUN crl-13774 164 20 instruction instruction NOUN crl-13774 164 21 , , PUNCT crl-13774 164 22 " " PUNCT crl-13774 164 23 college college PROPN crl-13774 164 24 & & CCONJ crl-13774 164 25 research research PROPN crl-13774 164 26 libraries librarie VERB crl-13774 164 27 40:309 40:309 NUM crl-13774 164 28 - - SYM crl-13774 164 29 17 17 NUM crl-13774 164 30 quly quly ADV crl-13774 164 31 1979 1979 NUM crl-13774 164 32 ) ) PUNCT crl-13774 164 33 . . PUNCT crl-13774 165 1 4 4 X crl-13774 165 2 . . X crl-13774 165 3 a a DET crl-13774 165 4 third third ADJ crl-13774 165 5 goal goal NOUN crl-13774 165 6 of of ADP crl-13774 165 7 the the DET crl-13774 165 8 earlier early ADJ crl-13774 165 9 study study NOUN crl-13774 165 10 was be AUX crl-13774 165 11 to to PART crl-13774 165 12 document document VERB crl-13774 165 13 the the DET crl-13774 165 14 effects effect NOUN crl-13774 165 15 of of ADP crl-13774 165 16 library library NOUN crl-13774 165 17 - - PUNCT crl-13774 165 18 use use NOUN crl-13774 165 19 instruction instruction NOUN crl-13774 165 20 on on ADP crl-13774 165 21 short short ADJ crl-13774 165 22 - - PUNCT crl-13774 165 23 term term NOUN crl-13774 165 24 changes change NOUN crl-13774 165 25 in in ADP crl-13774 165 26 attitudes attitude NOUN crl-13774 165 27 toward toward ADP crl-13774 165 28 the the DET crl-13774 165 29 library library NOUN crl-13774 165 30 . . PUNCT crl-13774 166 1 the the DET crl-13774 166 2 earlier early ADJ crl-13774 166 3 study study NOUN crl-13774 166 4 was be AUX crl-13774 166 5 largely largely ADV crl-13774 166 6 unsuccessful unsuccessful ADJ crl-13774 166 7 in in ADP crl-13774 166 8 addressing address VERB crl-13774 166 9 questions question NOUN crl-13774 166 10 relating relate VERB crl-13774 166 11 to to ADP crl-13774 166 12 attitudinal attitudinal ADJ crl-13774 166 13 changes change NOUN crl-13774 166 14 , , PUNCT crl-13774 166 15 and and CCONJ crl-13774 166 16 the the DET crl-13774 166 17 authors author NOUN crl-13774 166 18 concluded conclude VERB crl-13774 166 19 " " PUNCT crl-13774 166 20 that that SCONJ crl-13774 166 21 either either CCONJ crl-13774 166 22 attitudes attitude NOUN crl-13774 166 23 about about ADP crl-13774 166 24 libraries library NOUN crl-13774 166 25 are be AUX crl-13774 166 26 far far ADV crl-13774 166 27 more more ADV crl-13774 166 28 difficult difficult ADJ crl-13774 166 29 to to PART crl-13774 166 30 influence influence VERB crl-13774 166 31 or or CCONJ crl-13774 166 32 measure measure NOUN crl-13774 166 33 than than SCONJ crl-13774 166 34 are be AUX crl-13774 166 35 library library NOUN crl-13774 166 36 - - PUNCT crl-13774 166 37 use use NOUN crl-13774 166 38 skills skill NOUN crl-13774 166 39 , , PUNCT crl-13774 166 40 or or CCONJ crl-13774 166 41 the the DET crl-13774 166 42 particular particular ADJ crl-13774 166 43 program program NOUN crl-13774 166 44 at at ADP crl-13774 166 45 depauw depauw PROPN crl-13774 166 46 university university PROPN crl-13774 166 47 was be AUX crl-13774 166 48 less less ADV crl-13774 166 49 effective effective ADJ crl-13774 166 50 in in ADP crl-13774 166 51 influencing influence VERB crl-13774 166 52 attitudes attitude NOUN crl-13774 166 53 than than SCONJ crl-13774 166 54 it it PRON crl-13774 166 55 was be AUX crl-13774 166 56 in in ADP crl-13774 166 57 influencing influence VERB crl-13774 166 58 library library NOUN crl-13774 166 59 - - PUNCT crl-13774 166 60 use use NOUN crl-13774 166 61 skills skill NOUN crl-13774 166 62 . . PUNCT crl-13774 166 63 " " PUNCT crl-13774 167 1 the the DET crl-13774 167 2 same same ADJ crl-13774 167 3 attitude attitude NOUN crl-13774 167 4 - - PUNCT crl-13774 167 5 measure measure NOUN crl-13774 167 6 instrument instrument NOUN crl-13774 167 7 was be AUX crl-13774 167 8 used use VERB crl-13774 167 9 in in ADP crl-13774 167 10 the the DET crl-13774 167 11 long long ADJ crl-13774 167 12 - - PUNCT crl-13774 167 13 term term NOUN crl-13774 167 14 study study NOUN crl-13774 167 15 reported report VERB crl-13774 167 16 in in ADP crl-13774 167 17 this this DET crl-13774 167 18 article article NOUN crl-13774 167 19 and and CCONJ crl-13774 167 20 the the DET crl-13774 167 21 results result NOUN crl-13774 167 22 and and CCONJ crl-13774 167 23 conclusions conclusion NOUN crl-13774 167 24 are be AUX crl-13774 167 25 the the DET crl-13774 167 26 same same ADJ crl-13774 167 27 as as ADP crl-13774 167 28 in in ADP crl-13774 167 29 the the DET crl-13774 167 30 earlier early ADJ crl-13774 167 31 study study NOUN crl-13774 167 32 . . PUNCT crl-13774 168 1 for for ADP crl-13774 168 2 an an DET crl-13774 168 3 interesting interesting ADJ crl-13774 168 4 discussion discussion NOUN crl-13774 168 5 of of ADP crl-13774 168 6 a a DET crl-13774 168 7 long long ADJ crl-13774 168 8 - - PUNCT crl-13774 168 9 term term NOUN crl-13774 168 10 study study NOUN crl-13774 168 11 of of ADP crl-13774 168 12 student student NOUN crl-13774 168 13 attitudes attitude NOUN crl-13774 168 14 toward toward ADP crl-13774 168 15 library library NOUN crl-13774 168 16 - - PUNCT crl-13774 168 17 use use NOUN crl-13774 168 18 instruction instruction NOUN crl-13774 168 19 , , PUNCT crl-13774 168 20 the the DET crl-13774 168 21 reader reader NOUN crl-13774 168 22 is be AUX crl-13774 168 23 referred refer VERB crl-13774 168 24 to to PART crl-13774 168 25 roland roland VERB crl-13774 168 26 person person NOUN crl-13774 168 27 , , PUNCT crl-13774 168 28 " " PUNCT crl-13774 168 29 long long ADJ crl-13774 168 30 - - PUNCT crl-13774 168 31 term term NOUN crl-13774 168 32 evaluation evaluation NOUN crl-13774 168 33 of of ADP crl-13774 168 34 bibliographic bibliographic ADJ crl-13774 168 35 instruction instruction NOUN crl-13774 168 36 : : PUNCT crl-13774 168 37 lasting last VERB crl-13774 168 38 encouragement encouragement NOUN crl-13774 168 39 , , PUNCT crl-13774 168 40 " " PUNCT crl-13774 168 41 college college PROPN crl-13774 168 42 & & CCONJ crl-13774 168 43 research research PROPN crl-13774 168 44 libraries librarie VERB crl-13774 168 45 42:19 42:19 NUM crl-13774 168 46 - - SYM crl-13774 168 47 25 25 NUM crl-13774 168 48 qan qan NOUN crl-13774 168 49 . . PROPN crl-13774 168 50 1981 1981 NUM crl-13774 168 51 ) ) PUNCT crl-13774 168 52 . . PUNCT crl-13774 169 1 however however ADV crl-13774 169 2 laudable laudable ADJ crl-13774 169 3 person person NOUN crl-13774 169 4 's 's PART crl-13774 169 5 efforts effort NOUN crl-13774 169 6 and and CCONJ crl-13774 169 7 support support NOUN crl-13774 169 8 of of ADP crl-13774 169 9 library library NOUN crl-13774 169 10 - - PUNCT crl-13774 169 11 use use NOUN crl-13774 169 12 instruction instruction NOUN crl-13774 169 13 , , PUNCT crl-13774 169 14 his his PRON crl-13774 169 15 conclusions conclusion NOUN crl-13774 169 16 must must AUX crl-13774 169 17 be be AUX crl-13774 169 18 accepted accept VERB crl-13774 169 19 with with ADP crl-13774 169 20 some some DET crl-13774 169 21 reservations reservation NOUN crl-13774 169 22 . . PUNCT crl-13774 170 1 most most ADV crl-13774 170 2 critical critical ADJ crl-13774 170 3 is be AUX crl-13774 170 4 his his PRON crl-13774 170 5 reliance reliance NOUN crl-13774 170 6 on on ADP crl-13774 170 7 a a DET crl-13774 170 8 low low ADJ crl-13774 170 9 return return NOUN crl-13774 170 10 rate rate NOUN crl-13774 170 11 ( ( PUNCT crl-13774 170 12 26 26 NUM crl-13774 170 13 percent percent NOUN crl-13774 170 14 ) ) PUNCT crl-13774 170 15 from from ADP crl-13774 170 16 students student NOUN crl-13774 170 17 , , PUNCT crl-13774 170 18 most most ADJ crl-13774 170 19 of of ADP crl-13774 170 20 whom whom PRON crl-13774 170 21 had have AUX crl-13774 170 22 originally originally ADV crl-13774 170 23 volunteered volunteer VERB crl-13774 170 24 to to PART crl-13774 170 25 enroll enroll VERB crl-13774 170 26 in in ADP crl-13774 170 27 a a DET crl-13774 170 28 library library NOUN crl-13774 170 29 - - PUNCT crl-13774 170 30 use use NOUN crl-13774 170 31 instruction instruction NOUN crl-13774 170 32 course course NOUN crl-13774 170 33 . . PUNCT crl-13774 171 1 with with ADP crl-13774 171 2 such such ADJ crl-13774 171 3 selfl-------~------------------------------------------------------------------------~-46 selfl-------~------------------------------------------------------------------------~-46 PROPN crl-13774 171 4 i i PROPN crl-13774 171 5 college college PROPN crl-13774 171 6 & & CCONJ crl-13774 171 7 research research PROPN crl-13774 171 8 libraries library NOUN crl-13774 171 9 · · PUNCT crl-13774 171 10 january january PROPN crl-13774 171 11 1982 1982 NUM crl-13774 171 12 selection selection NOUN crl-13774 171 13 and and CCONJ crl-13774 171 14 low low ADJ crl-13774 171 15 return return NOUN crl-13774 171 16 rate rate NOUN crl-13774 171 17 the the DET crl-13774 171 18 reader reader NOUN crl-13774 171 19 does do AUX crl-13774 171 20 not not PART crl-13774 171 21 know know VERB crl-13774 171 22 what what PRON crl-13774 171 23 a a DET crl-13774 171 24 majority majority NOUN crl-13774 171 25 of of ADP crl-13774 171 26 the the DET crl-13774 171 27 students student NOUN crl-13774 171 28 who who PRON crl-13774 171 29 took take VERB crl-13774 171 30 the the DET crl-13774 171 31 course course NOUN crl-13774 171 32 thought think VERB crl-13774 171 33 , , PUNCT crl-13774 171 34 let let VERB crl-13774 171 35 alone alone ADV crl-13774 171 36 what what PRON crl-13774 171 37 a a DET crl-13774 171 38 majority majority NOUN crl-13774 171 39 of of ADP crl-13774 171 40 the the DET crl-13774 171 41 student student NOUN crl-13774 171 42 body body NOUN crl-13774 171 43 might might AUX crl-13774 171 44 think think VERB crl-13774 171 45 of of ADP crl-13774 171 46 such such DET crl-13774 171 47 a a DET crl-13774 171 48 course course NOUN crl-13774 171 49 . . PUNCT crl-13774 172 1 there.are there.are VERB crl-13774 172 2 other other ADJ crl-13774 172 3 concerns concern NOUN crl-13774 172 4 with with ADP crl-13774 172 5 the the DET crl-13774 172 6 article article NOUN crl-13774 172 7 , , PUNCT crl-13774 172 8 but but CCONJ crl-13774 172 9 this this DET crl-13774 172 10 criticism criticism NOUN crl-13774 172 11 is be AUX crl-13774 172 12 not not PART crl-13774 172 13 intended intend VERB crl-13774 172 14 to to PART crl-13774 172 15 discourage discourage VERB crl-13774 172 16 person person NOUN crl-13774 172 17 and and CCONJ crl-13774 172 18 others other NOUN crl-13774 172 19 from from ADP crl-13774 172 20 conducting conduct VERB crl-13774 172 21 such such ADJ crl-13774 172 22 studies study NOUN crl-13774 172 23 . . PUNCT crl-13774 173 1 it it PRON crl-13774 173 2 is be AUX crl-13774 173 3 intended intend VERB crl-13774 173 4 to to PART crl-13774 173 5 encourage encourage VERB crl-13774 173 6 the the DET crl-13774 173 7 " " PUNCT crl-13774 173 8 better well ADJ crl-13774 173 9 research research NOUN crl-13774 173 10 " " PUNCT crl-13774 173 11 in in ADP crl-13774 173 12 the the DET crl-13774 173 13 area area NOUN crl-13774 173 14 of of ADP crl-13774 173 15 library library NOUN crl-13774 173 16 - - PUNCT crl-13774 173 17 use use NOUN crl-13774 173 18 instruction instruction NOUN crl-13774 173 19 that that SCONJ crl-13774 173 20 both both DET crl-13774 173 21 person person NOUN crl-13774 173 22 and and CCONJ crl-13774 173 23 the the DET crl-13774 173 24 authors author NOUN crl-13774 173 25 agree agree VERB crl-13774 173 26 is be AUX crl-13774 173 27 needed need VERB crl-13774 173 28 . . PUNCT crl-13774 174 1 5 5 X crl-13774 174 2 . . X crl-13774 174 3 werking werking NOUN crl-13774 174 4 , , PUNCT crl-13774 174 5 " " PUNCT crl-13774 174 6 evaluating evaluate VERB crl-13774 174 7 bibliographic bibliographic ADJ crl-13774 174 8 education education NOUN crl-13774 174 9 , , PUNCT crl-13774 174 10 " " PUNCT crl-13774 174 11 p.161 p.161 NOUN crl-13774 174 12 . . PUNCT crl-13774 175 1 6 6 X crl-13774 175 2 . . X crl-13774 175 3 julian julian PROPN crl-13774 175 4 simon simon PROPN crl-13774 175 5 , , PUNCT crl-13774 175 6 basic basic ADJ crl-13774 175 7 research research NOUN crl-13774 175 8 methods method NOUN crl-13774 175 9 in in ADP crl-13774 175 10 social social ADJ crl-13774 175 11 science science NOUN crl-13774 175 12 ( ( PUNCT crl-13774 175 13 2d 2d NUM crl-13774 175 14 ed ed NOUN crl-13774 175 15 . . PROPN crl-13774 175 16 ; ; PUNCT crl-13774 175 17 new new PROPN crl-13774 175 18 york york PROPN crl-13774 175 19 : : PUNCT crl-13774 175 20 random random PROPN crl-13774 175 21 , , PUNCT crl-13774 175 22 1978 1978 NUM crl-13774 175 23 ) ) PUNCT crl-13774 175 24 , , PUNCT crl-13774 175 25 p.185 p.185 NOUN crl-13774 175 26 . . PUNCT crl-13774 176 1 7 7 X crl-13774 176 2 . . PROPN crl-13774 176 3 c. c. PROPN crl-13774 176 4 a. a. PROPN crl-13774 176 5 moser moser PROPN crl-13774 176 6 , , PUNCT crl-13774 176 7 survey survey NOUN crl-13774 176 8 methods method NOUN crl-13774 176 9 in in ADP crl-13774 176 10 social social ADJ crl-13774 176 11 investigation investigation NOUN crl-13774 176 12 ( ( PUNCT crl-13774 176 13 london london PROPN crl-13774 176 14 : : PUNCT crl-13774 176 15 heineman heineman PROPN crl-13774 176 16 , , PUNCT crl-13774 176 17 1965 1965 NUM crl-13774 176 18 ) ) PUNCT crl-13774 176 19 , , PUNCT crl-13774 176 20 p.lll p.lll PROPN crl-13774 176 21 . . PROPN crl-13774 177 1 8 8 X crl-13774 177 2 . . X crl-13774 177 3 werking werking NOUN crl-13774 177 4 , , PUNCT crl-13774 177 5 " " PUNCT crl-13774 177 6 evaluating evaluate VERB crl-13774 177 7 bibliographic bibliographic ADJ crl-13774 177 8 education education NOUN crl-13774 177 9 , , PUNCT crl-13774 177 10 " " PUNCT crl-13774 177 11 p.166 p.166 NOUN crl-13774 177 12 - - PUNCT crl-13774 177 13 67 67 NUM crl-13774 177 14 . . NUM crl-13774 177 15 9 9 NUM crl-13774 177 16 . . X crl-13774 178 1 the the DET crl-13774 178 2 impact impact NOUN crl-13774 178 3 of of ADP crl-13774 178 4 head head NOUN crl-13774 178 5 start start VERB crl-13774 178 6 : : PUNCT crl-13774 178 7 an an DET crl-13774 178 8 evaluation evaluation NOUN crl-13774 178 9 of of ADP crl-13774 178 10 the the DET crl-13774 178 11 effects effect NOUN crl-13774 178 12 of of ADP crl-13774 178 13 head head NOUN crl-13774 178 14 start start VERB crl-13774 178 15 on on ADP crl-13774 178 16 children child NOUN crl-13774 178 17 's 's PART crl-13774 178 18 cognitive cognitive ADJ crl-13774 178 19 and and CCONJ crl-13774 178 20 affective affective ADJ crl-13774 178 21 development development NOUN crl-13774 178 22 ( ( PUNCT crl-13774 178 23 bladensburg bladensburg PROPN crl-13774 178 24 , , PUNCT crl-13774 178 25 md md PROPN crl-13774 178 26 . . PUNCT crl-13774 178 27 : : PUNCT crl-13774 179 1 westinghouse westinghouse PROPN crl-13774 179 2 learning learning PROPN crl-13774 179 3 corporation corporation PROPN crl-13774 179 4 , , PUNCT crl-13774 179 5 1969 1969 NUM crl-13774 179 6 ) ) PUNCT crl-13774 179 7 . . PUNCT crl-13774 180 1 10 10 NUM crl-13774 180 2 . . X crl-13774 180 3 francis francis PROPN crl-13774 180 4 a. a. PROPN crl-13774 180 5 j. j. PROPN crl-13774 180 6 ianni ianni PROPN crl-13774 180 7 and and CCONJ crl-13774 180 8 margaret margaret PROPN crl-13774 180 9 terry terry PROPN crl-13774 180 10 orr orr PROPN crl-13774 180 11 , , PUNCT crl-13774 180 12 " " PUNCT crl-13774 180 13 toward toward ADP crl-13774 180 14 a a DET crl-13774 180 15 rapprochement rapprochement NOUN crl-13774 180 16 of of ADP crl-13774 180 17 quantitative quantitative ADJ crl-13774 180 18 and and CCONJ crl-13774 180 19 qualitative qualitative ADJ crl-13774 180 20 methodologies methodology NOUN crl-13774 180 21 , , PUNCT crl-13774 180 22 " " PUNCT crl-13774 180 23 in in ADP crl-13774 180 24 thomas thomas PROPN crl-13774 180 25 d. d. PROPN crl-13774 180 26 cook cook PROPN crl-13774 180 27 and and CCONJ crl-13774 180 28 charles charles PROPN crl-13774 180 29 s. s. PROPN crl-13774 180 30 reichardt reichardt PROPN crl-13774 180 31 , , PUNCT crl-13774 180 32 eds ed NOUN crl-13774 180 33 . . PUNCT crl-13774 180 34 , , PUNCT crl-13774 180 35 qualitative qualitative ADJ crl-13774 180 36 and and CCONJ crl-13774 180 37 quantitative quantitative ADJ crl-13774 180 38 methods method NOUN crl-13774 180 39 in in ADP crl-13774 180 40 evaluation evaluation NOUN crl-13774 180 41 research research NOUN crl-13774 180 42 , , PUNCT crl-13774 180 43 $ $ SYM crl-13774 180 44 age age NOUN crl-13774 180 45 research research NOUN crl-13774 180 46 progress progress NOUN crl-13774 180 47 series series NOUN crl-13774 180 48 in in ADP crl-13774 180 49 evaluation evaluation NOUN crl-13774 180 50 , , PUNCT crl-13774 180 51 v v NOUN crl-13774 180 52 .1 .1 NUM crl-13774 180 53 ( ( PUNCT crl-13774 180 54 beverly beverly PROPN crl-13774 180 55 hills hills PROPN crl-13774 180 56 , , PUNCT crl-13774 180 57 calif calif PROPN crl-13774 180 58 . . PUNCT crl-13774 180 59 : : PUNCT crl-13774 180 60 sage sage NOUN crl-13774 180 61 publications publication NOUN crl-13774 180 62 , , PUNCT crl-13774 180 63 1979 1979 NUM crl-13774 180 64 ) ) PUNCT crl-13774 180 65 , , PUNCT crl-13774 180 66 p.88 p.88 PROPN crl-13774 180 67 . . PROPN crl-13774 180 68 11 11 NUM crl-13774 180 69 . . PUNCT crl-13774 181 1 john john PROPN crl-13774 181 2 w. w. PROPN crl-13774 181 3 evans evans PROPN crl-13774 181 4 , , PUNCT crl-13774 181 5 " " PUNCT crl-13774 181 6 head head NOUN crl-13774 181 7 start start NOUN crl-13774 181 8 : : PUNCT crl-13774 181 9 comments comment NOUN crl-13774 181 10 on on ADP crl-13774 181 11 the the DET crl-13774 181 12 criticism criticism NOUN crl-13774 181 13 , , PUNCT crl-13774 181 14 " " PUNCT crl-13774 181 15 in in ADP crl-13774 181 16 francis francis PROPN crl-13774 181 17 g. g. PROPN crl-13774 181 18 caro caro PROPN crl-13774 181 19 , , PUNCT crl-13774 181 20 ed ed PROPN crl-13774 181 21 . . PROPN crl-13774 181 22 , , PUNCT crl-13774 181 23 readings reading NOUN crl-13774 181 24 in in ADP crl-13774 181 25 evaluation evaluation NOUN crl-13774 181 26 research research NOUN crl-13774 181 27 ( ( PUNCT crl-13774 181 28 new new PROPN crl-13774 181 29 york york PROPN crl-13774 181 30 : : PUNCT crl-13774 181 31 russell russell PROPN crl-13774 181 32 sage sage PROPN crl-13774 181 33 , , PUNCT crl-13774 181 34 1971 1971 NUM crl-13774 181 35 ) ) PUNCT crl-13774 181 36 , , PUNCT crl-13774 181 37 p.401 p.401 PROPN crl-13774 181 38 . . PROPN crl-13774 182 1 12 12 NUM crl-13774 182 2 . . PUNCT crl-13774 183 1 charles charles PROPN crl-13774 183 2 s. s. PROPN crl-13774 183 3 reichardt reichardt PROPN crl-13774 183 4 and and CCONJ crl-13774 183 5 thomas thomas PROPN crl-13774 183 6 d. d. PROPN crl-13774 183 7 cook cook PROPN crl-13774 183 8 , , PUNCT crl-13774 183 9 " " PUNCT crl-13774 183 10 beyond beyond ADP crl-13774 183 11 qualitative qualitative NOUN crl-13774 183 12 versus versus ADP crl-13774 183 13 quantitative quantitative ADJ crl-13774 183 14 methods method NOUN crl-13774 183 15 , , PUNCT crl-13774 183 16 " " PUNCT crl-13774 183 17 qualitative qualitative ADJ crl-13774 183 18 and and CCONJ crl-13774 183 19 quantitative quantitative ADJ crl-13774 183 20 methods method NOUN crl-13774 183 21 in in ADP crl-13774 183 22 evaluation evaluation NOUN crl-13774 183 23 research research NOUN crl-13774 183 24 , , PUNCT crl-13774 183 25 p.19 p.19 NOUN crl-13774 183 26 . . PUNCT crl-13774 184 1 13 13 NUM crl-13774 184 2 . . PUNCT crl-13774 185 1 ibid ibid PROPN crl-13774 185 2 . . PUNCT crl-13774 185 3 , , PUNCT crl-13774 185 4 p.17 p.17 PROPN crl-13774 185 5 . . PROPN crl-13774 186 1 14 14 NUM crl-13774 186 2 . . PUNCT crl-13774 187 1 john john PROPN crl-13774 187 2 mueller mueller PROPN crl-13774 187 3 and and CCONJ crl-13774 187 4 others other NOUN crl-13774 187 5 , , PUNCT crl-13774 187 6 statistical statistical ADJ crl-13774 187 7 reasoning reasoning NOUN crl-13774 187 8 in in ADP crl-13774 187 9 sociology sociology NOUN crl-13774 187 10 ( ( PUNCT crl-13774 187 11 2d 2d NUM crl-13774 187 12 ed ed NOUN crl-13774 187 13 . . PROPN crl-13774 187 14 ; ; PUNCT crl-13774 187 15 boston boston PROPN crl-13774 187 16 : : PUNCT crl-13774 187 17 houghton houghton PROPN crl-13774 187 18 , , PUNCT crl-13774 187 19 1970 1970 NUM crl-13774 187 20 ) ) PUNCT crl-13774 187 21 , , PUNCT crl-13774 187 22 p.3 p.3 NOUN crl-13774 187 23 . . PUNCT crl-13774 188 1 15 15 NUM crl-13774 188 2 . . PUNCT crl-13774 188 3 hardesty hardesty PROPN crl-13774 188 4 , , PUNCT crl-13774 188 5 lovrich lovrich NOUN crl-13774 188 6 , , PUNCT crl-13774 188 7 and and CCONJ crl-13774 188 8 mannon mannon PROPN crl-13774 188 9 , , PUNCT crl-13774 188 10 " " PUNCT crl-13774 188 11 evaluating evaluate VERB crl-13774 188 12 library library NOUN crl-13774 188 13 - - PUNCT crl-13774 188 14 use use NOUN crl-13774 188 15 instruction instruction NOUN crl-13774 188 16 , , PUNCT crl-13774 188 17 " " PUNCT crl-13774 188 18 p.313 p.313 PROPN crl-13774 188 19 . . PUNCT crl-13774 189 1 16 16 NUM crl-13774 189 2 . . PUNCT crl-13774 190 1 the the DET crl-13774 190 2 importance importance NOUN crl-13774 190 3 of of ADP crl-13774 190 4 individual individual ADJ crl-13774 190 5 - - PUNCT crl-13774 190 6 level level NOUN crl-13774 190 7 verification verification NOUN crl-13774 190 8 of of ADP crl-13774 190 9 aggregate aggregate ADJ crl-13774 190 10 comparisons comparison NOUN crl-13774 190 11 can can AUX crl-13774 190 12 not not PART crl-13774 190 13 be be AUX crl-13774 190 14 overemphasized overemphasize VERB crl-13774 190 15 , , PUNCT crl-13774 190 16 particularly particularly ADV crl-13774 190 17 in in ADP crl-13774 190 18 the the DET crl-13774 190 19 analysis analysis NOUN crl-13774 190 20 of of ADP crl-13774 190 21 change change NOUN crl-13774 190 22 along along ADP crl-13774 190 23 a a DET crl-13774 190 24 temporal temporal ADJ crl-13774 190 25 dimension dimension NOUN crl-13774 190 26 . . PUNCT crl-13774 191 1 as as ADP crl-13774 191 2 a a DET crl-13774 191 3 simple simple ADJ crl-13774 191 4 illustration illustration NOUN crl-13774 191 5 one one PRON crl-13774 191 6 might might AUX crl-13774 191 7 consider consider VERB crl-13774 191 8 the the DET crl-13774 191 9 nightly nightly ADJ crl-13774 191 10 newscast newscast NOUN crl-13774 191 11 of of ADP crl-13774 191 12 electoral electoral ADJ crl-13774 191 13 attitude attitude NOUN crl-13774 191 14 changes change NOUN crl-13774 191 15 occurring occur VERB crl-13774 191 16 in in ADP crl-13774 191 17 the the DET crl-13774 191 18 course course NOUN crl-13774 191 19 of of ADP crl-13774 191 20 an an DET crl-13774 191 21 election election NOUN crl-13774 191 22 . . PUNCT crl-13774 192 1 say say VERB crl-13774 192 2 a a DET crl-13774 192 3 report report NOUN crl-13774 192 4 of of ADP crl-13774 192 5 candidate candidate NOUN crl-13774 192 6 preference preference NOUN crl-13774 192 7 in in ADP crl-13774 192 8 september september PROPN crl-13774 192 9 shows show VERB crl-13774 192 10 candidate candidate NOUN crl-13774 192 11 x x PROPN crl-13774 192 12 with with ADP crl-13774 192 13 a a DET crl-13774 192 14 50 50 NUM crl-13774 192 15 percent percent NOUN crl-13774 192 16 approval approval NOUN crl-13774 192 17 rating rating NOUN crl-13774 192 18 , , PUNCT crl-13774 192 19 and and CCONJ crl-13774 192 20 another another DET crl-13774 192 21 survey survey NOUN crl-13774 192 22 in in ADP crl-13774 192 23 november november PROPN crl-13774 192 24 shows show VERB crl-13774 192 25 the the DET crl-13774 192 26 same same ADJ crl-13774 192 27 result-50 result-50 ADJ crl-13774 192 28 percent percent NOUN crl-13774 192 29 approval approval NOUN crl-13774 192 30 . . PUNCT crl-13774 193 1 could could AUX crl-13774 193 2 we we PRON crl-13774 193 3 conclude conclude VERB crl-13774 193 4 that that SCONJ crl-13774 193 5 no no DET crl-13774 193 6 voters voter NOUN crl-13774 193 7 changed change VERB crl-13774 193 8 their their PRON crl-13774 193 9 preferences preference NOUN crl-13774 193 10 during during ADP crl-13774 193 11 the the DET crl-13774 193 12 campaign campaign NOUN crl-13774 193 13 ? ? PUNCT crl-13774 194 1 could could AUX crl-13774 194 2 we we PRON crl-13774 194 3 assume assume VERB crl-13774 194 4 that that SCONJ crl-13774 194 5 all all DET crl-13774 194 6 voters voter NOUN crl-13774 194 7 changed change VERB crl-13774 194 8 their their PRON crl-13774 194 9 mindsi.e mindsi.e NOUN crl-13774 194 10 . . PUNCT crl-13774 194 11 , , PUNCT crl-13774 194 12 all all PRON crl-13774 194 13 of of ADP crl-13774 194 14 those those PRON crl-13774 194 15 who who PRON crl-13774 194 16 favored favor VERB crl-13774 194 17 x x PUNCT crl-13774 194 18 now now ADV crl-13774 194 19 fa fa PROPN crl-13774 194 20 : : PUNCT crl-13774 194 21 vor vor NOUN crl-13774 194 22 another another DET crl-13774 194 23 candidate candidate NOUN crl-13774 194 24 and and CCONJ crl-13774 194 25 all all PRON crl-13774 194 26 of of ADP crl-13774 194 27 those those PRON crl-13774 194 28 who who PRON crl-13774 194 29 favored favor VERB crl-13774 194 30 other other ADJ crl-13774 194 31 candidates candidate NOUN crl-13774 194 32 now now ADV crl-13774 194 33 favor favor VERB crl-13774 194 34 x x PUNCT crl-13774 194 35 ? ? PUNCT crl-13774 194 36 sadly sadly ADV crl-13774 194 37 enough enough ADV crl-13774 194 38 , , PUNCT crl-13774 194 39 either either PRON crl-13774 194 40 of of ADP crl-13774 194 41 these these DET crl-13774 194 42 explanations explanation NOUN crl-13774 194 43 could could AUX crl-13774 194 44 be be AUX crl-13774 194 45 trueor trueor PROPN crl-13774 194 46 neither neither PRON crl-13774 194 47 could could AUX crl-13774 194 48 be be AUX crl-13774 194 49 true true ADJ crl-13774 194 50 ; ; PUNCT crl-13774 194 51 perhaps perhaps ADV crl-13774 194 52 an an DET crl-13774 194 53 equal equal ADJ crl-13774 194 54 proportion proportion NOUN crl-13774 194 55 ( ( PUNCT crl-13774 194 56 large large ADJ crl-13774 194 57 or or CCONJ crl-13774 194 58 small small ADJ crl-13774 194 59 ? ? PUNCT crl-13774 194 60 ) ) PUNCT crl-13774 194 61 of of ADP crl-13774 194 62 voters voter NOUN crl-13774 194 63 moved move VERB crl-13774 194 64 both both CCONJ crl-13774 194 65 toward toward ADP crl-13774 194 66 and and CCONJ crl-13774 194 67 away away ADV crl-13774 194 68 from from ADP crl-13774 194 69 a a DET crl-13774 194 70 preference preference NOUN crl-13774 194 71 for for ADP crl-13774 194 72 x. x. PROPN crl-13774 194 73 as as SCONJ crl-13774 194 74 is be AUX crl-13774 194 75 quite quite ADV crl-13774 194 76 evident evident ADJ crl-13774 194 77 , , PUNCT crl-13774 194 78 without without ADP crl-13774 194 79 individual individual ADJ crl-13774 194 80 level level NOUN crl-13774 194 81 comparisons comparison NOUN crl-13774 194 82 wherein wherein SCONJ crl-13774 194 83 the the DET crl-13774 194 84 changes change NOUN crl-13774 194 85 in in ADP crl-13774 194 86 preferences preference NOUN crl-13774 194 87 of of ADP crl-13774 194 88 individuals individual NOUN crl-13774 194 89 can can AUX crl-13774 194 90 be be AUX crl-13774 194 91 observed observe VERB crl-13774 194 92 varying vary VERB crl-13774 194 93 over over ADP crl-13774 194 94 time time NOUN crl-13774 194 95 , , PUNCT crl-13774 194 96 none none NOUN crl-13774 194 97 of of ADP crl-13774 194 98 these these DET crl-13774 194 99 hypothetical hypothetical ADJ crl-13774 194 100 explanations explanation NOUN crl-13774 194 101 of of ADP crl-13774 194 102 attitude attitude NOUN crl-13774 194 103 change change NOUN crl-13774 194 104 can can AUX crl-13774 194 105 be be AUX crl-13774 194 106 accepted accept VERB crl-13774 194 107 . . PUNCT crl-13774 195 1 17 17 NUM crl-13774 195 2 . . PUNCT crl-13774 196 1 hubert hubert PROPN crl-13774 196 2 m. m. PROPN crl-13774 196 3 blalock blalock PROPN crl-13774 196 4 , , PUNCT crl-13774 196 5 jr jr PROPN crl-13774 196 6 . . PROPN crl-13774 196 7 , , PUNCT crl-13774 196 8 social social ADJ crl-13774 196 9 statistics statistic NOUN crl-13774 196 10 ( ( PUNCT crl-13774 196 11 2d 2d NOUN crl-13774 196 12 ed ed NOUN crl-13774 196 13 . . PUNCT crl-13774 196 14 : : PUNCT crl-13774 197 1 new new PROPN crl-13774 197 2 york york PROPN crl-13774 197 3 : : PUNCT crl-13774 197 4 mcgraw mcgraw NOUN crl-13774 197 5 - - PUNCT crl-13774 197 6 hill hill NOUN crl-13774 197 7 , , PUNCT crl-13774 197 8 1972 1972 NUM crl-13774 197 9 ) ) PUNCT crl-13774 197 10 , , PUNCT crl-13774 197 11 p.42972 p.42972 PROPN crl-13774 197 12 . . PUNCT crl-13774 198 1 18 18 NUM crl-13774 198 2 . . PUNCT crl-13774 198 3 w. w. PROPN crl-13774 198 4 s. s. PROPN crl-13774 198 5 robinson robinson PROPN crl-13774 198 6 , , PUNCT crl-13774 198 7 " " PUNCT crl-13774 198 8 ecological ecological ADJ crl-13774 198 9 correlations correlation NOUN crl-13774 198 10 and and CCONJ crl-13774 198 11 the the DET crl-13774 198 12 behavior behavior NOUN crl-13774 198 13 of of ADP crl-13774 198 14 individuals individual NOUN crl-13774 198 15 , , PUNCT crl-13774 198 16 " " PUNCT crl-13774 198 17 american american ADJ crl-13774 198 18 sociological sociological ADJ crl-13774 198 19 review review NOUN crl-13774 198 20 15:351 15:351 NUM crl-13774 198 21 - - SYM crl-13774 198 22 57 57 NUM crl-13774 198 23 oune oune NOUN crl-13774 198 24 1950 1950 NUM crl-13774 198 25 ) ) PUNCT crl-13774 198 26 . . PUNCT crl-13774 199 1 19 19 NUM crl-13774 199 2 . . X crl-13774 199 3 werking werking NOUN crl-13774 199 4 , , PUNCT crl-13774 199 5 " " PUNCT crl-13774 199 6 evaluating evaluate VERB crl-13774 199 7 bibliographic bibliographic ADJ crl-13774 199 8 education education NOUN crl-13774 199 9 , , PUNCT crl-13774 199 10 " " PUNCT crl-13774 199 11 p.166 p.166 NOUN crl-13774 199 12 - - PUNCT crl-13774 199 13 67 67 NUM crl-13774 199 14 . . NUM crl-13774 199 15 20 20 NUM crl-13774 199 16 . . PUNCT crl-13774 200 1 hardesty hardesty PROPN crl-13774 200 2 , , PUNCT crl-13774 200 3 lovrich lovrich NOUN crl-13774 200 4 , , PUNCT crl-13774 200 5 and and CCONJ crl-13774 200 6 mannon mannon PROPN crl-13774 200 7 , , PUNCT crl-13774 200 8 " " PUNCT crl-13774 200 9 evaluating evaluate VERB crl-13774 200 10 library library NOUN crl-13774 200 11 - - PUNCT crl-13774 200 12 use use NOUN crl-13774 200 13 instruction instruction NOUN crl-13774 200 14 , , PUNCT crl-13774 200 15 " " PUNCT crl-13774 200 16 p.316 p.316 NOUN crl-13774 200 17 . . PROPN crl-13774 200 18 21 21 NUM crl-13774 200 19 . . PUNCT crl-13774 201 1 norman norman PROPN crl-13774 201 2 e. e. PROPN crl-13774 201 3 gronlund gronlund PROPN crl-13774 201 4 , , PUNCT crl-13774 201 5 measurement measurement NOUN crl-13774 201 6 and and CCONJ crl-13774 201 7 evaluation evaluation NOUN crl-13774 201 8 in in ADP crl-13774 201 9 teaching teaching NOUN crl-13774 201 10 ( ( PUNCT crl-13774 201 11 3d 3d PROPN crl-13774 201 12 ed ed NOUN crl-13774 201 13 . . PROPN crl-13774 201 14 ; ; PUNCT crl-13774 201 15 new new PROPN crl-13774 201 16 york york PROPN crl-13774 201 17 : : PUNCT crl-13774 201 18 macmillan macmillan PROPN crl-13774 201 19 , , PUNCT crl-13774 201 20 1976 1976 NUM crl-13774 201 21 ) ) PUNCT crl-13774 201 22 , , PUNCT crl-13774 201 23 p.13 p.13 X crl-13774 201 24 . . PUNCT crl-13774 202 1 22 22 NUM crl-13774 202 2 . . PUNCT crl-13774 203 1 francis francis PROPN crl-13774 203 2 g. g. PROPN crl-13774 203 3 caro caro PROPN crl-13774 203 4 , , PUNCT crl-13774 203 5 " " PUNCT crl-13774 203 6 evaluation evaluation NOUN crl-13774 203 7 research research NOUN crl-13774 203 8 : : PUNCT crl-13774 203 9 an an DET crl-13774 203 10 overview overview NOUN crl-13774 203 11 , , PUNCT crl-13774 203 12 " " PUNCT crl-13774 203 13 in in ADP crl-13774 203 14 his his PRON crl-13774 203 15 readings reading NOUN crl-13774 203 16 in in ADP crl-13774 203 17 evaluation evaluation NOUN crl-13774 203 18 research research NOUN crl-13774 203 19 ( ( PUNCT crl-13774 203 20 new new PROPN crl-13774 203 21 york york PROPN crl-13774 203 22 : : PUNCT crl-13774 203 23 russell russell PROPN crl-13774 203 24 sage sage PROPN crl-13774 203 25 , , PUNCT crl-13774 203 26 1971 1971 NUM crl-13774 203 27 ) ) PUNCT crl-13774 203 28 , , PUNCT crl-13774 203 29 p.12 p.12 X crl-13774 203 30 . . PUNCT crl-13774 203 31 23 23 NUM crl-13774 203 32 . . PUNCT crl-13774 204 1 carol carol PROPN crl-13774 204 2 h. h. PROPN crl-13774 204 3 weiss weiss PROPN crl-13774 204 4 , , PUNCT crl-13774 204 5 " " PUNCT crl-13774 204 6 evaluation evaluation NOUN crl-13774 204 7 research research NOUN crl-13774 204 8 in in ADP crl-13774 204 9 the the DET crl-13774 204 10 political political ADJ crl-13774 204 11 context context NOUN crl-13774 204 12 , , PUNCT crl-13774 204 13 " " PUNCT crl-13774 204 14 in in ADP crl-13774 204 15 elmer elmer NOUN crl-13774 204 16 l. l. NOUN crl-13774 204 17 struening struening PROPN crl-13774 204 18 and and CCONJ crl-13774 204 19 marcia marcia PROPN crl-13774 204 20 guttentag guttentag NOUN crl-13774 204 21 , , PUNCT crl-13774 204 22 eds ed NOUN crl-13774 204 23 . . PUNCT crl-13774 204 24 , , PUNCT crl-13774 204 25 handbook handbook NOUN crl-13774 204 26 of of ADP crl-13774 204 27 evaluation evaluation NOUN crl-13774 204 28 research research NOUN crl-13774 204 29 , , PUNCT crl-13774 204 30 v.1 v.1 PUNCT crl-13774 204 31 ( ( PUNCT crl-13774 204 32 beverly beverly PROPN crl-13774 204 33 hills hills PROPN crl-13774 204 34 , , PUNCT crl-13774 204 35 calif calif PROPN crl-13774 204 36 . . PUNCT crl-13774 204 37 : : PUNCT crl-13774 204 38 sage sage NOUN crl-13774 204 39 publications publication NOUN crl-13774 204 40 , , PUNCT crl-13774 204 41 1975 1975 NUM crl-13774 204 42 ) ) PUNCT crl-13774 204 43 , , PUNCT crl-13774 204 44 p.13 p.13 X crl-13774 204 45 . . PUNCT crl-13774 205 1 24 24 NUM crl-13774 205 2 . . PUNCT crl-13774 206 1 werking werking NOUN crl-13774 206 2 , , PUNCT crl-13774 206 3 " " PUNCT crl-13774 206 4 evaluating evaluate VERB crl-13774 206 5 bibliographic bibliographic ADJ crl-13774 206 6 education education NOUN crl-13774 206 7 , , PUNCT crl-13774 206 8 " " PUNCT crl-13774 206 9 p.167 p.167 NOUN crl-13774 206 10 . . PUNCT crl-13774 207 1 25 25 NUM crl-13774 207 2 . . PUNCT crl-13774 208 1 benjamin benjamin PROPN crl-13774 208 2 s. s. PROPN crl-13774 208 3 bloom bloom PROPN crl-13774 208 4 , , PUNCT crl-13774 208 5 " " PUNCT crl-13774 208 6 some some DET crl-13774 208 7 theoretical theoretical ADJ crl-13774 208 8 issues issue NOUN crl-13774 208 9 relating relate VERB crl-13774 208 10 to to ADP crl-13774 208 11 educational educational ADJ crl-13774 208 12 evaluation evaluation NOUN crl-13774 208 13 , , PUNCT crl-13774 208 14 " " PUNCT crl-13774 208 15 in in ADP crl-13774 208 16 ralph ralph PROPN crl-13774 208 17 w. w. PROPN crl-13774 208 18 tyler tyler PROPN crl-13774 208 19 , , PUNCT crl-13774 208 20 ed ed NOUN crl-13774 208 21 . . PROPN crl-13774 208 22 , , PUNCT crl-13774 208 23 educational educational ADJ crl-13774 208 24 evaluation evaluation NOUN crl-13774 208 25 : : PUNCT crl-13774 208 26 new new ADJ crl-13774 208 27 roles role NOUN crl-13774 208 28 , , PUNCT crl-13774 208 29 new new ADJ crl-13774 208 30 means mean NOUN crl-13774 208 31 , , PUNCT crl-13774 208 32 sixty sixty NUM crl-13774 208 33 - - PUNCT crl-13774 208 34 eight eight NUM crl-13774 208 35 yearbook yearbook NOUN crl-13774 208 36 of of ADP crl-13774 208 37 the the DET crl-13774 208 38 national national ADJ crl-13774 208 39 society society NOUN crl-13774 208 40 for for ADP crl-13774 208 41 the the DET crl-13774 208 42 study study NOUN crl-13774 208 43 of of ADP crl-13774 208 44 education education NOUN crl-13774 208 45 , , PUNCT crl-13774 208 46 part part PROPN crl-13774 208 47 ii ii PROPN crl-13774 208 48 ( ( PUNCT crl-13774 208 49 chicago chicago PROPN crl-13774 208 50 : : PUNCT crl-13774 208 51 univ univ PROPN crl-13774 208 52 . . PROPN crl-13774 208 53 of of ADP crl-13774 208 54 chicago chicago PROPN crl-13774 208 55 pr pr PROPN crl-13774 208 56 . . PROPN crl-13774 208 57 , , PUNCT crl-13774 208 58 1969 1969 NUM crl-13774 208 59 ) ) PUNCT crl-13774 208 60 , , PUNCT crl-13774 208 61 p.44 p.44 PROPN crl-13774 208 62 . . PUNCT crl-13774 208 63 26 26 NUM crl-13774 208 64 . . PUNCT crl-13774 209 1 howard howard PROPN crl-13774 209 2 r. r. PROPN crl-13774 209 3 davis davis PROPN crl-13774 209 4 and and CCONJ crl-13774 209 5 susan susan PROPN crl-13774 209 6 e. e. PROPN crl-13774 209 7 salasin salasin PROPN crl-13774 209 8 , , PUNCT crl-13774 209 9 " " PUNCT crl-13774 209 10 the the DET crl-13774 209 11 utilization utilization NOUN crl-13774 209 12 of of ADP crl-13774 209 13 evaluation evaluation NOUN crl-13774 209 14 , , PUNCT crl-13774 209 15 " " PUNCT crl-13774 209 16 handbook handbook NOUN crl-13774 209 17 of of ADP crl-13774 209 18 evaluation evaluation NOUN crl-13774 209 19 research research NOUN crl-13774 209 20 , , PUNCT crl-13774 209 21 p.624 p.624 NUM crl-13774 209 22 . . PUNCT crl-13774 209 23 . . PUNCT crl-13774 210 1 27 27 NUM crl-13774 210 2 . . PUNCT crl-13774 210 3 edward edward PROPN crl-13774 210 4 a. a. PROPN crl-13774 210 5 suchman suchman PROPN crl-13774 210 6 , , PUNCT crl-13774 210 7 " " PUNCT crl-13774 210 8 evaluation evaluation NOUN crl-13774 210 9 research research NOUN crl-13774 210 10 , , PUNCT crl-13774 210 11 " " PUNCT crl-13774 210 12 in in ADP crl-13774 210 13 elmer elmer NOUN crl-13774 210 14 l. l. NOUN crl-13774 210 15 struening struening PROPN crl-13774 210 16 and and CCONJ crl-13774 210 17 marcia marcia PROPN crl-13774 210 18 guttentag guttentag NOUN crl-13774 210 19 , , PUNCT crl-13774 210 20 eds ed NOUN crl-13774 210 21 . . PUNCT crl-13774 210 22 , , PUNCT crl-13774 210 23 handbook handbook NOUN crl-13774 210 24 of of ADP crl-13774 210 25 evaluation evaluation NOUN crl-13774 210 26 research research NOUN crl-13774 210 27 , , PUNCT crl-13774 210 28 v.1 v.1 PUNCT crl-13774 210 29 ( ( PUNCT crl-13774 210 30 beverly beverly PROPN crl-13774 210 31 hills hills PROPN crl-13774 210 32 , , PUNCT crl-13774 210 33 calif calif PROPN crl-13774 210 34 . . PROPN crl-13774 210 35 : : PUNCT crl-13774 210 36 russell russell PROPN crl-13774 210 37 sage sage PROPN crl-13774 210 38 , , PUNCT crl-13774 210 39 1975 1975 NUM crl-13774 210 40 ) ) PUNCT crl-13774 210 41 , , PUNCT crl-13774 210 42 p.624 p.624 NOUN crl-13774 210 43 . . PUNCT crl-13774 211 1 28 28 X crl-13774 211 2 . . PUNCT crl-13774 211 3 larry larry PROPN crl-13774 211 4 hardesty hardesty PROPN crl-13774 211 5 , , PUNCT crl-13774 211 6 " " PUNCT crl-13774 211 7 instruction instruction NOUN crl-13774 211 8 development development NOUN crl-13774 211 9 in in ADP crl-13774 211 10 library library NOUN crl-13774 211 11 use use VERB crl-13774 211 12 education education NOUN crl-13774 211 13 , , PUNCT crl-13774 211 14 " " PUNCT crl-13774 211 15 in in ADP crl-13774 211 16 carolyn carolyn PROPN crl-13774 211 17 a. a. PROPN crl-13774 211 18 kirkendall kirkendall PROPN crl-13774 211 19 , , PUNCT crl-13774 211 20 ed ed NOUN crl-13774 211 21 . . PROPN crl-13774 211 22 , , PUNCT crl-13774 211 23 improving improve VERB crl-13774 211 24 library library NOUN crl-13774 211 25 instruction instruction NOUN crl-13774 211 26 ( ( PUNCT crl-13774 211 27 ann ann PROPN crl-13774 211 28 arbor arbor PROPN crl-13774 211 29 : : PUNCT crl-13774 211 30 pierian pierian PROPN crl-13774 211 31 pr pr PROPN crl-13774 211 32 . . PROPN crl-13774 211 33 , , PUNCT crl-13774 211 34 1979 1979 NUM crl-13774 211 35 ) ) PUNCT crl-13774 211 36 , , PUNCT crl-13774 211 37 p.ll-36 p.ll-36 NOUN crl-13774 211 38 . . PUNCT