id sid tid token lemma pos crl-14452 1 1 college college NOUN crl-14452 1 2 and and CCONJ crl-14452 1 3 research research NOUN crl-14452 1 4 libraries librarie VERB crl-14452 1 5 unobtrusive unobtrusive ADJ crl-14452 1 6 studies study NOUN crl-14452 1 7 and and CCONJ crl-14452 1 8 the the DET crl-14452 1 9 quality quality NOUN crl-14452 1 10 of of ADP crl-14452 1 11 academic academic ADJ crl-14452 1 12 library library NOUN crl-14452 1 13 reference reference PROPN crl-14452 1 14 services service NOUN crl-14452 1 15 jo jo PROPN crl-14452 1 16 bell bell PROPN crl-14452 1 17 whitlatch whitlatch VERB crl-14452 1 18 this this DET crl-14452 1 19 article article NOUN crl-14452 1 20 uses use VERB crl-14452 1 21 empirical empirical ADJ crl-14452 1 22 data datum NOUN crl-14452 1 23 from from ADP crl-14452 1 24 a a DET crl-14452 1 25 recent recent ADJ crl-14452 1 26 obtrusive obtrusive ADJ crl-14452 1 27 study study NOUN crl-14452 1 28 of of ADP crl-14452 1 29 reference reference NOUN crl-14452 1 30 performance performance NOUN crl-14452 1 31 to to PART crl-14452 1 32 explore explore VERB crl-14452 1 33 content content NOUN crl-14452 1 34 validity validity NOUN crl-14452 1 35 and and CCONJ crl-14452 1 36 assumptions assumption NOUN crl-14452 1 37 regarding regard VERB crl-14452 1 38 unobtrusive unobtrusive ADJ crl-14452 1 39 studies study NOUN crl-14452 1 40 . . PUNCT crl-14452 2 1 data datum NOUN crl-14452 2 2 collected collect VERB crl-14452 2 3 by by ADP crl-14452 2 4 the the DET crl-14452 2 5 author author NOUN crl-14452 2 6 support support VERB crl-14452 2 7 the the DET crl-14452 2 8 contention contention NOUN crl-14452 2 9 that that SCONJ crl-14452 2 10 improvements improvement NOUN crl-14452 2 11 are be AUX crl-14452 2 12 highly highly ADV crl-14452 2 13 desirable desirable ADJ crl-14452 2 14 before before ADP crl-14452 2 15 conducting conduct VERB crl-14452 2 16 more more ADJ crl-14452 2 17 unobtrusive unobtrusive ADJ crl-14452 2 18 studies study NOUN crl-14452 2 19 of of ADP crl-14452 2 20 reference reference NOUN crl-14452 2 21 service service NOUN crl-14452 2 22 . . PUNCT crl-14452 3 1 the the DET crl-14452 3 2 two two NUM crl-14452 3 3 most most ADV crl-14452 3 4 important important ADJ crl-14452 3 5 changes change NOUN crl-14452 3 6 concern concern NOUN crl-14452 3 7 the the DET crl-14452 3 8 development development NOUN crl-14452 3 9 of of ADP crl-14452 3 10 test test NOUN crl-14452 3 11 questions question NOUN crl-14452 3 12 representing represent VERB crl-14452 3 13 all all DET crl-14452 3 14 types type NOUN crl-14452 3 15 of of ADP crl-14452 3 16 queries query NOUN crl-14452 3 17 and and CCONJ crl-14452 3 18 supplementing supplement VERB crl-14452 3 19 the the DET crl-14452 3 20 correct correct ADJ crl-14452 3 21 fill fill NOUN crl-14452 3 22 rate rate NOUN crl-14452 3 23 with with ADP crl-14452 3 24 other other ADJ crl-14452 3 25 measures measure NOUN crl-14452 3 26 of of ADP crl-14452 3 27 reference reference NOUN crl-14452 3 28 performance performance NOUN crl-14452 3 29 . . PUNCT crl-14452 4 1 uring ure VERB crl-14452 4 2 the the DET crl-14452 4 3 past past ADJ crl-14452 4 4 two two NUM crl-14452 4 5 decades decade NOUN crl-14452 4 6 , , PUNCT crl-14452 4 7 the the DET crl-14452 4 8 most most ADV crl-14452 4 9 notable notable ADJ crl-14452 4 10 advance advance NOUN crl-14452 4 11 in in ADP crl-14452 4 12 reference reference NOUN crl-14452 4 13 services service NOUN crl-14452 4 14 evaluation evaluation NOUN crl-14452 4 15 has have AUX crl-14452 4 16 been be AUX crl-14452 4 17 the the DET crl-14452 4 18 increased increase VERB crl-14452 4 19 use use NOUN crl-14452 4 20 of of ADP crl-14452 4 21 unobtrusive unobtrusive ADJ crl-14452 4 22 observation observation NOUN crl-14452 4 23 methodology methodology NOUN crl-14452 4 24 . . PUNCT crl-14452 5 1 researchers researcher NOUN crl-14452 5 2 have have AUX crl-14452 5 3 come come VERB crl-14452 5 4 to to PART crl-14452 5 5 accept accept VERB crl-14452 5 6 unobtrusive unobtrusive ADJ crl-14452 5 7 studies study NOUN crl-14452 5 8 as as ADP crl-14452 5 9 a a DET crl-14452 5 10 valuable valuable ADJ crl-14452 5 11 tool tool NOUN crl-14452 5 12 for for ADP crl-14452 5 13 the the DET crl-14452 5 14 evaluation evaluation NOUN crl-14452 5 15 of of ADP crl-14452 5 16 reference reference NOUN crl-14452 5 17 services service NOUN crl-14452 5 18 . . PUNCT crl-14452 6 1 reference reference NOUN crl-14452 6 2 librarians librarians PROPN crl-14452 6 3 and and CCONJ crl-14452 6 4 library library NOUN crl-14452 6 5 managers manager NOUN crl-14452 6 6 , , PUNCT crl-14452 6 7 however however ADV crl-14452 6 8 , , PUNCT crl-14452 6 9 do do AUX crl-14452 6 10 not not PART crl-14452 6 11 appear appear VERB crl-14452 6 12 to to PART crl-14452 6 13 have have AUX crl-14452 6 14 integrated integrate VERB crl-14452 6 15 the the DET crl-14452 6 16 findings finding NOUN crl-14452 6 17 from from ADP crl-14452 6 18 these these DET crl-14452 6 19 unobtrusive unobtrusive ADJ crl-14452 6 20 studies study NOUN crl-14452 6 21 into into ADP crl-14452 6 22 reference reference NOUN crl-14452 6 23 services service NOUN crl-14452 6 24 practice practice NOUN crl-14452 6 25 . . PUNCT crl-14452 7 1 unobtrusive unobtrusive ADJ crl-14452 7 2 studies study NOUN crl-14452 7 3 of of ADP crl-14452 7 4 reference reference NOUN crl-14452 7 5 services service NOUN crl-14452 7 6 were be AUX crl-14452 7 7 developed develop VERB crl-14452 7 8 to to PART crl-14452 7 9 provide provide VERB crl-14452 7 10 an an DET crl-14452 7 11 alternative alternative NOUN crl-14452 7 12 to to ADP crl-14452 7 13 user user NOUN crl-14452 7 14 satisfaction satisfaction NOUN crl-14452 7 15 surveys survey NOUN crl-14452 7 16 . . PUNCT crl-14452 8 1 the the DET crl-14452 8 2 early early ADJ crl-14452 8 3 , , PUNCT crl-14452 8 4 obtrusive obtrusive ADJ crl-14452 8 5 and and CCONJ crl-14452 8 6 generally generally ADV crl-14452 8 7 global global ADJ crl-14452 8 8 surveys survey NOUN crl-14452 8 9 of of ADP crl-14452 8 10 user user NOUN crl-14452 8 11 satisfaction satisfaction NOUN crl-14452 8 12 provided provide VERB crl-14452 8 13 little little ADJ crl-14452 8 14 information information NOUN crl-14452 8 15 useful useful ADJ crl-14452 8 16 for for ADP crl-14452 8 17 improving improve VERB crl-14452 8 18 services service NOUN crl-14452 8 19 . . PUNCT crl-14452 9 1 unfortunately unfortunately ADV crl-14452 9 2 , , PUNCT crl-14452 9 3 unobtrusive unobtrusive ADJ crl-14452 9 4 studies study NOUN crl-14452 9 5 as as SCONJ crl-14452 9 6 they they PRON crl-14452 9 7 are be AUX crl-14452 9 8 presently presently ADV crl-14452 9 9 employed employ VERB crl-14452 9 10 in in ADP crl-14452 9 11 the the DET crl-14452 9 12 evaluation evaluation NOUN crl-14452 9 13 of of ADP crl-14452 9 14 reference reference NOUN crl-14452 9 15 services service NOUN crl-14452 9 16 also also ADV crl-14452 9 17 have have VERB crl-14452 9 18 serious serious ADJ crl-14452 9 19 limitations limitation NOUN crl-14452 9 20 that that PRON crl-14452 9 21 prevent prevent VERB crl-14452 9 22 an an DET crl-14452 9 23 adequate adequate ADJ crl-14452 9 24 assessment assessment NOUN crl-14452 9 25 of of ADP crl-14452 9 26 reference reference NOUN crl-14452 9 27 services service NOUN crl-14452 9 28 performance performance NOUN crl-14452 9 29 . . PUNCT crl-14452 10 1 this this DET crl-14452 10 2 paper paper NOUN crl-14452 10 3 begins begin VERB crl-14452 10 4 with with ADP crl-14452 10 5 a a DET crl-14452 10 6 comparison comparison NOUN crl-14452 10 7 of of ADP crl-14452 10 8 performance performance NOUN crl-14452 10 9 measures measure NOUN crl-14452 10 10 and and CCONJ crl-14452 10 11 methodologies methodology NOUN crl-14452 10 12 typically typically ADV crl-14452 10 13 employed employ VERB crl-14452 10 14 in in ADP crl-14452 10 15 unobtrusive unobtrusive ADJ crl-14452 10 16 and and CCONJ crl-14452 10 17 obtrusive obtrusive ADJ crl-14452 10 18 studies study NOUN crl-14452 10 19 and and CCONJ crl-14452 10 20 then then ADV crl-14452 10 21 discusses discuss VERB crl-14452 10 22 the the DET crl-14452 10 23 assumptions assumption NOUN crl-14452 10 24 underlying underlie VERB crl-14452 10 25 unobtrusive unobtrusive ADJ crl-14452 10 26 studies study NOUN crl-14452 10 27 . . PUNCT crl-14452 11 1 a a DET crl-14452 11 2 recently recently ADV crl-14452 11 3 published publish VERB crl-14452 11 4 text text NOUN crl-14452 11 5 , , PUNCT crl-14452 11 6 unobtrusive unobtrusive ADJ crl-14452 11 7 testing testing NOUN crl-14452 11 8 and and CCONJ crl-14452 11 9 library library NOUN crl-14452 11 10 reference reference NOUN crl-14452 11 11 services service NOUN crl-14452 11 12 by by ADP crl-14452 11 13 peter peter PROPN crl-14452 11 14 hernon hernon PROPN crl-14452 11 15 and and CCONJ crl-14452 11 16 charles charles PROPN crl-14452 11 17 mcclure mcclure NOUN crl-14452 11 18 , , PUNCT crl-14452 11 19 provides provide VERB crl-14452 11 20 an an DET crl-14452 11 21 excellent excellent ADJ crl-14452 11 22 review review NOUN crl-14452 11 23 of of ADP crl-14452 11 24 unobtrusive unobtrusive ADJ crl-14452 11 25 methodology methodology NOUN crl-14452 11 26 and and CCONJ crl-14452 11 27 practice practice NOUN crl-14452 11 28 . . PUNCT crl-14452 12 1 1 1 NUM crl-14452 12 2 to to PART crl-14452 12 3 illustrate illustrate VERB crl-14452 12 4 differences difference NOUN crl-14452 12 5 between between ADP crl-14452 12 6 these these DET crl-14452 12 7 two two NUM crl-14452 12 8 types type NOUN crl-14452 12 9 of of ADP crl-14452 12 10 studies study NOUN crl-14452 12 11 , , PUNCT crl-14452 12 12 i i PRON crl-14452 12 13 use use VERB crl-14452 12 14 material material NOUN crl-14452 12 15 from from ADP crl-14452 12 16 hernon hernon NOUN crl-14452 12 17 and and CCONJ crl-14452 12 18 mcoure mcoure NOUN crl-14452 12 19 and and CCONJ crl-14452 12 20 selected select VERB crl-14452 12 21 findings finding NOUN crl-14452 12 22 from from ADP crl-14452 12 23 an an DET crl-14452 12 24 obtrusive obtrusive ADJ crl-14452 12 25 study study NOUN crl-14452 12 26 that that PRON crl-14452 12 27 i i PRON crl-14452 12 28 have have AUX crl-14452 12 29 just just ADV crl-14452 12 30 completed complete VERB crl-14452 12 31 . . PUNCT crl-14452 13 1 2 2 NUM crl-14452 13 2 my my PRON crl-14452 13 3 findings finding NOUN crl-14452 13 4 support support VERB crl-14452 13 5 the the DET crl-14452 13 6 contention contention NOUN crl-14452 13 7 that that PRON crl-14452 13 8 unobtrusive unobtrusive ADJ crl-14452 13 9 studies study NOUN crl-14452 13 10 , , PUNCT crl-14452 13 11 as as SCONJ crl-14452 13 12 they they PRON crl-14452 13 13 are be AUX crl-14452 13 14 currently currently ADV crl-14452 13 15 conducted conduct VERB crl-14452 13 16 , , PUNCT crl-14452 13 17 are be AUX crl-14452 13 18 extremely extremely ADV crl-14452 13 19 limited limited ADJ crl-14452 13 20 as as ADP crl-14452 13 21 instruments instrument NOUN crl-14452 13 22 for for ADP crl-14452 13 23 the the DET crl-14452 13 24 evaluation evaluation NOUN crl-14452 13 25 of of ADP crl-14452 13 26 reference reference NOUN crl-14452 13 27 effectiveness effectiveness NOUN crl-14452 13 28 in in ADP crl-14452 13 29 academic academic ADJ crl-14452 13 30 libraries library NOUN crl-14452 13 31 . . PUNCT crl-14452 14 1 the the DET crl-14452 14 2 paper paper NOUN crl-14452 14 3 concludes conclude VERB crl-14452 14 4 with with ADP crl-14452 14 5 a a DET crl-14452 14 6 discussion discussion NOUN crl-14452 14 7 of of ADP crl-14452 14 8 the the DET crl-14452 14 9 changes change NOUN crl-14452 14 10 that that PRON crl-14452 14 11 are be AUX crl-14452 14 12 needed need VERB crl-14452 14 13 in in ADP crl-14452 14 14 order order NOUN crl-14452 14 15 to to PART crl-14452 14 16 develop develop VERB crl-14452 14 17 an an DET crl-14452 14 18 improved improved ADJ crl-14452 14 19 system system NOUN crl-14452 14 20 of of ADP crl-14452 14 21 reference reference NOUN crl-14452 14 22 evaluation evaluation NOUN crl-14452 14 23 . . PUNCT crl-14452 15 1 summary summary NOUN crl-14452 15 2 of of ADP crl-14452 15 3 findings finding NOUN crl-14452 15 4 and and CCONJ crl-14452 15 5 methodology methodology NOUN crl-14452 15 6 unobtrusive unobtrusive ADJ crl-14452 15 7 studies study NOUN crl-14452 15 8 in in ADP crl-14452 15 9 unobtrusive unobtrusive ADJ crl-14452 15 10 studies study NOUN crl-14452 15 11 of of ADP crl-14452 15 12 reference reference NOUN crl-14452 15 13 services service NOUN crl-14452 15 14 , , PUNCT crl-14452 15 15 predetermined predetermine VERB crl-14452 15 16 test test NOUN crl-14452 15 17 questions question NOUN crl-14452 15 18 are be AUX crl-14452 15 19 administered administer VERB crl-14452 15 20 to to PART crl-14452 15 21 reference reference VERB crl-14452 15 22 librarians librarian NOUN crl-14452 15 23 . . PUNCT crl-14452 16 1 these these DET crl-14452 16 2 librarians librarians PROPN crl-14452 16 3 are be AUX crl-14452 16 4 unaware unaware ADJ crl-14452 16 5 that that SCONJ crl-14452 16 6 their their PRON crl-14452 16 7 responses response NOUN crl-14452 16 8 are be AUX crl-14452 16 9 being be AUX crl-14452 16 10 assessed assess VERB crl-14452 16 11 . . PUNCT crl-14452 17 1 thus thus ADV crl-14452 17 2 , , PUNCT crl-14452 17 3 the the DET crl-14452 17 4 effect effect NOUN crl-14452 17 5 of of ADP crl-14452 17 6 being be AUX crl-14452 17 7 tested test VERB crl-14452 17 8 should should AUX crl-14452 17 9 not not PART crl-14452 17 10 influence influence VERB crl-14452 17 11 jo jo PROPN crl-14452 17 12 bell bell PROPN crl-14452 17 13 whitlatch whitlatch NOUN crl-14452 17 14 is be AUX crl-14452 17 15 associate associate ADJ crl-14452 17 16 library library NOUN crl-14452 17 17 director director NOUN crl-14452 17 18 , , PUNCT crl-14452 17 19 access access NOUN crl-14452 17 20 and and CCONJ crl-14452 17 21 bibliographic bibliographic ADJ crl-14452 17 22 services service NOUN crl-14452 17 23 , , PUNCT crl-14452 17 24 at at ADP crl-14452 17 25 san san PROPN crl-14452 17 26 jose jose PROPN crl-14452 17 27 state state PROPN crl-14452 17 28 university university PROPN crl-14452 17 29 , , PUNCT crl-14452 17 30 san san PROPN crl-14452 17 31 jose jose PROPN crl-14452 17 32 , , PUNCT crl-14452 17 33 california california PROPN crl-14452 17 34 95192 95192 NUM crl-14452 17 35 - - SYM crl-14452 17 36 0028 0028 NUM crl-14452 17 37 . . PUNCT crl-14452 18 1 181 181 NUM crl-14452 18 2 182 182 NUM crl-14452 18 3 college college PROPN crl-14452 18 4 & & CCONJ crl-14452 18 5 research research PROPN crl-14452 18 6 libraries librarie VERB crl-14452 18 7 the the DET crl-14452 18 8 normal normal ADJ crl-14452 18 9 behavior behavior NOUN crl-14452 18 10 of of ADP crl-14452 18 11 the the DET crl-14452 18 12 librarian librarian NOUN crl-14452 18 13 . . PUNCT crl-14452 19 1 those those PRON crl-14452 19 2 administering administer VERB crl-14452 19 3 the the DET crl-14452 19 4 test test NOUN crl-14452 19 5 questions question NOUN crl-14452 19 6 pose pose VERB crl-14452 19 7 as as ADP crl-14452 19 8 library library NOUN crl-14452 19 9 users user NOUN crl-14452 19 10 and and CCONJ crl-14452 19 11 receive receive VERB crl-14452 19 12 training training NOUN crl-14452 19 13 in in ADP crl-14452 19 14 how how SCONJ crl-14452 19 15 to to PART crl-14452 19 16 administer administer VERB crl-14452 19 17 the the DET crl-14452 19 18 questions question NOUN crl-14452 19 19 to to ADP crl-14452 19 20 the the DET crl-14452 19 21 unsuspecting unsuspecting ADJ crl-14452 19 22 librarians librarians PROPN crl-14452 19 23 . . PUNCT crl-14452 20 1 the the DET crl-14452 20 2 results result NOUN crl-14452 20 3 indicate indicate VERB crl-14452 20 4 that that SCONJ crl-14452 20 5 reference reference NOUN crl-14452 20 6 staff staff NOUN crl-14452 20 7 members member NOUN crl-14452 20 8 answer answer VERB crl-14452 20 9 correctly correctly ADV crl-14452 20 10 50 50 NUM crl-14452 20 11 to to PART crl-14452 20 12 60 60 NUM crl-14452 20 13 percent percent NOUN crl-14452 20 14 of of ADP crl-14452 20 15 the the DET crl-14452 20 16 questions question NOUN crl-14452 20 17 posed pose VERB crl-14452 20 18 in in ADP crl-14452 20 19 this this DET crl-14452 20 20 manner manner NOUN crl-14452 20 21 . . PUNCT crl-14452 21 1 3 3 NUM crl-14452 21 2 thomas thomas PROPN crl-14452 21 3 childers childer NOUN crl-14452 21 4 remarks remark VERB crl-14452 21 5 that that SCONJ crl-14452 21 6 he he PRON crl-14452 21 7 and and CCONJ crl-14452 21 8 crowley crowley NOUN crl-14452 21 9 unintentionally unintentionally ADV crl-14452 21 10 initiated initiate VERB crl-14452 21 11 a a DET crl-14452 21 12 tradition tradition NOUN crl-14452 21 13 of of ADP crl-14452 21 14 research research NOUN crl-14452 21 15 and and CCONJ crl-14452 21 16 a a DET crl-14452 21 17 particular particular ADJ crl-14452 21 18 way way NOUN crl-14452 21 19 of of ADP crl-14452 21 20 conceiving conceive VERB crl-14452 21 21 the the DET crl-14452 21 22 reference reference NOUN crl-14452 21 23 process process NOUN crl-14452 21 24 and and CCONJ crl-14452 21 25 applying apply VERB crl-14452 21 26 the the DET crl-14452 21 27 unobtrusive unobtrusive ADJ crl-14452 21 28 method method NOUN crl-14452 21 29 to to ADP crl-14452 21 30 the the DET crl-14452 21 31 evaluation evaluation NOUN crl-14452 21 32 of of ADP crl-14452 21 33 reference reference NOUN crl-14452 21 34 services service NOUN crl-14452 21 35 . . PUNCT crl-14452 22 1 today today NOUN crl-14452 22 2 , , PUNCT crl-14452 22 3 those those PRON crl-14452 22 4 performing perform VERB crl-14452 22 5 unobtrusive unobtrusive ADJ crl-14452 22 6 studies study NOUN crl-14452 22 7 continue continue VERB crl-14452 22 8 to to PART crl-14452 22 9 conceive conceive VERB crl-14452 22 10 the the DET crl-14452 22 11 reference reference NOUN crl-14452 22 12 process process NOUN crl-14452 22 13 · · PUNCT crl-14452 22 14 and and CCONJ crl-14452 22 15 employ employ VERB crl-14452 22 16 the the DET crl-14452 22 17 unobtrusive unobtrusive ADJ crl-14452 22 18 method method NOUN crl-14452 22 19 in in ADP crl-14452 22 20 roughly roughly ADV crl-14452 22 21 the the DET crl-14452 22 22 same same ADJ crl-14452 22 23 way way NOUN crl-14452 22 24 as as ADP crl-14452 22 25 the the DET crl-14452 22 26 original original ADJ crl-14452 22 27 investigators investigator NOUN crl-14452 22 28 . . PUNCT crl-14452 23 1 4 4 X crl-14452 23 2 . . PUNCT crl-14452 24 1 typically typically ADV crl-14452 24 2 , , PUNCT crl-14452 24 3 unobtrusive unobtrusive ADJ crl-14452 24 4 studies study NOUN crl-14452 24 5 use use VERB crl-14452 24 6 the the DET crl-14452 24 7 correct correct ADJ crl-14452 24 8 answer answer NOUN crl-14452 24 9 fill fill NOUN crl-14452 24 10 rate rate NOUN crl-14452 24 11 , , PUNCT crl-14452 24 12 that that PRON crl-14452 24 13 is be AUX crl-14452 24 14 to to PART crl-14452 24 15 say say VERB crl-14452 24 16 , , PUNCT crl-14452 24 17 the the DET crl-14452 24 18 proportion proportion NOUN crl-14452 24 19 of of ADP crl-14452 24 20 correct correct ADJ crl-14452 24 21 answers answer NOUN crl-14452 24 22 to to ADP crl-14452 24 23 questions question NOUN crl-14452 24 24 , , PUNCT crl-14452 24 25 as as ADP crl-14452 24 26 the the DET crl-14452 24 27 measure measure NOUN crl-14452 24 28 of of ADP crl-14452 24 29 reference reference NOUN crl-14452 24 30 performance performance NOUN crl-14452 24 31 . . PUNCT crl-14452 25 1 in in ADP crl-14452 25 2 their their PRON crl-14452 25 3 recent recent ADJ crl-14452 25 4 study study NOUN crl-14452 25 5 of of ADP crl-14452 25 6 government government NOUN crl-14452 25 7 documents document NOUN crl-14452 25 8 reference reference NOUN crl-14452 25 9 service service NOUN crl-14452 25 10 , , PUNCT crl-14452 25 11 hernon hernon NOUN crl-14452 25 12 and and CCONJ crl-14452 25 13 mcclure mcclure NOUN crl-14452 25 14 employed employ VERB crl-14452 25 15 the the DET crl-14452 25 16 two two NUM crl-14452 25 17 types type NOUN crl-14452 25 18 of of ADP crl-14452 25 19 test test NOUN crl-14452 25 20 questions question NOUN crl-14452 25 21 most most ADV crl-14452 25 22 commonly commonly ADV crl-14452 25 23 used use VERB crl-14452 25 24 in in ADP crl-14452 25 25 unobtrusive unobtrusive ADJ crl-14452 25 26 studies study NOUN crl-14452 25 27 : : PUNCT crl-14452 25 28 factual factual ADJ crl-14452 25 29 , , PUNCT crl-14452 25 30 e.g. e.g. ADV crl-14452 25 31 , , PUNCT crl-14452 25 32 requests request NOUN crl-14452 25 33 for for ADP crl-14452 25 34 the the DET crl-14452 25 35 name name NOUN crl-14452 25 36 of of ADP crl-14452 25 37 an an DET crl-14452 25 38 individual individual NOUN crl-14452 25 39 or or CCONJ crl-14452 25 40 for for ADP crl-14452 25 41 specific specific ADJ crl-14452 25 42 statistical statistical ADJ crl-14452 25 43 or or CCONJ crl-14452 25 44 descriptive descriptive ADJ crl-14452 25 45 information information NOUN crl-14452 25 46 ; ; PUNCT crl-14452 25 47 and and CCONJ crl-14452 25 48 bibliographic bibliographic ADJ crl-14452 25 49 , , PUNCT crl-14452 25 50 e.g. e.g. ADV crl-14452 25 51 , , PUNCT crl-14452 25 52 requests request NOUN crl-14452 25 53 for for ADP crl-14452 25 54 bibliographic bibliographic ADJ crl-14452 25 55 citations citation NOUN crl-14452 25 56 , , PUNCT crl-14452 25 57 information information NOUN crl-14452 25 58 on on ADP crl-14452 25 59 . . PUNCT crl-14452 26 1 the the DET crl-14452 26 2 availability availability NOUN crl-14452 26 3 of of ADP crl-14452 26 4 a a DET crl-14452 26 5 publication publication NOUN crl-14452 26 6 in in ADP crl-14452 26 7 the the DET crl-14452 26 8 library library NOUN crl-14452 26 9 or or CCONJ crl-14452 26 10 through through ADP crl-14452 26 11 the the DET crl-14452 26 12 government government NOUN crl-14452 26 13 publications publication NOUN crl-14452 26 14 sales sale NOUN crl-14452 26 15 program program NOUN crl-14452 26 16 , , PUNCT crl-14452 26 17 or or CCONJ crl-14452 26 18 information information NOUN crl-14452 26 19 on on ADP crl-14452 26 20 obtaining obtain VERB crl-14452 26 21 a a DET crl-14452 26 22 superintendent superintendent NOUN crl-14452 26 23 of of ADP crl-14452 26 24 documents document NOUN crl-14452 26 25 classification classification NOUN crl-14452 26 26 number number NOUN crl-14452 26 27 . . PUNCT crl-14452 27 1 5 5 NUM crl-14452 27 2 they they PRON crl-14452 27 3 report report VERB crl-14452 27 4 that that SCONJ crl-14452 27 5 the the DET crl-14452 27 6 most most ADV crl-14452 27 7 frequent frequent ADJ crl-14452 27 8 reasons reason NOUN crl-14452 27 9 for for ADP crl-14452 27 10 incorrect incorrect ADJ crl-14452 27 11 answers answer NOUN crl-14452 27 12 are be AUX crl-14452 27 13 that that SCONJ crl-14452 27 14 the the DET crl-14452 27 15 library library NOUN crl-14452 27 16 staff staff NOUN crl-14452 27 17 member member NOUN crl-14452 27 18 gave give VERB crl-14452 27 19 wrong wrong ADJ crl-14452 27 20 data datum NOUN crl-14452 27 21 ( ( PUNCT crl-14452 27 22 96 96 NUM crl-14452 27 23 cases case NOUN crl-14452 27 24 or or CCONJ crl-14452 27 25 64.4 64.4 NUM crl-14452 27 26 percent percent NOUN crl-14452 27 27 ) ) PUNCT crl-14452 27 28 , , PUNCT crl-14452 27 29 responded respond VERB crl-14452 27 30 " " PUNCT crl-14452 27 31 do do AUX crl-14452 27 32 n't not PART crl-14452 27 33 know know VERB crl-14452 27 34 " " PUNCT crl-14452 27 35 without without ADP crl-14452 27 36 referral referral NOUN crl-14452 27 37 ( ( PUNCT crl-14452 27 38 30 30 NUM crl-14452 27 39 cases case NOUN crl-14452 27 40 or or CCONJ crl-14452 27 41 20.1 20.1 NUM crl-14452 27 42 percent percent NOUN crl-14452 27 43 ) ) PUNCT crl-14452 27 44 or or CCONJ crl-14452 27 45 incorrectly incorrectly ADV crl-14452 27 46 claimed claim VERB crl-14452 27 47 that that SCONJ crl-14452 27 48 the the DET crl-14452 27 49 library library NOUN crl-14452 27 50 did do AUX crl-14452 27 51 not not PART crl-14452 27 52 own own VERB crl-14452 27 53 a a DET crl-14452 27 54 source source NOUN crl-14452 27 55 ( ( PUNCT crl-14452 27 56 23 23 NUM crl-14452 27 57 cases case NOUN crl-14452 27 58 or or CCONJ crl-14452 27 59 15.4 15.4 NUM crl-14452 27 60 percent percent NOUN crl-14452 27 61 ) ) PUNCT crl-14452 27 62 . . PUNCT crl-14452 28 1 6 6 NUM crl-14452 28 2 obtrusive obtrusive ADJ crl-14452 28 3 study study NOUN crl-14452 28 4 this this DET crl-14452 28 5 obtrusive obtrusive ADJ crl-14452 28 6 study study NOUN crl-14452 28 7 includes include VERB crl-14452 28 8 397 397 NUM crl-14452 28 9 reference reference NOUN crl-14452 28 10 transactions transaction NOUN crl-14452 28 11 in in ADP crl-14452 28 12 five five NUM crl-14452 28 13 academic academic ADJ crl-14452 28 14 libraries library NOUN crl-14452 28 15 in in ADP crl-14452 28 16 northern northern ADJ crl-14452 28 17 california california PROPN crl-14452 28 18 . . PUNCT crl-14452 29 1 librarians librarians PROPN crl-14452 29 2 asked ask VERB crl-14452 29 3 users user NOUN crl-14452 29 4 to to PART crl-14452 29 5 complete complete VERB crl-14452 29 6 a a DET crl-14452 29 7 questionnaire questionnaire NOUN crl-14452 29 8 for for ADP crl-14452 29 9 every every DET crl-14452 29 10 fifth fifth ADJ crl-14452 29 11 reference reference NOUN crl-14452 29 12 transaction transaction NOUN crl-14452 29 13 ; ; PUNCT crl-14452 29 14 librarians librarians PROPN crl-14452 29 15 also also ADV crl-14452 29 16 completed complete VERB crl-14452 29 17 a a DET crl-14452 29 18 companion companion NOUN crl-14452 29 19 questionnaire questionnaire NOUN crl-14452 29 20 for for ADP crl-14452 29 21 every every DET crl-14452 29 22 sampled sample VERB crl-14452 29 23 transaction transaction NOUN crl-14452 29 24 . . PUNCT crl-14452 30 1 matching match VERB crl-14452 30 2 questionnaires questionnaire NOUN crl-14452 30 3 were be AUX crl-14452 30 4 returned return VERB crl-14452 30 5 march march PROPN crl-14452 30 6 1989 1989 NUM crl-14452 30 7 for for ADP crl-14452 30 8 257 257 NUM crl-14452 30 9 transactions transaction NOUN crl-14452 30 10 . . PUNCT crl-14452 31 1 prior prior ADV crl-14452 31 2 to to ADP crl-14452 31 3 collecting collect VERB crl-14452 31 4 the the DET crl-14452 31 5 sample sample NOUN crl-14452 31 6 data datum NOUN crl-14452 31 7 , , PUNCT crl-14452 31 8 librarians librarian VERB crl-14452 31 9 from from ADP crl-14452 31 10 each each PRON crl-14452 31 11 of of ADP crl-14452 31 12 the the DET crl-14452 31 13 participating participate VERB crl-14452 31 14 libraries library NOUN crl-14452 31 15 met meet VERB crl-14452 31 16 with with ADP crl-14452 31 17 the the DET crl-14452 31 18 researcher researcher NOUN crl-14452 31 19 to to PART crl-14452 31 20 discuss discuss VERB crl-14452 31 21 survey survey NOUN crl-14452 31 22 procedures procedure NOUN crl-14452 31 23 . . PUNCT crl-14452 32 1 they they PRON crl-14452 32 2 were be AUX crl-14452 32 3 made make VERB crl-14452 32 4 aware aware ADJ crl-14452 32 5 of of ADP crl-14452 32 6 the the DET crl-14452 32 7 importance importance NOUN crl-14452 32 8 of of ADP crl-14452 32 9 not not PART crl-14452 32 10 biasing bias VERB crl-14452 32 11 the the DET crl-14452 32 12 survey survey NOUN crl-14452 32 13 results result NOUN crl-14452 32 14 by by ADP crl-14452 32 15 selecting select VERB crl-14452 32 16 preferred preferred ADJ crl-14452 32 17 questions question NOUN crl-14452 32 18 or or CCONJ crl-14452 32 19 treating treat VERB crl-14452 32 20 surveyed survey VERB crl-14452 32 21 users user NOUN crl-14452 32 22 differently differently ADV crl-14452 32 23 . . PUNCT crl-14452 33 1 individual individual ADJ crl-14452 33 2 librarian librarian ADJ crl-14452 33 3 confidentiality confidentiality NOUN crl-14452 33 4 was be AUX crl-14452 33 5 guaranteed guarantee VERB crl-14452 33 6 . . PUNCT crl-14452 34 1 reference reference NOUN crl-14452 34 2 departments department NOUN crl-14452 34 3 participated participate VERB crl-14452 34 4 voluntarily voluntarily ADV crl-14452 34 5 in in ADP crl-14452 34 6 the the DET crl-14452 34 7 survey survey NOUN crl-14452 34 8 because because SCONJ crl-14452 34 9 they they PRON crl-14452 34 10 wished wish VERB crl-14452 34 11 to to PART crl-14452 34 12 obtain obtain VERB crl-14452 34 13 an an DET crl-14452 34 14 accurate accurate ADJ crl-14452 34 15 picture picture NOUN crl-14452 34 16 of of ADP crl-14452 34 17 the the DET crl-14452 34 18 quality quality NOUN crl-14452 34 19 of of ADP crl-14452 34 20 their their PRON crl-14452 34 21 services service NOUN crl-14452 34 22 . . PUNCT crl-14452 35 1 the the DET crl-14452 35 2 study study NOUN crl-14452 35 3 tests test VERB crl-14452 35 4 a a DET crl-14452 35 5 model model NOUN crl-14452 35 6 of of ADP crl-14452 35 7 the the DET crl-14452 35 8 major major ADJ crl-14452 35 9 variables variable NOUN crl-14452 35 10 influencing influence VERB crl-14452 35 11 academic academic ADJ crl-14452 35 12 library library NOUN crl-14452 35 13 reference reference NOUN crl-14452 35 14 service service NOUN crl-14452 35 15 outcomes outcome NOUN crl-14452 35 16 . . PUNCT crl-14452 36 1 three three NUM crl-14452 36 2 measures measure NOUN crl-14452 36 3 of of ADP crl-14452 36 4 reference reference NOUN crl-14452 36 5 service service NOUN crl-14452 36 6 performance performance NOUN crl-14452 36 7 outcomes outcome NOUN crl-14452 36 8 were be AUX crl-14452 36 9 employed employ VERB crl-14452 36 10 : : PUNCT crl-14452 36 11 librarian librarian ADJ crl-14452 36 12 judgments judgment NOUN crl-14452 36 13 of of ADP crl-14452 36 14 the the DET crl-14452 36 15 value value NOUN crl-14452 36 16 of of ADP crl-14452 36 17 reference reference NOUN crl-14452 36 18 service service NOUN crl-14452 36 19 , , PUNCT crl-14452 36 20 user user NOUN crl-14452 36 21 judgments judgment NOUN crl-14452 36 22 of of ADP crl-14452 36 23 the the DET crl-14452 36 24 value value NOUN crl-14452 36 25 of of ADP crl-14452 36 26 reference reference NOUN crl-14452 36 27 service service NOUN crl-14452 36 28 , , PUNCT crl-14452 36 29 and and CCONJ crl-14452 36 30 user user NOUN crl-14452 36 31 success success NOUN crl-14452 36 32 or or CCONJ crl-14452 36 33 failure failure NOUN crl-14452 36 34 in in ADP crl-14452 36 35 locating locate VERB crl-14452 36 36 needed need VERB crl-14452 36 37 material material NOUN crl-14452 36 38 . . PUNCT crl-14452 37 1 independent independent ADJ crl-14452 37 2 variables variable NOUN crl-14452 37 3 used use VERB crl-14452 37 4 in in ADP crl-14452 37 5 the the DET crl-14452 37 6 study study NOUN crl-14452 37 7 included include VERB crl-14452 37 8 measures measure NOUN crl-14452 37 9 of of ADP crl-14452 37 10 task task NOUN crl-14452 37 11 uncertainty uncertainty NOUN crl-14452 37 12 , , PUNCT crl-14452 37 13 time time NOUN crl-14452 37 14 constraints constraint NOUN crl-14452 37 15 of of ADP crl-14452 37 16 users user NOUN crl-14452 37 17 and and CCONJ crl-14452 37 18 librarians librarian NOUN crl-14452 37 19 , , PUNCT crl-14452 37 20 feedback feedback NOUN crl-14452 37 21 , , PUNCT crl-14452 37 22 and and CCONJ crl-14452 37 23 type type NOUN crl-14452 37 24 of of ADP crl-14452 37 25 reference reference NOUN crl-14452 37 26 assistance assistance NOUN crl-14452 37 27 . . PUNCT crl-14452 38 1 only only ADV crl-14452 38 2 findings finding NOUN crl-14452 38 3 useful useful ADJ crl-14452 38 4 in in ADP crl-14452 38 5 evaluating evaluate VERB crl-14452 38 6 the the DET crl-14452 38 7 role role NOUN crl-14452 38 8 of of ADP crl-14452 38 9 unobtrusive unobtrusive ADJ crl-14452 38 10 studies study NOUN crl-14452 38 11 in in ADP crl-14452 38 12 reference reference NOUN crl-14452 38 13 performance performance NOUN crl-14452 38 14 are be AUX crl-14452 38 15 reported report VERB crl-14452 38 16 in in ADP crl-14452 38 17 this this DET crl-14452 38 18 paper paper NOUN crl-14452 38 19 . . PUNCT crl-14452 39 1 questions question NOUN crl-14452 39 2 from from ADP crl-14452 39 3 the the DET crl-14452 39 4 study study NOUN crl-14452 39 5 were be AUX crl-14452 39 6 classified classify VERB crl-14452 39 7 into into ADP crl-14452 39 8 three three NUM crl-14452 39 9 categories category NOUN crl-14452 39 10 : : PUNCT crl-14452 39 11 ( ( PUNCT crl-14452 39 12 1 1 X crl-14452 39 13 ) ) PUNCT crl-14452 39 14 bibliographic bibliographic ADJ crl-14452 39 15 citation citation NOUN crl-14452 39 16 for for ADP crl-14452 39 17 which which PRON crl-14452 39 18 a a DET crl-14452 39 19 correct correct ADJ crl-14452 39 20 answer answer NOUN crl-14452 39 21 could could AUX crl-14452 39 22 have have AUX crl-14452 39 23 been be AUX crl-14452 39 24 predetermined predetermine VERB crl-14452 39 25 ; ; PUNCT crl-14452 39 26 ( ( PUNCT crl-14452 39 27 2 2 X crl-14452 39 28 ) ) PUNCT crl-14452 39 29 questions question NOUN crl-14452 39 30 of of ADP crl-14452 39 31 fact fact NOUN crl-14452 39 32 for for ADP crl-14452 39 33 which which PRON crl-14452 39 34 a a DET crl-14452 39 35 correct correct ADJ crl-14452 39 36 answer answer NOUN crl-14452 39 37 could could AUX crl-14452 39 38 have have AUX crl-14452 39 39 been be AUX crl-14452 39 40 predetermined predetermine VERB crl-14452 39 41 ; ; PUNCT crl-14452 39 42 and and CCONJ crl-14452 39 43 ( ( PUNCT crl-14452 39 44 3 3 X crl-14452 39 45 ) ) PUNCT crl-14452 39 46 other other ADJ crl-14452 39 47 questions question NOUN crl-14452 39 48 , , PUNCT crl-14452 39 49 including include VERB crl-14452 39 50 narrow narrow ADJ crl-14452 39 51 and and CCONJ crl-14452 39 52 broad broad ADJ crl-14452 39 53 subject subject ADJ crl-14452 39 54 questions question NOUN crl-14452 39 55 ; ; PUNCT crl-14452 39 56 questions question NOUN crl-14452 39 57 concerning concern VERB crl-14452 39 58 evaluations evaluation NOUN crl-14452 39 59 of of ADP crl-14452 39 60 books book NOUN crl-14452 39 61 , , PUNCT crl-14452 39 62 movies movie NOUN crl-14452 39 63 , , PUNCT crl-14452 39 64 and and CCONJ crl-14452 39 65 plays play NOUN crl-14452 39 66 ; ; PUNCT crl-14452 39 67 and and CCONJ crl-14452 39 68 questions question NOUN crl-14452 39 69 on on ADP crl-14452 39 70 how how SCONJ crl-14452 39 71 to to PART crl-14452 39 72 use use VERB crl-14452 39 73 reference reference NOUN crl-14452 39 74 sources source NOUN crl-14452 39 75 . . PUNCT crl-14452 40 1 a a DET crl-14452 40 2 small small ADJ crl-14452 40 3 proportion proportion NOUN crl-14452 40 4 ( ( PUNCT crl-14452 40 5 11.3 11.3 NUM crl-14452 40 6 percent percent NOUN crl-14452 40 7 ) ) PUNCT crl-14452 40 8 of of ADP crl-14452 40 9 the the DET crl-14452 40 10 requests request NOUN crl-14452 40 11 were be AUX crl-14452 40 12 for for ADP crl-14452 40 13 specific specific ADJ crl-14452 40 14 factual factual ADJ crl-14452 40 15 information information NOUN crl-14452 40 16 and and CCONJ crl-14452 40 17 18.0 18.0 NUM crl-14452 40 18 percent percent NOUN crl-14452 40 19 were be AUX crl-14452 40 20 related relate VERB crl-14452 40 21 to to ADP crl-14452 40 22 locating locate VERB crl-14452 40 23 specific specific ADJ crl-14452 40 24 citations citation NOUN crl-14452 40 25 . . PUNCT crl-14452 41 1 the the DET crl-14452 41 2 majority majority NOUN crl-14452 41 3 ( ( PUNCT crl-14452 41 4 70.7 70.7 NUM crl-14452 41 5 percent percent NOUN crl-14452 41 6 ) ) PUNCT crl-14452 41 7 of of ADP crl-14452 41 8 the the DET crl-14452 41 9 queries query NOUN crl-14452 41 10 were be AUX crl-14452 41 11 requests request NOUN crl-14452 41 12 for for ADP crl-14452 41 13 locating locate VERB crl-14452 41 14 references reference NOUN crl-14452 41 15 on on ADP crl-14452 41 16 a a DET crl-14452 41 17 subject subject NOUN crl-14452 41 18 and/ and/ NOUN crl-14452 41 19 or or CCONJ crl-14452 41 20 assistance assistance NOUN crl-14452 41 21 in in ADP crl-14452 41 22 how how SCONJ crl-14452 41 23 to to PART crl-14452 41 24 use use VERB crl-14452 41 25 library library NOUN crl-14452 41 26 reference reference NOUN crl-14452 41 27 sources source NOUN crl-14452 41 28 ( ( PUNCT crl-14452 41 29 see see VERB crl-14452 41 30 table table NOUN crl-14452 41 31 1 1 NUM crl-14452 41 32 ) ) PUNCT crl-14452 41 33 . . PUNCT crl-14452 42 1 results result NOUN crl-14452 42 2 of of ADP crl-14452 42 3 spss spss PROPN crl-14452 42 4 cross cross PROPN crl-14452 42 5 - - NOUN crl-14452 42 6 tabulations tabulation NOUN crl-14452 42 7 for for ADP crl-14452 42 8 factual factual ADJ crl-14452 42 9 , , PUNCT crl-14452 42 10 bibliographic bibliographic ADJ crl-14452 42 11 , , PUNCT crl-14452 42 12 and and CCONJ crl-14452 42 13 subject subject ADJ crl-14452 42 14 / / SYM crl-14452 42 15 instructional instructional ADJ crl-14452 42 16 questions question NOUN crl-14452 42 17 by by ADP crl-14452 42 18 user user NOUN crl-14452 42 19 success success NOUN crl-14452 42 20 in in ADP crl-14452 42 21 locating locate VERB crl-14452 42 22 materials material NOUN crl-14452 42 23 are be AUX crl-14452 42 24 presented present VERB crl-14452 42 25 in in ADP crl-14452 42 26 table table NOUN crl-14452 42 27 2 2 NUM crl-14452 42 28 . . X crl-14452 43 1 the the DET crl-14452 43 2 chi chi PROPN crl-14452 43 3 - - PUNCT crl-14452 43 4 square square ADJ crl-14452 43 5 statistic statistic NOUN crl-14452 43 6 is be AUX crl-14452 43 7 significant significant ADJ crl-14452 43 8 , , PUNCT crl-14452 43 9 indicating indicate VERB crl-14452 43 10 that that SCONJ crl-14452 43 11 there there PRON crl-14452 43 12 is be VERB crl-14452 43 13 a a DET crl-14452 43 14 difference difference NOUN crl-14452 43 15 between between ADP crl-14452 43 16 user user NOUN crl-14452 43 17 success success NOUN crl-14452 43 18 in in ADP crl-14452 43 19 finding find VERB crl-14452 43 20 material material NOUN crl-14452 43 21 related relate VERB crl-14452 43 22 to to ADP crl-14452 43 23 factual factual ADJ crl-14452 43 24 and and CCONJ crl-14452 43 25 bibliographic bibliographic ADJ crl-14452 43 26 queries query NOUN crl-14452 43 27 versus versus ADP crl-14452 43 28 that that PRON crl-14452 43 29 for for ADP crl-14452 43 30 other other ADJ crl-14452 43 31 types type NOUN crl-14452 43 32 of of ADP crl-14452 43 33 queries query NOUN crl-14452 43 34 . . PUNCT crl-14452 44 1 for for ADP crl-14452 44 2 factual factual ADJ crl-14452 44 3 and and CCONJ crl-14452 44 4 bibliographic bibliographic ADJ crl-14452 44 5 queries query NOUN crl-14452 44 6 , , PUNCT crl-14452 44 7 greater great ADJ crl-14452 44 8 proportions proportion NOUN crl-14452 44 9 of of ADP crl-14452 44 10 users user NOUN crl-14452 44 11 either either CCONJ crl-14452 44 12 found find VERB crl-14452 44 13 what what PRON crl-14452 44 14 they they PRON crl-14452 44 15 needed need VERB crl-14452 44 16 , , PUNCT crl-14452 44 17 or or CCONJ crl-14452 44 18 nothing nothing PRON crl-14452 44 19 that that PRON crl-14452 44 20 they they PRON crl-14452 44 21 needed need VERB crl-14452 44 22 . . PUNCT crl-14452 45 1 for for ADP crl-14452 45 2 subject subject NOUN crl-14452 45 3 and and CCONJ crl-14452 45 4 instructional instructional ADJ crl-14452 45 5 queries query NOUN crl-14452 45 6 , , PUNCT crl-14452 45 7 a a DET crl-14452 45 8 much much ADV crl-14452 45 9 greater great ADJ crl-14452 45 10 proportion proportion NOUN crl-14452 45 11 of of ADP crl-14452 45 12 users user NOUN crl-14452 45 13 found find VERB crl-14452 45 14 some some PRON crl-14452 45 15 but but CCONJ crl-14452 45 16 not not PART crl-14452 45 17 all all PRON crl-14452 45 18 needed need VERB crl-14452 45 19 material material NOUN crl-14452 45 20 . . PUNCT crl-14452 46 1 type type PROPN crl-14452 46 2 tablet tablet PROPN crl-14452 46 3 type type NOUN crl-14452 46 4 of of ADP crl-14452 46 5 question question NOUN crl-14452 46 6 number number NOUN crl-14452 46 7 factual factual ADJ crl-14452 46 8 bibliographic bibliographic ADJ crl-14452 46 9 subject subject NOUN crl-14452 46 10 / / SYM crl-14452 46 11 fustructional fustructional ADJ crl-14452 46 12 29 29 NUM crl-14452 46 13 46 46 NUM crl-14452 46 14 181 181 NUM crl-14452 46 15 256 256 NUM crl-14452 46 16 missing miss VERB crl-14452 46 17 ( ( PUNCT crl-14452 46 18 1 1 NUM crl-14452 46 19 ) ) PUNCT crl-14452 46 20 table2 table2 NOUN crl-14452 46 21 type type NOUN crl-14452 46 22 of of ADP crl-14452 46 23 question question NOUN crl-14452 46 24 and and CCONJ crl-14452 46 25 user user NOUN crl-14452 46 26 success success NOUN crl-14452 46 27 in in ADP crl-14452 46 28 finding find VERB crl-14452 46 29 needed need VERB crl-14452 46 30 material material NOUN crl-14452 46 31 percent percent NOUN crl-14452 46 32 11.3 11.3 NUM crl-14452 46 33 18.0 18.0 NUM crl-14452 46 34 70.7 70.7 NUM crl-14452 46 35 100.0 100.0 NUM crl-14452 46 36 materials material NOUN crl-14452 46 37 available available ADJ crl-14452 46 38 fact fact NOUN crl-14452 46 39 . . PUNCT crl-14452 47 1 question question NOUN crl-14452 47 2 type type NOUN crl-14452 47 3 bibl bibl NOUN crl-14452 47 4 . . PUNCT crl-14452 48 1 subj./instr subj./instr PROPN crl-14452 48 2 . . PUNCT crl-14452 49 1 yes yes INTJ crl-14452 49 2 some some DET crl-14452 49 3 none none NOUN crl-14452 49 4 78.6 78.6 NUM crl-14452 49 5 % % NOUN crl-14452 49 6 10.7 10.7 NUM crl-14452 49 7 10.7 10.7 NUM crl-14452 49 8 100.0 100.0 NUM crl-14452 49 9 % % NOUN crl-14452 49 10 ( ( PUNCT crl-14452 49 11 28 28 NUM crl-14452 49 12 ) ) PUNCT crl-14452 49 13 missing miss VERB crl-14452 49 14 ( ( PUNCT crl-14452 49 15 14 14 NUM crl-14452 49 16 ) ) PUNCT crl-14452 49 17 x2 x2 PROPN crl-14452 49 18 16.87 16.87 NUM crl-14452 49 19 , , PUNCT crl-14452 49 20 df df PROPN crl-14452 49 21 4 4 NUM crl-14452 49 22 , , PUNCT crl-14452 49 23 p p NOUN crl-14452 49 24 .0021 .0021 PUNCT crl-14452 50 1 70.5 70.5 NUM crl-14452 50 2 % % NOUN crl-14452 50 3 62.6 62.6 NUM crl-14452 50 4 % % NOUN crl-14452 50 5 13.6 13.6 NUM crl-14452 50 6 33.3 33.3 NUM crl-14452 50 7 15.9 15.9 NUM crl-14452 50 8 4.1 4.1 NUM crl-14452 50 9 100.0 100.0 NUM crl-14452 50 10 % % NOUN crl-14452 50 11 ( ( PUNCT crl-14452 50 12 44 44 NUM crl-14452 50 13 ) ) PUNCT crl-14452 50 14 100.0 100.0 NUM crl-14452 50 15 % % NOUN crl-14452 50 16 ( ( PUNCT crl-14452 50 17 171 171 NUM crl-14452 50 18 ) ) PUNCT crl-14452 50 19 these these DET crl-14452 50 20 results result NOUN crl-14452 50 21 are be AUX crl-14452 50 22 not not PART crl-14452 50 23 always always ADV crl-14452 50 24 directly directly ADV crl-14452 50 25 comparable comparable ADJ crl-14452 50 26 to to PART crl-14452 50 27 unobtrusive unobtrusive VERB crl-14452 50 28 findings finding NOUN crl-14452 50 29 because because SCONJ crl-14452 50 30 in in ADP crl-14452 50 31 this this DET crl-14452 50 32 study study NOUN crl-14452 50 33 some some PRON crl-14452 50 34 of of ADP crl-14452 50 35 the the DET crl-14452 50 36 material material NOUN crl-14452 50 37 needed need VERB crl-14452 50 38 to to PART crl-14452 50 39 satisfy satisfy VERB crl-14452 50 40 factual factual ADJ crl-14452 50 41 and and CCONJ crl-14452 50 42 bibliographic bibliographic ADJ crl-14452 50 43 queries query NOUN crl-14452 50 44 was be AUX crl-14452 50 45 not not PART crl-14452 50 46 located locate VERB crl-14452 50 47 because because SCONJ crl-14452 50 48 of of ADP crl-14452 50 49 circulation circulation NOUN crl-14452 50 50 and and CCONJ crl-14452 50 51 collection collection NOUN crl-14452 50 52 development development NOUN crl-14452 50 53 problems problem NOUN crl-14452 50 54 . . PUNCT crl-14452 51 1 in in ADP crl-14452 51 2 many many ADJ crl-14452 51 3 unobtrusive unobtrusive ADJ crl-14452 51 4 studies study NOUN crl-14452 51 5 problems problem NOUN crl-14452 51 6 with with ADP crl-14452 51 7 collection collection NOUN crl-14452 51 8 development development NOUN crl-14452 51 9 and and CCONJ crl-14452 51 10 circulation circulation NOUN crl-14452 51 11 failures failure NOUN crl-14452 51 12 are be AUX crl-14452 51 13 fairly fairly ADV crl-14452 51 14 well well ADV crl-14452 51 15 controlled control VERB crl-14452 51 16 through through ADP crl-14452 51 17 preselection preselection NOUN crl-14452 51 18 of of ADP crl-14452 51 19 standard standard ADJ crl-14452 51 20 reference reference NOUN crl-14452 51 21 works work NOUN crl-14452 51 22 that that PRON crl-14452 51 23 are be AUX crl-14452 51 24 likely likely ADJ crl-14452 51 25 to to PART crl-14452 51 26 be be AUX crl-14452 51 27 in in ADP crl-14452 51 28 the the DET crl-14452 51 29 library library NOUN crl-14452 51 30 at at ADP crl-14452 51 31 all all DET crl-14452 51 32 times time NOUN crl-14452 51 33 . . PUNCT crl-14452 52 1 assumptions assumption NOUN crl-14452 52 2 accurate accurate ADJ crl-14452 52 3 fact fact NOUN crl-14452 52 4 provision provision NOUN crl-14452 52 5 as as ADP crl-14452 52 6 a a DET crl-14452 52 7 key key ADJ crl-14452 52 8 indicator indicator NOUN crl-14452 52 9 of of ADP crl-14452 52 10 reference reference NOUN crl-14452 52 11 performance performance NOUN crl-14452 52 12 the the DET crl-14452 52 13 first first ADJ crl-14452 52 14 assumption assumption NOUN crl-14452 52 15 is be AUX crl-14452 52 16 that that SCONJ crl-14452 52 17 correct correct ADJ crl-14452 52 18 answer answer NOUN crl-14452 52 19 fill fill NOUN crl-14452 52 20 rate rate NOUN crl-14452 52 21 is be AUX crl-14452 52 22 a a DET crl-14452 52 23 key key ADJ crl-14452 52 24 measure measure NOUN crl-14452 52 25 of of ADP crl-14452 52 26 reference reference NOUN crl-14452 52 27 service service NOUN crl-14452 52 28 effectiveness effectiveness NOUN crl-14452 52 29 . . PUNCT crl-14452 53 1 7 7 NUM crl-14452 53 2 hernon hernon NOUN crl-14452 53 3 and and CCONJ crl-14452 53 4 mcclure mcclure NOUN crl-14452 53 5 have have AUX crl-14452 53 6 carefully carefully ADV crl-14452 53 7 considered consider VERB crl-14452 53 8 some some DET crl-14452 53 9 important important ADJ crl-14452 53 10 aspects aspect NOUN crl-14452 53 11 of of ADP crl-14452 53 12 the the DET crl-14452 53 13 validity validity NOUN crl-14452 53 14 of of ADP crl-14452 53 15 the the DET crl-14452 53 16 test test NOUN crl-14452 53 17 unobbusive unobbusive ADJ crl-14452 53 18 studies study NOUN crl-14452 53 19 183 183 NUM crl-14452 53 20 questions question NOUN crl-14452 53 21 and and CCONJ crl-14452 53 22 measures measure NOUN crl-14452 53 23 of of ADP crl-14452 53 24 accuracy accuracy NOUN crl-14452 53 25 such such ADJ crl-14452 53 26 as as ADP crl-14452 53 27 face face NOUN crl-14452 53 28 , , PUNCT crl-14452 53 29 internal internal ADJ crl-14452 53 30 , , PUNCT crl-14452 53 31 external external ADJ crl-14452 53 32 , , PUNCT crl-14452 53 33 and and CCONJ crl-14452 53 34 construct construct VERB crl-14452 53 35 validity validity NOUN crl-14452 53 36 . . PUNCT crl-14452 54 1 their their PRON crl-14452 54 2 questions question NOUN crl-14452 54 3 were be AUX crl-14452 54 4 judged judge VERB crl-14452 54 5 by by ADP crl-14452 54 6 librarians librarian NOUN crl-14452 54 7 and and CCONJ crl-14452 54 8 researchers researcher NOUN crl-14452 54 9 as as ADP crl-14452 54 10 representative representative NOUN crl-14452 54 11 of of ADP crl-14452 54 12 typical typical ADJ crl-14452 54 13 questions question NOUN crl-14452 54 14 encountered encounter VERB crl-14452 54 15 at at ADP crl-14452 54 16 the the DET crl-14452 54 17 documents document NOUN crl-14452 54 18 and and CCONJ crl-14452 54 19 general general ADJ crl-14452 54 20 reference reference NOUN crl-14452 54 21 desk desk NOUN crl-14452 54 22 . . PUNCT crl-14452 55 1 8 8 NUM crl-14452 55 2 however however ADV crl-14452 55 3 , , PUNCT crl-14452 55 4 there there PRON crl-14452 55 5 has have AUX crl-14452 55 6 been be AUX crl-14452 55 7 little little ADJ crl-14452 55 8 discussion discussion NOUN crl-14452 55 9 of of ADP crl-14452 55 10 content content NOUN crl-14452 55 11 validity validity NOUN crl-14452 55 12 . . PUNCT crl-14452 56 1 content content NOUN crl-14452 56 2 validity validity NOUN crl-14452 56 3 is be AUX crl-14452 56 4 related relate VERB crl-14452 56 5 to to ADP crl-14452 56 6 the the DET crl-14452 56 7 adequacy adequacy NOUN crl-14452 56 8 with with ADP crl-14452 56 9 which which PRON crl-14452 56 10 important important ADJ crl-14452 56 11 content content NOUN crl-14452 56 12 has have AUX crl-14452 56 13 been be AUX crl-14452 56 14 sampled sample VERB crl-14452 56 15 and and CCONJ crl-14452 56 16 the the DET crl-14452 56 17 adequacy adequacy NOUN crl-14452 56 18 with with ADP crl-14452 56 19 which which PRON crl-14452 56 20 the the DET crl-14452 56 21 content content NOUN crl-14452 56 22 has have AUX crl-14452 56 23 been be AUX crl-14452 56 24 cast cast VERB crl-14452 56 25 in in ADP crl-14452 56 26 the the DET crl-14452 56 27 form form NOUN crl-14452 56 28 of of ADP crl-14452 56 29 test test NOUN crl-14452 56 30 items item NOUN crl-14452 56 31 . . PUNCT crl-14452 57 1 9 9 NUM crl-14452 57 2 therefore therefore ADV crl-14452 57 3 if if SCONJ crl-14452 57 4 we we PRON crl-14452 57 5 are be AUX crl-14452 57 6 really really ADV crl-14452 57 7 interested interested ADJ crl-14452 57 8 in in ADP crl-14452 57 9 measuring measure VERB crl-14452 57 10 the the DET crl-14452 57 11 performance performance NOUN crl-14452 57 12 of of ADP crl-14452 57 13 reference reference NOUN crl-14452 57 14 desk desk NOUN crl-14452 57 15 service service NOUN crl-14452 57 16 we we PRON crl-14452 57 17 must must AUX crl-14452 57 18 ask ask VERB crl-14452 57 19 how how SCONJ crl-14452 57 20 well well ADV crl-14452 57 21 a a DET crl-14452 57 22 test test NOUN crl-14452 57 23 represents represent VERB crl-14452 57 24 the the DET crl-14452 57 25 main main ADJ crl-14452 57 26 body body NOUN crl-14452 57 27 of of ADP crl-14452 57 28 reference reference NOUN crl-14452 57 29 questions question NOUN crl-14452 57 30 . . PUNCT crl-14452 58 1 childers childer NOUN crl-14452 58 2 roughly roughly ADV crl-14452 58 3 estimates estimate VERB crl-14452 58 4 that that SCONJ crl-14452 58 5 the the DET crl-14452 58 6 kind kind NOUN crl-14452 58 7 of of ADP crl-14452 58 8 query query NOUN crl-14452 58 9 that that PRON crl-14452 58 10 has have AUX crl-14452 58 11 been be AUX crl-14452 58 12 addressed address VERB crl-14452 58 13 through through ADP crl-14452 58 14 unobtrusive unobtrusive ADJ crl-14452 58 15 testing testing NOUN crl-14452 58 16 to to ADP crl-14452 58 17 date date NOUN crl-14452 58 18 may may AUX crl-14452 58 19 represent represent VERB crl-14452 58 20 about about ADP crl-14452 58 21 one one NUM crl-14452 58 22 - - PUNCT crl-14452 58 23 eighth eighth NOUN crl-14452 58 24 of of ADP crl-14452 58 25 the the DET crl-14452 58 26 range range NOUN crl-14452 58 27 of of ADP crl-14452 58 28 reference reference NOUN crl-14452 58 29 questions question NOUN crl-14452 58 30 asked ask VERB crl-14452 58 31 . . PUNCT crl-14452 59 1 1 1 NUM crl-14452 59 2 ° ° SPACE crl-14452 59 3 childers childer NOUN crl-14452 59 4 suggests suggest VERB crl-14452 59 5 that that SCONJ crl-14452 59 6 research research NOUN crl-14452 59 7 findings finding NOUN crl-14452 59 8 on on ADP crl-14452 59 9 part part NOUN crl-14452 59 10 of of ADP crl-14452 59 11 the the DET crl-14452 59 12 process process NOUN crl-14452 59 13 are be AUX crl-14452 59 14 being be AUX crl-14452 59 15 taken take VERB crl-14452 59 16 to to PART crl-14452 59 17 represent represent VERB crl-14452 59 18 the the DET crl-14452 59 19 whole whole NOUN crl-14452 59 20 . . PUNCT crl-14452 60 1 the the DET crl-14452 60 2 query query NOUN crl-14452 60 3 with with ADP crl-14452 60 4 a a DET crl-14452 60 5 short short ADJ crl-14452 60 6 , , PUNCT crl-14452 60 7 factual factual ADJ crl-14452 60 8 , , PUNCT crl-14452 60 9 unambiguous unambiguous ADJ crl-14452 60 10 answer answer NOUN crl-14452 60 11 has have AUX crl-14452 60 12 attracted attract VERB crl-14452 60 13 almost almost ADV crl-14452 60 14 all all PRON crl-14452 60 15 of of ADP crl-14452 60 16 the the DET crl-14452 60 17 field field NOUN crl-14452 60 18 's 's PART crl-14452 60 19 attention attention NOUN crl-14452 60 20 . . PUNCT crl-14452 61 1 the the DET crl-14452 61 2 problem problem NOUN crl-14452 61 3 with with ADP crl-14452 61 4 investigating investigate VERB crl-14452 61 5 such such ADJ crl-14452 61 6 queries query NOUN crl-14452 61 7 is be AUX crl-14452 61 8 that that SCONJ crl-14452 61 9 in in ADP crl-14452 61 10 the the DET crl-14452 61 11 minds mind NOUN crl-14452 61 12 of of ADP crl-14452 61 13 many many ADJ crl-14452 61 14 of of ADP crl-14452 61 15 those those PRON crl-14452 61 16 interested interested ADJ crl-14452 61 17 in in ADP crl-14452 61 18 evaluating evaluate VERB crl-14452 61 19 reference reference NOUN crl-14452 61 20 performance performance NOUN crl-14452 61 21 , , PUNCT crl-14452 61 22 findings finding NOUN crl-14452 61 23 from from ADP crl-14452 61 24 unobtrusive unobtrusive ADJ crl-14452 61 25 studies study NOUN crl-14452 61 26 assume assume VERB crl-14452 61 27 unrealistic unrealistic ADJ crl-14452 61 28 proportions proportion NOUN crl-14452 61 29 and and CCONJ crl-14452 61 30 come come VERB crl-14452 61 31 to to PART crl-14452 61 32 represent represent VERB crl-14452 61 33 the the DET crl-14452 61 34 whole whole NOUN crl-14452 61 35 of of ADP crl-14452 61 36 the the DET crl-14452 61 37 reference reference NOUN crl-14452 61 38 function function NOUN crl-14452 61 39 . . PUNCT crl-14452 62 1 however however ADV crl-14452 62 2 , , PUNCT crl-14452 62 3 there there PRON crl-14452 62 4 is be VERB crl-14452 62 5 no no DET crl-14452 62 6 empirical empirical ADJ crl-14452 62 7 literature literature NOUN crl-14452 62 8 that that PRON crl-14452 62 9 links link VERB crl-14452 62 10 performance performance NOUN crl-14452 62 11 of of ADP crl-14452 62 12 one one NUM crl-14452 62 13 kind kind NOUN crl-14452 62 14 of of ADP crl-14452 62 15 reference reference NOUN crl-14452 62 16 service service NOUN crl-14452 62 17 to to ADP crl-14452 62 18 performance performance NOUN crl-14452 62 19 of of ADP crl-14452 62 20 another another DET crl-14452 62 21 kind kind NOUN crl-14452 62 22 . . PUNCT crl-14452 63 1 11 11 X crl-14452 63 2 . . PUNCT crl-14452 64 1 evelyn evelyn VERB crl-14452 64 2 daniel daniel PROPN crl-14452 64 3 observes observe VERB crl-14452 64 4 that that SCONJ crl-14452 64 5 traditionally traditionally ADV crl-14452 64 6 fact fact NOUN crl-14452 64 7 provision provision NOUN crl-14452 64 8 has have AUX crl-14452 64 9 not not PART crl-14452 64 10 been be AUX crl-14452 64 11 a a DET crl-14452 64 12 major major ADJ crl-14452 64 13 service service NOUN crl-14452 64 14 of of ADP crl-14452 64 15 the the DET crl-14452 64 16 library library NOUN crl-14452 64 17 . . PUNCT crl-14452 65 1 it it PRON crl-14452 65 2 became become VERB crl-14452 65 3 a a DET crl-14452 65 4 convenient convenient ADJ crl-14452 65 5 afterthought afterthought NOUN crl-14452 65 6 to to ADP crl-14452 65 7 the the DET crl-14452 65 8 referral referral NOUN crl-14452 65 9 and and CCONJ crl-14452 65 10 provision provision NOUN crl-14452 65 11 of of ADP crl-14452 65 12 bibliographic bibliographic ADJ crl-14452 65 13 information information NOUN crl-14452 65 14 . . PUNCT crl-14452 66 1 12 12 NUM crl-14452 66 2 duane duane PROPN crl-14452 66 3 webster webster PROPN crl-14452 66 4 suggests suggest VERB crl-14452 66 5 that that SCONJ crl-14452 66 6 accuracy accuracy NOUN crl-14452 66 7 may may AUX crl-14452 66 8 not not PART crl-14452 66 9 be be AUX crl-14452 66 10 a a DET crl-14452 66 11 key key ADJ crl-14452 66 12 indicator indicator NOUN crl-14452 66 13 of of ADP crl-14452 66 14 the the DET crl-14452 66 15 overall overall ADJ crl-14452 66 16 quality quality NOUN crl-14452 66 17 of of ADP crl-14452 66 18 reference reference NOUN crl-14452 66 19 services service NOUN crl-14452 66 20 ; ; PUNCT crl-14452 66 21 users user NOUN crl-14452 66 22 often often ADV crl-14452 66 23 seem seem VERB crl-14452 66 24 to to PART crl-14452 66 25 value value VERB crl-14452 66 26 convenience convenience NOUN crl-14452 66 27 and and CCONJ crl-14452 66 28 timeliness timeliness NOUN crl-14452 66 29 of of ADP crl-14452 66 30 information information NOUN crl-14452 66 31 more more ADJ crl-14452 66 32 than than ADP crl-14452 66 33 accuracy accuracy NOUN crl-14452 66 34 . . PUNCT crl-14452 67 1 13 13 NUM crl-14452 67 2 the the DET crl-14452 67 3 findings finding NOUN crl-14452 67 4 of of ADP crl-14452 67 5 the the DET crl-14452 67 6 current current ADJ crl-14452 67 7 study study NOUN crl-14452 67 8 support support VERB crl-14452 67 9 these these DET crl-14452 67 10 observations observation NOUN crl-14452 67 11 and and CCONJ crl-14452 67 12 provide provide VERB crl-14452 67 13 evidence evidence NOUN crl-14452 67 14 that that SCONJ crl-14452 67 15 requests request VERB crl-14452 67 16 for for ADP crl-14452 67 17 specific specific ADJ crl-14452 67 18 factual factual ADJ crl-14452 67 19 information information NOUN crl-14452 67 20 represent represent VERB crl-14452 67 21 a a DET crl-14452 67 22 minority minority NOUN crl-14452 67 23 of of ADP crl-14452 67 24 reference reference NOUN crl-14452 67 25 queries query NOUN crl-14452 67 26 in in ADP crl-14452 67 27 academic academic ADJ crl-14452 67 28 libraries library NOUN crl-14452 67 29 . . PUNCT crl-14452 68 1 this this DET crl-14452 68 2 study study NOUN crl-14452 68 3 indicates indicate VERB crl-14452 68 4 that that SCONJ crl-14452 68 5 the the DET crl-14452 68 6 majority majority NOUN crl-14452 68 7 of of ADP crl-14452 68 8 queries query NOUN crl-14452 68 9 are be AUX crl-14452 68 10 related relate VERB crl-14452 68 11 to to ADP crl-14452 68 12 broad broad ADJ crl-14452 68 13 and and CCONJ crl-14452 68 14 narrow narrow ADJ crl-14452 68 15 subjects subject NOUN crl-14452 68 16 or or CCONJ crl-14452 68 17 involve involve VERB crl-14452 68 18 requests request NOUN crl-14452 68 19 for for ADP crl-14452 68 20 instruction instruction NOUN crl-14452 68 21 in in ADP crl-14452 68 22 the the DET crl-14452 68 23 use use NOUN crl-14452 68 24 of of ADP crl-14452 68 25 184 184 NUM crl-14452 68 26 college college PROPN crl-14452 68 27 & & CCONJ crl-14452 68 28 research research PROPN crl-14452 68 29 libraries librarie VERB crl-14452 68 30 library library NOUN crl-14452 68 31 reference reference NOUN crl-14452 68 32 materials material NOUN crl-14452 68 33 ( ( PUNCT crl-14452 68 34 see see VERB crl-14452 68 35 table table NOUN crl-14452 68 36 1 1 NUM crl-14452 68 37 ) ) PUNCT crl-14452 68 38 . . PUNCT crl-14452 69 1 with with ADP crl-14452 69 2 such such DET crl-14452 69 3 a a DET crl-14452 69 4 relatively relatively ADV crl-14452 69 5 small small ADJ crl-14452 69 6 percentage percentage NOUN crl-14452 69 7 of of ADP crl-14452 69 8 factual factual ADJ crl-14452 69 9 queries query NOUN crl-14452 69 10 , , PUNCT crl-14452 69 11 librarians librarian NOUN crl-14452 69 12 get get VERB crl-14452 69 13 little little ADJ crl-14452 69 14 opportunity opportunity NOUN crl-14452 69 15 to to PART crl-14452 69 16 develop develop VERB crl-14452 69 17 on on ADP crl-14452 69 18 - - PUNCT crl-14452 69 19 the the DET crl-14452 69 20 - - PUNCT crl-14452 69 21 job job NOUN crl-14452 69 22 expertise expertise NOUN crl-14452 69 23 using use VERB crl-14452 69 24 a a DET crl-14452 69 25 broad broad ADJ crl-14452 69 26 range range NOUN crl-14452 69 27 of of ADP crl-14452 69 28 tools tool NOUN crl-14452 69 29 to to PART crl-14452 69 30 answer answer VERB crl-14452 69 31 requests request NOUN crl-14452 69 32 for for ADP crl-14452 69 33 specific specific ADJ crl-14452 69 34 factual factual ADJ crl-14452 69 35 information information NOUN crl-14452 69 36 . . PUNCT crl-14452 70 1 some some DET crl-14452 70 2 factual factual ADJ crl-14452 70 3 queries query NOUN crl-14452 70 4 may may AUX crl-14452 70 5 represent represent VERB crl-14452 70 6 more more ADV crl-14452 70 7 difficult difficult ADJ crl-14452 70 8 problems problem NOUN crl-14452 70 9 for for ADP crl-14452 70 10 librarians librarian NOUN crl-14452 70 11 than than ADP crl-14452 70 12 subject subject ADJ crl-14452 70 13 queries query NOUN crl-14452 70 14 in in ADP crl-14452 70 15 locating locate VERB crl-14452 70 16 useful useful ADJ crl-14452 70 17 information information NOUN crl-14452 70 18 . . PUNCT crl-14452 71 1 success success NOUN crl-14452 71 2 rates rate NOUN crl-14452 71 3 for for ADP crl-14452 71 4 factual factual ADJ crl-14452 71 5 queries query NOUN crl-14452 71 6 appear appear VERB crl-14452 71 7 to to PART crl-14452 71 8 fall fall VERB crl-14452 71 9 more more ADV crl-14452 71 10 frequently frequently ADV crl-14452 71 11 into into ADP crl-14452 71 12 the the DET crl-14452 71 13 categories category NOUN crl-14452 71 14 of of ADP crl-14452 71 15 total total ADJ crl-14452 71 16 success success NOUN crl-14452 71 17 or or CCONJ crl-14452 71 18 total total ADJ crl-14452 71 19 failure failure NOUN crl-14452 71 20 ( ( PUNCT crl-14452 71 21 see see VERB crl-14452 71 22 table table NOUN crl-14452 71 23 2 2 NUM crl-14452 71 24 ) ) PUNCT crl-14452 71 25 . . PUNCT crl-14452 72 1 total total ADJ crl-14452 72 2 failure failure NOUN crl-14452 72 3 rates rate NOUN crl-14452 72 4 for for ADP crl-14452 72 5 factual factual ADJ crl-14452 72 6 queries query NOUN crl-14452 72 7 may may AUX crl-14452 72 8 be be AUX crl-14452 72 9 higher high ADJ crl-14452 72 10 because because SCONJ crl-14452 72 11 of of ADP crl-14452 72 12 the the DET crl-14452 72 13 design design NOUN crl-14452 72 14 of of ADP crl-14452 72 15 bibliographic bibliographic ADJ crl-14452 72 16 access access NOUN crl-14452 72 17 systems system NOUN crl-14452 72 18 . . PUNCT crl-14452 73 1 library library PROPN crl-14452 73 2 bibliographic bibliographic PROPN crl-14452 73 3 access access NOUN crl-14452 73 4 systems system NOUN crl-14452 73 5 tend tend VERB crl-14452 73 6 to to PART crl-14452 73 7 be be AUX crl-14452 73 8 designed design VERB crl-14452 73 9 to to PART crl-14452 73 10 locate locate VERB crl-14452 73 11 materials material NOUN crl-14452 73 12 by by ADP crl-14452 73 13 broad broad ADJ crl-14452 73 14 subject subject ADJ crl-14452 73 15 topic topic NOUN crl-14452 73 16 rather rather ADV crl-14452 73 17 than than ADP crl-14452 73 18 by by ADP crl-14452 73 19 precise precise ADJ crl-14452 73 20 fact fact NOUN crl-14452 73 21 . . PUNCT crl-14452 74 1 the the DET crl-14452 74 2 public public ADJ crl-14452 74 3 catalog catalog NOUN crl-14452 74 4 still still ADV crl-14452 74 5 provides provide VERB crl-14452 74 6 the the DET crl-14452 74 7 primary primary ADJ crl-14452 74 8 access access NOUN crl-14452 74 9 to to ADP crl-14452 74 10 a a DET crl-14452 74 11 library library NOUN crl-14452 74 12 's 's PART crl-14452 74 13 resources resource NOUN crl-14452 74 14 and and CCONJ crl-14452 74 15 is be AUX crl-14452 74 16 normally normally ADV crl-14452 74 17 useful useful ADJ crl-14452 74 18 only only ADV crl-14452 74 19 for for ADP crl-14452 74 20 locating locate VERB crl-14452 74 21 books book NOUN crl-14452 74 22 . . PUNCT crl-14452 75 1 with with ADP crl-14452 75 2 rare rare ADJ crl-14452 75 3 exceptions exception NOUN crl-14452 75 4 , , PUNCT crl-14452 75 5 the the DET crl-14452 75 6 catalog catalog NOUN crl-14452 75 7 does do AUX crl-14452 75 8 not not PART crl-14452 75 9 provide provide VERB crl-14452 75 10 access access NOUN crl-14452 75 11 to to ADP crl-14452 75 12 tables table NOUN crl-14452 75 13 of of ADP crl-14452 75 14 contents content NOUN crl-14452 75 15 or or CCONJ crl-14452 75 16 individual individual ADJ crl-14452 75 17 chapters chapter NOUN crl-14452 75 18 in in ADP crl-14452 75 19 books book NOUN crl-14452 75 20 ; ; PUNCT crl-14452 75 21 neither neither CCONJ crl-14452 75 22 does do AUX crl-14452 75 23 it it PRON crl-14452 75 24 provide provide VERB crl-14452 75 25 access access NOUN crl-14452 75 26 to to ADP crl-14452 75 27 book book NOUN crl-14452 75 28 indexes index NOUN crl-14452 75 29 , , PUNCT crl-14452 75 30 which which PRON crl-14452 75 31 are be AUX crl-14452 75 32 most most ADV crl-14452 75 33 useful useful ADJ crl-14452 75 34 for for ADP crl-14452 75 35 locating locate VERB crl-14452 75 36 factual factual ADJ crl-14452 75 37 information information NOUN crl-14452 75 38 . . PUNCT crl-14452 76 1 user user NOUN crl-14452 76 2 demand demand NOUN crl-14452 76 3 for for ADP crl-14452 76 4 factual factual ADJ crl-14452 76 5 answering answering NOUN crl-14452 76 6 services service NOUN crl-14452 76 7 appears appear VERB crl-14452 76 8 to to PART crl-14452 76 9 be be AUX crl-14452 76 10 relatively relatively ADV crl-14452 76 11 low low ADJ crl-14452 76 12 compared compare VERB crl-14452 76 13 to to ADP crl-14452 76 14 other other ADJ crl-14452 76 15 types type NOUN crl-14452 76 16 of of ADP crl-14452 76 17 requests request NOUN crl-14452 76 18 for for ADP crl-14452 76 19 reference reference NOUN crl-14452 76 20 assistance assistance NOUN crl-14452 76 21 . . PUNCT crl-14452 77 1 this this PRON crl-14452 77 2 is be AUX crl-14452 77 3 particularly particularly ADV crl-14452 77 4 true true ADJ crl-14452 77 5 for for ADP crl-14452 77 6 queries query NOUN crl-14452 77 7 related relate VERB crl-14452 77 8 to to ADP crl-14452 77 9 academic academic ADJ crl-14452 77 10 course course NOUN crl-14452 77 11 work work NOUN crl-14452 77 12 and and CCONJ crl-14452 77 13 research research NOUN crl-14452 77 14 . . PUNCT crl-14452 78 1 results result NOUN crl-14452 78 2 of of ADP crl-14452 78 3 spss spss PROPN crl-14452 78 4 cross cross PROPN crl-14452 78 5 - - NOUN crl-14452 78 6 tabulations tabulation NOUN crl-14452 78 7 for for ADP crl-14452 78 8 factual factual ADJ crl-14452 78 9 , , PUNCT crl-14452 78 10 bibliographic bibliographic ADJ crl-14452 78 11 , , PUNCT crl-14452 78 12 and and CCONJ crl-14452 78 13 subject subject ADJ crl-14452 78 14 / / SYM crl-14452 78 15 instructional instructional ADJ crl-14452 78 16 questions question NOUN crl-14452 78 17 by by ADP crl-14452 78 18 purpose purpose NOUN crl-14452 78 19 of of ADP crl-14452 78 20 the the DET crl-14452 78 21 user user NOUN crl-14452 78 22 are be AUX crl-14452 78 23 provided provide VERB crl-14452 78 24 in in ADP crl-14452 78 25 table table NOUN crl-14452 78 26 3 3 NUM crl-14452 78 27 . . PUNCT crl-14452 79 1 the the DET crl-14452 79 2 chisquare chisquare NOUN crl-14452 79 3 is be AUX crl-14452 79 4 significant significant ADJ crl-14452 79 5 , , PUNCT crl-14452 79 6 indicating indicate VERB crl-14452 79 7 that that SCONJ crl-14452 79 8 there there PRON crl-14452 79 9 is be VERB crl-14452 79 10 a a DET crl-14452 79 11 difference difference NOUN crl-14452 79 12 in in ADP crl-14452 79 13 proportion proportion NOUN crl-14452 79 14 among among ADP crl-14452 79 15 types type NOUN crl-14452 79 16 of of ADP crl-14452 79 17 queries query NOUN crl-14452 79 18 made make VERB crl-14452 79 19 for for ADP crl-14452 79 20 course course NOUN crl-14452 79 21 work work NOUN crl-14452 79 22 , , PUNCT crl-14452 79 23 research research NOUN crl-14452 79 24 , , PUNCT crl-14452 79 25 and and CCONJ crl-14452 79 26 other other ADJ crl-14452 79 27 reasons reason NOUN crl-14452 79 28 . . PUNCT crl-14452 80 1 the the DET crl-14452 80 2 proportion proportion NOUN crl-14452 80 3 of of ADP crl-14452 80 4 facmarch facmarch NOUN crl-14452 80 5 1989 1989 NUM crl-14452 80 6 tual tual ADJ crl-14452 80 7 questions question NOUN crl-14452 80 8 asked ask VERB crl-14452 80 9 to to PART crl-14452 80 10 meet meet VERB crl-14452 80 11 course course NOUN crl-14452 80 12 work work NOUN crl-14452 80 13 and and CCONJ crl-14452 80 14 research research NOUN crl-14452 80 15 needs need NOUN crl-14452 80 16 is be AUX crl-14452 80 17 much much ADV crl-14452 80 18 lower low ADJ crl-14452 80 19 than than ADP crl-14452 80 20 those those PRON crl-14452 80 21 asked ask VERB crl-14452 80 22 for for ADP crl-14452 80 23 other other ADJ crl-14452 80 24 reasons reason NOUN crl-14452 80 25 , , PUNCT crl-14452 80 26 i.e. i.e. X crl-14452 80 27 , , PUNCT crl-14452 80 28 other other ADJ crl-14452 80 29 job job NOUN crl-14452 80 30 related relate VERB crl-14452 80 31 , , PUNCT crl-14452 80 32 personal personal ADJ crl-14452 80 33 , , PUNCT crl-14452 80 34 and and CCONJ crl-14452 80 35 miscellaneous miscellaneous ADJ crl-14452 80 36 . . PUNCT crl-14452 81 1 of of ADP crl-14452 81 2 the the DET crl-14452 81 3 total total ADJ crl-14452 81 4 number number NOUN crl-14452 81 5 of of ADP crl-14452 81 6 factual factual ADJ crl-14452 81 7 questions question NOUN crl-14452 81 8 in in ADP crl-14452 81 9 the the DET crl-14452 81 10 sample sample NOUN crl-14452 81 11 , , PUNCT crl-14452 81 12 42.9 42.9 NUM crl-14452 81 13 percent percent NOUN crl-14452 81 14 are be AUX crl-14452 81 15 primarily primarily ADV crl-14452 81 16 related relate VERB crl-14452 81 17 to to PART crl-14452 81 18 course course VERB crl-14452 81 19 work work NOUN crl-14452 81 20 , , PUNCT crl-14452 81 21 17.9 17.9 NUM crl-14452 81 22 percent percent NOUN crl-14452 81 23 for for ADP crl-14452 81 24 research research NOUN crl-14452 81 25 and and CCONJ crl-14452 81 26 39.3 39.3 NUM crl-14452 81 27 percent percent NOUN crl-14452 81 28 for for ADP crl-14452 81 29 other other ADJ crl-14452 81 30 reasons reason NOUN crl-14452 81 31 . . PUNCT crl-14452 82 1 therefore therefore ADV crl-14452 82 2 , , PUNCT crl-14452 82 3 of of ADP crl-14452 82 4 the the DET crl-14452 82 5 237 237 NUM crl-14452 82 6 questions question NOUN crl-14452 82 7 for for ADP crl-14452 82 8 which which PRON crl-14452 82 9 both both DET crl-14452 82 10 purpose purpose NOUN crl-14452 82 11 and and CCONJ crl-14452 82 12 type type NOUN crl-14452 82 13 of of ADP crl-14452 82 14 question question NOUN crl-14452 82 15 are be AUX crl-14452 82 16 identified identify VERB crl-14452 82 17 , , PUNCT crl-14452 82 18 only only ADV crl-14452 82 19 17 17 NUM crl-14452 82 20 ( ( PUNCT crl-14452 82 21 7.2 7.2 NUM crl-14452 82 22 percent percent NOUN crl-14452 82 23 ) ) PUNCT crl-14452 82 24 are be AUX crl-14452 82 25 both both PRON crl-14452 82 26 factual factual ADJ crl-14452 82 27 and and CCONJ crl-14452 82 28 closely closely ADV crl-14452 82 29 related relate VERB crl-14452 82 30 to to ADP crl-14452 82 31 the the DET crl-14452 82 32 primary primary ADJ crl-14452 82 33 mission mission NOUN crl-14452 82 34 of of ADP crl-14452 82 35 the the DET crl-14452 82 36 academic academic ADJ crl-14452 82 37 library library NOUN crl-14452 82 38 , , PUNCT crl-14452 82 39 support support NOUN crl-14452 82 40 of of ADP crl-14452 82 41 coursework coursework NOUN crl-14452 82 42 and and CCONJ crl-14452 82 43 research research NOUN crl-14452 82 44 ( ( PUNCT crl-14452 82 45 see see VERB crl-14452 82 46 table table NOUN crl-14452 82 47 4 4 NUM crl-14452 82 48 ) ) PUNCT crl-14452 82 49 . . PUNCT crl-14452 83 1 one one PRON crl-14452 83 2 must must AUX crl-14452 83 3 also also ADV crl-14452 83 4 be be AUX crl-14452 83 5 realistic realistic ADJ crl-14452 83 6 by by ADP crl-14452 83 7 asking ask VERB crl-14452 83 8 if if SCONJ crl-14452 83 9 accuracy accuracy NOUN crl-14452 83 10 is be AUX crl-14452 83 11 a a DET crl-14452 83 12 key key ADJ crl-14452 83 13 indicator indicator NOUN crl-14452 83 14 of of ADP crl-14452 83 15 reference reference NOUN crl-14452 83 16 performance performance NOUN crl-14452 83 17 . . PUNCT crl-14452 84 1 while while SCONJ crl-14452 84 2 unobtrusive unobtrusive ADJ crl-14452 84 3 test test NOUN crl-14452 84 4 questions question NOUN crl-14452 84 5 have have AUX crl-14452 84 6 documented document VERB crl-14452 84 7 , , PUNCT crl-14452 84 8 authoritatively authoritatively ADV crl-14452 84 9 correct correct ADJ crl-14452 84 10 answers answer NOUN crl-14452 84 11 , , PUNCT crl-14452 84 12 most most ADJ crl-14452 84 13 real real ADJ crl-14452 84 14 - - PUNCT crl-14452 84 15 life life NOUN crl-14452 84 16 questions question NOUN crl-14452 84 17 are be AUX crl-14452 84 18 not not PART crl-14452 84 19 so so ADV crl-14452 84 20 conveniently conveniently ADV crl-14452 84 21 documented document VERB crl-14452 84 22 . . PUNCT crl-14452 85 1 professional professional ADJ crl-14452 85 2 education education NOUN crl-14452 85 3 stresses stress VERB crl-14452 85 4 the the DET crl-14452 85 5 identification identification NOUN crl-14452 85 6 of of ADP crl-14452 85 7 appropriate appropriate ADJ crl-14452 85 8 sources source NOUN crl-14452 85 9 containing contain VERB crl-14452 85 10 an an DET crl-14452 85 11 answer answer NOUN crl-14452 85 12 , , PUNCT crl-14452 85 13 but but CCONJ crl-14452 85 14 not not PART crl-14452 85 15 the the DET crl-14452 85 16 ability ability NOUN crl-14452 85 17 of of ADP crl-14452 85 18 the the DET crl-14452 85 19 librarian librarian NOUN crl-14452 85 20 to to PART crl-14452 85 21 judge judge VERB crl-14452 85 22 the the DET crl-14452 85 23 accuracy accuracy NOUN crl-14452 85 24 of of ADP crl-14452 85 25 that that DET crl-14452 85 26 answer answer NOUN crl-14452 85 27 . . PUNCT crl-14452 86 1 a a DET crl-14452 86 2 performance performance NOUN crl-14452 86 3 measure measure NOUN crl-14452 86 4 that that PRON crl-14452 86 5 evaluates evaluate VERB crl-14452 86 6 and and CCONJ crl-14452 86 7 identifies identify VERB crl-14452 86 8 a a DET crl-14452 86 9 proper proper ADJ crl-14452 86 10 source source NOUN crl-14452 86 11 might might AUX crl-14452 86 12 be be AUX crl-14452 86 13 a a DET crl-14452 86 14 more more ADV crl-14452 86 15 reasonable reasonable ADJ crl-14452 86 16 test test NOUN crl-14452 86 17 of of ADP crl-14452 86 18 reference reference NOUN crl-14452 86 19 librarian librarian NOUN crl-14452 86 20 effectiveness effectiveness NOUN crl-14452 86 21 . . PUNCT crl-14452 87 1 patrick patrick PROPN crl-14452 87 2 wilson wilson PROPN crl-14452 87 3 raises raise VERB crl-14452 87 4 serious serious ADJ crl-14452 87 5 questions question NOUN crl-14452 87 6 about about ADP crl-14452 87 7 the the DET crl-14452 87 8 ability ability NOUN crl-14452 87 9 of of ADP crl-14452 87 10 reference reference NOUN crl-14452 87 11 librarians librarian VERB crl-14452 87 12 to to PART crl-14452 87 13 determine determine VERB crl-14452 87 14 accuracy accuracy NOUN crl-14452 87 15 in in ADP crl-14452 87 16 all all DET crl-14452 87 17 subject subject NOUN crl-14452 87 18 areas area NOUN crl-14452 87 19 . . PUNCT crl-14452 88 1 he he PRON crl-14452 88 2 notes note VERB crl-14452 88 3 that that SCONJ crl-14452 88 4 reference reference NOUN crl-14452 88 5 works work NOUN crl-14452 88 6 do do AUX crl-14452 88 7 not not PART crl-14452 88 8 collectively collectively ADV crl-14452 88 9 give give VERB crl-14452 88 10 a a DET crl-14452 88 11 single single ADJ crl-14452 88 12 standard standard ADJ crl-14452 88 13 answer answer NOUN crl-14452 88 14 for for ADP crl-14452 88 15 the the DET crl-14452 88 16 same same ADJ crl-14452 88 17 question question NOUN crl-14452 88 18 ; ; PUNCT crl-14452 88 19 they they PRON crl-14452 88 20 are be AUX crl-14452 88 21 , , PUNCT crl-14452 88 22 in in ADP crl-14452 88 23 varying vary VERB crl-14452 88 24 degrees degree NOUN crl-14452 88 25 , , PUNCT crl-14452 88 26 full full ADJ crl-14452 88 27 of of ADP crl-14452 88 28 inaccuracies inaccuracy NOUN crl-14452 88 29 . . PUNCT crl-14452 89 1 further far ADV crl-14452 89 2 , , PUNCT crl-14452 89 3 a a DET crl-14452 89 4 standard standard ADJ crl-14452 89 5 reference reference NOUN crl-14452 89 6 work work NOUN crl-14452 89 7 quickly quickly ADV crl-14452 89 8 becomes become VERB crl-14452 89 9 dated date VERB crl-14452 89 10 and and CCONJ crl-14452 89 11 incomplete incomplete ADJ crl-14452 89 12 . . PUNCT crl-14452 90 1 14 14 NUM crl-14452 90 2 wilson wilson NOUN crl-14452 90 3 concludes conclude VERB crl-14452 90 4 that that SCONJ crl-14452 90 5 librarians librarian NOUN crl-14452 90 6 generally generally ADV crl-14452 90 7 work work VERB crl-14452 90 8 in in ADP crl-14452 90 9 a a DET crl-14452 90 10 world world NOUN crl-14452 90 11 of of ADP crl-14452 90 12 texts text NOUN crl-14452 90 13 that that PRON crl-14452 90 14 they they PRON crl-14452 90 15 take take VERB crl-14452 90 16 as as ADV crl-14452 90 17 simply simply ADV crl-14452 90 18 given give VERB crl-14452 90 19 and and CCONJ crl-14452 90 20 can can AUX crl-14452 90 21 not not PART crl-14452 90 22 claim claim VERB crl-14452 90 23 to to PART crl-14452 90 24 evalutable3 evalutable3 NOUN crl-14452 90 25 question question NOUN crl-14452 90 26 type type NOUN crl-14452 90 27 factual factual ADJ crl-14452 90 28 bibliographic bibliographic ADJ crl-14452 90 29 subject subject NOUN crl-14452 90 30 / / SYM crl-14452 90 31 instructional instructional ADJ crl-14452 90 32 missing miss VERB crl-14452 90 33 ( ( PUNCT crl-14452 90 34 20 20 NUM crl-14452 90 35 ) ) PUNCT crl-14452 90 36 x2 x2 PROPN crl-14452 90 37 28.99 28.99 NUM crl-14452 90 38 , , PUNCT crl-14452 90 39 df df PROPN crl-14452 90 40 = = PROPN crl-14452 90 41 4 4 NUM crl-14452 90 42 , , PUNCT crl-14452 90 43 p p NOUN crl-14452 90 44 < < X crl-14452 90 45 .ooos .ooo NOUN crl-14452 90 46 type type NOUN crl-14452 90 47 of of ADP crl-14452 90 48 question question NOUN crl-14452 90 49 and and CCONJ crl-14452 90 50 purpose purpose NOUN crl-14452 90 51 of of ADP crl-14452 90 52 question question NOUN crl-14452 90 53 course course NOUN crl-14452 90 54 work work NOUN crl-14452 90 55 7.5 7.5 NUM crl-14452 90 56 % % NOUN crl-14452 90 57 16.8 16.8 NUM crl-14452 90 58 75.8 75.8 NUM crl-14452 90 59 100.1 100.1 NUM crl-14452 90 60 % % NOUN crl-14452 90 61 ( ( PUNCT crl-14452 90 62 161 161 NUM crl-14452 90 63 ) ) PUNCT crl-14452 90 64 10.0 10.0 NUM crl-14452 90 65 % % NOUN crl-14452 90 66 26.0 26.0 NUM crl-14452 90 67 64.0 64.0 NUM crl-14452 90 68 100.0 100.0 NUM crl-14452 90 69 % % NOUN crl-14452 90 70 ( ( PUNCT crl-14452 90 71 50 50 NUM crl-14452 90 72 ) ) PUNCT crl-14452 90 73 other other ADJ crl-14452 90 74 42.3 42.3 NUM crl-14452 90 75 % % NOUN crl-14452 90 76 15.4 15.4 NUM crl-14452 90 77 42.3 42.3 NUM crl-14452 90 78 100.0 100.0 NUM crl-14452 90 79 % % NOUN crl-14452 90 80 i i PRON crl-14452 90 81 ( ( PUNCT crl-14452 90 82 26 26 NUM crl-14452 90 83 ) ) PUNCT crl-14452 90 84 table4 table4 NOUN crl-14452 90 85 questions question NOUN crl-14452 90 86 related relate VERB crl-14452 90 87 and and CCONJ crl-14452 90 88 unrelated unrelated ADJ crl-14452 90 89 to to ADP crl-14452 90 90 institutional institutional ADJ crl-14452 90 91 mission mission NOUN crl-14452 90 92 ! ! PUNCT crl-14452 90 93 jpeof jpeof PROPN crl-14452 90 94 question question NOUN crl-14452 90 95 number number NOUN crl-14452 90 96 course course NOUN crl-14452 90 97 work work NOUN crl-14452 90 98 and and CCONJ crl-14452 90 99 research research NOUN crl-14452 90 100 factual factual ADJ crl-14452 90 101 17 17 NUM crl-14452 90 102 bibliographic bibliographic ADJ crl-14452 90 103 40 40 NUM crl-14452 90 104 subject subject NOUN crl-14452 90 105 / / SYM crl-14452 90 106 instructional instructional ADJ crl-14452 90 107 154 154 NUM crl-14452 90 108 other other ADJ crl-14452 90 109 reasons reason NOUN crl-14452 90 110 factual factual ADJ crl-14452 90 111 11 11 NUM crl-14452 90 112 bibliographic bibliographic ADJ crl-14452 90 113 4 4 NUM crl-14452 90 114 subject subject ADJ crl-14452 90 115 / / SYM crl-14452 90 116 instructional instructional ADJ crl-14452 90 117 11 11 NUM crl-14452 90 118 237 237 NUM crl-14452 90 119 missing miss VERB crl-14452 90 120 ( ( PUNCT crl-14452 90 121 20 20 NUM crl-14452 90 122 ) ) PUNCT crl-14452 90 123 percent percent NOUN crl-14452 90 124 of of ADP crl-14452 90 125 sample sample NOUN crl-14452 90 126 7.2 7.2 NUM crl-14452 90 127 16.9 16.9 NUM crl-14452 90 128 65.0 65.0 NUM crl-14452 90 129 4.6 4.6 NUM crl-14452 90 130 1.7 1.7 NUM crl-14452 90 131 4.6 4.6 NUM crl-14452 90 132 100.0 100.0 NUM crl-14452 90 133 ate eat VERB crl-14452 90 134 independently independently ADV crl-14452 90 135 .15 .15 PUNCT crl-14452 90 136 the the DET crl-14452 90 137 evaluation evaluation NOUN crl-14452 90 138 of of ADP crl-14452 90 139 the the DET crl-14452 90 140 content content NOUN crl-14452 90 141 of of ADP crl-14452 90 142 texts text NOUN crl-14452 90 143 requires require VERB crl-14452 90 144 expertise expertise NOUN crl-14452 90 145 in in ADP crl-14452 90 146 the the DET crl-14452 90 147 subject subject ADJ crl-14452 90 148 matter matter NOUN crl-14452 90 149 of of ADP crl-14452 90 150 the the DET crl-14452 90 151 text text NOUN crl-14452 90 152 , , PUNCT crl-14452 90 153 which which PRON crl-14452 90 154 the the DET crl-14452 90 155 librarian librarian NOUN crl-14452 90 156 can can AUX crl-14452 90 157 not not PART crl-14452 90 158 be be AUX crl-14452 90 159 expected expect VERB crl-14452 90 160 to to PART crl-14452 90 161 have have VERB crl-14452 90 162 . . PUNCT crl-14452 91 1 librarians librarian NOUN crl-14452 91 2 are be AUX crl-14452 91 3 not not PART crl-14452 91 4 generally generally ADV crl-14452 91 5 in in ADP crl-14452 91 6 a a DET crl-14452 91 7 position position NOUN crl-14452 91 8 to to PART crl-14452 91 9 be be AUX crl-14452 91 10 able able ADJ crl-14452 91 11 to to PART crl-14452 91 12 evaluate evaluate VERB crl-14452 91 13 the the DET crl-14452 91 14 contents content NOUN crl-14452 91 15 of of ADP crl-14452 91 16 a a DET crl-14452 91 17 reference reference NOUN crl-14452 91 18 book book NOUN crl-14452 91 19 or or CCONJ crl-14452 91 20 to to PART crl-14452 91 21 make make VERB crl-14452 91 22 independent independent ADJ crl-14452 91 23 judgments judgment NOUN crl-14452 91 24 on on ADP crl-14452 91 25 the the DET crl-14452 91 26 correct correct ADJ crl-14452 91 27 or or CCONJ crl-14452 91 28 incorrect incorrect ADJ crl-14452 91 29 status status NOUN crl-14452 91 30 of of ADP crl-14452 91 31 answers answer NOUN crl-14452 91 32 . . PUNCT crl-14452 92 1 it it PRON crl-14452 92 2 seems seem VERB crl-14452 92 3 , , PUNCT crl-14452 92 4 therefore therefore ADV crl-14452 92 5 , , PUNCT crl-14452 92 6 that that SCONJ crl-14452 92 7 our our PRON crl-14452 92 8 key key ADJ crl-14452 92 9 performance performance NOUN crl-14452 92 10 measures measure NOUN crl-14452 92 11 ought ought AUX crl-14452 92 12 to to PART crl-14452 92 13 be be AUX crl-14452 92 14 designed design VERB crl-14452 92 15 to to PART crl-14452 92 16 acknowledge acknowledge VERB crl-14452 92 17 more more ADV crl-14452 92 18 thoroughly thoroughly ADV crl-14452 92 19 the the DET crl-14452 92 20 limited limited ADJ crl-14452 92 21 judgments judgment NOUN crl-14452 92 22 librarians librarian NOUN crl-14452 92 23 are be AUX crl-14452 92 24 able able ADJ crl-14452 92 25 to to PART crl-14452 92 26 make make VERB crl-14452 92 27 . . PUNCT crl-14452 93 1 data datum NOUN crl-14452 93 2 from from ADP crl-14452 93 3 this this DET crl-14452 93 4 study study NOUN crl-14452 93 5 support support NOUN crl-14452 93 6 wilson wilson PROPN crl-14452 93 7 's 's PART crl-14452 93 8 observations observation NOUN crl-14452 93 9 . . PUNCT crl-14452 94 1 librarians librarian NOUN crl-14452 94 2 in in ADP crl-14452 94 3 the the DET crl-14452 94 4 study study NOUN crl-14452 94 5 reported report VERB crl-14452 94 6 good good ADJ crl-14452 94 7 subject subject ADJ crl-14452 94 8 expertise expertise NOUN crl-14452 94 9 ( ( PUNCT crl-14452 94 10 1 1 NUM crl-14452 94 11 or or CCONJ crl-14452 94 12 2 2 NUM crl-14452 94 13 on on ADP crl-14452 94 14 a a DET crl-14452 94 15 scale scale NOUN crl-14452 94 16 of of ADP crl-14452 94 17 7 7 NUM crl-14452 94 18 ) ) PUNCT crl-14452 94 19 for for ADP crl-14452 94 20 only only ADV crl-14452 94 21 51.8 51.8 NUM crl-14452 94 22 percent percent NOUN crl-14452 94 23 of of ADP crl-14452 94 24 the the DET crl-14452 94 25 transactions transaction NOUN crl-14452 94 26 , , PUNCT crl-14452 94 27 and and CCONJ crl-14452 94 28 users user NOUN crl-14452 94 29 reported report VERB crl-14452 94 30 the the DET crl-14452 94 31 same same ADJ crl-14452 94 32 level level NOUN crl-14452 94 33 of of ADP crl-14452 94 34 subject subject ADJ crl-14452 94 35 expertise expertise NOUN crl-14452 94 36 only only ADV crl-14452 94 37 17.3 17.3 NUM crl-14452 94 38 percent percent NOUN crl-14452 94 39 of of ADP crl-14452 94 40 the the DET crl-14452 94 41 time time NOUN crl-14452 94 42 . . PUNCT crl-14452 95 1 this this PRON crl-14452 95 2 is be AUX crl-14452 95 3 the the DET crl-14452 95 4 nature nature NOUN crl-14452 95 5 of of ADP crl-14452 95 6 general general ADJ crl-14452 95 7 reference reference NOUN crl-14452 95 8 desk desk NOUN crl-14452 95 9 service service NOUN crl-14452 95 10 , , PUNCT crl-14452 95 11 where where SCONJ crl-14452 95 12 librarians librarian NOUN crl-14452 95 13 can can AUX crl-14452 95 14 not not PART crl-14452 95 15 hope hope VERB crl-14452 95 16 to to PART crl-14452 95 17 have have VERB crl-14452 95 18 in in ADP crl-14452 95 19 - - PUNCT crl-14452 95 20 depth depth NOUN crl-14452 95 21 subject subject ADJ crl-14452 95 22 competence competence NOUN crl-14452 95 23 in in ADP crl-14452 95 24 all all DET crl-14452 95 25 areas area NOUN crl-14452 95 26 for for ADP crl-14452 95 27 which which PRON crl-14452 95 28 they they PRON crl-14452 95 29 are be AUX crl-14452 95 30 expected expect VERB crl-14452 95 31 to to PART crl-14452 95 32 answer answer VERB crl-14452 95 33 questions question NOUN crl-14452 95 34 . . PUNCT crl-14452 96 1 one one NUM crl-14452 96 2 user user NOUN crl-14452 96 3 noted note VERB crl-14452 96 4 , , PUNCT crl-14452 96 5 '' '' PUNCT crl-14452 96 6 the the DET crl-14452 96 7 people people NOUN crl-14452 96 8 are be AUX crl-14452 96 9 helpful helpful ADJ crl-14452 96 10 , , PUNCT crl-14452 96 11 and and CCONJ crl-14452 96 12 try try VERB crl-14452 96 13 to to PART crl-14452 96 14 do do VERB crl-14452 96 15 their their PRON crl-14452 96 16 best good ADJ crl-14452 96 17 , , PUNCT crl-14452 96 18 but but CCONJ crl-14452 96 19 some some PRON crl-14452 96 20 of of ADP crl-14452 96 21 them they PRON crl-14452 96 22 are be AUX crl-14452 96 23 not not PART crl-14452 96 24 qualified qualified ADJ crl-14452 96 25 enough enough ADV crl-14452 96 26 . . PUNCT crl-14452 96 27 '' '' PUNCT crl-14452 97 1 significant significant ADJ crl-14452 97 2 subject subject ADJ crl-14452 97 3 familiarity familiarity NOUN crl-14452 97 4 by by ADP crl-14452 97 5 the the DET crl-14452 97 6 librarian librarian NOUN crl-14452 97 7 was be AUX crl-14452 97 8 positively positively ADV crl-14452 97 9 associated associate VERB crl-14452 97 10 with with ADP crl-14452 97 11 user user NOUN crl-14452 97 12 success success NOUN crl-14452 97 13 for for ADP crl-14452 97 14 subject subject ADJ crl-14452 97 15 and and CCONJ crl-14452 97 16 instructional instructional ADJ crl-14452 97 17 questions question NOUN crl-14452 97 18 ( ( PUNCT crl-14452 97 19 r r NOUN crl-14452 97 20 = = SYM crl-14452 97 21 .303 .303 NUM crl-14452 97 22 , , PUNCT crl-14452 97 23 p p NOUN crl-14452 98 1 = = NOUN crl-14452 98 2 < < X crl-14452 98 3 .0005 .0005 PUNCT crl-14452 98 4 ) ) PUNCT crl-14452 98 5 and and CCONJ crl-14452 98 6 factual factual ADJ crl-14452 98 7 and and CCONJ crl-14452 98 8 bibliographic bibliographic ADJ crl-14452 98 9 queries query NOUN crl-14452 98 10 ( ( PUNCT crl-14452 98 11 r r NOUN crl-14452 98 12 = = X crl-14452 98 13 .208 .208 NUM crl-14452 98 14 , , PUNCT crl-14452 98 15 p p NOUN crl-14452 98 16 = = SYM crl-14452 98 17 .040 .040 NUM crl-14452 98 18 ) ) PUNCT crl-14452 98 19 . . PUNCT crl-14452 99 1 user user NOUN crl-14452 99 2 reports report NOUN crl-14452 99 3 of of ADP crl-14452 99 4 shorter short ADJ crl-14452 99 5 lengths length NOUN crl-14452 99 6 of of ADP crl-14452 99 7 time time NOUN crl-14452 99 8 spent spend VERB crl-14452 99 9 with with ADP crl-14452 99 10 the the DET crl-14452 99 11 librarian librarian NOUN crl-14452 99 12 were be AUX crl-14452 99 13 more more ADV crl-14452 99 14 strongly strongly ADV crl-14452 99 15 associated associate VERB crl-14452 99 16 with with ADP crl-14452 99 17 user user NOUN crl-14452 99 18 success success NOUN crl-14452 99 19 in in ADP crl-14452 99 20 locating locate VERB crl-14452 99 21 materials material NOUN crl-14452 99 22 for for ADP crl-14452 99 23 factual factual ADJ crl-14452 99 24 and and CCONJ crl-14452 99 25 bibliographic bibliographic ADJ crl-14452 99 26 citation citation NOUN crl-14452 99 27 queries query NOUN crl-14452 99 28 ( ( PUNCT crl-14452 99 29 r r NOUN crl-14452 99 30 = = SYM crl-14452 99 31 .560 .560 NUM crl-14452 99 32 , , PUNCT crl-14452 99 33 p. p. NOUN crl-14452 99 34 = = NOUN crl-14452 99 35 < < X crl-14452 99 36 .0005 .0005 PUNCT crl-14452 99 37 ) ) PUNCT crl-14452 99 38 than than ADP crl-14452 99 39 for for ADP crl-14452 99 40 subject subject ADJ crl-14452 99 41 unobtrusive unobtrusive ADJ crl-14452 99 42 studies study NOUN crl-14452 99 43 185 185 NUM crl-14452 99 44 and and CCONJ crl-14452 99 45 instructional instructional ADJ crl-14452 99 46 queries query NOUN crl-14452 99 47 ( ( PUNCT crl-14452 99 48 r r NOUN crl-14452 99 49 = = SYM crl-14452 99 50 .149 .149 NUM crl-14452 99 51 , , PUNCT crl-14452 99 52 p. p. NOUN crl-14452 99 53 = = PUNCT crl-14452 99 54 .026 .026 NUM crl-14452 99 55 ) ) PUNCT crl-14452 99 56 . . PUNCT crl-14452 100 1 hernon hernon PROPN crl-14452 100 2 and and CCONJ crl-14452 100 3 mcclure mcclure NOUN crl-14452 100 4 note note NOUN crl-14452 100 5 that that SCONJ crl-14452 100 6 when when SCONJ crl-14452 100 7 conducting conduct VERB crl-14452 100 8 evaluation evaluation NOUN crl-14452 100 9 studies study NOUN crl-14452 100 10 , , PUNCT crl-14452 100 11 issues issue NOUN crl-14452 100 12 related relate VERB crl-14452 100 13 to to ADP crl-14452 100 14 the the DET crl-14452 100 15 quality quality NOUN crl-14452 100 16 of of ADP crl-14452 100 17 the the DET crl-14452 100 18 service service NOUN crl-14452 100 19 must must AUX crl-14452 100 20 be be AUX crl-14452 100 21 separated separate VERB crl-14452 100 22 from from ADP crl-14452 100 23 the the DET crl-14452 100 24 value value NOUN crl-14452 100 25 of of ADP crl-14452 100 26 that that DET crl-14452 100 27 service service NOUN crl-14452 100 28 . . PUNCT crl-14452 101 1 ultimately ultimately ADV crl-14452 101 2 , , PUNCT crl-14452 101 3 the the DET crl-14452 101 4 value value NOUN crl-14452 101 5 of of ADP crl-14452 101 6 the the DET crl-14452 101 7 service service NOUN crl-14452 101 8 is be AUX crl-14452 101 9 based base VERB crl-14452 101 10 upon upon SCONJ crl-14452 101 11 the the DET crl-14452 101 12 degree degree NOUN crl-14452 101 13 to to PART crl-14452 101 14 which which PRON crl-14452 101 15 the the DET crl-14452 101 16 service service NOUN crl-14452 101 17 meets meet VERB crl-14452 101 18 the the DET crl-14452 101 19 information information NOUN crl-14452 101 20 needs need NOUN crl-14452 101 21 of of ADP crl-14452 101 22 library library NOUN crl-14452 101 23 clientele clientele NOUN crl-14452 101 24 and and CCONJ crl-14452 101 25 facilitates facilitate VERB crl-14452 101 26 the the DET crl-14452 101 27 accomplishment accomplishment NOUN crl-14452 101 28 of of ADP crl-14452 101 29 service service NOUN crl-14452 101 30 objectives objective NOUN crl-14452 101 31 . . PUNCT crl-14452 102 1 16 16 NUM crl-14452 102 2 libraries library NOUN crl-14452 102 3 and and CCONJ crl-14452 102 4 librarians librarian NOUN crl-14452 102 5 should should AUX crl-14452 102 6 be be AUX crl-14452 102 7 judged judge VERB crl-14452 102 8 primarily primarily ADV crl-14452 102 9 on on ADP crl-14452 102 10 whether whether SCONJ crl-14452 102 11 they they PRON crl-14452 102 12 provide provide VERB crl-14452 102 13 added add VERB crl-14452 102 14 value value NOUN crl-14452 102 15 to to ADP crl-14452 102 16 users user NOUN crl-14452 102 17 . . PUNCT crl-14452 103 1 when when SCONJ crl-14452 103 2 partial partial ADJ crl-14452 103 3 and and CCONJ crl-14452 103 4 full full ADJ crl-14452 103 5 success success NOUN crl-14452 103 6 are be AUX crl-14452 103 7 both both PRON crl-14452 103 8 considered consider VERB crl-14452 103 9 , , PUNCT crl-14452 103 10 users user NOUN crl-14452 103 11 report report VERB crl-14452 103 12 greater great ADJ crl-14452 103 13 success success NOUN crl-14452 103 14 in in ADP crl-14452 103 15 finding find VERB crl-14452 103 16 some some DET crl-14452 103 17 or or CCONJ crl-14452 103 18 all all PRON crl-14452 103 19 materials material NOUN crl-14452 103 20 for for ADP crl-14452 103 21 subject subject NOUN crl-14452 103 22 and and CCONJ crl-14452 103 23 instructional instructional ADJ crl-14452 103 24 ( ( PUNCT crl-14452 103 25 95 95 NUM crl-14452 103 26 . . NUM crl-14452 103 27 9 9 NUM crl-14452 103 28 percent percent NOUN crl-14452 103 29 ) ) PUNCT crl-14452 103 30 queries query VERB crl-14452 103 31 than than ADP crl-14452 103 32 for for ADP crl-14452 103 33 factual factual ADJ crl-14452 103 34 ( ( PUNCT crl-14452 103 35 89 89 NUM crl-14452 103 36 . . NUM crl-14452 103 37 3 3 NUM crl-14452 103 38 percent percent NOUN crl-14452 103 39 ) ) PUNCT crl-14452 103 40 and and CCONJ crl-14452 103 41 bibliographic bibliographic ADJ crl-14452 103 42 ( ( PUNCT crl-14452 103 43 84.1 84.1 NUM crl-14452 103 44 percent percent NOUN crl-14452 103 45 ) ) PUNCT crl-14452 103 46 queries query VERB crl-14452 103 47 . . PUNCT crl-14452 104 1 only only ADV crl-14452 104 2 when when SCONJ crl-14452 104 3 judged judge VERB crl-14452 104 4 by by ADP crl-14452 104 5 the the DET crl-14452 104 6 more more ADV crl-14452 104 7 stringent stringent ADJ crl-14452 104 8 criterion criterion NOUN crl-14452 104 9 of of ADP crl-14452 104 10 locating locate VERB crl-14452 104 11 all all DET crl-14452 104 12 materials material NOUN crl-14452 104 13 needed need VERB crl-14452 104 14 did do AUX crl-14452 104 15 users user NOUN crl-14452 104 16 report report VERB crl-14452 104 17 the the DET crl-14452 104 18 greatest great ADJ crl-14452 104 19 success success NOUN crl-14452 104 20 rates rate NOUN crl-14452 104 21 for for ADP crl-14452 104 22 factual factual ADJ crl-14452 104 23 queries query NOUN crl-14452 104 24 ( ( PUNCT crl-14452 104 25 see see VERB crl-14452 104 26 table table NOUN crl-14452 104 27 2 2 NUM crl-14452 104 28 ) ) PUNCT crl-14452 104 29 . . PUNCT crl-14452 105 1 thus thus ADV crl-14452 105 2 , , PUNCT crl-14452 105 3 the the DET crl-14452 105 4 correct correct ADJ crl-14452 105 5 answer answer NOUN crl-14452 105 6 fill fill NOUN crl-14452 105 7 rate rate NOUN crl-14452 105 8 appears appear VERB crl-14452 105 9 to to PART crl-14452 105 10 be be AUX crl-14452 105 11 a a DET crl-14452 105 12 useful useful ADJ crl-14452 105 13 , , PUNCT crl-14452 105 14 but but CCONJ crl-14452 105 15 extremely extremely ADV crl-14452 105 16 limited limited ADJ crl-14452 105 17 , , PUNCT crl-14452 105 18 measure measure NOUN crl-14452 105 19 of of ADP crl-14452 105 20 reference reference NOUN crl-14452 105 21 performance performance NOUN crl-14452 105 22 . . PUNCT crl-14452 106 1 easier easy ADJ crl-14452 106 2 - - PUNCT crl-14452 106 3 than than ADP crl-14452 106 4 - - PUNCT crl-14452 106 5 average average NOUN crl-14452 106 6 queries query VERB crl-14452 106 7 another another DET crl-14452 106 8 assumption assumption NOUN crl-14452 106 9 underlying underlie VERB crl-14452 106 10 many many ADJ crl-14452 106 11 unobtrusive unobtrusive ADJ crl-14452 106 12 studies study NOUN crl-14452 106 13 of of ADP crl-14452 106 14 reference reference NOUN crl-14452 106 15 service service NOUN crl-14452 106 16 is be AUX crl-14452 106 17 that that SCONJ crl-14452 106 18 the the DET crl-14452 106 19 questions question NOUN crl-14452 106 20 used use VERB crl-14452 106 21 are be AUX crl-14452 106 22 not not PART crl-14452 106 23 difficult difficult ADJ crl-14452 106 24 to to PART crl-14452 106 25 answer answer VERB crl-14452 106 26 . . PUNCT crl-14452 107 1 mcclure mcclure NOUN crl-14452 107 2 and and CCONJ crl-14452 107 3 hernon hernon PROPN crl-14452 107 4 suggest suggest VERB crl-14452 107 5 that that SCONJ crl-14452 107 6 the the DET crl-14452 107 7 55 55 NUM crl-14452 107 8 percent percent NOUN crl-14452 107 9 correct correct ADJ crl-14452 107 10 answer answer NOUN crl-14452 107 11 fill fill NOUN crl-14452 107 12 rate rate NOUN crl-14452 107 13 is be AUX crl-14452 107 14 typically typically ADV crl-14452 107 15 computed compute VERB crl-14452 107 16 on on ADP crl-14452 107 17 questions question NOUN crl-14452 107 18 with with ADP crl-14452 107 19 an an DET crl-14452 107 20 '' '' PUNCT crl-14452 107 21 easier easy ADJ crl-14452 107 22 - - PUNCT crl-14452 107 23 than than ADP crl-14452 107 24 - - PUNCT crl-14452 107 25 average average ADJ crl-14452 107 26 '' '' PUNCT crl-14452 107 27 difficulty difficulty NOUN crl-14452 107 28 level level NOUN crl-14452 107 29 . . PUNCT crl-14452 108 1 17 17 NUM crl-14452 108 2 also also ADV crl-14452 108 3 , , PUNCT crl-14452 108 4 in in ADP crl-14452 108 5 response response NOUN crl-14452 108 6 to to ADP crl-14452 108 7 a a DET crl-14452 108 8 reviewer reviewer NOUN crl-14452 108 9 's 's PART crl-14452 108 10 query query NOUN crl-14452 108 11 as as ADP crl-14452 108 12 to to ADP crl-14452 108 13 whether whether SCONJ crl-14452 108 14 the the DET crl-14452 108 15 degree degree NOUN crl-14452 108 16 of of ADP crl-14452 108 17 difficulty difficulty NOUN crl-14452 108 18 should should AUX crl-14452 108 19 be be AUX crl-14452 108 20 used use VERB crl-14452 108 21 to to PART crl-14452 108 22 judge judge VERB crl-14452 108 23 the the DET crl-14452 108 24 quality quality NOUN crl-14452 108 25 of of ADP crl-14452 108 26 reference reference NOUN crl-14452 108 27 service service NOUN crl-14452 108 28 , , PUNCT crl-14452 108 29 hernon hernon NOUN crl-14452 108 30 and and CCONJ crl-14452 108 31 mcclure mcclure VERB crl-14452 108 32 state state NOUN crl-14452 108 33 that that SCONJ crl-14452 108 34 '' '' PUNCT crl-14452 108 35 factual factual ADJ crl-14452 108 36 and and CCONJ crl-14452 108 37 bibliographic bibliographic ADJ crl-14452 108 38 questions question NOUN crl-14452 108 39 are be AUX crl-14452 108 40 generally generally ADV crl-14452 108 41 recognized recognize VERB crl-14452 108 42 as as ADP crl-14452 108 43 two two NUM crl-14452 108 44 of of ADP crl-14452 108 45 the the DET crl-14452 108 46 easier easy ADJ crl-14452 108 47 types type NOUN crl-14452 108 48 of of ADP crl-14452 108 49 reference reference NOUN crl-14452 108 50 questions question NOUN crl-14452 108 51 . . PUNCT crl-14452 108 52 '' '' PUNCT crl-14452 109 1 18 18 NUM crl-14452 109 2 however however ADV crl-14452 109 3 , , PUNCT crl-14452 109 4 the the DET crl-14452 109 5 degree degree NOUN crl-14452 109 6 of of ADP crl-14452 109 7 difficulty difficulty NOUN crl-14452 109 8 of of ADP crl-14452 109 9 average average ADJ crl-14452 109 10 unobtrusive unobtrusive ADJ crl-14452 109 11 test test NOUN crl-14452 109 12 questions question NOUN crl-14452 109 13 versus versus ADP crl-14452 109 14 average average ADJ crl-14452 109 15 questions question NOUN crl-14452 109 16 actually actually ADV crl-14452 109 17 asked ask VERB crl-14452 109 18 in in ADP crl-14452 109 19 academic academic ADJ crl-14452 109 20 libraries library NOUN crl-14452 109 21 for for ADP crl-14452 109 22 factual factual ADJ crl-14452 109 23 , , PUNCT crl-14452 109 24 bibliographic bibliographic ADJ crl-14452 109 25 , , PUNCT crl-14452 109 26 and and CCONJ crl-14452 109 27 subject subject ADJ crl-14452 109 28 / / SYM crl-14452 109 29 instructional instructional ADJ crl-14452 109 30 questions question NOUN crl-14452 109 31 has have AUX crl-14452 109 32 not not PART crl-14452 109 33 been be AUX crl-14452 109 34 carefully carefully ADV crl-14452 109 35 studied study VERB crl-14452 109 36 . . PUNCT crl-14452 110 1 for for ADP crl-14452 110 2 service service NOUN crl-14452 110 3 providers provider NOUN crl-14452 110 4 , , PUNCT crl-14452 110 5 task task NOUN crl-14452 110 6 difficulty difficulty NOUN crl-14452 110 7 was be AUX crl-14452 110 8 found find VERB crl-14452 110 9 to to PART crl-14452 110 10 be be AUX crl-14452 110 11 positively positively ADV crl-14452 110 12 related relate VERB crl-14452 110 13 to to ADP crl-14452 110 14 task task NOUN crl-14452 110 15 uncertainty uncertainty NOUN crl-14452 110 16 . . PUNCT crl-14452 111 1 19 19 NUM crl-14452 111 2 thus thus ADV crl-14452 111 3 , , PUNCT crl-14452 111 4 data datum NOUN crl-14452 111 5 on on ADP crl-14452 111 6 task task NOUN crl-14452 111 7 uncertainty uncertainty NOUN crl-14452 111 8 collected collect VERB crl-14452 111 9 for for ADP crl-14452 111 10 this this DET crl-14452 111 11 study study NOUN crl-14452 111 12 provide provide VERB crl-14452 111 13 an an DET crl-14452 111 14 opportunity opportunity NOUN crl-14452 111 15 to to ADP crl-14452 111 16 186 186 NUM crl-14452 111 17 college college NOUN crl-14452 111 18 & & CCONJ crl-14452 111 19 research research PROPN crl-14452 111 20 libraries library NOUN crl-14452 111 21 explore explore VERB crl-14452 111 22 the the DET crl-14452 111 23 differences difference NOUN crl-14452 111 24 in in ADP crl-14452 111 25 types type NOUN crl-14452 111 26 of of ADP crl-14452 111 27 questions question NOUN crl-14452 111 28 . . PUNCT crl-14452 112 1 uwork uwork NOUN crl-14452 112 2 flow flow NOUN crl-14452 112 3 uncertainties uncertainty NOUN crl-14452 112 4 are be AUX crl-14452 112 5 created create VERB crl-14452 112 6 by by ADP crl-14452 112 7 unpredictable unpredictable ADJ crl-14452 112 8 client client NOUN crl-14452 112 9 arrival arrival NOUN crl-14452 112 10 , , PUNCT crl-14452 112 11 service service NOUN crl-14452 112 12 , , PUNCT crl-14452 112 13 and and CCONJ crl-14452 112 14 exit exit NOUN crl-14452 112 15 patterns pattern NOUN crl-14452 112 16 . . PUNCT crl-14452 112 17 " " PUNCT crl-14452 113 1 uncertainty uncertainty NOUN crl-14452 113 2 can can AUX crl-14452 113 3 be be AUX crl-14452 113 4 defined define VERB crl-14452 113 5 as as ADP crl-14452 113 6 a a DET crl-14452 113 7 situation situation NOUN crl-14452 113 8 in in ADP crl-14452 113 9 which which PRON crl-14452 113 10 one one PRON crl-14452 113 11 can can AUX crl-14452 113 12 not not PART crl-14452 113 13 control control VERB crl-14452 113 14 or or CCONJ crl-14452 113 15 reliabl~ reliabl~ NOUN crl-14452 113 16 predict predict VERB crl-14452 113 17 all all PRON crl-14452 113 18 of of ADP crl-14452 113 19 the the DET crl-14452 113 20 variables variable NOUN crl-14452 113 21 and and CCONJ crl-14452 113 22 relations relation NOUN crl-14452 113 23 . . PUNCT crl-14452 114 1 uncertainty uncertainty NOUN crl-14452 114 2 is be AUX crl-14452 114 3 also also ADV crl-14452 114 4 thought think VERB crl-14452 114 5 to to PART crl-14452 114 6 have have VERB crl-14452 114 7 an an DET crl-14452 114 8 important important ADJ crl-14452 114 9 influence influence NOUN crl-14452 114 10 upon upon SCONJ crl-14452 114 11 delivery delivery NOUN crl-14452 114 12 of of ADP crl-14452 114 13 services.21 services.21 NOUN crl-14452 114 14 fundamental fundamental ADJ crl-14452 114 15 differences difference NOUN crl-14452 114 16 exist exist VERB crl-14452 114 17 between between ADP crl-14452 114 18 production production NOUN crl-14452 114 19 processes process NOUN crl-14452 114 20 in in ADP crl-14452 114 21 service service NOUN crl-14452 114 22 and and CCONJ crl-14452 114 23 manufacturing manufacturing NOUN crl-14452 114 24 industries industry NOUN crl-14452 114 25 . . PUNCT crl-14452 115 1 these these DET crl-14452 115 2 important important ADJ crl-14452 115 3 differences difference NOUN crl-14452 115 4 include include VERB crl-14452 115 5 work work NOUN crl-14452 115 6 flow flow NOUN crl-14452 115 7 and and CCONJ crl-14452 115 8 task task NOUN crl-14452 115 9 uncertainties uncertainty NOUN crl-14452 115 10 peculiar peculiar ADJ crl-14452 115 11 to to PART crl-14452 115 12 service service NOUN crl-14452 115 13 operations operation NOUN crl-14452 115 14 . . PUNCT crl-14452 116 1 work work NOUN crl-14452 116 2 flow flow NOUN crl-14452 116 3 uncertainties uncertainty NOUN crl-14452 116 4 are be AUX crl-14452 116 5 created create VERB crl-14452 116 6 by by ADP crl-14452 116 7 unpredictable unpredictable ADJ crl-14452 116 8 client client NOUN crl-14452 116 9 arrival arrival NOUN crl-14452 116 10 , , PUNCT crl-14452 116 11 service service NOUN crl-14452 116 12 , , PUNCT crl-14452 116 13 and and CCONJ crl-14452 116 14 exit exit NOUN crl-14452 116 15 patterns pattern NOUN crl-14452 116 16 . . PUNCT crl-14452 117 1 task task NOUN crl-14452 117 2 uncertainty uncertainty NOUN crl-14452 117 3 occurs occur VERB crl-14452 117 4 when when SCONJ crl-14452 117 5 there there PRON crl-14452 117 6 is be VERB crl-14452 117 7 incomplete incomplete ADJ crl-14452 117 8 knowledge knowledge NOUN crl-14452 117 9 about about ADP crl-14452 117 10 how how SCONJ crl-14452 117 11 to to PART crl-14452 117 12 produce produce VERB crl-14452 117 13 a a DET crl-14452 117 14 desired desire VERB crl-14452 117 15 outcome outcome NOUN crl-14452 117 16 . . PUNCT crl-14452 118 1 because because SCONJ crl-14452 118 2 the the DET crl-14452 118 3 production production NOUN crl-14452 118 4 of of ADP crl-14452 118 5 service service NOUN crl-14452 118 6 outcomes outcome NOUN crl-14452 118 7 depends depend VERB crl-14452 118 8 upon upon SCONJ crl-14452 118 9 interaction interaction NOUN crl-14452 118 10 between between ADP crl-14452 118 11 clients client NOUN crl-14452 118 12 and and CCONJ crl-14452 118 13 service service NOUN crl-14452 118 14 providers provider NOUN crl-14452 118 15 , , PUNCT crl-14452 118 16 workers worker NOUN crl-14452 118 17 can can AUX crl-14452 118 18 not not PART crl-14452 118 19 totally totally ADV crl-14452 118 20 rely rely VERB crl-14452 118 21 upon upon SCONJ crl-14452 118 22 past past ADJ crl-14452 118 23 procedures procedure NOUN crl-14452 118 24 when when SCONJ crl-14452 118 25 providing provide VERB crl-14452 118 26 service service NOUN crl-14452 118 27 to to ADP crl-14452 118 28 individual individual ADJ crl-14452 118 29 clients client NOUN crl-14452 118 30 . . PUNCT crl-14452 119 1 thus thus ADV crl-14452 119 2 , , PUNCT crl-14452 119 3 this this DET crl-14452 119 4 obtrusive obtrusive ADJ crl-14452 119 5 study study NOUN crl-14452 119 6 includes include VERB crl-14452 119 7 five five NUM crl-14452 119 8 uncertainty uncertainty NOUN crl-14452 119 9 measures measure NOUN crl-14452 119 10 for for ADP crl-14452 119 11 each each DET crl-14452 119 12 question question NOUN crl-14452 119 13 . . PUNCT crl-14452 120 1 the the DET crl-14452 120 2 five five NUM crl-14452 120 3 measures measure NOUN crl-14452 120 4 are be AUX crl-14452 120 5 librarian librarian ADJ crl-14452 120 6 ratings rating NOUN crl-14452 120 7 of of ADP crl-14452 120 8 : : PUNCT crl-14452 120 9 ( ( PUNCT crl-14452 120 10 1 1 X crl-14452 120 11 ) ) PUNCT crl-14452 120 12 the the DET crl-14452 120 13 frequency frequency NOUN crl-14452 120 14 of of ADP crl-14452 120 15 use use NOUN crl-14452 120 16 of of ADP crl-14452 120 17 sources source NOUN crl-14452 120 18 used use VERB crl-14452 120 19 to to PART crl-14452 120 20 answer answer VERB crl-14452 120 21 a a DET crl-14452 120 22 question question NOUN crl-14452 120 23 , , PUNCT crl-14452 120 24 ( ( PUNCT crl-14452 120 25 2 2 X crl-14452 120 26 ) ) PUNCT crl-14452 120 27 the the DET crl-14452 120 28 question question NOUN crl-14452 120 29 as as ADP crl-14452 120 30 a a DET crl-14452 120 31 new new ADJ crl-14452 120 32 type type NOUN crl-14452 120 33 of of ADP crl-14452 120 34 problem problem NOUN crl-14452 120 35 , , PUNCT crl-14452 120 36 ( ( PUNCT crl-14452 120 37 3 3 X crl-14452 120 38 ) ) PUNCT crl-14452 120 39 the the DET crl-14452 120 40 similarity similarity NOUN crl-14452 120 41 of of ADP crl-14452 120 42 a a DET crl-14452 120 43 question question NOUN crl-14452 120 44 to to ADP crl-14452 120 45 other other ADJ crl-14452 120 46 questions question NOUN crl-14452 120 47 , , PUNCT crl-14452 120 48 ( ( PUNCT crl-14452 120 49 4 4 X crl-14452 120 50 ) ) PUNCT crl-14452 120 51 familiarity familiarity NOUN crl-14452 120 52 with with ADP crl-14452 120 53 the the DET crl-14452 120 54 subject subject NOUN crl-14452 120 55 of of ADP crl-14452 120 56 the the DET crl-14452 120 57 question question NOUN crl-14452 120 58 , , PUNCT crl-14452 120 59 and and CCONJ crl-14452 120 60 ( ( PUNCT crl-14452 120 61 5 5 NUM crl-14452 120 62 ) ) PUNCT crl-14452 120 63 familiarity familiarity NOUN crl-14452 120 64 with with ADP crl-14452 120 65 the the DET crl-14452 120 66 information information NOUN crl-14452 120 67 source source NOUN crl-14452 120 68 used use VERB crl-14452 120 69 to to PART crl-14452 120 70 answer answer VERB crl-14452 120 71 a a DET crl-14452 120 72 question question NOUN crl-14452 120 73 . . PUNCT crl-14452 121 1 librarian librarian ADJ crl-14452 121 2 ratings rating NOUN crl-14452 121 3 are be AUX crl-14452 121 4 compared compare VERB crl-14452 121 5 for for ADP crl-14452 121 6 factual factual ADJ crl-14452 121 7 , , PUNCT crl-14452 121 8 bibliographic bibliographic ADJ crl-14452 121 9 , , PUNCT crl-14452 121 10 and and CCONJ crl-14452 121 11 subject subject ADJ crl-14452 121 12 / / SYM crl-14452 121 13 instructional instructional ADJ crl-14452 121 14 types type NOUN crl-14452 121 15 of of ADP crl-14452 121 16 queries query NOUN crl-14452 121 17 . . PUNCT crl-14452 122 1 factual factual ADJ crl-14452 122 2 and and CCONJ crl-14452 122 3 bibliographic bibliographic ADJ crl-14452 122 4 citation citation NOUN crl-14452 122 5 questions question NOUN crl-14452 122 6 are be AUX crl-14452 122 7 separated separate VERB crl-14452 122 8 for for ADP crl-14452 122 9 this this DET crl-14452 122 10 analysis analysis NOUN crl-14452 122 11 because because SCONJ crl-14452 122 12 the the DET crl-14452 122 13 majority majority NOUN crl-14452 122 14 of of ADP crl-14452 122 15 questions question NOUN crl-14452 122 16 used use VERB crl-14452 122 17 for for ADP crl-14452 122 18 unobtrusive unobtrusive ADJ crl-14452 122 19 studies study NOUN crl-14452 122 20 appear appear VERB crl-14452 122 21 to to ADP crl-14452 122 22 concern concern NOUN crl-14452 122 23 factual factual NOUN crl-14452 122 24 rather rather ADV crl-14452 122 25 than than ADP crl-14452 122 26 bibliographic bibliographic ADJ crl-14452 122 27 citations citation NOUN crl-14452 122 28 . . PUNCT crl-14452 123 1 thus thus ADV crl-14452 123 2 , , PUNCT crl-14452 123 3 this this DET crl-14452 123 4 study study NOUN crl-14452 123 5 compares compare VERB crl-14452 123 6 mean mean VERB crl-14452 123 7 ratings rating NOUN crl-14452 123 8 of of ADP crl-14452 123 9 task task NOUN crl-14452 123 10 uncertainty uncertainty NOUN crl-14452 123 11 for for ADP crl-14452 123 12 the the DET crl-14452 123 13 factual factual ADJ crl-14452 123 14 , , PUNCT crl-14452 123 15 bibliographic bibliographic ADJ crl-14452 123 16 citation citation NOUN crl-14452 123 17 , , PUNCT crl-14452 123 18 and and CCONJ crl-14452 123 19 subject subject ADJ crl-14452 123 20 / / SYM crl-14452 123 21 instructional instructional ADJ crl-14452 123 22 types type NOUN crl-14452 123 23 of of ADP crl-14452 123 24 questions question NOUN crl-14452 123 25 ( ( PUNCT crl-14452 123 26 table table NOUN crl-14452 123 27 5 5 NUM crl-14452 123 28 ) ) PUNCT crl-14452 123 29 and and CCONJ crl-14452 123 30 also also ADV crl-14452 123 31 compares compare VERB crl-14452 123 32 mean mean VERB crl-14452 123 33 ratings rating NOUN crl-14452 123 34 march march PROPN crl-14452 123 35 1989 1989 NUM crl-14452 123 36 of of ADP crl-14452 123 37 task task NOUN crl-14452 123 38 uncertainty uncertainty NOUN crl-14452 123 39 for for ADP crl-14452 123 40 factual factual NOUN crl-14452 123 41 versus versus ADP crl-14452 123 42 all all DET crl-14452 123 43 other other ADJ crl-14452 123 44 types type NOUN crl-14452 123 45 of of ADP crl-14452 123 46 questions question NOUN crl-14452 123 47 ( ( PUNCT crl-14452 123 48 table table NOUN crl-14452 123 49 6 6 NUM crl-14452 123 50 ) ) PUNCT crl-14452 123 51 . . PUNCT crl-14452 124 1 means mean VERB crl-14452 124 2 for for ADP crl-14452 124 3 frequency frequency NOUN crl-14452 124 4 of of ADP crl-14452 124 5 use use NOUN crl-14452 124 6 of of ADP crl-14452 124 7 sources source NOUN crl-14452 124 8 are be AUX crl-14452 124 9 significantly significantly ADV crl-14452 124 10 different different ADJ crl-14452 124 11 for for ADP crl-14452 124 12 factual factual ADJ crl-14452 124 13 and and CCONJ crl-14452 124 14 subject subject ADJ crl-14452 124 15 / / SYM crl-14452 124 16 instructional instructional ADJ crl-14452 124 17 questions question NOUN crl-14452 124 18 , , PUNCT crl-14452 124 19 with with ADP crl-14452 124 20 sources source NOUN crl-14452 124 21 for for ADP crl-14452 124 22 factual factual ADJ crl-14452 124 23 queries query NOUN crl-14452 124 24 used use VERB crl-14452 124 25 less less ADV crl-14452 124 26 frequently frequently ADV crl-14452 124 27 ( ( PUNCT crl-14452 124 28 table table NOUN crl-14452 124 29 5 5 NUM crl-14452 124 30 ) ) PUNCT crl-14452 124 31 . . PUNCT crl-14452 125 1 for for ADP crl-14452 125 2 three three NUM crl-14452 125 3 measures measure NOUN crl-14452 125 4 of of ADP crl-14452 125 5 task task NOUN crl-14452 125 6 uncertainty uncertainty NOUN crl-14452 125 7 - - PUNCT crl-14452 125 8 similarity similarity NOUN crl-14452 125 9 of of ADP crl-14452 125 10 questions question NOUN crl-14452 125 11 , , PUNCT crl-14452 125 12 librarian librarian ADJ crl-14452 125 13 subject subject NOUN crl-14452 125 14 familiarity familiarity NOUN crl-14452 125 15 , , PUNCT crl-14452 125 16 and and CCONJ crl-14452 125 17 librarian librarian ADJ crl-14452 125 18 information information NOUN crl-14452 125 19 source source NOUN crl-14452 125 20 familiarity familiarity NOUN crl-14452 125 21 - - PUNCT crl-14452 125 22 means mean NOUN crl-14452 125 23 for for ADP crl-14452 125 24 factual factual ADJ crl-14452 125 25 and and CCONJ crl-14452 125 26 bibliographic bibliographic ADJ crl-14452 125 27 questions question NOUN crl-14452 125 28 are be AUX crl-14452 125 29 significantly significantly ADV crl-14452 125 30 different different ADJ crl-14452 125 31 . . PUNCT crl-14452 126 1 for for ADP crl-14452 126 2 three three NUM crl-14452 126 3 measures measure NOUN crl-14452 126 4 - - PUNCT crl-14452 126 5 frequency frequency NOUN crl-14452 126 6 of of ADP crl-14452 126 7 use use NOUN crl-14452 126 8 of of ADP crl-14452 126 9 sources source NOUN crl-14452 126 10 , , PUNCT crl-14452 126 11 similarity similarity NOUN crl-14452 126 12 of of ADP crl-14452 126 13 questions question NOUN crl-14452 126 14 , , PUNCT crl-14452 126 15 and and CCONJ crl-14452 126 16 librarian librarian ADJ crl-14452 126 17 subject subject NOUN crl-14452 126 18 familiarity familiarity NOUN crl-14452 126 19 - - PUNCT crl-14452 126 20 there there PRON crl-14452 126 21 are be VERB crl-14452 126 22 significant significant ADJ crl-14452 126 23 differences difference NOUN crl-14452 126 24 between between ADP crl-14452 126 25 the the DET crl-14452 126 26 means mean NOUN crl-14452 126 27 for for ADP crl-14452 126 28 factual factual ADJ crl-14452 126 29 and and CCONJ crl-14452 126 30 other other ADJ crl-14452 126 31 types type NOUN crl-14452 126 32 of of ADP crl-14452 126 33 reference reference NOUN crl-14452 126 34 queries query NOUN crl-14452 126 35 ( ( PUNCT crl-14452 126 36 table table NOUN crl-14452 126 37 6 6 NUM crl-14452 126 38 ) ) PUNCT crl-14452 126 39 . . PUNCT crl-14452 127 1 on on ADP crl-14452 127 2 the the DET crl-14452 127 3 average average ADJ crl-14452 127 4 these these DET crl-14452 127 5 librarians librarians PROPN crl-14452 127 6 regard regard VERB crl-14452 127 7 factual factual ADJ crl-14452 127 8 questions question NOUN crl-14452 127 9 as as ADV crl-14452 127 10 somewhat somewhat ADV crl-14452 127 11 less less ADV crl-14452 127 12 routine routine ADJ crl-14452 127 13 , , PUNCT crl-14452 127 14 because because SCONJ crl-14452 127 15 they they PRON crl-14452 127 16 involve involve VERB crl-14452 127 17 the the DET crl-14452 127 18 use use NOUN crl-14452 127 19 of of ADP crl-14452 127 20 somewhat somewhat ADV crl-14452 127 21 less less ADV crl-14452 127 22 frequently frequently ADV crl-14452 127 23 used use VERB crl-14452 127 24 sources source NOUN crl-14452 127 25 and and CCONJ crl-14452 127 26 are be AUX crl-14452 127 27 slightly slightly ADV crl-14452 127 28 less less ADV crl-14452 127 29 similar similar ADJ crl-14452 127 30 to to ADP crl-14452 127 31 other other ADJ crl-14452 127 32 types type NOUN crl-14452 127 33 of of ADP crl-14452 127 34 questions question NOUN crl-14452 127 35 . . PUNCT crl-14452 128 1 librarians librarian NOUN crl-14452 128 2 also also ADV crl-14452 128 3 report report VERB crl-14452 128 4 somewhat somewhat ADV crl-14452 128 5 less less ADV crl-14452 128 6 subject subject ADJ crl-14452 128 7 familiarity familiarity NOUN crl-14452 128 8 when when SCONJ crl-14452 128 9 responding respond VERB crl-14452 128 10 to to ADP crl-14452 128 11 the the DET crl-14452 128 12 factual factual ADJ crl-14452 128 13 queries query NOUN crl-14452 128 14 included include VERB crl-14452 128 15 in in ADP crl-14452 128 16 this this DET crl-14452 128 17 sample sample NOUN crl-14452 128 18 . . PUNCT crl-14452 129 1 u u PROPN crl-14452 129 2 librarians librarians PROPN crl-14452 129 3 judge judge VERB crl-14452 129 4 factual factual ADJ crl-14452 129 5 questions question NOUN crl-14452 129 6 to to PART crl-14452 129 7 be be AUX crl-14452 129 8 more more ADV crl-14452 129 9 difficult difficult ADJ crl-14452 129 10 because because SCONJ crl-14452 129 11 answering answer VERB crl-14452 129 12 these these DET crl-14452 129 13 questions question NOUN crl-14452 129 14 involves involve VERB crl-14452 129 15 the the DET crl-14452 129 16 use use NOUN crl-14452 129 17 of of ADP crl-14452 129 18 less less ADV crl-14452 129 19 familiar familiar ADJ crl-14452 129 20 , , PUNCT crl-14452 129 21 less less ADV crl-14452 129 22 frequently frequently ADV crl-14452 129 23 used use VERB crl-14452 129 24 sources source NOUN crl-14452 129 25 . . PUNCT crl-14452 129 26 " " PUNCT crl-14452 130 1 mean mean VERB crl-14452 130 2 ratings rating NOUN crl-14452 130 3 of of ADP crl-14452 130 4 the the DET crl-14452 130 5 task task NOUN crl-14452 130 6 uncertainty uncertainty NOUN crl-14452 130 7 involved involve VERB crl-14452 130 8 with with ADP crl-14452 130 9 factual factual ADJ crl-14452 130 10 queries query NOUN crl-14452 130 11 indicate indicate VERB crl-14452 130 12 that that SCONJ crl-14452 130 13 on on ADP crl-14452 130 14 the the DET crl-14452 130 15 average average ADJ crl-14452 130 16 librarians librarian NOUN crl-14452 130 17 in in ADP crl-14452 130 18 this this DET crl-14452 130 19 study study NOUN crl-14452 130 20 view view VERB crl-14452 130 21 the the DET crl-14452 130 22 uncertainty uncertainty NOUN crl-14452 130 23 in in ADP crl-14452 130 24 the the DET crl-14452 130 25 task task NOUN crl-14452 130 26 of of ADP crl-14452 130 27 answering answer VERB crl-14452 130 28 factual factual ADJ crl-14452 130 29 queries query NOUN crl-14452 130 30 as as ADV crl-14452 130 31 somewhat somewhat ADV crl-14452 130 32 greater great ADJ crl-14452 130 33 than than ADP crl-14452 130 34 the the DET crl-14452 130 35 uncertainty uncertainty NOUN crl-14452 130 36 involved involve VERB crl-14452 130 37 in in ADP crl-14452 130 38 answering answer VERB crl-14452 130 39 other other ADJ crl-14452 130 40 queries query NOUN crl-14452 130 41 . . PUNCT crl-14452 131 1 therefore therefore ADV crl-14452 131 2 , , PUNCT crl-14452 131 3 findings finding NOUN crl-14452 131 4 in in ADP crl-14452 131 5 this this DET crl-14452 131 6 study study NOUN crl-14452 131 7 suggest suggest VERB crl-14452 131 8 that that SCONJ crl-14452 131 9 librarians librarians PROPN crl-14452 131 10 judge judge VERB crl-14452 131 11 factual factual ADJ crl-14452 131 12 questions question NOUN crl-14452 131 13 to to PART crl-14452 131 14 be be AUX crl-14452 131 15 more more ADV crl-14452 131 16 difficult difficult ADJ crl-14452 131 17 because because SCONJ crl-14452 131 18 answering answer VERB crl-14452 131 19 these these DET crl-14452 131 20 questions question NOUN crl-14452 131 21 involves involve VERB crl-14452 131 22 the the DET crl-14452 131 23 use use NOUN crl-14452 131 24 of of ADP crl-14452 131 25 less less ADV crl-14452 131 26 familiar familiar ADJ crl-14452 131 27 , , PUNCT crl-14452 131 28 less less ADV crl-14452 131 29 frequently frequently ADV crl-14452 131 30 used use VERB crl-14452 131 31 sources source NOUN crl-14452 131 32 . . PUNCT crl-14452 132 1 represents represent VERB crl-14452 132 2 real real ADJ crl-14452 132 3 - - PUNCT crl-14452 132 4 life life NOUN crl-14452 132 5 patrons patron NOUN crl-14452 132 6 hernon hernon NOUN crl-14452 132 7 and and CCONJ crl-14452 132 8 mcclure mcclure NOUN crl-14452 132 9 argue argue VERB crl-14452 132 10 that that SCONJ crl-14452 132 11 increased increase VERB crl-14452 132 12 use use NOUN crl-14452 132 13 of of ADP crl-14452 132 14 unobtrusive unobtrusive ADJ crl-14452 132 15 testing testing NOUN crl-14452 132 16 of of ADP crl-14452 132 17 referunobtrusive referunobtrusive ADJ crl-14452 132 18 studies study NOUN crl-14452 132 19 187 187 NUM crl-14452 132 20 tables table NOUN crl-14452 132 21 mean mean VERB crl-14452 132 22 ratings rating NOUN crl-14452 132 23 of of ADP crl-14452 132 24 task task NOUN crl-14452 132 25 uncertainty uncertainty NOUN crl-14452 132 26 for for ADP crl-14452 132 27 facfual facfual NOUN crl-14452 132 28 , , PUNCT crl-14452 132 29 bffiliograpidc bffiliograpidc VERB crl-14452 132 30 , , PUNCT crl-14452 132 31 and and CCONJ crl-14452 132 32 subject subject ADJ crl-14452 132 33 / / SYM crl-14452 132 34 instructional instructional ADJ crl-14452 132 35 questions question NOUN crl-14452 132 36 ( ( PUNCT crl-14452 132 37 rating rating NOUN crl-14452 132 38 scale scale NOUN crl-14452 132 39 : : PUNCT crl-14452 132 40 1 1 NUM crl-14452 132 41 = = SYM crl-14452 132 42 very very ADV crl-14452 132 43 great great ADJ crl-14452 132 44 or or CCONJ crl-14452 132 45 completely completely ADV crl-14452 132 46 ; ; PUNCT crl-14452 132 47 7 7 NUM crl-14452 132 48 = = NUM crl-14452 132 49 very very ADV crl-14452 132 50 little little ADV crl-14452 132 51 , , PUNCT crl-14452 132 52 very very ADV crl-14452 132 53 seldom seldom ADV crl-14452 132 54 or or CCONJ crl-14452 132 55 not not PART crl-14452 132 56 at at ADV crl-14452 132 57 all all ADV crl-14452 132 58 ) ) PUNCT crl-14452 132 59 task task NOUN crl-14452 132 60 uncertain uncertain ADJ crl-14452 132 61 ! ! PUNCT crl-14452 132 62 ! ! PUNCT crl-14452 133 1 frequency frequency NOUN crl-14452 133 2 of of ADP crl-14452 133 3 use use NOUN crl-14452 133 4 of of ADP crl-14452 133 5 sources source NOUN crl-14452 133 6 new new ADJ crl-14452 133 7 type type NOUN crl-14452 133 8 of of ADP crl-14452 133 9 problem problem NOUN crl-14452 133 10 similanty similanty PROPN crl-14452 133 11 of of ADP crl-14452 133 12 questions question NOUN crl-14452 133 13 librarian librarian ADJ crl-14452 133 14 subject subject NOUN crl-14452 133 15 familiarity familiarity NOUN crl-14452 133 16 librarian librarian ADJ crl-14452 133 17 information information NOUN crl-14452 133 18 source source NOUN crl-14452 133 19 familiari!y familiari!y PROPN crl-14452 133 20 * * PUNCT crl-14452 133 21 p<.os p<.os NOUN crl-14452 133 22 tp<.ol tp<.ol NOUN crl-14452 133 23 fact fact NOUN crl-14452 133 24 . . PUNCT crl-14452 134 1 bibl bibl PROPN crl-14452 134 2 . . PUNCT crl-14452 135 1 2.7c 2.7c NUM crl-14452 135 2 ? ? NUM crl-14452 135 3 2.07 2.07 NUM crl-14452 135 4 6.00 6.00 NUM crl-14452 135 5 6.04 6.04 NUM crl-14452 135 6 3.38b 3.38b NUM crl-14452 135 7 2.15b 2.15b NUM crl-14452 135 8 3.59b 3.59b NUM crl-14452 135 9 2.48b 2.48b NOUN crl-14452 135 10 2.5~ 2.5~ NUM crl-14452 135 11 1.5~ 1.5~ NUM crl-14452 135 12 subject/ subject/ NUM crl-14452 135 13 instruct instruct NOUN crl-14452 135 14 . . PUNCT crl-14452 136 1 df df PROPN crl-14452 136 2 f f PROPN crl-14452 136 3 2.038 2.038 NUM crl-14452 136 4 2,249 2,249 NUM crl-14452 136 5 3.34 3.34 NUM crl-14452 136 6 * * NUM crl-14452 136 7 5.73 5.73 NUM crl-14452 136 8 2,252 2,252 NUM crl-14452 137 1 .40 .40 NUM crl-14452 137 2 2.69 2.69 NUM crl-14452 137 3 2,253 2,253 NUM crl-14452 137 4 5.20 5.20 NUM crl-14452 137 5 + + NUM crl-14452 137 6 2.% 2.% NUM crl-14452 137 7 2,253 2,253 NUM crl-14452 137 8 3.52 3.52 NUM crl-14452 137 9 * * NUM crl-14452 137 10 2.25c 2.25c NUM crl-14452 137 11 2,253 2,253 NUM crl-14452 137 12 5.53 5.53 NUM crl-14452 137 13 + + NUM crl-14452 137 14 8 8 NUM crl-14452 137 15 means mean NOUN crl-14452 137 16 for for ADP crl-14452 137 17 factual factual ADJ crl-14452 137 18 and and CCONJ crl-14452 137 19 subject subject ADJ crl-14452 137 20 / / SYM crl-14452 137 21 instructional instructional ADJ crl-14452 137 22 queries query NOUN crl-14452 137 23 are be AUX crl-14452 137 24 significantly significantly ADV crl-14452 137 25 different different ADJ crl-14452 137 26 at at ADP crl-14452 137 27 the the DET crl-14452 137 28 .os .os PUNCT crl-14452 137 29 level level NOUN crl-14452 137 30 ( ( PUNCT crl-14452 137 31 scheffe scheffe ADJ crl-14452 137 32 test test NOUN crl-14452 137 33 ) ) PUNCT crl-14452 137 34 . . PUNCT crl-14452 138 1 ~eans ~ean NOUN crl-14452 138 2 for for ADP crl-14452 138 3 factual factual ADJ crl-14452 138 4 and and CCONJ crl-14452 138 5 bibliographic bibliographic ADJ crl-14452 138 6 queries query NOUN crl-14452 138 7 are be AUX crl-14452 138 8 significantly significantly ADV crl-14452 138 9 different different ADJ crl-14452 138 10 at at ADP crl-14452 138 11 the the DET crl-14452 138 12 .os .os PUNCT crl-14452 138 13 level level NOUN crl-14452 138 14 ( ( PUNCT crl-14452 138 15 scheffe scheffe ADJ crl-14452 138 16 test test NOUN crl-14452 138 17 ) ) PUNCT crl-14452 138 18 . . PUNCT crl-14452 139 1 ~eans ~ean NOUN crl-14452 139 2 for for ADP crl-14452 139 3 factual factual ADJ crl-14452 139 4 and and CCONJ crl-14452 139 5 subject subject ADJ crl-14452 139 6 / / SYM crl-14452 139 7 instructional instructional ADJ crl-14452 139 8 queries query NOUN crl-14452 139 9 are be AUX crl-14452 139 10 significantly significantly ADV crl-14452 139 11 different different ADJ crl-14452 139 12 from from ADP crl-14452 139 13 bibliographic bibliographic ADJ crl-14452 139 14 queries query NOUN crl-14452 139 15 ( ( PUNCT crl-14452 139 16 scheffe scheffe ADJ crl-14452 139 17 test test NOUN crl-14452 139 18 ) ) PUNCT crl-14452 139 19 . . PUNCT crl-14452 140 1 table6 table6 NOUN crl-14452 140 2 mean mean VERB crl-14452 140 3 ratings rating NOUN crl-14452 140 4 of of ADP crl-14452 140 5 task task NOUN crl-14452 140 6 uncertainty uncertainty NOUN crl-14452 140 7 for for ADP crl-14452 140 8 facfual facfual NOUN crl-14452 140 9 versus versus ADP crl-14452 140 10 other other ADJ crl-14452 140 11 types type NOUN crl-14452 140 12 of of ADP crl-14452 140 13 questions question NOUN crl-14452 140 14 ( ( PUNCT crl-14452 140 15 rating rating NOUN crl-14452 140 16 scale scale NOUN crl-14452 140 17 : : PUNCT crl-14452 140 18 1 1 NUM crl-14452 140 19 = = SYM crl-14452 140 20 very very ADV crl-14452 140 21 great great ADJ crl-14452 140 22 or or CCONJ crl-14452 140 23 completely completely ADV crl-14452 140 24 ; ; PUNCT crl-14452 140 25 7 7 NUM crl-14452 140 26 = = NUM crl-14452 140 27 very very ADV crl-14452 140 28 little little ADV crl-14452 140 29 , , PUNCT crl-14452 140 30 very very ADV crl-14452 140 31 seldom seldom ADV crl-14452 140 32 or or CCONJ crl-14452 140 33 not not PART crl-14452 140 34 at at ADV crl-14452 140 35 all all ADV crl-14452 140 36 ) ) PUNCT crl-14452 140 37 task task NOUN crl-14452 140 38 uncertainty uncertainty NOUN crl-14452 140 39 frequency frequency NOUN crl-14452 140 40 of of ADP crl-14452 140 41 use use NOUN crl-14452 140 42 of of ADP crl-14452 140 43 sources source NOUN crl-14452 140 44 new new ADJ crl-14452 140 45 type type NOUN crl-14452 140 46 of of ADP crl-14452 140 47 problem problem NOUN crl-14452 140 48 similanty similanty PROPN crl-14452 140 49 of of ADP crl-14452 140 50 questions question NOUN crl-14452 140 51 librarian librarian ADJ crl-14452 140 52 subject subject NOUN crl-14452 140 53 familiarity familiarity NOUN crl-14452 140 54 librarian librarian ADJ crl-14452 140 55 information information NOUN crl-14452 140 56 source source NOUN crl-14452 140 57 familiari!y familiari!y PROPN crl-14452 140 58 * * PUNCT crl-14452 141 1 p p NOUN crl-14452 141 2 < < X crl-14452 141 3 .os .os X crl-14452 142 1 ence ence NOUN crl-14452 142 2 services service NOUN crl-14452 142 3 is be AUX crl-14452 142 4 necessary necessary ADJ crl-14452 142 5 because because SCONJ crl-14452 142 6 it it PRON crl-14452 142 7 provides provide VERB crl-14452 142 8 an an DET crl-14452 142 9 excellent excellent ADJ crl-14452 142 10 means mean NOUN crl-14452 142 11 to to PART crl-14452 142 12 see see VERB crl-14452 142 13 the the DET crl-14452 142 14 library library NOUN crl-14452 142 15 and and CCONJ crl-14452 142 16 its its PRON crl-14452 142 17 services service NOUN crl-14452 142 18 from from ADP crl-14452 142 19 the the DET crl-14452 142 20 viewpoint viewpoint NOUN crl-14452 142 21 of of ADP crl-14452 142 22 the the DET crl-14452 142 23 patron patron NOUN crl-14452 142 24 . . PUNCT crl-14452 143 1 22 22 NUM crl-14452 143 2 however however ADV crl-14452 143 3 , , PUNCT crl-14452 143 4 unobtrusive unobtrusive ADJ crl-14452 143 5 testing testing NOUN crl-14452 143 6 takes take VERB crl-14452 143 7 the the DET crl-14452 143 8 view view NOUN crl-14452 143 9 that that SCONJ crl-14452 143 10 information information NOUN crl-14452 143 11 is be AUX crl-14452 143 12 a a DET crl-14452 143 13 commodity commodity NOUN crl-14452 143 14 . . PUNCT crl-14452 144 1 catherine catherine PROPN crl-14452 144 2 sheldrick sheldrick PROPN crl-14452 144 3 ross ross PROPN crl-14452 144 4 notes note VERB crl-14452 144 5 that that SCONJ crl-14452 144 6 if if SCONJ crl-14452 144 7 we we PRON crl-14452 144 8 think think VERB crl-14452 144 9 of of ADP crl-14452 144 10 information information NOUN crl-14452 144 11 as as ADP crl-14452 144 12 a a DET crl-14452 144 13 commodity commodity NOUN crl-14452 144 14 , , PUNCT crl-14452 144 15 as as SCONJ crl-14452 144 16 existing exist VERB crl-14452 144 17 apart apart ADV crl-14452 144 18 from from ADP crl-14452 144 19 people people NOUN crl-14452 144 20 or or CCONJ crl-14452 144 21 their their PRON crl-14452 144 22 contexts context NOUN crl-14452 144 23 , , PUNCT crl-14452 144 24 then then ADV crl-14452 144 25 questions question NOUN crl-14452 144 26 and and CCONJ crl-14452 144 27 answers answer NOUN crl-14452 144 28 can can AUX crl-14452 144 29 be be AUX crl-14452 144 30 held hold VERB crl-14452 144 31 to to PART crl-14452 144 32 exist exist VERB crl-14452 144 33 independently independently ADV crl-14452 144 34 . . PUNCT crl-14452 145 1 23 23 NUM crl-14452 145 2 library library NOUN crl-14452 145 3 schools school NOUN crl-14452 145 4 have have AUX crl-14452 145 5 typically typically ADV crl-14452 145 6 taught teach VERB crl-14452 145 7 and and CCONJ crl-14452 145 8 evaluated evaluate VERB crl-14452 145 9 basic basic ADJ crl-14452 145 10 reference reference NOUN crl-14452 145 11 courses course NOUN crl-14452 145 12 this this DET crl-14452 145 13 way way NOUN crl-14452 145 14 . . PUNCT crl-14452 146 1 they they PRON crl-14452 146 2 give give VERB crl-14452 146 3 students student NOUN crl-14452 146 4 questions question NOUN crl-14452 146 5 to to PART crl-14452 146 6 answer answer VERB crl-14452 146 7 . . PUNCT crl-14452 147 1 this this DET crl-14452 147 2 approach approach NOUN crl-14452 147 3 strengthens strengthen VERB crl-14452 147 4 the the DET crl-14452 147 5 tendency tendency NOUN crl-14452 147 6 of of ADP crl-14452 147 7 these these DET crl-14452 147 8 future future NOUN crl-14452 147 9 librarians librarian VERB crl-14452 147 10 to to PART crl-14452 147 11 conceptualize conceptualize VERB crl-14452 147 12 information information NOUN crl-14452 147 13 as as ADP crl-14452 147 14 a a DET crl-14452 147 15 commodity commodity NOUN crl-14452 147 16 with with ADP crl-14452 147 17 no no DET crl-14452 147 18 reference reference NOUN crl-14452 147 19 to to ADP crl-14452 147 20 its its PRON crl-14452 147 21 context context NOUN crl-14452 147 22 in in ADP crl-14452 147 23 the the DET crl-14452 147 24 life life NOUN crl-14452 147 25 of of ADP crl-14452 147 26 the the DET crl-14452 147 27 inquirer inquirer NOUN crl-14452 147 28 . . PUNCT crl-14452 148 1 in in ADP crl-14452 148 2 reality reality NOUN crl-14452 148 3 people people NOUN crl-14452 148 4 ask ask VERB crl-14452 148 5 questions question NOUN crl-14452 148 6 to to PART crl-14452 148 7 fill fill VERB crl-14452 148 8 gaps gap NOUN crl-14452 148 9 in in ADP crl-14452 148 10 their their PRON crl-14452 148 11 understanding understanding NOUN crl-14452 148 12 so so SCONJ crl-14452 148 13 that that SCONJ crl-14452 148 14 they they PRON crl-14452 148 15 can can AUX crl-14452 148 16 use use VERB crl-14452 148 17 the the DET crl-14452 148 18 information information NOUN crl-14452 148 19 as as ADP crl-14452 148 20 a a DET crl-14452 148 21 means means NOUN crl-14452 148 22 to to ADP crl-14452 148 23 an an DET crl-14452 148 24 end end NOUN crl-14452 148 25 . . PUNCT crl-14452 149 1 users user NOUN crl-14452 149 2 are be AUX crl-14452 149 3 helped help VERB crl-14452 149 4 to to ADP crl-14452 149 5 the the DET crl-14452 149 6 extent extent NOUN crl-14452 149 7 that that SCONJ crl-14452 149 8 the the DET crl-14452 149 9 answers answer NOUN crl-14452 149 10 to to ADP crl-14452 149 11 their their PRON crl-14452 149 12 questions question NOUN crl-14452 149 13 help help VERB crl-14452 149 14 them they PRON crl-14452 149 15 type type NOUN crl-14452 149 16 of of ADP crl-14452 149 17 question question NOUN crl-14452 149 18 factual factual NOUN crl-14452 149 19 all all DET crl-14452 149 20 others other NOUN crl-14452 149 21 df df VERB crl-14452 149 22 f f PROPN crl-14452 149 23 2.79 2.79 NUM crl-14452 149 24 2.04 2.04 NUM crl-14452 149 25 1,250 1,250 NUM crl-14452 149 26 6.67 6.67 NUM crl-14452 149 27 * * NUM crl-14452 149 28 6.00 6.00 NUM crl-14452 149 29 5.79 5.79 NUM crl-14452 149 30 1,253 1,253 NUM crl-14452 149 31 .44 .44 NUM crl-14452 149 32 3.38 3.38 NUM crl-14452 149 33 2.58 2.58 NUM crl-14452 149 34 1,254 1,254 NUM crl-14452 149 35 6.22 6.22 NUM crl-14452 149 36 * * SYM crl-14452 149 37 3.59 3.59 NUM crl-14452 149 38 2.86 2.86 NUM crl-14452 149 39 1,254 1,254 NUM crl-14452 149 40 4.27 4.27 NUM crl-14452 149 41 * * NUM crl-14452 149 42 2.59 2.59 NUM crl-14452 149 43 2.11 2.11 NUM crl-14452 149 44 1,254 1,254 NUM crl-14452 149 45 2.83 2.83 NUM crl-14452 149 46 accomplish accomplish ADJ crl-14452 149 47 something something PRON crl-14452 149 48 . . PUNCT crl-14452 150 1 librarians librarian NOUN crl-14452 150 2 who who PRON crl-14452 150 3 answer answer VERB crl-14452 150 4 questions question NOUN crl-14452 150 5 without without ADP crl-14452 150 6 knowing know VERB crl-14452 150 7 anything anything PRON crl-14452 150 8 about about ADP crl-14452 150 9 the the DET crl-14452 150 10 context context NOUN crl-14452 150 11 may may AUX crl-14452 150 12 provide provide VERB crl-14452 150 13 an an DET crl-14452 150 14 answer answer NOUN crl-14452 150 15 that that PRON crl-14452 150 16 is be AUX crl-14452 150 17 technically technically ADV crl-14452 150 18 correct correct ADJ crl-14452 150 19 but but CCONJ crl-14452 150 20 is be AUX crl-14452 150 21 otherwise otherwise ADV crl-14452 150 22 unhelpful unhelpful ADJ crl-14452 150 23 in in ADP crl-14452 150 24 filling fill VERB crl-14452 150 25 the the DET crl-14452 150 26 user user NOUN crl-14452 150 27 's 's PART crl-14452 150 28 need need NOUN crl-14452 150 29 . . PUNCT crl-14452 151 1 24 24 NUM crl-14452 151 2 fred fre VERB crl-14452 151 3 oser oser NOUN crl-14452 151 4 summarizes summarize VERB crl-14452 151 5 trends trend NOUN crl-14452 151 6 on on ADP crl-14452 151 7 the the DET crl-14452 151 8 basis basis NOUN crl-14452 151 9 of of ADP crl-14452 151 10 a a DET crl-14452 151 11 survey survey NOUN crl-14452 151 12 of of ADP crl-14452 151 13 the the DET crl-14452 151 14 literature literature NOUN crl-14452 151 15 and and CCONJ crl-14452 151 16 concludes conclude VERB crl-14452 151 17 that that SCONJ crl-14452 151 18 there there PRON crl-14452 151 19 is be VERB crl-14452 151 20 a a DET crl-14452 151 21 large large ADJ crl-14452 151 22 area area NOUN crl-14452 151 23 of of ADP crl-14452 151 24 situational situational ADJ crl-14452 151 25 content content NOUN crl-14452 151 26 that that PRON crl-14452 151 27 can can AUX crl-14452 151 28 be be AUX crl-14452 151 29 of of ADP crl-14452 151 30 great great ADJ crl-14452 151 31 use use NOUN crl-14452 151 32 to to ADP crl-14452 151 33 the the DET crl-14452 151 34 librarian librarian NOUN crl-14452 151 35 in in ADP crl-14452 151 36 conducting conduct VERB crl-14452 151 37 an an DET crl-14452 151 38 efficient efficient ADJ crl-14452 151 39 and and CCONJ crl-14452 151 40 rapid rapid ADJ crl-14452 151 41 interview interview NOUN crl-14452 151 42 . . PUNCT crl-14452 152 1 the the DET crl-14452 152 2 type type NOUN crl-14452 152 3 of of ADP crl-14452 152 4 library library NOUN crl-14452 152 5 in in ADP crl-14452 152 6 which which PRON crl-14452 152 7 one one NOUN crl-14452 152 8 is be AUX crl-14452 152 9 working work VERB crl-14452 152 10 can can AUX crl-14452 152 11 lead lead VERB crl-14452 152 12 to to ADP crl-14452 152 13 highly highly ADV crl-14452 152 14 predictable predictable ADJ crl-14452 152 15 expectations expectation NOUN crl-14452 152 16 toward toward ADP crl-14452 152 17 purpose purpose NOUN crl-14452 152 18 , , PUNCT crl-14452 152 19 scope scope NOUN crl-14452 152 20 , , PUNCT crl-14452 152 21 and and CCONJ crl-14452 152 22 level level NOUN crl-14452 152 23 of of ADP crl-14452 152 24 reference reference NOUN crl-14452 152 25 queries query NOUN crl-14452 152 26 . . PUNCT crl-14452 153 1 25 25 NUM crl-14452 153 2 helen helen PROPN crl-14452 153 3 gothberg gothberg PROPN crl-14452 153 4 also also ADV crl-14452 153 5 notes note VERB crl-14452 153 6 the the DET crl-14452 153 7 variability variability NOUN crl-14452 153 8 in in ADP crl-14452 153 9 levels level NOUN crl-14452 153 10 of of ADP crl-14452 153 11 service service NOUN crl-14452 153 12 , , PUNCT crl-14452 153 13 which which PRON crl-14452 153 14 are be AUX crl-14452 153 15 based base VERB crl-14452 153 16 to to ADP crl-14452 153 17 a a DET crl-14452 153 18 considerable considerable ADJ crl-14452 153 19 extent extent NOUN crl-14452 153 20 on on ADP crl-14452 153 21 the the DET crl-14452 153 22 type type NOUN crl-14452 153 23 of of ADP crl-14452 153 24 library library NOUN crl-14452 153 25 . . PUNCT crl-14452 154 1 for for ADP crl-14452 154 2 example example NOUN crl-14452 154 3 , , PUNCT crl-14452 154 4 a a DET crl-14452 154 5 special special ADJ crl-14452 154 6 library library NOUN crl-14452 154 7 with with ADP crl-14452 154 8 its its PRON crl-14452 154 9 limited limited ADJ crl-14452 154 10 clientele clientele NOUN crl-14452 154 11 may may AUX crl-14452 154 12 find find VERB crl-14452 154 13 it it PRON crl-14452 154 14 most most ADV crl-14452 154 15 expedient expedient ADJ crl-14452 154 16 to to PART crl-14452 154 17 provide provide VERB crl-14452 154 18 the the DET crl-14452 154 19 answer answer NOUN crl-14452 154 20 . . PUNCT crl-14452 155 1 on on ADP crl-14452 155 2 the the DET crl-14452 155 3 other other ADJ crl-14452 155 4 hand hand NOUN crl-14452 155 5 , , PUNCT crl-14452 155 6 libraries library NOUN crl-14452 155 7 located locate VERB crl-14452 155 8 in in ADP crl-14452 155 9 educational educational ADJ crl-14452 155 10 institutions institution NOUN crl-14452 155 11 place place VERB crl-14452 155 12 a a DET crl-14452 155 13 greater great ADJ crl-14452 155 14 emphasis emphasis NOUN crl-14452 155 15 on on ADP crl-14452 155 16 educating educate VERB crl-14452 155 17 the the DET crl-14452 155 18 188 188 NUM crl-14452 155 19 college college PROPN crl-14452 155 20 & & CCONJ crl-14452 155 21 research research PROPN crl-14452 155 22 libraries librarie VERB crl-14452 155 23 user user NOUN crl-14452 155 24 to to PART crl-14452 155 25 answer answer VERB crl-14452 155 26 his his PRON crl-14452 155 27 / / SYM crl-14452 155 28 her her PRON crl-14452 155 29 own own ADJ crl-14452 155 30 questions question NOUN crl-14452 155 31 at at ADP crl-14452 155 32 the the DET crl-14452 155 33 basic basic ADJ crl-14452 155 34 level level NOUN crl-14452 155 35 of of ADP crl-14452 155 36 information information NOUN crl-14452 155 37 need need NOUN crl-14452 155 38 ; ; PUNCT crl-14452 155 39 yet yet CCONJ crl-14452 155 40 there there PRON crl-14452 155 41 need need AUX crl-14452 155 42 be be AUX crl-14452 155 43 nothing nothing PRON crl-14452 155 44 minimal minimal ADJ crl-14452 155 45 about about ADP crl-14452 155 46 the the DET crl-14452 155 47 type type NOUN crl-14452 155 48 of of ADP crl-14452 155 49 instruction instruction NOUN crl-14452 155 50 provided provide VERB crl-14452 155 51 . . PUNCT crl-14452 156 1 26 26 NUM crl-14452 156 2 in in ADP crl-14452 156 3 this this DET crl-14452 156 4 study study NOUN crl-14452 156 5 , , PUNCT crl-14452 156 6 a a DET crl-14452 156 7 substantial substantial ADJ crl-14452 156 8 proportion proportion NOUN crl-14452 156 9 ( ( PUNCT crl-14452 156 10 23 23 NUM crl-14452 156 11 . . NUM crl-14452 156 12 9 9 NUM crl-14452 156 13 percent percent NOUN crl-14452 156 14 ) ) PUNCT crl-14452 156 15 of of ADP crl-14452 156 16 the the DET crl-14452 156 17 bibliographic bibliographic ADJ crl-14452 156 18 citation citation NOUN crl-14452 156 19 questions question NOUN crl-14452 156 20 are be AUX crl-14452 156 21 identified identify VERB crl-14452 156 22 in in ADP crl-14452 156 23 the the DET crl-14452 156 24 context context NOUN crl-14452 156 25 of of ADP crl-14452 156 26 the the DET crl-14452 156 27 library library NOUN crl-14452 156 28 . . PUNCT crl-14452 157 1 that that PRON crl-14452 157 2 is be AUX crl-14452 157 3 , , PUNCT crl-14452 157 4 the the DET crl-14452 157 5 library library NOUN crl-14452 157 6 user user NOUN crl-14452 157 7 had have VERB crl-14452 157 8 an an DET crl-14452 157 9 index index NOUN crl-14452 157 10 or or CCONJ crl-14452 157 11 other other ADJ crl-14452 157 12 bibliographic bibliographic ADJ crl-14452 157 13 material material NOUN crl-14452 157 14 in in ADP crl-14452 157 15 hand hand NOUN crl-14452 157 16 and and CCONJ crl-14452 157 17 wanted want VERB crl-14452 157 18 the the DET crl-14452 157 19 librarian librarian NOUN crl-14452 157 20 's 's PART crl-14452 157 21 assistance assistance NOUN crl-14452 157 22 with with ADP crl-14452 157 23 locating locate VERB crl-14452 157 24 one one NUM crl-14452 157 25 or or CCONJ crl-14452 157 26 more more ADJ crl-14452 157 27 references reference NOUN crl-14452 157 28 and/or and/or CCONJ crl-14452 157 29 understanding understand VERB crl-14452 157 30 the the DET crl-14452 157 31 meaning meaning NOUN crl-14452 157 32 of of ADP crl-14452 157 33 different different ADJ crl-14452 157 34 parts part NOUN crl-14452 157 35 of of ADP crl-14452 157 36 the the DET crl-14452 157 37 citation citation NOUN crl-14452 157 38 . . PUNCT crl-14452 158 1 this this DET crl-14452 158 2 relatively relatively ADV crl-14452 158 3 straightforward straightforward ADJ crl-14452 158 4 , , PUNCT crl-14452 158 5 but but CCONJ crl-14452 158 6 nonetheless nonetheless ADV crl-14452 158 7 important important ADJ crl-14452 158 8 class class NOUN crl-14452 158 9 of of ADP crl-14452 158 10 bibliographic bibliographic ADJ crl-14452 158 11 citation citation NOUN crl-14452 158 12 questions question NOUN crl-14452 158 13 does do AUX crl-14452 158 14 not not PART crl-14452 158 15 appear appear VERB crl-14452 158 16 to to PART crl-14452 158 17 be be AUX crl-14452 158 18 represented represent VERB crl-14452 158 19 in in ADP crl-14452 158 20 unobtrusive unobtrusive ADJ crl-14452 158 21 studies study NOUN crl-14452 158 22 . . PUNCT crl-14452 159 1 the the DET crl-14452 159 2 unobtrusive unobtrusive ADJ crl-14452 159 3 model model NOUN crl-14452 159 4 of of ADP crl-14452 159 5 testing testing NOUN crl-14452 159 6 reference reference NOUN crl-14452 159 7 service service NOUN crl-14452 159 8 assumes assume VERB crl-14452 159 9 that that SCONJ crl-14452 159 10 the the DET crl-14452 159 11 librarian librarian NOUN crl-14452 159 12 is be AUX crl-14452 159 13 responsible responsible ADJ crl-14452 159 14 for for ADP crl-14452 159 15 finding find VERB crl-14452 159 16 the the DET crl-14452 159 17 correct correct ADJ crl-14452 159 18 answer answer NOUN crl-14452 159 19 . . PUNCT crl-14452 160 1 a a DET crl-14452 160 2 proxy proxy NOUN crl-14452 160 3 is be AUX crl-14452 160 4 hired hire VERB crl-14452 160 5 to to PART crl-14452 160 6 conduct conduct VERB crl-14452 160 7 the the DET crl-14452 160 8 test test NOUN crl-14452 160 9 . . PUNCT crl-14452 161 1 hernon hernon PROPN crl-14452 161 2 and and CCONJ crl-14452 161 3 mcclure mcclure NOUN crl-14452 161 4 note note NOUN crl-14452 161 5 that that SCONJ crl-14452 161 6 research research NOUN crl-14452 161 7 has have AUX crl-14452 161 8 shown show VERB crl-14452 161 9 that that SCONJ crl-14452 161 10 many many ADJ crl-14452 161 11 users user NOUN crl-14452 161 12 of of ADP crl-14452 161 13 academic academic ADJ crl-14452 161 14 and and CCONJ crl-14452 161 15 public public ADJ crl-14452 161 16 libraries library NOUN crl-14452 161 17 are be AUX crl-14452 161 18 not not PART crl-14452 161 19 aggressive aggressive ADJ crl-14452 161 20 in in ADP crl-14452 161 21 pressing press VERB crl-14452 161 22 staff staff NOUN crl-14452 161 23 for for ADP crl-14452 161 24 an an DET crl-14452 161 25 answer answer NOUN crl-14452 161 26 . . PUNCT crl-14452 162 1 27 27 NUM crl-14452 162 2 they they PRON crl-14452 162 3 also also ADV crl-14452 162 4 indicate indicate VERB crl-14452 162 5 that that SCONJ crl-14452 162 6 , , PUNCT crl-14452 162 7 ultimately ultimately ADV crl-14452 162 8 , , PUNCT crl-14452 162 9 the the DET crl-14452 162 10 responsibility responsibility NOUN crl-14452 162 11 for for ADP crl-14452 162 12 ensuring ensure VERB crl-14452 162 13 that that SCONJ crl-14452 162 14 the the DET crl-14452 162 15 patrons patron NOUN crl-14452 162 16 ' ' PART crl-14452 162 17 information information NOUN crl-14452 162 18 needs need NOUN crl-14452 162 19 are be AUX crl-14452 162 20 met meet VERB crl-14452 162 21 belongs belong VERB crl-14452 162 22 to to ADP crl-14452 162 23 library library PROPN crl-14452 162 24 management.28 management.28 PROPN crl-14452 162 25 proxies proxy NOUN crl-14452 162 26 neither neither CCONJ crl-14452 162 27 suggested suggest VERB crl-14452 162 28 sources source NOUN crl-14452 162 29 or or CCONJ crl-14452 162 30 places place NOUN crl-14452 162 31 where where SCONJ crl-14452 162 32 the the DET crl-14452 162 33 answer answer NOUN crl-14452 162 34 might might AUX crl-14452 162 35 be be AUX crl-14452 162 36 obtained obtain VERB crl-14452 162 37 nor nor CCONJ crl-14452 162 38 encouraged encouraged ADJ crl-14452 162 39 referrals referral NOUN crl-14452 162 40 . . PUNCT crl-14452 163 1 the the DET crl-14452 163 2 methodology methodology NOUN crl-14452 163 3 also also ADV crl-14452 163 4 makes make VERB crl-14452 163 5 librarians librarian NOUN crl-14452 163 6 , , PUNCT crl-14452 163 7 not not PART crl-14452 163 8 users user NOUN crl-14452 163 9 , , PUNCT crl-14452 163 10 responsible responsible ADJ crl-14452 163 11 for for ADP crl-14452 163 12 locating locating NOUN crl-14452 163 13 and and CCONJ crl-14452 163 14 verifying verify VERB crl-14452 163 15 the the DET crl-14452 163 16 exact exact ADJ crl-14452 163 17 information information NOUN crl-14452 163 18 . . PUNCT crl-14452 164 1 hernon hernon NOUN crl-14452 164 2 and and CCONJ crl-14452 164 3 mcclure mcclure NOUN crl-14452 164 4 note note NOUN crl-14452 164 5 that that SCONJ crl-14452 164 6 when when SCONJ crl-14452 164 7 library library NOUN crl-14452 164 8 personnel personnel NOUN crl-14452 164 9 referred refer VERB crl-14452 164 10 a a DET crl-14452 164 11 proxy proxy NOUN crl-14452 164 12 to to ADP crl-14452 164 13 a a DET crl-14452 164 14 source source NOUN crl-14452 164 15 , , PUNCT crl-14452 164 16 but but CCONJ crl-14452 164 17 did do AUX crl-14452 164 18 not not PART crl-14452 164 19 offer offer VERB crl-14452 164 20 to to PART crl-14452 164 21 look look VERB crl-14452 164 22 for for ADP crl-14452 164 23 the the DET crl-14452 164 24 answer answer NOUN crl-14452 164 25 , , PUNCT crl-14452 164 26 the the DET crl-14452 164 27 proxy proxy NOUN crl-14452 164 28 would would AUX crl-14452 164 29 pretend pretend VERB crl-14452 164 30 to to PART crl-14452 164 31 examine examine VERB crl-14452 164 32 the the DET crl-14452 164 33 source source NOUN crl-14452 164 34 for for ADP crl-14452 164 35 a a DET crl-14452 164 36 short short ADJ crl-14452 164 37 time time NOUN crl-14452 164 38 and and CCONJ crl-14452 164 39 return return VERB crl-14452 164 40 to to ADP crl-14452 164 41 the the DET crl-14452 164 42 same same ADJ crl-14452 164 43 person person NOUN crl-14452 164 44 for for ADP crl-14452 164 45 further further ADJ crl-14452 164 46 guidance guidance NOUN crl-14452 164 47 in in ADP crl-14452 164 48 use use NOUN crl-14452 164 49 of of ADP crl-14452 164 50 the the DET crl-14452 164 51 source source NOUN crl-14452 164 52 . . PUNCT crl-14452 165 1 29 29 NUM crl-14452 165 2 but but CCONJ crl-14452 165 3 in in ADP crl-14452 165 4 reality reality NOUN crl-14452 165 5 , , PUNCT crl-14452 165 6 user user NOUN crl-14452 165 7 behavior behavior NOUN crl-14452 165 8 may may AUX crl-14452 165 9 significantly significantly ADV crl-14452 165 10 affect affect VERB crl-14452 165 11 reference reference NOUN crl-14452 165 12 performance performance NOUN crl-14452 165 13 . . PUNCT crl-14452 166 1 wilson wilson PROPN crl-14452 166 2 notes note VERB crl-14452 166 3 that that SCONJ crl-14452 166 4 in in ADP crl-14452 166 5 the the DET crl-14452 166 6 delivery delivery NOUN crl-14452 166 7 of of ADP crl-14452 166 8 reference reference NOUN crl-14452 166 9 service service NOUN crl-14452 166 10 , , PUNCT crl-14452 166 11 limits limit NOUN crl-14452 166 12 are be AUX crl-14452 166 13 set set VERB crl-14452 166 14 by by ADP crl-14452 166 15 the the DET crl-14452 166 16 preferences preference NOUN crl-14452 166 17 , , PUNCT crl-14452 166 18 habits habit NOUN crl-14452 166 19 , , PUNCT crl-14452 166 20 abilities ability NOUN crl-14452 166 21 , , PUNCT crl-14452 166 22 and and CCONJ crl-14452 166 23 resources resource NOUN crl-14452 166 24 of of ADP crl-14452 166 25 the the DET crl-14452 166 26 user user NOUN crl-14452 166 27 . . PUNCT crl-14452 167 1 the the DET crl-14452 167 2 library library NOUN crl-14452 167 3 can can AUX crl-14452 167 4 not not PART crl-14452 167 5 supply supply VERB crl-14452 167 6 the the DET crl-14452 167 7 user user NOUN crl-14452 167 8 with with ADP crl-14452 167 9 time time NOUN crl-14452 167 10 or or CCONJ crl-14452 167 11 ability ability NOUN crl-14452 167 12 . . PUNCT crl-14452 168 1 it it PRON crl-14452 168 2 can can AUX crl-14452 168 3 supply supply VERB crl-14452 168 4 documents document NOUN crl-14452 168 5 to to PART crl-14452 168 6 study study VERB crl-14452 168 7 , , PUNCT crl-14452 168 8 but but CCONJ crl-14452 168 9 not not PART crl-14452 168 10 the the DET crl-14452 168 11 inclination inclination NOUN crl-14452 168 12 to to PART crl-14452 168 13 do do AUX crl-14452 168 14 so so ADV crl-14452 168 15 . . PUNCT crl-14452 169 1 30 30 NUM crl-14452 169 2 in in ADP crl-14452 169 3 this this DET crl-14452 169 4 study study NOUN crl-14452 169 5 , , PUNCT crl-14452 169 6 librarian librarian ADJ crl-14452 169 7 judgments judgment NOUN crl-14452 169 8 of of ADP crl-14452 169 9 the the DET crl-14452 169 10 value value NOUN crl-14452 169 11 of of ADP crl-14452 169 12 service service NOUN crl-14452 169 13 are be AUX crl-14452 169 14 significantly significantly ADV crl-14452 169 15 related relate VERB crl-14452 169 16 to to ADP crl-14452 169 17 librarian librarian ADJ crl-14452 169 18 judgments judgment NOUN crl-14452 169 19 of of ADP crl-14452 169 20 user user NOUN crl-14452 169 21 participation participation NOUN crl-14452 169 22 in in ADP crl-14452 169 23 the the DET crl-14452 169 24 reference reference NOUN crl-14452 169 25 process process NOUN crl-14452 169 26 for for ADP crl-14452 169 27 factual factual ADJ crl-14452 169 28 and and CCONJ crl-14452 169 29 bibliographic bibliographic ADJ crl-14452 169 30 citation citation NOUN crl-14452 169 31 questions question NOUN crl-14452 169 32 march march PROPN crl-14452 169 33 1989 1989 NUM crl-14452 169 34 ( ( PUNCT crl-14452 169 35 r r NOUN crl-14452 169 36 = = SYM crl-14452 169 37 .236 .236 NUM crl-14452 169 38 , , PUNCT crl-14452 169 39 p p NOUN crl-14452 169 40 = = NOUN crl-14452 169 41 .022 .022 NUM crl-14452 169 42 ) ) PUNCT crl-14452 169 43 but but CCONJ crl-14452 169 44 not not PART crl-14452 169 45 significantly significantly ADV crl-14452 169 46 related relate VERB crl-14452 169 47 for for ADP crl-14452 169 48 subject subject NOUN crl-14452 169 49 and and CCONJ crl-14452 169 50 instructional instructional ADJ crl-14452 169 51 queries query NOUN crl-14452 169 52 ( ( PUNCT crl-14452 169 53 r r NOUN crl-14452 169 54 = = SYM crl-14452 169 55 .111 .111 NUM crl-14452 169 56 , , PUNCT crl-14452 169 57 p p NOUN crl-14452 169 58 = = NOUN crl-14452 169 59 .073 .073 NUM crl-14452 169 60 ) ) PUNCT crl-14452 169 61 . . PUNCT crl-14452 170 1 user user NOUN crl-14452 170 2 success success NOUN crl-14452 170 3 is be AUX crl-14452 170 4 positively positively ADV crl-14452 170 5 associated associate VERB crl-14452 170 6 with with ADP crl-14452 170 7 librarian librarian ADJ crl-14452 170 8 perceptions perception NOUN crl-14452 170 9 of of ADP crl-14452 170 10 feedback feedback NOUN crl-14452 170 11 quality quality NOUN crl-14452 170 12 both both PRON crl-14452 170 13 for for ADP crl-14452 170 14 factual factual ADJ crl-14452 170 15 and and CCONJ crl-14452 170 16 bibliographic bibliographic ADJ crl-14452 170 17 questions question NOUN crl-14452 170 18 ( ( PUNCT crl-14452 170 19 r r NOUN crl-14452 170 20 = = SYM crl-14452 170 21 .262 .262 NUM crl-14452 170 22 , , PUNCT crl-14452 170 23 p p NOUN crl-14452 170 24 = = NOUN crl-14452 170 25 .014 .014 NUM crl-14452 170 26 ) ) PUNCT crl-14452 170 27 and and CCONJ crl-14452 170 28 for for ADP crl-14452 170 29 subject subject ADJ crl-14452 170 30 and and CCONJ crl-14452 170 31 instructional instructional ADJ crl-14452 170 32 questions question NOUN crl-14452 170 33 ( ( PUNCT crl-14452 170 34 r r NOUN crl-14452 170 35 = = SYM crl-14452 170 36 .155 .155 NUM crl-14452 170 37 , , PUNCT crl-14452 170 38 p p NOUN crl-14452 170 39 = = NOUN crl-14452 170 40 .024 .024 NUM crl-14452 170 41 ) ) PUNCT crl-14452 170 42 . . PUNCT crl-14452 171 1 when when SCONJ crl-14452 171 2 users user NOUN crl-14452 171 3 let let VERB crl-14452 171 4 the the DET crl-14452 171 5 librarian librarian NOUN crl-14452 171 6 know know VERB crl-14452 171 7 how how SCONJ crl-14452 171 8 well well ADV crl-14452 171 9 the the DET crl-14452 171 10 question question NOUN crl-14452 171 11 is be AUX crl-14452 171 12 answered answer VERB crl-14452 171 13 , , PUNCT crl-14452 171 14 this this DET crl-14452 171 15 feedback feedback NOUN crl-14452 171 16 is be AUX crl-14452 171 17 significantly significantly ADV crl-14452 171 18 and and CCONJ crl-14452 171 19 positively positively ADV crl-14452 171 20 associated associate VERB crl-14452 171 21 with with ADP crl-14452 171 22 all all DET crl-14452 171 23 three three NUM crl-14452 171 24 reference reference NOUN crl-14452 171 25 service service NOUN crl-14452 171 26 outcomes outcome NOUN crl-14452 171 27 , , PUNCT crl-14452 171 28 irrespective irrespective ADV crl-14452 171 29 of of ADP crl-14452 171 30 the the DET crl-14452 171 31 type type NOUN crl-14452 171 32 of of ADP crl-14452 171 33 question question NOUN crl-14452 171 34 , , PUNCT crl-14452 171 35 again again ADV crl-14452 171 36 suggesting suggest VERB crl-14452 171 37 that that SCONJ crl-14452 171 38 the the DET crl-14452 171 39 controls control NOUN crl-14452 171 40 placed place VERB crl-14452 171 41 on on ADP crl-14452 171 42 proxy proxy ADJ crl-14452 171 43 behavior behavior NOUN crl-14452 171 44 in in ADP crl-14452 171 45 unobtrusive unobtrusive ADJ crl-14452 171 46 studies study NOUN crl-14452 171 47 may may AUX crl-14452 171 48 lower lower VERB crl-14452 171 49 the the DET crl-14452 171 50 success success NOUN crl-14452 171 51 rate rate NOUN crl-14452 171 52 ( ( PUNCT crl-14452 171 53 see see VERB crl-14452 171 54 table table NOUN crl-14452 171 55 7 7 NUM crl-14452 171 56 ) ) PUNCT crl-14452 171 57 . . PUNCT crl-14452 172 1 11 11 NUM crl-14452 172 2 • • PROPN crl-14452 172 3 •• •• NOUN crl-14452 172 4 the the DET crl-14452 172 5 controls control NOUN crl-14452 172 6 placed place VERB crl-14452 172 7 on on ADP crl-14452 172 8 proxy proxy ADJ crl-14452 172 9 behavior behavior NOUN crl-14452 172 10 in in ADP crl-14452 172 11 unobtrusive unobtrusive ADJ crl-14452 172 12 studies study NOUN crl-14452 172 13 may may AUX crl-14452 172 14 lower lower VERB crl-14452 172 15 the the DET crl-14452 172 16 success success NOUN crl-14452 172 17 rate rate NOUN crl-14452 172 18 . . PUNCT crl-14452 172 19 '' '' PUNCT crl-14452 173 1 for for ADP crl-14452 173 2 factual factual ADJ crl-14452 173 3 questions question NOUN crl-14452 173 4 , , PUNCT crl-14452 173 5 approximately approximately ADV crl-14452 173 6 one one NUM crl-14452 173 7 - - PUNCT crl-14452 173 8 third third NOUN crl-14452 173 9 of of ADP crl-14452 173 10 the the DET crl-14452 173 11 users user NOUN crl-14452 173 12 report report VERB crl-14452 173 13 receiving receive VERB crl-14452 173 14 a a DET crl-14452 173 15 direct direct ADJ crl-14452 173 16 answer answer NOUN crl-14452 173 17 , , PUNCT crl-14452 173 18 while while SCONJ crl-14452 173 19 other other ADJ crl-14452 173 20 users user NOUN crl-14452 173 21 report report VERB crl-14452 173 22 receiving receive VERB crl-14452 173 23 assistance assistance NOUN crl-14452 173 24 in in ADP crl-14452 173 25 locating locate VERB crl-14452 173 26 the the DET crl-14452 173 27 answer answer NOUN crl-14452 173 28 for for ADP crl-14452 173 29 themselves themselves PRON crl-14452 173 30 ( ( PUNCT crl-14452 173 31 table table NOUN crl-14452 173 32 8) 8) PROPN crl-14452 173 33 . . PUNCT crl-14452 174 1 therefore therefore ADV crl-14452 174 2 , , PUNCT crl-14452 174 3 in in ADP crl-14452 174 4 these these DET crl-14452 174 5 five five NUM crl-14452 174 6 academic academic ADJ crl-14452 174 7 libraries library NOUN crl-14452 174 8 , , PUNCT crl-14452 174 9 users user NOUN crl-14452 174 10 report report VERB crl-14452 174 11 that that SCONJ crl-14452 174 12 the the DET crl-14452 174 13 librarian librarian NOUN crl-14452 174 14 accompanied accompany VERB crl-14452 174 15 them they PRON crl-14452 174 16 ( ( PUNCT crl-14452 174 17 but but CCONJ crl-14452 174 18 did do AUX crl-14452 174 19 not not PART crl-14452 174 20 refer refer VERB crl-14452 174 21 ) ) PUNCT crl-14452 174 22 or or CCONJ crl-14452 174 23 provided provide VERB crl-14452 174 24 a a DET crl-14452 174 25 direct direct ADJ crl-14452 174 26 answer answer NOUN crl-14452 174 27 for for ADP crl-14452 174 28 65.5 65.5 NUM crl-14452 174 29 percent percent NOUN crl-14452 174 30 of of ADP crl-14452 174 31 all all DET crl-14452 174 32 factual factual ADJ crl-14452 174 33 queries query NOUN crl-14452 174 34 . . PUNCT crl-14452 175 1 librarians librarian NOUN crl-14452 175 2 did do AUX crl-14452 175 3 not not PART crl-14452 175 4 have have VERB crl-14452 175 5 the the DET crl-14452 175 6 opportunity opportunity NOUN crl-14452 175 7 to to PART crl-14452 175 8 verify verify VERB crl-14452 175 9 the the DET crl-14452 175 10 complete complete ADJ crl-14452 175 11 precise precise ADJ crl-14452 175 12 information information NOUN crl-14452 175 13 for for ADP crl-14452 175 14 the the DET crl-14452 175 15 remaining remain VERB crl-14452 175 16 34.5 34.5 NUM crl-14452 175 17 percent percent NOUN crl-14452 175 18 of of ADP crl-14452 175 19 factual factual ADJ crl-14452 175 20 queries query NOUN crl-14452 175 21 . . PUNCT crl-14452 176 1 consequently consequently ADV crl-14452 176 2 , , PUNCT crl-14452 176 3 in in ADP crl-14452 176 4 the the DET crl-14452 176 5 real real ADJ crl-14452 176 6 - - PUNCT crl-14452 176 7 life life NOUN crl-14452 176 8 provision provision NOUN crl-14452 176 9 of of ADP crl-14452 176 10 factual factual ADJ crl-14452 176 11 reference reference NOUN crl-14452 176 12 service service NOUN crl-14452 176 13 , , PUNCT crl-14452 176 14 academic academic ADJ crl-14452 176 15 librarians librarian NOUN crl-14452 176 16 often often ADV crl-14452 176 17 do do AUX crl-14452 176 18 not not PART crl-14452 176 19 assume assume VERB crl-14452 176 20 full full ADJ crl-14452 176 21 responsibility responsibility NOUN crl-14452 176 22 for for ADP crl-14452 176 23 direct direct ADJ crl-14452 176 24 answer answer NOUN crl-14452 176 25 provision provision NOUN crl-14452 176 26 table table NOUN crl-14452 176 27 7 7 NUM crl-14452 176 28 correlations correlation NOUN crl-14452 176 29 between between ADP crl-14452 176 30 user user NOUN crl-14452 176 31 feedback feedback NOUN crl-14452 176 32 and and CCONJ crl-14452 176 33 reference reference NOUN crl-14452 176 34 service service NOUN crl-14452 176 35 outcomes outcome NOUN crl-14452 176 36 by by ADP crl-14452 176 37 type type NOUN crl-14452 176 38 of of ADP crl-14452 176 39 question question NOUN crl-14452 176 40 reference reference NOUN crl-14452 176 41 outcome outcome NOUN crl-14452 176 42 librarian librarian ADJ crl-14452 176 43 judgment judgment NOUN crl-14452 176 44 of of ADP crl-14452 176 45 service service NOUN crl-14452 176 46 vafue vafue PROPN crl-14452 176 47 user user NOUN crl-14452 176 48 judgment judgment NOUN crl-14452 176 49 of of ADP crl-14452 176 50 service service NOUN crl-14452 176 51 value value NOUN crl-14452 176 52 user user NOUN crl-14452 176 53 success success NOUN crl-14452 176 54 * * PUNCT crl-14452 177 1 p p NOUN crl-14452 177 2 < < X crl-14452 177 3 .05 .05 NUM crl-14452 178 1 tp tp NOUN crl-14452 178 2 < < X crl-14452 178 3 .ol .ol PUNCT crl-14452 179 1 tp tp VERB crl-14452 179 2 < < X crl-14452 179 3 .ool .ool PUNCT crl-14452 180 1 feedback feedback NOUN crl-14452 180 2 on on ADP crl-14452 180 3 feedback feedback NOUN crl-14452 180 4 on on ADP crl-14452 180 5 factual factual ADJ crl-14452 180 6 / / SYM crl-14452 180 7 bib bib NOUN crl-14452 180 8 ! ! PUNCT crl-14452 180 9 . . PUNCT crl-14452 181 1 subject subject ADJ crl-14452 181 2 / / SYM crl-14452 181 3 instruct instruct NOUN crl-14452 181 4 . . PUNCT crl-14452 182 1 .160 .160 NUM crl-14452 182 2 .200 .200 NUM crl-14452 182 3 + + NUM crl-14452 182 4 .593 .593 NUM crl-14452 182 5 ! ! PUNCT crl-14452 183 1 .387 .387 NUM crl-14452 183 2 : : PUNCT crl-14452 183 3 t t PROPN crl-14452 183 4 : : PUNCT crl-14452 183 5 .247 .247 NUM crl-14452 183 6 .306:1 .306:1 SYM crl-14452 183 7 : : PUNCT crl-14452 183 8 tables table NOUN crl-14452 183 9 type type NOUN crl-14452 183 10 of of ADP crl-14452 183 11 reference reference NOUN crl-14452 183 12 assistance assistance NOUN crl-14452 183 13 for for ADP crl-14452 183 14 factual factual ADJ crl-14452 183 15 / / SYM crl-14452 183 16 bibliographic bibliographic ADJ crl-14452 183 17 questions question NOUN crl-14452 183 18 assistance assistance NOUN crl-14452 183 19 accompany accompany NOUN crl-14452 183 20 refer refer VERB crl-14452 183 21 accompany accompany PROPN crl-14452 183 22 & & CCONJ crl-14452 183 23 refer refer VERB crl-14452 183 24 direct direct ADJ crl-14452 183 25 answer answer NOUN crl-14452 183 26 factual factual ADJ crl-14452 183 27 31.0 31.0 NUM crl-14452 183 28 % % NOUN crl-14452 183 29 10.3 10.3 NUM crl-14452 183 30 24.1 24.1 NUM crl-14452 183 31 34.5 34.5 NUM crl-14452 183 32 and and CCONJ crl-14452 183 33 verification verification NOUN crl-14452 183 34 of of ADP crl-14452 183 35 accuracy accuracy NOUN crl-14452 183 36 of of ADP crl-14452 183 37 information information NOUN crl-14452 183 38 . . PUNCT crl-14452 184 1 instructions instruction NOUN crl-14452 184 2 to to ADP crl-14452 184 3 proxies proxy NOUN crl-14452 184 4 do do AUX crl-14452 184 5 not not PART crl-14452 184 6 encourage encourage VERB crl-14452 184 7 them they PRON crl-14452 184 8 to to PART crl-14452 184 9 push push VERB crl-14452 184 10 the the DET crl-14452 184 11 librarian librarian NOUN crl-14452 184 12 to to PART crl-14452 184 13 provide provide VERB crl-14452 184 14 as as ADV crl-14452 184 15 much much ADJ crl-14452 184 16 assistance assistance NOUN crl-14452 184 17 as as SCONJ crl-14452 184 18 needed need VERB crl-14452 184 19 . . PUNCT crl-14452 185 1 should should AUX crl-14452 185 2 so so ADV crl-14452 185 3 much much ADJ crl-14452 185 4 emphasis emphasis NOUN crl-14452 185 5 be be AUX crl-14452 185 6 placed place VERB crl-14452 185 7 on on ADP crl-14452 185 8 an an DET crl-14452 185 9 evaluation evaluation NOUN crl-14452 185 10 method method NOUN crl-14452 185 11 that that PRON crl-14452 185 12 eliminates eliminate VERB crl-14452 185 13 many many ADJ crl-14452 185 14 of of ADP crl-14452 185 15 the the DET crl-14452 185 16 contextual contextual ADJ crl-14452 185 17 clues clue NOUN crl-14452 185 18 provided provide VERB crl-14452 185 19 by by ADP crl-14452 185 20 users user NOUN crl-14452 185 21 seeking seek VERB crl-14452 185 22 to to PART crl-14452 185 23 fill fill VERB crl-14452 185 24 a a DET crl-14452 185 25 gap gap NOUN crl-14452 185 26 in in ADP crl-14452 185 27 their their PRON crl-14452 185 28 understanding understanding NOUN crl-14452 185 29 and and CCONJ crl-14452 185 30 to to PART crl-14452 185 31 use use VERB crl-14452 185 32 the the DET crl-14452 185 33 information information NOUN crl-14452 185 34 for for ADP crl-14452 185 35 their their PRON crl-14452 185 36 own own ADJ crl-14452 185 37 purposes purpose NOUN crl-14452 185 38 ? ? PUNCT crl-14452 186 1 an an DET crl-14452 186 2 alternative alternative ADJ crl-14452 186 3 model model NOUN crl-14452 186 4 to to PART crl-14452 186 5 use use VERB crl-14452 186 6 in in ADP crl-14452 186 7 studying study VERB crl-14452 186 8 the the DET crl-14452 186 9 reference reference NOUN crl-14452 186 10 process process NOUN crl-14452 186 11 is be AUX crl-14452 186 12 one one NUM crl-14452 186 13 in in ADP crl-14452 186 14 which which PRON crl-14452 186 15 the the DET crl-14452 186 16 reference reference NOUN crl-14452 186 17 transaction transaction NOUN crl-14452 186 18 and and CCONJ crl-14452 186 19 the the DET crl-14452 186 20 resulting result VERB crl-14452 186 21 service service NOUN crl-14452 186 22 outcome outcome NOUN crl-14452 186 23 are be AUX crl-14452 186 24 joint joint ADJ crl-14452 186 25 products product NOUN crl-14452 186 26 of of ADP crl-14452 186 27 the the DET crl-14452 186 28 effort effort NOUN crl-14452 186 29 , , PUNCT crl-14452 186 30 skill skill NOUN crl-14452 186 31 , , PUNCT crl-14452 186 32 and and CCONJ crl-14452 186 33 knowledge knowledge NOUN crl-14452 186 34 of of ADP crl-14452 186 35 both both CCONJ crl-14452 186 36 librarian librarian NOUN crl-14452 186 37 and and CCONJ crl-14452 186 38 user user NOUN crl-14452 186 39 . . PUNCT crl-14452 187 1 in in ADP crl-14452 187 2 gordon gordon PROPN crl-14452 187 3 whitaker whitaker NOUN crl-14452 187 4 's 's PART crl-14452 187 5 model model NOUN crl-14452 187 6 of of ADP crl-14452 187 7 coproduction coproduction NOUN crl-14452 187 8 of of ADP crl-14452 187 9 service service NOUN crl-14452 187 10 , , PUNCT crl-14452 187 11 service service NOUN crl-14452 187 12 delivery delivery NOUN crl-14452 187 13 is be AUX crl-14452 187 14 accomplished accomplish VERB crl-14452 187 15 through through ADP crl-14452 187 16 a a DET crl-14452 187 17 process process NOUN crl-14452 187 18 of of ADP crl-14452 187 19 mutual mutual ADJ crl-14452 187 20 adjustment adjustment NOUN crl-14452 187 21 , , PUNCT crl-14452 187 22 whereby whereby SCONJ crl-14452 187 23 both both PRON crl-14452 187 24 client client NOUN crl-14452 187 25 and and CCONJ crl-14452 187 26 service service NOUN crl-14452 187 27 provider provider NOUN crl-14452 187 28 mutually mutually ADV crl-14452 187 29 consider consider VERB crl-14452 187 30 the the DET crl-14452 187 31 client client NOUN crl-14452 187 32 's 's PART crl-14452 187 33 problem problem NOUN crl-14452 187 34 and and CCONJ crl-14452 187 35 what what PRON crl-14452 187 36 each each PRON crl-14452 187 37 of of ADP crl-14452 187 38 them they PRON crl-14452 187 39 can can AUX crl-14452 187 40 do do VERB crl-14452 187 41 about about ADP crl-14452 187 42 it it PRON crl-14452 187 43 . . PUNCT crl-14452 188 1 citizens citizen NOUN crl-14452 188 2 influence influence VERB crl-14452 188 3 the the DET crl-14452 188 4 content content NOUN crl-14452 188 5 of of ADP crl-14452 188 6 many many ADJ crl-14452 188 7 public public ADJ crl-14452 188 8 services service NOUN crl-14452 188 9 through through ADP crl-14452 188 10 direct direct ADJ crl-14452 188 11 participation participation NOUN crl-14452 188 12 in in ADP crl-14452 188 13 service service NOUN crl-14452 188 14 delivery delivery NOUN crl-14452 188 15 . . PUNCT crl-14452 189 1 this this PRON crl-14452 189 2 is be AUX crl-14452 189 3 particularly particularly ADV crl-14452 189 4 the the DET crl-14452 189 5 case case NOUN crl-14452 189 6 in in ADP crl-14452 189 7 services service NOUN crl-14452 189 8 designed design VERB crl-14452 189 9 to to PART crl-14452 189 10 change change VERB crl-14452 189 11 or or CCONJ crl-14452 189 12 empower empower VERB crl-14452 189 13 people people NOUN crl-14452 189 14 directly directly ADV crl-14452 189 15 , , PUNCT crl-14452 189 16 such such ADJ crl-14452 189 17 as as ADP crl-14452 189 18 education education NOUN crl-14452 189 19 and and CCONJ crl-14452 189 20 health health NOUN crl-14452 189 21 care care NOUN crl-14452 189 22 . . PUNCT crl-14452 190 1 the the DET crl-14452 190 2 agent agent NOUN crl-14452 190 3 can can AUX crl-14452 190 4 encourage encourage VERB crl-14452 190 5 , , PUNCT crl-14452 190 6 suggest suggest VERB crl-14452 190 7 options option NOUN crl-14452 190 8 , , PUNCT crl-14452 190 9 illustrate illustrate NOUN crl-14452 190 10 techniques technique NOUN crl-14452 190 11 , , PUNCT crl-14452 190 12 and and CCONJ crl-14452 190 13 provide provide VERB crl-14452 190 14 guidance guidance NOUN crl-14452 190 15 and and CCONJ crl-14452 190 16 advice advice NOUN crl-14452 190 17 , , PUNCT crl-14452 190 18 but but CCONJ crl-14452 190 19 can can AUX crl-14452 190 20 not not PART crl-14452 190 21 · · PUNCT crl-14452 190 22 bring bring VERB crl-14452 190 23 about about ADP crl-14452 190 24 the the DET crl-14452 190 25 change change NOUN crl-14452 190 26 alone alone ADV crl-14452 190 27 . . PUNCT crl-14452 191 1 31 31 NUM crl-14452 191 2 for for ADP crl-14452 191 3 libraries library NOUN crl-14452 191 4 functioning function VERB crl-14452 191 5 as as ADP crl-14452 191 6 part part NOUN crl-14452 191 7 of of ADP crl-14452 191 8 the the DET crl-14452 191 9 educational educational ADJ crl-14452 191 10 process process NOUN crl-14452 191 11 , , PUNCT crl-14452 191 12 this this PRON crl-14452 191 13 may may AUX crl-14452 191 14 be be AUX crl-14452 191 15 an an DET crl-14452 191 16 appropriate appropriate ADJ crl-14452 191 17 model model NOUN crl-14452 191 18 . . PUNCT crl-14452 192 1 conclusion conclusion PROPN crl-14452 192 2 john john PROPN crl-14452 192 3 campbell campbell PROPN crl-14452 192 4 suggests suggest VERB crl-14452 192 5 that that SCONJ crl-14452 192 6 given give VERB crl-14452 192 7 a a DET crl-14452 192 8 specific specific ADJ crl-14452 192 9 research research NOUN crl-14452 192 10 question question NOUN crl-14452 192 11 , , PUNCT crl-14452 192 12 we we PRON crl-14452 192 13 can can AUX crl-14452 192 14 ask ask VERB crl-14452 192 15 what what DET crl-14452 192 16 specific specific ADJ crl-14452 192 17 research research NOUN crl-14452 192 18 method(s method(s PROPN crl-14452 192 19 ) ) PUNCT crl-14452 192 20 possess possess VERB crl-14452 192 21 the the DET crl-14452 192 22 most most ADJ crl-14452 192 23 validity validity NOUN crl-14452 192 24 for for ADP crl-14452 192 25 the the DET crl-14452 192 26 independent independent ADJ crl-14452 192 27 and and CCONJ crl-14452 192 28 dependent dependent ADJ crl-14452 192 29 variables variable NOUN crl-14452 192 30 . . PUNCT crl-14452 193 1 it it PRON crl-14452 193 2 should should AUX crl-14452 193 3 not not PART crl-14452 193 4 be be AUX crl-14452 193 5 assumed assume VERB crl-14452 193 6 that that SCONJ crl-14452 193 7 hard hard ADJ crl-14452 193 8 measures measure NOUN crl-14452 193 9 are be AUX crl-14452 193 10 always always ADV crl-14452 193 11 more more ADV crl-14452 193 12 valid valid ADJ crl-14452 193 13 than than ADP crl-14452 193 14 soft soft ADJ crl-14452 193 15 measures measure NOUN crl-14452 193 16 of of ADP crl-14452 193 17 depenunobtrusive depenunobtrusive ADJ crl-14452 193 18 studies study NOUN crl-14452 193 19 189 189 NUM crl-14452 193 20 dent dent ADJ crl-14452 193 21 variables variable NOUN crl-14452 193 22 . . PUNCT crl-14452 194 1 campbell campbell NOUN crl-14452 194 2 comments comment VERB crl-14452 194 3 that that SCONJ crl-14452 194 4 the the DET crl-14452 194 5 term term NOUN crl-14452 194 6 " " PUNCT crl-14452 194 7 hard hard ADJ crl-14452 194 8 " " PUNCT crl-14452 194 9 seems seem VERB crl-14452 194 10 to to PART crl-14452 194 11 refer refer VERB crl-14452 194 12 to to ADP crl-14452 194 13 dependent dependent ADJ crl-14452 194 14 variables variable NOUN crl-14452 194 15 that that PRON crl-14452 194 16 consist consist VERB crl-14452 194 17 of of ADP crl-14452 194 18 countable countable ADJ crl-14452 194 19 outcomes outcome NOUN crl-14452 194 20 . . PUNCT crl-14452 195 1 they they PRON crl-14452 195 2 are be AUX crl-14452 195 3 objective objective ADJ crl-14452 195 4 in in ADP crl-14452 195 5 the the DET crl-14452 195 6 sense sense NOUN crl-14452 195 7 that that SCONJ crl-14452 195 8 they they PRON crl-14452 195 9 can can AUX crl-14452 195 10 be be AUX crl-14452 195 11 counted count VERB crl-14452 195 12 by by ADP crl-14452 195 13 an an DET crl-14452 195 14 independent independent ADJ crl-14452 195 15 party party NOUN crl-14452 195 16 . . PUNCT crl-14452 196 1 soft soft ADJ crl-14452 196 2 measures measure NOUN crl-14452 196 3 seem seem VERB crl-14452 196 4 to to PART crl-14452 196 5 refer refer VERB crl-14452 196 6 to to ADP crl-14452 196 7 those those PRON crl-14452 196 8 based base VERB crl-14452 196 9 on on ADP crl-14452 196 10 human human ADJ crl-14452 196 11 judgment judgment NOUN crl-14452 196 12 or or CCONJ crl-14452 196 13 scaling scale VERB crl-14452 196 14 consideration consideration NOUN crl-14452 196 15 . . PUNCT crl-14452 197 1 32 32 NUM crl-14452 197 2 the the DET crl-14452 197 3 unobtrusive unobtrusive ADJ crl-14452 197 4 studies study NOUN crl-14452 197 5 use use VERB crl-14452 197 6 a a DET crl-14452 197 7 modified modify VERB crl-14452 197 8 laboratory laboratory NOUN crl-14452 197 9 method method NOUN crl-14452 197 10 and and CCONJ crl-14452 197 11 have have VERB crl-14452 197 12 the the DET crl-14452 197 13 strengths strength NOUN crl-14452 197 14 and and CCONJ crl-14452 197 15 weaknesses weakness NOUN crl-14452 197 16 commonly commonly ADV crl-14452 197 17 found find VERB crl-14452 197 18 in in ADP crl-14452 197 19 such such ADJ crl-14452 197 20 methods method NOUN crl-14452 197 21 . . PUNCT crl-14452 198 1 their their PRON crl-14452 198 2 strengths strength NOUN crl-14452 198 3 are be AUX crl-14452 198 4 that that SCONJ crl-14452 198 5 reference reference NOUN crl-14452 198 6 librarians librarian NOUN crl-14452 198 7 can can AUX crl-14452 198 8 not not PART crl-14452 198 9 introduce introduce VERB crl-14452 198 10 bias bias NOUN crl-14452 198 11 into into ADP crl-14452 198 12 the the DET crl-14452 198 13 study study NOUN crl-14452 198 14 because because SCONJ crl-14452 198 15 they they PRON crl-14452 198 16 are be AUX crl-14452 198 17 unaware unaware ADJ crl-14452 198 18 of of ADP crl-14452 198 19 it it PRON crl-14452 198 20 , , PUNCT crl-14452 198 21 and and CCONJ crl-14452 198 22 a a DET crl-14452 198 23 clear clear ADJ crl-14452 198 24 standard standard NOUN crl-14452 198 25 for for ADP crl-14452 198 26 correct correct ADJ crl-14452 198 27 and and CCONJ crl-14452 198 28 incorrect incorrect ADJ crl-14452 198 29 answers answer NOUN crl-14452 198 30 to to ADP crl-14452 198 31 queries query NOUN crl-14452 198 32 can can AUX crl-14452 198 33 be be AUX crl-14452 198 34 established establish VERB crl-14452 198 35 . . PUNCT crl-14452 199 1 their their PRON crl-14452 199 2 weakness weakness NOUN crl-14452 199 3 is be AUX crl-14452 199 4 that that SCONJ crl-14452 199 5 they they PRON crl-14452 199 6 do do AUX crl-14452 199 7 not not PART crl-14452 199 8 necessarily necessarily ADV crl-14452 199 9 represent represent VERB crl-14452 199 10 reality reality NOUN crl-14452 199 11 . . PUNCT crl-14452 200 1 figure figure NOUN crl-14452 200 2 1 1 NUM crl-14452 200 3 provides provide VERB crl-14452 200 4 a a DET crl-14452 200 5 summary summary NOUN crl-14452 200 6 of of ADP crl-14452 200 7 the the DET crl-14452 200 8 differences difference NOUN crl-14452 200 9 in in ADP crl-14452 200 10 treatment treatment NOUN crl-14452 200 11 of of ADP crl-14452 200 12 users user NOUN crl-14452 200 13 and and CCONJ crl-14452 200 14 questions question NOUN crl-14452 200 15 for for ADP crl-14452 200 16 unobtrusive unobtrusive ADJ crl-14452 200 17 versus versus ADP crl-14452 200 18 obtrusive obtrusive ADJ crl-14452 200 19 studies study NOUN crl-14452 200 20 of of ADP crl-14452 200 21 reference reference NOUN crl-14452 200 22 performance performance NOUN crl-14452 200 23 . . PUNCT crl-14452 201 1 studies study NOUN crl-14452 201 2 employing employ VERB crl-14452 201 3 unobtrusive unobtrusive ADJ crl-14452 201 4 methods method NOUN crl-14452 201 5 are be AUX crl-14452 201 6 often often ADV crl-14452 201 7 viewed view VERB crl-14452 201 8 by by ADP crl-14452 201 9 researchers researcher NOUN crl-14452 201 10 as as ADP crl-14452 201 11 more more ADV crl-14452 201 12 desirable desirable ADJ crl-14452 201 13 for for ADP crl-14452 201 14 reference reference NOUN crl-14452 201 15 evaluation evaluation NOUN crl-14452 201 16 because because SCONJ crl-14452 201 17 of of ADP crl-14452 201 18 their their PRON crl-14452 201 19 objective objective ADJ crl-14452 201 20 qualities quality NOUN crl-14452 201 21 . . PUNCT crl-14452 202 1 unobtrusive unobtrusive ADJ crl-14452 202 2 studies study NOUN crl-14452 202 3 seem seem VERB crl-14452 202 4 to to PART crl-14452 202 5 be be AUX crl-14452 202 6 more more ADV crl-14452 202 7 scientific scientific ADJ crl-14452 202 8 . . PUNCT crl-14452 203 1 hernon hernon NOUN crl-14452 203 2 and and CCONJ crl-14452 203 3 mcclure mcclure NOUN crl-14452 203 4 express express VERB crl-14452 203 5 this this DET crl-14452 203 6 view view NOUN crl-14452 203 7 in in ADP crl-14452 203 8 the the DET crl-14452 203 9 following follow VERB crl-14452 203 10 statement statement NOUN crl-14452 203 11 : : PUNCT crl-14452 203 12 " " PUNCT crl-14452 203 13 basing base VERB crl-14452 203 14 managerial managerial ADJ crl-14452 203 15 decisions decision NOUN crl-14452 203 16 regarding regard VERB crl-14452 203 17 reference reference NOUN crl-14452 203 18 services service NOUN crl-14452 203 19 on on ADP crl-14452 203 20 perceptions perception NOUN crl-14452 203 21 rather rather ADV crl-14452 203 22 than than ADP crl-14452 203 23 realistic realistic ADJ crl-14452 203 24 appraisal appraisal NOUN crl-14452 203 25 is be AUX crl-14452 203 26 a a DET crl-14452 203 27 disservice disservice NOUN crl-14452 203 28 to to ADP crl-14452 203 29 library library NOUN crl-14452 203 30 clientele clientele NOUN crl-14452 203 31 and and CCONJ crl-14452 203 32 a a DET crl-14452 203 33 myopic myopic ADJ crl-14452 203 34 stance stance NOUN crl-14452 203 35 that that PRON crl-14452 203 36 continues continue VERB crl-14452 203 37 to to PART crl-14452 203 38 impede impede VERB crl-14452 203 39 the the DET crl-14452 203 40 development development NOUN crl-14452 203 41 of of ADP crl-14452 203 42 quality quality NOUN crl-14452 203 43 reference reference NOUN crl-14452 203 44 services service NOUN crl-14452 203 45 . . PUNCT crl-14452 203 46 " " PUNCT crl-14452 204 1 33 33 NUM crl-14452 204 2 the the DET crl-14452 204 3 popularity popularity NOUN crl-14452 204 4 of of ADP crl-14452 204 5 unobtrusive unobtrusive ADJ crl-14452 204 6 studies study NOUN crl-14452 204 7 appears appear VERB crl-14452 204 8 to to PART crl-14452 204 9 be be AUX crl-14452 204 10 a a DET crl-14452 204 11 reaction reaction NOUN crl-14452 204 12 to to ADP crl-14452 204 13 early early ADJ crl-14452 204 14 uncritical uncritical ADJ crl-14452 204 15 global global ADJ crl-14452 204 16 surveys survey NOUN crl-14452 204 17 of of ADP crl-14452 204 18 user user NOUN crl-14452 204 19 satisfaction satisfaction NOUN crl-14452 204 20 with with ADP crl-14452 204 21 libraries library NOUN crl-14452 204 22 and and CCONJ crl-14452 204 23 the the DET crl-14452 204 24 growing grow VERB crl-14452 204 25 awareness awareness NOUN crl-14452 204 26 that that SCONJ crl-14452 204 27 although although SCONJ crl-14452 204 28 users user NOUN crl-14452 204 29 appear appear VERB crl-14452 204 30 to to PART crl-14452 204 31 be be AUX crl-14452 204 32 highly highly ADV crl-14452 204 33 satisfied satisfied ADJ crl-14452 204 34 with with ADP crl-14452 204 35 library library NOUN crl-14452 204 36 service service NOUN crl-14452 204 37 , , PUNCT crl-14452 204 38 they they PRON crl-14452 204 39 do do AUX crl-14452 204 40 not not PART crl-14452 204 41 represent represent VERB crl-14452 204 42 the the DET crl-14452 204 43 best good ADJ crl-14452 204 44 critical critical ADJ crl-14452 204 45 judgment judgment NOUN crl-14452 204 46 about about ADP crl-14452 204 47 the the DET crl-14452 204 48 provision provision NOUN crl-14452 204 49 of of ADP crl-14452 204 50 information information NOUN crl-14452 204 51 . . PUNCT crl-14452 205 1 perhaps perhaps ADV crl-14452 205 2 we we PRON crl-14452 205 3 have have AUX crl-14452 205 4 now now ADV crl-14452 205 5 gone go VERB crl-14452 205 6 too too ADV crl-14452 205 7 far far ADV crl-14452 205 8 in in ADP crl-14452 205 9 the the DET crl-14452 205 10 opposite opposite ADJ crl-14452 205 11 direction direction NOUN crl-14452 205 12 by by ADP crl-14452 205 13 studying study VERB crl-14452 205 14 an an DET crl-14452 205 15 unrepresentative unrepresentative ADJ crl-14452 205 16 minority minority NOUN crl-14452 205 17 of of ADP crl-14452 205 18 reference reference NOUN crl-14452 205 19 queries query NOUN crl-14452 205 20 . . PUNCT crl-14452 206 1 the the DET crl-14452 206 2 method method NOUN crl-14452 206 3 has have AUX crl-14452 206 4 been be AUX crl-14452 206 5 allowed allow VERB crl-14452 206 6 to to PART crl-14452 206 7 dictate dictate VERB crl-14452 206 8 the the DET crl-14452 206 9 evaluation evaluation NOUN crl-14452 206 10 criteria criterion NOUN crl-14452 206 11 and and CCONJ crl-14452 206 12 scope scope NOUN crl-14452 206 13 by by ADP crl-14452 206 14 limiting limit VERB crl-14452 206 15 the the DET crl-14452 206 16 test test NOUN crl-14452 206 17 to to ADP crl-14452 206 18 only only ADV crl-14452 206 19 that that DET crl-14452 206 20 portion portion NOUN crl-14452 206 21 amenable amenable ADJ crl-14452 206 22 to to ADP crl-14452 206 23 hard hard ADJ crl-14452 206 24 , , PUNCT crl-14452 206 25 objective objective ADJ crl-14452 206 26 measures measure NOUN crl-14452 206 27 . . PUNCT crl-14452 207 1 the the DET crl-14452 207 2 scientific scientific ADJ crl-14452 207 3 method method NOUN crl-14452 207 4 was be AUX crl-14452 207 5 originally originally ADV crl-14452 207 6 developed develop VERB crl-14452 207 7 in in ADP crl-14452 207 8 order order NOUN crl-14452 207 9 to to PART crl-14452 207 10 more more ADV crl-14452 207 11 effectively effectively ADV crl-14452 207 12 study study VERB crl-14452 207 13 the the DET crl-14452 207 14 physical physical ADJ crl-14452 207 15 world world NOUN crl-14452 207 16 around around ADP crl-14452 207 17 us we PRON crl-14452 207 18 . . PUNCT crl-14452 208 1 is be AUX crl-14452 208 2 this this DET crl-14452 208 3 method method NOUN crl-14452 208 4 really really ADV crl-14452 208 5 the the DET crl-14452 208 6 primary primary ADJ crl-14452 208 7 one one NOUN crl-14452 208 8 to to PART crl-14452 208 9 use use VERB crl-14452 208 10 for for ADP crl-14452 208 11 the the DET crl-14452 208 12 study study NOUN crl-14452 208 13 of of ADP crl-14452 208 14 how how SCONJ crl-14452 208 15 190 190 NUM crl-14452 208 16 college college NOUN crl-14452 208 17 & & CCONJ crl-14452 208 18 research research PROPN crl-14452 208 19 libraries librarie VERB crl-14452 208 20 unobtrusive unobtrusive ADJ crl-14452 208 21 studies study NOUN crl-14452 208 22 -are -are VERB crl-14452 208 23 passive passive ADJ crl-14452 208 24 receivers receiver NOUN crl-14452 208 25 of of ADP crl-14452 208 26 service service NOUN crl-14452 208 27 -have -have VERB crl-14452 208 28 little little ADJ crl-14452 208 29 investment investment NOUN crl-14452 208 30 in in ADP crl-14452 208 31 answers answer NOUN crl-14452 208 32 march march PROPN crl-14452 208 33 1989 1989 NUM crl-14452 208 34 obtrusive obtrusive ADJ crl-14452 208 35 studies study NOUN crl-14452 208 36 users user NOUN crl-14452 208 37 -may -may PUNCT crl-14452 208 38 be be AUX crl-14452 208 39 passive passive ADJ crl-14452 208 40 or or CCONJ crl-14452 208 41 active active ADJ crl-14452 208 42 -have -have NOUN crl-14452 208 43 a a DET crl-14452 208 44 definite definite ADJ crl-14452 208 45 interest interest NOUN crl-14452 208 46 in in ADP crl-14452 208 47 results result NOUN crl-14452 208 48 -operate -operate ADJ crl-14452 208 49 without without ADP crl-14452 208 50 a a DET crl-14452 208 51 context context NOUN crl-14452 208 52 in in ADP crl-14452 208 53 which which PRON crl-14452 208 54 to to PART crl-14452 208 55 place place VERB crl-14452 208 56 -have -have VERB crl-14452 208 57 a a DET crl-14452 208 58 knowledge knowledge NOUN crl-14452 208 59 gap gap NOUN crl-14452 208 60 to to PART crl-14452 208 61 fill fill VERB crl-14452 208 62 answers answer NOUN crl-14452 208 63 -provide -provide ADV crl-14452 208 64 limited limited ADJ crl-14452 208 65 or or CCONJ crl-14452 208 66 no no DET crl-14452 208 67 clues clue NOUN crl-14452 208 68 to to PART crl-14452 208 69 librarians librarians VERB crl-14452 208 70 -operate -operate ADJ crl-14452 208 71 without without ADP crl-14452 208 72 specific specific ADJ crl-14452 208 73 time time NOUN crl-14452 208 74 pressures pressure NOUN crl-14452 208 75 -expect -expect VERB crl-14452 208 76 librarians librarian NOUN crl-14452 208 77 to to PART crl-14452 208 78 supply supply VERB crl-14452 208 79 the the DET crl-14452 208 80 answers answer NOUN crl-14452 208 81 -provide -provide ADP crl-14452 208 82 a a DET crl-14452 208 83 wide wide ADJ crl-14452 208 84 range range NOUN crl-14452 208 85 of of ADP crl-14452 208 86 contextual contextual ADJ crl-14452 208 87 clues clue NOUN crl-14452 208 88 to to PART crl-14452 208 89 librarians librarians VERB crl-14452 208 90 -operate -operate ADJ crl-14452 208 91 under under ADP crl-14452 208 92 a a DET crl-14452 208 93 variety variety NOUN crl-14452 208 94 of of ADP crl-14452 208 95 time time NOUN crl-14452 208 96 pressures pressure NOUN crl-14452 208 97 -normally -normally ADV crl-14452 208 98 expect expect VERB crl-14452 208 99 librarians librarian NOUN crl-14452 208 100 to to PART crl-14452 208 101 provide provide VERB crl-14452 208 102 a a DET crl-14452 208 103 source source NOUN crl-14452 208 104 for for ADP crl-14452 208 105 answers answer NOUN crl-14452 208 106 questions question NOUN crl-14452 208 107 -are -are VERB crl-14452 208 108 quantifiable quantifiable ADJ crl-14452 208 109 requests request NOUN crl-14452 208 110 for for ADP crl-14452 208 111 specific specific ADJ crl-14452 208 112 information information NOUN crl-14452 208 113 -are -are NOUN crl-14452 208 114 relevant relevant ADJ crl-14452 208 115 to to ADP crl-14452 208 116 a a DET crl-14452 208 117 limited limited ADJ crl-14452 208 118 task task NOUN crl-14452 208 119 -are -are PUNCT crl-14452 208 120 general general ADJ crl-14452 208 121 requests request NOUN crl-14452 208 122 for for ADP crl-14452 208 123 subject subject ADJ crl-14452 208 124 information information NOUN crl-14452 208 125 -are -are NOUN crl-14452 208 126 relevant relevant ADJ crl-14452 208 127 to to ADP crl-14452 208 128 a a DET crl-14452 208 129 broad broad ADJ crl-14452 208 130 set set NOUN crl-14452 208 131 of of ADP crl-14452 208 132 tasks task NOUN crl-14452 208 133 figure figure VERB crl-14452 208 134 1 1 NUM crl-14452 208 135 differences difference NOUN crl-14452 208 136 between between ADP crl-14452 208 137 unobtrusive unobtrusive ADJ crl-14452 208 138 and and CCONJ crl-14452 208 139 obtrusive obtrusive ADJ crl-14452 208 140 reference reference NOUN crl-14452 208 141 studies study NOUN crl-14452 208 142 people people NOUN crl-14452 208 143 behave behave VERB crl-14452 208 144 in in ADP crl-14452 208 145 organizational organizational ADJ crl-14452 208 146 settings setting NOUN crl-14452 208 147 ? ? PUNCT crl-14452 209 1 unobtrusive unobtrusive ADJ crl-14452 209 2 studies study NOUN crl-14452 209 3 tell tell VERB crl-14452 209 4 us we PRON crl-14452 209 5 only only ADV crl-14452 209 6 a a DET crl-14452 209 7 little little ADJ crl-14452 209 8 about about ADP crl-14452 209 9 the the DET crl-14452 209 10 quality quality NOUN crl-14452 209 11 of of ADP crl-14452 209 12 reference reference NOUN crl-14452 209 13 services service NOUN crl-14452 209 14 . . PUNCT crl-14452 210 1 given give VERB crl-14452 210 2 the the DET crl-14452 210 3 weaknesses weakness NOUN crl-14452 210 4 in in ADP crl-14452 210 5 unobtrusive unobtrusive ADJ crl-14452 210 6 studies study NOUN crl-14452 210 7 and and CCONJ crl-14452 210 8 the the DET crl-14452 210 9 problems problem NOUN crl-14452 210 10 with with ADP crl-14452 210 11 content content NOUN crl-14452 210 12 validity validity NOUN crl-14452 210 13 , , PUNCT crl-14452 210 14 can can AUX crl-14452 210 15 more more ADV crl-14452 210 16 representative representative ADJ crl-14452 210 17 studies study NOUN crl-14452 210 18 be be AUX crl-14452 210 19 designed design VERB crl-14452 210 20 using use VERB crl-14452 210 21 the the DET crl-14452 210 22 unobtrusive unobtrusive ADJ crl-14452 210 23 methodology methodology NOUN crl-14452 210 24 ? ? PUNCT crl-14452 211 1 unobtrusive unobtrusive ADJ crl-14452 211 2 methods method NOUN crl-14452 211 3 remain remain VERB crl-14452 211 4 a a DET crl-14452 211 5 valuable valuable ADJ crl-14452 211 6 alternative alternative ADJ crl-14452 211 7 methodology methodology NOUN crl-14452 211 8 for for ADP crl-14452 211 9 · · PUNCT crl-14452 211 10 countering counter VERB crl-14452 211 11 some some PRON crl-14452 211 12 of of ADP crl-14452 211 13 the the DET crl-14452 211 14 known know VERB crl-14452 211 15 weaknesses weakness NOUN crl-14452 211 16 in in ADP crl-14452 211 17 field field NOUN crl-14452 211 18 studies study NOUN crl-14452 211 19 using use VERB crl-14452 211 20 obtrusive obtrusive ADJ crl-14452 211 21 methodologies methodology NOUN crl-14452 211 22 . . PUNCT crl-14452 212 1 but but CCONJ crl-14452 212 2 unobtrusive unobtrusive ADJ crl-14452 212 3 studies study NOUN crl-14452 212 4 would would AUX crl-14452 212 5 tell tell VERB crl-14452 212 6 us we PRON crl-14452 212 7 much much ADV crl-14452 212 8 more more ADJ crl-14452 212 9 about about ADP crl-14452 212 10 the the DET crl-14452 212 11 quality quality NOUN crl-14452 212 12 of of ADP crl-14452 212 13 reference reference NOUN crl-14452 212 14 services service NOUN crl-14452 212 15 if if SCONJ crl-14452 212 16 the the DET crl-14452 212 17 assumptions assumption NOUN crl-14452 212 18 and and CCONJ crl-14452 212 19 the the DET crl-14452 212 20 methodology methodology NOUN crl-14452 212 21 were be AUX crl-14452 212 22 modified modify VERB crl-14452 212 23 substantially substantially ADV crl-14452 212 24 . . PUNCT crl-14452 213 1 test test NOUN crl-14452 213 2 questions question NOUN crl-14452 213 3 need need VERB crl-14452 213 4 to to PART crl-14452 213 5 represent represent VERB crl-14452 213 6 all all DET crl-14452 213 7 facets facet NOUN crl-14452 213 8 of of ADP crl-14452 213 9 reference reference NOUN crl-14452 213 10 . . PUNCT crl-14452 214 1 unobtrusive unobtrusive ADJ crl-14452 214 2 studies study NOUN crl-14452 214 3 must must AUX crl-14452 214 4 develop develop VERB crl-14452 214 5 more more ADV crl-14452 214 6 representative representative ADJ crl-14452 214 7 reference reference NOUN crl-14452 214 8 questions question NOUN crl-14452 214 9 . . PUNCT crl-14452 215 1 research research NOUN crl-14452 215 2 findings finding NOUN crl-14452 215 3 from from ADP crl-14452 215 4 the the DET crl-14452 215 5 present present ADJ crl-14452 215 6 obtrusive obtrusive ADJ crl-14452 215 7 study study NOUN crl-14452 215 8 demonstrate demonstrate VERB crl-14452 215 9 that that SCONJ crl-14452 215 10 it it PRON crl-14452 215 11 is be AUX crl-14452 215 12 feasible feasible ADJ crl-14452 215 13 to to PART crl-14452 215 14 involve involve VERB crl-14452 215 15 reference reference NOUN crl-14452 215 16 departments department NOUN crl-14452 215 17 in in ADP crl-14452 215 18 the the DET crl-14452 215 19 evaluation evaluation NOUN crl-14452 215 20 process process NOUN crl-14452 215 21 and and CCONJ crl-14452 215 22 collect collect VERB crl-14452 215 23 summaries summary NOUN crl-14452 215 24 of of ADP crl-14452 215 25 questions question NOUN crl-14452 215 26 and and CCONJ crl-14452 215 27 answers answer NOUN crl-14452 215 28 . . PUNCT crl-14452 216 1 collecting collect VERB crl-14452 216 2 and and CCONJ crl-14452 216 3 compiling compile VERB crl-14452 216 4 such such ADJ crl-14452 216 5 information information NOUN crl-14452 216 6 also also ADV crl-14452 216 7 enhances enhance VERB crl-14452 216 8 the the DET crl-14452 216 9 ability ability NOUN crl-14452 216 10 to to PART crl-14452 216 11 analyze analyze VERB crl-14452 216 12 the the DET crl-14452 216 13 entire entire ADJ crl-14452 216 14 spectrum spectrum NOUN crl-14452 216 15 of of ADP crl-14452 216 16 queries query NOUN crl-14452 216 17 people people NOUN crl-14452 216 18 bring bring VERB crl-14452 216 19 to to ADP crl-14452 216 20 libraries library NOUN crl-14452 216 21 . . PUNCT crl-14452 217 1 questions question NOUN crl-14452 217 2 representing represent VERB crl-14452 217 3 the the DET crl-14452 217 4 entire entire ADJ crl-14452 217 5 body body NOUN crl-14452 217 6 of of ADP crl-14452 217 7 reference reference NOUN crl-14452 217 8 could could AUX crl-14452 217 9 be be AUX crl-14452 217 10 selected select VERB crl-14452 217 11 from from ADP crl-14452 217 12 questions question NOUN crl-14452 217 13 sampled sample VERB crl-14452 217 14 in in ADP crl-14452 217 15 the the DET crl-14452 217 16 field field NOUN crl-14452 217 17 , , PUNCT crl-14452 217 18 and and CCONJ crl-14452 217 19 expert expert NOUN crl-14452 217 20 peer peer NOUN crl-14452 217 21 review review NOUN crl-14452 217 22 could could AUX crl-14452 217 23 be be AUX crl-14452 217 24 used use VERB crl-14452 217 25 to to PART crl-14452 217 26 supply supply VERB crl-14452 217 27 appropriate appropriate ADJ crl-14452 217 28 sources source NOUN crl-14452 217 29 . . PUNCT crl-14452 218 1 unobtrusive unobtrusive ADJ crl-14452 218 2 observations observation NOUN crl-14452 218 3 should should AUX crl-14452 218 4 also also ADV crl-14452 218 5 be be AUX crl-14452 218 6 used use VERB crl-14452 218 7 more more ADV crl-14452 218 8 extensively extensively ADV crl-14452 218 9 to to PART crl-14452 218 10 collect collect VERB crl-14452 218 11 information information NOUN crl-14452 218 12 on on ADP crl-14452 218 13 referrals referral NOUN crl-14452 218 14 and and CCONJ crl-14452 218 15 service service NOUN crl-14452 218 16 orientation orientation NOUN crl-14452 218 17 ( ( PUNCT crl-14452 218 18 the the DET crl-14452 218 19 helpfulness helpfulness ADJ crl-14452 218 20 , , PUNCT crl-14452 218 21 responsiveness responsiveness NOUN crl-14452 218 22 , , PUNCT crl-14452 218 23 and and CCONJ crl-14452 218 24 interest interest NOUN crl-14452 218 25 of of ADP crl-14452 218 26 the the DET crl-14452 218 27 librarian librarian NOUN crl-14452 218 28 in in ADP crl-14452 218 29 the the DET crl-14452 218 30 user user NOUN crl-14452 218 31 's 's PART crl-14452 218 32 problem problem NOUN crl-14452 218 33 ) ) PUNCT crl-14452 218 34 . . PUNCT crl-14452 219 1 wilson wilson NOUN crl-14452 219 2 observes observe VERB crl-14452 219 3 that that SCONJ crl-14452 219 4 librarians librarian NOUN crl-14452 219 5 can can AUX crl-14452 219 6 claim claim VERB crl-14452 219 7 to to PART crl-14452 219 8 be be AUX crl-14452 219 9 adept adept ADJ crl-14452 219 10 at at ADP crl-14452 219 11 locating locate VERB crl-14452 219 12 texts text NOUN crl-14452 219 13 and and CCONJ crl-14452 219 14 what what PRON crl-14452 219 15 these these DET crl-14452 219 16 texts text NOUN crl-14452 219 17 sax sax NOUN crl-14452 219 18 about about ADP crl-14452 219 19 each each DET crl-14452 219 20 other other ADJ crl-14452 219 21 and and CCONJ crl-14452 219 22 the the DET crl-14452 219 23 external external ADJ crl-14452 219 24 world world NOUN crl-14452 219 25 . . PUNCT crl-14452 220 1 therefore therefore ADV crl-14452 220 2 , , PUNCT crl-14452 220 3 the the DET crl-14452 220 4 correct correct ADJ crl-14452 220 5 referral referral NOUN crl-14452 220 6 to to ADP crl-14452 220 7 appropriate appropriate ADJ crl-14452 220 8 sources source NOUN crl-14452 220 9 would would AUX crl-14452 220 10 be be AUX crl-14452 220 11 a a DET crl-14452 220 12 more more ADV crl-14452 220 13 appropriate appropriate ADJ crl-14452 220 14 measure measure NOUN crl-14452 220 15 than than ADP crl-14452 220 16 accuracy accuracy NOUN crl-14452 220 17 . . PUNCT crl-14452 221 1 even even ADV crl-14452 221 2 correct correct ADJ crl-14452 221 3 referral referral NOUN crl-14452 221 4 to to ADP crl-14452 221 5 sources source NOUN crl-14452 221 6 is be AUX crl-14452 221 7 not not PART crl-14452 221 8 without without ADP crl-14452 221 9 its its PRON crl-14452 221 10 problems problem NOUN crl-14452 221 11 as as ADP crl-14452 221 12 a a DET crl-14452 221 13 performance performance NOUN crl-14452 221 14 measure measure NOUN crl-14452 221 15 . . PUNCT crl-14452 222 1 sandra sandra PROPN crl-14452 222 2 naiman naiman NOUN crl-14452 222 3 notes note VERB crl-14452 222 4 that that SCONJ crl-14452 222 5 other other ADJ crl-14452 222 6 professions profession NOUN crl-14452 222 7 can can AUX crl-14452 222 8 and and CCONJ crl-14452 222 9 do do AUX crl-14452 222 10 agree agree VERB crl-14452 222 11 that that SCONJ crl-14452 222 12 there there PRON crl-14452 222 13 is be VERB crl-14452 222 14 a a DET crl-14452 222 15 basic basic ADJ crl-14452 222 16 core core NOUN crl-14452 222 17 of of ADP crl-14452 222 18 information information NOUN crl-14452 222 19 and and CCONJ crl-14452 222 20 or or CCONJ crl-14452 222 21 skills skill NOUN crl-14452 222 22 that that SCONJ crl-14452 222 23 members member NOUN crl-14452 222 24 must must AUX crl-14452 222 25 posses posse NOUN crl-14452 222 26 . . PUNCT crl-14452 223 1 yet yet CCONJ crl-14452 223 2 she she PRON crl-14452 223 3 has have AUX crl-14452 223 4 never never ADV crl-14452 223 5 met meet VERB crl-14452 223 6 a a DET crl-14452 223 7 group group NOUN crl-14452 223 8 of of ADP crl-14452 223 9 librarians librarians PROPN crl-14452 223 10 who who PRON crl-14452 223 11 were be AUX crl-14452 223 12 willing willing ADJ crl-14452 223 13 to to PART crl-14452 223 14 reach reach VERB crl-14452 223 15 a a DET crl-14452 223 16 consensus consensus NOUN crl-14452 223 17 on on ADP crl-14452 223 18 the the DET crl-14452 223 19 indispensable indispensable ADJ crl-14452 223 20 reference reference NOUN crl-14452 223 21 sources source NOUN crl-14452 223 22 . . PUNCT crl-14452 224 1 35 35 NUM crl-14452 224 2 reference reference NOUN crl-14452 224 3 performance performance NOUN crl-14452 224 4 measures measure NOUN crl-14452 224 5 used use VERB crl-14452 224 6 in in ADP crl-14452 224 7 obtrusive obtrusive ADJ crl-14452 224 8 studies study NOUN crl-14452 224 9 could could AUX crl-14452 224 10 also also ADV crl-14452 224 11 be be AUX crl-14452 224 12 modified modify VERB crl-14452 224 13 for for ADP crl-14452 224 14 use use NOUN crl-14452 224 15 in in ADP crl-14452 224 16 unobtrusive unobtrusive ADJ crl-14452 224 17 studies study NOUN crl-14452 224 18 . . PUNCT crl-14452 225 1 charles charles PROPN crl-14452 225 2 bunge bunge PROPN crl-14452 225 3 and and CCONJ crl-14452 225 4 marjorie marjorie NOUN crl-14452 225 5 murfin murfin NOUN crl-14452 225 6 have have AUX crl-14452 225 7 established establish VERB crl-14452 225 8 a a DET crl-14452 225 9 stringent stringent ADJ crl-14452 225 10 criterion criterion NOUN crl-14452 225 11 for for ADP crl-14452 225 12 patron patron NOUN crl-14452 225 13 - - PUNCT crl-14452 225 14 perceived perceive VERB crl-14452 225 15 fill fill NOUN crl-14452 225 16 rate rate NOUN crl-14452 225 17 . . PUNCT crl-14452 226 1 36 36 NUM crl-14452 226 2 in in ADP crl-14452 226 3 order order NOUN crl-14452 226 4 to to PART crl-14452 226 5 count count VERB crl-14452 226 6 as as ADP crl-14452 226 7 a a DET crl-14452 226 8 totally totally ADV crl-14452 226 9 successful successful ADJ crl-14452 226 10 question question NOUN crl-14452 226 11 , , PUNCT crl-14452 226 12 users user NOUN crl-14452 226 13 must must AUX crl-14452 226 14 report report VERB crl-14452 226 15 that that SCONJ crl-14452 226 16 they they PRON crl-14452 226 17 located locate VERB crl-14452 226 18 just just ADV crl-14452 226 19 what what PRON crl-14452 226 20 was be AUX crl-14452 226 21 wanted want VERB crl-14452 226 22 and and CCONJ crl-14452 226 23 that that SCONJ crl-14452 226 24 they they PRON crl-14452 226 25 were be AUX crl-14452 226 26 completely completely ADV crl-14452 226 27 satisfied satisfied ADJ crl-14452 226 28 with with ADP crl-14452 226 29 the the DET crl-14452 226 30 information information NOUN crl-14452 226 31 or or CCONJ crl-14452 226 32 materials material NOUN crl-14452 226 33 found find VERB crl-14452 226 34 or or CCONJ crl-14452 226 35 suggested suggest VERB crl-14452 226 36 . . PUNCT crl-14452 227 1 the the DET crl-14452 227 2 average average ADJ crl-14452 227 3 success success NOUN crl-14452 227 4 rate rate NOUN crl-14452 227 5 for for ADP crl-14452 227 6 thirty thirty NUM crl-14452 227 7 - - PUNCT crl-14452 227 8 one one NUM crl-14452 227 9 libraries library NOUN crl-14452 227 10 participating participate VERB crl-14452 227 11 in in ADP crl-14452 227 12 their their PRON crl-14452 227 13 study study NOUN crl-14452 227 14 was be AUX crl-14452 227 15 55.81 55.81 NUM crl-14452 227 16 percent percent NOUN crl-14452 227 17 for for ADP crl-14452 227 18 all all DET crl-14452 227 19 types type NOUN crl-14452 227 20 of of ADP crl-14452 227 21 reference reference NOUN crl-14452 227 22 questions question NOUN crl-14452 227 23 and and CCONJ crl-14452 227 24 46.7 46.7 NUM crl-14452 227 25 percent percent NOUN crl-14452 227 26 for for ADP crl-14452 227 27 factual factual ADJ crl-14452 227 28 reference reference NOUN crl-14452 227 29 questions question NOUN crl-14452 227 30 . . PUNCT crl-14452 228 1 murfin murfin NOUN crl-14452 228 2 and and CCONJ crl-14452 228 3 gary gary PROPN crl-14452 228 4 gugelchuk gugelchuk NOUN crl-14452 228 5 note note VERB crl-14452 228 6 that that SCONJ crl-14452 228 7 the the DET crl-14452 228 8 unrealistically unrealistically ADV crl-14452 228 9 high high ADJ crl-14452 228 10 ratings rating NOUN crl-14452 228 11 found find VERB crl-14452 228 12 in in ADP crl-14452 228 13 previous previous ADJ crl-14452 228 14 studies study NOUN crl-14452 228 15 of of ADP crl-14452 228 16 reference reference NOUN crl-14452 228 17 performance performance NOUN crl-14452 228 18 may may AUX crl-14452 228 19 be be AUX crl-14452 228 20 due due ADJ crl-14452 228 21 in in ADP crl-14452 228 22 great great ADJ crl-14452 228 23 part part NOUN crl-14452 228 24 to to ADP crl-14452 228 25 the the DET crl-14452 228 26 use use NOUN crl-14452 228 27 of of ADP crl-14452 228 28 inadequate inadequate ADJ crl-14452 228 29 instruments instrument NOUN crl-14452 228 30 and and CCONJ crl-14452 228 31 methods method NOUN crl-14452 228 32 to to PART crl-14452 228 33 study study VERB crl-14452 228 34 a a DET crl-14452 228 35 complex complex ADJ crl-14452 228 36 phenomenon phenomenon NOUN crl-14452 228 37 . . PUNCT crl-14452 229 1 37 37 NUM crl-14452 229 2 in in ADP crl-14452 229 3 the the DET crl-14452 229 4 present present ADJ crl-14452 229 5 study study NOUN crl-14452 229 6 of of ADP crl-14452 229 7 five five NUM crl-14452 229 8 academic academic ADJ crl-14452 229 9 libraries library NOUN crl-14452 229 10 , , PUNCT crl-14452 229 11 66 66 NUM crl-14452 229 12 percent percent NOUN crl-14452 229 13 of of ADP crl-14452 229 14 users user NOUN crl-14452 229 15 report report VERB crl-14452 229 16 finding find VERB crl-14452 229 17 what what PRON crl-14452 229 18 they they PRON crl-14452 229 19 needed need VERB crl-14452 229 20 . . PUNCT crl-14452 230 1 this this PRON crl-14452 230 2 exceeds exceed VERB crl-14452 230 3 the the DET crl-14452 230 4 average average ADJ crl-14452 230 5 success success NOUN crl-14452 230 6 rates rate NOUN crl-14452 230 7 generally generally ADV crl-14452 230 8 found find VERB crl-14452 230 9 in in ADP crl-14452 230 10 unobtrusive unobtrusive ADJ crl-14452 230 11 studies study NOUN crl-14452 230 12 . . PUNCT crl-14452 231 1 the the DET crl-14452 231 2 majority majority NOUN crl-14452 231 3 ( ( PUNCT crl-14452 231 4 75 75 NUM crl-14452 231 5 percent percent NOUN crl-14452 231 6 ) ) PUNCT crl-14452 231 7 also also ADV crl-14452 231 8 report report VERB crl-14452 231 9 that that SCONJ crl-14452 231 10 they they PRON crl-14452 231 11 are be AUX crl-14452 231 12 very very ADV crl-14452 231 13 highly highly ADV crl-14452 231 14 satisfied satisfied ADJ crl-14452 231 15 ( ( PUNCT crl-14452 231 16 1 1 NUM crl-14452 231 17 or or CCONJ crl-14452 231 18 2 2 NUM crl-14452 231 19 on on ADP crl-14452 231 20 a a DET crl-14452 231 21 scale scale NOUN crl-14452 231 22 of of ADP crl-14452 231 23 7 7 NUM crl-14452 231 24 ) ) PUNCT crl-14452 231 25 . . PUNCT crl-14452 232 1 for for ADP crl-14452 232 2 this this DET crl-14452 232 3 study study NOUN crl-14452 232 4 , , PUNCT crl-14452 232 5 adopting adopt VERB crl-14452 232 6 a a DET crl-14452 232 7 more more ADV crl-14452 232 8 stringent stringent ADJ crl-14452 232 9 criterion criterion NOUN crl-14452 232 10 similar similar ADJ crl-14452 232 11 to to ADP crl-14452 232 12 that that PRON crl-14452 232 13 used use VERB crl-14452 232 14 by by ADP crl-14452 232 15 bunge bunge NOUN crl-14452 232 16 and and CCONJ crl-14452 232 17 murfin murfin NOUN crl-14452 232 18 would would AUX crl-14452 232 19 result result VERB crl-14452 232 20 in in ADP crl-14452 232 21 a a DET crl-14452 232 22 total total ADJ crl-14452 232 23 success success NOUN crl-14452 232 24 rate rate NOUN crl-14452 232 25 of of ADP crl-14452 232 26 57 57 NUM crl-14452 232 27 percent percent NOUN crl-14452 232 28 for for ADP crl-14452 232 29 users user NOUN crl-14452 232 30 who who PRON crl-14452 232 31 found find VERB crl-14452 232 32 what what PRON crl-14452 232 33 they they PRON crl-14452 232 34 needed need VERB crl-14452 232 35 and and CCONJ crl-14452 232 36 also also ADV crl-14452 232 37 indicated indicate VERB crl-14452 232 38 that that SCONJ crl-14452 232 39 they they PRON crl-14452 232 40 were be AUX crl-14452 232 41 very very ADV crl-14452 232 42 highly highly ADV crl-14452 232 43 satisfied satisfied ADJ crl-14452 232 44 . . PUNCT crl-14452 233 1 therefore therefore ADV crl-14452 233 2 , , PUNCT crl-14452 233 3 use use NOUN crl-14452 233 4 of of ADP crl-14452 233 5 these these DET crl-14452 233 6 or or CCONJ crl-14452 233 7 similar similar ADJ crl-14452 233 8 measures measure NOUN crl-14452 233 9 in in ADP crl-14452 233 10 unobtrusive unobtrusive ADJ crl-14452 233 11 studies study NOUN crl-14452 233 12 would would AUX crl-14452 233 13 definitely definitely ADV crl-14452 233 14 permit permit VERB crl-14452 233 15 researchers researcher NOUN crl-14452 233 16 to to PART crl-14452 233 17 include include VERB crl-14452 233 18 the the DET crl-14452 233 19 more more ADV crl-14452 233 20 common common ADJ crl-14452 233 21 subject subject NOUN crl-14452 233 22 and and CCONJ crl-14452 233 23 instructional instructional ADJ crl-14452 233 24 types type NOUN crl-14452 233 25 of of ADP crl-14452 233 26 questions question NOUN crl-14452 233 27 with with ADP crl-14452 233 28 more more ADV crl-14452 233 29 precise precise ADJ crl-14452 233 30 measures measure NOUN crl-14452 233 31 than than ADP crl-14452 233 32 global global ADJ crl-14452 233 33 indications indication NOUN crl-14452 233 34 of of ADP crl-14452 233 35 satisfaction satisfaction NOUN crl-14452 233 36 . . PUNCT crl-14452 234 1 with with ADP crl-14452 234 2 the the DET crl-14452 234 3 evidence evidence NOUN crl-14452 234 4 of of ADP crl-14452 234 5 poor poor ADJ crl-14452 234 6 performance performance NOUN crl-14452 234 7 on on ADP crl-14452 234 8 certain certain ADJ crl-14452 234 9 types type NOUN crl-14452 234 10 of of ADP crl-14452 234 11 factual factual ADJ crl-14452 234 12 and and CCONJ crl-14452 234 13 bibliographic bibliographic ADJ crl-14452 234 14 questions question NOUN crl-14452 234 15 that that PRON crl-14452 234 16 librarians librarian NOUN crl-14452 234 17 are be AUX crl-14452 234 18 asked ask VERB crl-14452 234 19 , , PUNCT crl-14452 234 20 academic academic ADJ crl-14452 234 21 librarians librarian NOUN crl-14452 234 22 might might AUX crl-14452 234 23 be be AUX crl-14452 234 24 well well ADV crl-14452 234 25 advised advise VERB crl-14452 234 26 to to PART crl-14452 234 27 be be AUX crl-14452 234 28 more more ADV crl-14452 234 29 critical critical ADJ crl-14452 234 30 in in ADP crl-14452 234 31 interpreting interpret VERB crl-14452 234 32 the the DET crl-14452 234 33 text text NOUN crl-14452 234 34 to to ADP crl-14452 234 35 the the DET crl-14452 234 36 user user NOUN crl-14452 234 37 , , PUNCT crl-14452 234 38 particularly particularly ADV crl-14452 234 39 when when SCONJ crl-14452 234 40 they they PRON crl-14452 234 41 can can AUX crl-14452 234 42 not not PART crl-14452 234 43 claim claim VERB crl-14452 234 44 expertise expertise NOUN crl-14452 234 45 in in ADP crl-14452 234 46 the the DET crl-14452 234 47 subject subject ADJ crl-14452 234 48 area area NOUN crl-14452 234 49 . . PUNCT crl-14452 235 1 library library PROPN crl-14452 235 2 schools school NOUN crl-14452 235 3 might might AUX crl-14452 235 4 consider consider VERB crl-14452 235 5 providing provide VERB crl-14452 235 6 more more ADV crl-14452 235 7 extensive extensive ADJ crl-14452 235 8 education education NOUN crl-14452 235 9 for for ADP crl-14452 235 10 librarians librarian NOUN crl-14452 235 11 in in ADP crl-14452 235 12 interpretation interpretation NOUN crl-14452 235 13 and and CCONJ crl-14452 235 14 verification verification NOUN crl-14452 235 15 of of ADP crl-14452 235 16 answers answer NOUN crl-14452 235 17 in in ADP crl-14452 235 18 standard standard ADJ crl-14452 235 19 factual factual ADJ crl-14452 235 20 sources source NOUN crl-14452 235 21 . . PUNCT crl-14452 236 1 academic academic ADJ crl-14452 236 2 librarians librarian NOUN crl-14452 236 3 responding respond VERB crl-14452 236 4 to to ADP crl-14452 236 5 factual factual ADJ crl-14452 236 6 queries query NOUN crl-14452 236 7 in in ADP crl-14452 236 8 areas area NOUN crl-14452 236 9 for for ADP crl-14452 236 10 which which PRON crl-14452 236 11 they they PRON crl-14452 236 12 lacked lack VERB crl-14452 236 13 the the DET crl-14452 236 14 expertise expertise NOUN crl-14452 236 15 to to PART crl-14452 236 16 make make VERB crl-14452 236 17 . . PUNCT crl-14452 237 1 an an DET crl-14452 237 2 independent independent ADJ crl-14452 237 3 evaluation evaluation NOUN crl-14452 237 4 would would AUX crl-14452 237 5 then then ADV crl-14452 237 6 say say VERB crl-14452 237 7 to to ADP crl-14452 237 8 the the DET crl-14452 237 9 user user NOUN crl-14452 237 10 , , PUNCT crl-14452 237 11 '' '' PUNCT crl-14452 237 12 here here ADV crl-14452 237 13 is be AUX crl-14452 237 14 a a DET crl-14452 237 15 source source NOUN crl-14452 237 16 that that PRON crl-14452 237 17 might might AUX crl-14452 237 18 help help VERB crl-14452 237 19 you you PRON crl-14452 237 20 find find VERB crl-14452 237 21 an an DET crl-14452 237 22 answer answer NOUN crl-14452 237 23 to to ADP crl-14452 237 24 your your PRON crl-14452 237 25 question question NOUN crl-14452 237 26 '' '' PUNCT crl-14452 237 27 rather rather ADV crl-14452 237 28 than than ADP crl-14452 237 29 , , PUNCT crl-14452 237 30 '' '' PUNCT crl-14452 237 31 here here ADV crl-14452 237 32 is be AUX crl-14452 237 33 the the DET crl-14452 237 34 answer answer NOUN crl-14452 237 35 to to ADP crl-14452 237 36 your your PRON crl-14452 237 37 question question NOUN crl-14452 237 38 . . PUNCT crl-14452 237 39 '' '' PUNCT crl-14452 238 1 when when SCONJ crl-14452 238 2 problems problem NOUN crl-14452 238 3 of of ADP crl-14452 238 4 authority authority NOUN crl-14452 238 5 arise arise NOUN crl-14452 238 6 and and CCONJ crl-14452 238 7 neither neither CCONJ crl-14452 238 8 librarian librarian NOUN crl-14452 238 9 nor nor CCONJ crl-14452 238 10 the the DET crl-14452 238 11 user user NOUN crl-14452 238 12 have have VERB crl-14452 238 13 the the DET crl-14452 238 14 subject subject ADJ crl-14452 238 15 expertise expertise NOUN crl-14452 238 16 to to PART crl-14452 238 17 make make VERB crl-14452 238 18 a a DET crl-14452 238 19 judgment judgment NOUN crl-14452 238 20 , , PUNCT crl-14452 238 21 academic academic ADJ crl-14452 238 22 librarians librarian NOUN crl-14452 238 23 would would AUX crl-14452 238 24 do do VERB crl-14452 238 25 well well ADV crl-14452 238 26 to to PART crl-14452 238 27 refer refer VERB crl-14452 238 28 users user NOUN crl-14452 238 29 to to ADP crl-14452 238 30 teachers teacher NOUN crl-14452 238 31 with with ADP crl-14452 238 32 expert expert ADJ crl-14452 238 33 knowledge knowledge NOUN crl-14452 238 34 . . PUNCT crl-14452 239 1 the the DET crl-14452 239 2 results result NOUN crl-14452 239 3 of of ADP crl-14452 239 4 the the DET crl-14452 239 5 unobtrusive unobtrusive ADJ crl-14452 239 6 studies study NOUN crl-14452 239 7 also also ADV crl-14452 239 8 provide provide VERB crl-14452 239 9 convincing convincing ADJ crl-14452 239 10 evidence evidence NOUN crl-14452 239 11 that that SCONJ crl-14452 239 12 many many ADJ crl-14452 239 13 librarians librarian NOUN crl-14452 239 14 need need VERB crl-14452 239 15 to to PART crl-14452 239 16 be be AUX crl-14452 239 17 more more ADV crl-14452 239 18 critical critical ADJ crl-14452 239 19 in in ADP crl-14452 239 20 assessing assess VERB crl-14452 239 21 their their PRON crl-14452 239 22 expertise expertise NOUN crl-14452 239 23 when when SCONJ crl-14452 239 24 responding respond VERB crl-14452 239 25 to to ADP crl-14452 239 26 f f NUM crl-14452 239 27 ~ ~ SYM crl-14452 239 28 ctual ctual ADJ crl-14452 239 29 queries query NOUN crl-14452 239 30 . . PUNCT crl-14452 240 1 harold harold PROPN crl-14452 240 2 wilensky wilensky PROPN crl-14452 240 3 unobtrusive unobtrusive VERB crl-14452 240 4 studies study NOUN crl-14452 240 5 191 191 NUM crl-14452 240 6 notes note VERB crl-14452 240 7 that that SCONJ crl-14452 240 8 one one NUM crl-14452 240 9 standard standard NOUN crl-14452 240 10 highly highly ADV crl-14452 240 11 adhered adhere VERB crl-14452 240 12 to to ADP crl-14452 240 13 and and CCONJ crl-14452 240 14 accepted accept VERB crl-14452 240 15 in in ADP crl-14452 240 16 established establish VERB crl-14452 240 17 professions profession NOUN crl-14452 240 18 is be AUX crl-14452 240 19 awareness awareness NOUN crl-14452 240 20 of of ADP crl-14452 240 21 the the DET crl-14452 240 22 limited limited ADJ crl-14452 240 23 competence competence NOUN crl-14452 240 24 of of ADP crl-14452 240 25 your your PRON crl-14452 240 26 own own ADJ crl-14452 240 27 specialty specialty NOUN crl-14452 240 28 within within ADP crl-14452 240 29 the the DET crl-14452 240 30 profession profession NOUN crl-14452 240 31 and and CCONJ crl-14452 240 32 readiness readiness NOUN crl-14452 240 33 to to PART crl-14452 240 34 refer refer VERB crl-14452 240 35 clients client NOUN crl-14452 240 36 to to ADP crl-14452 240 37 a a DET crl-14452 240 38 more more ADV crl-14452 240 39 competent competent ADJ crl-14452 240 40 colleague colleague NOUN crl-14452 240 41 . . PUNCT crl-14452 241 1 38 38 NUM crl-14452 241 2 by by ADP crl-14452 241 3 closely closely ADV crl-14452 241 4 adhering adhere VERB crl-14452 241 5 to to ADP crl-14452 241 6 this this DET crl-14452 241 7 professional professional ADJ crl-14452 241 8 standard standard NOUN crl-14452 241 9 , , PUNCT crl-14452 241 10 reference reference NOUN crl-14452 241 11 librarians librarian NOUN crl-14452 241 12 could could AUX crl-14452 241 13 improve improve VERB crl-14452 241 14 the the DET crl-14452 241 15 quality quality NOUN crl-14452 241 16 of of ADP crl-14452 241 17 their their PRON crl-14452 241 18 factual factual ADJ crl-14452 241 19 answering answering NOUN crl-14452 241 20 services service NOUN crl-14452 241 21 by by ADP crl-14452 241 22 referring refer VERB crl-14452 241 23 users user NOUN crl-14452 241 24 to to AUX crl-14452 241 25 expert expert VERB crl-14452 241 26 sources source NOUN crl-14452 241 27 rather rather ADV crl-14452 241 28 than than ADP crl-14452 241 29 providing provide VERB crl-14452 241 30 an an DET crl-14452 241 31 answer answer NOUN crl-14452 241 32 of of ADP crl-14452 241 33 uncertain uncertain ADJ crl-14452 241 34 quality quality NOUN crl-14452 241 35 . . PUNCT crl-14452 242 1 for for ADP crl-14452 242 2 academic academic ADJ crl-14452 242 3 libraries library NOUN crl-14452 242 4 with with ADP crl-14452 242 5 a a DET crl-14452 242 6 government government NOUN crl-14452 242 7 publications publication NOUN crl-14452 242 8 department department NOUN crl-14452 242 9 , , PUNCT crl-14452 242 10 specialized specialized ADJ crl-14452 242 11 factual factual ADJ crl-14452 242 12 answering answer VERB crl-14452 242 13 services service NOUN crl-14452 242 14 might might AUX crl-14452 242 15 be be AUX crl-14452 242 16 combined combine VERB crl-14452 242 17 with with ADP crl-14452 242 18 the the DET crl-14452 242 19 duties duty NOUN crl-14452 242 20 of of ADP crl-14452 242 21 documents document NOUN crl-14452 242 22 librarians librarians PROPN crl-14452 242 23 . . PUNCT crl-14452 243 1 librarians librarian NOUN crl-14452 243 2 in in ADP crl-14452 243 3 smaller small ADJ crl-14452 243 4 libraries library NOUN crl-14452 243 5 who who PRON crl-14452 243 6 have have VERB crl-14452 243 7 difficulty difficulty NOUN crl-14452 243 8 developing develop VERB crl-14452 243 9 such such ADJ crl-14452 243 10 expertise expertise NOUN crl-14452 243 11 in in ADP crl-14452 243 12 the the DET crl-14452 243 13 staff staff NOUN crl-14452 243 14 might might AUX crl-14452 243 15 try try VERB crl-14452 243 16 to to PART crl-14452 243 17 maintain maintain VERB crl-14452 243 18 sources source NOUN crl-14452 243 19 for for ADP crl-14452 243 20 expert expert NOUN crl-14452 243 21 referral referral NOUN crl-14452 243 22 and and CCONJ crl-14452 243 23 carefully carefully ADV crl-14452 243 24 identify identify VERB crl-14452 243 25 those those DET crl-14452 243 26 sources source NOUN crl-14452 243 27 for for ADP crl-14452 243 28 which which PRON crl-14452 243 29 they they PRON crl-14452 243 30 are be AUX crl-14452 243 31 prepared prepared ADJ crl-14452 243 32 to to PART crl-14452 243 33 provide provide VERB crl-14452 243 34 in in ADP crl-14452 243 35 - - PUNCT crl-14452 243 36 depth depth NOUN crl-14452 243 37 factual factual ADJ crl-14452 243 38 question question NOUN crl-14452 243 39 answering answer VERB crl-14452 243 40 services service NOUN crl-14452 243 41 . . PUNCT crl-14452 244 1 because because SCONJ crl-14452 244 2 of of ADP crl-14452 244 3 the the DET crl-14452 244 4 weaknesses weakness NOUN crl-14452 244 5 of of ADP crl-14452 244 6 both both CCONJ crl-14452 244 7 unobtrusive unobtrusive ADJ crl-14452 244 8 and and CCONJ crl-14452 244 9 obtrusive obtrusive ADJ crl-14452 244 10 studies study NOUN crl-14452 244 11 , , PUNCT crl-14452 244 12 more more ADV crl-14452 244 13 sophisticated sophisticated ADJ crl-14452 244 14 methods method NOUN crl-14452 244 15 must must AUX crl-14452 244 16 be be AUX crl-14452 244 17 developed develop VERB crl-14452 244 18 for for ADP crl-14452 244 19 evaluating evaluate VERB crl-14452 244 20 reference reference NOUN crl-14452 244 21 service service NOUN crl-14452 244 22 performance performance NOUN crl-14452 244 23 . . PUNCT crl-14452 245 1 when when SCONJ crl-14452 245 2 reference reference NOUN crl-14452 245 3 evaluation evaluation NOUN crl-14452 245 4 methods method NOUN crl-14452 245 5 are be AUX crl-14452 245 6 able able ADJ crl-14452 245 7 to to PART crl-14452 245 8 provide provide VERB crl-14452 245 9 a a DET crl-14452 245 10 more more ADV crl-14452 245 11 comprehensive comprehensive ADJ crl-14452 245 12 picture picture NOUN crl-14452 245 13 of of ADP crl-14452 245 14 the the DET crl-14452 245 15 quality quality NOUN crl-14452 245 16 of of ADP crl-14452 245 17 reference reference NOUN crl-14452 245 18 service service NOUN crl-14452 245 19 , , PUNCT crl-14452 245 20 reference reference NOUN crl-14452 245 21 librarians librarian NOUN crl-14452 245 22 and and CCONJ crl-14452 245 23 managers manager NOUN crl-14452 245 24 will will AUX crl-14452 245 25 be be AUX crl-14452 245 26 more more ADV crl-14452 245 27 interested interested ADJ crl-14452 245 28 in in ADP crl-14452 245 29 using use VERB crl-14452 245 30 the the DET crl-14452 245 31 results result NOUN crl-14452 245 32 to to PART crl-14452 245 33 modify modify VERB crl-14452 245 34 reference reference NOUN crl-14452 245 35 service service NOUN crl-14452 245 36 practice practice NOUN crl-14452 245 37 . . PUNCT crl-14452 246 1 a a DET crl-14452 246 2 major major ADJ crl-14452 246 3 advance advance NOUN crl-14452 246 4 in in ADP crl-14452 246 5 improving improve VERB crl-14452 246 6 reference reference NOUN crl-14452 246 7 evaluation evaluation NOUN crl-14452 246 8 will will AUX crl-14452 246 9 be be AUX crl-14452 246 10 expanding expand VERB crl-14452 246 11 the the DET crl-14452 246 12 scope scope NOUN crl-14452 246 13 of of ADP crl-14452 246 14 the the DET crl-14452 246 15 predetermined predetermined ADJ crl-14452 246 16 test test NOUN crl-14452 246 17 questions question NOUN crl-14452 246 18 now now ADV crl-14452 246 19 used use VERB crl-14452 246 20 in in ADP crl-14452 246 21 unobtrusive unobtrusive ADJ crl-14452 246 22 studies study NOUN crl-14452 246 23 and and CCONJ crl-14452 246 24 developing develop VERB crl-14452 246 25 additional additional ADJ crl-14452 246 26 measures measure NOUN crl-14452 246 27 of of ADP crl-14452 246 28 effectiveness effectiveness NOUN crl-14452 246 29 to to PART crl-14452 246 30 supplement supplement VERB crl-14452 246 31 correct correct ADJ crl-14452 246 32 answer answer NOUN crl-14452 246 33 fill fill NOUN crl-14452 246 34 rate rate NOUN crl-14452 246 35 . . PUNCT crl-14452 247 1 while while SCONJ crl-14452 247 2 we we PRON crl-14452 247 3 are be AUX crl-14452 247 4 waiting wait VERB crl-14452 247 5 for for ADP crl-14452 247 6 more more ADV crl-14452 247 7 sophisticated sophisticated ADJ crl-14452 247 8 studies study NOUN crl-14452 247 9 that that PRON crl-14452 247 10 use use VERB crl-14452 247 11 a a DET crl-14452 247 12 greater great ADJ crl-14452 247 13 variety variety NOUN crl-14452 247 14 of of ADP crl-14452 247 15 evaluation evaluation NOUN crl-14452 247 16 methods method NOUN crl-14452 247 17 , , PUNCT crl-14452 247 18 we we PRON crl-14452 247 19 can can AUX crl-14452 247 20 modify modify VERB crl-14452 247 21 our our PRON crl-14452 247 22 professional professional ADJ crl-14452 247 23 service service NOUN crl-14452 247 24 practices practice NOUN crl-14452 247 25 by by ADP crl-14452 247 26 more more ADV crl-14452 247 27 critically critically ADV crl-14452 247 28 examining examine VERB crl-14452 247 29 our our PRON crl-14452 247 30 competence competence NOUN crl-14452 247 31 to to PART crl-14452 247 32 answer answer VERB crl-14452 247 33 certain certain ADJ crl-14452 247 34 types type NOUN crl-14452 247 35 of of ADP crl-14452 247 36 factual factual ADJ crl-14452 247 37 queries query NOUN crl-14452 247 38 . . PUNCT crl-14452 248 1 for for ADP crl-14452 248 2 most most ADJ crl-14452 248 3 queries query NOUN crl-14452 248 4 , , PUNCT crl-14452 248 5 academic academic ADJ crl-14452 248 6 librarians librarian NOUN crl-14452 248 7 might might AUX crl-14452 248 8 do do VERB crl-14452 248 9 best well ADV crl-14452 248 10 to to PART crl-14452 248 11 focus focus VERB crl-14452 248 12 on on ADP crl-14452 248 13 evaluating evaluate VERB crl-14452 248 14 their their PRON crl-14452 248 15 competency competency NOUN crl-14452 248 16 in in ADP crl-14452 248 17 source source NOUN crl-14452 248 18 referral referral NOUN crl-14452 248 19 , , PUNCT crl-14452 248 20 both both CCONJ crl-14452 248 21 internal internal ADJ crl-14452 248 22 and and CCONJ crl-14452 248 23 external external ADJ crl-14452 248 24 . . PUNCT crl-14452 249 1 finally finally ADV crl-14452 249 2 , , PUNCT crl-14452 249 3 we we PRON crl-14452 249 4 should should AUX crl-14452 249 5 consider consider VERB crl-14452 249 6 how how SCONJ crl-14452 249 7 often often ADV crl-14452 249 8 we we PRON crl-14452 249 9 ask ask VERB crl-14452 249 10 users user NOUN crl-14452 249 11 whether whether SCONJ crl-14452 249 12 their their PRON crl-14452 249 13 questions question NOUN crl-14452 249 14 were be AUX crl-14452 249 15 answered answer VERB crl-14452 249 16 fully fully ADV crl-14452 249 17 and and CCONJ crl-14452 249 18 whether whether SCONJ crl-14452 249 19 they they PRON crl-14452 249 20 have have AUX crl-14452 249 21 found find VERB crl-14452 249 22 what what PRON crl-14452 249 23 they they PRON crl-14452 249 24 wanted want VERB crl-14452 249 25 . . PUNCT crl-14452 250 1 192 192 NUM crl-14452 250 2 college college PROPN crl-14452 250 3 & & CCONJ crl-14452 250 4 research research PROPN crl-14452 250 5 libraries library NOUN crl-14452 250 6 march march PROPN crl-14452 250 7 1989 1989 NUM crl-14452 250 8 references reference NOUN crl-14452 250 9 1 1 NUM crl-14452 250 10 . . PUNCT crl-14452 250 11 peter peter PROPN crl-14452 250 12 hernon hernon PROPN crl-14452 250 13 and and CCONJ crl-14452 250 14 charles charles PROPN crl-14452 250 15 r. r. PROPN crl-14452 250 16 mcclure mcclure PROPN crl-14452 250 17 , , PUNCT crl-14452 250 18 unobtrusive unobtrusive ADJ crl-14452 250 19 testing testing NOUN crl-14452 250 20 and and CCONJ crl-14452 250 21 library library NOUN crl-14452 250 22 reference reference NOUN crl-14452 250 23 seroices seroice NOUN crl-14452 250 24 ( ( PUNCT crl-14452 250 25 norwood norwood NOUN crl-14452 250 26 , , PUNCT crl-14452 250 27 n.j n.j PROPN crl-14452 250 28 . . PROPN crl-14452 250 29 : : PUNCT crl-14452 250 30 ablex ablex PROPN crl-14452 250 31 , , PUNCT crl-14452 250 32 1987 1987 NUM crl-14452 250 33 ) ) PUNCT crl-14452 250 34 . . PUNCT crl-14452 251 1 2 2 X crl-14452 251 2 . . X crl-14452 251 3 jo jo PROPN crl-14452 251 4 bell bell PROPN crl-14452 251 5 whitlatch whitlatch NOUN crl-14452 251 6 , , PUNCT crl-14452 251 7 " " PUNCT crl-14452 251 8 client client NOUN crl-14452 251 9 / / SYM crl-14452 251 10 service service NOUN crl-14452 251 11 provider provider NOUN crl-14452 251 12 perceptions perception NOUN crl-14452 251 13 of of ADP crl-14452 251 14 reference reference NOUN crl-14452 251 15 service service NOUN crl-14452 251 16 outcomes outcome NOUN crl-14452 251 17 in in ADP crl-14452 251 18 academic academic ADJ crl-14452 251 19 libraries library NOUN crl-14452 251 20 : : PUNCT crl-14452 251 21 effects effect NOUN crl-14452 251 22 of of ADP crl-14452 251 23 feedback feedback NOUN crl-14452 251 24 and and CCONJ crl-14452 251 25 uncertainty uncertainty NOUN crl-14452 251 26 " " PUNCT crl-14452 251 27 ( ( PUNCT crl-14452 251 28 ph.d ph.d PROPN crl-14452 251 29 . . PUNCT crl-14452 251 30 diss diss PROPN crl-14452 251 31 . . PROPN crl-14452 251 32 , , PUNCT crl-14452 251 33 university university PROPN crl-14452 251 34 of of ADP crl-14452 251 35 california california PROPN crl-14452 251 36 , , PUNCT crl-14452 251 37 berkeley berkeley PROPN crl-14452 251 38 , , PUNCT crl-14452 251 39 1987 1987 NUM crl-14452 251 40 ) ) PUNCT crl-14452 251 41 . . PUNCT crl-14452 252 1 3 3 X crl-14452 252 2 . . X crl-14452 252 3 peter peter PROPN crl-14452 252 4 hernon hernon PROPN crl-14452 252 5 and and CCONJ crl-14452 252 6 charles charles PROPN crl-14452 252 7 r. r. PROPN crl-14452 252 8 mcoure mcoure PROPN crl-14452 252 9 , , PUNCT crl-14452 252 10 " " PUNCT crl-14452 252 11 unobtrusive unobtrusive ADJ crl-14452 252 12 testing testing NOUN crl-14452 252 13 : : PUNCT crl-14452 252 14 the the DET crl-14452 252 15 55 55 NUM crl-14452 252 16 percent percent NOUN crl-14452 252 17 rule rule NOUN crl-14452 252 18 , , PUNCT crl-14452 252 19 " " PUNCT crl-14452 252 20 library library PROPN crl-14452 252 21 journa1111:37 journa1111:37 PROPN crl-14452 252 22 - - PROPN crl-14452 252 23 41 41 NUM crl-14452 252 24 ( ( PUNCT crl-14452 252 25 1986 1986 NUM crl-14452 252 26 ) ) PUNCT crl-14452 252 27 . . PUNCT crl-14452 253 1 4 4 X crl-14452 253 2 . . X crl-14452 253 3 thomas thomas PROPN crl-14452 253 4 childers childer NOUN crl-14452 253 5 , , PUNCT crl-14452 253 6 '' '' PUNCT crl-14452 253 7 the the DET crl-14452 253 8 quality quality NOUN crl-14452 253 9 of of ADP crl-14452 253 10 reference reference NOUN crl-14452 253 11 : : PUNCT crl-14452 253 12 still still ADV crl-14452 253 13 moot moot VERB crl-14452 253 14 after after ADP crl-14452 253 15 20 20 NUM crl-14452 253 16 years year NOUN crl-14452 253 17 , , PUNCT crl-14452 253 18 '' '' PUNCT crl-14452 253 19 journal journal PROPN crl-14452 253 20 of of ADP crl-14452 253 21 academic academic ADJ crl-14452 253 22 librarianship librarianship NOUN crl-14452 253 23 13:73 13:73 NUM crl-14452 253 24 - - SYM crl-14452 253 25 74 74 NUM crl-14452 253 26 ( ( PUNCT crl-14452 253 27 1987 1987 NUM crl-14452 253 28 ) ) PUNCT crl-14452 253 29 . . PUNCT crl-14452 254 1 5 5 X crl-14452 254 2 . . X crl-14452 254 3 hernon hernon NOUN crl-14452 254 4 and and CCONJ crl-14452 254 5 mcoure mcoure NOUN crl-14452 254 6 , , PUNCT crl-14452 254 7 " " PUNCT crl-14452 254 8 unobtrusive unobtrusive ADJ crl-14452 254 9 testing testing NOUN crl-14452 254 10 , , PUNCT crl-14452 254 11 " " PUNCT crl-14452 254 12 p.39 p.39 X crl-14452 254 13 . . PUNCT crl-14452 255 1 6 6 X crl-14452 255 2 . . X crl-14452 255 3 ibid ibid NOUN crl-14452 255 4 . . PUNCT crl-14452 255 5 , , PUNCT crl-14452 255 6 p.48 p.48 PROPN crl-14452 255 7 . . PROPN crl-14452 256 1 7 7 X crl-14452 256 2 . . X crl-14452 256 3 hernon hernon PROPN crl-14452 256 4 and and CCONJ crl-14452 256 5 mcclure mcclure NOUN crl-14452 256 6 , , PUNCT crl-14452 256 7 " " PUNCT crl-14452 256 8 unobtrusive unobtrusive ADJ crl-14452 256 9 testing testing NOUN crl-14452 256 10 , , PUNCT crl-14452 256 11 " " PUNCT crl-14452 256 12 p.24 p.24 X crl-14452 256 13 . . NOUN crl-14452 257 1 8 8 X crl-14452 257 2 . . X crl-14452 257 3 ibid ibid PROPN crl-14452 257 4 . . PUNCT crl-14452 257 5 , , PUNCT crl-14452 257 6 p.41 p.41 PROPN crl-14452 257 7 . . PUNCT crl-14452 258 1 9 9 X crl-14452 258 2 . . PROPN crl-14452 258 3 jum jum PROPN crl-14452 258 4 c. c. PROPN crl-14452 258 5 nunnally nunnally ADV crl-14452 258 6 , , PUNCT crl-14452 258 7 psychometric psychometric ADJ crl-14452 258 8 theory theory NOUN crl-14452 258 9 ( ( PUNCT crl-14452 258 10 new new PROPN crl-14452 258 11 york york PROPN crl-14452 258 12 : : PUNCT crl-14452 258 13 mcgraw mcgraw PROPN crl-14452 258 14 hill hill PROPN crl-14452 258 15 , , PUNCT crl-14452 258 16 1978 1978 NUM crl-14452 258 17 ) ) PUNCT crl-14452 258 18 , , PUNCT crl-14452 258 19 p.93 p.93 NOUN crl-14452 258 20 . . PUNCT crl-14452 259 1 10 10 NUM crl-14452 259 2 . . PUNCT crl-14452 260 1 childers childer NOUN crl-14452 260 2 , , PUNCT crl-14452 260 3 " " PUNCT crl-14452 260 4 the the DET crl-14452 260 5 quality quality NOUN crl-14452 260 6 of of ADP crl-14452 260 7 reference reference NOUN crl-14452 260 8 . . PUNCT crl-14452 260 9 " " PUNCT crl-14452 261 1 11 11 NUM crl-14452 261 2 . . X crl-14452 261 3 ibid ibid PROPN crl-14452 261 4 . . PUNCT crl-14452 262 1 u. u. PROPN crl-14452 262 2 evelyn evelyn PROPN crl-14452 262 3 h. h. PROPN crl-14452 262 4 daniel daniel PROPN crl-14452 262 5 , , PUNCT crl-14452 262 6 " " PUNCT crl-14452 262 7 the the DET crl-14452 262 8 effects effect NOUN crl-14452 262 9 of of ADP crl-14452 262 10 identity identity NOUN crl-14452 262 11 , , PUNCT crl-14452 262 12 attitude attitude NOUN crl-14452 262 13 and and CCONJ crl-14452 262 14 priority priority NOUN crl-14452 262 15 , , PUNCT crl-14452 262 16 " " PUNCT crl-14452 262 17 journal journal NOUN crl-14452 262 18 of of ADP crl-14452 262 19 academic academic ADJ crl-14452 262 20 librarianship librarianship NOUN crl-14452 262 21 13:76 13:76 NUM crl-14452 262 22 - - SYM crl-14452 262 23 78 78 NUM crl-14452 262 24 ( ( PUNCT crl-14452 262 25 1987 1987 NUM crl-14452 262 26 ) ) PUNCT crl-14452 262 27 . . PUNCT crl-14452 263 1 . . PUNCT crl-14452 264 1 13 13 NUM crl-14452 264 2 . . PUNCT crl-14452 264 3 duane duane PROPN crl-14452 264 4 e. e. PROPN crl-14452 264 5 webster webster PROPN crl-14452 264 6 , , PUNCT crl-14452 264 7 " " PUNCT crl-14452 264 8 examining examine VERB crl-14452 264 9 the the DET crl-14452 264 10 broader broad ADJ crl-14452 264 11 domain domain NOUN crl-14452 264 12 , , PUNCT crl-14452 264 13 " " PUNCT crl-14452 264 14 journal journal NOUN crl-14452 264 15 of of ADP crl-14452 264 16 academic academic ADJ crl-14452 264 17 librarianship librarianship NOUN crl-14452 264 18 13:79 13:79 NUM crl-14452 264 19 - - SYM crl-14452 264 20 80 80 NUM crl-14452 264 21 ( ( PUNCT crl-14452 264 22 1987 1987 NUM crl-14452 264 23 ) ) PUNCT crl-14452 264 24 . . PUNCT crl-14452 265 1 14 14 NUM crl-14452 265 2 . . PUNCT crl-14452 266 1 patrick patrick PROPN crl-14452 266 2 wilson wilson PROPN crl-14452 266 3 , , PUNCT crl-14452 266 4 second second ADJ crl-14452 266 5 - - PUNCT crl-14452 266 6 hand hand NOUN crl-14452 266 7 knowledge knowledge NOUN crl-14452 266 8 : : PUNCT crl-14452 266 9 an an DET crl-14452 266 10 inquiry inquiry NOUN crl-14452 266 11 into into ADP crl-14452 266 12 cognitive cognitive ADJ crl-14452 266 13 authority authority NOUN crl-14452 266 14 ( ( PUNCT crl-14452 266 15 westport westport PROPN crl-14452 266 16 , , PUNCT crl-14452 266 17 conn conn PROPN crl-14452 266 18 . . PROPN crl-14452 266 19 : : PUNCT crl-14452 266 20 greenwood greenwood PROPN crl-14452 266 21 , , PUNCT crl-14452 266 22 1983 1983 NUM crl-14452 266 23 ) ) PUNCT crl-14452 266 24 , , PUNCT crl-14452 266 25 p.173 p.173 NOUN crl-14452 266 26 - - SYM crl-14452 266 27 92 92 NUM crl-14452 266 28 . . PUNCT crl-14452 267 1 15 15 NUM crl-14452 267 2 . . X crl-14452 268 1 ibid ibid PROPN crl-14452 268 2 . . PUNCT crl-14452 268 3 , , PUNCT crl-14452 268 4 p.192 p.192 PROPN crl-14452 268 5 . . PUNCT crl-14452 269 1 16 16 NUM crl-14452 269 2 . . PUNCT crl-14452 270 1 hernon hernon NOUN crl-14452 270 2 and and CCONJ crl-14452 270 3 mcoure mcoure NOUN crl-14452 270 4 , , PUNCT crl-14452 270 5 " " PUNCT crl-14452 270 6 unobtrusive unobtrusive ADJ crl-14452 270 7 testing testing NOUN crl-14452 270 8 , , PUNCT crl-14452 270 9 " " PUNCT crl-14452 270 10 p.128 p.128 NOUN crl-14452 270 11 . . PUNCT crl-14452 270 12 17 17 NUM crl-14452 270 13 . . PUNCT crl-14452 270 14 ibid ibid PROPN crl-14452 270 15 . . PUNCT crl-14452 270 16 , , PUNCT crl-14452 270 17 p.144 p.144 PROPN crl-14452 270 18 . . PROPN crl-14452 271 1 18 18 NUM crl-14452 271 2 . . X crl-14452 271 3 ibid ibid PROPN crl-14452 271 4 . . PUNCT crl-14452 271 5 , , PUNCT crl-14452 271 6 p.167 p.167 PROPN crl-14452 271 7 . . PUNCT crl-14452 272 1 19 19 NUM crl-14452 272 2 . . PUNCT crl-14452 272 3 richard richard PROPN crl-14452 272 4 j. j. PROPN crl-14452 272 5 butler butler PROPN crl-14452 272 6 , , PUNCT crl-14452 272 7 " " PUNCT crl-14452 272 8 user user NOUN crl-14452 272 9 satisfaction satisfaction NOUN crl-14452 272 10 with with ADP crl-14452 272 11 a a DET crl-14452 272 12 service service NOUN crl-14452 272 13 : : PUNCT crl-14452 272 14 an an DET crl-14452 272 15 approach approach NOUN crl-14452 272 16 from from ADP crl-14452 272 17 power power NOUN crl-14452 272 18 and and CCONJ crl-14452 272 19 task task NOUN crl-14452 272 20 characteristics characteristic NOUN crl-14452 272 21 , , PUNCT crl-14452 272 22 '' '' PUNCT crl-14452 272 23 journal journal PROPN crl-14452 272 24 of of ADP crl-14452 272 25 management management NOUN crl-14452 272 26 studies study NOUN crl-14452 272 27 17:1 17:1 NUM crl-14452 272 28 - - SYM crl-14452 272 29 18 18 NUM crl-14452 272 30 ( ( PUNCT crl-14452 272 31 1980 1980 NUM crl-14452 272 32 ) ) PUNCT crl-14452 272 33 . . PUNCT crl-14452 273 1 · · PUNCT crl-14452 273 2 20 20 NUM crl-14452 273 3 . . PUNCT crl-14452 274 1 james james PROPN crl-14452 274 2 d. d. PROPN crl-14452 274 3 thompson thompson PROPN crl-14452 274 4 , , PUNCT crl-14452 274 5 organizations organization NOUN crl-14452 274 6 in in ADP crl-14452 274 7 action action NOUN crl-14452 274 8 ( ( PUNCT crl-14452 274 9 new new PROPN crl-14452 274 10 york york PROPN crl-14452 274 11 : : PUNCT crl-14452 274 12 mcgraw mcgraw PROPN crl-14452 274 13 hill hill PROPN crl-14452 274 14 , , PUNCT crl-14452 274 15 1967 1967 NUM crl-14452 274 16 ) ) PUNCT crl-14452 274 17 . . PUNCT crl-14452 275 1 21 21 NUM crl-14452 275 2 . . PUNCT crl-14452 276 1 peter peter PROPN crl-14452 276 2 k. k. PROPN crl-14452 276 3 mills mills PROPN crl-14452 276 4 and and CCONJ crl-14452 276 5 dennis dennis PROPN crl-14452 276 6 j. j. PROPN crl-14452 276 7 moberg moberg PROPN crl-14452 276 8 , , PUNCT crl-14452 276 9 " " PUNCT crl-14452 276 10 perspectives perspective NOUN crl-14452 276 11 on on ADP crl-14452 276 12 the the DET crl-14452 276 13 technology technology NOUN crl-14452 276 14 of of ADP crl-14452 276 15 service service NOUN crl-14452 276 16 operations operation NOUN crl-14452 276 17 , , PUNCT crl-14452 276 18 " " PUNCT crl-14452 276 19 academy academy NOUN crl-14452 276 20 of of ADP crl-14452 276 21 management management NOUN crl-14452 276 22 review review NOUN crl-14452 276 23 7:467 7:467 PROPN crl-14452 276 24 - - SYM crl-14452 276 25 78 78 NUM crl-14452 276 26 ( ( PUNCT crl-14452 276 27 1982 1982 NUM crl-14452 276 28 ) ) PUNCT crl-14452 276 29 . . PUNCT crl-14452 277 1 22 22 NUM crl-14452 277 2 . . PUNCT crl-14452 278 1 hernon hernon NOUN crl-14452 278 2 and and CCONJ crl-14452 278 3 mcclure mcclure NOUN crl-14452 278 4 , , PUNCT crl-14452 278 5 " " PUNCT crl-14452 278 6 unobtrusive unobtrusive ADJ crl-14452 278 7 testing testing NOUN crl-14452 278 8 , , PUNCT crl-14452 278 9 " " PUNCT crl-14452 278 10 p.104 p.104 PROPN crl-14452 278 11 - - SYM crl-14452 278 12 105 105 NUM crl-14452 278 13 . . PUNCT crl-14452 278 14 23 23 NUM crl-14452 278 15 . . PUNCT crl-14452 279 1 catherine catherine PROPN crl-14452 279 2 sheldrick sheldrick PROPN crl-14452 279 3 ross ross PROPN crl-14452 279 4 , , PUNCT crl-14452 279 5 " " PUNCT crl-14452 279 6 how how SCONJ crl-14452 279 7 to to PART crl-14452 279 8 find find VERB crl-14452 279 9 out out ADP crl-14452 279 10 what what PRON crl-14452 279 11 people people NOUN crl-14452 279 12 really really ADV crl-14452 279 13 want want VERB crl-14452 279 14 to to PART crl-14452 279 15 know know VERB crl-14452 279 16 , , PUNCT crl-14452 279 17 " " PUNCT crl-14452 279 18 the the DET crl-14452 279 19 reference reference NOUN crl-14452 279 20 librarian librarian NOUN crl-14452 279 21 16:19 16:19 NUM crl-14452 279 22 - - SYM crl-14452 279 23 30 30 NUM crl-14452 279 24 ( ( PUNCT crl-14452 279 25 1986 1986 NUM crl-14452 279 26 ) ) PUNCT crl-14452 279 27 . . PUNCT crl-14452 280 1 24 24 NUM crl-14452 280 2 . . X crl-14452 280 3 ibid ibid VERB crl-14452 280 4 . . PUNCT crl-14452 281 1 25 25 NUM crl-14452 281 2 . . PUNCT crl-14452 282 1 fred fred PROPN crl-14452 282 2 oser oser PROPN crl-14452 282 3 , , PUNCT crl-14452 282 4 '' '' PUNCT crl-14452 282 5 referens referen VERB crl-14452 282 6 simplex simplex PROPN crl-14452 282 7 or or CCONJ crl-14452 282 8 the the DET crl-14452 282 9 mysteries mystery NOUN crl-14452 282 10 of of ADP crl-14452 282 11 reference reference NOUN crl-14452 282 12 interviewing interviewing NOUN crl-14452 282 13 revealed reveal VERB crl-14452 282 14 , , PUNCT crl-14452 282 15 '' '' PUNCT crl-14452 282 16 the the DET crl-14452 282 17 reference reference NOUN crl-14452 282 18 librarian librarian NOUN crl-14452 282 19 16:53 16:53 NUM crl-14452 282 20 - - SYM crl-14452 282 21 78 78 NUM crl-14452 282 22 ( ( PUNCT crl-14452 282 23 1986 1986 NUM crl-14452 282 24 ) ) PUNCT crl-14452 282 25 . . PUNCT crl-14452 283 1 26 26 NUM crl-14452 283 2 . . PUNCT crl-14452 284 1 helen helen PROPN crl-14452 284 2 m. m. PROPN crl-14452 284 3 gothberg gothberg PROPN crl-14452 284 4 , , PUNCT crl-14452 284 5 " " PUNCT crl-14452 284 6 the the DET crl-14452 284 7 beginnings beginning NOUN crl-14452 284 8 , , PUNCT crl-14452 284 9 " " PUNCT crl-14452 284 10 the the DET crl-14452 284 11 reference reference NOUN crl-14452 284 12 librarian librarian ADJ crl-14452 284 13 16:7 16:7 NUM crl-14452 284 14 - - SYM crl-14452 284 15 18 18 NUM crl-14452 284 16 ( ( PUNCT crl-14452 284 17 1986 1986 NUM crl-14452 284 18 ) ) PUNCT crl-14452 284 19 . . PUNCT crl-14452 285 1 27 27 NUM crl-14452 285 2 . . PUNCT crl-14452 286 1 hernon hernon NOUN crl-14452 286 2 and and CCONJ crl-14452 286 3 mcoure mcoure NOUN crl-14452 286 4 , , PUNCT crl-14452 286 5 " " PUNCT crl-14452 286 6 unobtrusive unobtrusive ADJ crl-14452 286 7 testing testing NOUN crl-14452 286 8 , , PUNCT crl-14452 286 9 " " PUNCT crl-14452 286 10 p.167 p.167 NOUN crl-14452 286 11 . . PUNCT crl-14452 287 1 28 28 X crl-14452 287 2 . . X crl-14452 288 1 ibid ibid PROPN crl-14452 288 2 . . PUNCT crl-14452 288 3 , , PUNCT crl-14452 288 4 p.105 p.105 PROPN crl-14452 288 5 . . PROPN crl-14452 288 6 29 29 NUM crl-14452 288 7 . . PUNCT crl-14452 289 1 ibid ibid PROPN crl-14452 289 2 . . PUNCT crl-14452 289 3 , , PUNCT crl-14452 289 4 p.39 p.39 PROPN crl-14452 289 5 - - SYM crl-14452 289 6 40 40 NUM crl-14452 289 7 . . NUM crl-14452 290 1 30 30 NUM crl-14452 290 2 . . PUNCT crl-14452 291 1 patrick patrick PROPN crl-14452 291 2 wilson wilson PROPN crl-14452 291 3 , , PUNCT crl-14452 291 4 public public ADJ crl-14452 291 5 knowledge knowledge NOUN crl-14452 291 6 , , PUNCT crl-14452 291 7 private private ADJ crl-14452 291 8 ignorance ignorance NOUN crl-14452 291 9 : : PUNCT crl-14452 291 10 toward toward ADP crl-14452 291 11 a a DET crl-14452 291 12 library library NOUN crl-14452 291 13 and and CCONJ crl-14452 291 14 information information NOUN crl-14452 291 15 policy policy NOUN crl-14452 291 16 ( ( PUNCT crl-14452 291 17 westport westport PROPN crl-14452 291 18 , , PUNCT crl-14452 291 19 conn conn PROPN crl-14452 291 20 . . PROPN crl-14452 291 21 : : PUNCT crl-14452 291 22 greenwood greenwood PROPN crl-14452 291 23 , , PUNCT crl-14452 291 24 1977 1977 NUM crl-14452 291 25 ) ) PUNCT crl-14452 291 26 , , PUNCT crl-14452 291 27 p.122 p.122 PROPN crl-14452 291 28 . . PUNCT crl-14452 291 29 31 31 NUM crl-14452 291 30 . . PUNCT crl-14452 292 1 gordon gordon PROPN crl-14452 292 2 p. p. PROPN crl-14452 292 3 whitaker whitaker NOUN crl-14452 292 4 , , PUNCT crl-14452 292 5 " " PUNCT crl-14452 292 6 coproduction coproduction NOUN crl-14452 292 7 : : PUNCT crl-14452 292 8 citizen citizen NOUN crl-14452 292 9 participation participation NOUN crl-14452 292 10 in in ADP crl-14452 292 11 service service NOUN crl-14452 292 12 delivery delivery NOUN crl-14452 292 13 , , PUNCT crl-14452 292 14 " " PUNCT crl-14452 292 15 public public ADJ crl-14452 292 16 administration administration NOUN crl-14452 292 17 review review NOUN crl-14452 292 18 40:240 40:240 NUM crl-14452 292 19 - - SYM crl-14452 292 20 46 46 NUM crl-14452 292 21 ( ( PUNCT crl-14452 292 22 1980 1980 NUM crl-14452 292 23 ) ) PUNCT crl-14452 292 24 . . PUNCT crl-14452 293 1 32 32 NUM crl-14452 293 2 . . PUNCT crl-14452 294 1 john john PROPN crl-14452 294 2 n. n. PROPN crl-14452 294 3 campbell campbell PROPN crl-14452 294 4 , , PUNCT crl-14452 294 5 " " PUNCT crl-14452 294 6 labs lab NOUN crl-14452 294 7 , , PUNCT crl-14452 294 8 fields field NOUN crl-14452 294 9 , , PUNCT crl-14452 294 10 and and CCONJ crl-14452 294 11 straw straw NOUN crl-14452 294 12 issues issue NOUN crl-14452 294 13 , , PUNCT crl-14452 294 14 " " PUNCT crl-14452 294 15 in in ADP crl-14452 294 16 generalizing generalize VERB crl-14452 294 17 from from ADP crl-14452 294 18 laboratory laboratory NOUN crl-14452 294 19 to to ADP crl-14452 294 20 field field NOUN crl-14452 294 21 settings setting NOUN crl-14452 294 22 , , PUNCT crl-14452 294 23 ed ed NOUN crl-14452 294 24 . . PROPN crl-14452 295 1 edwin edwin PROPN crl-14452 295 2 a. a. PROPN crl-14452 295 3 locke locke PROPN crl-14452 295 4 ( ( PUNCT crl-14452 295 5 lexington lexington PROPN crl-14452 295 6 , , PUNCT crl-14452 295 7 mass mass PROPN crl-14452 295 8 . . PUNCT crl-14452 295 9 : : PUNCT crl-14452 295 10 lexington lexington PROPN crl-14452 295 11 books books PROPN crl-14452 295 12 , , PUNCT crl-14452 295 13 1987 1987 NUM crl-14452 295 14 ) ) PUNCT crl-14452 295 15 , , PUNCT crl-14452 295 16 p.269 p.269 PROPN crl-14452 295 17 - - SYM crl-14452 295 18 79 79 NUM crl-14452 295 19 . . PUNCT crl-14452 296 1 33 33 NUM crl-14452 296 2 . . PUNCT crl-14452 297 1 hernon hernon PROPN crl-14452 297 2 and and CCONJ crl-14452 297 3 mcoure mcoure NOUN crl-14452 297 4 , , PUNCT crl-14452 297 5 " " PUNCT crl-14452 297 6 unobtrusive unobtrusive ADJ crl-14452 297 7 testing testing NOUN crl-14452 297 8 , , PUNCT crl-14452 297 9 " " PUNCT crl-14452 297 10 p.164 p.164 NOUN crl-14452 297 11 . . PUNCT crl-14452 298 1 34 34 NUM crl-14452 298 2 . . PUNCT crl-14452 299 1 wilson wilson PROPN crl-14452 299 2 , , PUNCT crl-14452 299 3 second second ADJ crl-14452 299 4 - - PUNCT crl-14452 299 5 hand hand NOUN crl-14452 299 6 knowledge knowledge NOUN crl-14452 299 7 , , PUNCT crl-14452 299 8 p.192 p.192 NOUN crl-14452 299 9 . . PROPN crl-14452 299 10 35 35 NUM crl-14452 299 11 . . PUNCT crl-14452 300 1 sandra sandra PROPN crl-14452 300 2 m m PROPN crl-14452 300 3 . . PUNCT crl-14452 301 1 naiman naiman NOUN crl-14452 301 2 , , PUNCT crl-14452 301 3 " " PUNCT crl-14452 301 4 the the DET crl-14452 301 5 unexamined unexamined ADJ crl-14452 301 6 interview interview NOUN crl-14452 301 7 is be AUX crl-14452 301 8 not not PART crl-14452 301 9 worth worth ADJ crl-14452 301 10 having have VERB crl-14452 301 11 , , PUNCT crl-14452 301 12 " " PUNCT crl-14452 301 13 the the DET crl-14452 301 14 reference reference NOUN crl-14452 301 15 librarian librarian NOUN crl-14452 301 16 16:31 16:31 NUM crl-14452 301 17 - - SYM crl-14452 301 18 46 46 NUM crl-14452 301 19 ( ( PUNCT crl-14452 301 20 1986 1986 NUM crl-14452 301 21 ) ) PUNCT crl-14452 301 22 . . PUNCT crl-14452 302 1 36 36 NUM crl-14452 302 2 . . PUNCT crl-14452 302 3 charles charles PROPN crl-14452 302 4 a. a. PROPN crl-14452 302 5 bunge bunge PROPN crl-14452 302 6 and and CCONJ crl-14452 302 7 marjorie marjorie PROPN crl-14452 302 8 e. e. PROPN crl-14452 302 9 murfin murfin PROPN crl-14452 302 10 , , PUNCT crl-14452 302 11 " " PUNCT crl-14452 302 12 reference reference NOUN crl-14452 302 13 questions question NOUN crl-14452 302 14 - - PUNCT crl-14452 302 15 data datum NOUN crl-14452 302 16 from from ADP crl-14452 302 17 the the DET crl-14452 302 18 field field NOUN crl-14452 302 19 , , PUNCT crl-14452 302 20 " " PUNCT crl-14452 302 21 rq rq X crl-14452 302 22 27:15 27:15 NUM crl-14452 302 23 - - SYM crl-14452 302 24 18 18 NUM crl-14452 302 25 ( ( PUNCT crl-14452 302 26 1987 1987 NUM crl-14452 302 27 ) ) PUNCT crl-14452 302 28 . . PUNCT crl-14452 303 1 37 37 NUM crl-14452 303 2 . . PUNCT crl-14452 303 3 marjorie marjorie PROPN crl-14452 303 4 e. e. PROPN crl-14452 303 5 murfin murfin PROPN crl-14452 303 6 and and CCONJ crl-14452 303 7 gary gary PROPN crl-14452 303 8 m. m. PROPN crl-14452 303 9 gugelchuk gugelchuk PROPN crl-14452 303 10 , , PUNCT crl-14452 303 11 " " PUNCT crl-14452 303 12 development development NOUN crl-14452 303 13 and and CCONJ crl-14452 303 14 testing testing NOUN crl-14452 303 15 of of ADP crl-14452 303 16 a a DET crl-14452 303 17 reference reference NOUN crl-14452 303 18 transaction transaction NOUN crl-14452 303 19 assessment assessment NOUN crl-14452 303 20 instrument instrument NOUN crl-14452 303 21 , , PUNCT crl-14452 303 22 " " PUNCT crl-14452 303 23 college college NOUN crl-14452 303 24 and and CCONJ crl-14452 303 25 research research NOUN crl-14452 303 26 libraries library NOUN crl-14452 303 27 48:314 48:314 NUM crl-14452 303 28 - - SYM crl-14452 303 29 38 38 NUM crl-14452 303 30 ( ( PUNCT crl-14452 303 31 1987 1987 NUM crl-14452 303 32 ) ) PUNCT crl-14452 303 33 . . PUNCT crl-14452 304 1 38 38 NUM crl-14452 304 2 . . PUNCT crl-14452 305 1 harold harold PROPN crl-14452 305 2 wilensky wilensky PROPN crl-14452 305 3 , , PUNCT crl-14452 305 4 " " PUNCT crl-14452 305 5 the the DET crl-14452 305 6 professionalization professionalization NOUN crl-14452 305 7 of of ADP crl-14452 305 8 everyone everyone PRON crl-14452 305 9 ? ? PUNCT crl-14452 305 10 " " PUNCT crl-14452 306 1 american american PROPN crl-14452 306 2 journal journal PROPN crl-14452 306 3 of of ADP crl-14452 306 4 sociology sociology NOUN crl-14452 306 5 70:137 70:137 NUM crl-14452 306 6 - - SYM crl-14452 306 7 58 58 NUM crl-14452 306 8 ( ( PUNCT crl-14452 306 9 1964 1964 NUM crl-14452 306 10 ) ) PUNCT crl-14452 306 11 . . PUNCT crl-14452 307 1 unobtrusive unobtrusive ADJ crl-14452 307 2 studies study NOUN crl-14452 307 3 193 193 NUM crl-14452 307 4 appendix appendix PROPN crl-14452 307 5 a a PRON crl-14452 307 6 : : PUNCT crl-14452 307 7 scales scale NOUN crl-14452 307 8 for for ADP crl-14452 307 9 variables variable NOUN crl-14452 307 10 included include VERB crl-14452 307 11 in in ADP crl-14452 307 12 the the DET crl-14452 307 13 author author NOUN crl-14452 307 14 's 's PART crl-14452 307 15 obtrusive obtrusive ADJ crl-14452 307 16 study study NOUN crl-14452 307 17 reference reference NOUN crl-14452 307 18 service service NOUN crl-14452 307 19 performance performance NOUN crl-14452 307 20 outcomes outcomes PROPN crl-14452 307 21 1 1 NUM crl-14452 307 22 . . PUNCT crl-14452 308 1 librarian librarian ADJ crl-14452 308 2 judgments judgment NOUN crl-14452 308 3 of of ADP crl-14452 308 4 the the DET crl-14452 308 5 value value NOUN crl-14452 308 6 of of ADP crl-14452 308 7 reference reference NOUN crl-14452 308 8 service service NOUN crl-14452 308 9 ( ( PUNCT crl-14452 308 10 five five NUM crl-14452 308 11 questions question NOUN crl-14452 308 12 , , PUNCT crl-14452 308 13 loading load VERB crl-14452 308 14 on on ADP crl-14452 308 15 one one NUM crl-14452 308 16 factor factor NOUN crl-14452 308 17 , , PUNCT crl-14452 308 18 a a DET crl-14452 308 19 = = SYM crl-14452 308 20 .89 .89 NUM crl-14452 308 21 ) ) PUNCT crl-14452 308 22 please please INTJ crl-14452 308 23 check check VERB crl-14452 308 24 the the DET crl-14452 308 25 space space NOUN crl-14452 308 26 : : PUNCT crl-14452 308 27 _ _ PUNCT crl-14452 308 28 _ _ PUNCT crl-14452 308 29 : : PUNCT crl-14452 308 30 that that SCONJ crl-14452 308 31 best well ADV crl-14452 308 32 describes describe VERB crl-14452 308 33 how how SCONJ crl-14452 308 34 you you PRON crl-14452 308 35 think think VERB crl-14452 308 36 the the DET crl-14452 308 37 user user NOUN crl-14452 308 38 viewed view VERB crl-14452 308 39 the the DET crl-14452 308 40 quality quality NOUN crl-14452 308 41 of of ADP crl-14452 308 42 service service NOUN crl-14452 308 43 received receive VERB crl-14452 308 44 . . PUNCT crl-14452 309 1 ( ( PUNCT crl-14452 309 2 seven seven NUM crl-14452 309 3 - - PUNCT crl-14452 309 4 point point NOUN crl-14452 309 5 scale scale NOUN crl-14452 309 6 : : PUNCT crl-14452 309 7 outstanding outstanding ADJ crl-14452 309 8 - - PUNCT crl-14452 309 9 terrible terrible ADJ crl-14452 309 10 ) ) PUNCT crl-14452 309 11 relevance relevance NOUN crl-14452 309 12 of of ADP crl-14452 309 13 information information NOUN crl-14452 309 14 provided provide VERB crl-14452 309 15 . . PUNCT crl-14452 310 1 ( ( PUNCT crl-14452 310 2 two two NUM crl-14452 310 3 seven seven NUM crl-14452 310 4 - - PUNCT crl-14452 310 5 point point NOUN crl-14452 310 6 scales scale NOUN crl-14452 310 7 : : PUNCT crl-14452 310 8 useful useful ADJ crl-14452 310 9 - - PUNCT crl-14452 310 10 useless useless ADJ crl-14452 310 11 ; ; PUNCT crl-14452 310 12 relevant relevant ADJ crl-14452 310 13 - - PUNCT crl-14452 310 14 irrelevant irrelevant ADJ crl-14452 310 15 ) ) PUNCT crl-14452 310 16 amount amount NOUN crl-14452 310 17 of of ADP crl-14452 310 18 information information NOUN crl-14452 310 19 provided provide VERB crl-14452 310 20 . . PUNCT crl-14452 311 1 ( ( PUNCT crl-14452 311 2 two two NUM crl-14452 311 3 seven seven NUM crl-14452 311 4 - - PUNCT crl-14452 311 5 point point NOUN crl-14452 311 6 scales scale NOUN crl-14452 311 7 : : PUNCT crl-14452 311 8 sufficient sufficient ADJ crl-14452 311 9 - - PUNCT crl-14452 311 10 insufficient insufficient ADJ crl-14452 311 11 ; ; PUNCT crl-14452 311 12 reasonableunreasonable reasonableunreasonable ADJ crl-14452 311 13 ) ) PUNCT crl-14452 311 14 2 2 NUM crl-14452 311 15 . . X crl-14452 311 16 user user NOUN crl-14452 311 17 judgments judgment NOUN crl-14452 311 18 of of ADP crl-14452 311 19 the the DET crl-14452 311 20 value value NOUN crl-14452 311 21 of of ADP crl-14452 311 22 reference reference NOUN crl-14452 311 23 service service NOUN crl-14452 311 24 ( ( PUNCT crl-14452 311 25 six six NUM crl-14452 311 26 questions question NOUN crl-14452 311 27 , , PUNCT crl-14452 311 28 loading load VERB crl-14452 311 29 on on ADP crl-14452 311 30 one one NUM crl-14452 311 31 factor factor NOUN crl-14452 311 32 , , PUNCT crl-14452 311 33 a a DET crl-14452 311 34 = = SYM crl-14452 311 35 .84 .84 NUM crl-14452 311 36 ) ) PUNCT crl-14452 311 37 check check VERB crl-14452 311 38 the the DET crl-14452 311 39 space space NOUN crl-14452 311 40 : : PUNCT crl-14452 311 41 _ _ PUNCT crl-14452 311 42 _ _ PUNCT crl-14452 311 43 _ _ PUNCT crl-14452 311 44 : : PUNCT crl-14452 311 45 that that SCONJ crl-14452 311 46 best well ADV crl-14452 311 47 describes describe VERB crl-14452 311 48 the the DET crl-14452 311 49 general general ADJ crl-14452 311 50 quality quality NOUN crl-14452 311 51 of of ADP crl-14452 311 52 service service NOUN crl-14452 311 53 you you PRON crl-14452 311 54 received receive VERB crl-14452 311 55 . . PUNCT crl-14452 312 1 ( ( PUNCT crl-14452 312 2 seven seven NUM crl-14452 312 3 - - PUNCT crl-14452 312 4 point point NOUN crl-14452 312 5 scale scale NOUN crl-14452 312 6 : : PUNCT crl-14452 312 7 outstanding outstanding ADJ crl-14452 312 8 - - PUNCT crl-14452 312 9 terrible terrible ADJ crl-14452 312 10 ) ) PUNCT crl-14452 312 11 _ _ PRON crl-14452 312 12 indicate indicate VERB crl-14452 312 13 how how SCONJ crl-14452 312 14 satisfied satisfied ADJ crl-14452 312 15 you you PRON crl-14452 312 16 are be AUX crl-14452 312 17 on on ADP crl-14452 312 18 the the DET crl-14452 312 19 following follow VERB crl-14452 312 20 scale scale NOUN crl-14452 312 21 . . PUNCT crl-14452 313 1 ( ( PUNCT crl-14452 313 2 seven seven NUM crl-14452 313 3 - - PUNCT crl-14452 313 4 point point NOUN crl-14452 313 5 scale scale NOUN crl-14452 313 6 : : PUNCT crl-14452 313 7 satisfactoryunsatisfactory satisfactoryunsatisfactory ADJ crl-14452 313 8 ) ) PUNCT crl-14452 313 9 relevance relevance NOUN crl-14452 313 10 of of ADP crl-14452 313 11 information information NOUN crl-14452 313 12 provided provide VERB crl-14452 313 13 . . PUNCT crl-14452 314 1 ( ( PUNCT crl-14452 314 2 two two NUM crl-14452 314 3 seven seven NUM crl-14452 314 4 - - PUNCT crl-14452 314 5 point point NOUN crl-14452 314 6 scales scale NOUN crl-14452 314 7 : : PUNCT crl-14452 314 8 useful useful ADJ crl-14452 314 9 - - PUNCT crl-14452 314 10 useless useless ADJ crl-14452 314 11 ; ; PUNCT crl-14452 314 12 relevant relevant ADJ crl-14452 314 13 - - PUNCT crl-14452 314 14 irrelevant irrelevant ADJ crl-14452 314 15 ) ) PUNCT crl-14452 314 16 amount amount NOUN crl-14452 314 17 of of ADP crl-14452 314 18 information information NOUN crl-14452 314 19 provided provide VERB crl-14452 314 20 . . PUNCT crl-14452 315 1 ( ( PUNCT crl-14452 315 2 two two NUM crl-14452 315 3 seven seven NUM crl-14452 315 4 - - PUNCT crl-14452 315 5 point point NOUN crl-14452 315 6 scales scale NOUN crl-14452 315 7 : : PUNCT crl-14452 315 8 sufficient sufficient ADJ crl-14452 315 9 - - PUNCT crl-14452 315 10 insufficient insufficient ADJ crl-14452 315 11 ; ; PUNCT crl-14452 315 12 reasonableunreasonable reasonableunreasonable ADJ crl-14452 315 13 ) ) PUNCT crl-14452 315 14 3 3 NUM crl-14452 315 15 . . X crl-14452 315 16 user user NOUN crl-14452 315 17 success success NOUN crl-14452 315 18 ( ( PUNCT crl-14452 315 19 one one NUM crl-14452 315 20 question question NOUN crl-14452 315 21 ) ) PUNCT crl-14452 315 22 were be AUX crl-14452 315 23 you you PRON crl-14452 315 24 able able ADJ crl-14452 315 25 to to PART crl-14452 315 26 locate locate VERB crl-14452 315 27 the the DET crl-14452 315 28 materials material NOUN crl-14452 315 29 you you PRON crl-14452 315 30 needed need VERB crl-14452 315 31 ? ? PUNCT crl-14452 316 1 ( ( PUNCT crl-14452 316 2 choices choice NOUN crl-14452 316 3 were be AUX crl-14452 316 4 : : PUNCT crl-14452 316 5 yes yes INTJ crl-14452 316 6 ; ; PUNCT crl-14452 316 7 no no INTJ crl-14452 316 8 ; ; PUNCT crl-14452 316 9 some some PRON crl-14452 316 10 but but CCONJ crl-14452 316 11 not not PART crl-14452 316 12 all all PRON crl-14452 316 13 ; ; PUNCT crl-14452 316 14 and and CCONJ crl-14452 316 15 other other ADJ crl-14452 316 16 ( ( PUNCT crl-14452 316 17 please please INTJ crl-14452 316 18 explain explain VERB crl-14452 316 19 ) ) PUNCT crl-14452 316 20 ) ) PUNCT crl-14452 317 1 task task NOUN crl-14452 317 2 uncertainty uncertainty NOUN crl-14452 317 3 ( ( PUNCT crl-14452 317 4 five five NUM crl-14452 317 5 questions question NOUN crl-14452 317 6 , , PUNCT crl-14452 317 7 loading load VERB crl-14452 317 8 on on ADP crl-14452 317 9 one one NUM crl-14452 317 10 factor factor NOUN crl-14452 317 11 , , PUNCT crl-14452 317 12 a a DET crl-14452 317 13 = = X crl-14452 317 14 .80 .80 PROPN crl-14452 317 15 ) ) PUNCT crl-14452 317 16 to to ADP crl-14452 317 17 what what DET crl-14452 317 18 extent extent NOUN crl-14452 317 19 were be AUX crl-14452 317 20 the the DET crl-14452 317 21 sources source NOUN crl-14452 317 22 you you PRON crl-14452 317 23 suggested suggest VERB crl-14452 317 24 to to ADP crl-14452 317 25 this this DET crl-14452 317 26 user user NOUN crl-14452 317 27 materials material NOUN crl-14452 317 28 you you PRON crl-14452 317 29 frequently frequently ADV crl-14452 317 30 consult consult VERB crl-14452 317 31 in in ADP crl-14452 317 32 providing provide VERB crl-14452 317 33 reference reference NOUN crl-14452 317 34 service service NOUN crl-14452 317 35 ? ? PUNCT crl-14452 318 1 ( ( PUNCT crl-14452 318 2 seven seven NUM crl-14452 318 3 - - PUNCT crl-14452 318 4 point point NOUN crl-14452 318 5 scale scale NOUN crl-14452 318 6 : : PUNCT crl-14452 318 7 very very ADV crl-14452 318 8 great great ADJ crl-14452 318 9 extent extent NOUN crl-14452 318 10 - - PUNCT crl-14452 318 11 very very ADV crl-14452 318 12 little little ADJ crl-14452 318 13 extent extent NOUN crl-14452 318 14 ) ) PUNCT crl-14452 318 15 to to ADP crl-14452 318 16 what what DET crl-14452 318 17 extent extent NOUN crl-14452 318 18 did do AUX crl-14452 318 19 you you PRON crl-14452 318 20 see see VERB crl-14452 318 21 answering answer VERB crl-14452 318 22 this this DET crl-14452 318 23 reference reference NOUN crl-14452 318 24 question question NOUN crl-14452 318 25 as as ADP crl-14452 318 26 a a DET crl-14452 318 27 new new ADJ crl-14452 318 28 type type NOUN crl-14452 318 29 of of ADP crl-14452 318 30 problem problem NOUN crl-14452 318 31 : : PUNCT crl-14452 318 32 ( ( PUNCT crl-14452 318 33 seven seven NUM crl-14452 318 34 - - PUNCT crl-14452 318 35 point point NOUN crl-14452 318 36 scale scale NOUN crl-14452 318 37 : : PUNCT crl-14452 318 38 very very ADV crl-14452 318 39 great great ADJ crl-14452 318 40 extent extent NOUN crl-14452 318 41 - - PUNCT crl-14452 318 42 very very ADV crl-14452 318 43 little little ADJ crl-14452 318 44 extent extent NOUN crl-14452 318 45 ) ) PUNCT crl-14452 318 46 how how SCONJ crl-14452 318 47 often often ADV crl-14452 318 48 do do AUX crl-14452 318 49 you you PRON crl-14452 318 50 answer answer VERB crl-14452 318 51 this this DET crl-14452 318 52 question question NOUN crl-14452 318 53 or or CCONJ crl-14452 318 54 questions question NOUN crl-14452 318 55 that that PRON crl-14452 318 56 are be AUX crl-14452 318 57 very very ADV crl-14452 318 58 similar similar ADJ crl-14452 318 59 ? ? PUNCT crl-14452 319 1 ( ( PUNCT crl-14452 319 2 seven seven NUM crl-14452 319 3 - - PUNCT crl-14452 319 4 point point NOUN crl-14452 319 5 scale scale NOUN crl-14452 319 6 : : PUNCT crl-14452 319 7 very very ADV crl-14452 319 8 often often ADV crl-14452 319 9 - - PUNCT crl-14452 319 10 very very ADV crl-14452 319 11 seldom seldom ADV crl-14452 319 12 ) ) PUNCT crl-14452 319 13 how how SCONJ crl-14452 319 14 familiar familiar ADJ crl-14452 319 15 were be AUX crl-14452 319 16 you you PRON crl-14452 319 17 with with ADP crl-14452 319 18 the the DET crl-14452 319 19 subject(s subject(s PROPN crl-14452 319 20 ) ) PUNCT crl-14452 319 21 involved involve VERB crl-14452 319 22 in in ADP crl-14452 319 23 the the DET crl-14452 319 24 reference reference NOUN crl-14452 319 25 question question NOUN crl-14452 319 26 ? ? PUNCT crl-14452 320 1 ( ( PUNCT crl-14452 320 2 seven seven NUM crl-14452 320 3 - - PUNCT crl-14452 320 4 point point NOUN crl-14452 320 5 scale scale NOUN crl-14452 320 6 : : PUNCT crl-14452 320 7 completely completely ADV crl-14452 320 8 - - PUNCT crl-14452 320 9 not not PART crl-14452 320 10 at at ADV crl-14452 320 11 all all ADV crl-14452 320 12 ) ) PUNCT crl-14452 320 13 were be AUX crl-14452 320 14 you you PRON crl-14452 320 15 already already ADV crl-14452 320 16 familiar familiar ADJ crl-14452 320 17 with with ADP crl-14452 320 18 the the DET crl-14452 320 19 information information NOUN crl-14452 320 20 resources resource NOUN crl-14452 320 21 most most ADV crl-14452 320 22 likely likely ADJ crl-14452 320 23 to to PART crl-14452 320 24 contain contain VERB crl-14452 320 25 the the DET crl-14452 320 26 answer answer NOUN crl-14452 320 27 to to ADP crl-14452 320 28 this this DET crl-14452 320 29 reference reference NOUN crl-14452 320 30 question question NOUN crl-14452 320 31 from from ADP crl-14452 320 32 previous previous ADJ crl-14452 320 33 knowledge knowledge NOUN crl-14452 320 34 or or CCONJ crl-14452 320 35 experience experience NOUN crl-14452 320 36 ? ? PUNCT crl-14452 321 1 ( ( PUNCT crl-14452 321 2 seven seven NUM crl-14452 321 3 - - PUNCT crl-14452 321 4 point point NOUN crl-14452 321 5 scale scale NOUN crl-14452 321 6 : : PUNCT crl-14452 321 7 completely completely ADV crl-14452 321 8 - - PUNCT crl-14452 321 9 not not PART crl-14452 321 10 at at ADV crl-14452 321 11 all all ADV crl-14452 321 12 ) ) PUNCT crl-14452 321 13 time time NOUN crl-14452 321 14 user user NOUN crl-14452 321 15 spent spend VERB crl-14452 321 16 with with ADP crl-14452 321 17 librarian librarian NOUN crl-14452 321 18 ( ( PUNCT crl-14452 321 19 one one NUM crl-14452 321 20 question question NOUN crl-14452 321 21 ) ) PUNCT crl-14452 321 22 how how SCONJ crl-14452 321 23 long long ADV crl-14452 321 24 did do AUX crl-14452 321 25 you you PRON crl-14452 321 26 spend spend VERB crl-14452 321 27 with with ADP crl-14452 321 28 the the DET crl-14452 321 29 reference reference NOUN crl-14452 321 30 librarian librarian NOUN crl-14452 321 31 ? ? PUNCT crl-14452 322 1 ( ( PUNCT crl-14452 322 2 choices choice NOUN crl-14452 322 3 were be AUX crl-14452 322 4 : : PUNCT crl-14452 322 5 0 0 NUM crl-14452 322 6 - - SYM crl-14452 322 7 2 2 NUM crl-14452 322 8 minutes minute NOUN crl-14452 322 9 ; ; PUNCT crl-14452 322 10 3 3 NUM crl-14452 322 11 - - SYM crl-14452 322 12 5 5 NUM crl-14452 322 13 minutes minute NOUN crl-14452 322 14 ; ; PUNCT crl-14452 322 15 6 6 NUM crl-14452 322 16 - - SYM crl-14452 322 17 15 15 NUM crl-14452 322 18 minutes minute NOUN crl-14452 322 19 ; ; PUNCT crl-14452 322 20 over over ADP crl-14452 322 21 15 15 NUM crl-14452 322 22 minutes minute NOUN crl-14452 322 23 ) ) PUNCT crl-14452 322 24 user user NOUN crl-14452 322 25 feedback feedback NOUN crl-14452 322 26 ( ( PUNCT crl-14452 322 27 one one NUM crl-14452 322 28 question question NOUN crl-14452 322 29 ) ) PUNCT crl-14452 322 30 to to ADP crl-14452 322 31 what what DET crl-14452 322 32 degree degree NOUN crl-14452 322 33 did do AUX crl-14452 322 34 you you PRON crl-14452 322 35 inform inform VERB crl-14452 322 36 the the DET crl-14452 322 37 library library NOUN crl-14452 322 38 staff staff NOUN crl-14452 322 39 member member NOUN crl-14452 322 40 whether whether SCONJ crl-14452 322 41 or or CCONJ crl-14452 322 42 not not PART crl-14452 322 43 your your PRON crl-14452 322 44 question question NOUN crl-14452 322 45 was be AUX crl-14452 322 46 answered answer VERB crl-14452 322 47 ? ? PUNCT crl-14452 323 1 ( ( PUNCT crl-14452 323 2 seven seven NUM crl-14452 323 3 point point NOUN crl-14452 323 4 scale scale NOUN crl-14452 323 5 : : PUNCT crl-14452 323 6 completely completely ADV crl-14452 323 7 - - PUNCT crl-14452 323 8 not not PART crl-14452 323 9 at at ADV crl-14452 323 10 all all ADV crl-14452 323 11 ) ) PUNCT crl-14452 323 12 librarian librarian ADJ crl-14452 323 13 perception perception NOUN crl-14452 323 14 of of ADP crl-14452 323 15 quality quality NOUN crl-14452 323 16 of of ADP crl-14452 323 17 communication communication NOUN crl-14452 323 18 ( ( PUNCT crl-14452 323 19 four four NUM crl-14452 323 20 questions question NOUN crl-14452 323 21 , , PUNCT crl-14452 323 22 loading load VERB crl-14452 323 23 on on ADP crl-14452 323 24 one one NUM crl-14452 323 25 factor factor NOUN crl-14452 323 26 , , PUNCT crl-14452 323 27 a a DET crl-14452 323 28 = = SYM crl-14452 323 29 .72 .72 NUM crl-14452 323 30 ) ) PUNCT crl-14452 323 31 communication communication NOUN crl-14452 323 32 with with ADP crl-14452 323 33 the the DET crl-14452 323 34 user user NOUN crl-14452 323 35 was be AUX crl-14452 323 36 : : PUNCT crl-14452 323 37 ( ( PUNCT crl-14452 323 38 two two NUM crl-14452 323 39 seven seven NUM crl-14452 323 40 - - PUNCT crl-14452 323 41 point point NOUN crl-14452 323 42 scales scale NOUN crl-14452 323 43 : : PUNCT crl-14452 323 44 very very ADV crl-14452 323 45 easy easy ADV crl-14452 323 46 - - PUNCT crl-14452 323 47 very very ADV crl-14452 323 48 difficult difficult ADJ crl-14452 323 49 ; ; PUNCT crl-14452 323 50 pleasantunpleasant pleasantunpleasant ADJ crl-14452 323 51 ) ) PUNCT crl-14452 323 52 did do AUX crl-14452 323 53 the the DET crl-14452 323 54 user user NOUN crl-14452 323 55 give give VERB crl-14452 323 56 you you PRON crl-14452 323 57 sufficient sufficient ADJ crl-14452 323 58 information information NOUN crl-14452 323 59 to to PART crl-14452 323 60 answer answer VERB crl-14452 323 61 his his PRON crl-14452 323 62 / / SYM crl-14452 323 63 her her PRON crl-14452 323 64 question question NOUN crl-14452 323 65 ? ? PUNCT crl-14452 324 1 ( ( PUNCT crl-14452 324 2 seven seven NUM crl-14452 324 3 - - PUNCT crl-14452 324 4 point point NOUN crl-14452 324 5 scale scale NOUN crl-14452 324 6 : : PUNCT crl-14452 324 7 sufficient sufficient ADJ crl-14452 324 8 - - PUNCT crl-14452 324 9 insufficient insufficient ADJ crl-14452 324 10 ) ) PUNCT crl-14452 324 11 how how SCONJ crl-14452 324 12 explicit explicit ADJ crl-14452 324 13 was be AUX crl-14452 324 14 the the DET crl-14452 324 15 user user NOUN crl-14452 324 16 's 's PART crl-14452 324 17 question question NOUN crl-14452 324 18 ? ? PUNCT crl-14452 325 1 ( ( PUNCT crl-14452 325 2 seven seven NUM crl-14452 325 3 - - PUNCT crl-14452 325 4 point point NOUN crl-14452 325 5 scale scale NOUN crl-14452 325 6 : : PUNCT crl-14452 325 7 very very ADV crl-14452 325 8 explicit explicit ADJ crl-14452 325 9 - - PUNCT crl-14452 325 10 not not PART crl-14452 325 11 at at ADV crl-14452 325 12 all all ADV crl-14452 325 13 explicit explicit ADJ crl-14452 325 14 ) ) PUNCT crl-14452 325 15 librarian librarian ADJ crl-14452 325 16 judgments judgment NOUN crl-14452 325 17 of of ADP crl-14452 325 18 user user NOUN crl-14452 325 19 participation participation NOUN crl-14452 325 20 ( ( PUNCT crl-14452 325 21 two two NUM crl-14452 325 22 questions question NOUN crl-14452 325 23 , , PUNCT crl-14452 325 24 loading load VERB crl-14452 325 25 on on ADP crl-14452 325 26 one one NUM crl-14452 325 27 factor factor NOUN crl-14452 325 28 , , PUNCT crl-14452 325 29 a a DET crl-14452 325 30 = = SYM crl-14452 325 31 .72 .72 PROPN crl-14452 325 32 ) ) PUNCT crl-14452 325 33 to to ADP crl-14452 325 34 what what DET crl-14452 325 35 extent extent NOUN crl-14452 325 36 did do AUX crl-14452 325 37 the the DET crl-14452 325 38 user user NOUN crl-14452 325 39 provide provide VERB crl-14452 325 40 you you PRON crl-14452 325 41 with with ADP crl-14452 325 42 feedback feedback NOUN crl-14452 325 43 ? ? PUNCT crl-14452 326 1 ( ( PUNCT crl-14452 326 2 seven seven NUM crl-14452 326 3 - - PUNCT crl-14452 326 4 point point NOUN crl-14452 326 5 scale scale NOUN crl-14452 326 6 : : PUNCT crl-14452 326 7 very very ADV crl-14452 326 8 great great ADJ crl-14452 326 9 extent extent NOUN crl-14452 326 10 - - PUNCT crl-14452 326 11 very very ADV crl-14452 326 12 little little ADJ crl-14452 326 13 extent extent NOUN crl-14452 326 14 ) ) PUNCT crl-14452 326 15 194 194 NUM crl-14452 326 16 college college PROPN crl-14452 326 17 & & CCONJ crl-14452 326 18 research research PROPN crl-14452 326 19 libraries library NOUN crl-14452 326 20 march march PROPN crl-14452 326 21 1989 1989 NUM crl-14452 326 22 how how SCONJ crl-14452 326 23 active active ADJ crl-14452 326 24 a a DET crl-14452 326 25 role role NOUN crl-14452 326 26 did do AUX crl-14452 326 27 the the DET crl-14452 326 28 user user NOUN crl-14452 326 29 play play VERB crl-14452 326 30 in in ADP crl-14452 326 31 resolving resolve VERB crl-14452 326 32 his his PRON crl-14452 326 33 / / SYM crl-14452 326 34 her her PRON crl-14452 326 35 information information NOUN crl-14452 326 36 need need NOUN crl-14452 326 37 ? ? PUNCT crl-14452 327 1 ( ( PUNCT crl-14452 327 2 seven seven NUM crl-14452 327 3 - - PUNCT crl-14452 327 4 point point NOUN crl-14452 327 5 scale scale NOUN crl-14452 327 6 : : PUNCT crl-14452 327 7 very very ADV crl-14452 327 8 active active ADJ crl-14452 327 9 - - PUNCT crl-14452 327 10 not not PART crl-14452 327 11 very very ADV crl-14452 327 12 active active ADJ crl-14452 327 13 ) ) PUNCT crl-14452 327 14 type type NOUN crl-14452 327 15 of of ADP crl-14452 327 16 reference reference NOUN crl-14452 327 17 assistance assistance NOUN crl-14452 327 18 ( ( PUNCT crl-14452 327 19 one one NUM crl-14452 327 20 question question NOUN crl-14452 327 21 ) ) PUNCT crl-14452 327 22 how how SCONJ crl-14452 327 23 did do AUX crl-14452 327 24 the the DET crl-14452 327 25 reference reference NOUN crl-14452 327 26 librarian librarian NOUN crl-14452 327 27 assist assist VERB crl-14452 327 28 you you PRON crl-14452 327 29 ? ? PUNCT crl-14452 328 1 ( ( PUNCT crl-14452 328 2 the the DET crl-14452 328 3 user user NOUN crl-14452 328 4 selected select VERB crl-14452 328 5 one one NUM crl-14452 328 6 of of ADP crl-14452 328 7 five five NUM crl-14452 328 8 choices choice NOUN crl-14452 328 9 : : PUNCT crl-14452 328 10 ( ( PUNCT crl-14452 328 11 1 1 X crl-14452 328 12 ) ) PUNCT crl-14452 328 13 by by ADP crl-14452 328 14 accompanying accompany VERB crl-14452 328 15 you you PRON crl-14452 328 16 to to ADP crl-14452 328 17 sources source NOUN crl-14452 328 18 to to PART crl-14452 328 19 help help VERB crl-14452 328 20 find find VERB crl-14452 328 21 the the DET crl-14452 328 22 answers answer NOUN crl-14452 328 23 ; ; PUNCT crl-14452 328 24 ( ( PUNCT crl-14452 328 25 2 2 NUM crl-14452 328 26 ) ) PUNCT crl-14452 328 27 by by ADP crl-14452 328 28 referring refer VERB crl-14452 328 29 you you PRON crl-14452 328 30 to to ADP crl-14452 328 31 sources source NOUN crl-14452 328 32 to to PART crl-14452 328 33 find find VERB crl-14452 328 34 the the DET crl-14452 328 35 answer answer NOUN crl-14452 328 36 on on ADP crl-14452 328 37 your your PRON crl-14452 328 38 own own ADJ crl-14452 328 39 ; ; PUNCT crl-14452 328 40 ( ( PUNCT crl-14452 328 41 3 3 NUM crl-14452 328 42 ) ) PUNCT crl-14452 328 43 by by ADP crl-14452 328 44 accompanying accompany VERB crl-14452 328 45 you you PRON crl-14452 328 46 to to ADP crl-14452 328 47 some some DET crl-14452 328 48 sources source NOUN crl-14452 328 49 and and CCONJ crl-14452 328 50 referring refer VERB crl-14452 328 51 you you PRON crl-14452 328 52 to to ADP crl-14452 328 53 other other ADJ crl-14452 328 54 sources source NOUN crl-14452 328 55 ; ; PUNCT crl-14452 328 56 ( ( PUNCT crl-14452 328 57 4 4 X crl-14452 328 58 ) ) PUNCT crl-14452 328 59 by by ADP crl-14452 328 60 directly directly ADV crl-14452 328 61 giving give VERB crl-14452 328 62 you you PRON crl-14452 328 63 the the DET crl-14452 328 64 answer answer NOUN crl-14452 328 65 to to ADP crl-14452 328 66 your your PRON crl-14452 328 67 question question NOUN crl-14452 328 68 ; ; PUNCT crl-14452 328 69 or or CCONJ crl-14452 328 70 ( ( PUNCT crl-14452 328 71 5 5 X crl-14452 328 72 ) ) PUNCT crl-14452 328 73 other other ADJ crl-14452 328 74 ( ( PUNCT crl-14452 328 75 please please INTJ crl-14452 328 76 explain explain VERB crl-14452 328 77 ) ) PUNCT crl-14452 328 78 ) ) PUNCT crl-14452 329 1 note note VERB crl-14452 329 2 : : PUNCT crl-14452 329 3 the the DET crl-14452 329 4 abbreviation abbreviation NOUN crl-14452 329 5 11 11 NUM crl-14452 329 6 a a NOUN crl-14452 329 7 '' '' PUNCT crl-14452 329 8 refers refer VERB crl-14452 329 9 to to PART crl-14452 329 10 cronbach cronbach VERB crl-14452 329 11 ' ' PUNCT crl-14452 329 12 s s PART crl-14452 329 13 alpha alpha NOUN crl-14452 329 14 , , PUNCT crl-14452 329 15 a a DET crl-14452 329 16 measure measure NOUN crl-14452 329 17 of of ADP crl-14452 329 18 internal internal ADJ crl-14452 329 19 reliability reliability NOUN crl-14452 329 20 for for ADP crl-14452 329 21 the the DET crl-14452 329 22 variable variable NOUN crl-14452 329 23 . . PUNCT crl-14452 330 1 the the DET crl-14452 330 2 library library PROPN crl-14452 330 3 program program NOUN crl-14452 330 4 is be AUX crl-14452 330 5 basically basically ADV crl-14452 330 6 concerned concerned ADJ crl-14452 330 7 with with ADP crl-14452 330 8 teaching teaching NOUN crl-14452 330 9 and and CCONJ crl-14452 330 10 learning learning NOUN crl-14452 330 11 , , PUNCT crl-14452 330 12 with with ADP crl-14452 330 13 adapting adapt VERB crl-14452 330 14 the the DET crl-14452 330 15 library library NOUN crl-14452 330 16 to to ADP crl-14452 330 17 instructional instructional ADJ crl-14452 330 18 needs need NOUN crl-14452 330 19 , , PUNCT crl-14452 330 20 and and CCONJ crl-14452 330 21 with with ADP crl-14452 330 22 improving improve VERB crl-14452 330 23 student student NOUN crl-14452 330 24 work work NOUN crl-14452 330 25 and and CCONJ crl-14452 330 26 achievement achievement NOUN crl-14452 330 27 . . PUNCT crl-14452 331 1 -frank -frank PROPN crl-14452 331 2 a. a. PROPN crl-14452 331 3 lundy lundy PROPN crl-14452 331 4 , , PUNCT crl-14452 331 5 january january PROPN crl-14452 331 6 1951 1951 NUM crl-14452 331 7 william william PROPN crl-14452 331 8 miller miller PROPN crl-14452 331 9 , , PUNCT crl-14452 331 10 in in ADP crl-14452 331 11 the the DET crl-14452 331 12 book book NOUN crl-14452 331 13 industry industry NOUN crl-14452 331 14 , , PUNCT crl-14452 331 15 quotes quote VERB crl-14452 331 16 g. g. PROPN crl-14452 331 17 p. p. PROPN crl-14452 331 18 bret bret PROPN crl-14452 331 19 , , PUNCT crl-14452 331 20 jr jr PROPN crl-14452 331 21 . . PROPN crl-14452 331 22 , , PUNCT crl-14452 331 23 president president NOUN crl-14452 331 24 of of ADP crl-14452 331 25 macmillan macmillan PROPN crl-14452 331 26 company company PROPN crl-14452 331 27 , , PUNCT crl-14452 331 28 as as ADP crl-14452 331 29 saying say VERB crl-14452 331 30 in in ADP crl-14452 331 31 march march PROPN crl-14452 331 32 1948 1948 NUM crl-14452 331 33 that that SCONJ crl-14452 331 34 " " PUNCT crl-14452 331 35 all all DET crl-14452 331 36 ( ( PUNCT crl-14452 331 37 book book NOUN crl-14452 331 38 ) ) PUNCT crl-14452 331 39 costs cost NOUN crl-14452 331 40 have have AUX crl-14452 331 41 increased increase VERB crl-14452 331 42 since since SCONJ crl-14452 331 43 1940 1940 NUM crl-14452 331 44 between between ADP crl-14452 331 45 60 60 NUM crl-14452 331 46 and and CCONJ crl-14452 331 47 70 70 NUM crl-14452 331 48 percent percent NOUN crl-14452 331 49 . . PUNCT crl-14452 331 50 '' '' PUNCT crl-14452 332 1 -elizabeth -elizabeth X crl-14452 333 1 c. c. PROPN crl-14452 333 2 seely seely ADV crl-14452 333 3 , , PUNCT crl-14452 333 4 october october PROPN crl-14452 333 5 1951 1951 NUM