id sid tid token lemma pos crl-12214 1 1 college college NOUN crl-12214 1 2 and and CCONJ crl-12214 1 3 research research NOUN crl-12214 1 4 libraries librarie VERB crl-12214 1 5 l l PROPN crl-12214 1 6 louis louis PROPN crl-12214 1 7 kaplan kaplan PROPN crl-12214 1 8 i i PRON crl-12214 1 9 lnforination lnforination VERB crl-12214 1 10 retrieval retrieval NOUN crl-12214 1 11 from from ADP crl-12214 1 12 the the DET crl-12214 1 13 management management NOUN crl-12214 1 14 point point NOUN crl-12214 1 15 of of ADP crl-12214 1 16 view view NOUN crl-12214 1 17 several several ADJ crl-12214 1 18 conclusions conclusion NOUN crl-12214 1 19 may may AUX crl-12214 1 20 now now ADV crl-12214 1 21 be be AUX crl-12214 1 22 drawn draw VERB crl-12214 1 23 by by ADP crl-12214 1 24 management management NOUN crl-12214 1 25 , , PUNCT crl-12214 1 26 based base VERB crl-12214 1 27 on on ADP crl-12214 1 28 results result NOUN crl-12214 1 29 derived derive VERB crl-12214 1 30 from from ADP crl-12214 1 31 several several ADJ crl-12214 1 32 " " PUNCT crl-12214 1 33 laboratory laboratory NOUN crl-12214 1 34 " " PUNCT crl-12214 1 35 experiments experiment NOUN crl-12214 1 36 in in ADP crl-12214 1 37 information information NOUN crl-12214 1 38 retrieval retrieval NOUN crl-12214 1 39 . . PUNCT crl-12214 2 1 a a DET crl-12214 2 2 major major ADJ crl-12214 2 3 finding finding NOUN crl-12214 2 4 is be AUX crl-12214 2 5 that that SCONJ crl-12214 2 6 a a DET crl-12214 2 7 controlled control VERB crl-12214 2 8 indexing indexing NOUN crl-12214 2 9 language language NOUN crl-12214 2 10 ( ( PUNCT crl-12214 2 11 controlled control VERB crl-12214 2 12 by by ADP crl-12214 2 13 an an DET crl-12214 2 14 authority authority NOUN crl-12214 2 15 list list NOUN crl-12214 2 16 of of ADP crl-12214 2 17 headings heading NOUN crl-12214 2 18 ) ) PUNCT crl-12214 2 19 will will AUX crl-12214 2 20 not not PART crl-12214 2 21 provide provide VERB crl-12214 2 22 more more ADV crl-12214 2 23 effective effective ADJ crl-12214 2 24 retrieval retrieval NOUN crl-12214 2 25 than than SCONJ crl-12214 2 26 will will AUX crl-12214 2 27 the the DET crl-12214 2 28 uncontrolled uncontrolled ADJ crl-12214 2 29 type type NOUN crl-12214 2 30 . . PUNCT crl-12214 3 1 automatic automatic ADJ crl-12214 3 2 indexing indexing NOUN crl-12214 3 3 , , PUNCT crl-12214 3 4 using use VERB crl-12214 3 5 semantic semantic ADJ crl-12214 3 6 and and CCONJ crl-12214 3 7 syntactic syntactic ADJ crl-12214 3 8 devices device NOUN crl-12214 3 9 , , PUNCT crl-12214 3 10 does do AUX crl-12214 3 11 not not PART crl-12214 3 12 improve improve VERB crl-12214 3 13 upon upon SCONJ crl-12214 3 14 the the DET crl-12214 3 15 performance performance NOUN crl-12214 3 16 of of ADP crl-12214 3 17 a a DET crl-12214 3 18 manual manual ADJ crl-12214 3 19 system system NOUN crl-12214 3 20 . . PUNCT crl-12214 4 1 increasing increase VERB crl-12214 4 2 the the DET crl-12214 4 3 number number NOUN crl-12214 4 4 of of ADP crl-12214 4 5 subject subject ADJ crl-12214 4 6 entries entry NOUN crl-12214 4 7 per per ADP crl-12214 4 8 document document NOUN crl-12214 4 9 ( ( PUNCT crl-12214 4 10 with with ADP crl-12214 4 11 or or CCONJ crl-12214 4 12 without without ADP crl-12214 4 13 computer computer NOUN crl-12214 4 14 ) ) PUNCT crl-12214 4 15 will will AUX crl-12214 4 16 increase increase VERB crl-12214 4 17 the the DET crl-12214 4 18 number number NOUN crl-12214 4 19 of of ADP crl-12214 4 20 retrievals retrieval NOUN crl-12214 4 21 relevant relevant ADJ crl-12214 4 22 to to ADP crl-12214 4 23 a a DET crl-12214 4 24 question question NOUN crl-12214 4 25 , , PUNCT crl-12214 4 26 but but CCONJ crl-12214 4 27 will will AUX crl-12214 4 28 at at ADP crl-12214 4 29 the the DET crl-12214 4 30 same same ADJ crl-12214 4 31 time time NOUN crl-12214 4 32 disproportionately disproportionately ADV crl-12214 4 33 increase increase VERB crl-12214 4 34 the the DET crl-12214 4 35 number number NOUN crl-12214 4 36 of of ADP crl-12214 4 37 nonrelevant nonrelevant ADJ crl-12214 4 38 references reference NOUN crl-12214 4 39 . . PUNCT crl-12214 5 1 introduction introduction NOUN crl-12214 5 2 a a DET crl-12214 5 3 number number NOUN crl-12214 5 4 of of ADP crl-12214 5 5 investigations investigation NOUN crl-12214 5 6 conducted conduct VERB crl-12214 5 7 recently recently ADV crl-12214 5 8 by by ADP crl-12214 5 9 documentalists documentalist NOUN crl-12214 5 10 have have VERB crl-12214 5 11 grave grave ADJ crl-12214 5 12 implications implication NOUN crl-12214 5 13 for for ADP crl-12214 5 14 those those DET crl-12214 5 15 library library NOUN crl-12214 5 16 administrators administrator NOUN crl-12214 5 17 contemplating contemplate VERB crl-12214 5 18 the the DET crl-12214 5 19 development development NOUN crl-12214 5 20 of of ADP crl-12214 5 21 a a DET crl-12214 5 22 large large ADJ crl-12214 5 23 - - PUNCT crl-12214 5 24 scale scale NOUN crl-12214 5 25 information information NOUN crl-12214 5 26 system system NOUN crl-12214 5 27 . . PUNCT crl-12214 6 1 in in ADP crl-12214 6 2 this this DET crl-12214 6 3 paper paper NOUN crl-12214 6 4 some some DET crl-12214 6 5 well well ADV crl-12214 6 6 - - PUNCT crl-12214 6 7 known know VERB crl-12214 6 8 experiments experiment NOUN crl-12214 6 9 are be AUX crl-12214 6 10 discussed discuss VERB crl-12214 6 11 , , PUNCT crl-12214 6 12 and and CCONJ crl-12214 6 13 the the DET crl-12214 6 14 results result NOUN crl-12214 6 15 evaluated evaluate VERB crl-12214 6 16 from from ADP crl-12214 6 17 a a DET crl-12214 6 18 management management NOUN crl-12214 6 19 point point NOUN crl-12214 6 20 of of ADP crl-12214 6 21 view view NOUN crl-12214 6 22 . . PUNCT crl-12214 7 1 during during ADP crl-12214 7 2 the the DET crl-12214 7 3 past past ADJ crl-12214 7 4 few few ADJ crl-12214 7 5 years year NOUN crl-12214 7 6 a a DET crl-12214 7 7 num num ADJ crl-12214 7 8 her she PRON crl-12214 7 9 of of ADP crl-12214 7 10 significant significant ADJ crl-12214 7 11 tests test NOUN crl-12214 7 12 of of ADP crl-12214 7 13 information information NOUN crl-12214 7 14 retrieval retrieval NOUN crl-12214 7 15 systems system NOUN crl-12214 7 16 have have AUX crl-12214 7 17 been be AUX crl-12214 7 18 conducted conduct VERB crl-12214 7 19 , , PUNCT crl-12214 7 20 of of ADP crl-12214 7 21 which which PRON crl-12214 7 22 three three NUM crl-12214 7 23 are be AUX crl-12214 7 24 perhaps perhaps ADV crl-12214 7 25 most most ADV crl-12214 7 26 important important ADJ crl-12214 7 27 to to ADP crl-12214 7 28 librarians librarian NOUN crl-12214 7 29 : : PUNCT crl-12214 7 30 the the DET crl-12214 7 31 work work NOUN crl-12214 7 32 by by ADP crl-12214 7 33 cleverdon cleverdon PROPN crl-12214 7 34 and and CCONJ crl-12214 7 35 his his PRON crl-12214 7 36 associates associate NOUN crl-12214 7 37 at at ADP crl-12214 7 38 the the DET crl-12214 7 39 college college NOUN crl-12214 7 40 of of ADP crl-12214 7 41 aeronautics aeronautic NOUN crl-12214 7 42 in in ADP crl-12214 7 43 cranfield cranfield PROPN crl-12214 7 44 , , PUNCT crl-12214 7 45 england england PROPN crl-12214 7 46 ; ; PUNCT crl-12214 7 47 by by ADP crl-12214 7 48 saracevic saracevic ADJ crl-12214 7 49 , , PUNCT crl-12214 7 50 rees ree NOUN crl-12214 7 51 , , PUNCT crl-12214 7 52 and and CCONJ crl-12214 7 53 others other NOUN crl-12214 7 54 at at ADP crl-12214 7 55 the the DET crl-12214 7 56 center center NOUN crl-12214 7 57 for for ADP crl-12214 7 58 documentation documentation NOUN crl-12214 7 59 and and CCONJ crl-12214 7 60 communication communication NOUN crl-12214 7 61 research research NOUN crl-12214 7 62 at at ADP crl-12214 7 63 case case NOUN crl-12214 7 64 western western PROPN crl-12214 7 65 reserve reserve PROPN crl-12214 7 66 university university PROPN crl-12214 7 67 ; ; PUNCT crl-12214 7 68 and and CCONJ crl-12214 7 69 by by ADP crl-12214 7 70 salton salton PROPN crl-12214 7 71 and and CCONJ crl-12214 7 72 his his PRON crl-12214 7 73 co co NOUN crl-12214 7 74 - - NOUN crl-12214 7 75 workers worker NOUN crl-12214 7 76 in in ADP crl-12214 7 77 the the DET crl-12214 7 78 department department NOUN crl-12214 7 79 of of ADP crl-12214 7 80 computer computer NOUN crl-12214 7 81 sciences science NOUN crl-12214 7 82 at at ADP crl-12214 7 83 cornell cornell PROPN crl-12214 7 84 . . PUNCT crl-12214 8 1 these these DET crl-12214 8 2 information information NOUN crl-12214 8 3 scientists scientist NOUN crl-12214 8 4 have have AUX crl-12214 8 5 indisputably indisputably ADV crl-12214 8 6 advanced advance VERB crl-12214 8 7 our our PRON crl-12214 8 8 mr mr PROPN crl-12214 8 9 . . PROPN crl-12214 8 10 kapla.n kapla.n PROPN crl-12214 8 11 is be AUX crl-12214 8 12 director director NOUN crl-12214 8 13 of of ADP crl-12214 8 14 libraries library NOUN crl-12214 8 15 , , PUNCT crl-12214 8 16 the the DET crl-12214 8 17 . . PUNCT crl-12214 8 18 memorial memorial PROPN crl-12214 8 19 library library PROPN crl-12214 8 20 , , PUNCT crl-12214 8 21 university university PROPN crl-12214 8 22 of of ADP crl-12214 8 23 wisconsin wisconsin PROPN crl-12214 8 24 , , PUNCT crl-12214 8 25 madison madison PROPN crl-12214 8 26 . . PUNCT crl-12214 9 1 understanding understanding NOUN crl-12214 9 2 of of ADP crl-12214 9 3 information information NOUN crl-12214 9 4 retrieval retrieval NOUN crl-12214 9 5 ; ; PUNCT crl-12214 9 6 on on ADP crl-12214 9 7 the the DET crl-12214 9 8 other other ADJ crl-12214 9 9 hand hand NOUN crl-12214 9 10 , , PUNCT crl-12214 9 11 their their PRON crl-12214 9 12 efforts effort NOUN crl-12214 9 13 to to PART crl-12214 9 14 optimize optimize VERB crl-12214 9 15 retrieval retrieval NOUN crl-12214 9 16 have have AUX crl-12214 9 17 not not PART crl-12214 9 18 met meet VERB crl-12214 9 19 with with ADP crl-12214 9 20 undivided undivided ADJ crl-12214 9 21 success success NOUN crl-12214 9 22 . . PUNCT crl-12214 10 1 furthermore furthermore ADV crl-12214 10 2 , , PUNCT crl-12214 10 3 from from ADP crl-12214 10 4 the the DET crl-12214 10 5 library library NOUN crl-12214 10 6 management management NOUN crl-12214 10 7 point point NOUN crl-12214 10 8 of of ADP crl-12214 10 9 view view NOUN crl-12214 10 10 , , PUNCT crl-12214 10 11 the the DET crl-12214 10 12 depth depth NOUN crl-12214 10 13 of of ADP crl-12214 10 14 indexing indexing NOUN crl-12214 10 15 employed employ VERB crl-12214 10 16 , , PUNCT crl-12214 10 17 the the DET crl-12214 10 18 construction construction NOUN crl-12214 10 19 of of ADP crl-12214 10 20 thesauri thesauri PROPN crl-12214 10 21 , , PUNCT crl-12214 10 22 and and CCONJ crl-12214 10 23 the the DET crl-12214 10 24 sophisticated sophisticated ADJ crl-12214 10 25 devices device NOUN crl-12214 10 26 introduced introduce VERB crl-12214 10 27 seem seem VERB crl-12214 10 28 terribly terribly ADV crl-12214 10 29 expensive expensive ADJ crl-12214 10 30 . . PUNCT crl-12214 11 1 nevertheless nevertheless ADV crl-12214 11 2 , , PUNCT crl-12214 11 3 it it PRON crl-12214 11 4 would would AUX crl-12214 11 5 be be AUX crl-12214 11 6 a a DET crl-12214 11 7 mistake mistake NOUN crl-12214 11 8 for for SCONJ crl-12214 11 9 librarians librarian NOUN crl-12214 11 10 to to PART crl-12214 11 11 ignore ignore VERB crl-12214 11 12 the the DET crl-12214 11 13 implications implication NOUN crl-12214 11 14 of of ADP crl-12214 11 15 the the DET crl-12214 11 16 work work NOUN crl-12214 11 17 done do VERB crl-12214 11 18 by by ADP crl-12214 11 19 these these DET crl-12214 11 20 information information NOUN crl-12214 11 21 scientists scientist NOUN crl-12214 11 22 . . PUNCT crl-12214 12 1 brief brief ADJ crl-12214 12 2 . . PUNCT crl-12214 13 1 description description NOUN crl-12214 13 2 of of ADP crl-12214 13 3 the the DET crl-12214 13 4 tests test NOUN crl-12214 13 5 under under ADP crl-12214 13 6 discussion discussion NOUN crl-12214 13 7 1 1 NUM crl-12214 13 8 . . PUNCT crl-12214 13 9 the the DET crl-12214 13 10 cranfield cranfield NOUN crl-12214 13 11 tests test NOUN crl-12214 13 12 . . PUNCT crl-12214 14 1 the the DET crl-12214 14 2 cranfield cranfield NOUN crl-12214 14 3 tests test NOUN crl-12214 14 4 emphasized emphasize VERB crl-12214 14 5 the the DET crl-12214 14 6 significance significance NOUN crl-12214 14 7 of of ADP crl-12214 14 8 language language NOUN crl-12214 14 9 devices device NOUN crl-12214 14 10 which which PRON crl-12214 14 11 influence influence VERB crl-12214 14 12 recall recall NOUN crl-12214 14 13 and and CCONJ crl-12214 14 14 precision precision NOUN crl-12214 14 15 , , PUNCT crl-12214 14 16 such such ADJ crl-12214 14 17 as as ADP crl-12214 14 18 roles role NOUN crl-12214 14 19 , , PUNCT crl-12214 14 20 links link NOUN crl-12214 14 21 , , PUNCT crl-12214 14 22 interfixing interfixing NOUN crl-12214 14 23 , , PUNCT crl-12214 14 24 partitioning partition VERB crl-12214 14 25 ; ; PUNCT crl-12214 14 26 also also ADV crl-12214 14 27 studied study VERB crl-12214 14 28 was be AUX crl-12214 14 29 the the DET crl-12214 14 30 influence influence NOUN crl-12214 14 31 of of ADP crl-12214 14 32 the the DET crl-12214 14 33 number number NOUN crl-12214 14 34 of of ADP crl-12214 14 35 coordinate coordinate NOUN crl-12214 14 36 tenns tenns NOUN crl-12214 14 37 in in ADP crl-12214 14 38 a a DET crl-12214 14 39 search search NOUN crl-12214 14 40 question question NOUN crl-12214 14 41 and and CCONJ crl-12214 14 42 the the DET crl-12214 14 43 depth depth NOUN crl-12214 14 44 of of ADP crl-12214 14 45 indexing.1 indexing.1 ADV crl-12214 14 46 three three NUM crl-12214 14 47 indexing indexing NOUN crl-12214 14 48 languages language NOUN crl-12214 14 49 were be AUX crl-12214 14 50 tested test VERB crl-12214 14 51 : : PUNCT crl-12214 14 52 single single ADJ crl-12214 14 53 - - PUNCT crl-12214 14 54 terms term NOUN crl-12214 14 55 , , PUNCT crl-12214 14 56 concepts concept NOUN crl-12214 14 57 , , PUNCT crl-12214 14 58 and and CCONJ crl-12214 14 59 a a DET crl-12214 14 60 controlled control VERB crl-12214 14 61 language language NOUN crl-12214 14 62 , , PUNCT crl-12214 14 63 all all PRON crl-12214 14 64 in in ADP crl-12214 14 65 the the DET crl-12214 14 66 subject subject ADJ crl-12214 14 67 field field NOUN crl-12214 14 68 of of ADP crl-12214 14 69 aerodynamics aerodynamic NOUN crl-12214 14 70 . . PUNCT crl-12214 15 1 with with ADP crl-12214 15 2 each each DET crl-12214 15 3 language language NOUN crl-12214 15 4 several several ADJ crl-12214 15 5 recall recall NOUN crl-12214 15 6 devices device NOUN crl-12214 15 7 were be AUX crl-12214 15 8 tested test VERB crl-12214 15 9 , , PUNCT crl-12214 15 10 and and CCONJ crl-12214 15 11 i i PRON crl-12214 15 12 169 169 NUM crl-12214 15 13 170 170 NUM crl-12214 15 14 j j PROPN crl-12214 15 15 college college PROPN crl-12214 15 16 & & CCONJ crl-12214 15 17 research research PROPN crl-12214 15 18 libraries library NOUN crl-12214 15 19 • • INTJ crl-12214 15 20 may may AUX crl-12214 15 21 1970 1970 NUM crl-12214 15 22 for for ADP crl-12214 15 23 each each PRON crl-12214 15 24 of of ADP crl-12214 15 25 the the DET crl-12214 15 26 languages language NOUN crl-12214 15 27 several several ADJ crl-12214 15 28 precision precision NOUN crl-12214 15 29 devices device NOUN crl-12214 15 30 were be AUX crl-12214 15 31 used use VERB crl-12214 15 32 , , PUNCT crl-12214 15 33 including include VERB crl-12214 15 34 coordination coordination NOUN crl-12214 15 35 . . PUNCT crl-12214 16 1 2 2 X crl-12214 16 2 . . X crl-12214 16 3 the the DET crl-12214 16 4 case case NOUN crl-12214 16 5 western western PROPN crl-12214 16 6 reserve reserve PROPN crl-12214 16 7 tests test NOUN crl-12214 16 8 . . PUNCT crl-12214 17 1 several several ADJ crl-12214 17 2 indexing indexing NOUN crl-12214 17 3 languages language NOUN crl-12214 17 4 were be AUX crl-12214 17 5 tested test VERB crl-12214 17 6 by by ADP crl-12214 17 7 saracevic saracevic NOUN crl-12214 17 8 and and CCONJ crl-12214 17 9 his his PRON crl-12214 17 10 team team NOUN crl-12214 17 11 . . PUNCT crl-12214 18 1 2 2 NUM crl-12214 18 2 those those PRON crl-12214 18 3 that that PRON crl-12214 18 4 need need VERB crl-12214 18 5 be be AUX crl-12214 18 6 referred refer VERB crl-12214 18 7 to to ADP crl-12214 18 8 in in ADP crl-12214 18 9 this this DET crl-12214 18 10 context context NOUN crl-12214 18 11 are be AUX crl-12214 18 12 : : PUNCT crl-12214 18 13 ( ( PUNCT crl-12214 18 14 a a X crl-12214 18 15 ) ) PUNCT crl-12214 18 16 keywords keyword NOUN crl-12214 18 17 assigned assign VERB crl-12214 18 18 by by ADP crl-12214 18 19 indexers indexer NOUN crl-12214 18 20 ( ( PUNCT crl-12214 18 21 that that ADV crl-12214 18 22 is be AUX crl-12214 18 23 , , PUNCT crl-12214 18 24 in in ADP crl-12214 18 25 the the DET crl-12214 18 26 language language NOUN crl-12214 18 27 of of ADP crl-12214 18 28 the the DET crl-12214 18 29 text text NOUN crl-12214 18 30 ) ) PUNCT crl-12214 18 31 and and CCONJ crl-12214 18 32 ( ( PUNCT crl-12214 18 33 b b X crl-12214 18 34 ) ) PUNCT crl-12214 18 35 a a DET crl-12214 18 36 language language NOUN crl-12214 18 37 based base VERB crl-12214 18 38 on on ADP crl-12214 18 39 the the DET crl-12214 18 40 so so ADV crl-12214 18 41 - - PUNCT crl-12214 18 42 called call VERB crl-12214 18 43 " " PUNCT crl-12214 18 44 telegraphic telegraphic ADJ crl-12214 18 45 abstracts abstract NOUN crl-12214 18 46 " " PUNCT crl-12214 18 47 ( ( PUNCT crl-12214 18 48 a a DET crl-12214 18 49 language language NOUN crl-12214 18 50 employing employ VERB crl-12214 18 51 a a DET crl-12214 18 52 number number NOUN crl-12214 18 53 of of ADP crl-12214 18 54 formal formal ADJ crl-12214 18 55 recall recall NOUN crl-12214 18 56 and and CCONJ crl-12214 18 57 precision precision NOUN crl-12214 18 58 devices device NOUN crl-12214 18 59 ) ) PUNCT crl-12214 18 60 . . PUNCT crl-12214 19 1 the the DET crl-12214 19 2 tests test NOUN crl-12214 19 3 conducted conduct VERB crl-12214 19 4 at at ADP crl-12214 19 5 case case NOUN crl-12214 19 6 western western PROPN crl-12214 19 7 reserve reserve PROPN crl-12214 19 8 university university PROPN crl-12214 19 9 emphasized emphasize VERB crl-12214 19 10 the the DET crl-12214 19 11 influence influence NOUN crl-12214 19 12 of of ADP crl-12214 19 13 the the DET crl-12214 19 14 manipulation manipulation NOUN crl-12214 19 15 of of ADP crl-12214 19 16 search search NOUN crl-12214 19 17 questions question NOUN crl-12214 19 18 . . PUNCT crl-12214 20 1 depth depth NOUN crl-12214 20 2 of of ADP crl-12214 20 3 indexing indexing NOUN crl-12214 20 4 was be AUX crl-12214 20 5 tested test VERB crl-12214 20 6 by by ADP crl-12214 20 7 treating treat VERB crl-12214 20 8 full full ADJ crl-12214 20 9 texts text NOUN crl-12214 20 10 , , PUNCT crl-12214 20 11 abstracts abstract NOUN crl-12214 20 12 , , PUNCT crl-12214 20 13 and and CCONJ crl-12214 20 14 titles title NOUN crl-12214 20 15 as as ADP crl-12214 20 16 independent independent ADJ crl-12214 20 17 variables variable NOUN crl-12214 20 18 . . PUNCT crl-12214 21 1 a a DET crl-12214 21 2 third third ADJ crl-12214 21 3 major major ADJ crl-12214 21 4 variable variable NOUN crl-12214 21 5 was be AUX crl-12214 21 6 the the DET crl-12214 21 7 indexing indexing NOUN crl-12214 21 8 languages language NOUN crl-12214 21 9 . . PUNCT crl-12214 22 1 3 3 X crl-12214 22 2 . . X crl-12214 22 3 smart smart ADJ crl-12214 22 4 . . PUNCT crl-12214 23 1 the the DET crl-12214 23 2 smart smart ADJ crl-12214 23 3 system system NOUN crl-12214 23 4 ( ( PUNCT crl-12214 23 5 originally originally ADV crl-12214 23 6 established establish VERB crl-12214 23 7 at at ADP crl-12214 23 8 harvard harvard PROPN crl-12214 23 9 , , PUNCT crl-12214 23 10 now now ADV crl-12214 23 11 at at ADP crl-12214 23 12 cornell cornell PROPN crl-12214 23 13 ) ) PUNCT crl-12214 23 14 is be AUX crl-12214 23 15 described describe VERB crl-12214 23 16 in in ADP crl-12214 23 17 a a DET crl-12214 23 18 recent recent ADJ crl-12214 23 19 text text NOUN crl-12214 23 20 by by ADP crl-12214 23 21 gerard gerard NOUN crl-12214 23 22 salton salton PROPN crl-12214 23 23 and and CCONJ crl-12214 23 24 in in ADP crl-12214 23 25 a a DET crl-12214 23 26 number number NOUN crl-12214 23 27 of of ADP crl-12214 23 28 reports report NOUN crl-12214 23 29 entitled entitle VERB crl-12214 23 30 information information NOUN crl-12214 23 31 retrieval retrieval NOUN crl-12214 23 32 system system NOUN crl-12214 23 33 , , PUNCT crl-12214 23 34 coming come VERB crl-12214 23 35 most most ADV crl-12214 23 36 recently recently ADV crl-12214 23 37 from from ADP crl-12214 23 38 the the DET crl-12214 23 39 department department NOUN crl-12214 23 40 of of ADP crl-12214 23 41 computer computer NOUN crl-12214 23 42 sciences science NOUN crl-12214 23 43 at at ADP crl-12214 23 44 cornell.3 cornell.3 NOUN crl-12214 23 45 unlike unlike ADP crl-12214 23 46 medlars medlar NOUN crl-12214 23 47 , , PUNCT crl-12214 23 48 where where SCONJ crl-12214 23 49 machine machine NOUN crl-12214 23 50 manipulation manipulation NOUN crl-12214 23 51 follows follow VERB crl-12214 23 52 manual manual ADJ crl-12214 23 53 indexing indexing NOUN crl-12214 23 54 , , PUNCT crl-12214 23 55 smart smart ADJ crl-12214 23 56 indexing indexing NOUN crl-12214 23 57 depends depend VERB crl-12214 23 58 as as ADV crl-12214 23 59 well well ADV crl-12214 23 60 upon upon SCONJ crl-12214 23 61 machine machine NOUN crl-12214 23 62 manipulation manipulation NOUN crl-12214 23 63 of of ADP crl-12214 23 64 the the DET crl-12214 23 65 documents document NOUN crl-12214 23 66 prior prior ADV crl-12214 23 67 to to ADP crl-12214 23 68 the the DET crl-12214 23 69 actual actual ADJ crl-12214 23 70 retrieval retrieval NOUN crl-12214 23 71 process process NOUN crl-12214 23 72 . . PUNCT crl-12214 24 1 each each DET crl-12214 24 2 search search NOUN crl-12214 24 3 question question NOUN crl-12214 24 4 and and CCONJ crl-12214 24 5 each each DET crl-12214 24 6 document document NOUN crl-12214 24 7 is be AUX crl-12214 24 8 manipulated manipulate VERB crl-12214 24 9 from from ADP crl-12214 24 10 the the DET crl-12214 24 11 viewpoint viewpoint NOUN crl-12214 24 12 of of ADP crl-12214 24 13 word word NOUN crl-12214 24 14 and and CCONJ crl-12214 24 15 phrase phrase NOUN crl-12214 24 16 frequency frequency NOUN crl-12214 24 17 and and CCONJ crl-12214 24 18 from from ADP crl-12214 24 19 the the DET crl-12214 24 20 viewpoint viewpoint NOUN crl-12214 24 21 of of ADP crl-12214 24 22 establishing establish VERB crl-12214 24 23 , , PUNCT crl-12214 24 24 by by ADP crl-12214 24 25 frequency frequency NOUN crl-12214 24 26 studies study NOUN crl-12214 24 27 , , PUNCT crl-12214 24 28 clusters cluster NOUN crl-12214 24 29 of of ADP crl-12214 24 30 related related ADJ crl-12214 24 31 documents document NOUN crl-12214 24 32 . . PUNCT crl-12214 25 1 in in ADP crl-12214 25 2 addition addition NOUN crl-12214 25 3 , , PUNCT crl-12214 25 4 dictionaries dictionary NOUN crl-12214 25 5 are be AUX crl-12214 25 6 provided provide VERB crl-12214 25 7 to to PART crl-12214 25 8 reduce reduce VERB crl-12214 25 9 the the DET crl-12214 25 10 variety variety NOUN crl-12214 25 11 of of ADP crl-12214 25 12 words word NOUN crl-12214 25 13 by by ADP crl-12214 25 14 compounding compound VERB crl-12214 25 15 stems stem NOUN crl-12214 25 16 and and CCONJ crl-12214 25 17 suffixes suffix NOUN crl-12214 25 18 ; ; PUNCT crl-12214 25 19 for for ADP crl-12214 25 20 example example NOUN crl-12214 25 21 , , PUNCT crl-12214 25 22 one one NUM crl-12214 25 23 dictionary dictionary NOUN crl-12214 25 24 makes make VERB crl-12214 25 25 it it PRON crl-12214 25 26 possible possible ADJ crl-12214 25 27 to to PART crl-12214 25 28 recognize recognize VERB crl-12214 25 29 the the DET crl-12214 25 30 singular singular NOUN crl-12214 25 31 and and CCONJ crl-12214 25 32 the the DET crl-12214 25 33 plural plural NOUN crl-12214 25 34 of of ADP crl-12214 25 35 a a DET crl-12214 25 36 word word NOUN crl-12214 25 37 as as ADP crl-12214 25 38 a a DET crl-12214 25 39 single single ADJ crl-12214 25 40 term term NOUN crl-12214 25 41 , , PUNCT crl-12214 25 42 and and CCONJ crl-12214 25 43 words word NOUN crl-12214 25 44 such such ADJ crl-12214 25 45 as as ADP crl-12214 25 46 economize economize VERB crl-12214 25 47 , , PUNCT crl-12214 25 48 economical economical ADJ crl-12214 25 49 , , PUNCT crl-12214 25 50 economies economy NOUN crl-12214 25 51 are be AUX crl-12214 25 52 also also ADV crl-12214 25 53 gathered gather VERB crl-12214 25 54 up up ADP crl-12214 25 55 as as ADP crl-12214 25 56 a a DET crl-12214 25 57 single single ADJ crl-12214 25 58 term term NOUN crl-12214 25 59 . . PUNCT crl-12214 26 1 semantic semantic ADJ crl-12214 26 2 relationships relationship NOUN crl-12214 26 3 are be AUX crl-12214 26 4 established establish VERB crl-12214 26 5 by by ADP crl-12214 26 6 means mean NOUN crl-12214 26 7 of of ADP crl-12214 26 8 a a DET crl-12214 26 9 dictionary dictionary NOUN crl-12214 26 10 of of ADP crl-12214 26 11 synonyms synonyms PROPN crl-12214 26 12 , , PUNCT crl-12214 26 13 and and CCONJ crl-12214 26 14 the the DET crl-12214 26 15 hierarchical hierarchical ADJ crl-12214 26 16 relationships relationship NOUN crl-12214 26 17 are be AUX crl-12214 26 18 established establish VERB crl-12214 26 19 in in ADP crl-12214 26 20 a a DET crl-12214 26 21 classified classified ADJ crl-12214 26 22 system system NOUN crl-12214 26 23 . . PUNCT crl-12214 27 1 the the DET crl-12214 27 2 syntactic syntactic ADJ crl-12214 27 3 relationship relationship NOUN crl-12214 27 4 between between ADP crl-12214 27 5 phrases phrase NOUN crl-12214 27 6 is be AUX crl-12214 27 7 controlled control VERB crl-12214 27 8 by by ADP crl-12214 27 9 phrase phrase NOUN crl-12214 27 10 dictionaries dictionary NOUN crl-12214 27 11 , , PUNCT crl-12214 27 12 for for ADP crl-12214 27 13 example example NOUN crl-12214 27 14 , , PUNCT crl-12214 27 15 library library NOUN crl-12214 27 16 schools school NOUN crl-12214 27 17 and and CCONJ crl-12214 27 18 schools school NOUN crl-12214 27 19 of of ADP crl-12214 27 20 librarianship librarianship NOUN crl-12214 27 21 . . PUNCT crl-12214 28 1 the the DET crl-12214 28 2 emphasis emphasis NOUN crl-12214 28 3 in in ADP crl-12214 28 4 smart smart ADJ crl-12214 28 5 , , PUNCT crl-12214 28 6 then then ADV crl-12214 28 7 , , PUNCT crl-12214 28 8 is be AUX crl-12214 28 9 on on ADP crl-12214 28 10 the the DET crl-12214 28 11 influence influence NOUN crl-12214 28 12 of of ADP crl-12214 28 13 these these DET crl-12214 28 14 dictionaries dictionary NOUN crl-12214 28 15 on on ADP crl-12214 28 16 the the DET crl-12214 28 17 document document NOUN crl-12214 28 18 search search NOUN crl-12214 28 19 and and CCONJ crl-12214 28 20 in in ADP crl-12214 28 21 the the DET crl-12214 28 22 manipulation manipulation NOUN crl-12214 28 23 of of ADP crl-12214 28 24 the the DET crl-12214 28 25 search search NOUN crl-12214 28 26 questions question NOUN crl-12214 28 27 . . PUNCT crl-12214 29 1 these these DET crl-12214 29 2 dictionaries dictionary NOUN crl-12214 29 3 are be AUX crl-12214 29 4 studied study VERB crl-12214 29 5 independently independently ADV crl-12214 29 6 and and CCONJ crl-12214 29 7 also also ADV crl-12214 29 8 with with ADP crl-12214 29 9 respect respect NOUN crl-12214 29 10 to to ADP crl-12214 29 11 their their PRON crl-12214 29 12 cumulative cumulative ADJ crl-12214 29 13 effect effect NOUN crl-12214 29 14 . . PUNCT crl-12214 30 1 thus thus ADV crl-12214 30 2 the the DET crl-12214 30 3 smart smart ADJ crl-12214 30 4 system system NOUN crl-12214 30 5 identifies identify VERB crl-12214 30 6 the the DET crl-12214 30 7 single single ADJ crl-12214 30 8 best good ADJ crl-12214 30 9 dictionary dictionary NOUN crl-12214 30 10 , , PUNCT crl-12214 30 11 as as ADV crl-12214 30 12 well well ADV crl-12214 30 13 as as ADP crl-12214 30 14 those those PRON crl-12214 30 15 which which PRON crl-12214 30 16 in in ADP crl-12214 30 17 combination combination NOUN crl-12214 30 18 prove prove VERB crl-12214 30 19 most most ADV crl-12214 30 20 efficient efficient ADJ crl-12214 30 21 with with ADP crl-12214 30 22 respect respect NOUN crl-12214 30 23 to to PART crl-12214 30 24 recall recall VERB crl-12214 30 25 and and CCONJ crl-12214 30 26 precision precision NOUN crl-12214 30 27 . . PUNCT crl-12214 31 1 results result NOUN crl-12214 31 2 of of ADP crl-12214 31 3 tests test NOUN crl-12214 31 4 the the DET crl-12214 31 5 inverse inverse ADJ crl-12214 31 6 relationships relationship NOUN crl-12214 31 7 of of ADP crl-12214 31 8 recall recall NOUN crl-12214 31 9 and and CCONJ crl-12214 31 10 precision precision NOUN crl-12214 31 11 . . PUNCT crl-12214 32 1 there there PRON crl-12214 32 2 is be VERB crl-12214 32 3 general general ADJ crl-12214 32 4 agreement agreement NOUN crl-12214 32 5 that that SCONJ crl-12214 32 6 there there PRON crl-12214 32 7 is be VERB crl-12214 32 8 usually usually ADV crl-12214 32 9 an an DET crl-12214 32 10 inverse inverse ADJ crl-12214 32 11 relationship relationship NOUN crl-12214 32 12 between between ADP crl-12214 32 13 recall recall NOUN crl-12214 32 14 and and CCONJ crl-12214 32 15 precision precision NOUN crl-12214 32 16 , , PUNCT crl-12214 32 17 that that ADV crl-12214 32 18 is is ADV crl-12214 32 19 , , PUNCT crl-12214 32 20 while while SCONJ crl-12214 32 21 recall recall NOUN crl-12214 32 22 can can AUX crl-12214 32 23 be be AUX crl-12214 32 24 raised raise VERB crl-12214 32 25 to to ADP crl-12214 32 26 100 100 NUM crl-12214 32 27 percent percent NOUN crl-12214 32 28 , , PUNCT crl-12214 32 29 the the DET crl-12214 32 30 cost cost NOUN crl-12214 32 31 in in ADP crl-12214 32 32 the the DET crl-12214 32 33 number number NOUN crl-12214 32 34 of of ADP crl-12214 32 35 nonrelevant nonrelevant ADJ crl-12214 32 36 documents document NOUN crl-12214 32 37 retrieved retrieve VERB crl-12214 32 38 is be AUX crl-12214 32 39 great great ADJ crl-12214 32 40 . . PUNCT crl-12214 33 1 the the DET crl-12214 33 2 nearer near ADJ crl-12214 33 3 one one NUM crl-12214 33 4 approaches approach NOUN crl-12214 33 5 100 100 NUM crl-12214 33 6 percent percent NOUN crl-12214 33 7 recall recall NOUN crl-12214 33 8 , , PUNCT crl-12214 33 9 the the DET crl-12214 33 10 greater great ADJ crl-12214 33 11 proportionately proportionately ADV crl-12214 33 12 is be AUX crl-12214 33 13 the the DET crl-12214 33 14 drop drop NOUN crl-12214 33 15 in in ADP crl-12214 33 16 precision precision NOUN crl-12214 33 17 . . PUNCT crl-12214 34 1 automatic automatic ADJ crl-12214 34 2 indexing indexing NOUN crl-12214 34 3 . . PUNCT crl-12214 35 1 using use VERB crl-12214 35 2 smart smart ADJ crl-12214 35 3 methods method NOUN crl-12214 35 4 salton salton PROPN crl-12214 35 5 came come VERB crl-12214 35 6 to to ADP crl-12214 35 7 the the DET crl-12214 35 8 conclusion conclusion NOUN crl-12214 35 9 that that SCONJ crl-12214 35 10 , , PUNCT crl-12214 35 11 " " PUNCT crl-12214 35 12 fully fully ADV crl-12214 35 13 automatic automatic ADJ crl-12214 35 14 text text NOUN crl-12214 35 15 analysis analysis NOUN crl-12214 35 16 and and CCONJ crl-12214 35 17 search search NOUN crl-12214 35 18 systems system NOUN crl-12214 35 19 do do AUX crl-12214 35 20 not not PART crl-12214 35 21 appear appear VERB crl-12214 35 22 to to PART crl-12214 35 23 produce produce VERB crl-12214 35 24 a a DET crl-12214 35 25 retrieval retrieval NOUN crl-12214 35 26 performance performance NOUN crl-12214 35 27 which which PRON crl-12214 35 28 is be AUX crl-12214 35 29 inferior inferior ADJ crl-12214 35 30 to to ADP crl-12214 35 31 that that PRON crl-12214 35 32 obtained obtain VERB crl-12214 35 33 by by ADP crl-12214 35 34 conventional conventional ADJ crl-12214 35 35 systems system NOUN crl-12214 35 36 using use VERB crl-12214 35 37 manual manual ADJ crl-12214 35 38 document document NOUN crl-12214 35 39 indexing indexing NOUN crl-12214 35 40 and and CCONJ crl-12214 35 41 manual manual ADJ crl-12214 35 42 search search NOUN crl-12214 35 43 formulations formulation NOUN crl-12214 35 44 . . PUNCT crl-12214 35 45 " " PUNCT crl-12214 36 1 precision precision NOUN crl-12214 36 2 and and CCONJ crl-12214 36 3 recall recall NOUN crl-12214 36 4 devices device NOUN crl-12214 36 5 . . PUNCT crl-12214 37 1 precision precision NOUN crl-12214 37 2 devices device NOUN crl-12214 37 3 , , PUNCT crl-12214 37 4 except except SCONJ crl-12214 37 5 for for ADP crl-12214 37 6 coordination coordination NOUN crl-12214 37 7 , , PUNCT crl-12214 37 8 proved prove VERB crl-12214 37 9 of of ADP crl-12214 37 10 little little ADJ crl-12214 37 11 value value NOUN crl-12214 37 12 . . PUNCT crl-12214 38 1 of of ADP crl-12214 38 2 the the DET crl-12214 38 3 various various ADJ crl-12214 38 4 recall recall NOUN crl-12214 38 5 devices device NOUN crl-12214 38 6 , , PUNCT crl-12214 38 7 the the DET crl-12214 38 8 use use NOUN crl-12214 38 9 of of ADP crl-12214 38 10 synonyms synonym NOUN crl-12214 38 11 proved prove VERB crl-12214 38 12 significant significant ADJ crl-12214 38 13 , , PUNCT crl-12214 38 14 while while SCONJ crl-12214 38 15 the the DET crl-12214 38 16 hierarchical hierarchical ADJ crl-12214 38 17 ( ( PUNCT crl-12214 38 18 classified classify VERB crl-12214 38 19 ) ) PUNCT crl-12214 38 20 proved prove VERB crl-12214 38 21 less less ADV crl-12214 38 22 effective effective ADJ crl-12214 38 23 than than SCONJ crl-12214 38 24 had have AUX crl-12214 38 25 been be AUX crl-12214 38 26 supposed suppose VERB crl-12214 38 27 . . PUNCT crl-12214 39 1 at at ADP crl-12214 39 2 case case NOUN crl-12214 39 3 western western ADJ crl-12214 39 4 the the DET crl-12214 39 5 use use NOUN crl-12214 39 6 of of ADP crl-12214 39 7 role role NOUN crl-12214 39 8 indicators indicator NOUN crl-12214 39 9 proved prove VERB crl-12214 39 10 to to PART crl-12214 39 11 be be AUX crl-12214 39 12 significant significant ADJ crl-12214 39 13 only only ADV crl-12214 39 14 when when SCONJ crl-12214 39 15 the the DET crl-12214 39 16 full full ADJ crl-12214 39 17 text text NOUN crl-12214 39 18 was be AUX crl-12214 39 19 available available ADJ crl-12214 39 20 to to ADP crl-12214 39 21 the the DET crl-12214 39 22 indexers indexer NOUN crl-12214 39 23 ; ; PUNCT crl-12214 39 24 with with ADP crl-12214 39 25 abstracts abstract NOUN crl-12214 39 26 , , PUNCT crl-12214 39 27 role role NOUN crl-12214 39 28 indicators indicator NOUN crl-12214 39 29 and and CCONJ crl-12214 39 30 other other ADJ crl-12214 39 31 retrieval retrieval NOUN crl-12214 39 32 devices device NOUN crl-12214 39 33 were be AUX crl-12214 39 34 not not PART crl-12214 39 35 superior superior ADJ crl-12214 39 36 . . PUNCT crl-12214 40 1 at at ADP crl-12214 40 2 cranfield cranfield PROPN crl-12214 40 3 , , PUNCT crl-12214 40 4 the the DET crl-12214 40 5 controlled control VERB crl-12214 40 6 language language NOUN crl-12214 40 7 performance performance NOUN crl-12214 40 8 i i PRON crl-12214 40 9 j j PROPN crl-12214 40 10 1 1 NUM crl-12214 40 11 j j PROPN crl-12214 40 12 was be AUX crl-12214 40 13 not not PART crl-12214 40 14 improved improve VERB crl-12214 40 15 by by ADP crl-12214 40 16 manipulating manipulate VERB crl-12214 40 17 it it PRON crl-12214 40 18 hierarchically hierarchically ADV crl-12214 40 19 . . PUNCT crl-12214 41 1 at at ADP crl-12214 41 2 cranfield cranfield PROPN crl-12214 41 3 a a DET crl-12214 41 4 surprising surprising ADJ crl-12214 41 5 outcome outcome NOUN crl-12214 41 6 was be AUX crl-12214 41 7 the the DET crl-12214 41 8 realization realization NOUN crl-12214 41 9 that that SCONJ crl-12214 41 10 the the DET crl-12214 41 11 uncontrolled uncontrolled ADJ crl-12214 41 12 single single ADJ crl-12214 41 13 term term NOUN crl-12214 41 14 natural natural ADJ crl-12214 41 15 language language NOUN crl-12214 41 16 of of ADP crl-12214 41 17 the the DET crl-12214 41 18 text text NOUN crl-12214 41 19 was be AUX crl-12214 41 20 little little ADJ crl-12214 41 21 improved improve VERB crl-12214 41 22 by by ADP crl-12214 41 23 most most ADV crl-12214 41 24 recall recall NOUN crl-12214 41 25 or or CCONJ crl-12214 41 26 precision precision NOUN crl-12214 41 27 devices device NOUN crl-12214 41 28 . . PUNCT crl-12214 42 1 at at ADP crl-12214 42 2 cornell cornell PROPN crl-12214 42 3 , , PUNCT crl-12214 42 4 it it PRON crl-12214 42 5 was be AUX crl-12214 42 6 found find VERB crl-12214 42 7 that that SCONJ crl-12214 42 8 the the DET crl-12214 42 9 cumulative cumulative ADJ crl-12214 42 10 effect effect NOUN crl-12214 42 11 of of ADP crl-12214 42 12 all all DET crl-12214 42 13 the the DET crl-12214 42 14 dictionaries dictionary NOUN crl-12214 42 15 was be AUX crl-12214 42 16 more more ADV crl-12214 42 17 effective effective ADJ crl-12214 42 18 than than ADP crl-12214 42 19 any any DET crl-12214 42 20 lesser less ADJ crl-12214 42 21 combination combination NOUN crl-12214 42 22 . . PUNCT crl-12214 43 1 in in ADP crl-12214 43 2 summary summary NOUN crl-12214 43 3 , , PUNCT crl-12214 43 4 in in ADP crl-12214 43 5 any any DET crl-12214 43 6 system system NOUN crl-12214 43 7 a a DET crl-12214 43 8 significant significant ADJ crl-12214 43 9 recall recall NOUN crl-12214 43 10 device device NOUN crl-12214 43 11 is be AUX crl-12214 43 12 the the DET crl-12214 43 13 dictionary dictionary NOUN crl-12214 43 14 of of ADP crl-12214 43 15 synonyms synonyms PROPN crl-12214 43 16 , , PUNCT crl-12214 43 17 but but CCONJ crl-12214 43 18 the the DET crl-12214 43 19 hierarchical hierarchical ADJ crl-12214 43 20 element element NOUN crl-12214 43 21 is be AUX crl-12214 43 22 not not PART crl-12214 43 23 of of ADP crl-12214 43 24 major major ADJ crl-12214 43 25 significance significance NOUN crl-12214 43 26 . . PUNCT crl-12214 44 1 coordination coordination NOUN crl-12214 44 2 is be AUX crl-12214 44 3 a a DET crl-12214 44 4 powerful powerful ADJ crl-12214 44 5 retrieval retrieval NOUN crl-12214 44 6 procedure procedure NOUN crl-12214 44 7 . . PUNCT crl-12214 45 1 controlled control VERB crl-12214 45 2 languages language NOUN crl-12214 45 3 . . PUNCT crl-12214 46 1 at at ADP crl-12214 46 2 cranfield cranfield PROPN crl-12214 46 3 , , PUNCT crl-12214 46 4 a a DET crl-12214 46 5 rank rank NOUN crl-12214 46 6 order order NOUN crl-12214 46 7 of of ADP crl-12214 46 8 thirty thirty NUM crl-12214 46 9 - - PUNCT crl-12214 46 10 three three NUM crl-12214 46 11 indexing indexing NOUN crl-12214 46 12 languages language NOUN crl-12214 46 13 and and CCONJ crl-12214 46 14 devices device NOUN crl-12214 46 15 was be AUX crl-12214 46 16 published publish VERB crl-12214 46 17 , , PUNCT crl-12214 46 18 indicating indicate VERB crl-12214 46 19 their their PRON crl-12214 46 20 power power NOUN crl-12214 46 21 of of ADP crl-12214 46 22 recall recall NOUN crl-12214 46 23 . . PUNCT crl-12214 47 1 the the DET crl-12214 47 2 top top ADJ crl-12214 47 3 seven seven NUM crl-12214 47 4 languages language NOUN crl-12214 47 5 were be AUX crl-12214 47 6 all all ADV crl-12214 47 7 uncontrolled uncontrolle VERB crl-12214 47 8 . . PUNCT crl-12214 48 1 the the DET crl-12214 48 2 best well ADV crl-12214 48 3 controlled control VERB crl-12214 48 4 language language NOUN crl-12214 48 5 ranked rank VERB crl-12214 48 6 tenth tenth ADV crl-12214 48 7 ; ; PUNCT crl-12214 48 8 its its PRON crl-12214 48 9 recall recall NOUN crl-12214 48 10 ratio ratio NOUN crl-12214 48 11 was be AUX crl-12214 48 12 61 61 NUM crl-12214 48 13 percent percent NOUN crl-12214 48 14 compared compare VERB crl-12214 48 15 to to ADP crl-12214 48 16 65 65 NUM crl-12214 48 17 percent percent NOUN crl-12214 48 18 for for ADP crl-12214 48 19 the the DET crl-12214 48 20 best good ADJ crl-12214 48 21 of of ADP crl-12214 48 22 the the DET crl-12214 48 23 uncontrolled uncontrolled ADJ crl-12214 48 24 languages language NOUN crl-12214 48 25 . . PUNCT crl-12214 49 1 the the DET crl-12214 49 2 statistical statistical ADJ crl-12214 49 3 difference difference NOUN crl-12214 49 4 between between ADP crl-12214 49 5 them they PRON crl-12214 49 6 is be AUX crl-12214 49 7 regarded regard VERB crl-12214 49 8 as as ADV crl-12214 49 9 significant significant ADJ crl-12214 49 10 . . PUNCT crl-12214 50 1 some some DET crl-12214 50 2 observations observation NOUN crl-12214 50 3 from from ADP crl-12214 50 4 the the DET crl-12214 50 5 managerial managerial ADJ crl-12214 50 6 point point NOUN crl-12214 50 7 of of ADP crl-12214 50 8 view view NOUN crl-12214 50 9 cost cost NOUN crl-12214 50 10 factors factor NOUN crl-12214 50 11 . . PUNCT crl-12214 51 1 information information NOUN crl-12214 51 2 scientists scientist NOUN crl-12214 51 3 have have AUX crl-12214 51 4 not not PART crl-12214 51 5 seriously seriously ADV crl-12214 51 6 attacked attack VERB crl-12214 51 7 the the DET crl-12214 51 8 question question NOUN crl-12214 51 9 of of ADP crl-12214 51 10 the the DET crl-12214 51 11 cost cost NOUN crl-12214 51 12 of of ADP crl-12214 51 13 the the DET crl-12214 51 14 various various ADJ crl-12214 51 15 indexing indexing NOUN crl-12214 51 16 languages.4 languages.4 NOUN crl-12214 51 17 it it PRON crl-12214 51 18 would would AUX crl-12214 51 19 appear appear VERB crl-12214 51 20 , , PUNCT crl-12214 51 21 given give VERB crl-12214 51 22 the the DET crl-12214 51 23 emphasis emphasis NOUN crl-12214 51 24 placed place VERB crl-12214 51 25 on on ADP crl-12214 51 26 the the DET crl-12214 51 27 indexing indexing NOUN crl-12214 51 28 languages language NOUN crl-12214 51 29 at at ADP crl-12214 51 30 cranfield cranfield NOUN crl-12214 51 31 and and CCONJ crl-12214 51 32 the the DET crl-12214 51 33 search search NOUN crl-12214 51 34 strategy strategy NOUN crl-12214 51 35 at at ADP crl-12214 51 36 western western PROPN crl-12214 51 37 reserve reserve PROPN crl-12214 51 38 , , PUNCT crl-12214 51 39 that that SCONJ crl-12214 51 40 a a DET crl-12214 51 41 number number NOUN crl-12214 51 42 of of ADP crl-12214 51 43 those those PRON crl-12214 51 44 engaged engage VERB crl-12214 51 45 in in ADP crl-12214 51 46 the the DET crl-12214 51 47 testing testing NOUN crl-12214 51 48 were be AUX crl-12214 51 49 probably probably ADV crl-12214 51 50 well well ADV crl-12214 51 51 acquainted acquaint VERB crl-12214 51 52 with with ADP crl-12214 51 53 the the DET crl-12214 51 54 subject subject ADJ crl-12214 51 55 matter matter NOUN crl-12214 51 56 of of ADP crl-12214 51 57 the the DET crl-12214 51 58 tests test NOUN crl-12214 51 59 . . PUNCT crl-12214 52 1 despite despite SCONJ crl-12214 52 2 this this PRON crl-12214 52 3 , , PUNCT crl-12214 52 4 saracevic saracevic PROPN crl-12214 52 5 reported report VERB crl-12214 52 6 that that SCONJ crl-12214 52 7 the the DET crl-12214 52 8 single single ADJ crl-12214 52 9 greatest great ADJ crl-12214 52 10 and and CCONJ crl-12214 52 11 most most ADV crl-12214 52 12 important important ADJ crl-12214 52 13 variable variable NOUN crl-12214 52 14 was be AUX crl-12214 52 15 the the DET crl-12214 52 16 quality quality NOUN crl-12214 52 17 of of ADP crl-12214 52 18 the the DET crl-12214 52 19 indexing indexing NOUN crl-12214 52 20 . . PUNCT crl-12214 53 1 a a DET crl-12214 53 2 study study NOUN crl-12214 53 3 of of ADP crl-12214 53 4 medlar medlar ADJ crl-12214 53 5 failures failure NOUN crl-12214 53 6 shows show VERB crl-12214 53 7 that that SCONJ crl-12214 53 8 with with ADP crl-12214 53 9 respect respect NOUN crl-12214 53 10 to to PART crl-12214 53 11 recall recall VERB crl-12214 53 12 , , PUNCT crl-12214 53 13 72 72 NUM crl-12214 53 14 percent percent NOUN crl-12214 53 15 of of ADP crl-12214 53 16 the the DET crl-12214 53 17 failures failure NOUN crl-12214 53 18 can can AUX crl-12214 53 19 be be AUX crl-12214 53 20 attributed attribute VERB crl-12214 53 21 to to ADP crl-12214 53 22 faulty faulty ADJ crl-12214 53 23 indexing indexing NOUN crl-12214 53 24 or or CCONJ crl-12214 53 25 to to ADP crl-12214 53 26 faulty faulty ADJ crl-12214 53 27 search search NOUN crl-12214 53 28 strategy strategy NOUN crl-12214 53 29 , , PUNCT crl-12214 53 30 while while SCONJ crl-12214 53 31 with with ADP crl-12214 53 32 respect respect NOUN crl-12214 53 33 to to PART crl-12214 53 34 precision precision VERB crl-12214 53 35 the the DET crl-12214 53 36 number number NOUN crl-12214 53 37 attributable attributable ADJ crl-12214 53 38 to to ADP crl-12214 53 39 these these DET crl-12214 53 40 two two NUM crl-12214 53 41 factors factor NOUN crl-12214 53 42 was be AUX crl-12214 53 43 45 45 NUM crl-12214 53 44 perc perc NOUN crl-12214 53 45 nt not PART crl-12214 53 46 from from ADP crl-12214 53 47 these these DET crl-12214 53 48 bits bit NOUN crl-12214 53 49 of of ADP crl-12214 53 50 evidence evidence NOUN crl-12214 53 51 the the DET crl-12214 53 52 relative relative ADJ crl-12214 53 53 insignificance insignificance NOUN crl-12214 53 54 of of ADP crl-12214 53 55 information information NOUN crl-12214 53 56 retrieval retrieval NOUN crl-12214 53 57 i i PRON crl-12214 53 58 171 171 NUM crl-12214 53 59 the the DET crl-12214 53 60 indexing indexing NOUN crl-12214 53 61 system system NOUN crl-12214 53 62 and and CCONJ crl-12214 53 63 language language NOUN crl-12214 53 64 , , PUNCT crl-12214 53 65 compared compare VERB crl-12214 53 66 to to ADP crl-12214 53 67 the the DET crl-12214 53 68 indexing indexing NOUN crl-12214 53 69 itself itself PRON crl-12214 53 70 , , PUNCT crl-12214 53 71 and and CCONJ crl-12214 53 72 the the DET crl-12214 53 73 imaginativeness imaginativeness NOUN crl-12214 53 74 of of ADP crl-12214 53 75 the the DET crl-12214 53 76 search search NOUN crl-12214 53 77 strategy strategy NOUN crl-12214 53 78 , , PUNCT crl-12214 53 79 rises rise VERB crl-12214 53 80 to to PART crl-12214 53 81 haunt haunt VERB crl-12214 53 82 us we PRON crl-12214 53 83 . . PUNCT crl-12214 54 1 furthermore furthermore ADV crl-12214 54 2 , , PUNCT crl-12214 54 3 realizing realize VERB crl-12214 54 4 that that SCONJ crl-12214 54 5 automatic automatic ADJ crl-12214 54 6 indexing indexing NOUN crl-12214 54 7 is be AUX crl-12214 54 8 not not PART crl-12214 54 9 now now ADV crl-12214 54 10 superior superior ADJ crl-12214 54 11 to to ADP crl-12214 54 12 manual manual ADJ crl-12214 54 13 indexing indexing NOUN crl-12214 54 14 , , PUNCT crl-12214 54 15 and and CCONJ crl-12214 54 16 guessing guess VERB crl-12214 54 17 at at ADP crl-12214 54 18 the the DET crl-12214 54 19 cost cost NOUN crl-12214 54 20 of of ADP crl-12214 54 21 this this DET crl-12214 54 22 kind kind NOUN crl-12214 54 23 of of ADP crl-12214 54 24 indexing indexing NOUN crl-12214 54 25 , , PUNCT crl-12214 54 26 the the DET crl-12214 54 27 prospects prospect NOUN crl-12214 54 28 are be AUX crl-12214 54 29 anything anything PRON crl-12214 54 30 but but CCONJ crl-12214 54 31 bright bright ADJ crl-12214 54 32 . . PUNCT crl-12214 55 1 depth depth NOUN crl-12214 55 2 of of ADP crl-12214 55 3 indexing indexing NOUN crl-12214 55 4 . . PUNCT crl-12214 56 1 also also ADV crl-12214 56 2 significant significant ADJ crl-12214 56 3 is be AUX crl-12214 56 4 the the DET crl-12214 56 5 considerable considerable ADJ crl-12214 56 6 depth depth NOUN crl-12214 56 7 of of ADP crl-12214 56 8 indexing indexing NOUN crl-12214 56 9 employed employ VERB crl-12214 56 10 in in ADP crl-12214 56 11 these these DET crl-12214 56 12 tests test NOUN crl-12214 56 13 , , PUNCT crl-12214 56 14 depth depth VERB crl-12214 56 15 considerably considerably ADV crl-12214 56 16 greater great ADJ crl-12214 56 17 than than SCONJ crl-12214 56 18 is be AUX crl-12214 56 19 provided provide VERB crl-12214 56 20 by by ADP crl-12214 56 21 conventional conventional ADJ crl-12214 56 22 subject subject ADJ crl-12214 56 23 catalogers cataloger NOUN crl-12214 56 24 . . PUNCT crl-12214 57 1 at at ADP crl-12214 57 2 western western PROPN crl-12214 57 3 reserve reserve PROPN crl-12214 57 4 , , PUNCT crl-12214 57 5 the the DET crl-12214 57 6 num num ADJ crl-12214 57 7 her she PRON crl-12214 57 8 of of ADP crl-12214 57 9 indexing indexing NOUN crl-12214 57 10 terms term NOUN crl-12214 57 11 extracted extract VERB crl-12214 57 12 from from ADP crl-12214 57 13 the the DET crl-12214 57 14 full full ADJ crl-12214 57 15 text text NOUN crl-12214 57 16 ranged range VERB crl-12214 57 17 from from ADP crl-12214 57 18 thirty thirty NUM crl-12214 57 19 - - PUNCT crl-12214 57 20 six six NUM crl-12214 57 21 to to PART crl-12214 57 22 forty forty NUM crl-12214 57 23 , , PUNCT crl-12214 57 24 while while SCONJ crl-12214 57 25 twenty twenty NUM crl-12214 57 26 - - PUNCT crl-12214 57 27 three three NUM crl-12214 57 28 to to PART crl-12214 57 29 thirty thirty NUM crl-12214 57 30 were be AUX crl-12214 57 31 taken take VERB crl-12214 57 32 from from ADP crl-12214 57 33 the the DET crl-12214 57 34 abstracts abstract NOUN crl-12214 57 35 . . PUNCT crl-12214 58 1 the the DET crl-12214 58 2 significance significance NOUN crl-12214 58 3 of of ADP crl-12214 58 4 the the DET crl-12214 58 5 depth depth NOUN crl-12214 58 6 of of ADP crl-12214 58 7 indexing indexing NOUN crl-12214 58 8 can can AUX crl-12214 58 9 be be AUX crl-12214 58 10 seen see VERB crl-12214 58 11 in in ADP crl-12214 58 12 the the DET crl-12214 58 13 statistics statistic NOUN crl-12214 58 14 supplied supply VERB crl-12214 58 15 by by ADP crl-12214 58 16 cranfield cranfield NOUN crl-12214 58 17 in in ADP crl-12214 58 18 tests test NOUN crl-12214 58 19 run run VERB crl-12214 58 20 on on ADP crl-12214 58 21 the the DET crl-12214 58 22 single single ADJ crl-12214 58 23 - - PUNCT crl-12214 58 24 term term NOUN crl-12214 58 25 , , PUNCT crl-12214 58 26 natural natural ADJ crl-12214 58 27 language language NOUN crl-12214 58 28 indexing indexing NOUN crl-12214 58 29 language language NOUN crl-12214 58 30 : : PUNCT crl-12214 58 31 with with ADP crl-12214 58 32 fourteen fourteen NUM crl-12214 58 33 index index NOUN crl-12214 58 34 terms term NOUN crl-12214 58 35 , , PUNCT crl-12214 58 36 the the DET crl-12214 58 37 recall recall NOUN crl-12214 58 38 ratio ratio NOUN crl-12214 58 39 was be AUX crl-12214 58 40 62.8 62.8 NUM crl-12214 58 41 ; ; PUNCT crl-12214 58 42 twenty twenty NUM crl-12214 58 43 - - PUNCT crl-12214 58 44 two two NUM crl-12214 58 45 terms term NOUN crl-12214 58 46 produced produce VERB crl-12214 58 47 a a DET crl-12214 58 48 ratio ratio NOUN crl-12214 58 49 of of ADP crl-12214 58 50 63.5 63.5 NUM crl-12214 58 51 ; ; PUNCT crl-12214 58 52 and and CCONJ crl-12214 58 53 thirty thirty NUM crl-12214 58 54 - - PUNCT crl-12214 58 55 three three NUM crl-12214 58 56 terms term NOUN crl-12214 58 57 produced produce VERB crl-12214 58 58 a a DET crl-12214 58 59 ratio ratio NOUN crl-12214 58 60 of of ADP crl-12214 58 61 65 65 NUM crl-12214 58 62 . . PUNCT crl-12214 59 1 however however ADV crl-12214 59 2 , , PUNCT crl-12214 59 3 there there PRON crl-12214 59 4 is be VERB crl-12214 59 5 a a DET crl-12214 59 6 law law NOUN crl-12214 59 7 of of ADP crl-12214 59 8 diminishing diminish VERB crl-12214 59 9 returns return NOUN crl-12214 59 10 with with ADP crl-12214 59 11 respect respect NOUN crl-12214 59 12 to to ADP crl-12214 59 13 the the DET crl-12214 59 14 depth depth NOUN crl-12214 59 15 of of ADP crl-12214 59 16 indexing indexing NOUN crl-12214 59 17 . . PUNCT crl-12214 60 1 when when SCONJ crl-12214 60 2 an an DET crl-12214 60 3 average average NOUN crl-12214 60 4 of of ADP crl-12214 60 5 sixty sixty NUM crl-12214 60 6 terms term NOUN crl-12214 60 7 were be AUX crl-12214 60 8 taken take VERB crl-12214 60 9 from from ADP crl-12214 60 10 abstracts abstract NOUN crl-12214 60 11 , , PUNCT crl-12214 60 12 the the DET crl-12214 60 13 recall recall NOUN crl-12214 60 14 ratio ratio NOUN crl-12214 60 15 dropped drop VERB crl-12214 60 16 to to ADP crl-12214 60 17 60.9 60.9 NUM crl-12214 60 18 . . PUNCT crl-12214 61 1 au.tomatic au.tomatic ADJ crl-12214 61 2 indexing indexing NOUN crl-12214 61 3 . . PUNCT crl-12214 62 1 turning turn VERB crl-12214 62 2 to to ADP crl-12214 62 3 automatic automatic ADJ crl-12214 62 4 indexing indexing NOUN crl-12214 62 5 , , PUNCT crl-12214 62 6 of of ADP crl-12214 62 7 considerable considerable ADJ crl-12214 62 8 significance significance NOUN crl-12214 62 9 from from ADP crl-12214 62 10 the the DET crl-12214 62 11 managerial managerial ADJ crl-12214 62 12 point point NOUN crl-12214 62 13 of of ADP crl-12214 62 14 view view NOUN crl-12214 62 15 is be AUX crl-12214 62 16 the the DET crl-12214 62 17 fact fact NOUN crl-12214 62 18 that that SCONJ crl-12214 62 19 the the DET crl-12214 62 20 intellectual intellectual ADJ crl-12214 62 21 effort effort NOUN crl-12214 62 22 required require VERB crl-12214 62 23 is be AUX crl-12214 62 24 considerable considerable ADJ crl-12214 62 25 and and CCONJ crl-12214 62 26 of of ADP crl-12214 62 27 great great ADJ crl-12214 62 28 significance significance NOUN crl-12214 62 29 with with ADP crl-12214 62 30 respect respect NOUN crl-12214 62 31 to to ADP crl-12214 62 32 the the DET crl-12214 62 33 results result NOUN crl-12214 62 34 . . PUNCT crl-12214 63 1 in in ADP crl-12214 63 2 the the DET crl-12214 63 3 absence absence NOUN crl-12214 63 4 of of ADP crl-12214 63 5 a a DET crl-12214 63 6 good good ADJ crl-12214 63 7 dictionary dictionary NOUN crl-12214 63 8 of of ADP crl-12214 63 9 synonyms synonyms PROPN crl-12214 63 10 , , PUNCT crl-12214 63 11 the the DET crl-12214 63 12 results result NOUN crl-12214 63 13 can can AUX crl-12214 63 14 be be AUX crl-12214 63 15 disappointing disappointing ADJ crl-12214 63 16 , , PUNCT crl-12214 63 17 while while SCONJ crl-12214 63 18 the the DET crl-12214 63 19 time time NOUN crl-12214 63 20 required require VERB crl-12214 63 21 to to PART crl-12214 63 22 compose compose VERB crl-12214 63 23 a a DET crl-12214 63 24 dictionary dictionary NOUN crl-12214 63 25 is be AUX crl-12214 63 26 an an DET crl-12214 63 27 imposing impose VERB crl-12214 63 28 consideration consideration NOUN crl-12214 63 29 , , PUNCT crl-12214 63 30 as as SCONJ crl-12214 63 31 salton salton PROPN crl-12214 63 32 has have AUX crl-12214 63 33 noted note VERB crl-12214 63 34 . . PUNCT crl-12214 64 1 on on ADP crl-12214 64 2 the the DET crl-12214 64 3 average average NOUN crl-12214 64 4 , , PUNCT crl-12214 64 5 using use VERB crl-12214 64 6 all all DET crl-12214 64 7 the the DET crl-12214 64 8 devices device NOUN crl-12214 64 9 available available ADJ crl-12214 64 10 , , PUNCT crl-12214 64 11 smart smart ADJ crl-12214 64 12 performs perform NOUN crl-12214 64 13 as as SCONJ crl-12214 64 14 follows follow VERB crl-12214 64 15 : : PUNCT crl-12214 64 16 recall recall VERB crl-12214 64 17 precision precision NOUN crl-12214 64 18 ratio ratio NOUN crl-12214 64 19 ratio ratio NOUN crl-12214 64 20 10 10 NUM crl-12214 64 21 85 85 NUM crl-12214 64 22 - - SYM crl-12214 64 23 95 95 NUM crl-12214 64 24 50 50 NUM crl-12214 64 25 60 60 NUM crl-12214 64 26 - - SYM crl-12214 64 27 80 80 NUM crl-12214 64 28 100 100 NUM crl-12214 64 29 30 30 NUM crl-12214 64 30 - - SYM crl-12214 64 31 45 45 NUM crl-12214 64 32 172 172 NUM crl-12214 64 33 i i PROPN crl-12214 64 34 college college PROPN crl-12214 64 35 & & CCONJ crl-12214 64 36 research research PROPN crl-12214 64 37 libraries library NOUN crl-12214 64 38 • • INTJ crl-12214 64 39 may may AUX crl-12214 64 40 1970 1970 NUM crl-12214 64 41 as as SCONJ crl-12214 64 42 salton salton VERB crl-12214 64 43 himself himself PRON crl-12214 64 44 has have AUX crl-12214 64 45 admitted admit VERB crl-12214 64 46 , , PUNCT crl-12214 64 47 these these PRON crl-12214 64 48 are be AUX crl-12214 64 49 not not PART crl-12214 64 50 satisfactory satisfactory ADJ crl-12214 64 51 levels level NOUN crl-12214 64 52 of of ADP crl-12214 64 53 performance performance NOUN crl-12214 64 54 . . PUNCT crl-12214 65 1 coordinate coordinate VERB crl-12214 65 2 indexing indexing NOUN crl-12214 65 3 . . PUNCT crl-12214 66 1 the the DET crl-12214 66 2 first first ADJ crl-12214 66 3 cranfield cranfield NOUN crl-12214 66 4 study study NOUN crl-12214 66 5 ( ( PUNCT crl-12214 66 6 1962 1962 NUM crl-12214 66 7 ) ) PUNCT crl-12214 66 8 tested test VERB crl-12214 66 9 four four NUM crl-12214 66 10 indexing indexing NOUN crl-12214 66 11 systems system NOUN crl-12214 66 12 , , PUNCT crl-12214 66 13 of of ADP crl-12214 66 14 which which PRON crl-12214 66 15 one one NOUN crl-12214 66 16 was be AUX crl-12214 66 17 a a DET crl-12214 66 18 coordinate coordinate NOUN crl-12214 66 19 system system NOUN crl-12214 66 20 , , PUNCT crl-12214 66 21 best well ADV crl-12214 66 22 known know VERB crl-12214 66 23 as as ADP crl-12214 66 24 uniterms uniterm NOUN crl-12214 66 25 . . PUNCT crl-12214 67 1 as as SCONJ crl-12214 67 2 summarized summarize VERB crl-12214 67 3 by by ADP crl-12214 67 4 cleverdon cleverdon PROPN crl-12214 67 5 , , PUNCT crl-12214 67 6 " " PUNCT crl-12214 67 7 it it PRON crl-12214 67 8 achieved achieve VERB crl-12214 67 9 the the DET crl-12214 67 10 best good ADJ crl-12214 67 11 overall overall ADJ crl-12214 67 12 figures figure NOUN crl-12214 67 13 in in ADP crl-12214 67 14 the the DET crl-12214 67 15 test test NOUN crl-12214 67 16 , , PUNCT crl-12214 67 17 it it PRON crl-12214 67 18 presented present VERB crl-12214 67 19 no no DET crl-12214 67 20 difficulties difficulty NOUN crl-12214 67 21 for for ADP crl-12214 67 22 the the DET crl-12214 67 23 technical technical ADJ crl-12214 67 24 searchers searcher NOUN crl-12214 67 25 ... ... PUNCT crl-12214 67 26 and and CCONJ crl-12214 67 27 was be AUX crl-12214 67 28 notably notably ADV crl-12214 67 29 successful successful ADJ crl-12214 67 30 with with ADP crl-12214 67 31 short short ADJ crl-12214 67 32 indexing indexing NOUN crl-12214 67 33 times time NOUN crl-12214 67 34 . . PUNCT crl-12214 68 1 it it PRON crl-12214 68 2 appears appear VERB crl-12214 68 3 to to PART crl-12214 68 4 have have VERB crl-12214 68 5 as as ADV crl-12214 68 6 good good ADJ crl-12214 68 7 a a DET crl-12214 68 8 relevance relevance NOUN crl-12214 68 9 figure figure NOUN crl-12214 68 10 as as ADP crl-12214 68 11 any any DET crl-12214 68 12 other other ADJ crl-12214 68 13 system system NOUN crl-12214 68 14 . . PUNCT crl-12214 68 15 " " PUNCT crl-12214 69 1 nevertheless nevertheless ADV crl-12214 69 2 , , PUNCT crl-12214 69 3 the the DET crl-12214 69 4 cranfield cranfield NOUN crl-12214 69 5 group group NOUN crl-12214 69 6 refuses refuse VERB crl-12214 69 7 to to PART crl-12214 69 8 concede concede VERB crl-12214 69 9 any any DET crl-12214 69 10 natural natural ADJ crl-12214 69 11 advantage advantage NOUN crl-12214 69 12 to to ADP crl-12214 69 13 uniterms uniterm NOUN crl-12214 69 14 ( ( PUNCT crl-12214 69 15 a a DET crl-12214 69 16 '' '' PUNCT crl-12214 69 17 post post ADJ crl-12214 69 18 - - ADJ crl-12214 69 19 coordinate coordinate ADJ crl-12214 69 20 " " PUNCT crl-12214 69 21 system system NOUN crl-12214 69 22 ) ) PUNCT crl-12214 69 23 over over ADP crl-12214 69 24 the the DET crl-12214 69 25 others other NOUN crl-12214 69 26 tested test VERB crl-12214 69 27 ( ( PUNCT crl-12214 69 28 the the DET crl-12214 69 29 " " PUNCT crl-12214 69 30 precoordinate precoordinate ADJ crl-12214 69 31 " " PUNCT crl-12214 69 32 types type NOUN crl-12214 69 33 ) ) PUNCT crl-12214 69 34 . . PUNCT crl-12214 70 1 the the DET crl-12214 70 2 capability capability NOUN crl-12214 70 3 of of ADP crl-12214 70 4 retrieving retrieve VERB crl-12214 70 5 any any DET crl-12214 70 6 combination combination NOUN crl-12214 70 7 of of ADP crl-12214 70 8 terms term NOUN crl-12214 70 9 is be AUX crl-12214 70 10 a a DET crl-12214 70 11 feature feature NOUN crl-12214 70 12 of of ADP crl-12214 70 13 a a DET crl-12214 70 14 post post ADJ crl-12214 70 15 - - ADJ crl-12214 70 16 coordinate coordinate ADJ crl-12214 70 17 system system NOUN crl-12214 70 18 , , PUNCT crl-12214 70 19 yet yet CCONJ crl-12214 70 20 « « SPACE crl-12214 70 21 the the DET crl-12214 70 22 results result NOUN crl-12214 70 23 of of ADP crl-12214 70 24 the the DET crl-12214 70 25 investigation investigation NOUN crl-12214 70 26 show show VERB crl-12214 70 27 that that SCONJ crl-12214 70 28 this this DET crl-12214 70 29 advantage advantage NOUN crl-12214 70 30 , , PUNCT crl-12214 70 31 though though SCONJ crl-12214 70 32 it it PRON crl-12214 70 33 existed exist VERB crl-12214 70 34 , , PUNCT crl-12214 70 35 was be AUX crl-12214 70 36 not not PART crl-12214 70 37 large large ADJ crl-12214 70 38 . . PUNCT crl-12214 70 39 " " PUNCT crl-12214 71 1 also also ADV crl-12214 71 2 : : PUNCT crl-12214 71 3 " " PUNCT crl-12214 71 4 the the DET crl-12214 71 5 difference difference NOUN crl-12214 71 6 between between ADP crl-12214 71 7 the the DET crl-12214 71 8 two two NUM crl-12214 71 9 types type NOUN crl-12214 71 10 of of ADP crl-12214 71 11 system system NOUN crl-12214 71 12 is be AUX crl-12214 71 13 therefore therefore ADV crl-12214 71 14 shown show VERB crl-12214 71 15 to to PART crl-12214 71 16 be be AUX crl-12214 71 17 not not PART crl-12214 71 18 a a DET crl-12214 71 19 fundamental fundamental ADJ crl-12214 71 20 difference difference NOUN crl-12214 71 21 but but CCONJ crl-12214 71 22 merely merely ADV crl-12214 71 23 one one NUM crl-12214 71 24 of of ADP crl-12214 71 25 cost cost NOUN crl-12214 71 26 or or CCONJ crl-12214 71 27 convenience convenience NOUN crl-12214 71 28 , , PUNCT crl-12214 71 29 and and CCONJ crl-12214 71 30 it it PRON crl-12214 71 31 has have AUX crl-12214 71 32 not not PART crl-12214 71 33 been be AUX crl-12214 71 34 proven prove VERB crl-12214 71 35 as as ADV crl-12214 71 36 yet yet ADV crl-12214 71 37 on on ADP crl-12214 71 38 which which DET crl-12214 71 39 side side NOUN crl-12214 71 40 the the DET crl-12214 71 41 advantage advantage NOUN crl-12214 71 42 lies lie VERB crl-12214 71 43 . . PUNCT crl-12214 71 44 "5 "5 PUNCT crl-12214 72 1 it it PRON crl-12214 72 2 should should AUX crl-12214 72 3 be be AUX crl-12214 72 4 made make VERB crl-12214 72 5 clear clear ADJ crl-12214 72 6 in in ADP crl-12214 72 7 this this DET crl-12214 72 8 connection connection NOUN crl-12214 72 9 that that SCONJ crl-12214 72 10 the the DET crl-12214 72 11 uniterm uniterm NOUN crl-12214 72 12 index index NOUN crl-12214 72 13 system system NOUN crl-12214 72 14 tested test VERB crl-12214 72 15 at at ADP crl-12214 72 16 cranfield cranfield PROPN crl-12214 72 17 was be AUX crl-12214 72 18 devoid devoid ADJ crl-12214 72 19 of of ADP crl-12214 72 20 various various ADJ crl-12214 72 21 precision precision NOUN crl-12214 72 22 devices device NOUN crl-12214 72 23 which which PRON crl-12214 72 24 are be AUX crl-12214 72 25 a a DET crl-12214 72 26 feature feature NOUN crl-12214 72 27 of of ADP crl-12214 72 28 other other ADJ crl-12214 72 29 coordinate coordinate NOUN crl-12214 72 30 indexing indexing NOUN crl-12214 72 31 systems system NOUN crl-12214 72 32 ( ( PUNCT crl-12214 72 33 such such ADJ crl-12214 72 34 as as ADP crl-12214 72 35 the the DET crl-12214 72 36 metallurgical metallurgical ADJ crl-12214 72 37 index index NOUN crl-12214 72 38 at at ADP crl-12214 72 39 case case NOUN crl-12214 72 40 western western PROPN crl-12214 72 41 reserve reserve PROPN crl-12214 72 42 ) ) PUNCT crl-12214 72 43 . . PUNCT crl-12214 73 1 in in ADP crl-12214 73 2 the the DET crl-12214 73 3 presence presence NOUN crl-12214 73 4 of of ADP crl-12214 73 5 such such ADJ crl-12214 73 6 precision precision NOUN crl-12214 73 7 devices device NOUN crl-12214 73 8 , , PUNCT crl-12214 73 9 the the DET crl-12214 73 10 recall recall NOUN crl-12214 73 11 ratio ratio NOUN crl-12214 73 12 found find VERB crl-12214 73 13 at at ADP crl-12214 73 14 cranfield cranfield PROPN crl-12214 73 15 presumably presumably ADV crl-12214 73 16 would would AUX crl-12214 73 17 have have AUX crl-12214 73 18 been be AUX crl-12214 73 19 lowered lower VERB crl-12214 73 20 . . PUNCT crl-12214 74 1 the the DET crl-12214 74 2 argument argument NOUN crl-12214 74 3 has have AUX crl-12214 74 4 been be AUX crl-12214 74 5 made make VERB crl-12214 74 6 that that SCONJ crl-12214 74 7 a a DET crl-12214 74 8 uniterm uniterm NOUN crl-12214 74 9 system system NOUN crl-12214 74 10 will will AUX crl-12214 74 11 break break VERB crl-12214 74 12 down down ADP crl-12214 74 13 if if SCONJ crl-12214 74 14 used use VERB crl-12214 74 15 with with ADP crl-12214 74 16 a a DET crl-12214 74 17 large large ADJ crl-12214 74 18 collection collection NOUN crl-12214 74 19 of of ADP crl-12214 74 20 documents document NOUN crl-12214 74 21 . . PUNCT crl-12214 75 1 6 6 NUM crl-12214 75 2 cleverdon cleverdon PROPN crl-12214 75 3 disputes dispute VERB crl-12214 75 4 this this PRON crl-12214 75 5 , , PUNCT crl-12214 75 6 though though SCONJ crl-12214 75 7 neither neither DET crl-12214 75 8 disputant disputant NOUN crl-12214 75 9 can can AUX crl-12214 75 10 argue argue VERB crl-12214 75 11 from from ADP crl-12214 75 12 experience experience NOUN crl-12214 75 13 . . PUNCT crl-12214 76 1 still still ADV crl-12214 76 2 another another DET crl-12214 76 3 theoretical theoretical ADJ crl-12214 76 4 argument argument NOUN crl-12214 76 5 against against ADP crl-12214 76 6 the the DET crl-12214 76 7 u u PROPN crl-12214 76 8 niterm niterm NOUN crl-12214 76 9 system system NOUN crl-12214 76 10 is be AUX crl-12214 76 11 that that SCONJ crl-12214 76 12 it it PRON crl-12214 76 13 might might AUX crl-12214 76 14 prove prove VERB crl-12214 76 15 less less ADV crl-12214 76 16 effective effective ADJ crl-12214 76 17 with with ADP crl-12214 76 18 social social ADJ crl-12214 76 19 science science NOUN crl-12214 76 20 and and CCONJ crl-12214 76 21 humanistic humanistic ADJ crl-12214 76 22 materials material NOUN crl-12214 76 23 than than ADP crl-12214 76 24 with with ADP crl-12214 76 25 materials material NOUN crl-12214 76 26 in in ADP crl-12214 76 27 the the DET crl-12214 76 28 natural natural ADJ crl-12214 76 29 sciences science NOUN crl-12214 76 30 . . PUNCT crl-12214 77 1 computer computer NOUN crl-12214 77 2 manipulation manipulation NOUN crl-12214 77 3 of of ADP crl-12214 77 4 a a DET crl-12214 77 5 manualbased manualbase VERB crl-12214 77 6 system system NOUN crl-12214 77 7 . . PUNCT crl-12214 78 1 such such DET crl-12214 78 2 a a DET crl-12214 78 3 system system NOUN crl-12214 78 4 is be AUX crl-12214 78 5 medlars medlar NOUN crl-12214 78 6 ; ; PUNCT crl-12214 78 7 it it PRON crl-12214 78 8 is be AUX crl-12214 78 9 not not PART crl-12214 78 10 an an DET crl-12214 78 11 automatic automatic ADJ crl-12214 78 12 system system NOUN crl-12214 78 13 in in ADP crl-12214 78 14 the the DET crl-12214 78 15 sense sense NOUN crl-12214 78 16 of of ADP crl-12214 78 17 the the DET crl-12214 78 18 smart smart ADJ crl-12214 78 19 system system NOUN crl-12214 78 20 . . PUNCT crl-12214 79 1 in in ADP crl-12214 79 2 the the DET crl-12214 79 3 medlars medlar NOUN crl-12214 79 4 system system NOUN crl-12214 79 5 , , PUNCT crl-12214 79 6 other other ADJ crl-12214 79 7 than than ADP crl-12214 79 8 the the DET crl-12214 79 9 machine machine NOUN crl-12214 79 10 search search NOUN crl-12214 79 11 itself itself PRON crl-12214 79 12 , , PUNCT crl-12214 79 13 the the DET crl-12214 79 14 indexing indexing NOUN crl-12214 79 15 operations operation NOUN crl-12214 79 16 are be AUX crl-12214 79 17 performed perform VERB crl-12214 79 18 manually manually ADV crl-12214 79 19 . . PUNCT crl-12214 80 1 the the DET crl-12214 80 2 medlars medlar NOUN crl-12214 80 3 system system NOUN crl-12214 80 4 , , PUNCT crl-12214 80 5 on on ADP crl-12214 80 6 the the DET crl-12214 80 7 average average ADJ crl-12214 80 8 , , PUNCT crl-12214 80 9 provides provide VERB crl-12214 80 10 the the DET crl-12214 80 11 user user NOUN crl-12214 80 12 with with ADP crl-12214 80 13 about about ADV crl-12214 80 14 60 60 NUM crl-12214 80 15 percent percent NOUN crl-12214 80 16 of of ADP crl-12214 80 17 the the DET crl-12214 80 18 relevant relevant ADJ crl-12214 80 19 documents document NOUN crl-12214 80 20 in in ADP crl-12214 80 21 the the DET crl-12214 80 22 collection collection NOUN crl-12214 80 23 , , PUNCT crl-12214 80 24 but but CCONJ crl-12214 80 25 of of ADP crl-12214 80 26 the the DET crl-12214 80 27 total total ADJ crl-12214 80 28 documents document NOUN crl-12214 80 29 retrieved retrieve VERB crl-12214 80 30 , , PUNCT crl-12214 80 31 about about ADV crl-12214 80 32 50 50 NUM crl-12214 80 33 percent percent NOUN crl-12214 80 34 will will AUX crl-12214 80 35 not not PART crl-12214 80 36 be be AUX crl-12214 80 37 relevant relevant ADJ crl-12214 80 38 . . PUNCT crl-12214 81 1 it it PRON crl-12214 81 2 is be AUX crl-12214 81 3 widely widely ADV crl-12214 81 4 believed believe VERB crl-12214 81 5 that that SCONJ crl-12214 81 6 computer computer NOUN crl-12214 81 7 manipulation manipulation NOUN crl-12214 81 8 when when SCONJ crl-12214 81 9 applied apply VERB crl-12214 81 10 to to ADP crl-12214 81 11 a a DET crl-12214 81 12 controlled control VERB crl-12214 81 13 indexing indexing NOUN crl-12214 81 14 language language NOUN crl-12214 81 15 will will AUX crl-12214 81 16 greatly greatly ADV crl-12214 81 17 improve improve VERB crl-12214 81 18 its its PRON crl-12214 81 19 efficiency efficiency NOUN crl-12214 81 20 . . PUNCT crl-12214 82 1 this this PRON crl-12214 82 2 is be AUX crl-12214 82 3 not not PART crl-12214 82 4 true true ADJ crl-12214 82 5 ; ; PUNCT crl-12214 82 6 even even ADV crl-12214 82 7 if if SCONJ crl-12214 82 8 more more ADJ crl-12214 82 9 subject subject ADJ crl-12214 82 10 terms term NOUN crl-12214 82 11 per per ADP crl-12214 82 12 document document NOUN crl-12214 82 13 are be AUX crl-12214 82 14 posted post VERB crl-12214 82 15 , , PUNCT crl-12214 82 16 the the DET crl-12214 82 17 overall overall ADJ crl-12214 82 18 efficiency efficiency NOUN crl-12214 82 19 of of ADP crl-12214 82 20 a a DET crl-12214 82 21 controlled control VERB crl-12214 82 22 indexing indexing NOUN crl-12214 82 23 language language NOUN crl-12214 82 24 will will AUX crl-12214 82 25 not not PART crl-12214 82 26 be be AUX crl-12214 82 27 significantly significantly ADV crl-12214 82 28 improved improve VERB crl-12214 82 29 by by ADP crl-12214 82 30 computer computer NOUN crl-12214 82 31 manipulation manipulation NOUN crl-12214 82 32 , , PUNCT crl-12214 82 33 assuming assume VERB crl-12214 82 34 that that DET crl-12214 82 35 improvement improvement NOUN crl-12214 82 36 of of ADP crl-12214 82 37 the the DET crl-12214 82 38 recall recall NOUN crl-12214 82 39 factor factor NOUN crl-12214 82 40 alone alone ADV crl-12214 82 41 is be AUX crl-12214 82 42 not not PART crl-12214 82 43 enough enough ADJ crl-12214 82 44 . . PUNCT crl-12214 83 1 this this PRON crl-12214 83 2 raises raise VERB crl-12214 83 3 a a DET crl-12214 83 4 perplexing perplexing ADJ crl-12214 83 5 question question NOUN crl-12214 83 6 . . PUNCT crl-12214 84 1 are be AUX crl-12214 84 2 all all PRON crl-12214 84 3 our our PRON crl-12214 84 4 users user NOUN crl-12214 84 5 equally equally ADV crl-12214 84 6 allergic allergic ADJ crl-12214 84 7 to to ADP crl-12214 84 8 an an DET crl-12214 84 9 increase increase NOUN crl-12214 84 10 in in ADP crl-12214 84 11 the the DET crl-12214 84 12 number number NOUN crl-12214 84 13 of of ADP crl-12214 84 14 nonrelevant nonrelevant ADJ crl-12214 84 15 documents document NOUN crl-12214 84 16 , , PUNCT crl-12214 84 17 given give VERB crl-12214 84 18 an an DET crl-12214 84 19 increase increase NOUN crl-12214 84 20 in in ADP crl-12214 84 21 the the DET crl-12214 84 22 number number NOUN crl-12214 84 23 of of ADP crl-12214 84 24 relevant relevant ADJ crl-12214 84 25 ones one NOUN crl-12214 84 26 ? ? PUNCT crl-12214 85 1 for for ADP crl-12214 85 2 example example NOUN crl-12214 85 3 , , PUNCT crl-12214 85 4 in in ADP crl-12214 85 5 this this DET crl-12214 85 6 regard regard NOUN crl-12214 85 7 are be AUX crl-12214 85 8 historians historian NOUN crl-12214 85 9 to to PART crl-12214 85 10 be be AUX crl-12214 85 11 equated equate VERB crl-12214 85 12 with with ADP crl-12214 85 13 chemists chemist NOUN crl-12214 85 14 ? ? PUNCT crl-12214 86 1 with with ADP crl-12214 86 2 economists economist NOUN crl-12214 86 3 ? ? PUNCT crl-12214 87 1 another another DET crl-12214 87 2 perplexing perplexing ADJ crl-12214 87 3 question question NOUN crl-12214 87 4 is be AUX crl-12214 87 5 this this PRON crl-12214 87 6 : : PUNCT crl-12214 87 7 librarians librarian NOUN crl-12214 87 8 suspect suspect VERB crl-12214 87 9 that that SCONJ crl-12214 87 10 scholars scholar NOUN crl-12214 87 11 do do AUX crl-12214 87 12 not not PART crl-12214 87 13 use use VERB crl-12214 87 14 the the DET crl-12214 87 15 subject subject ADJ crl-12214 87 16 catalog catalog NOUN crl-12214 87 17 extensively extensively ADV crl-12214 87 18 , , PUNCT crl-12214 87 19 and and CCONJ crl-12214 87 20 most most ADV crl-12214 87 21 often often ADV crl-12214 87 22 use use VERB crl-12214 87 23 it it PRON crl-12214 87 24 with with ADP crl-12214 87 25 respect respect NOUN crl-12214 87 26 to to ADP crl-12214 87 27 subjects subject NOUN crl-12214 87 28 outside outside ADP crl-12214 87 29 their their PRON crl-12214 87 30 own own ADJ crl-12214 87 31 speciality speciality NOUN crl-12214 87 32 . . PUNCT crl-12214 88 1 is be AUX crl-12214 88 2 this this PRON crl-12214 88 3 mainly mainly ADV crl-12214 88 4 because because SCONJ crl-12214 88 5 the the DET crl-12214 88 6 subject subject ADJ crl-12214 88 7 catalog catalog NOUN crl-12214 88 8 is be AUX crl-12214 88 9 inadequate inadequate ADJ crl-12214 88 10 , , PUNCT crl-12214 88 11 or or CCONJ crl-12214 88 12 because because SCONJ crl-12214 88 13 their their PRON crl-12214 88 14 more more ADV crl-12214 88 15 urgent urgent ADJ crl-12214 88 16 retrieval retrieval NOUN crl-12214 88 17 needs need NOUN crl-12214 88 18 lie lie VERB crl-12214 88 19 in in ADP crl-12214 88 20 nonmonographic nonmonographic ADJ crl-12214 88 21 documents document NOUN crl-12214 88 22 not not PART crl-12214 88 23 now now ADV crl-12214 88 24 indexed index VERB crl-12214 88 25 in in ADP crl-12214 88 26 our our PRON crl-12214 88 27 subject subject NOUN crl-12214 88 28 catalogs catalog NOUN crl-12214 88 29 ? ? PUNCT crl-12214 89 1 search search NOUN crl-12214 89 2 strategy strategy NOUN crl-12214 89 3 . . PUNCT crl-12214 90 1 also also ADV crl-12214 90 2 of of ADP crl-12214 90 3 importance importance NOUN crl-12214 90 4 is be AUX crl-12214 90 5 the the DET crl-12214 90 6 amount amount NOUN crl-12214 90 7 of of ADP crl-12214 90 8 manipulation manipulation NOUN crl-12214 90 9 of of ADP crl-12214 90 10 questions question NOUN crl-12214 90 11 ( ( PUNCT crl-12214 90 12 commonly commonly ADV crl-12214 90 13 termed term VERB crl-12214 90 14 search search NOUN crl-12214 90 15 strategy strategy NOUN crl-12214 90 16 ) ) PUNCT crl-12214 90 17 that that PRON crl-12214 90 18 took take VERB crl-12214 90 19 place place NOUN crl-12214 90 20 in in ADP crl-12214 90 21 these these DET crl-12214 90 22 experiments experiment NOUN crl-12214 90 23 . . PUNCT crl-12214 91 1 in in ADP crl-12214 91 2 university university NOUN crl-12214 91 3 libraries library NOUN crl-12214 91 4 few few ADJ crl-12214 91 5 questions question NOUN crl-12214 91 6 are be AUX crl-12214 91 7 manipulated manipulate VERB crl-12214 91 8 to to ADP crl-12214 91 9 the the DET crl-12214 91 10 extent extent NOUN crl-12214 91 11 that that PRON crl-12214 91 12 took take VERB crl-12214 91 13 place place NOUN crl-12214 91 14 in in ADP crl-12214 91 15 the the DET crl-12214 91 16 tests test NOUN crl-12214 91 17 under under ADP crl-12214 91 18 discussion discussion NOUN crl-12214 91 19 . . PUNCT crl-12214 92 1 in in ADP crl-12214 92 2 the the DET crl-12214 92 3 cranfield cranfield NOUN crl-12214 92 4 tests test NOUN crl-12214 92 5 and and CCONJ crl-12214 92 6 at at ADP crl-12214 92 7 case case NOUN crl-12214 92 8 western western ADJ crl-12214 92 9 the the DET crl-12214 92 10 manipulation manipulation NOUN crl-12214 92 11 of of ADP crl-12214 92 12 the the DET crl-12214 92 13 questions question NOUN crl-12214 92 14 was be AUX crl-12214 92 15 extensive extensive ADJ crl-12214 92 16 . . PUNCT crl-12214 93 1 at at ADP crl-12214 93 2 case case NOUN crl-12214 93 3 western western ADJ crl-12214 93 4 each each DET crl-12214 93 5 question question NOUN crl-12214 93 6 was be AUX crl-12214 93 7 searched search VERB crl-12214 93 8 in in ADP crl-12214 93 9 four four NUM crl-12214 93 10 different different ADJ crl-12214 93 11 ways way NOUN crl-12214 93 12 , , PUNCT crl-12214 93 13 namely namely ADV crl-12214 93 14 : : PUNCT crl-12214 93 15 ( ( PUNCT crl-12214 93 16 1 1 X crl-12214 93 17 ) ) PUNCT crl-12214 93 18 the the DET crl-12214 93 19 searchable searchable ADJ crl-12214 93 20 terms term NOUN crl-12214 93 21 found find VERB crl-12214 93 22 in in ADP crl-12214 93 23 the the DET crl-12214 93 24 question question NOUN crl-12214 93 25 itself itself PRON crl-12214 93 26 ; ; PUNCT crl-12214 93 27 ( ( PUNCT crl-12214 93 28 2 2 X crl-12214 93 29 ) ) PUNCT crl-12214 93 30 to to ADP crl-12214 93 31 ( ( PUNCT crl-12214 93 32 1 1 X crl-12214 93 33 ) ) PUNCT crl-12214 93 34 is be AUX crl-12214 93 35 added add VERB crl-12214 93 36 terms term NOUN crl-12214 93 37 taken take VERB crl-12214 93 38 from from ADP crl-12214 93 39 a a DET crl-12214 93 40 thesaurus thesaurus NOUN crl-12214 93 41 ; ; PUNCT crl-12214 93 42 ( ( PUNCT crl-12214 93 43 3 3 X crl-12214 93 44 ) ) PUNCT crl-12214 93 45 to to ADP crl-12214 93 46 ( ( PUNCT crl-12214 93 47 1 1 X crl-12214 93 48 ) ) PUNCT crl-12214 93 49 is be AUX crl-12214 93 50 added add VERB crl-12214 93 51 terms term NOUN crl-12214 93 52 taken take VERB crl-12214 93 53 from from ADP crl-12214 93 54 encyclopedias encyclopedia NOUN crl-12214 93 55 and and CCONJ crl-12214 93 56 sources source NOUN crl-12214 93 57 other other ADJ crl-12214 93 58 than than ADP crl-12214 93 59 the the DET crl-12214 93 60 thesaurus thesaurus NOUN crl-12214 93 61 ; ; PUNCT crl-12214 93 62 ( ( PUNCT crl-12214 93 63 4 4 X crl-12214 93 64 ) ) PUNCT crl-12214 93 65 a a DET crl-12214 93 66 combination combination NOUN crl-12214 93 67 of of ADP crl-12214 93 68 ( ( PUNCT crl-12214 93 69 2 2 NUM crl-12214 93 70 ) ) PUNCT crl-12214 93 71 and and CCONJ crl-12214 93 72 ( ( PUNCT crl-12214 93 73 3 3 NUM crl-12214 93 74 ) ) PUNCT crl-12214 93 75 . . PUNCT crl-12214 94 1 , , PUNCT crl-12214 94 2 the the DET crl-12214 94 3 considerable considerable ADJ crl-12214 94 4 influence influence NOUN crl-12214 94 5 of of ADP crl-12214 94 6 these these DET crl-12214 94 7 four four NUM crl-12214 94 8 manipulations manipulation NOUN crl-12214 94 9 can can AUX crl-12214 94 10 be be AUX crl-12214 94 11 seen see VERB crl-12214 94 12 in in ADP crl-12214 94 13 the the DET crl-12214 94 14 number number NOUN crl-12214 94 15 of of ADP crl-12214 94 16 relevant relevant ADJ crl-12214 94 17 and and CCONJ crl-12214 94 18 nonrelevant nonrelevant ADJ crl-12214 94 19 documents document NOUN crl-12214 94 20 retrieved retrieve VERB crl-12214 94 21 : : PUNCT crl-12214 94 22 ( ( PUNCT crl-12214 94 23 1 1 X crl-12214 94 24 ) ) PUNCT crl-12214 94 25 relevant relevant ADJ crl-12214 94 26 106 106 NUM crl-12214 94 27 n n NOUN crl-12214 94 28 onrelevant onrelevant VERB crl-12214 94 29 124 124 NUM crl-12214 94 30 recall recall NOUN crl-12214 94 31 ratio ratio NOUN crl-12214 94 32 .43 .43 NUM crl-12214 94 33 precision precision NOUN crl-12214 94 34 ratio ratio NOUN crl-12214 94 35 .54 .54 PROPN crl-12214 95 1 at at ADP crl-12214 95 2 cornell cornell PROPN crl-12214 95 3 , , PUNCT crl-12214 95 4 various various ADJ crl-12214 95 5 semantic semantic ADJ crl-12214 95 6 and and CCONJ crl-12214 95 7 syntactic syntactic ADJ crl-12214 95 8 procedures procedure NOUN crl-12214 95 9 are be AUX crl-12214 95 10 applied apply VERB crl-12214 95 11 both both PRON crl-12214 95 12 to to ADP crl-12214 95 13 the the DET crl-12214 95 14 questions question NOUN crl-12214 95 15 and and CCONJ crl-12214 95 16 to to ADP crl-12214 95 17 the the DET crl-12214 95 18 documents document NOUN crl-12214 95 19 ; ; PUNCT crl-12214 95 20 to to PART crl-12214 95 21 put put VERB crl-12214 95 22 it it PRON crl-12214 95 23 otherwise otherwise ADV crl-12214 95 24 , , PUNCT crl-12214 95 25 the the DET crl-12214 95 26 heart heart NOUN crl-12214 95 27 of of ADP crl-12214 95 28 the the DET crl-12214 95 29 smart smart ADJ crl-12214 95 30 system system NOUN crl-12214 95 31 is be AUX crl-12214 95 32 the the DET crl-12214 95 33 correlation correlation NOUN crl-12214 95 34 coefficients coefficient NOUN crl-12214 95 35 by by ADP crl-12214 95 36 which which PRON crl-12214 95 37 terms term NOUN crl-12214 95 38 in in ADP crl-12214 95 39 the the DET crl-12214 95 40 question question NOUN crl-12214 95 41 are be AUX crl-12214 95 42 matched match VERB crl-12214 95 43 with with ADP crl-12214 95 44 terms term NOUN crl-12214 95 45 from from ADP crl-12214 95 46 the the DET crl-12214 95 47 documents document NOUN crl-12214 95 48 . . PUNCT crl-12214 96 1 information information NOUN crl-12214 96 2 retrieval retrieval NOUN crl-12214 96 3 i i PRON crl-12214 96 4 173 173 NUM crl-12214 96 5 except except SCONJ crl-12214 96 6 in in ADP crl-12214 96 7 libraries library NOUN crl-12214 96 8 serving serve VERB crl-12214 96 9 a a DET crl-12214 96 10 small small ADJ crl-12214 96 11 group group NOUN crl-12214 96 12 of of ADP crl-12214 96 13 users user NOUN crl-12214 96 14 , , PUNCT crl-12214 96 15 in in ADP crl-12214 96 16 a a DET crl-12214 96 17 manual manual ADJ crl-12214 96 18 setting set VERB crl-12214 96 19 this this DET crl-12214 96 20 kind kind NOUN crl-12214 96 21 of of ADP crl-12214 96 22 question question NOUN crl-12214 96 23 manipulation manipulation NOUN crl-12214 96 24 will will AUX crl-12214 96 25 not not PART crl-12214 96 26 be be AUX crl-12214 96 27 possible possible ADJ crl-12214 96 28 unless unless SCONJ crl-12214 96 29 highly highly ADV crl-12214 96 30 skilled skilled ADJ crl-12214 96 31 librarians librarian NOUN crl-12214 96 32 in in ADP crl-12214 96 33 considerable considerable ADJ crl-12214 96 34 numbers number NOUN crl-12214 96 35 are be AUX crl-12214 96 36 employed employ VERB crl-12214 96 37 . . PUNCT crl-12214 97 1 in in ADP crl-12214 97 2 the the DET crl-12214 97 3 automatic automatic ADJ crl-12214 97 4 system system NOUN crl-12214 97 5 the the DET crl-12214 97 6 manipulation manipulation NOUN crl-12214 97 7 of of ADP crl-12214 97 8 the the DET crl-12214 97 9 questions question NOUN crl-12214 97 10 is be AUX crl-12214 97 11 mandatory mandatory ADJ crl-12214 97 12 . . PUNCT crl-12214 98 1 · · PUNCT crl-12214 98 2 whether whether SCONJ crl-12214 98 3 the the DET crl-12214 98 4 costs cost NOUN crl-12214 98 5 of of ADP crl-12214 98 6 sophisticated sophisticated ADJ crl-12214 98 7 information information NOUN crl-12214 98 8 systems system NOUN crl-12214 98 9 can can AUX crl-12214 98 10 be be AUX crl-12214 98 11 justified justify VERB crl-12214 98 12 in in ADP crl-12214 98 13 either either CCONJ crl-12214 98 14 the the DET crl-12214 98 15 manual manual NOUN crl-12214 98 16 or or CCONJ crl-12214 98 17 the the DET crl-12214 98 18 automatic automatic ADJ crl-12214 98 19 mode mode NOUN crl-12214 98 20 remains remain VERB crl-12214 98 21 to to PART crl-12214 98 22 be be AUX crl-12214 98 23 seen see VERB crl-12214 98 24 . . PUNCT crl-12214 99 1 at at ADP crl-12214 99 2 the the DET crl-12214 99 3 moment moment NOUN crl-12214 99 4 we we PRON crl-12214 99 5 have have VERB crl-12214 99 6 no no DET crl-12214 99 7 idea idea NOUN crl-12214 99 8 what what PRON crl-12214 99 9 costs cost NOUN crl-12214 99 10 would would AUX crl-12214 99 11 be be AUX crl-12214 99 12 in(2 in(2 ADJ crl-12214 99 13 ) ) PUNCT crl-12214 99 14 ( ( PUNCT crl-12214 99 15 3 3 NUM crl-12214 99 16 ) ) PUNCT crl-12214 99 17 ( ( PUNCT crl-12214 99 18 4 4 X crl-12214 99 19 ) ) PUNCT crl-12214 99 20 130 130 NUM crl-12214 99 21 180 180 NUM crl-12214 99 22 192 192 NUM crl-12214 99 23 197 197 NUM crl-12214 99 24 509 509 NUM crl-12214 99 25 598 598 NUM crl-12214 99 26 .52 .52 NUM crl-12214 99 27 .72 .72 SYM crl-12214 99 28 .77 .77 NUM crl-12214 100 1 .48 .48 NUM crl-12214 100 2 .34 .34 NUM crl-12214 100 3 .33 .33 NUM crl-12214 100 4 curred curre VERB crl-12214 100 5 by by ADP crl-12214 100 6 systems system NOUN crl-12214 100 7 such such ADJ crl-12214 100 8 as as ADP crl-12214 100 9 the the DET crl-12214 100 10 smart smart ADJ crl-12214 100 11 system system NOUN crl-12214 100 12 in in ADP crl-12214 100 13 the the DET crl-12214 100 14 setting setting NOUN crl-12214 100 15 of of ADP crl-12214 100 16 a a DET crl-12214 100 17 large large ADJ crl-12214 100 18 library library NOUN crl-12214 100 19 with with ADP crl-12214 100 20 a a DET crl-12214 100 21 large large ADJ crl-12214 100 22 number number NOUN crl-12214 100 23 of of ADP crl-12214 100 24 scholars scholar NOUN crl-12214 100 25 engaged engage VERB crl-12214 100 26 in in ADP crl-12214 100 27 research research NOUN crl-12214 100 28 . . PUNCT crl-12214 101 1 as as ADP crl-12214 101 2 for for ADP crl-12214 101 3 making make VERB crl-12214 101 4 the the DET crl-12214 101 5 system system NOUN crl-12214 101 6 available available ADJ crl-12214 101 7 to to ADP crl-12214 101 8 undergraduates undergraduate NOUN crl-12214 101 9 , , PUNCT crl-12214 101 10 this this PRON crl-12214 101 11 involves involve VERB crl-12214 101 12 an an DET crl-12214 101 13 entirely entirely ADV crl-12214 101 14 different different ADJ crl-12214 101 15 order order NOUN crl-12214 101 16 of of ADP crl-12214 101 17 cost cost NOUN crl-12214 101 18 magnitude magnitude NOUN crl-12214 101 19 . . PUNCT crl-12214 102 1 references reference NOUN crl-12214 102 2 1 1 NUM crl-12214 102 3 . . PROPN crl-12214 102 4 cyril cyril PROPN crl-12214 102 5 w. w. PROPN crl-12214 102 6 cleverdon cleverdon PROPN crl-12214 102 7 , , PUNCT crl-12214 102 8 factors factor NOUN crl-12214 102 9 determining determine VERB crl-12214 102 10 the the DET crl-12214 102 11 performance performance NOUN crl-12214 102 12 of of ADP crl-12214 102 13 indexing indexing NOUN crl-12214 102 14 systems system NOUN crl-12214 102 15 ( ( PUNCT crl-12214 102 16 cranfield cranfield PROPN crl-12214 102 17 , , PUNCT crl-12214 102 18 england england PROPN crl-12214 102 19 : : PUNCT crl-12214 102 20 college college NOUN crl-12214 102 21 of of ADP crl-12214 102 22 aeronautics aeronautics PROPN crl-12214 102 23 , , PUNCT crl-12214 102 24 1966 1966 NUM crl-12214 102 25 ) ) PUNCT crl-12214 102 26 , , PUNCT crl-12214 102 27 2v 2v NUM crl-12214 102 28 . . PUNCT crl-12214 103 1 2 2 X crl-12214 103 2 . . X crl-12214 103 3 tefko tefko VERB crl-12214 103 4 saracevic saracevic ADJ crl-12214 103 5 , , PUNCT crl-12214 103 6 an an DET crl-12214 103 7 inquiry inquiry NOUN crl-12214 103 8 into into ADP crl-12214 103 9 testing testing NOUN crl-12214 103 10 of of ADP crl-12214 103 11 i i PROPN crl-12214 103 12 nforrruj;tion nforrruj;tion NOUN crl-12214 103 13 retrieval retrieval NOUN crl-12214 103 14 systems system NOUN crl-12214 103 15 ( ( PUNCT crl-12214 103 16 cleveland cleveland PROPN crl-12214 103 17 , , PUNCT crl-12214 103 18 ohio ohio PROPN crl-12214 103 19 : : PUNCT crl-12214 103 20 center center NOUN crl-12214 103 21 for for ADP crl-12214 103 22 documentation documentation NOUN crl-12214 103 23 and and CCONJ crl-12214 103 24 communication communication NOUN crl-12214 103 25 research research NOUN crl-12214 103 26 , , PUNCT crl-12214 103 27 case case NOUN crl-12214 103 28 western western PROPN crl-12214 103 29 reserve reserve PROPN crl-12214 103 30 univ univ PROPN crl-12214 103 31 . . PROPN crl-12214 103 32 , , PUNCT crl-12214 103 33 1968 1968 NUM crl-12214 103 34 ) ) PUNCT crl-12214 103 35 . . PUNCT crl-12214 104 1 3 3 X crl-12214 104 2 . . X crl-12214 104 3 gerald gerald PROPN crl-12214 104 4 salton salton PROPN crl-12214 104 5 , , PUNCT crl-12214 104 6 automatic automatic ADJ crl-12214 104 7 information information NOUN crl-12214 104 8 organization organization NOUN crl-12214 104 9 and and CCONJ crl-12214 104 10 retrieval retrieval NOUN crl-12214 104 11 ( ( PUNCT crl-12214 104 12 new new PROPN crl-12214 104 13 york york PROPN crl-12214 104 14 : : PUNCT crl-12214 104 15 mcgraw mcgraw NOUN crl-12214 104 16 - - PUNCT crl-12214 104 17 hill hill NOUN crl-12214 104 18 , , PUNCT crl-12214 104 19 1968 1968 NUM crl-12214 104 20 ) ) PUNCT crl-12214 104 21 . . PUNCT crl-12214 105 1 4 4 X crl-12214 105 2 . . X crl-12214 105 3 frank frank PROPN crl-12214 105 4 b. b. PROPN crl-12214 105 5 rogers rogers PROPN crl-12214 105 6 , , PUNCT crl-12214 105 7 " " PUNCT crl-12214 105 8 costs cost NOUN crl-12214 105 9 of of ADP crl-12214 105 10 operating operate VERB crl-12214 105 11 an an DET crl-12214 105 12 information information NOUN crl-12214 105 13 retrieval retrieval NOUN crl-12214 105 14 service service NOUN crl-12214 105 15 , , PUNCT crl-12214 105 16 " " PUNCT crl-12214 105 17 drexel drexel PROPN crl-12214 105 18 library library PROPN crl-12214 105 19 quarterly quarterly PROPN crl-12214 105 20 4:27178 4:27178 PROPN crl-12214 105 21 ( ( PUNCT crl-12214 105 22 oct oct PROPN crl-12214 105 23 . . PROPN crl-12214 105 24 1968 1968 NUM crl-12214 105 25 ) ) PUNCT crl-12214 105 26 . . PUNCT crl-12214 106 1 5 5 X crl-12214 106 2 . . PROPN crl-12214 106 3 cyril cyril PROPN crl-12214 106 4 w. w. PROPN crl-12214 106 5 cleverdon cleverdon PROPN crl-12214 106 6 , , PUNCT crl-12214 106 7 report report NOUN crl-12214 106 8 on on ADP crl-12214 106 9 the the DET crl-12214 106 10 testing testing NOUN crl-12214 106 11 and and CCONJ crl-12214 106 12 analysis analysis NOUN crl-12214 106 13 of of ADP crl-12214 106 14 . . PUNCT crl-12214 106 15 . . PUNCT crl-12214 106 16 . . PUNCT crl-12214 107 1 indexing indexing NOUN crl-12214 107 2 systems system NOUN crl-12214 107 3 ( ( PUNCT crl-12214 107 4 cranfield cranfield PROPN crl-12214 107 5 , , PUNCT crl-12214 107 6 england england PROPN crl-12214 107 7 : : PUNCT crl-12214 107 8 college college NOUN crl-12214 107 9 of of ADP crl-12214 107 10 aeronautics aeronautics PROPN crl-12214 107 11 , , PUNCT crl-12214 107 12 1962 1962 NUM crl-12214 107 13 ) ) PUNCT crl-12214 107 14 , , PUNCT crl-12214 107 15 pp.101 pp.101 PROPN crl-12214 107 16 - - PUNCT crl-12214 107 17 02 02 NUM crl-12214 107 18 . . NUM crl-12214 107 19 6 6 NUM crl-12214 107 20 . . PROPN crl-12214 107 21 arthur arthur PROPN crl-12214 107 22 d. d. PROPN crl-12214 107 23 little little PROPN crl-12214 107 24 , , PUNCT crl-12214 107 25 inc inc PROPN crl-12214 107 26 . . PROPN crl-12214 107 27 , , PUNCT crl-12214 107 28 centralization centralization NOUN crl-12214 107 29 and and CCONJ crl-12214 107 30 documentation documentation NOUN crl-12214 107 31 . . PUNCT crl-12214 108 1 final final ADJ crl-12214 108 2 report report NOUN crl-12214 108 3 to to ADP crl-12214 108 4 the the DET crl-12214 108 5 national national PROPN crl-12214 108 6 science science PROPN crl-12214 108 7 foundation foundation PROPN crl-12214 108 8 . . PUNCT crl-12214 109 1 2d 2d PROPN crl-12214 109 2 ed ed PROPN crl-12214 109 3 . . PUNCT crl-12214 110 1 ( ( PUNCT crl-12214 110 2 cambridge cambridge PROPN crl-12214 110 3 , , PUNCT crl-12214 110 4 mass mass PROPN crl-12214 110 5 . . PUNCT crl-12214 110 6 : : PUNCT crl-12214 110 7 1964 1964 NUM crl-12214 110 8 ) ) PUNCT crl-12214 110 9 . . PUNCT crl-12214 111 1 7 7 X crl-12214 111 2 . . X crl-12214 111 3 cleverdon cleverdon PROPN crl-12214 111 4 , , PUNCT crl-12214 111 5 report report NOUN crl-12214 111 6 . . PUNCT