id sid tid token lemma pos 3334 1 1 78 78 CD 3334 1 2 INFORMATION information NN 3334 1 3 TECHNOLOGY TECHNOLOGY NNP 3334 1 4 AND and CC 3334 1 5 LIBRARIES LIBRARIES NNP 3334 1 6 | | JJ 3334 1 7 JUNE JUNE NNP 3334 1 8 2006 2006 CD 3334 1 9 In in IN 3334 1 10 the the DT 3334 1 11 early early JJ 3334 1 12 years year NNS 3334 1 13 of of IN 3334 1 14 modern modern JJ 3334 1 15 information information NN 3334 1 16 retrieval retrieval NN 3334 1 17 , , , 3334 1 18 the the DT 3334 1 19 fundamental fundamental JJ 3334 1 20 way way NN 3334 1 21 in in IN 3334 1 22 which which WDT 3334 1 23 we -PRON- PRP 3334 1 24 understood understand VBD 3334 1 25 and and CC 3334 1 26 evalu- evalu- VBZ 3334 1 27 ated ate VBN 3334 1 28 search search NN 3334 1 29 performance performance NN 3334 1 30 was be VBD 3334 1 31 by by IN 3334 1 32 measuring measure VBG 3334 1 33 precision precision NN 3334 1 34 and and CC 3334 1 35 recall recall NN 3334 1 36 . . . 3334 2 1 In in IN 3334 2 2 recent recent JJ 3334 2 3 decades decade NNS 3334 2 4 , , , 3334 2 5 however however RB 3334 2 6 , , , 3334 2 7 models model NNS 3334 2 8 of of IN 3334 2 9 evaluation evaluation NN 3334 2 10 have have VBP 3334 2 11 expanded expand VBN 3334 2 12 to to TO 3334 2 13 incorporate incorporate VB 3334 2 14 the the DT 3334 2 15 information information NN 3334 2 16 - - HYPH 3334 2 17 seeking seek VBG 3334 2 18 task task NN 3334 2 19 and and CC 3334 2 20 the the DT 3334 2 21 quality quality NN 3334 2 22 of of IN 3334 2 23 its -PRON- PRP$ 3334 2 24 outcome outcome NN 3334 2 25 , , , 3334 2 26 as as RB 3334 2 27 well well RB 3334 2 28 as as IN 3334 2 29 the the DT 3334 2 30 value value NN 3334 2 31 of of IN 3334 2 32 the the DT 3334 2 33 information information NN 3334 2 34 to to IN 3334 2 35 the the DT 3334 2 36 user user NN 3334 2 37 . . . 3334 3 1 We -PRON- PRP 3334 3 2 have have VBP 3334 3 3 developed develop VBN 3334 3 4 a a DT 3334 3 5 systems system NNS 3334 3 6 engineering engineering NN 3334 3 7 - - HYPH 3334 3 8 based base VBN 3334 3 9 methodology methodology NN 3334 3 10 for for IN 3334 3 11 improving improve VBG 3334 3 12 the the DT 3334 3 13 whole whole JJ 3334 3 14 search search NN 3334 3 15 experience experience NN 3334 3 16 . . . 3334 4 1 The the DT 3334 4 2 approach approach NN 3334 4 3 focuses focus VBZ 3334 4 4 on on IN 3334 4 5 understand- understand- JJ 3334 4 6 ing ing NN 3334 4 7 users user NNS 3334 4 8 ’ ’ POS 3334 4 9 information information NN 3334 4 10 - - HYPH 3334 4 11 seeking seek VBG 3334 4 12 problems problem NNS 3334 4 13 , , , 3334 4 14 understand- understand- JJ 3334 4 15 ing ing NNP 3334 4 16 who who WP 3334 4 17 has have VBZ 3334 4 18 the the DT 3334 4 19 problems problem NNS 3334 4 20 , , , 3334 4 21 and and CC 3334 4 22 applying apply VBG 3334 4 23 solutions solution NNS 3334 4 24 that that WDT 3334 4 25 address address VBP 3334 4 26 these these DT 3334 4 27 problems problem NNS 3334 4 28 . . . 3334 5 1 This this DT 3334 5 2 information information NN 3334 5 3 is be VBZ 3334 5 4 gathered gather VBN 3334 5 5 through through IN 3334 5 6 ongoing ongoing JJ 3334 5 7 analysis analysis NN 3334 5 8 of of IN 3334 5 9 site site NN 3334 5 10 - - HYPH 3334 5 11 usage usage NN 3334 5 12 reports report NNS 3334 5 13 , , , 3334 5 14 satisfac- satisfac- VBG 3334 5 15 tion tion NN 3334 5 16 surveys survey NNS 3334 5 17 , , , 3334 5 18 Help Help NNP 3334 5 19 Desk Desk NNP 3334 5 20 reports report VBZ 3334 5 21 , , , 3334 5 22 and and CC 3334 5 23 a a DT 3334 5 24 working work VBG 3334 5 25 relation- relation- FW 3334 5 26 ship ship NN 3334 5 27 with with IN 3334 5 28 the the DT 3334 5 29 business business NN 3334 5 30 owners owner NNS 3334 5 31 . . . 3334 6 1 ■ ■ NFP 3334 6 2 Evaluation evaluation NN 3334 6 3 models model NNS 3334 6 4 In in IN 3334 6 5 the the DT 3334 6 6 early early JJ 3334 6 7 years year NNS 3334 6 8 of of IN 3334 6 9 modern modern JJ 3334 6 10 information information NN 3334 6 11 retrieval retrieval NN 3334 6 12 , , , 3334 6 13 the the DT 3334 6 14 fundamental fundamental JJ 3334 6 15 way way NN 3334 6 16 in in IN 3334 6 17 which which WDT 3334 6 18 we -PRON- PRP 3334 6 19 understood understand VBD 3334 6 20 and and CC 3334 6 21 evalu- evalu- VBZ 3334 6 22 ated ate VBN 3334 6 23 search search NN 3334 6 24 performance performance NN 3334 6 25 was be VBD 3334 6 26 by by IN 3334 6 27 measuring measure VBG 3334 6 28 precision precision NN 3334 6 29 and and CC 3334 6 30 recall.1 recall.1 NN 3334 6 31 In in IN 3334 6 32 recent recent JJ 3334 6 33 decades decade NNS 3334 6 34 , , , 3334 6 35 however however RB 3334 6 36 , , , 3334 6 37 models model NNS 3334 6 38 of of IN 3334 6 39 evaluation evaluation NN 3334 6 40 have have VBP 3334 6 41 expanded expand VBN 3334 6 42 to to TO 3334 6 43 incorporate incorporate VB 3334 6 44 the the DT 3334 6 45 information information NN 3334 6 46 - - HYPH 3334 6 47 seeking seek VBG 3334 6 48 task task NN 3334 6 49 and and CC 3334 6 50 the the DT 3334 6 51 quality quality NN 3334 6 52 of of IN 3334 6 53 its -PRON- PRP$ 3334 6 54 outcome outcome NN 3334 6 55 , , , 3334 6 56 cognitive cognitive JJ 3334 6 57 models model NNS 3334 6 58 of of IN 3334 6 59 information information NN 3334 6 60 behavior behavior NN 3334 6 61 , , , 3334 6 62 as as RB 3334 6 63 well well RB 3334 6 64 as as IN 3334 6 65 the the DT 3334 6 66 value value NN 3334 6 67 of of IN 3334 6 68 the the DT 3334 6 69 informa- informa- JJ 3334 6 70 tion tion NN 3334 6 71 to to IN 3334 6 72 the the DT 3334 6 73 user.2 user.2 NNP 3334 6 74 The the DT 3334 6 75 conceptual conceptual JJ 3334 6 76 framework framework NN 3334 6 77 for for IN 3334 6 78 holistic holistic JJ 3334 6 79 evaluation evaluation NN 3334 6 80 of of IN 3334 6 81 libraries library NNS 3334 6 82 described describe VBN 3334 6 83 by by IN 3334 6 84 Nicholson Nicholson NNP 3334 6 85 defines define VBZ 3334 6 86 multiple multiple JJ 3334 6 87 perspectives perspective NNS 3334 6 88 ( ( -LRB- 3334 6 89 internal internal JJ 3334 6 90 and and CC 3334 6 91 external external JJ 3334 6 92 views view NNS 3334 6 93 of of IN 3334 6 94 the the DT 3334 6 95 library library NN 3334 6 96 system system NN 3334 6 97 as as RB 3334 6 98 well well RB 3334 6 99 as as IN 3334 6 100 internal internal JJ 3334 6 101 and and CC 3334 6 102 external external JJ 3334 6 103 views view NNS 3334 6 104 of of IN 3334 6 105 its -PRON- PRP$ 3334 6 106 use use NN 3334 6 107 ) ) -RRB- 3334 6 108 from from IN 3334 6 109 which which WDT 3334 6 110 to to TO 3334 6 111 measure measure VB 3334 6 112 and and CC 3334 6 113 evaluate evaluate VB 3334 6 114 a a DT 3334 6 115 library library NN 3334 6 116 system.3 system.3 CD 3334 6 117 The the DT 3334 6 118 work work NN 3334 6 119 described describe VBN 3334 6 120 in in IN 3334 6 121 this this DT 3334 6 122 paper paper NN 3334 6 123 is be VBZ 3334 6 124 consistent consistent JJ 3334 6 125 with with IN 3334 6 126 these these DT 3334 6 127 frameworks framework NNS 3334 6 128 as as IN 3334 6 129 it -PRON- PRP 3334 6 130 emphasizes emphasize VBZ 3334 6 131 that that DT 3334 6 132 , , , 3334 6 133 while while IN 3334 6 134 efforts effort NNS 3334 6 135 to to TO 3334 6 136 improve improve VB 3334 6 137 search search NN 3334 6 138 may may MD 3334 6 139 focus focus VB 3334 6 140 on on IN 3334 6 141 optimizing optimize VBG 3334 6 142 preci- preci- JJ 3334 6 143 sion sion NN 3334 6 144 or or CC 3334 6 145 recall recall NN 3334 6 146 , , , 3334 6 147 it -PRON- PRP 3334 6 148 is be VBZ 3334 6 149 equally equally RB 3334 6 150 important important JJ 3334 6 151 to to TO 3334 6 152 recognize recognize VB 3334 6 153 that that IN 3334 6 154 the the DT 3334 6 155 search search NN 3334 6 156 experience experience NN 3334 6 157 involves involve VBZ 3334 6 158 more more JJR 3334 6 159 than than IN 3334 6 160 a a DT 3334 6 161 perfect perfect JJ 3334 6 162 set set NN 3334 6 163 of of IN 3334 6 164 high high JJ 3334 6 165 - - HYPH 3334 6 166 precision precision NN 3334 6 167 , , , 3334 6 168 high high JJ 3334 6 169 - - HYPH 3334 6 170 recall recall NN 3334 6 171 search search NN 3334 6 172 results result NNS 3334 6 173 . . . 3334 7 1 The the DT 3334 7 2 total total JJ 3334 7 3 search search NN 3334 7 4 experience experience NN 3334 7 5 and and CC 3334 7 6 how how WRB 3334 7 7 well well RB 3334 7 8 the the DT 3334 7 9 system system NN 3334 7 10 actually actually RB 3334 7 11 helps help VBZ 3334 7 12 the the DT 3334 7 13 user user NN 3334 7 14 solve solve VB 3334 7 15 the the DT 3334 7 16 search search NN 3334 7 17 task task NN 3334 7 18 must must MD 3334 7 19 be be VB 3334 7 20 evaluated evaluate VBN 3334 7 21 . . . 3334 8 1 A a DT 3334 8 2 search search NN 3334 8 3 experience experience NN 3334 8 4 begins begin VBZ 3334 8 5 when when WRB 3334 8 6 users user NNS 3334 8 7 enter enter VBP 3334 8 8 words word NNS 3334 8 9 in in IN 3334 8 10 a a DT 3334 8 11 search search NN 3334 8 12 box box NN 3334 8 13 . . . 3334 9 1 It -PRON- PRP 3334 9 2 continues continue VBZ 3334 9 3 when when WRB 3334 9 4 the the DT 3334 9 5 users user NNS 3334 9 6 view view VBP 3334 9 7 some some DT 3334 9 8 representation representation NN 3334 9 9 ( ( -LRB- 3334 9 10 such such JJ 3334 9 11 as as IN 3334 9 12 a a DT 3334 9 13 list list NN 3334 9 14 or or CC 3334 9 15 a a DT 3334 9 16 table table NN 3334 9 17 ) ) -RRB- 3334 9 18 of of IN 3334 9 19 candidate candidate NN 3334 9 20 answers answer NNS 3334 9 21 to to IN 3334 9 22 their -PRON- PRP$ 3334 9 23 queries query NNS 3334 9 24 . . . 3334 10 1 It -PRON- PRP 3334 10 2 includes include VBZ 3334 10 3 the the DT 3334 10 4 users user NNS 3334 10 5 ’ ’ POS 3334 10 6 reactions reaction NNS 3334 10 7 to to IN 3334 10 8 the the DT 3334 10 9 usefulness usefulness NN 3334 10 10 of of IN 3334 10 11 those those DT 3334 10 12 answers answer NNS 3334 10 13 and and CC 3334 10 14 their -PRON- PRP$ 3334 10 15 representa- representa- JJ 3334 10 16 tion tion NN 3334 10 17 in in IN 3334 10 18 satisfying satisfy VBG 3334 10 19 information information NN 3334 10 20 needs need NNS 3334 10 21 , , , 3334 10 22 and and CC 3334 10 23 continues continue VBZ 3334 10 24 with with IN 3334 10 25 the the DT 3334 10 26 users user NNS 3334 10 27 clicking click VBG 3334 10 28 on on IN 3334 10 29 a a DT 3334 10 30 link link NN 3334 10 31 ( ( -LRB- 3334 10 32 or or CC 3334 10 33 links link NNS 3334 10 34 ) ) -RRB- 3334 10 35 to to TO 3334 10 36 view view VB 3334 10 37 content content NN 3334 10 38 . . . 3334 11 1 Optimizing optimize VBG 3334 11 2 search search NN 3334 11 3 results result NNS 3334 11 4 without without IN 3334 11 5 considering consider VBG 3334 11 6 the the DT 3334 11 7 rest rest NN 3334 11 8 of of IN 3334 11 9 the the DT 3334 11 10 search search NN 3334 11 11 experience experience NN 3334 11 12 and and CC 3334 11 13 without without IN 3334 11 14 considering consider VBG 3334 11 15 user user NN 3334 11 16 behavior behavior NN 3334 11 17 is be VBZ 3334 11 18 missing miss VBG 3334 11 19 an an DT 3334 11 20 opportunity opportunity NN 3334 11 21 to to TO 3334 11 22 further further RB 3334 11 23 improve improve VB 3334 11 24 user user NN 3334 11 25 success success NN 3334 11 26 . . . 3334 12 1 For for IN 3334 12 2 example example NN 3334 12 3 , , , 3334 12 4 the the DT 3334 12 5 experience experience NN 3334 12 6 is be VBZ 3334 12 7 a a DT 3334 12 8 failure failure NN 3334 12 9 if if IN 3334 12 10 typical typical JJ 3334 12 11 users user NNS 3334 12 12 can can MD 3334 12 13 not not RB 3334 12 14 recognize recognize VB 3334 12 15 the the DT 3334 12 16 answers answer NNS 3334 12 17 to to IN 3334 12 18 their -PRON- PRP$ 3334 12 19 infor- infor- JJ 3334 12 20 mation mation NN 3334 12 21 need need VBP 3334 12 22 because because IN 3334 12 23 the the DT 3334 12 24 items item NNS 3334 12 25 lack lack VBP 3334 12 26 a a DT 3334 12 27 recognizable recognizable JJ 3334 12 28 title title NN 3334 12 29 or or CC 3334 12 30 an an DT 3334 12 31 informative informative JJ 3334 12 32 description description NN 3334 12 33 , , , 3334 12 34 or or CC 3334 12 35 they -PRON- PRP 3334 12 36 involve involve VBP 3334 12 37 extensive extensive JJ 3334 12 38 scrolling scrolling NN 3334 12 39 or or CC 3334 12 40 hard hard JJ 3334 12 41 - - HYPH 3334 12 42 to to TO 3334 12 43 - - HYPH 3334 12 44 use use NN 3334 12 45 content content NN 3334 12 46 . . . 3334 13 1 ■ ■ NFP 3334 13 2 Proposed propose VBN 3334 13 3 solutions solution NNS 3334 13 4 Problems problem NNS 3334 13 5 with with IN 3334 13 6 search search NN 3334 13 7 , , , 3334 13 8 such such JJ 3334 13 9 as as IN 3334 13 10 low low JJ 3334 13 11 precision precision NN 3334 13 12 or or CC 3334 13 13 low low JJ 3334 13 14 recall recall NN 3334 13 15 , , , 3334 13 16 are be VBP 3334 13 17 often often RB 3334 13 18 addressed address VBN 3334 13 19 by by IN 3334 13 20 either either DT 3334 13 21 metadata metadata NNP 3334 13 22 solutions solution NNS 3334 13 23 ( ( -LRB- 3334 13 24 add- add- RB 3334 13 25 ing e VBG 3334 13 26 topical topical JJ 3334 13 27 tags tag NNS 3334 13 28 to to IN 3334 13 29 content content JJ 3334 13 30 objects object NNS 3334 13 31 based base VBN 3334 13 32 on on IN 3334 13 33 controlled control VBN 3334 13 34 vocabularies vocabulary NNS 3334 13 35 ) ) -RRB- 3334 13 36 or or CC 3334 13 37 replacement replacement NN 3334 13 38 of of IN 3334 13 39 the the DT 3334 13 40 search search NN 3334 13 41 engine engine NN 3334 13 42 . . . 3334 14 1 The the DT 3334 14 2 problems problem NNS 3334 14 3 with with IN 3334 14 4 the the DT 3334 14 5 metadata metadata NN 3334 14 6 approach approach NN 3334 14 7 include include VBP 3334 14 8 the the DT 3334 14 9 time time NN 3334 14 10 and and CC 3334 14 11 effort effort NN 3334 14 12 required require VBN 3334 14 13 to to TO 3334 14 14 establish establish VB 3334 14 15 , , , 3334 14 16 evolve evolve VB 3334 14 17 , , , 3334 14 18 and and CC 3334 14 19 maintain maintain VB 3334 14 20 taxonomies taxonomy NNS 3334 14 21 , , , 3334 14 22 and and CC 3334 14 23 the the DT 3334 14 24 need need NN 3334 14 25 for for IN 3334 14 26 trained train VBN 3334 14 27 intermediaries intermediary NNS 3334 14 28 to to TO 3334 14 29 apply apply VB 3334 14 30 the the DT 3334 14 31 tags.4 tags.4 NN 3334 14 32 A a DT 3334 14 33 community community NN 3334 14 34 of of IN 3334 14 35 stakeholders stakeholder NNS 3334 14 36 may may MD 3334 14 37 be be VB 3334 14 38 convened convene VBN 3334 14 39 to to TO 3334 14 40 define define VB 3334 14 41 the the DT 3334 14 42 controlled control VBN 3334 14 43 vocabulary vocabulary NN 3334 14 44 , , , 3334 14 45 but but CC 3334 14 46 often often RB 3334 14 47 the the DT 3334 14 48 lowest low JJS 3334 14 49 common common JJ 3334 14 50 denominator denominator NN 3334 14 51 prevails prevail VBZ 3334 14 52 , , , 3334 14 53 the the DT 3334 14 54 champi- champi- XX 3334 14 55 ons ons NN 3334 14 56 and and CC 3334 14 57 stakeholders stakeholder NNS 3334 14 58 leave leave VBP 3334 14 59 , , , 3334 14 60 and and CC 3334 14 61 no no DT 3334 14 62 one one NN 3334 14 63 is be VBZ 3334 14 64 happy happy JJ 3334 14 65 with with IN 3334 14 66 the the DT 3334 14 67 resulting result VBG 3334 14 68 standard standard NN 3334 14 69 . . . 3334 15 1 Even even RB 3334 15 2 with with IN 3334 15 3 trained trained JJ 3334 15 4 intermediaries intermediary NNS 3334 15 5 , , , 3334 15 6 inter inter JJ 3334 15 7 - - JJ 3334 15 8 indexer indexer JJ 3334 15 9 inconsistency inconsistency NN 3334 15 10 compromises compromise VBZ 3334 15 11 this this DT 3334 15 12 approach approach NN 3334 15 13 , , , 3334 15 14 and and CC 3334 15 15 inconsistent inconsistent JJ 3334 15 16 term term NN 3334 15 17 application application NN 3334 15 18 can can MD 3334 15 19 cause cause VB 3334 15 20 degradation degradation NN 3334 15 21 of of IN 3334 15 22 search search NN 3334 15 23 results.5 results.5 PDT 3334 15 24 Another another DT 3334 15 25 shortcoming shortcoming NN 3334 15 26 of of IN 3334 15 27 the the DT 3334 15 28 metadata metadata NN 3334 15 29 approach approach NN 3334 15 30 is be VBZ 3334 15 31 that that IN 3334 15 32 a a DT 3334 15 33 specific specific JJ 3334 15 34 metadata metadata NN 3334 15 35 classification classification NN 3334 15 36 is be VBZ 3334 15 37 just just RB 3334 15 38 a a DT 3334 15 39 snapshot snapshot NN 3334 15 40 in in IN 3334 15 41 time time NN 3334 15 42 and and CC 3334 15 43 assumes assume VBZ 3334 15 44 that that IN 3334 15 45 there there EX 3334 15 46 is be VBZ 3334 15 47 only only RB 3334 15 48 one one CD 3334 15 49 particular particular JJ 3334 15 50 hierarchy hierarchy NN 3334 15 51 of of IN 3334 15 52 the the DT 3334 15 53 information information NN 3334 15 54 in in IN 3334 15 55 the the DT 3334 15 56 corpus corpus NNP 3334 15 57 . . . 3334 16 1 In in IN 3334 16 2 reality reality NN 3334 16 3 , , , 3334 16 4 however however RB 3334 16 5 , , , 3334 16 6 there there EX 3334 16 7 is be VBZ 3334 16 8 almost almost RB 3334 16 9 always always RB 3334 16 10 more more JJR 3334 16 11 than than IN 3334 16 12 one one CD 3334 16 13 way way NN 3334 16 14 to to TO 3334 16 15 describe describe VB 3334 16 16 a a DT 3334 16 17 concept concept NN 3334 16 18 , , , 3334 16 19 and and CC 3334 16 20 the the DT 3334 16 21 taxonomy taxonomy NN 3334 16 22 is be VBZ 3334 16 23 the the DT 3334 16 24 view view NN 3334 16 25 of of IN 3334 16 26 only only RB 3334 16 27 one one CD 3334 16 28 individual individual NN 3334 16 29 or or CC 3334 16 30 group group NN 3334 16 31 of of IN 3334 16 32 individuals individual NNS 3334 16 33 . . . 3334 17 1 In in IN 3334 17 2 addition addition NN 3334 17 3 , , , 3334 17 4 topical topical JJ 3334 17 5 metadata metadata NN 3334 17 6 is be VBZ 3334 17 7 often often RB 3334 17 8 implemented implement VBN 3334 17 9 with with IN 3334 17 10 little little JJ 3334 17 11 understanding understanding NN 3334 17 12 of of IN 3334 17 13 the the DT 3334 17 14 types type NNS 3334 17 15 of of IN 3334 17 16 queries query NNS 3334 17 17 that that WDT 3334 17 18 are be VBP 3334 17 19 submitted submit VBN 3334 17 20 or or CC 3334 17 21 the the DT 3334 17 22 probable probable JJ 3334 17 23 user user NN 3334 17 24 search search NN 3334 17 25 behavior behavior NN 3334 17 26 . . . 3334 18 1 The the DT 3334 18 2 other other JJ 3334 18 3 approach approach NN 3334 18 4 to to IN 3334 18 5 improving improve VBG 3334 18 6 search search NN 3334 18 7 results result NNS 3334 18 8 — — : 3334 18 9 replacing replace VBG 3334 18 10 a a DT 3334 18 11 search search NN 3334 18 12 engine engine NN 3334 18 13 — — : 3334 18 14 is be VBZ 3334 18 15 not not RB 3334 18 16 a a DT 3334 18 17 guarantee guarantee NN 3334 18 18 to to IN 3334 18 19 fixing fix VBG 3334 18 20 the the DT 3334 18 21 problem problem NN 3334 18 22 because because IN 3334 18 23 it -PRON- PRP 3334 18 24 focuses focus VBZ 3334 18 25 only only RB 3334 18 26 on on IN 3334 18 27 improving improve VBG 3334 18 28 precision precision NN 3334 18 29 ( ( -LRB- 3334 18 30 and and CC 3334 18 31 perhaps perhaps RB 3334 18 32 recall recall VB 3334 18 33 as as RB 3334 18 34 well well RB 3334 18 35 ) ) -RRB- 3334 18 36 without without IN 3334 18 37 understanding understand VBG 3334 18 38 the the DT 3334 18 39 true true JJ 3334 18 40 barriers barrier NNS 3334 18 41 to to IN 3334 18 42 a a DT 3334 18 43 successful successful JJ 3334 18 44 search search NN 3334 18 45 experience experience NN 3334 18 46 . . . 3334 19 1 ■ ■ NFP 3334 19 2 IRS.gov irs.gov FW 3334 19 3 IRS.gov irs.gov FW 3334 19 4 , , , 3334 19 5 one one CD 3334 19 6 of of IN 3334 19 7 the the DT 3334 19 8 most most RBS 3334 19 9 widely widely RB 3334 19 10 used use VBN 3334 19 11 government government NN 3334 19 12 Web web NN 3334 19 13 sites site NNS 3334 19 14 , , , 3334 19 15 is be VBZ 3334 19 16 routinely routinely RB 3334 19 17 accessed access VBN 3334 19 18 by by IN 3334 19 19 millions million NNS 3334 19 20 of of IN 3334 19 21 people people NNS 3334 19 22 each each DT 3334 19 23 month month NN 3334 19 24 ( ( -LRB- 3334 19 25 more more JJR 3334 19 26 than than IN 3334 19 27 27 27 CD 3334 19 28 million million CD 3334 19 29 visits visit NNS 3334 19 30 in in IN 3334 19 31 April April NNP 3334 19 32 2005 2005 CD 3334 19 33 ) ) -RRB- 3334 19 34 . . . 3334 20 1 As as IN 3334 20 2 an an DT 3334 20 3 informational informational JJ 3334 20 4 site site NN 3334 20 5 , , , 3334 20 6 the the DT 3334 20 7 key key JJ 3334 20 8 goal goal NN 3334 20 9 of of IN 3334 20 10 IRS.gov IRS.gov NNP 3334 20 11 is be VBZ 3334 20 12 to to TO 3334 20 13 direct direct VB 3334 20 14 visitors visitor NNS 3334 20 15 quickly quickly RB 3334 20 16 to to IN 3334 20 17 useful useful JJ 3334 20 18 information information NN 3334 20 19 , , , 3334 20 20 either either CC 3334 20 21 through through IN 3334 20 22 Marcia Marcia NNP 3334 20 23 D. D. NNP 3334 20 24 Kerchner Kerchner NNP 3334 20 25 ( ( -LRB- 3334 20 26 mkerchner@mitre.org mkerchner@mitre.org NN 3334 20 27 ) ) -RRB- 3334 20 28 is be VBZ 3334 20 29 a a DT 3334 20 30 Principal Principal NNP 3334 20 31 Information Information NNP 3334 20 32 Systems Systems NNP 3334 20 33 Engineer Engineer NNP 3334 20 34 at at IN 3334 20 35 the the DT 3334 20 36 MITRE MITRE NNP 3334 20 37 Corporation Corporation NNP 3334 20 38 , , , 3334 20 39 McLean McLean NNP 3334 20 40 , , , 3334 20 41 Va. Virginia NNP 3334 20 42 A A NNP 3334 20 43 Dynamic Dynamic NNP 3334 20 44 Methodology methodology NN 3334 20 45 for for IN 3334 20 46 Improving improve VBG 3334 20 47 the the DT 3334 20 48 Search Search NNP 3334 20 49 Experience Experience NNP 3334 20 50 Marcia Marcia NNP 3334 20 51 D. D. NNP 3334 20 52 Kerchner Kerchner NNP 3334 20 53 ARTICLE ARTICLE NNP 3334 20 54 TITLE TITLE NNP 3334 20 55 | | NNP 3334 20 56 AUTHOR AUTHOR NNP 3334 20 57 79A 79A NNP 3334 20 58 DYNAMIC dynamic NN 3334 20 59 METHODOLOGY methodology NN 3334 20 60 FOR for IN 3334 20 61 IMPROVING improve VBG 3334 20 62 THE the DT 3334 20 63 SEARCH SEARCH NNS 3334 20 64 EXPERIENCE EXPERIENCE NNP 3334 20 65 | | CD 3334 20 66 KERCHNER kerchner NN 3334 20 67 79 79 CD 3334 20 68 navigation navigation NN 3334 20 69 or or CC 3334 20 70 a a DT 3334 20 71 search search NN 3334 20 72 function function NN 3334 20 73 . . . 3334 21 1 Given give VBN 3334 21 2 that that IN 3334 21 3 there there EX 3334 21 4 were be VBD 3334 21 5 almost almost RB 3334 21 6 16 16 CD 3334 21 7 million million CD 3334 21 8 queries query NNS 3334 21 9 submitted submit VBN 3334 21 10 to to IN 3334 21 11 IRS.gov irs.gov PRP 3334 21 12 in in IN 3334 21 13 April April NNP 3334 21 14 2005 2005 CD 3334 21 15 , , , 3334 21 16 search search NN 3334 21 17 is be VBZ 3334 21 18 clearly clearly RB 3334 21 19 a a DT 3334 21 20 popular popular JJ 3334 21 21 way way NN 3334 21 22 for for IN 3334 21 23 its -PRON- PRP$ 3334 21 24 users user NNS 3334 21 25 to to TO 3334 21 26 look look VB 3334 21 27 for for IN 3334 21 28 information information NN 3334 21 29 . . . 3334 22 1 This this DT 3334 22 2 paper paper NN 3334 22 3 offers offer VBZ 3334 22 4 an an DT 3334 22 5 alternative alternative NN 3334 22 6 to to IN 3334 22 7 con- con- NNP 3334 22 8 ventional ventional JJ 3334 22 9 search search NN 3334 22 10 - - HYPH 3334 22 11 improvement improvement NN 3334 22 12 approaches approach NNS 3334 22 13 by by IN 3334 22 14 presenting present VBG 3334 22 15 a a DT 3334 22 16 systems system NNS 3334 22 17 engineering engineering NN 3334 22 18 - - HYPH 3334 22 19 based base VBN 3334 22 20 methodology methodology NN 3334 22 21 for for IN 3334 22 22 improv- improv- NNP 3334 22 23 ing e VBG 3334 22 24 the the DT 3334 22 25 whole whole JJ 3334 22 26 search search NN 3334 22 27 experience experience NN 3334 22 28 . . . 3334 23 1 This this DT 3334 23 2 methodology methodology NN 3334 23 3 was be VBD 3334 23 4 developed develop VBN 3334 23 5 , , , 3334 23 6 honed hone VBN 3334 23 7 , , , 3334 23 8 and and CC 3334 23 9 modified modify VBN 3334 23 10 in in IN 3334 23 11 conjunction conjunction NN 3334 23 12 with with IN 3334 23 13 work work NN 3334 23 14 performed perform VBN 3334 23 15 on on IN 3334 23 16 the the DT 3334 23 17 IRS.gov irs.gov FW 3334 23 18 Web web NN 3334 23 19 site site NN 3334 23 20 over over IN 3334 23 21 a a DT 3334 23 22 three- three- JJ 3334 23 23 year year NN 3334 23 24 period period NN 3334 23 25 . . . 3334 24 1 A a DT 3334 24 2 similar similar JJ 3334 24 3 strategy strategy NN 3334 24 4 of of IN 3334 24 5 “ " `` 3334 24 6 sense sense NN 3334 24 7 - - HYPH 3334 24 8 and and CC 3334 24 9 - - HYPH 3334 24 10 respond respond NN 3334 24 11 ” " '' 3334 24 12 for for IN 3334 24 13 information information NN 3334 24 14 technology technology NN 3334 24 15 ( ( -LRB- 3334 24 16 IT it NN 3334 24 17 ) ) -RRB- 3334 24 18 departments department NNS 3334 24 19 of of IN 3334 24 20 public public JJ 3334 24 21 organizations organization NNS 3334 24 22 that that WDT 3334 24 23 involves involve VBZ 3334 24 24 systematic systematic JJ 3334 24 25 intelligence intelligence NN 3334 24 26 gath- gath- NN 3334 24 27 ering ere VBG 3334 24 28 on on IN 3334 24 29 potential potential JJ 3334 24 30 customer customer NN 3334 24 31 demand demand NN 3334 24 32 , , , 3334 24 33 a a DT 3334 24 34 rapid rapid JJ 3334 24 35 response response NN 3334 24 36 to to TO 3334 24 37 fulfill fulfill VB 3334 24 38 that that DT 3334 24 39 demand demand NN 3334 24 40 , , , 3334 24 41 and and CC 3334 24 42 metrics metric NNS 3334 24 43 to to TO 3334 24 44 determine determine VB 3334 24 45 how how WRB 3334 24 46 well well RB 3334 24 47 the the DT 3334 24 48 demand demand NN 3334 24 49 was be VBD 3334 24 50 satisfied satisfied JJ 3334 24 51 , , , 3334 24 52 has have VBZ 3334 24 53 recently recently RB 3334 24 54 been be VBN 3334 24 55 described.6 described.6 CD 3334 24 56 The the DT 3334 24 57 methodology methodology NN 3334 24 58 described describe VBN 3334 24 59 in in IN 3334 24 60 this this DT 3334 24 61 paper paper NN 3334 24 62 focuses focus VBZ 3334 24 63 on on IN 3334 24 64 analyzing analyze VBG 3334 24 65 the the DT 3334 24 66 information information NN 3334 24 67 - - HYPH 3334 24 68 seeking seek VBG 3334 24 69 behaviors behavior NNS 3334 24 70 and and CC 3334 24 71 needs need NNS 3334 24 72 of of IN 3334 24 73 users user NNS 3334 24 74 and and CC 3334 24 75 determining determine VBG 3334 24 76 the the DT 3334 24 77 requirements requirement NNS 3334 24 78 of of IN 3334 24 79 the the DT 3334 24 80 busi- busi- JJ 3334 24 81 ness ness NN 3334 24 82 owners owner NNS 3334 24 83 ( ( -LRB- 3334 24 84 the the DT 3334 24 85 IRS IRS NNP 3334 24 86 business business NN 3334 24 87 operating operating NN 3334 24 88 divisions division NNS 3334 24 89 that that WDT 3334 24 90 provide provide VBP 3334 24 91 content content NN 3334 24 92 to to IN 3334 24 93 IRS.gov IRS.gov NNP 3334 24 94 , , , 3334 24 95 such such JJ 3334 24 96 as as IN 3334 24 97 Small Small NNP 3334 24 98 Business Business NNP 3334 24 99 and and CC 3334 24 100 Self Self NNP 3334 24 101 - - HYPH 3334 24 102 Employed Employed NNP 3334 24 103 , , , 3334 24 104 Wage Wage NNP 3334 24 105 and and CC 3334 24 106 Investment Investment NNP 3334 24 107 ) ) -RRB- 3334 24 108 for for IN 3334 24 109 directing direct VBG 3334 24 110 users user NNS 3334 24 111 to to IN 3334 24 112 relevant relevant JJ 3334 24 113 content content NN 3334 24 114 . . . 3334 25 1 It -PRON- PRP 3334 25 2 is be VBZ 3334 25 3 based base VBN 3334 25 4 on on IN 3334 25 5 the the DT 3334 25 6 assumption assumption NN 3334 25 7 that that IN 3334 25 8 a a DT 3334 25 9 Web web NN 3334 25 10 site site NN 3334 25 11 must must MD 3334 25 12 evolve evolve VB 3334 25 13 based base VBN 3334 25 14 on on IN 3334 25 15 its -PRON- PRP$ 3334 25 16 user user NN 3334 25 17 needs need NNS 3334 25 18 , , , 3334 25 19 rather rather RB 3334 25 20 than than IN 3334 25 21 expecting expect VBG 3334 25 22 users user NNS 3334 25 23 to to TO 3334 25 24 adapt adapt VB 3334 25 25 to to IN 3334 25 26 its -PRON- PRP$ 3334 25 27 singularities singularity NNS 3334 25 28 . . . 3334 26 1 To to IN 3334 26 2 sup- sup- JJ 3334 26 3 port port NN 3334 26 4 this this DT 3334 26 5 evolution evolution NN 3334 26 6 , , , 3334 26 7 this this DT 3334 26 8 approach approach NN 3334 26 9 leverages leverage VBZ 3334 26 10 techniques technique VBZ 3334 26 11 for for IN 3334 26 12 query query NN 3334 26 13 expansion expansion NN 3334 26 14 and and CC 3334 26 15 document document NN 3334 26 16 - - HYPH 3334 26 17 space space NN 3334 26 18 modification.7 modification.7 IN 3334 26 19 Dramatic dramatic JJ 3334 26 20 improvements improvement NNS 3334 26 21 in in IN 3334 26 22 quality quality NN 3334 26 23 of of IN 3334 26 24 service service NN 3334 26 25 to to IN 3334 26 26 the the DT 3334 26 27 user user NN 3334 26 28 have have VBP 3334 26 29 resulted result VBN 3334 26 30 , , , 3334 26 31 enhancing enhance VBG 3334 26 32 the the DT 3334 26 33 user user NN 3334 26 34 experience experience NN 3334 26 35 at at IN 3334 26 36 the the DT 3334 26 37 site site NN 3334 26 38 and and CC 3334 26 39 reducing reduce VBG 3334 26 40 the the DT 3334 26 41 need need NN 3334 26 42 to to TO 3334 26 43 contact contact VB 3334 26 44 the the DT 3334 26 45 Help Help NNP 3334 26 46 Desk Desk NNP 3334 26 47 . . . 3334 27 1 The the DT 3334 27 2 approach approach NN 3334 27 3 is be VBZ 3334 27 4 particularly particularly RB 3334 27 5 applicable applicable JJ 3334 27 6 for for IN 3334 27 7 those those DT 3334 27 8 government government NN 3334 27 9 , , , 3334 27 10 corporate corporate JJ 3334 27 11 , , , 3334 27 12 and and CC 3334 27 13 commercial commercial JJ 3334 27 14 Web web NN 3334 27 15 sites site NNS 3334 27 16 where where WRB 3334 27 17 there there EX 3334 27 18 is be VBZ 3334 27 19 some some DT 3334 27 20 control control NN 3334 27 21 over over IN 3334 27 22 the the DT 3334 27 23 content content NN 3334 27 24 , , , 3334 27 25 and and CC 3334 27 26 usage usage NN 3334 27 27 can can MD 3334 27 28 be be VB 3334 27 29 categorized categorize VBN 3334 27 30 into into IN 3334 27 31 regular regular JJ 3334 27 32 patterns pattern NNS 3334 27 33 . . . 3334 28 1 The the DT 3334 28 2 rest rest NN 3334 28 3 of of IN 3334 28 4 this this DT 3334 28 5 paper paper NN 3334 28 6 provides provide VBZ 3334 28 7 a a DT 3334 28 8 case case NN 3334 28 9 study study NN 3334 28 10 in in IN 3334 28 11 the the DT 3334 28 12 application application NN 3334 28 13 of of IN 3334 28 14 the the DT 3334 28 15 methodology methodology NN 3334 28 16 and and CC 3334 28 17 the the DT 3334 28 18 application application NN 3334 28 19 of of IN 3334 28 20 metrics metric NNS 3334 28 21 , , , 3334 28 22 in in IN 3334 28 23 addition addition NN 3334 28 24 to to IN 3334 28 25 precision precision NN 3334 28 26 and and CC 3334 28 27 recall recall NN 3334 28 28 , , , 3334 28 29 to to TO 3334 28 30 measure measure VB 3334 28 31 search search NN 3334 28 32 experience experience NN 3334 28 33 improvement improvement NN 3334 28 34 . . . 3334 29 1 ■ ■ NFP 3334 29 2 Conceptual conceptual JJ 3334 29 3 framework framework NN 3334 29 4 While while IN 3334 29 5 analysis analysis NN 3334 29 6 of of IN 3334 29 7 search search NN 3334 29 8 results result NNS 3334 29 9 often often RB 3334 29 10 focuses focus VBZ 3334 29 11 on on IN 3334 29 12 search search NN 3334 29 13 syntax syntax NN 3334 29 14 and and CC 3334 29 15 search search NN 3334 29 16 - - HYPH 3334 29 17 engine engine NN 3334 29 18 performance performance NN 3334 29 19 , , , 3334 29 20 there there EX 3334 29 21 are be VBP 3334 29 22 actu- actu- JJ 3334 29 23 ally ally NN 3334 29 24 several several JJ 3334 29 25 steps step NNS 3334 29 26 in in IN 3334 29 27 the the DT 3334 29 28 retrieval retrieval NN 3334 29 29 process process NN 3334 29 30 , , , 3334 29 31 from from IN 3334 29 32 the the DT 3334 29 33 user user NN 3334 29 34 identifying identify VBG 3334 29 35 an an DT 3334 29 36 information information NN 3334 29 37 need need NN 3334 29 38 to to IN 3334 29 39 the the DT 3334 29 40 user user NN 3334 29 41 receiving receive VBG 3334 29 42 and and CC 3334 29 43 reviewing review VBG 3334 29 44 query query NN 3334 29 45 results result NNS 3334 29 46 . . . 3334 30 1 As as IN 3334 30 2 shown show VBN 3334 30 3 in in IN 3334 30 4 figure figure NN 3334 30 5 1 1 CD 3334 30 6 , , , 3334 30 7 find- find- NNP 3334 30 8 ing ing NNP 3334 30 9 information information NN 3334 30 10 is be VBZ 3334 30 11 a a DT 3334 30 12 holistic holistic JJ 3334 30 13 process process NN 3334 30 14 . . . 3334 31 1 There there EX 3334 31 2 are be VBP 3334 31 3 several several JJ 3334 31 4 opportunities opportunity NNS 3334 31 5 to to TO 3334 31 6 improve improve VB 3334 31 7 the the DT 3334 31 8 whole whole JJ 3334 31 9 user user NN 3334 31 10 experience experience NN 3334 31 11 by by IN 3334 31 12 fine fine NN 3334 31 13 - - HYPH 3334 31 14 tuning tuning NN 3334 31 15 this this DT 3334 31 16 process process NN 3334 31 17 with with IN 3334 31 18 a a DT 3334 31 19 variety variety NN 3334 31 20 of of IN 3334 31 21 tools tool NNS 3334 31 22 — — : 3334 31 23 from from IN 3334 31 24 document document NN 3334 31 25 engineering engineering NN 3334 31 26 to to IN 3334 31 27 results result NNS 3334 31 28 categorization categorization NN 3334 31 29 . . . 3334 32 1 Once once IN 3334 32 2 the the DT 3334 32 3 user user NN 3334 32 4 and and CC 3334 32 5 business business NN 3334 32 6 - - HYPH 3334 32 7 owner owner NN 3334 32 8 needs need NNS 3334 32 9 are be VBP 3334 32 10 understood understand VBN 3334 32 11 , , , 3334 32 12 the the DT 3334 32 13 appropriate appropriate JJ 3334 32 14 tools tool NNS 3334 32 15 to to TO 3334 32 16 address address VB 3334 32 17 specific specific JJ 3334 32 18 issues issue NNS 3334 32 19 can can MD 3334 32 20 be be VB 3334 32 21 identified identify VBN 3334 32 22 . . . 3334 33 1 The the DT 3334 33 2 tools tool NNS 3334 33 3 in in IN 3334 33 4 our -PRON- PRP$ 3334 33 5 toolkit toolkit NNS 3334 33 6 are be VBP 3334 33 7 described describe VBN 3334 33 8 in in IN 3334 33 9 the the DT 3334 33 10 follow- follow- JJ 3334 33 11 ing ing NN 3334 33 12 sections section NNS 3334 33 13 . . . 3334 34 1 Document document NN 3334 34 2 engineering engineering NN 3334 34 3 Document Document NNP 3334 34 4 engineering engineering NN 3334 34 5 includes include VBZ 3334 34 6 : : : 3334 34 7 ■ ■ NFP 3334 34 8 Document document NN 3334 34 9 - - HYPH 3334 34 10 space space NN 3334 34 11 modification modification NN 3334 34 12 : : : 3334 34 13 Modifying modify VBG 3334 34 14 the the DT 3334 34 15 docu- docu- JJ 3334 34 16 ment ment JJ 3334 34 17 space space NN 3334 34 18 by by IN 3334 34 19 adding add VBG 3334 34 20 terms term NNS 3334 34 21 to to IN 3334 34 22 content content VB 3334 34 23 ( ( -LRB- 3334 34 24 especially especially RB 3334 34 25 to to IN 3334 34 26 titles title NNS 3334 34 27 ) ) -RRB- 3334 34 28 that that WDT 3334 34 29 are be VBP 3334 34 30 good good JJ 3334 34 31 discriminators discriminator NNS 3334 34 32 and and CC 3334 34 33 reflect reflect VBP 3334 34 34 terms term NNS 3334 34 35 commonly commonly RB 3334 34 36 entered enter VBN 3334 34 37 by by IN 3334 34 38 users user NNS 3334 34 39 . . . 3334 35 1 This this DT 3334 35 2 approach approach NN 3334 35 3 has have VBZ 3334 35 4 the the DT 3334 35 5 added add VBN 3334 35 6 benefit benefit NN 3334 35 7 of of IN 3334 35 8 making make VBG 3334 35 9 the the DT 3334 35 10 content content NN 3334 35 11 more more RBR 3334 35 12 under- under- XX 3334 35 13 standable standable JJ 3334 35 14 to to IN 3334 35 15 users user NNS 3334 35 16 . . . 3334 36 1 ■ ■ NFP 3334 36 2 Establishment establishment NN 3334 36 3 of of IN 3334 36 4 content content NN 3334 36 5 - - HYPH 3334 36 6 quality quality NN 3334 36 7 standards standard NNS 3334 36 8 : : : 3334 36 9 Defining define VBG 3334 36 10 business business NN 3334 36 11 processes process NNS 3334 36 12 that that WDT 3334 36 13 improve improve VBP 3334 36 14 content content JJ 3334 36 15 quality quality NN 3334 36 16 and and CC 3334 36 17 organization organization NN 3334 36 18 . . . 3334 37 1 Document document NN 3334 37 2 - - HYPH 3334 37 3 space space NN 3334 37 4 modification modification NN 3334 37 5 There there EX 3334 37 6 is be VBZ 3334 37 7 significant significant JJ 3334 37 8 syntactic syntactic JJ 3334 37 9 and and CC 3334 37 10 semantic semantic JJ 3334 37 11 imprecise- imprecise- NN 3334 37 12 ness ness NN 3334 37 13 in in IN 3334 37 14 the the DT 3334 37 15 English english JJ 3334 37 16 language language NN 3334 37 17 . . . 3334 38 1 In in IN 3334 38 2 addition addition NN 3334 38 3 , , , 3334 38 4 because because IN 3334 38 5 of of IN 3334 38 6 the the DT 3334 38 7 inadequacies inadequacy NNS 3334 38 8 of of IN 3334 38 9 human human JJ 3334 38 10 or or CC 3334 38 11 automatic automatic JJ 3334 38 12 keyword keyword NNP 3334 38 13 assign- assign- NNP 3334 38 14 ment ment JJ 3334 38 15 , , , 3334 38 16 standard standard JJ 3334 38 17 means mean NNS 3334 38 18 of of IN 3334 38 19 representing represent VBG 3334 38 20 documents document NNS 3334 38 21 in in IN 3334 38 22 indexes index NNS 3334 38 23 by by IN 3334 38 24 statistical statistical JJ 3334 38 25 term term NN 3334 38 26 associations association NNS 3334 38 27 and and CC 3334 38 28 frequency frequency NN 3334 38 29 counts count NNS 3334 38 30 or or CC 3334 38 31 by by IN 3334 38 32 adding add VBG 3334 38 33 metadata metadata NN 3334 38 34 tags tag NNS 3334 38 35 are be VBP 3334 38 36 not not RB 3334 38 37 definitive definitive JJ 3334 38 38 enough enough RB 3334 38 39 to to TO 3334 38 40 produce produce VB 3334 38 41 a a DT 3334 38 42 space space NN 3334 38 43 that that WDT 3334 38 44 is be VBZ 3334 38 45 an an DT 3334 38 46 exact exact JJ 3334 38 47 image image NN 3334 38 48 of of IN 3334 38 49 the the DT 3334 38 50 original original JJ 3334 38 51 documents document NNS 3334 38 52 . . . 3334 39 1 Document document NN 3334 39 2 - - HYPH 3334 39 3 space space NN 3334 39 4 modifica- modifica- NN 3334 39 5 tion tion NN 3334 39 6 moves move VBZ 3334 39 7 documents document NNS 3334 39 8 in in IN 3334 39 9 the the DT 3334 39 10 document document NN 3334 39 11 space space NN 3334 39 12 closer close JJR 3334 39 13 to to IN 3334 39 14 future future JJ 3334 39 15 similar similar JJ 3334 39 16 queries query NNS 3334 39 17 by by IN 3334 39 18 adding add VBG 3334 39 19 new new JJ 3334 39 20 terms term NNS 3334 39 21 or or CC 3334 39 22 modify- modify- NNP 3334 39 23 ing e VBG 3334 39 24 the the DT 3334 39 25 weight weight NN 3334 39 26 of of IN 3334 39 27 existing exist VBG 3334 39 28 terms term NNS 3334 39 29 in in IN 3334 39 30 the the DT 3334 39 31 content content NN 3334 39 32 ( ( -LRB- 3334 39 33 figure figure VB 3334 39 34 2).8 2).8 CD 3334 39 35 The the DT 3334 39 36 document document NN 3334 39 37 space space NN 3334 39 38 is be VBZ 3334 39 39 thus thus RB 3334 39 40 modified modify VBN 3334 39 41 to to TO 3334 39 42 improve improve VB 3334 39 43 retrieval retrieval NN 3334 39 44 . . . 3334 40 1 For for IN 3334 40 2 IRS.gov irs.gov PRP 3334 40 3 , , , 3334 40 4 rather rather RB 3334 40 5 than than IN 3334 40 6 adjusting adjust VBG 3334 40 7 content content NN 3334 40 8 weights weight NNS 3334 40 9 , , , 3334 40 10 titles title NNS 3334 40 11 and and CC 3334 40 12 content content NN 3334 40 13 are be VBP 3334 40 14 modified modify VBN 3334 40 15 to to TO 3334 40 16 adjust adjust VB 3334 40 17 to to IN 3334 40 18 changing change VBG 3334 40 19 terminology terminology NN 3334 40 20 and and CC 3334 40 21 user user NN 3334 40 22 needs need NNS 3334 40 23 . . . 3334 41 1 Establishment establishment NN 3334 41 2 of of IN 3334 41 3 content content NN 3334 41 4 - - HYPH 3334 41 5 quality quality NN 3334 41 6 standards standard NNS 3334 41 7 The the DT 3334 41 8 quality quality NN 3334 41 9 of of IN 3334 41 10 the the DT 3334 41 11 search search NN 3334 41 12 correlates correlate VBZ 3334 41 13 with with IN 3334 41 14 the the DT 3334 41 15 quality quality NN 3334 41 16 of of IN 3334 41 17 the the DT 3334 41 18 content content NN 3334 41 19 . . . 3334 42 1 Improved improve VBN 3334 42 2 search search NN 3334 42 3 results result NNS 3334 42 4 can can MD 3334 42 5 be be VB 3334 42 6 achieved achieve VBN 3334 42 7 by by IN 3334 42 8 applying apply VBG 3334 42 9 good good JJ 3334 42 10 content content NN 3334 42 11 - - HYPH 3334 42 12 creation creation NN 3334 42 13 practices practice NNS 3334 42 14 . . . 3334 43 1 Retrieval retrieval NN 3334 43 2 can can MD 3334 43 3 be be VB 3334 43 4 significantly significantly RB 3334 43 5 improved improve VBN 3334 43 6 by by IN 3334 43 7 addressing address VBG 3334 43 8 problems problem NNS 3334 43 9 observed observe VBN 3334 43 10 in in IN 3334 43 11 the the DT 3334 43 12 content content NN 3334 43 13 . . . 3334 44 1 These these DT 3334 44 2 problems problem NNS 3334 44 3 include include VBP 3334 44 4 inconsistencies inconsistency NNS 3334 44 5 in in IN 3334 44 6 term term NN 3334 44 7 use use NN 3334 44 8 — — : 3334 44 9 for for IN 3334 44 10 example example NN 3334 44 11 , , , 3334 44 12 Earned Earned NNP 3334 44 13 Income Income NNP 3334 44 14 Credit Credit NNP 3334 44 15 ( ( -LRB- 3334 44 16 EIC EIC NNP 3334 44 17 ) ) -RRB- 3334 44 18 ver- ver- NN 3334 44 19 sus sus NN 3334 44 20 Earned Earned NNP 3334 44 21 Income Income NNP 3334 44 22 Tax Tax NNP 3334 44 23 Credit Credit NNP 3334 44 24 ( ( -LRB- 3334 44 25 EITC)—duplicate EITC)—duplicate NNP 3334 44 26 content content NN 3334 44 27 , , , 3334 44 28 insufficiently insufficiently RB 3334 44 29 descriptive descriptive JJ 3334 44 30 page page NN 3334 44 31 titles title NNS 3334 44 32 , , , 3334 44 33 missing miss VBG 3334 44 34 document document NN 3334 44 35 summaries summary NNS 3334 44 36 , , , 3334 44 37 misspellings misspelling NNS 3334 44 38 , , , 3334 44 39 and and CC 3334 44 40 inconsistent inconsistent JJ 3334 44 41 spellings spelling NNS 3334 44 42 . . . 3334 45 1 Figure figure NN 3334 45 2 1 1 CD 3334 45 3 . . . 3334 46 1 The the DT 3334 46 2 Information Information NNP 3334 46 3 Retrieval Retrieval NNP 3334 46 4 Process Process NNP 3334 46 5 80 80 CD 3334 46 6 INFORMATION information NN 3334 46 7 TECHNOLOGY technology NN 3334 46 8 AND and CC 3334 46 9 LIBRARIES LIBRARIES NNP 3334 46 10 | | JJ 3334 46 11 JUNE JUNE NNP 3334 46 12 2006 2006 CD 3334 46 13 Processes process NNS 3334 46 14 to to TO 3334 46 15 improve improve VB 3334 46 16 content content JJ 3334 46 17 quality quality NN 3334 46 18 should should MD 3334 46 19 estab- estab- VB 3334 46 20 lish lish JJ 3334 46 21 standards standard NNS 3334 46 22 for for IN 3334 46 23 consistent consistent JJ 3334 46 24 term term NN 3334 46 25 usage usage NN 3334 46 26 in in IN 3334 46 27 content content NN 3334 46 28 , , , 3334 46 29 as as RB 3334 46 30 well well RB 3334 46 31 as as IN 3334 46 32 standards standard NNS 3334 46 33 for for IN 3334 46 34 consistent consistent JJ 3334 46 35 and and CC 3334 46 36 descriptive descriptive JJ 3334 46 37 naming naming NN 3334 46 38 of of IN 3334 46 39 content content NN 3334 46 40 types type NNS 3334 46 41 ( ( -LRB- 3334 46 42 for for IN 3334 46 43 example example NN 3334 46 44 , , , 3334 46 45 IRS IRS NNP 3334 46 46 types type NNS 3334 46 47 include include VBP 3334 46 48 forms form NNS 3334 46 49 , , , 3334 46 50 instructions instruction NNS 3334 46 51 , , , 3334 46 52 and and CC 3334 46 53 publications publication NNS 3334 46 54 ) ) -RRB- 3334 46 55 . . . 3334 47 1 These these DT 3334 47 2 processes process NNS 3334 47 3 will will MD 3334 47 4 not not RB 3334 47 5 only only RB 3334 47 6 improve improve VB 3334 47 7 search search NN 3334 47 8 precision precision NN 3334 47 9 , , , 3334 47 10 but but CC 3334 47 11 will will MD 3334 47 12 also also RB 3334 47 13 help help VB 3334 47 14 users user NNS 3334 47 15 identify identify VB 3334 47 16 appropriate appropriate JJ 3334 47 17 content content NN 3334 47 18 in in IN 3334 47 19 the the DT 3334 47 20 search search NN 3334 47 21 results result NNS 3334 47 22 . . . 3334 48 1 For for IN 3334 48 2 example example NN 3334 48 3 , , , 3334 48 4 content content NN 3334 48 5 entitled entitle VBN 3334 48 6 “ " `` 3334 48 7 Publication publication NN 3334 48 8 503 503 CD 3334 48 9 ” " '' 3334 48 10 in in IN 3334 48 11 response response NN 3334 48 12 to to IN 3334 48 13 the the DT 3334 48 14 query query NNP 3334 48 15 “ " `` 3334 48 16 child child NN 3334 48 17 care care NN 3334 48 18 ” " '' 3334 48 19 may may MD 3334 48 20 be be VB 3334 48 21 the the DT 3334 48 22 perfect perfect JJ 3334 48 23 answer answer NN 3334 48 24 ( ( -LRB- 3334 48 25 with with IN 3334 48 26 excellent excellent JJ 3334 48 27 precision precision NN 3334 48 28 and and CC 3334 48 29 recall recall NN 3334 48 30 ) ) -RRB- 3334 48 31 , , , 3334 48 32 but but CC 3334 48 33 the the DT 3334 48 34 user user NN 3334 48 35 will will MD 3334 48 36 not not RB 3334 48 37 recog- recog- VB 3334 48 38 nize nize VB 3334 48 39 it -PRON- PRP 3334 48 40 as as IN 3334 48 41 the the DT 3334 48 42 right right JJ 3334 48 43 answer answer NN 3334 48 44 . . . 3334 49 1 A a DT 3334 49 2 title title NN 3334 49 3 such such JJ 3334 49 4 as as IN 3334 49 5 “ " `` 3334 49 6 Publication publication NN 3334 49 7 503 503 CD 3334 49 8 : : : 3334 49 9 Child child NN 3334 49 10 and and CC 3334 49 11 Dependent Dependent NNP 3334 49 12 Care Care NNP 3334 49 13 Expenses Expenses NNP 3334 49 14 ” " '' 3334 49 15 will will MD 3334 49 16 clearly clearly RB 3334 49 17 point point VB 3334 49 18 the the DT 3334 49 19 user user NN 3334 49 20 to to IN 3334 49 21 the the DT 3334 49 22 relevant relevant JJ 3334 49 23 information information NN 3334 49 24 . . . 3334 50 1 Usability usability NN 3334 50 2 tests test NNS 3334 50 3 conducted conduct VBN 3334 50 4 in in IN 3334 50 5 March March NNP 3334 50 6 2005 2005 CD 3334 50 7 for for IN 3334 50 8 IRS.gov IRS.gov NNP 3334 50 9 confirmed confirm VBD 3334 50 10 that that IN 3334 50 11 content content NN 3334 50 12 organization organization NN 3334 50 13 plays play VBZ 3334 50 14 an an DT 3334 50 15 important important JJ 3334 50 16 role role NN 3334 50 17 in in IN 3334 50 18 the the DT 3334 50 19 perceived perceive VBN 3334 50 20 success success NN 3334 50 21 of of IN 3334 50 22 a a DT 3334 50 23 user user NN 3334 50 24 ’s ’s NN 3334 50 25 search search NN 3334 50 26 experi- experi- NN 3334 50 27 ence ence NN 3334 50 28 . . . 3334 51 1 Long long JJ 3334 51 2 pages page NNS 3334 51 3 of of IN 3334 51 4 links link NNS 3334 51 5 or or CC 3334 51 6 scrolling scroll VBG 3334 51 7 pages page NNS 3334 51 8 of of IN 3334 51 9 content content NN 3334 51 10 left leave VBD 3334 51 11 some some DT 3334 51 12 users user NNS 3334 51 13 confused confused JJ 3334 51 14 and and CC 3334 51 15 overwhelmed overwhelmed JJ 3334 51 16 , , , 3334 51 17 unable unable JJ 3334 51 18 to to TO 3334 51 19 find find VB 3334 51 20 the the DT 3334 51 21 needed needed JJ 3334 51 22 information information NN 3334 51 23 . . . 3334 52 1 For for IN 3334 52 2 these these DT 3334 52 3 queries query NNS 3334 52 4 , , , 3334 52 5 although although IN 3334 52 6 the the DT 3334 52 7 search search NN 3334 52 8 results result NNS 3334 52 9 were be VBD 3334 52 10 perfect perfect JJ 3334 52 11 , , , 3334 52 12 with with IN 3334 52 13 a a DT 3334 52 14 precision precision NN 3334 52 15 of of IN 3334 52 16 100 100 CD 3334 52 17 percent percent NN 3334 52 18 after after IN 3334 52 19 one one CD 3334 52 20 document document NN 3334 52 21 , , , 3334 52 22 the the DT 3334 52 23 search search NN 3334 52 24 experiences experience NNS 3334 52 25 were be VBD 3334 52 26 still still RB 3334 52 27 failures failure NNS 3334 52 28 . . . 3334 53 1 Query query NN 3334 53 2 enhancement enhancement NN 3334 53 3 The the DT 3334 53 4 technique technique NN 3334 53 5 of of IN 3334 53 6 relevance relevance NN 3334 53 7 feedback feedback NN 3334 53 8 for for IN 3334 53 9 query query NNP 3334 53 10 expansion expansion NN 3334 53 11 improves improve VBZ 3334 53 12 retrieval retrieval NN 3334 53 13 in in IN 3334 53 14 an an DT 3334 53 15 iterative iterative JJ 3334 53 16 fashion.9 fashion.9 NN 3334 53 17 According accord VBG 3334 53 18 to to IN 3334 53 19 this this DT 3334 53 20 approach approach NN 3334 53 21 , , , 3334 53 22 the the DT 3334 53 23 user user NN 3334 53 24 submits submit VBZ 3334 53 25 a a DT 3334 53 26 query query NN 3334 53 27 , , , 3334 53 28 reviews review VBZ 3334 53 29 the the DT 3334 53 30 search search NN 3334 53 31 results result NNS 3334 53 32 , , , 3334 53 33 and and CC 3334 53 34 then then RB 3334 53 35 reports report VBZ 3334 53 36 query query NN 3334 53 37 - - HYPH 3334 53 38 document document NN 3334 53 39 rel- rel- VBZ 3334 53 40 evance evance NN 3334 53 41 assessments assessment NNS 3334 53 42 to to IN 3334 53 43 the the DT 3334 53 44 system system NN 3334 53 45 . . . 3334 54 1 These these DT 3334 54 2 assessments assessment NNS 3334 54 3 are be VBP 3334 54 4 used use VBN 3334 54 5 to to TO 3334 54 6 modify modify VB 3334 54 7 the the DT 3334 54 8 initial initial JJ 3334 54 9 query query NN 3334 54 10 , , , 3334 54 11 that that RB 3334 54 12 is is RB 3334 54 13 , , , 3334 54 14 new new JJ 3334 54 15 terms term NNS 3334 54 16 are be VBP 3334 54 17 added add VBN 3334 54 18 to to IN 3334 54 19 the the DT 3334 54 20 initial initial JJ 3334 54 21 query query NN 3334 54 22 ( ( -LRB- 3334 54 23 hopefully hopefully RB 3334 54 24 ) ) -RRB- 3334 54 25 to to TO 3334 54 26 improve improve VB 3334 54 27 it -PRON- PRP 3334 54 28 , , , 3334 54 29 and and CC 3334 54 30 the the DT 3334 54 31 query query NN 3334 54 32 is be VBZ 3334 54 33 resubmitted resubmitte VBN 3334 54 34 . . . 3334 55 1 If if IN 3334 55 2 one one PRP 3334 55 3 visualizes visualize VBZ 3334 55 4 the the DT 3334 55 5 content content NN 3334 55 6 in in IN 3334 55 7 a a DT 3334 55 8 collection collection NN 3334 55 9 as as IN 3334 55 10 a a DT 3334 55 11 space space NN 3334 55 12 ( ( -LRB- 3334 55 13 figure figure NN 3334 55 14 3 3 CD 3334 55 15 ) ) -RRB- 3334 55 16 , , , 3334 55 17 this this DT 3334 55 18 approach approach NN 3334 55 19 attempts attempt VBZ 3334 55 20 to to TO 3334 55 21 move move VB 3334 55 22 the the DT 3334 55 23 query query NN 3334 55 24 closer close RBR 3334 55 25 to to IN 3334 55 26 the the DT 3334 55 27 most most RBS 3334 55 28 relevant relevant JJ 3334 55 29 content content NN 3334 55 30 . . . 3334 56 1 A a DT 3334 56 2 drawback drawback NN 3334 56 3 of of IN 3334 56 4 relevance relevance NN 3334 56 5 feedback feedback NN 3334 56 6 is be VBZ 3334 56 7 that that IN 3334 56 8 it -PRON- PRP 3334 56 9 is be VBZ 3334 56 10 not not RB 3334 56 11 generally generally RB 3334 56 12 collected collect VBN 3334 56 13 over over IN 3334 56 14 multiple multiple JJ 3334 56 15 user user NN 3334 56 16 sessions session NNS 3334 56 17 and and CC 3334 56 18 over over IN 3334 56 19 time time NN 3334 56 20 , , , 3334 56 21 so so CC 3334 56 22 the the DT 3334 56 23 next next JJ 3334 56 24 user user NN 3334 56 25 submitting submit VBG 3334 56 26 the the DT 3334 56 27 same same JJ 3334 56 28 query query NN 3334 56 29 has have VBZ 3334 56 30 to to TO 3334 56 31 go go VB 3334 56 32 through through IN 3334 56 33 the the DT 3334 56 34 same same JJ 3334 56 35 process process NN 3334 56 36 of of IN 3334 56 37 providing provide VBG 3334 56 38 results result NNS 3334 56 39 evalu- evalu- VBZ 3334 56 40 ations ation NNS 3334 56 41 for for IN 3334 56 42 query query NN 3334 56 43 expansion expansion NN 3334 56 44 . . . 3334 57 1 Borlund Borlund NNP 3334 57 2 has have VBZ 3334 57 3 noted note VBN 3334 57 4 that that IN 3334 57 5 , , , 3334 57 6 given give VBN 3334 57 7 that that IN 3334 57 8 an an DT 3334 57 9 individual individual JJ 3334 57 10 user user NN 3334 57 11 ’s 's POS 3334 57 12 information information NN 3334 57 13 need need NN 3334 57 14 is be VBZ 3334 57 15 personal personal JJ 3334 57 16 and and CC 3334 57 17 may may MD 3334 57 18 change change VB 3334 57 19 over over IN 3334 57 20 session session NN 3334 57 21 time time NN 3334 57 22 , , , 3334 57 23 relevance relevance NN 3334 57 24 assessments assessment NNS 3334 57 25 can can MD 3334 57 26 only only RB 3334 57 27 be be VB 3334 57 28 made make VBN 3334 57 29 by by IN 3334 57 30 a a DT 3334 57 31 user user NN 3334 57 32 at at IN 3334 57 33 a a DT 3334 57 34 particular particular JJ 3334 57 35 time.10 time.10 NNP 3334 57 36 However however RB 3334 57 37 , , , 3334 57 38 on on IN 3334 57 39 IRS.gov IRS.gov NNP 3334 57 40 , , , 3334 57 41 where where WRB 3334 57 42 there there EX 3334 57 43 are be VBP 3334 57 44 many many JJ 3334 57 45 common common JJ 3334 57 46 queries query NNS 3334 57 47 for for IN 3334 57 48 which which WDT 3334 57 49 there there EX 3334 57 50 is be VBZ 3334 57 51 a a DT 3334 57 52 clear clear JJ 3334 57 53 best good JJS 3334 57 54 - - HYPH 3334 57 55 guess guess NN 3334 57 56 response response NN 3334 57 57 , , , 3334 57 58 there there EX 3334 57 59 is be VBZ 3334 57 60 valuable valuable JJ 3334 57 61 relevance relevance NN 3334 57 62 information information NN 3334 57 63 that that WDT 3334 57 64 , , , 3334 57 65 if if IN 3334 57 66 captured capture VBN 3334 57 67 once once RB 3334 57 68 , , , 3334 57 69 could could MD 3334 57 70 benefit benefit VB 3334 57 71 tens ten NNS 3334 57 72 of of IN 3334 57 73 thousands thousand NNS 3334 57 74 of of IN 3334 57 75 users user NNS 3334 57 76 for for IN 3334 57 77 specific specific JJ 3334 57 78 queries query NNS 3334 57 79 . . . 3334 58 1 In in IN 3334 58 2 fact fact NN 3334 58 3 , , , 3334 58 4 in in IN 3334 58 5 April April NNP 3334 58 6 2005 2005 CD 3334 58 7 , , , 3334 58 8 the the DT 3334 58 9 top top JJ 3334 58 10 four four CD 3334 58 11 hundred hundred CD 3334 58 12 queries query NNS 3334 58 13 represented represent VBD 3334 58 14 almost almost RB 3334 58 15 half half NN 3334 58 16 of of IN 3334 58 17 all all PDT 3334 58 18 the the DT 3334 58 19 queries query NNS 3334 58 20 . . . 3334 59 1 Another another DT 3334 59 2 drawback drawback NN 3334 59 3 of of IN 3334 59 4 the the DT 3334 59 5 relevance relevance NN 3334 59 6 - - HYPH 3334 59 7 feedback feedback NN 3334 59 8 ap- ap- NNP 3334 59 9 proach proach NN 3334 59 10 is be VBZ 3334 59 11 that that IN 3334 59 12 it -PRON- PRP 3334 59 13 forces force VBZ 3334 59 14 the the DT 3334 59 15 user user NN 3334 59 16 , , , 3334 59 17 novice novice NN 3334 59 18 or or CC 3334 59 19 expert expert NN 3334 59 20 , , , 3334 59 21 to to TO 3334 59 22 become become VB 3334 59 23 engaged engage VBN 3334 59 24 in in IN 3334 59 25 the the DT 3334 59 26 search search NN 3334 59 27 process process NN 3334 59 28 . . . 3334 60 1 As as IN 3334 60 2 noted note VBN 3334 60 3 previ- previ- NNS 3334 60 4 ously ously RB 3334 60 5 , , , 3334 60 6 users user NNS 3334 60 7 are be VBP 3334 60 8 generally generally RB 3334 60 9 not not RB 3334 60 10 interested interested JJ 3334 60 11 in in IN 3334 60 12 becoming become VBG 3334 60 13 search search NN 3334 60 14 experts expert NNS 3334 60 15 or or CC 3334 60 16 in in IN 3334 60 17 becoming become VBG 3334 60 18 intimately intimately RB 3334 60 19 involved involved JJ 3334 60 20 in in IN 3334 60 21 the the DT 3334 60 22 process process NN 3334 60 23 of of IN 3334 60 24 search search NN 3334 60 25 . . . 3334 61 1 The the DT 3334 61 2 relevance relevance NN 3334 61 3 - - HYPH 3334 61 4 feedback feedback NN 3334 61 5 approach approach NN 3334 61 6 tries try VBZ 3334 61 7 to to TO 3334 61 8 change change VB 3334 61 9 users user NNS 3334 61 10 ’ ’ POS 3334 61 11 behavior behavior NN 3334 61 12 and and CC 3334 61 13 forces force VBZ 3334 61 14 them -PRON- PRP 3334 61 15 to to TO 3334 61 16 find find VB 3334 61 17 the the DT 3334 61 18 specific specific JJ 3334 61 19 word word NN 3334 61 20 or or CC 3334 61 21 words word NNS 3334 61 22 that that WDT 3334 61 23 will will MD 3334 61 24 best well RBS 3334 61 25 retrieve retrieve VB 3334 61 26 the the DT 3334 61 27 relevant relevant JJ 3334 61 28 information information NN 3334 61 29 . . . 3334 62 1 In in IN 3334 62 2 fact fact NN 3334 62 3 , , , 3334 62 4 some some DT 3334 62 5 research research NN 3334 62 6 has have VBZ 3334 62 7 shown show VBN 3334 62 8 that that IN 3334 62 9 the the DT 3334 62 10 potential potential JJ 3334 62 11 benefits benefit NNS 3334 62 12 of of IN 3334 62 13 relevance relevance NN 3334 62 14 feedback feedback NN 3334 62 15 may may MD 3334 62 16 be be VB 3334 62 17 hard hard JJ 3334 62 18 to to TO 3334 62 19 achieve achieve VB 3334 62 20 primarily primarily RB 3334 62 21 because because IN 3334 62 22 searchers searcher NNS 3334 62 23 have have VBP 3334 62 24 difficulty difficulty NN 3334 62 25 find- find- VB 3334 62 26 ing e VBG 3334 62 27 useful useful JJ 3334 62 28 terms term NNS 3334 62 29 for for IN 3334 62 30 effective effective JJ 3334 62 31 query query NN 3334 62 32 expansion.11 expansion.11 NNP 3334 62 33 To to TO 3334 62 34 avoid avoid VB 3334 62 35 requiring require VBG 3334 62 36 users user NNS 3334 62 37 to to TO 3334 62 38 submit submit VB 3334 62 39 relevance relevance NN 3334 62 40 - - HYPH 3334 62 41 feedback feedback NN 3334 62 42 judgments judgment NNS 3334 62 43 , , , 3334 62 44 the the DT 3334 62 45 methodology methodology NN 3334 62 46 uses use VBZ 3334 62 47 alternative alternative JJ 3334 62 48 approaches approach NNS 3334 62 49 for for IN 3334 62 50 gathering gather VBG 3334 62 51 feedback feedback NN 3334 62 52 : : : 3334 62 53 ( ( -LRB- 3334 62 54 1 1 LS 3334 62 55 ) ) -RRB- 3334 62 56 mining mining NN 3334 62 57 sources source NNS 3334 62 58 of of IN 3334 62 59 input input NN 3334 62 60 that that WDT 3334 62 61 do do VBP 3334 62 62 not not RB 3334 62 63 require require VB 3334 62 64 any any DT 3334 62 65 additional additional JJ 3334 62 66 involvement involvement NN 3334 62 67 on on IN 3334 62 68 the the DT 3334 62 69 part part NN 3334 62 70 of of IN 3334 62 71 the the DT 3334 62 72 users user NNS 3334 62 73 ; ; : 3334 62 74 and and CC 3334 62 75 ( ( -LRB- 3334 62 76 2 2 LS 3334 62 77 ) ) -RRB- 3334 62 78 soliciting solicit VBG 3334 62 79 relevance relevance NN 3334 62 80 judgments judgment NNS 3334 62 81 from from IN 3334 62 82 subject subject JJ 3334 62 83 matter matter NN 3334 62 84 experts expert NNS 3334 62 85 . . . 3334 63 1 As as IN 3334 63 2 noted note VBN 3334 63 3 above above IN 3334 63 4 , , , 3334 63 5 while while IN 3334 63 6 best good JJS 3334 63 7 results result NNS 3334 63 8 may may MD 3334 63 9 be be VB 3334 63 10 different different JJ 3334 63 11 per per IN 3334 63 12 task task NN 3334 63 13 and and CC 3334 63 14 per per IN 3334 63 15 user user NN 3334 63 16 , , , 3334 63 17 particularly particularly RB 3334 63 18 given give VBN 3334 63 19 the the DT 3334 63 20 shortness shortness NN 3334 63 21 of of IN 3334 63 22 the the DT 3334 63 23 queries query NNS 3334 63 24 , , , 3334 63 25 our -PRON- PRP$ 3334 63 26 goal goal NN 3334 63 27 is be VBZ 3334 63 28 to to TO 3334 63 29 maximize maximize VB 3334 63 30 the the DT 3334 63 31 good good JJ 3334 63 32 results result NNS 3334 63 33 for for IN 3334 63 34 the the DT 3334 63 35 maximum maximum JJ 3334 63 36 number number NN 3334 63 37 of of IN 3334 63 38 people people NNS 3334 63 39 . . . 3334 64 1 Best good JJS 3334 64 2 - - HYPH 3334 64 3 guess guess VB 3334 64 4 results result NNS 3334 64 5 are be VBP 3334 64 6 derived derive VBN 3334 64 7 from from IN 3334 64 8 a a DT 3334 64 9 variety variety NN 3334 64 10 of of IN 3334 64 11 sources source NNS 3334 64 12 , , , 3334 64 13 including include VBG 3334 64 14 usability usability NN 3334 64 15 testing testing NN 3334 64 16 , , , 3334 64 17 satisfaction satisfaction NN 3334 64 18 survey survey NN 3334 64 19 questionnaires questionnaire NNS 3334 64 20 , , , 3334 64 21 and and CC 3334 64 22 business- business- XX 3334 64 23 content content NN 3334 64 24 owners owner NNS 3334 64 25 . . . 3334 65 1 For for IN 3334 65 2 example example NN 3334 65 3 , , , 3334 65 4 users user NNS 3334 65 5 entering enter VBG 3334 65 6 the the DT 3334 65 7 common common JJ 3334 65 8 query query NN 3334 65 9 “ " `` 3334 65 10 1040ez 1040ez NN 3334 65 11 ” " '' 3334 65 12 can can MD 3334 65 13 be be VB 3334 65 14 looking look VBG 3334 65 15 for for IN 3334 65 16 information information NN 3334 65 17 on on IN 3334 65 18 the the DT 3334 65 19 form form NN 3334 65 20 or or CC 3334 65 21 the the DT 3334 65 22 form form NN 3334 65 23 itself -PRON- PRP 3334 65 24 . . . 3334 66 1 Given give VBN 3334 66 2 that that DT 3334 66 3 — — : 3334 66 4 as as IN 3334 66 5 shown show VBN 3334 66 6 in in IN 3334 66 7 table table NN 3334 66 8 1 1 CD 3334 66 9 ( ( -LRB- 3334 66 10 based base VBN 3334 66 11 on on IN 3334 66 12 the the DT 3334 66 13 responses response NNS 3334 66 14 of of IN 3334 66 15 11,715 11,715 CD 3334 66 16 users user NNS 3334 66 17 to to TO 3334 66 18 satisfaction satisfaction VB 3334 66 19 sur- sur- NN 3334 66 20 veys vey NNS 3334 66 21 in in IN 3334 66 22 2005)—the 2005)—the CD 3334 66 23 goal goal NN 3334 66 24 of of IN 3334 66 25 39 39 CD 3334 66 26 percent percent NN 3334 66 27 of of IN 3334 66 28 IRS.gov irs.gov FW 3334 66 29 searchers searcher NNS 3334 66 30 is be VBZ 3334 66 31 to to TO 3334 66 32 download download VB 3334 66 33 a a DT 3334 66 34 form form NN 3334 66 35 as as IN 3334 66 36 opposed oppose VBN 3334 66 37 to to IN 3334 66 38 28 28 CD 3334 66 39 percent percent NN 3334 66 40 seeking seek VBG 3334 66 41 to to TO 3334 66 42 obtain obtain VB 3334 66 43 general general JJ 3334 66 44 tax tax NN 3334 66 45 information information NN 3334 66 46 , , , 3334 66 47 the the DT 3334 66 48 retrieval retrieval NN 3334 66 49 of of IN 3334 66 50 the the DT 3334 66 51 1040ez 1040ez JJ 3334 66 52 form form NN 3334 66 53 and and CC 3334 66 54 its -PRON- PRP$ 3334 66 55 instructions instruction NNS 3334 66 56 is be VBZ 3334 66 57 prioritized prioritize VBN 3334 66 58 , , , 3334 66 59 while while IN 3334 66 60 also also RB 3334 66 61 retrieving retrieve VBG 3334 66 62 any any DT 3334 66 63 general general JJ 3334 66 64 related related JJ 3334 66 65 information information NN 3334 66 66 . . . 3334 67 1 Figure figure NN 3334 67 2 2 2 CD 3334 67 3 . . . 3334 68 1 Document document NN 3334 68 2 - - HYPH 3334 68 3 space space NN 3334 68 4 modification modification NN 3334 68 5 Figure figure NN 3334 68 6 3 3 CD 3334 68 7 . . . 3334 69 1 Query query JJ 3334 69 2 modification modification NN 3334 69 3 ARTICLE article NN 3334 69 4 TITLE TITLE NNP 3334 69 5 | | NNP 3334 69 6 AUTHOR AUTHOR NNP 3334 69 7 81A 81A NNP 3334 69 8 DYNAMIC DYNAMIC VBZ 3334 69 9 METHODOLOGY methodology NN 3334 69 10 FOR for IN 3334 69 11 IMPROVING improve VBG 3334 69 12 THE the DT 3334 69 13 SEARCH SEARCH NNS 3334 69 14 EXPERIENCE EXPERIENCE NNP 3334 69 15 | | CD 3334 69 16 KERCHNER kerchner NN 3334 69 17 81 81 CD 3334 69 18 We -PRON- PRP 3334 69 19 can can MD 3334 69 20 determine determine VB 3334 69 21 the the DT 3334 69 22 best good JJS 3334 69 23 - - HYPH 3334 69 24 guess guess VB 3334 69 25 results result NNS 3334 69 26 as as IN 3334 69 27 follows follow VBZ 3334 69 28 : : : 3334 69 29 ■ ■ NFP 3334 69 30 Review review VB 3334 69 31 the the DT 3334 69 32 search search NN 3334 69 33 results result VBZ 3334 69 34 for for IN 3334 69 35 terms term NNS 3334 69 36 that that WDT 3334 69 37 are be VBP 3334 69 38 on on IN 3334 69 39 the the DT 3334 69 40 frequently frequently RB 3334 69 41 entered enter VBN 3334 69 42 search search NN 3334 69 43 - - HYPH 3334 69 44 terms term NNS 3334 69 45 list list VBP 3334 69 46 ■ ■ NFP 3334 69 47 Review Review NNP 3334 69 48 Help Help NNP 3334 69 49 Desk Desk NNP 3334 69 50 contacts contact NNS 3334 69 51 , , , 3334 69 52 satisfaction satisfaction NN 3334 69 53 - - HYPH 3334 69 54 survey survey NN 3334 69 55 com- com- NN 3334 69 56 ments ment NNS 3334 69 57 , , , 3334 69 58 and and CC 3334 69 59 zero zero CD 3334 69 60 - - HYPH 3334 69 61 results result NNS 3334 69 62 reports report NNS 3334 69 63 to to TO 3334 69 64 identify identify VB 3334 69 65 infor- infor- IN 3334 69 66 mation mation NN 3334 69 67 users user NNS 3334 69 68 who who WP 3334 69 69 are be VBP 3334 69 70 having have VBG 3334 69 71 trouble trouble NN 3334 69 72 finding find VBG 3334 69 73 or or CC 3334 69 74 understanding understanding NN 3334 69 75 ■ ■ NFP 3334 69 76 Identify identify VB 3334 69 77 best good JJS 3334 69 78 results result NNS 3334 69 79 by by IN 3334 69 80 working work VBG 3334 69 81 with with IN 3334 69 82 the the DT 3334 69 83 business business NN 3334 69 84 owners owner NNS 3334 69 85 as as IN 3334 69 86 necessary necessary JJ 3334 69 87 ■ ■ NFP 3334 69 88 Analyze analyze VB 3334 69 89 why why WRB 3334 69 90 best good JJS 3334 69 91 results result NNS 3334 69 92 are be VBP 3334 69 93 not not RB 3334 69 94 being be VBG 3334 69 95 retrieved retrieve VBN 3334 69 96 for for IN 3334 69 97 a a DT 3334 69 98 particular particular JJ 3334 69 99 query query NN 3334 69 100 ■ ■ NFP 3334 69 101 Add add VB 3334 69 102 appropriate appropriate JJ 3334 69 103 synonyms synonyms NN 3334 69 104 for for IN 3334 69 105 this this DT 3334 69 106 and and CC 3334 69 107 relat- relat- JJ 3334 69 108 ed ed NN 3334 69 109 queries query NNS 3334 69 110 ■ ■ NFP 3334 69 111 Engineer Engineer NNP 3334 69 112 relevant relevant JJ 3334 69 113 documents document NNS 3334 69 114 ( ( -LRB- 3334 69 115 as as IN 3334 69 116 described describe VBN 3334 69 117 above above RB 3334 69 118 ) ) -RRB- 3334 69 119 In in IN 3334 69 120 this this DT 3334 69 121 way way NN 3334 69 122 , , , 3334 69 123 the the DT 3334 69 124 thesaurus thesaurus NN 3334 69 125 , , , 3334 69 126 as as IN 3334 69 127 the the DT 3334 69 128 source source NN 3334 69 129 for for IN 3334 69 130 query query NN 3334 69 131 enhancement enhancement NN 3334 69 132 , , , 3334 69 133 is be VBZ 3334 69 134 an an DT 3334 69 135 evolving evolve VBG 3334 69 136 structure structure NN 3334 69 137 that that WDT 3334 69 138 adapts adapt VBZ 3334 69 139 to to IN 3334 69 140 the the DT 3334 69 141 needs need NNS 3334 69 142 of of IN 3334 69 143 the the DT 3334 69 144 users user NNS 3334 69 145 rather rather RB 3334 69 146 than than IN 3334 69 147 being be VBG 3334 69 148 a a DT 3334 69 149 fixed fix VBN 3334 69 150 entity entity NN 3334 69 151 of of IN 3334 69 152 elements element NNS 3334 69 153 based base VBN 3334 69 154 on on IN 3334 69 155 someone someone NN 3334 69 156 ’s ’s POS 3334 69 157 idea idea NN 3334 69 158 of of IN 3334 69 159 a a DT 3334 69 160 standardized standardized JJ 3334 69 161 vocabulary vocabulary NN 3334 69 162 . . . 3334 70 1 Search search NN 3334 70 2 improvement improvement NN 3334 70 3 We -PRON- PRP 3334 70 4 can can MD 3334 70 5 intercept intercept VB 3334 70 6 very very RB 3334 70 7 popular popular JJ 3334 70 8 queries query NNS 3334 70 9 and and CC 3334 70 10 return return VB 3334 70 11 a a DT 3334 70 12 set set NN 3334 70 13 of of IN 3334 70 14 preconfigured preconfigure VBN 3334 70 15 results result NNS 3334 70 16 or or CC 3334 70 17 a a DT 3334 70 18 quick quick JJ 3334 70 19 link link NN 3334 70 20 at at IN 3334 70 21 the the DT 3334 70 22 top top NN 3334 70 23 of of IN 3334 70 24 the the DT 3334 70 25 search search NN 3334 70 26 - - HYPH 3334 70 27 results result NNS 3334 70 28 listing listing NN 3334 70 29 . . . 3334 71 1 For for IN 3334 71 2 example example NN 3334 71 3 , , , 3334 71 4 the the DT 3334 71 5 user user NN 3334 71 6 enter- enter- NNP 3334 71 7 ing ing NNP 3334 71 8 “ " `` 3334 71 9 1040 1040 CD 3334 71 10 ” " '' 3334 71 11 sees see VBZ 3334 71 12 a a DT 3334 71 13 list list NN 3334 71 14 of of IN 3334 71 15 the the DT 3334 71 16 most most RBS 3334 71 17 popular popular JJ 3334 71 18 1040-related 1040-relate VBN 3334 71 19 forms form NNS 3334 71 20 and and CC 3334 71 21 instructions instruction NNS 3334 71 22 in in IN 3334 71 23 addition addition NN 3334 71 24 to to IN 3334 71 25 a a DT 3334 71 26 list list NN 3334 71 27 of of IN 3334 71 28 other other JJ 3334 71 29 search search NN 3334 71 30 results result NNS 3334 71 31 . . . 3334 72 1 There there EX 3334 72 2 were be VBD 3334 72 3 more more JJR 3334 72 4 than than IN 3334 72 5 31,000 31,000 CD 3334 72 6 users user NNS 3334 72 7 in in IN 3334 72 8 April April NNP 3334 72 9 2005 2005 CD 3334 72 10 who who WP 3334 72 11 requested request VBD 3334 72 12 the the DT 3334 72 13 I-9 I-9 NNP 3334 72 14 form form NN 3334 72 15 . . . 3334 73 1 Since since IN 3334 73 2 the the DT 3334 73 3 form form NN 3334 73 4 is be VBZ 3334 73 5 not not RB 3334 73 6 an an DT 3334 73 7 IRS IRS NNP 3334 73 8 form form NN 3334 73 9 , , , 3334 73 10 users user NNS 3334 73 11 are be VBP 3334 73 12 presented present VBN 3334 73 13 with with IN 3334 73 14 a a DT 3334 73 15 link link NN 3334 73 16 to to IN 3334 73 17 the the DT 3334 73 18 Bureau Bureau NNP 3334 73 19 of of IN 3334 73 20 Citizen Citizen NNP 3334 73 21 and and CC 3334 73 22 Immigration Immigration NNP 3334 73 23 Services Services NNPS 3334 73 24 Web web NN 3334 73 25 site site NN 3334 73 26 . . . 3334 74 1 The the DT 3334 74 2 tens ten NNS 3334 74 3 of of IN 3334 74 4 thousands thousand NNS 3334 74 5 of of IN 3334 74 6 users user NNS 3334 74 7 who who WP 3334 74 8 look look VBP 3334 74 9 for for IN 3334 74 10 state state NN 3334 74 11 tax tax NN 3334 74 12 forms form NNS 3334 74 13 on on IN 3334 74 14 IRS.gov IRS.gov NNS 3334 74 15 are be VBP 3334 74 16 directed direct VBN 3334 74 17 either either CC 3334 74 18 to to IN 3334 74 19 the the DT 3334 74 20 spe- spe- NN 3334 74 21 cific cific JJ 3334 74 22 state state NN 3334 74 23 - - HYPH 3334 74 24 tax tax NN 3334 74 25 - - HYPH 3334 74 26 form form NN 3334 74 27 Web- web- NN 3334 74 28 site site NN 3334 74 29 page page NN 3334 74 30 or or CC 3334 74 31 to to IN 3334 74 32 a a DT 3334 74 33 page page NN 3334 74 34 with with IN 3334 74 35 links link NNS 3334 74 36 to to IN 3334 74 37 state state NN 3334 74 38 tax tax NN 3334 74 39 sites site NNS 3334 74 40 . . . 3334 75 1 This this DT 3334 75 2 unique unique JJ 3334 75 3 and and CC 3334 75 4 user user NN 3334 75 5 - - HYPH 3334 75 6 friendly friendly JJ 3334 75 7 approach approach NN 3334 75 8 provides provide VBZ 3334 75 9 a a DT 3334 75 10 sig- sig- RB 3334 75 11 nificant nificant JJ 3334 75 12 improvement improvement NN 3334 75 13 over over IN 3334 75 14 a a DT 3334 75 15 page page NN 3334 75 16 that that WDT 3334 75 17 tells tell VBZ 3334 75 18 the the DT 3334 75 19 user user NN 3334 75 20 that that IN 3334 75 21 there there EX 3334 75 22 is be VBZ 3334 75 23 no no DT 3334 75 24 matching matching NN 3334 75 25 result result NN 3334 75 26 , , , 3334 75 27 leaving leave VBG 3334 75 28 him -PRON- PRP 3334 75 29 to to TO 3334 75 30 fend fend VB 3334 75 31 for for IN 3334 75 32 himself -PRON- PRP 3334 75 33 . . . 3334 76 1 Another another DT 3334 76 2 technique technique NN 3334 76 3 for for IN 3334 76 4 improving improve VBG 3334 76 5 search search NN 3334 76 6 preci- preci- -RRB- 3334 76 7 sion sion NN 3334 76 8 ( ( -LRB- 3334 76 9 not not RB 3334 76 10 currently currently RB 3334 76 11 used use VBN 3334 76 12 for for IN 3334 76 13 IRS.gov irs.gov NN 3334 76 14 ) ) -RRB- 3334 76 15 is be VBZ 3334 76 16 to to TO 3334 76 17 tune tune VB 3334 76 18 and and CC 3334 76 19 adjust adjust VB 3334 76 20 parameters parameter NNS 3334 76 21 in in IN 3334 76 22 the the DT 3334 76 23 search search NN 3334 76 24 engine engine NN 3334 76 25 , , , 3334 76 26 such such JJ 3334 76 27 as as IN 3334 76 28 the the DT 3334 76 29 relative relative JJ 3334 76 30 weighting weighting NN 3334 76 31 of of IN 3334 76 32 basic basic JJ 3334 76 33 metadata metadata NN 3334 76 34 tags tag NNS 3334 76 35 such such JJ 3334 76 36 as as IN 3334 76 37 title title NN 3334 76 38 ( ( -LRB- 3334 76 39 if if IN 3334 76 40 they -PRON- PRP 3334 76 41 are be VBP 3334 76 42 used use VBN 3334 76 43 in in IN 3334 76 44 the the DT 3334 76 45 relevance relevance NN 3334 76 46 calculation calculation NN 3334 76 47 ) ) -RRB- 3334 76 48 . . . 3334 77 1 Results result NNS 3334 77 2 - - HYPH 3334 77 3 ranking rank VBG 3334 77 4 improvement improvement NN 3334 77 5 The the DT 3334 77 6 search search NN 3334 77 7 results result NNS 3334 77 8 can can MD 3334 77 9 be be VB 3334 77 10 programmatically programmatically RB 3334 77 11 re re VBN 3334 77 12 - - VBN 3334 77 13 ranked rank VBN 3334 77 14 before before IN 3334 77 15 being be VBG 3334 77 16 presented present VBN 3334 77 17 to to IN 3334 77 18 the the DT 3334 77 19 user user NN 3334 77 20 . . . 3334 78 1 This this DT 3334 78 2 approach approach NN 3334 78 3 ( ( -LRB- 3334 78 4 not not RB 3334 78 5 used use VBN 3334 78 6 as as IN 3334 78 7 yet yet RB 3334 78 8 on on IN 3334 78 9 IRS.gov IRS.gov NNP 3334 78 10 ) ) -RRB- 3334 78 11 is be VBZ 3334 78 12 a a DT 3334 78 13 variation variation NN 3334 78 14 on on IN 3334 78 15 the the DT 3334 78 16 quick quick JJ 3334 78 17 links link NNS 3334 78 18 described describe VBN 3334 78 19 above above IN 3334 78 20 for for IN 3334 78 21 re re VBG 3334 78 22 - - VBG 3334 78 23 ranking rank VBG 3334 78 24 more more JJR 3334 78 25 than than IN 3334 78 26 one one CD 3334 78 27 result result NN 3334 78 28 . . . 3334 79 1 Categorization categorization NN 3334 79 2 A a DT 3334 79 3 large large JJ 3334 79 4 set set NN 3334 79 5 of of IN 3334 79 6 search search NN 3334 79 7 results result NNS 3334 79 8 can can MD 3334 79 9 be be VB 3334 79 10 automatically automatically RB 3334 79 11 catego- catego- JJ 3334 79 12 rized rize VBN 3334 79 13 into into IN 3334 79 14 subsets subset NNS 3334 79 15 to to TO 3334 79 16 help help VB 3334 79 17 the the DT 3334 79 18 user user NN 3334 79 19 find find VB 3334 79 20 the the DT 3334 79 21 information information NN 3334 79 22 he -PRON- PRP 3334 79 23 needs need VBZ 3334 79 24 . . . 3334 80 1 In in IN 3334 80 2 addition addition NN 3334 80 3 , , , 3334 80 4 a a DT 3334 80 5 “ " `` 3334 80 6 search search NN 3334 80 7 within within IN 3334 80 8 a a DT 3334 80 9 search search NN 3334 80 10 ” " '' 3334 80 11 function function NN 3334 80 12 is be VBZ 3334 80 13 available available JJ 3334 80 14 to to TO 3334 80 15 help help VB 3334 80 16 the the DT 3334 80 17 user user NN 3334 80 18 narrow narrow VB 3334 80 19 down down RP 3334 80 20 results result NNS 3334 80 21 . . . 3334 81 1 Research research NN 3334 81 2 to to TO 3334 81 3 be be VB 3334 81 4 conducted conduct VBN 3334 81 5 on on IN 3334 81 6 commercial commercial JJ 3334 81 7 products product NNS 3334 81 8 to to TO 3334 81 9 support support VB 3334 81 10 auto- auto- NNP 3334 81 11 matic matic JJ 3334 81 12 categorization categorization NN 3334 81 13 is be VBZ 3334 81 14 planned plan VBN 3334 81 15 for for IN 3334 81 16 the the DT 3334 81 17 future future NN 3334 81 18 . . . 3334 82 1 Summarization summarization NN 3334 82 2 As as IN 3334 82 3 noted note VBN 3334 82 4 earlier early RBR 3334 82 5 , , , 3334 82 6 a a DT 3334 82 7 barrier barrier NN 3334 82 8 to to IN 3334 82 9 a a DT 3334 82 10 successful successful JJ 3334 82 11 user user NN 3334 82 12 experience experience NN 3334 82 13 can can MD 3334 82 14 be be VB 3334 82 15 the the DT 3334 82 16 lack lack NN 3334 82 17 of of IN 3334 82 18 informative informative JJ 3334 82 19 descriptions description NNS 3334 82 20 in in IN 3334 82 21 the the DT 3334 82 22 search search NN 3334 82 23 results result NNS 3334 82 24 . . . 3334 83 1 Therefore therefore RB 3334 83 2 , , , 3334 83 3 an an DT 3334 83 4 important important JJ 3334 83 5 tool tool NN 3334 83 6 for for IN 3334 83 7 search search NN 3334 83 8 - - HYPH 3334 83 9 experi- experi- NN 3334 83 10 ence ence NN 3334 83 11 improvement improvement NN 3334 83 12 is be VBZ 3334 83 13 to to TO 3334 83 14 make make VB 3334 83 15 sure sure JJ 3334 83 16 that that IN 3334 83 17 content content NN 3334 83 18 titles title NNS 3334 83 19 and and CC 3334 83 20 summaries summary NNS 3334 83 21 are be VBP 3334 83 22 informative informative JJ 3334 83 23 , , , 3334 83 24 or or CC 3334 83 25 as as IN 3334 83 26 a a DT 3334 83 27 second second JJ 3334 83 28 choice choice NN 3334 83 29 , , , 3334 83 30 that that IN 3334 83 31 the the DT 3334 83 32 search search NN 3334 83 33 engine engine NN 3334 83 34 dynamically dynamically RB 3334 83 35 generates generate VBZ 3334 83 36 informative informative JJ 3334 83 37 sum- sum- NN 3334 83 38 maries mary NNS 3334 83 39 . . . 3334 84 1 Passage passage NN 3334 84 2 - - HYPH 3334 84 3 based base VBN 3334 84 4 summaries summary NNS 3334 84 5 and and CC 3334 84 6 highlighted highlight VBN 3334 84 7 search search NN 3334 84 8 terms term NNS 3334 84 9 in in IN 3334 84 10 the the DT 3334 84 11 summary summary NN 3334 84 12 and and CC 3334 84 13 the the DT 3334 84 14 content content NN 3334 84 15 have have VBP 3334 84 16 become become VBN 3334 84 17 a a DT 3334 84 18 feature feature NN 3334 84 19 of of IN 3334 84 20 many many JJ 3334 84 21 commercial commercial JJ 3334 84 22 search search NN 3334 84 23 engines engine NNS 3334 84 24 as as IN 3334 84 25 another another DT 3334 84 26 way way NN 3334 84 27 to to TO 3334 84 28 improve improve VB 3334 84 29 the the DT 3334 84 30 usability usability NN 3334 84 31 of of IN 3334 84 32 the the DT 3334 84 33 returned return VBN 3334 84 34 results result NNS 3334 84 35 . . . 3334 85 1 In in IN 3334 85 2 Table table NN 3334 85 3 1 1 CD 3334 85 4 . . . 3334 86 1 Reasons reason NNS 3334 86 2 for for IN 3334 86 3 using use VBG 3334 86 4 IRS.gov IRS.gov NNP 3334 86 5 Reason reason NN 3334 86 6 for for IN 3334 86 7 coming come VBG 3334 86 8 to to IN 3334 86 9 IRS.gov irs.gov CD 3334 86 10 % % NN 3334 86 11 of of IN 3334 86 12 total total JJ 3334 86 13 site site NN 3334 86 14 visitors visitor NNS 3334 86 15 % % NN 3334 86 16 of of IN 3334 86 17 total total JJ 3334 86 18 search search NN 3334 86 19 users user NNS 3334 86 20 Download download VBP 3334 86 21 a a DT 3334 86 22 tax tax NN 3334 86 23 form form NN 3334 86 24 , , , 3334 86 25 publication publication NN 3334 86 26 , , , 3334 86 27 or or CC 3334 86 28 instructions instruction NNS 3334 86 29 39 39 CD 3334 86 30 39 39 CD 3334 86 31 Obtain obtain NN 3334 86 32 general general JJ 3334 86 33 tax tax NN 3334 86 34 information information NN 3334 86 35 27 27 CD 3334 86 36 28 28 CD 3334 86 37 Obtain obtain VB 3334 86 38 information information NN 3334 86 39 on on IN 3334 86 40 e e NN 3334 86 41 - - NN 3334 86 42 file file NN 3334 86 43 10 10 CD 3334 86 44 10 10 CD 3334 86 45 Other other JJ 3334 86 46 6 6 CD 3334 86 47 6 6 CD 3334 86 48 Obtain obtain NN 3334 86 49 info info NN 3334 86 50 on on IN 3334 86 51 tax tax NN 3334 86 52 regulations regulation NNS 3334 86 53 or or CC 3334 86 54 written write VBN 3334 86 55 determinations determination NNS 3334 86 56 4 4 CD 3334 86 57 4 4 CD 3334 86 58 Order order NN 3334 86 59 forms form NNS 3334 86 60 from from IN 3334 86 61 the the DT 3334 86 62 IRS IRS NNP 3334 86 63 3 3 CD 3334 86 64 4 4 CD 3334 86 65 Sign sign VB 3334 86 66 up up RP 3334 86 67 or or CC 3334 86 68 login login NNP 3334 86 69 to to IN 3334 86 70 e e NN 3334 86 71 - - HYPH 3334 86 72 services service NNS 3334 86 73 3 3 CD 3334 86 74 3 3 CD 3334 86 75 Link Link NNP 3334 86 76 and and CC 3334 86 77 learn learn VB 3334 86 78 ( ( -LRB- 3334 86 79 VITA VITA NNP 3334 86 80 / / SYM 3334 86 81 VCE VCE NNP 3334 86 82 ) ) -RRB- 3334 86 83 training training NN 3334 86 84 3 3 CD 3334 86 85 3 3 CD 3334 86 86 Obtain obtain VB 3334 86 87 info info NN 3334 86 88 on on IN 3334 86 89 the the DT 3334 86 90 status status NN 3334 86 91 of of IN 3334 86 92 your -PRON- PRP$ 3334 86 93 tax tax NN 3334 86 94 return return NN 3334 86 95 2 2 CD 3334 86 96 2 2 CD 3334 86 97 Use Use NNP 3334 86 98 online online JJ 3334 86 99 tax tax NN 3334 86 100 calculators calculator NNS 3334 86 101 1 1 CD 3334 86 102 1 1 CD 3334 86 103 Obtain obtain VB 3334 86 104 info info NN 3334 86 105 on on IN 3334 86 106 revenue revenue NN 3334 86 107 rulings ruling NNS 3334 86 108 or or CC 3334 86 109 court court NN 3334 86 110 cases case NNS 3334 86 111 1 1 CD 3334 86 112 1 1 CD 3334 86 113 Obtain obtain VB 3334 86 114 an an DT 3334 86 115 Employer Employer NNP 3334 86 116 Identification identification NN 3334 86 117 Number Number NNP 3334 86 118 ( ( -LRB- 3334 86 119 EIN EIN NNP 3334 86 120 ) ) -RRB- 3334 86 121 1 1 CD 3334 86 122 — — : 3334 86 123 Note note VB 3334 86 124 : : : 3334 86 125 Due due IN 3334 86 126 to to IN 3334 86 127 rounding rounding NN 3334 86 128 , , , 3334 86 129 totals total NNS 3334 86 130 may may MD 3334 86 131 not not RB 3334 86 132 equal equal VB 3334 86 133 100 100 CD 3334 86 134 % % NN 3334 86 135 . . . 3334 87 1 82 82 CD 3334 87 2 INFORMATION information NN 3334 87 3 TECHNOLOGY technology NN 3334 87 4 AND and CC 3334 87 5 LIBRARIES LIBRARIES NNP 3334 87 6 | | NNP 3334 87 7 JUNE JUNE NNP 3334 87 8 2006 2006 CD 3334 87 9 addition addition NN 3334 87 10 , , , 3334 87 11 for for IN 3334 87 12 those those DT 3334 87 13 PDF PDF NNP 3334 87 14 publications publication NNS 3334 87 15 that that WDT 3334 87 16 lacked lack VBD 3334 87 17 informa- informa- NN 3334 87 18 tive tive JJ 3334 87 19 titles title NNS 3334 87 20 in in IN 3334 87 21 the the DT 3334 87 22 title title NN 3334 87 23 tag tag NN 3334 87 24 , , , 3334 87 25 descriptive descriptive JJ 3334 87 26 information information NN 3334 87 27 from from IN 3334 87 28 a a DT 3334 87 29 different different JJ 3334 87 30 metadata metadata NN 3334 87 31 field field NN 3334 87 32 was be VBD 3334 87 33 added add VBN 3334 87 34 to to IN 3334 87 35 the the DT 3334 87 36 search search NN 3334 87 37 display display NN 3334 87 38 programmatically programmatically RB 3334 87 39 , , , 3334 87 40 which which WDT 3334 87 41 improved improve VBD 3334 87 42 the the DT 3334 87 43 usability usability NN 3334 87 44 of of IN 3334 87 45 such such JJ 3334 87 46 results result NNS 3334 87 47 significantly significantly RB 3334 87 48 . . . 3334 88 1 ■ ■ NFP 3334 88 2 Methodology methodology NN 3334 88 3 The the DT 3334 88 4 methodology methodology NN 3334 88 5 for for IN 3334 88 6 evolving evolve VBG 3334 88 7 the the DT 3334 88 8 search search NN 3334 88 9 functionality functionality NN 3334 88 10 is be VBZ 3334 88 11 based base VBN 3334 88 12 on on IN 3334 88 13 a a DT 3334 88 14 logical logical JJ 3334 88 15 , , , 3334 88 16 systems system NNS 3334 88 17 - - HYPH 3334 88 18 engineering engineering NN 3334 88 19 approach approach NN 3334 88 20 to to IN 3334 88 21 the the DT 3334 88 22 issue issue NN 3334 88 23 of of IN 3334 88 24 getting get VBG 3334 88 25 users user NNS 3334 88 26 the the DT 3334 88 27 information information NN 3334 88 28 they -PRON- PRP 3334 88 29 seek seek VBP 3334 88 30 : : : 3334 88 31 under- under- XX 3334 88 32 standing stand VBG 3334 88 33 the the DT 3334 88 34 problems problem NNS 3334 88 35 , , , 3334 88 36 understanding understand VBG 3334 88 37 who who WP 3334 88 38 has have VBZ 3334 88 39 the the DT 3334 88 40 prob- prob- JJ 3334 88 41 lems lem NNS 3334 88 42 , , , 3334 88 43 and and CC 3334 88 44 applying apply VBG 3334 88 45 solutions solution NNS 3334 88 46 that that WDT 3334 88 47 address address VBP 3334 88 48 the the DT 3334 88 49 problems problem NNS 3334 88 50 . . . 3334 89 1 Usability Usability NNP 3334 89 2 studies study NNS 3334 89 3 , , , 3334 89 4 weblogs weblog NNS 3334 89 5 , , , 3334 89 6 focus focus JJ 3334 89 7 groups group NNS 3334 89 8 , , , 3334 89 9 Help Help NNP 3334 89 10 Desk Desk NNP 3334 89 11 contacts contact NNS 3334 89 12 , , , 3334 89 13 and and CC 3334 89 14 user user NN 3334 89 15 surveys survey NNS 3334 89 16 provide provide VBP 3334 89 17 different different JJ 3334 89 18 perspectives perspective NNS 3334 89 19 of of IN 3334 89 20 the the DT 3334 89 21 information information NN 3334 89 22 system system NN 3334 89 23 . . . 3334 90 1 The the DT 3334 90 2 steps step NNS 3334 90 3 of of IN 3334 90 4 the the DT 3334 90 5 methodology methodology NN 3334 90 6 are be VBP 3334 90 7 : : : 3334 90 8 1 1 LS 3334 90 9 . . . 3334 91 1 Understand understand VB 3334 91 2 the the DT 3334 91 3 user user NN 3334 91 4 population population NN 3334 91 5 . . . 3334 92 1 2 2 LS 3334 92 2 . . . 3334 93 1 Identify identify VB 3334 93 2 the the DT 3334 93 3 barriers barrier NNS 3334 93 4 to to IN 3334 93 5 a a DT 3334 93 6 successful successful JJ 3334 93 7 search search NN 3334 93 8 experi- experi- NN 3334 93 9 ence ence NN 3334 93 10 . . . 3334 94 1 3 3 LS 3334 94 2 . . . 3334 95 1 Analyze analyze VB 3334 95 2 the the DT 3334 95 3 information information NN 3334 95 4 - - HYPH 3334 95 5 seeking seek VBG 3334 95 6 behaviors behavior NNS 3334 95 7 of of IN 3334 95 8 the the DT 3334 95 9 users user NNS 3334 95 10 . . . 3334 96 1 4 4 LS 3334 96 2 . . . 3334 97 1 Understand understand VB 3334 97 2 the the DT 3334 97 3 needs need NNS 3334 97 4 of of IN 3334 97 5 the the DT 3334 97 6 business business NN 3334 97 7 owners owner NNS 3334 97 8 . . . 3334 98 1 5 5 CD 3334 98 2 . . . 3334 99 1 Identify identify VB 3334 99 2 and and CC 3334 99 3 use use VB 3334 99 4 the the DT 3334 99 5 appropriate appropriate JJ 3334 99 6 tools tool NNS 3334 99 7 to to TO 3334 99 8 improve improve VB 3334 99 9 the the DT 3334 99 10 user user NN 3334 99 11 ’s ’s NN 3334 99 12 search search NN 3334 99 13 experience experience NN 3334 99 14 . . . 3334 100 1 6 6 CD 3334 100 2 . . . 3334 101 1 Repeat repeat NN 3334 101 2 as as IN 3334 101 3 needed need VBN 3334 101 4 . . . 3334 102 1 7 7 LS 3334 102 2 . . . 3334 103 1 Monitor monitor VB 3334 103 2 new new JJ 3334 103 3 developments development NNS 3334 103 4 in in IN 3334 103 5 search search NN 3334 103 6 and and CC 3334 103 7 analytic analytic JJ 3334 103 8 technologies technology NNS 3334 103 9 and and CC 3334 103 10 replace replace VB 3334 103 11 the the DT 3334 103 12 search search NN 3334 103 13 engine engine NN 3334 103 14 as as IN 3334 103 15 appropriate appropriate JJ 3334 103 16 . . . 3334 104 1 Step step NN 3334 104 2 1 1 CD 3334 104 3 : : : 3334 104 4 Understand understand VB 3334 104 5 the the DT 3334 104 6 user user NN 3334 104 7 population population NN 3334 104 8 The the DT 3334 104 9 first first JJ 3334 104 10 step step NN 3334 104 11 is be VBZ 3334 104 12 to to TO 3334 104 13 profile profile VB 3334 104 14 and and CC 3334 104 15 understand understand VB 3334 104 16 the the DT 3334 104 17 user user NN 3334 104 18 popu- popu- NNP 3334 104 19 lation lation NNP 3334 104 20 . . . 3334 105 1 As as IN 3334 105 2 mentioned mention VBN 3334 105 3 above above RB 3334 105 4 , , , 3334 105 5 an an DT 3334 105 6 online online JJ 3334 105 7 satisfaction satisfaction NN 3334 105 8 survey survey NN 3334 105 9 was be VBD 3334 105 10 conducted conduct VBN 3334 105 11 during during IN 3334 105 12 a a DT 3334 105 13 six six CD 3334 105 14 - - HYPH 3334 105 15 week week NN 3334 105 16 period period NN 3334 105 17 in in IN 3334 105 18 January January NNP 3334 105 19 – – : 3334 105 20 February February NNP 3334 105 21 2005 2005 CD 3334 105 22 , , , 3334 105 23 to to IN 3334 105 24 which which WDT 3334 105 25 11,715 11,715 CD 3334 105 26 users user NNS 3334 105 27 responded respond VBD 3334 105 28 . . . 3334 106 1 The the DT 3334 106 2 users user NNS 3334 106 3 were be VBD 3334 106 4 asked ask VBN 3334 106 5 the the DT 3334 106 6 frequency frequency NN 3334 106 7 of of IN 3334 106 8 their -PRON- PRP$ 3334 106 9 usage usage NN 3334 106 10 of of IN 3334 106 11 the the DT 3334 106 12 site site NN 3334 106 13 , , , 3334 106 14 their -PRON- PRP$ 3334 106 15 primary primary JJ 3334 106 16 reason reason NN 3334 106 17 for for IN 3334 106 18 coming come VBG 3334 106 19 to to IN 3334 106 20 IRS.gov IRS.gov NNP 3334 106 21 , , , 3334 106 22 their -PRON- PRP$ 3334 106 23 category category NN 3334 106 24 ( ( -LRB- 3334 106 25 individual individual JJ 3334 106 26 , , , 3334 106 27 tax tax NN 3334 106 28 professional professional NN 3334 106 29 , , , 3334 106 30 business business NN 3334 106 31 representative representative NN 3334 106 32 ) ) -RRB- 3334 106 33 , , , 3334 106 34 and and CC 3334 106 35 how how WRB 3334 106 36 they -PRON- PRP 3334 106 37 generally generally RB 3334 106 38 find find VBP 3334 106 39 information information NN 3334 106 40 on on IN 3334 106 41 IRS.gov IRS.gov NNP 3334 106 42 . . . 3334 107 1 As as IN 3334 107 2 shown show VBN 3334 107 3 in in IN 3334 107 4 tables table NNS 3334 107 5 1–4 1–4 CD 3334 107 6 , , , 3334 107 7 76 76 CD 3334 107 8 percent percent NN 3334 107 9 of of IN 3334 107 10 the the DT 3334 107 11 IRS IRS NNP 3334 107 12 . . . 3334 108 1 gov gov NNP 3334 108 2 visitors visitor NNS 3334 108 3 use use VBP 3334 108 4 it -PRON- PRP 3334 108 5 once once RB 3334 108 6 a a DT 3334 108 7 month month NN 3334 108 8 or or CC 3334 108 9 less less JJR 3334 108 10 ( ( -LRB- 3334 108 11 the the DT 3334 108 12 largest large JJS 3334 108 13 group group NN 3334 108 14 being be VBG 3334 108 15 those those DT 3334 108 16 who who WP 3334 108 17 use use VBP 3334 108 18 it -PRON- PRP 3334 108 19 every every DT 3334 108 20 six six CD 3334 108 21 months month NNS 3334 108 22 or or CC 3334 108 23 less less JJR 3334 108 24 ) ) -RRB- 3334 108 25 , , , 3334 108 26 or or CC 3334 108 27 were be VBD 3334 108 28 using use VBG 3334 108 29 it -PRON- PRP 3334 108 30 for for IN 3334 108 31 the the DT 3334 108 32 first first JJ 3334 108 33 time time NN 3334 108 34 ; ; : 3334 108 35 64 64 CD 3334 108 36 percent percent NN 3334 108 37 are be VBP 3334 108 38 individual individual JJ 3334 108 39 taxpayers taxpayer NNS 3334 108 40 ; ; : 3334 108 41 10 10 CD 3334 108 42 percent percent NN 3334 108 43 are be VBP 3334 108 44 tax tax NN 3334 108 45 profes- profes- NN 3334 108 46 sionals sional NNS 3334 108 47 ; ; : 3334 108 48 39 39 CD 3334 108 49 percent percent NN 3334 108 50 visit visit VBP 3334 108 51 the the DT 3334 108 52 site site NN 3334 108 53 to to TO 3334 108 54 download download VB 3334 108 55 a a DT 3334 108 56 form form NN 3334 108 57 or or CC 3334 108 58 publication publication NN 3334 108 59 ; ; : 3334 108 60 and and CC 3334 108 61 27 27 CD 3334 108 62 percent percent NN 3334 108 63 come come VBP 3334 108 64 for for IN 3334 108 65 general general JJ 3334 108 66 tax tax NN 3334 108 67 or or CC 3334 108 68 e e NN 3334 108 69 - - HYPH 3334 108 70 file file NN 3334 108 71 information information NN 3334 108 72 . . . 3334 109 1 Forty forty CD 3334 109 2 - - HYPH 3334 109 3 nine nine CD 3334 109 4 per- per- NN 3334 109 5 cent cent NN 3334 109 6 use use VB 3334 109 7 the the DT 3334 109 8 search search NN 3334 109 9 engine engine NN 3334 109 10 . . . 3334 110 1 Not not RB 3334 110 2 surprisingly surprisingly RB 3334 110 3 , , , 3334 110 4 44 44 CD 3334 110 5 percent percent NN 3334 110 6 of of IN 3334 110 7 the the DT 3334 110 8 frequent frequent JJ 3334 110 9 visitors visitor NNS 3334 110 10 ( ( -LRB- 3334 110 11 those those DT 3334 110 12 who who WP 3334 110 13 visit visit VBP 3334 110 14 once once RB 3334 110 15 a a DT 3334 110 16 week week NN 3334 110 17 or or CC 3334 110 18 more more JJR 3334 110 19 ) ) -RRB- 3334 110 20 are be VBP 3334 110 21 tax tax NN 3334 110 22 professionals professional NNS 3334 110 23 , , , 3334 110 24 while while IN 3334 110 25 72 72 CD 3334 110 26 percent percent NN 3334 110 27 of of IN 3334 110 28 the the DT 3334 110 29 infrequent infrequent JJ 3334 110 30 visitors visitor NNS 3334 110 31 are be VBP 3334 110 32 individuals individual NNS 3334 110 33 or or CC 3334 110 34 those those DT 3334 110 35 who who WP 3334 110 36 represent represent VBP 3334 110 37 a a DT 3334 110 38 business business NN 3334 110 39 . . . 3334 111 1 The the DT 3334 111 2 most most RBS 3334 111 3 common common JJ 3334 111 4 task task NN 3334 111 5 of of IN 3334 111 6 both both CC 3334 111 7 the the DT 3334 111 8 most most RBS 3334 111 9 frequent frequent JJ 3334 111 10 and and CC 3334 111 11 infrequent infrequent JJ 3334 111 12 visitors visitor NNS 3334 111 13 is be VBZ 3334 111 14 to to TO 3334 111 15 download download VB 3334 111 16 a a DT 3334 111 17 form form NN 3334 111 18 , , , 3334 111 19 publication publication NN 3334 111 20 , , , 3334 111 21 or or CC 3334 111 22 instructions instruction NNS 3334 111 23 , , , 3334 111 24 followed follow VBN 3334 111 25 by by IN 3334 111 26 obtaining obtain VBG 3334 111 27 general general JJ 3334 111 28 tax tax NN 3334 111 29 informa- informa- NN 3334 111 30 tion tion NN 3334 111 31 . . . 3334 112 1 Most Most JJS 3334 112 2 frequent frequent JJ 3334 112 3 and and CC 3334 112 4 infrequent infrequent JJ 3334 112 5 visitors visitor NNS 3334 112 6 use use VBP 3334 112 7 the the DT 3334 112 8 search search NN 3334 112 9 function function NN 3334 112 10 to to TO 3334 112 11 locate locate VB 3334 112 12 their -PRON- PRP$ 3334 112 13 information information NN 3334 112 14 . . . 3334 113 1 Thus thus RB 3334 113 2 , , , 3334 113 3 the the DT 3334 113 4 largest large JJS 3334 113 5 group group NN 3334 113 6 of of IN 3334 113 7 IRS.gov IRS.gov NNP 3334 113 8 users user NNS 3334 113 9 consists consist VBZ 3334 113 10 of of IN 3334 113 11 average average JJ 3334 113 12 citizens citizen NNS 3334 113 13 , , , 3334 113 14 unfamiliar unfamiliar JJ 3334 113 15 with with IN 3334 113 16 the the DT 3334 113 17 site site NN 3334 113 18 , , , 3334 113 19 who who WP 3334 113 20 have have VBP 3334 113 21 a a DT 3334 113 22 specific specific JJ 3334 113 23 question question NN 3334 113 24 or or CC 3334 113 25 a a DT 3334 113 26 need need NN 3334 113 27 for for IN 3334 113 28 a a DT 3334 113 29 specific specific JJ 3334 113 30 form form NN 3334 113 31 or or CC 3334 113 32 publication publication NN 3334 113 33 . . . 3334 114 1 These these DT 3334 114 2 users user NNS 3334 114 3 require require VBP 3334 114 4 high high JJ 3334 114 5 - - HYPH 3334 114 6 precision precision NN 3334 114 7 , , , 3334 114 8 highly highly RB 3334 114 9 relevant relevant JJ 3334 114 10 results result NNS 3334 114 11 , , , 3334 114 12 and and CC 3334 114 13 a a DT 3334 114 14 highly highly RB 3334 114 15 intuitive intuitive JJ 3334 114 16 search search NN 3334 114 17 interface interface NN 3334 114 18 . . . 3334 115 1 They -PRON- PRP 3334 115 2 do do VBP 3334 115 3 not not RB 3334 115 4 want want VB 3334 115 5 or or CC 3334 115 6 need need VB 3334 115 7 to to TO 3334 115 8 read read VB 3334 115 9 all all PDT 3334 115 10 the the DT 3334 115 11 material material NN 3334 115 12 gen- gen- NN 3334 115 13 erated erate VBN 3334 115 14 by by IN 3334 115 15 their -PRON- PRP$ 3334 115 16 search search NN 3334 115 17 , , , 3334 115 18 but but CC 3334 115 19 they -PRON- PRP 3334 115 20 want want VBP 3334 115 21 their -PRON- PRP$ 3334 115 22 question question NN 3334 115 23 answered answer VBN 3334 115 24 quickly quickly RB 3334 115 25 . . . 3334 116 1 These these DT 3334 116 2 users user NNS 3334 116 3 are be VBP 3334 116 4 generally generally RB 3334 116 5 not not RB 3334 116 6 experienced experience VBN 3334 116 7 with with IN 3334 116 8 so- so- XX 3334 116 9 phisticated phisticate VBN 3334 116 10 query query NN 3334 116 11 language language NN 3334 116 12 syntax syntax NN 3334 116 13 , , , 3334 116 14 and and CC 3334 116 15 because because IN 3334 116 16 they -PRON- PRP 3334 116 17 come come VBP 3334 116 18 to to IN 3334 116 19 the the DT 3334 116 20 site site NN 3334 116 21 no no DT 3334 116 22 more more RBR 3334 116 23 than than IN 3334 116 24 once once RB 3334 116 25 a a DT 3334 116 26 month month NN 3334 116 27 , , , 3334 116 28 they -PRON- PRP 3334 116 29 are be VBP 3334 116 30 not not RB 3334 116 31 likely likely JJ 3334 116 32 to to TO 3334 116 33 be be VB 3334 116 34 familiar familiar JJ 3334 116 35 with with IN 3334 116 36 its -PRON- PRP$ 3334 116 37 navigational navigational JJ 3334 116 38 organization organization NN 3334 116 39 . . . 3334 117 1 As as IN 3334 117 2 studies study NNS 3334 117 3 demonstrate demonstrate VBP 3334 117 4 , , , 3334 117 5 users user NNS 3334 117 6 in in IN 3334 117 7 general general JJ 3334 117 8 do do VBP 3334 117 9 not not RB 3334 117 10 want want VB 3334 117 11 to to TO 3334 117 12 learn learn VB 3334 117 13 a a DT 3334 117 14 search search NN 3334 117 15 engine engine NN 3334 117 16 interface interface NN 3334 117 17 or or CC 3334 117 18 tailor tailor VB 3334 117 19 their -PRON- PRP$ 3334 117 20 queries query NNS 3334 117 21 to to IN 3334 117 22 the the DT 3334 117 23 design design NN 3334 117 24 of of IN 3334 117 25 a a DT 3334 117 26 particular particular JJ 3334 117 27 search search NN 3334 117 28 engine.12 engine.12 NNP 3334 117 29 They -PRON- PRP 3334 117 30 want want VBP 3334 117 31 to to TO 3334 117 32 find find VB 3334 117 33 their -PRON- PRP$ 3334 117 34 information information NN 3334 117 35 now now RB 3334 117 36 before before IN 3334 117 37 “ " `` 3334 117 38 search search NN 3334 117 39 rage rage NN 3334 117 40 ” " '' 3334 117 41 sets set NNS 3334 117 42 in in RP 3334 117 43 . . . 3334 118 1 One one CD 3334 118 2 study study NN 3334 118 3 observed observe VBD 3334 118 4 that that IN 3334 118 5 , , , 3334 118 6 on on IN 3334 118 7 average average JJ 3334 118 8 , , , 3334 118 9 searchers searcher NNS 3334 118 10 get get VBP 3334 118 11 frus- frus- NNP 3334 118 12 trated trate VBN 3334 118 13 in in IN 3334 118 14 twelve twelve CD 3334 118 15 minutes.13 minutes.13 NNP 3334 118 16 Tax Tax NNP 3334 118 17 professionals professional NNS 3334 118 18 form form VBP 3334 118 19 a a DT 3334 118 20 small small JJ 3334 118 21 but but CC 3334 118 22 important important JJ 3334 118 23 group group NN 3334 118 24 of of IN 3334 118 25 IRS.gov IRS.gov NNP 3334 118 26 users user NNS 3334 118 27 that that WDT 3334 118 28 includes include VBZ 3334 118 29 lawyers lawyer NNS 3334 118 30 , , , 3334 118 31 accountants accountant NNS 3334 118 32 , , , 3334 118 33 and and CC 3334 118 34 tax tax NN 3334 118 35 preparers preparer NNS 3334 118 36 . . . 3334 119 1 They -PRON- PRP 3334 119 2 generally generally RB 3334 119 3 use use VBP 3334 119 4 the the DT 3334 119 5 site site NN 3334 119 6 on on IN 3334 119 7 a a DT 3334 119 8 regular regular JJ 3334 119 9 basis basis NN 3334 119 10 , , , 3334 119 11 which which WDT 3334 119 12 could could MD 3334 119 13 be be VB 3334 119 14 daily daily JJ 3334 119 15 , , , 3334 119 16 weekly weekly JJ 3334 119 17 , , , 3334 119 18 or or CC 3334 119 19 monthly monthly JJ 3334 119 20 . . . 3334 120 1 Some some DT 3334 120 2 of of IN 3334 120 3 these these DT 3334 120 4 users user NNS 3334 120 5 , , , 3334 120 6 particularly particularly RB 3334 120 7 lawyers lawyer NNS 3334 120 8 and and CC 3334 120 9 accountants accountant NNS 3334 120 10 , , , 3334 120 11 require require VBP 3334 120 12 high high JJ 3334 120 13 relevance relevance NN 3334 120 14 in in IN 3334 120 15 their -PRON- PRP$ 3334 120 16 search search NN 3334 120 17 results result NNS 3334 120 18 ; ; : 3334 120 19 it -PRON- PRP 3334 120 20 is be VBZ 3334 120 21 critical critical JJ 3334 120 22 that that IN 3334 120 23 they -PRON- PRP 3334 120 24 retrieve retrieve VBP 3334 120 25 every every DT 3334 120 26 relevant relevant JJ 3334 120 27 piece piece NN 3334 120 28 of of IN 3334 120 29 information information NN 3334 120 30 ( ( -LRB- 3334 120 31 e.g. e.g. RB 3334 120 32 , , , 3334 120 33 all all PDT 3334 120 34 the the DT 3334 120 35 tax tax NN 3334 120 36 regulations regulation NNS 3334 120 37 ) ) -RRB- 3334 120 38 related relate VBD 3334 120 39 to to IN 3334 120 40 a a DT 3334 120 41 tax tax NN 3334 120 42 topic topic NN 3334 120 43 . . . 3334 121 1 They -PRON- PRP 3334 121 2 may may MD 3334 121 3 be be VB 3334 121 4 willing willing JJ 3334 121 5 to to TO 3334 121 6 sift sift VB 3334 121 7 through through IN 3334 121 8 large large JJ 3334 121 9 results result NNS 3334 121 10 sets set NNS 3334 121 11 to to TO 3334 121 12 make make VB 3334 121 13 sure sure JJ 3334 121 14 they -PRON- PRP 3334 121 15 have have VBP 3334 121 16 seen see VBN 3334 121 17 all all PDT 3334 121 18 the the DT 3334 121 19 relevant relevant JJ 3334 121 20 items item NNS 3334 121 21 . . . 3334 122 1 In in IN 3334 122 2 contrast contrast NN 3334 122 3 , , , 3334 122 4 many many JJ 3334 122 5 tax tax NN 3334 122 6 preparers preparer NNS 3334 122 7 use use VBP 3334 122 8 the the DT 3334 122 9 site site NN 3334 122 10 primarily primarily RB 3334 122 11 to to TO 3334 122 12 download download VB 3334 122 13 forms form NNS 3334 122 14 and and CC 3334 122 15 instructions instruction NNS 3334 122 16 . . . 3334 123 1 While while IN 3334 123 2 these these DT 3334 123 3 different different JJ 3334 123 4 sets set NNS 3334 123 5 of of IN 3334 123 6 users user NNS 3334 123 7 have have VBP 3334 123 8 different different JJ 3334 123 9 levels level NNS 3334 123 10 of of IN 3334 123 11 expertise expertise NN 3334 123 12 using use VBG 3334 123 13 the the DT 3334 123 14 site site NN 3334 123 15 and and CC 3334 123 16 somewhat somewhat RB 3334 123 17 different different JJ 3334 123 18 precision precision NN 3334 123 19 and and CC 3334 123 20 recall recall NN 3334 123 21 requirements requirement NNS 3334 123 22 , , , 3334 123 23 they -PRON- PRP 3334 123 24 do do VBP 3334 123 25 have have VB 3334 123 26 one one CD 3334 123 27 char- char- NN 3334 123 28 acteristic acteristic JJ 3334 123 29 in in IN 3334 123 30 common common JJ 3334 123 31 — — : 3334 123 32 they -PRON- PRP 3334 123 33 are be VBP 3334 123 34 not not RB 3334 123 35 interested interested JJ 3334 123 36 in in IN 3334 123 37 search search NN 3334 123 38 Table table NN 3334 123 39 2 2 CD 3334 123 40 . . . 3334 124 1 Frequency frequency NN 3334 124 2 of of IN 3334 124 3 visits visit NNS 3334 124 4 to to IN 3334 124 5 IRS.gov irs.gov PRP$ 3334 124 6 First first JJ 3334 124 7 time time NN 3334 124 8 Every every DT 3334 124 9 six six CD 3334 124 10 months month NNS 3334 124 11 or or CC 3334 124 12 less less JJR 3334 124 13 About about RB 3334 124 14 once once RB 3334 124 15 a a DT 3334 124 16 month month NN 3334 124 17 About about RB 3334 124 18 once once RB 3334 124 19 a a DT 3334 124 20 week week NN 3334 124 21 Daily Daily NNP 3334 124 22 More more RBR 3334 124 23 than than IN 3334 124 24 once once RB 3334 124 25 a a DT 3334 124 26 day day NN 3334 124 27 Site Site NNP 3334 124 28 visitor visitor NN 3334 124 29 29 29 CD 3334 124 30 % % NN 3334 124 31 34 34 CD 3334 124 32 % % NN 3334 124 33 13 13 CD 3334 124 34 % % NN 3334 124 35 13 13 CD 3334 124 36 % % NN 3334 124 37 7 7 CD 3334 124 38 % % NN 3334 124 39 4 4 CD 3334 124 40 % % NN 3334 124 41 Search Search NNP 3334 124 42 user user NN 3334 124 43 26 26 CD 3334 124 44 % % NN 3334 124 45 34 34 CD 3334 124 46 % % NN 3334 124 47 14 14 CD 3334 124 48 % % NN 3334 124 49 14 14 CD 3334 124 50 % % NN 3334 124 51 7 7 CD 3334 124 52 % % NN 3334 124 53 5 5 CD 3334 124 54 % % NN 3334 124 55 ARTICLE ARTICLE NNP 3334 124 56 TITLE TITLE NNP 3334 124 57 | | NNP 3334 124 58 AUTHOR AUTHOR NNP 3334 124 59 83A 83a CD 3334 124 60 DYNAMIC dynamic NN 3334 124 61 METHODOLOGY methodology NN 3334 124 62 FOR for IN 3334 124 63 IMPROVING improve VBG 3334 124 64 THE the DT 3334 124 65 SEARCH SEARCH NNS 3334 124 66 EXPERIENCE EXPERIENCE NNP 3334 124 67 | | CD 3334 124 68 KERCHNER kerchner NN 3334 124 69 83 83 CD 3334 124 70 for for IN 3334 124 71 its -PRON- PRP$ 3334 124 72 own own JJ 3334 124 73 sake sake NN 3334 124 74 . . . 3334 125 1 Approaches approach NNS 3334 125 2 to to IN 3334 125 3 improving improve VBG 3334 125 4 retrieval retrieval NN 3334 125 5 results result NNS 3334 125 6 that that WDT 3334 125 7 focus focus VBP 3334 125 8 on on IN 3334 125 9 forcing force VBG 3334 125 10 users user NNS 3334 125 11 to to TO 3334 125 12 use use VB 3334 125 13 tools tool NNS 3334 125 14 to to TO 3334 125 15 refine refine VB 3334 125 16 their -PRON- PRP$ 3334 125 17 query query NN 3334 125 18 to to TO 3334 125 19 get get VB 3334 125 20 presumably presumably RB 3334 125 21 better well JJR 3334 125 22 search search NN 3334 125 23 results result NNS 3334 125 24 ( ( -LRB- 3334 125 25 e.g. e.g. RB 3334 125 26 , , , 3334 125 27 leveraging leverage VBG 3334 125 28 the the DT 3334 125 29 power power NN 3334 125 30 of of IN 3334 125 31 Boolean Boolean NNP 3334 125 32 or or CC 3334 125 33 other other JJ 3334 125 34 search search NN 3334 125 35 syntax syntax NN 3334 125 36 ) ) -RRB- 3334 125 37 are be VBP 3334 125 38 not not RB 3334 125 39 desirable desirable JJ 3334 125 40 in in IN 3334 125 41 a a DT 3334 125 42 public public JJ 3334 125 43 Web web NN 3334 125 44 site site NN 3334 125 45 environment environment NN 3334 125 46 . . . 3334 126 1 The the DT 3334 126 2 complexity complexity NN 3334 126 3 of of IN 3334 126 4 the the DT 3334 126 5 search search NN 3334 126 6 must must MD 3334 126 7 be be VB 3334 126 8 hidden hide VBN 3334 126 9 behind behind IN 3334 126 10 the the DT 3334 126 11 search search NN 3334 126 12 box box NN 3334 126 13 and and CC 3334 126 14 users user NNS 3334 126 15 must must MD 3334 126 16 be be VB 3334 126 17 helped help VBN 3334 126 18 to to TO 3334 126 19 find find VB 3334 126 20 information information NN 3334 126 21 rather rather RB 3334 126 22 than than IN 3334 126 23 be be VB 3334 126 24 expected expect VBN 3334 126 25 to to TO 3334 126 26 master master VB 3334 126 27 a a DT 3334 126 28 search search NN 3334 126 29 function function NN 3334 126 30 . . . 3334 127 1 Step step NN 3334 127 2 2 2 CD 3334 127 3 : : : 3334 127 4 Identify identify VB 3334 127 5 the the DT 3334 127 6 barriers barrier NNS 3334 127 7 to to IN 3334 127 8 a a DT 3334 127 9 successful successful JJ 3334 127 10 search search NN 3334 127 11 experience experience NN 3334 127 12 There there EX 3334 127 13 are be VBP 3334 127 14 several several JJ 3334 127 15 categories category NNS 3334 127 16 of of IN 3334 127 17 reasons reason NNS 3334 127 18 why why WRB 3334 127 19 finding find VBG 3334 127 20 infor- infor- XX 3334 127 21 mation mation NN 3334 127 22 on on IN 3334 127 23 a a DT 3334 127 24 public public JJ 3334 127 25 Web web NN 3334 127 26 site site NN 3334 127 27 can can MD 3334 127 28 be be VB 3334 127 29 frustrating frustrating JJ 3334 127 30 for for IN 3334 127 31 the the DT 3334 127 32 user user NN 3334 127 33 . . . 3334 128 1 ■ ■ NFP 3334 128 2 Mismatch mismatch NN 3334 128 3 between between IN 3334 128 4 user user NN 3334 128 5 terminology terminology NN 3334 128 6 and and CC 3334 128 7 content content NN 3334 128 8 terminology terminology NN 3334 128 9   '' 3334 128 10 The the DT 3334 128 11 user user NN 3334 128 12 search search NN 3334 128 13 terms term NNS 3334 128 14 may may MD 3334 128 15 not not RB 3334 128 16 match match VB 3334 128 17 the the DT 3334 128 18 ter- ter- JJ 3334 128 19 minology minology NN 3334 128 20 or or CC 3334 128 21 jargon jargon NNP 3334 128 22 used use VBN 3334 128 23 in in IN 3334 128 24 the the DT 3334 128 25 content content NN 3334 128 26 ( ( -LRB- 3334 128 27 e.g. e.g. RB 3334 128 28 , , , 3334 128 29 users user NNS 3334 128 30 ask ask VBP 3334 128 31 for for IN 3334 128 32 “ " `` 3334 128 33 Tax Tax NNP 3334 128 34 Tables Tables NNP 3334 128 35 ” " '' 3334 128 36 or or CC 3334 128 37 “ " `` 3334 128 38 Tax Tax NNP 3334 128 39 Brackets Brackets NNPS 3334 128 40 ” " '' 3334 128 41 ; ; : 3334 128 42 the the DT 3334 128 43 IRS IRS NNP 3334 128 44 names name VBZ 3334 128 45 them -PRON- PRP 3334 128 46 “ " `` 3334 128 47 Tax Tax NNP 3334 128 48 Rate rate NN 3334 128 49 Schedules schedule NNS 3334 128 50 ” " '' 3334 128 51 ) ) -RRB- 3334 128 52 . . . 3334 129 1   -RRB- 3334 129 2 Multiple multiple JJ 3334 129 3 synonymous synonymous JJ 3334 129 4 terms term NNS 3334 129 5 or or CC 3334 129 6 acronyms acronym NNS 3334 129 7 are be VBP 3334 129 8 found find VBN 3334 129 9 because because IN 3334 129 10 different different JJ 3334 129 11 authors author NNS 3334 129 12 are be VBP 3334 129 13 pro- pro- NN 3334 129 14 viding vide VBG 3334 129 15 content content NN 3334 129 16 on on IN 3334 129 17 similar similar JJ 3334 129 18 topics topic NNS 3334 129 19 ( ( -LRB- 3334 129 20 e.g. e.g. RB 3334 129 21 , , , 3334 129 22 “ " `` 3334 129 23 EIN EIN NNP 3334 129 24 , , , 3334 129 25 ” " '' 3334 129 26 “ " `` 3334 129 27 employer employer NN 3334 129 28 identification identification NN 3334 129 29 number number NN 3334 129 30 , , , 3334 129 31 ” " '' 3334 129 32 “ " `` 3334 129 33 federal federal JJ 3334 129 34 i -PRON- PRP 3334 129 35 d d NN 3334 129 36 number number NN 3334 129 37 ” " '' 3334 129 38 ; ; : 3334 129 39 “ " `` 3334 129 40 EIC EIC NNP 3334 129 41 ” " '' 3334 129 42 versus versus IN 3334 129 43 “ " `` 3334 129 44 EITC EITC NNP 3334 129 45 ” " '' 3334 129 46 ) ) -RRB- 3334 129 47 . . . 3334 130 1   `` 3334 130 2 Users user NNS 3334 130 3 request request VBP 3334 130 4 the the DT 3334 130 5 same same JJ 3334 130 6 information information NN 3334 130 7 in in IN 3334 130 8 a a DT 3334 130 9 vari- vari- JJ 3334 130 10 ety ety NN 3334 130 11 of of IN 3334 130 12 ways way NNS 3334 130 13 ( ( -LRB- 3334 130 14 e.g. e.g. RB 3334 130 15 , , , 3334 130 16 “ " `` 3334 130 17 1040ez 1040ez NNP 3334 130 18 , , , 3334 130 19 ” " '' 3334 130 20 “ " `` 3334 130 21 1040-ez 1040-ez NNP 3334 130 22 , , , 3334 130 23 ” " '' 3334 130 24 “ " `` 3334 130 25 ez ez FW 3334 130 26 , , , 3334 130 27 ” " '' 3334 130 28 “ " `` 3334 130 29 form1040EZ form1040EZ NNP 3334 130 30 , , , 3334 130 31 ” " '' 3334 130 32 “ " `` 3334 130 33 1040ez 1040ez JJ 3334 130 34 form form NN 3334 130 35 , , , 3334 130 36 ” " '' 3334 130 37 “ " `` 3334 130 38 2005 2005 CD 3334 130 39 1040ez 1040ez CD 3334 130 40 , , , 3334 130 41 ” " '' 3334 130 42 “ " `` 3334 130 43 ez1040 ez1040 FW 3334 130 44 ” " '' 3334 130 45 ) ) -RRB- 3334 130 46 . . . 3334 131 1   `` 3334 131 2 Related relate VBN 3334 131 3 content content NN 3334 131 4 may may MD 3334 131 5 be be VB 3334 131 6 inconsistently inconsistently RB 3334 131 7 named name VBN 3334 131 8 , , , 3334 131 9 complicating complicate VBG 3334 131 10 the the DT 3334 131 11 user user NN 3334 131 12 ’s ’s NN 3334 131 13 search search NN 3334 131 14 process process NN 3334 131 15 ( ( -LRB- 3334 131 16 e.g. e.g. RB 3334 131 17 , , , 3334 131 18 “ " `` 3334 131 19 1040X 1040X NNP 3334 131 20 ” " '' 3334 131 21 form form NN 3334 131 22 versus versus IN 3334 131 23 “ " `` 3334 131 24 1040-X 1040-X NNS 3334 131 25 ” " '' 3334 131 26 instructions instruction NNS 3334 131 27 ) ) -RRB- 3334 131 28 . . . 3334 132 1   `` 3334 132 2 The the DT 3334 132 3 user user NN 3334 132 4 may may MD 3334 132 5 use use VB 3334 132 6 a a DT 3334 132 7 familiar familiar JJ 3334 132 8 acronym acronym NN 3334 132 9 that that WDT 3334 132 10 is be VBZ 3334 132 11 spelled spell VBN 3334 132 12 out out RP 3334 132 13 in in IN 3334 132 14 the the DT 3334 132 15 content content NN 3334 132 16 ( ( -LRB- 3334 132 17 e.g. e.g. RB 3334 132 18 , , , 3334 132 19 “ " `` 3334 132 20 poa poa VB 3334 132 21 ” " '' 3334 132 22 for for IN 3334 132 23 “ " `` 3334 132 24 power power NN 3334 132 25 of of IN 3334 132 26 attorney attorney NN 3334 132 27 ” " '' 3334 132 28 ) ) -RRB- 3334 132 29 . . . 3334 133 1 ■ ■ NFP 3334 133 2 Mismatch mismatch NN 3334 133 3 between between IN 3334 133 4 user user NN 3334 133 5 requests request NNS 3334 133 6 and and CC 3334 133 7 actual actual JJ 3334 133 8 content content NN 3334 133 9   -RRB- 3334 133 10 Many many JJ 3334 133 11 users user NNS 3334 133 12 ask ask VBP 3334 133 13 for for IN 3334 133 14 information information NN 3334 133 15 that that WDT 3334 133 16 they -PRON- PRP 3334 133 17 ex- ex- VBP 3334 133 18 pect pect VBP 3334 133 19 to to TO 3334 133 20 find find VB 3334 133 21 on on IN 3334 133 22 the the DT 3334 133 23 site site NN 3334 133 24 but but CC 3334 133 25 is be VBZ 3334 133 26 actually actually RB 3334 133 27 hosted host VBN 3334 133 28 at at IN 3334 133 29 another another DT 3334 133 30 site site NN 3334 133 31 ( ( -LRB- 3334 133 32 e.g. e.g. RB 3334 133 33 , , , 3334 133 34 “ " `` 3334 133 35 ds156 ds156 NN 3334 133 36 , , , 3334 133 37 ” " '' 3334 133 38 a a DT 3334 133 39 Department Department NNP 3334 133 40 of of IN 3334 133 41 State State NNP 3334 133 42 form form NN 3334 133 43 ; ; : 3334 133 44 “ " `` 3334 133 45 IT-201 it-201 NN 3334 133 46 , , , 3334 133 47 ” " '' 3334 133 48 a a DT 3334 133 49 New New NNP 3334 133 50 York York NNP 3334 133 51 State State NNP 3334 133 52 tax tax NN 3334 133 53 form form NN 3334 133 54 ) ) -RRB- 3334 133 55 . . . 3334 134 1 ■ ■ NFP 3334 134 2 Issues issue NNS 3334 134 3 with with IN 3334 134 4 results result NNS 3334 134 5 listing listing NN 3334 134 6 and and CC 3334 134 7 content content NN 3334 134 8 display display NN 3334 134 9   '' 3334 134 10 Content Content NNP 3334 134 11 may may MD 3334 134 12 lack lack VB 3334 134 13 informative informative JJ 3334 134 14 titles title NNS 3334 134 15 . . . 3334 135 1   ADD 3334 135 2 Automatically automatically RB 3334 135 3 generated generate VBN 3334 135 4 summaries summary NNS 3334 135 5 may may MD 3334 135 6 not not RB 3334 135 7 be be VB 3334 135 8 sufficiently sufficiently RB 3334 135 9 descriptive descriptive JJ 3334 135 10 for for IN 3334 135 11 users user NNS 3334 135 12 to to TO 3334 135 13 recog- recog- VB 3334 135 14 nize nize VB 3334 135 15 the the DT 3334 135 16 relevant relevant JJ 3334 135 17 material material NN 3334 135 18 in in IN 3334 135 19 the the DT 3334 135 20 results result NNS 3334 135 21 listing list VBG 3334 135 22 . . . 3334 136 1   `` 3334 136 2 Content Content NNP 3334 136 3 may may MD 3334 136 4 consist consist VB 3334 136 5 of of IN 3334 136 6 long long JJ 3334 136 7 , , , 3334 136 8 scrolling scroll VBG 3334 136 9 pages page NNS 3334 136 10 , , , 3334 136 11 which which WDT 3334 136 12 users user NNS 3334 136 13 find find VBP 3334 136 14 hard hard JJ 3334 136 15 to to TO 3334 136 16 manage manage VB 3334 136 17 . . . 3334 137 1 ■ ■ NFP 3334 137 2 Incomplete incomplete JJ 3334 137 3 user user NN 3334 137 4 queries query NNS 3334 137 5   `` 3334 137 6 Very very RB 3334 137 7 short short JJ 3334 137 8 search search NN 3334 137 9 phrases phrase NNS 3334 137 10 ( ( -LRB- 3334 137 11 average average JJ 3334 137 12 length length NN 3334 137 13 of of IN 3334 137 14 less less JJR 3334 137 15 than than IN 3334 137 16 two two CD 3334 137 17 words word NNS 3334 137 18 ) ) -RRB- 3334 137 19 can can MD 3334 137 20 make make VB 3334 137 21 it -PRON- PRP 3334 137 22 difficult difficult JJ 3334 137 23 for for IN 3334 137 24 a a DT 3334 137 25 search search NN 3334 137 26 algorithm algorithm NN 3334 137 27 to to TO 3334 137 28 deduce deduce VB 3334 137 29 the the DT 3334 137 30 specific specific JJ 3334 137 31 con- con- NN 3334 137 32 tent tent NN 3334 137 33 the the DT 3334 137 34 user user NN 3334 137 35 is be VBZ 3334 137 36 seeking seek VBG 3334 137 37 . . . 3334 138 1 Step step NN 3334 138 2 3 3 CD 3334 138 3 : : : 3334 138 4 Analyze analyze VB 3334 138 5 the the DT 3334 138 6 information information NN 3334 138 7 - - HYPH 3334 138 8 seeking seek VBG 3334 138 9 behaviors behavior NNS 3334 138 10 of of IN 3334 138 11 the the DT 3334 138 12 users user NNS 3334 138 13 Site site NN 3334 138 14 - - HYPH 3334 138 15 usage usage NN 3334 138 16 reports report NNS 3334 138 17 , , , 3334 138 18 satisfaction satisfaction NN 3334 138 19 surveys survey NNS 3334 138 20 , , , 3334 138 21 Help Help NNP 3334 138 22 Desk Desk NNP 3334 138 23 con- con- NN 3334 138 24 tact tact NN 3334 138 25 reports report NNS 3334 138 26 , , , 3334 138 27 zero zero CD 3334 138 28 - - HYPH 3334 138 29 results result NNS 3334 138 30 reports report NNS 3334 138 31 , , , 3334 138 32 focus focus JJ 3334 138 33 groups group NNS 3334 138 34 , , , 3334 138 35 and and CC 3334 138 36 usability usability NN 3334 138 37 studies study NNS 3334 138 38 are be VBP 3334 138 39 valuable valuable JJ 3334 138 40 sources source NNS 3334 138 41 of of IN 3334 138 42 information information NN 3334 138 43 . . . 3334 139 1 They -PRON- PRP 3334 139 2 should should MD 3334 139 3 be be VB 3334 139 4 mined mine VBN 3334 139 5 for for IN 3334 139 6 information information NN 3334 139 7 - - HYPH 3334 139 8 seeking seek VBG 3334 139 9 behaviors behavior NNS 3334 139 10 of of IN 3334 139 11 the the DT 3334 139 12 site site NN 3334 139 13 ’s ’s POS 3334 139 14 users user NNS 3334 139 15 and and CC 3334 139 16 other other JJ 3334 139 17 barriers barrier NNS 3334 139 18 to to IN 3334 139 19 a a DT 3334 139 20 successful successful JJ 3334 139 21 search search NN 3334 139 22 experience experience NN 3334 139 23 , , , 3334 139 24 as as IN 3334 139 25 follows follow VBZ 3334 139 26 : : : 3334 139 27 ■ ■ NFP 3334 139 28 Review review NN 3334 139 29 site site NN 3334 139 30 - - HYPH 3334 139 31 usage usage NN 3334 139 32 reports report NNS 3334 139 33 for for IN 3334 139 34 the the DT 3334 139 35 most most RBS 3334 139 36 frequently frequently RB 3334 139 37 entered enter VBN 3334 139 38 search search NN 3334 139 39 terms term NNS 3334 139 40 and and CC 3334 139 41 popular popular JJ 3334 139 42 pages page NNS 3334 139 43 ( ( -LRB- 3334 139 44 both both DT 3334 139 45 may may MD 3334 139 46 change change VB 3334 139 47 over over IN 3334 139 48 time time NN 3334 139 49 ) ) -RRB- 3334 139 50 and and CC 3334 139 51 the the DT 3334 139 52 zero zero CD 3334 139 53 - - HYPH 3334 139 54 results result NNS 3334 139 55 search search NN 3334 139 56 terms term NNS 3334 139 57 . . . 3334 140 1 Look look VB 3334 140 2 for for IN 3334 140 3 : : : 3334 140 4   `` 3334 140 5 New new JJ 3334 140 6 terms term NNS 3334 140 7   VBZ 3334 140 8 Variations variation NNS 3334 140 9 on on IN 3334 140 10 popular popular JJ 3334 140 11 terms term NNS 3334 140 12   VBG 3334 140 13 Common common JJ 3334 140 14 misspellings misspelling NNS 3334 140 15 or or CC 3334 140 16 typos typo NNS 3334 140 17   VBZ 3334 140 18 Common common JJ 3334 140 19 searches search NNS 3334 140 20 , , , 3334 140 21 including include VBG 3334 140 22 searches search NNS 3334 140 23 for for IN 3334 140 24 items item NNS 3334 140 25 Table table NN 3334 140 26 3 3 CD 3334 140 27 . . . 3334 141 1 IRS.gov irs.gov FW 3334 141 2 user user NN 3334 141 3 types type NNS 3334 141 4 Type Type NNP 3334 141 5 of of IN 3334 141 6 user user NN 3334 141 7 % % NN 3334 141 8 of of IN 3334 141 9 total total JJ 3334 141 10 site site NN 3334 141 11 visitors visitor NNS 3334 141 12 % % NN 3334 141 13 of of IN 3334 141 14 total total JJ 3334 141 15 search search NN 3334 141 16 users user NNS 3334 141 17 Individual individual JJ 3334 141 18 taxpayer taxpayer NN 3334 141 19 64 64 CD 3334 141 20 % % NN 3334 141 21 64 64 CD 3334 141 22 % % NN 3334 141 23 Representing represent VBG 3334 141 24 a a DT 3334 141 25 business business NN 3334 141 26 11 11 CD 3334 141 27 % % NN 3334 141 28 11 11 CD 3334 141 29 % % NN 3334 141 30 Tax Tax NNP 3334 141 31 professional professional JJ 3334 141 32 10 10 CD 3334 141 33 % % NN 3334 141 34 11 11 CD 3334 141 35 % % NN 3334 141 36 Representing represent VBG 3334 141 37 a a DT 3334 141 38 charity charity NN 3334 141 39 or or CC 3334 141 40 nonprofit nonprofit VB 3334 141 41 3 3 CD 3334 141 42 % % NN 3334 141 43 3 3 CD 3334 141 44 % % NN 3334 141 45 VITA VITA NNP 3334 141 46 / / SYM 3334 141 47 VCE VCE NNP 3334 141 48 volunteers volunteer VBZ 3334 141 49 3 3 CD 3334 141 50 % % NN 3334 141 51 3 3 CD 3334 141 52 % % NN 3334 141 53 Representing represent VBG 3334 141 54 a a DT 3334 141 55 government government NN 3334 141 56 entity entity NN 3334 141 57 2 2 CD 3334 141 58 % % NN 3334 141 59 2 2 CD 3334 141 60 % % NN 3334 141 61 Student student NN 3334 141 62 2 2 CD 3334 141 63 % % NN 3334 141 64 1 1 CD 3334 141 65 % % NN 3334 141 66 IRS IRS NNP 3334 141 67 employee employee NN 3334 141 68 1 1 CD 3334 141 69 % % NN 3334 141 70 2 2 CD 3334 141 71 % % NN 3334 141 72 Other other JJ 3334 141 73 4 4 CD 3334 141 74 % % NN 3334 141 75 3 3 CD 3334 141 76 % % NN 3334 141 77 Table table NN 3334 141 78 4 4 CD 3334 141 79 . . . 3334 142 1 How how WRB 3334 142 2 users user NNS 3334 142 3 find find VBP 3334 142 4 information information NN 3334 142 5 on on IN 3334 142 6 IRS.gov IRS.gov NNP 3334 142 7 How how WRB 3334 142 8 do do VBP 3334 142 9 you -PRON- PRP 3334 142 10 usually usually RB 3334 142 11 find find VB 3334 142 12 information information NN 3334 142 13 on on IN 3334 142 14 IRS.gov IRS.gov NNP 3334 142 15 ? ? . 3334 143 1 % % NN 3334 143 2 of of IN 3334 143 3 total total JJ 3334 143 4 site site NN 3334 143 5 visitors visitor NNS 3334 143 6 Search Search NNP 3334 143 7 engine engine NN 3334 143 8 49 49 CD 3334 143 9 % % NN 3334 143 10 IRS IRS NNP 3334 143 11 keyword keyword NN 3334 143 12 18 18 CD 3334 143 13 % % NN 3334 143 14 Navigation Navigation NNP 3334 143 15 to to IN 3334 143 16 the the DT 3334 143 17 Web web NN 3334 143 18 page page NN 3334 143 19 11 11 CD 3334 143 20 % % NN 3334 143 21 Internet internet NN 3334 143 22 search search NN 3334 143 23 engine engine NN 3334 143 24 ( ( -LRB- 3334 143 25 e.g. e.g. RB 3334 143 26 , , , 3334 143 27 Google Google NNP 3334 143 28 , , , 3334 143 29 Yahoo Yahoo NNP 3334 143 30 ) ) -RRB- 3334 143 31 7 7 CD 3334 143 32 % % NN 3334 143 33 Site site NN 3334 143 34 map map NN 3334 143 35 5 5 CD 3334 143 36 % % NN 3334 143 37 Other other JJ 3334 143 38 4 4 CD 3334 143 39 % % NN 3334 143 40 Bookmarks bookmark NNS 3334 143 41 3 3 CD 3334 143 42 % % NN 3334 143 43 Links link NNS 3334 143 44 to to TO 3334 143 45 IRS.gov irs.gov VB 3334 143 46 from from IN 3334 143 47 other other JJ 3334 143 48 Web web NN 3334 143 49 sites site NNS 3334 143 50 3 3 CD 3334 143 51 % % NN 3334 143 52 84 84 CD 3334 143 53 INFORMATION INFORMATION NNS 3334 143 54 TECHNOLOGY technology NN 3334 143 55 AND and CC 3334 143 56 LIBRARIES LIBRARIES NNP 3334 143 57 | | NNP 3334 143 58 JUNE JUNE NNP 3334 143 59 2006 2006 CD 3334 143 60 not not RB 3334 143 61 on on IN 3334 143 62 the the DT 3334 143 63 site site NN 3334 143 64 , , , 3334 143 65 that that WDT 3334 143 66 could could MD 3334 143 67 be be VB 3334 143 68 candidates candidate NNS 3334 143 69 for for IN 3334 143 70 pre- pre- RB 3334 143 71 programmed program VBN 3334 143 72 “ " `` 3334 143 73 quick quick JJ 3334 143 74 links link NNS 3334 143 75 ” " '' 3334 143 76   '' 3334 143 77 Frequently frequently RB 3334 143 78 entered enter VBD 3334 143 79 terms term NNS 3334 143 80 — — : 3334 143 81 review review NN 3334 143 82 search search NN 3334 143 83 re- re- RB 3334 143 84 sults sult NNS 3334 143 85 to to TO 3334 143 86 identify identify VB 3334 143 87 candidates candidate NNS 3334 143 88 for for IN 3334 143 89 improvement improvement NN 3334 143 90 ■ ■ NN 3334 143 91 Review review NN 3334 143 92 satisfaction satisfaction NN 3334 143 93 surveys survey NNS 3334 143 94 over over IN 3334 143 95 time time NN 3334 143 96   -RRB- 3334 143 97 Look look VB 3334 143 98 for for IN 3334 143 99 new new JJ 3334 143 100 problems problem NNS 3334 143 101 that that WDT 3334 143 102 caused cause VBD 3334 143 103 satisfac- satisfac- PRP$ 3334 143 104 tion tion NN 3334 143 105 to to TO 3334 143 106 decrease decrease VB 3334 143 107   `` 3334 143 108 Analyze analyze JJ 3334 143 109 answers answer NNS 3334 143 110 to to IN 3334 143 111 questions question NNS 3334 143 112 asking ask VBG 3334 143 113 what what WP 3334 143 114 people people NNS 3334 143 115 could could MD 3334 143 116 not not RB 3334 143 117 find find VB 3334 143 118 , , , 3334 143 119 potentially potentially RB 3334 143 120 identifying identify VBG 3334 143 121 new new JJ 3334 143 122 barriers barrier NNS 3334 143 123 to to IN 3334 143 124 success success NN 3334 143 125 ■ ■ NFP 3334 143 126 Conduct conduct NN 3334 143 127 usability usability NN 3334 143 128 studies study NNS 3334 143 129   -RRB- 3334 143 130 Identify identify VB 3334 143 131 issues issue NNS 3334 143 132 with with IN 3334 143 133 the the DT 3334 143 134 user user NN 3334 143 135 interface interface NN 3334 143 136 as as RB 3334 143 137 well well RB 3334 143 138 as as IN 3334 143 139 with with IN 3334 143 140 content content NN 3334 143 141 findability findability NN 3334 143 142 and and CC 3334 143 143 usability usability NN 3334 143 144 ■ ■ NFP 3334 143 145 Review Review NNP 3334 143 146 Help Help NNP 3334 143 147 Desk Desk NNP 3334 143 148 contact contact NN 3334 143 149 reports report NNS 3334 143 150   -LRB- 3334 143 151 Identify identify VB 3334 143 152 which which WDT 3334 143 153 topics topic NNS 3334 143 154 users user NNS 3334 143 155 are be VBP 3334 143 156 having have VBG 3334 143 157 trouble trouble NN 3334 143 158 finding find VBG 3334 143 159 or or CC 3334 143 160 understanding understand VBG 3334 143 161 Step Step NNP 3334 143 162 4 4 CD 3334 143 163 : : : 3334 143 164 Understand understand VB 3334 143 165 the the DT 3334 143 166 needs need NNS 3334 143 167 of of IN 3334 143 168 the the DT 3334 143 169 business business NN 3334 143 170 owners owner NNS 3334 143 171 The the DT 3334 143 172 business business NN 3334 143 173 owners owner NNS 3334 143 174 are be VBP 3334 143 175 the the DT 3334 143 176 IRS IRS NNP 3334 143 177 business business NN 3334 143 178 operating operating NN 3334 143 179 divisions division NNS 3334 143 180 that that WDT 3334 143 181 provide provide VBP 3334 143 182 content content NN 3334 143 183 to to IN 3334 143 184 IRS.gov IRS.gov NNP 3334 143 185 , , , 3334 143 186 such such JJ 3334 143 187 as as IN 3334 143 188 Small Small NNP 3334 143 189 Business Business NNP 3334 143 190 and and CC 3334 143 191 Self Self NNP 3334 143 192 - - HYPH 3334 143 193 Employed Employed NNP 3334 143 194 , , , 3334 143 195 Wage Wage NNP 3334 143 196 and and CC 3334 143 197 Investment Investment NNP 3334 143 198 . . . 3334 144 1 It -PRON- PRP 3334 144 2 is be VBZ 3334 144 3 important important JJ 3334 144 4 to to TO 3334 144 5 involve involve VB 3334 144 6 them -PRON- PRP 3334 144 7 in in IN 3334 144 8 the the DT 3334 144 9 process process NN 3334 144 10 of of IN 3334 144 11 enhancing enhance VBG 3334 144 12 the the DT 3334 144 13 user user NN 3334 144 14 experience experience NN 3334 144 15 , , , 3334 144 16 because because IN 3334 144 17 they -PRON- PRP 3334 144 18 may may MD 3334 144 19 have have VB 3334 144 20 specific specific JJ 3334 144 21 goals goal NNS 3334 144 22 for for IN 3334 144 23 prioritizing prioritize VBG 3334 144 24 information information NN 3334 144 25 on on IN 3334 144 26 a a DT 3334 144 27 particular particular JJ 3334 144 28 topic topic NN 3334 144 29 or or CC 3334 144 30 may may MD 3334 144 31 be be VB 3334 144 32 managing manage VBG 3334 144 33 campaigns campaign NNS 3334 144 34 for for IN 3334 144 35 highlighting highlight VBG 3334 144 36 new new JJ 3334 144 37 informa- informa- JJ 3334 144 38 tion tion NN 3334 144 39 . . . 3334 145 1 Thus thus RB 3334 145 2 it -PRON- PRP 3334 145 3 is be VBZ 3334 145 4 desirable desirable JJ 3334 145 5 to to TO 3334 145 6 : : : 3334 145 7 ■ ■ NFP 3334 145 8 Meet meet VB 3334 145 9 with with IN 3334 145 10 business business NN 3334 145 11 owners owner NNS 3334 145 12 regularly regularly RB 3334 145 13 to to TO 3334 145 14 understand understand VB 3334 145 15 their -PRON- PRP$ 3334 145 16 goals goal NNS 3334 145 17 for for IN 3334 145 18 providing provide VBG 3334 145 19 information information NN 3334 145 20 to to IN 3334 145 21 users user NNS 3334 145 22 ■ ■ NFP 3334 145 23 Work work VB 3334 145 24 with with IN 3334 145 25 them -PRON- PRP 3334 145 26 to to TO 3334 145 27 increase increase VB 3334 145 28 the the DT 3334 145 29 findability findability NN 3334 145 30 of of IN 3334 145 31 their -PRON- PRP$ 3334 145 32 content content NN 3334 145 33 For for IN 3334 145 34 example example NN 3334 145 35 , , , 3334 145 36 when when WRB 3334 145 37 an an DT 3334 145 38 issue issue NN 3334 145 39 in in IN 3334 145 40 finding find VBG 3334 145 41 a a DT 3334 145 42 particular particular JJ 3334 145 43 content content NN 3334 145 44 topic topic NN 3334 145 45 is be VBZ 3334 145 46 identified identify VBN 3334 145 47 ( ( -LRB- 3334 145 48 e.g. e.g. RB 3334 145 49 , , , 3334 145 50 through through IN 3334 145 51 an an DT 3334 145 52 increase increase NN 3334 145 53 in in IN 3334 145 54 Help Help NNP 3334 145 55 Desk Desk NNP 3334 145 56 contacts contact NNS 3334 145 57 ) ) -RRB- 3334 145 58 , , , 3334 145 59 one one CD 3334 145 60 approach approach NN 3334 145 61 is be VBZ 3334 145 62 to to TO 3334 145 63 show show VB 3334 145 64 the the DT 3334 145 65 business business NN 3334 145 66 owner owner NN 3334 145 67 the the DT 3334 145 68 actual actual JJ 3334 145 69 results result NNS 3334 145 70 that that WDT 3334 145 71 common common JJ 3334 145 72 queries query NNS 3334 145 73 ( ( -LRB- 3334 145 74 based base VBN 3334 145 75 on on IN 3334 145 76 the the DT 3334 145 77 site site NN 3334 145 78 - - HYPH 3334 145 79 usage usage NN 3334 145 80 reports report NNS 3334 145 81 ) ) -RRB- 3334 145 82 on on IN 3334 145 83 the the DT 3334 145 84 topic topic NN 3334 145 85 retrieve retrieve NN 3334 145 86 and and CC 3334 145 87 then then RB 3334 145 88 pres- pres- VBZ 3334 145 89 ent ent NN 3334 145 90 suggested suggest VBD 3334 145 91 alternative alternative JJ 3334 145 92 results result NNS 3334 145 93 that that WDT 3334 145 94 could could MD 3334 145 95 be be VB 3334 145 96 retrieved retrieve VBN 3334 145 97 with with IN 3334 145 98 a a DT 3334 145 99 variety variety NN 3334 145 100 of of IN 3334 145 101 enhancement enhancement NN 3334 145 102 techniques technique NNS 3334 145 103 , , , 3334 145 104 such such JJ 3334 145 105 as as IN 3334 145 106 thesau- thesau- NNP 3334 145 107 rus rus NNP 3334 145 108 expansion expansion NN 3334 145 109 or or CC 3334 145 110 title title NN 3334 145 111 improvement improvement NN 3334 145 112 . . . 3334 146 1 The the DT 3334 146 2 business business NN 3334 146 3 owner owner NN 3334 146 4 can can MD 3334 146 5 then then RB 3334 146 6 evaluate evaluate VB 3334 146 7 which which WDT 3334 146 8 set set NN 3334 146 9 of of IN 3334 146 10 results result NNS 3334 146 11 presents present VBZ 3334 146 12 the the DT 3334 146 13 content content NN 3334 146 14 in in IN 3334 146 15 the the DT 3334 146 16 most most RBS 3334 146 17 informative informative JJ 3334 146 18 manner manner NN 3334 146 19 to to IN 3334 146 20 the the DT 3334 146 21 user user NN 3334 146 22 . . . 3334 147 1 Steps step NNS 3334 147 2 1–4 1–4 CD 3334 147 3 facilitate facilitate VBP 3334 147 4 work work NN 3334 147 5 behind behind IN 3334 147 6 the the DT 3334 147 7 scenes scene NNS 3334 147 8 to to TO 3334 147 9 gather gather VB 3334 147 10 the the DT 3334 147 11 data datum NNS 3334 147 12 needed need VBN 3334 147 13 to to TO 3334 147 14 improve improve VB 3334 147 15 precision precision NN 3334 147 16 and and CC 3334 147 17 recall recall NN 3334 147 18 and and CC 3334 147 19 to to TO 3334 147 20 make make VB 3334 147 21 information information NN 3334 147 22 more more RBR 3334 147 23 findable findable JJ 3334 147 24 . . . 3334 148 1 The the DT 3334 148 2 remaining remain VBG 3334 148 3 steps step NNS 3334 148 4 use use VBP 3334 148 5 these these DT 3334 148 6 data datum NNS 3334 148 7 to to TO 3334 148 8 adapt adapt VB 3334 148 9 proven prove VBN 3334 148 10 , , , 3334 148 11 widely widely RB 3334 148 12 used use VBN 3334 148 13 techniques technique NNS 3334 148 14 for for IN 3334 148 15 improv- improv- JJ 3334 148 16 ing ing NN 3334 148 17 search search NN 3334 148 18 experiences experience NNS 3334 148 19 to to IN 3334 148 20 a a DT 3334 148 21 Web web NN 3334 148 22 site site NN 3334 148 23 ’s ’s POS 3334 148 24 specific specific JJ 3334 148 25 environment environment NN 3334 148 26 . . . 3334 149 1 Step step NN 3334 149 2 5 5 CD 3334 149 3 : : : 3334 149 4 Identify identify VB 3334 149 5 appropriate appropriate JJ 3334 149 6 tools tool NNS 3334 149 7 to to TO 3334 149 8 improve improve VB 3334 149 9 the the DT 3334 149 10 information information NN 3334 149 11 - - HYPH 3334 149 12 retrieval retrieval NN 3334 149 13 process process NN 3334 149 14 As as IN 3334 149 15 described describe VBN 3334 149 16 in in IN 3334 149 17 the the DT 3334 149 18 previous previous JJ 3334 149 19 section section NN 3334 149 20 , , , 3334 149 21 the the DT 3334 149 22 tools tool NNS 3334 149 23 in in IN 3334 149 24 our -PRON- PRP$ 3334 149 25 toolkit toolkit NNS 3334 149 26 are be VBP 3334 149 27 document document JJ 3334 149 28 engineering engineering NN 3334 149 29 , , , 3334 149 30 query query NN 3334 149 31 enhancement enhancement NN 3334 149 32 , , , 3334 149 33 search search NN 3334 149 34 improvement improvement NN 3334 149 35 , , , 3334 149 36 results result NNS 3334 149 37 - - HYPH 3334 149 38 ranking rank VBG 3334 149 39 improvement improvement NN 3334 149 40 , , , 3334 149 41 cat- cat- JJ 3334 149 42 egorization egorization NN 3334 149 43 , , , 3334 149 44 and and CC 3334 149 45 summarization summarization NN 3334 149 46 . . . 3334 150 1 Step step NN 3334 150 2 6 6 CD 3334 150 3 : : : 3334 150 4 Repeat repeat NN 3334 150 5 as as RB 3334 150 6 needed need VBD 3334 150 7 The the DT 3334 150 8 process process NN 3334 150 9 of of IN 3334 150 10 improving improve VBG 3334 150 11 the the DT 3334 150 12 user user NN 3334 150 13 search search NN 3334 150 14 experience experience NN 3334 150 15 is be VBZ 3334 150 16 ongoing ongoing JJ 3334 150 17 as as IN 3334 150 18 the the DT 3334 150 19 site site NN 3334 150 20 evolves evolve VBZ 3334 150 21 . . . 3334 151 1 At at IN 3334 151 2 IRS.gov IRS.gov NNP 3334 151 3 , , , 3334 151 4 different different JJ 3334 151 5 search search NN 3334 151 6 terms term NNS 3334 151 7 appear appear VBP 3334 151 8 on on IN 3334 151 9 the the DT 3334 151 10 site site NN 3334 151 11 - - HYPH 3334 151 12 usage usage NN 3334 151 13 reports report NNS 3334 151 14 over over IN 3334 151 15 time time NN 3334 151 16 , , , 3334 151 17 depend- depend- NNP 3334 151 18 ing ing NNP 3334 151 19 on on IN 3334 151 20 whether whether IN 3334 151 21 or or CC 3334 151 22 not not RB 3334 151 23 it -PRON- PRP 3334 151 24 is be VBZ 3334 151 25 filing file VBG 3334 151 26 season season NN 3334 151 27 , , , 3334 151 28 or or CC 3334 151 29 as as IN 3334 151 30 new new JJ 3334 151 31 content content NN 3334 151 32 and and CC 3334 151 33 applications application NNS 3334 151 34 are be VBP 3334 151 35 published publish VBN 3334 151 36 . . . 3334 152 1 Human human JJ 3334 152 2 intervention intervention NN 3334 152 3 ( ( -LRB- 3334 152 4 with with IN 3334 152 5 the the DT 3334 152 6 help help NN 3334 152 7 of of IN 3334 152 8 applicable applicable JJ 3334 152 9 tracking tracking NN 3334 152 10 software software NN 3334 152 11 ) ) -RRB- 3334 152 12 is be VBZ 3334 152 13 essen- essen- NNP 3334 152 14 tial tial NN 3334 152 15 for for IN 3334 152 16 incorporating incorporate VBG 3334 152 17 business business NN 3334 152 18 requirements requirement NNS 3334 152 19 , , , 3334 152 20 evaluating evaluate VBG 3334 152 21 human human JJ 3334 152 22 behavior behavior NN 3334 152 23 , , , 3334 152 24 and and CC 3334 152 25 identifying identify VBG 3334 152 26 changing change VBG 3334 152 27 terms term NNS 3334 152 28 . . . 3334 153 1 Step step NN 3334 153 2 7 7 CD 3334 153 3 : : : 3334 153 4 Monitor monitor VB 3334 153 5 new new JJ 3334 153 6 developments development NNS 3334 153 7 in in IN 3334 153 8 search search NN 3334 153 9 and and CC 3334 153 10 analytic analytic JJ 3334 153 11 technologies technology NNS 3334 153 12 and and CC 3334 153 13 replace replace VB 3334 153 14 the the DT 3334 153 15 search search NN 3334 153 16 engine engine NN 3334 153 17 as as RB 3334 153 18 appropriate appropriate JJ 3334 153 19 Although although IN 3334 153 20 a a DT 3334 153 21 new new JJ 3334 153 22 search search NN 3334 153 23 engine engine NN 3334 153 24 will will MD 3334 153 25 not not RB 3334 153 26 address address VB 3334 153 27 all all PDT 3334 153 28 the the DT 3334 153 29 issues issue NNS 3334 153 30 that that WDT 3334 153 31 have have VBP 3334 153 32 been be VBN 3334 153 33 described describe VBN 3334 153 34 , , , 3334 153 35 new new JJ 3334 153 36 features feature NNS 3334 153 37 such such JJ 3334 153 38 as as IN 3334 153 39 passage passage NN 3334 153 40 - - HYPH 3334 153 41 based base VBN 3334 153 42 summaries summary NNS 3334 153 43 and and CC 3334 153 44 term term NN 3334 153 45 - - HYPH 3334 153 46 highlighting highlight VBG 3334 153 47 can can MD 3334 153 48 improve improve VB 3334 153 49 the the DT 3334 153 50 search search NN 3334 153 51 experience experience NN 3334 153 52 . . . 3334 154 1 Of of RB 3334 154 2 course course RB 3334 154 3 , , , 3334 154 4 one one PRP 3334 154 5 should should MD 3334 154 6 consider consider VB 3334 154 7 replacing replace VBG 3334 154 8 a a DT 3334 154 9 search search NN 3334 154 10 engine engine NN 3334 154 11 if if IN 3334 154 12 new new JJ 3334 154 13 technology technology NN 3334 154 14 can can MD 3334 154 15 demonstrate demonstrate VB 3334 154 16 significantly significantly RB 3334 154 17 improved improve VBN 3334 154 18 precision precision NN 3334 154 19 and and CC 3334 154 20 recall recall NN 3334 154 21 . . . 3334 155 1 The the DT 3334 155 2 application application NN 3334 155 3 of of IN 3334 155 4 the the DT 3334 155 5 methodology methodology NN 3334 155 6 and and CC 3334 155 7 the the DT 3334 155 8 use use NN 3334 155 9 of of IN 3334 155 10 the the DT 3334 155 11 toolkit toolkit NNS 3334 155 12 for for IN 3334 155 13 IRS.gov IRS.gov NNP 3334 155 14 will will MD 3334 155 15 be be VB 3334 155 16 described describe VBN 3334 155 17 in in IN 3334 155 18 the the DT 3334 155 19 next next JJ 3334 155 20 section section NN 3334 155 21 . . . 3334 156 1 ■ ■ NFP 3334 156 2 Findings finding NNS 3334 156 3 Site Site NNP 3334 156 4 - - HYPH 3334 156 5 usage usage NN 3334 156 6 reports report NNS 3334 156 7 In in IN 3334 156 8 2003 2003 CD 3334 156 9 , , , 3334 156 10 an an DT 3334 156 11 example example NN 3334 156 12 of of IN 3334 156 13 a a DT 3334 156 14 serious serious JJ 3334 156 15 mismatch mismatch NN 3334 156 16 in in IN 3334 156 17 user user NN 3334 156 18 and and CC 3334 156 19 content content NN 3334 156 20 terminology terminology NN 3334 156 21 was be VBD 3334 156 22 discovered discover VBN 3334 156 23 when when WRB 3334 156 24 site site NN 3334 156 25 - - HYPH 3334 156 26 usage usage NN 3334 156 27 reports report NNS 3334 156 28 were be VBD 3334 156 29 analyzed analyze VBN 3334 156 30 . . . 3334 157 1 Users user NNS 3334 157 2 entering enter VBG 3334 157 3 the the DT 3334 157 4 equivalent equivalent JJ 3334 157 5 terms term NNS 3334 157 6 EIN EIN NNP 3334 157 7 , , , 3334 157 8 employer employer NN 3334 157 9 number number NN 3334 157 10 , , , 3334 157 11 employer employer NN 3334 157 12 i -PRON- PRP 3334 157 13 d d NN 3334 157 14 number number NN 3334 157 15 , , , 3334 157 16 and and CC 3334 157 17 employer employer NN 3334 157 18 identification identification NN 3334 157 19 number number NN 3334 157 20 retrieved retrieve VBD 3334 157 21 significantly significantly RB 3334 157 22 different different JJ 3334 157 23 sets set NNS 3334 157 24 of of IN 3334 157 25 results result NNS 3334 157 26 . . . 3334 158 1 We -PRON- PRP 3334 158 2 met meet VBD 3334 158 3 with with IN 3334 158 4 the the DT 3334 158 5 business business NN 3334 158 6 owner owner NN 3334 158 7 , , , 3334 158 8 who who WP 3334 158 9 identified identify VBD 3334 158 10 a a DT 3334 158 11 key key NN 3334 158 12 - - HYPH 3334 158 13 starting starting NN 3334 158 14 page page NN 3334 158 15 that that WDT 3334 158 16 should should MD 3334 158 17 be be VB 3334 158 18 retrieved retrieve VBN 3334 158 19 along along IN 3334 158 20 with with IN 3334 158 21 other other JJ 3334 158 22 highly highly RB 3334 158 23 relevant relevant JJ 3334 158 24 pages page NNS 3334 158 25 for for IN 3334 158 26 all all DT 3334 158 27 of of IN 3334 158 28 these these DT 3334 158 29 query query NN 3334 158 30 terms term NNS 3334 158 31 . . . 3334 159 1 We -PRON- PRP 3334 159 2 recommended recommend VBD 3334 159 3 that that IN 3334 159 4 “ " `` 3334 159 5 EIN EIN NNP 3334 159 6 ” " '' 3334 159 7 be be VB 3334 159 8 added add VBN 3334 159 9 to to IN 3334 159 10 the the DT 3334 159 11 title title NN 3334 159 12 of of IN 3334 159 13 the the DT 3334 159 14 key key JJ 3334 159 15 page page NN 3334 159 16 because because IN 3334 159 17 , , , 3334 159 18 although although IN 3334 159 19 EIN EIN NNP 3334 159 20 is be VBZ 3334 159 21 a a DT 3334 159 22 very very RB 3334 159 23 popular popular JJ 3334 159 24 query query NN 3334 159 25 , , , 3334 159 26 the the DT 3334 159 27 acronym acronym NN 3334 159 28 was be VBD 3334 159 29 not not RB 3334 159 30 used use VBN 3334 159 31 in in IN 3334 159 32 the the DT 3334 159 33 content content NN 3334 159 34 , , , 3334 159 35 but but CC 3334 159 36 was be VBD 3334 159 37 instead instead RB 3334 159 38 spelled spell VBN 3334 159 39 out out RP 3334 159 40 . . . 3334 160 1 As as IN 3334 160 2 a a DT 3334 160 3 result result NN 3334 160 4 , , , 3334 160 5 the the DT 3334 160 6 key key JJ 3334 160 7 page page NN 3334 160 8 was be VBD 3334 160 9 not not RB 3334 160 10 being be VBG 3334 160 11 retrieved retrieve VBN 3334 160 12 . . . 3334 161 1 Synonyms Synonyms NNP 3334 161 2 were be VBD 3334 161 3 added add VBN 3334 161 4 to to IN 3334 161 5 the the DT 3334 161 6 query query NNP 3334 161 7 enhancement enhancement NN 3334 161 8 thesaurus thesaurus NNP 3334 161 9 to to TO 3334 161 10 accommodate accommodate VB 3334 161 11 the the DT 3334 161 12 variants variant NNS 3334 161 13 on on IN 3334 161 14 the the DT 3334 161 15 EIN EIN NNP 3334 161 16 concept concept NN 3334 161 17 . . . 3334 162 1 After after IN 3334 162 2 these these DT 3334 162 3 steps step NNS 3334 162 4 were be VBD 3334 162 5 implemented implement VBN 3334 162 6 , , , 3334 162 7 the the DT 3334 162 8 results result NNS 3334 162 9 were be VBD 3334 162 10 as as IN 3334 162 11 follows follow VBZ 3334 162 12 : : : 3334 162 13 ■ ■ NFP 3334 162 14 For for IN 3334 162 15 the the DT 3334 162 16 query query NNP 3334 162 17 ein ein NNP 3334 162 18 , , , 3334 162 19 the the DT 3334 162 20 target target NN 3334 162 21 page page NN 3334 162 22 moved move VBD 3334 162 23 from from IN 3334 162 24 # # $ 3334 162 25 16 16 CD 3334 162 26 to to IN 3334 162 27 # # $ 3334 162 28 1 1 CD 3334 162 29 ■ ■ NFP 3334 162 30 For for IN 3334 162 31 the the DT 3334 162 32 query query NN 3334 162 33 ein ein NN 3334 162 34 number number NN 3334 162 35 , , , 3334 162 36 it -PRON- PRP 3334 162 37 moved move VBD 3334 162 38 from from IN 3334 162 39 # # $ 3334 162 40 17 17 CD 3334 162 41 to to IN 3334 162 42 # # $ 3334 162 43 5 5 CD 3334 162 44 ARTICLE ARTICLE NNP 3334 162 45 TITLE TITLE NNP 3334 162 46 | | NNP 3334 162 47 AUTHOR AUTHOR NNP 3334 162 48 85A 85A NNPS 3334 162 49 DYNAMIC dynamic VB 3334 162 50 METHODOLOGY methodology NN 3334 162 51 FOR for IN 3334 162 52 IMPROVING improve VBG 3334 162 53 THE the DT 3334 162 54 SEARCH SEARCH NNS 3334 162 55 EXPERIENCE EXPERIENCE NNP 3334 162 56 | | CD 3334 162 57 KERCHNER kerchner NN 3334 162 58 85 85 CD 3334 162 59 ■ ■ CD 3334 162 60 For for IN 3334 162 61 the the DT 3334 162 62 query query NN 3334 162 63 employer employer NN 3334 162 64 identification identification NN 3334 162 65 number number NN 3334 162 66 , , , 3334 162 67 it -PRON- PRP 3334 162 68 moved move VBD 3334 162 69 up up RB 3334 162 70 to to IN 3334 162 71 # # $ 3334 162 72 2 2 CD 3334 162 73 ( ( -LRB- 3334 162 74 it -PRON- PRP 3334 162 75 was be VBD 3334 162 76 not not RB 3334 162 77 in in IN 3334 162 78 the the DT 3334 162 79 top top JJ 3334 162 80 20 20 CD 3334 162 81 previously previously RB 3334 162 82 ) ) -RRB- 3334 162 83 ■ ■ NFP 3334 162 84 All all DT 3334 162 85 search search NN 3334 162 86 results result NNS 3334 162 87 now now RB 3334 162 88 retrieved retrieve VBN 3334 162 89 on on IN 3334 162 90 the the DT 3334 162 91 first first JJ 3334 162 92 page page NN 3334 162 93 for for IN 3334 162 94 these these DT 3334 162 95 terms term NNS 3334 162 96 were be VBD 3334 162 97 highly highly RB 3334 162 98 relevant relevant JJ 3334 162 99 In in IN 3334 162 100 January January NNP 3334 162 101 2004 2004 CD 3334 162 102 , , , 3334 162 103 there there EX 3334 162 104 were be VBD 3334 162 105 approximately approximately RB 3334 162 106 twenty twenty CD 3334 162 107 thousand thousand CD 3334 162 108 queries query NNS 3334 162 109 using use VBG 3334 162 110 these these DT 3334 162 111 terms term NNS 3334 162 112 , , , 3334 162 113 so so IN 3334 162 114 the the DT 3334 162 115 search search NN 3334 162 116 experi- experi- NN 3334 162 117 ence ence NN 3334 162 118 has have VBZ 3334 162 119 been be VBN 3334 162 120 improved improve VBN 3334 162 121 for for IN 3334 162 122 tens ten NNS 3334 162 123 of of IN 3334 162 124 thousands thousand NNS 3334 162 125 of of IN 3334 162 126 users user NNS 3334 162 127 in in IN 3334 162 128 one one CD 3334 162 129 month month NN 3334 162 130 and and CC 3334 162 131 hundreds hundred NNS 3334 162 132 of of IN 3334 162 133 thousands thousand NNS 3334 162 134 of of IN 3334 162 135 users user NNS 3334 162 136 through- through- VBG 3334 162 137 out out RP 3334 162 138 the the DT 3334 162 139 year year NN 3334 162 140 . . . 3334 163 1 ■ ■ NFP 3334 163 2 Review Review NNP 3334 163 3 of of IN 3334 163 4 Help Help NNP 3334 163 5 Desk Desk NNP 3334 163 6 contacts contact NNS 3334 163 7 Help Help NNP 3334 163 8 Desk Desk NNP 3334 163 9 reports report NNS 3334 163 10 summarize summarize VB 3334 163 11 , , , 3334 163 12 for for IN 3334 163 13 each each DT 3334 163 14 call call NN 3334 163 15 or or CC 3334 163 16 e e NN 3334 163 17 - - NN 3334 163 18 mail mail NN 3334 163 19 , , , 3334 163 20 the the DT 3334 163 21 general general JJ 3334 163 22 topic topic NN 3334 163 23 of of IN 3334 163 24 the the DT 3334 163 25 user user NN 3334 163 26 ’s ’s POS 3334 163 27 contact contact NN 3334 163 28 ( ( -LRB- 3334 163 29 filing filing NN 3334 163 30 information information NN 3334 163 31 , , , 3334 163 32 employer employer NN 3334 163 33 ID ID NNP 3334 163 34 number number NN 3334 163 35 , , , 3334 163 36 forms form NNS 3334 163 37 , , , 3334 163 38 and and CC 3334 163 39 publications publication NNS 3334 163 40 issues issue NNS 3334 163 41 ) ) -RRB- 3334 163 42 and and CC 3334 163 43 the the DT 3334 163 44 specific specific JJ 3334 163 45 question question NN 3334 163 46 . . . 3334 164 1 For for IN 3334 164 2 example example NN 3334 164 3 , , , 3334 164 4 the the DT 3334 164 5 report report NN 3334 164 6 might may MD 3334 164 7 indicate indicate VB 3334 164 8 that that IN 3334 164 9 a a DT 3334 164 10 user user NN 3334 164 11 needed need VBN 3334 164 12 help help NN 3334 164 13 in in IN 3334 164 14 finding find VBG 3334 164 15 or or CC 3334 164 16 download- download- VB 3334 164 17 ing e VBG 3334 164 18 the the DT 3334 164 19 W-4 W-4 NNP 3334 164 20 form form NN 3334 164 21 or or CC 3334 164 22 did do VBD 3334 164 23 not not RB 3334 164 24 understand understand VB 3334 164 25 the the DT 3334 164 26 instructions instruction NNS 3334 164 27 for for IN 3334 164 28 amending amend VBG 3334 164 29 a a DT 3334 164 30 tax tax NN 3334 164 31 return return NN 3334 164 32 . . . 3334 165 1 As as IN 3334 165 2 Help Help NNP 3334 165 3 Desk Desk NNP 3334 165 4 contact contact NN 3334 165 5 reports report NNS 3334 165 6 were be VBD 3334 165 7 reviewed review VBN 3334 165 8 , , , 3334 165 9 clusters cluster NNS 3334 165 10 of of IN 3334 165 11 questions question NNS 3334 165 12 emerged emerge VBD 3334 165 13 indicating indicate VBG 3334 165 14 information information NN 3334 165 15 that that IN 3334 165 16 many many JJ 3334 165 17 users user NNS 3334 165 18 could could MD 3334 165 19 not not RB 3334 165 20 find find VB 3334 165 21 or or CC 3334 165 22 under- under- JJ 3334 165 23 stand stand NN 3334 165 24 . . . 3334 166 1 By by IN 3334 166 2 analyzing analyze VBG 3334 166 3 approximately approximately RB 3334 166 4 9,800 9,800 CD 3334 166 5 contacts contact NNS 3334 166 6 ( ( -LRB- 3334 166 7 e e NN 3334 166 8 - - NN 3334 166 9 mail mail NN 3334 166 10 , , , 3334 166 11 telephone telephone NN 3334 166 12 , , , 3334 166 13 chat chat VBP 3334 166 14 ) ) -RRB- 3334 166 15 during during IN 3334 166 16 a a DT 3334 166 17 peak peak NN 3334 166 18 five five CD 3334 166 19 - - HYPH 3334 166 20 day day NN 3334 166 21 period period NN 3334 166 22 in in IN 3334 166 23 April April NNP 3334 166 24 2003 2003 CD 3334 166 25 , , , 3334 166 26 four four CD 3334 166 27 particular particular JJ 3334 166 28 areas area NNS 3334 166 29 were be VBD 3334 166 30 identified identify VBN 3334 166 31 that that WDT 3334 166 32 were be VBD 3334 166 33 ripe ripe JJ 3334 166 34 for for IN 3334 166 35 improvement improvement NN 3334 166 36 : : : 3334 166 37 480 480 CD 3334 166 38 users user NNS 3334 166 39 could could MD 3334 166 40 not not RB 3334 166 41 find find VB 3334 166 42 previous previous JJ 3334 166 43 years year NNS 3334 166 44 ’ ’ POS 3334 166 45 forms form NNS 3334 166 46 , , , 3334 166 47 which which WDT 3334 166 48 , , , 3334 166 49 although although IN 3334 166 50 they -PRON- PRP 3334 166 51 can can MD 3334 166 52 be be VB 3334 166 53 found find VBN 3334 166 54 on on IN 3334 166 55 the the DT 3334 166 56 site site NN 3334 166 57 , , , 3334 166 58 are be VBP 3334 166 59 not not RB 3334 166 60 indexed index VBN 3334 166 61 and and CC 3334 166 62 thus thus RB 3334 166 63 not not RB 3334 166 64 findable findable JJ 3334 166 65 through through IN 3334 166 66 search search NN 3334 166 67 ; ; : 3334 166 68 250 250 CD 3334 166 69 users user NNS 3334 166 70 had have VBD 3334 166 71 questions question NNS 3334 166 72 about about IN 3334 166 73 where where WRB 3334 166 74 to to TO 3334 166 75 send send VB 3334 166 76 their -PRON- PRP$ 3334 166 77 tax tax NN 3334 166 78 returns return NNS 3334 166 79 ; ; : 3334 166 80 170 170 CD 3334 166 81 users user NNS 3334 166 82 had have VBD 3334 166 83 questions question NNS 3334 166 84 about about IN 3334 166 85 getting get VBG 3334 166 86 a a DT 3334 166 87 copy copy NN 3334 166 88 of of IN 3334 166 89 their -PRON- PRP$ 3334 166 90 tax tax NN 3334 166 91 return return NN 3334 166 92 or or CC 3334 166 93 W-2 W-2 NNP 3334 166 94 form form NN 3334 166 95 ; ; : 3334 166 96 and and CC 3334 166 97 77 77 CD 3334 166 98 users user NNS 3334 166 99 had have VBD 3334 166 100 problems problem NNS 3334 166 101 finding find VBG 3334 166 102 the the DT 3334 166 103 1040X 1040X NNP 3334 166 104 or or CC 3334 166 105 1040EZ 1040ez CD 3334 166 106 forms form NNS 3334 166 107 . . . 3334 167 1 Utilizing utilize VBG 3334 167 2 the the DT 3334 167 3 information information NN 3334 167 4 retrieval retrieval NN 3334 167 5 toolkit toolkit NNP 3334 167 6 , , , 3334 167 7 the the DT 3334 167 8 follow- follow- JJ 3334 167 9 ing ing NN 3334 167 10 improvements improvement NNS 3334 167 11 were be VBD 3334 167 12 implemented implement VBN 3334 167 13 : : : 3334 167 14 a a LS 3334 167 15 ) ) -RRB- 3334 167 16 Search search VB 3334 167 17 for for IN 3334 167 18 previous previous JJ 3334 167 19 years year NNS 3334 167 20 ’ ’ POS 3334 167 21 forms form NNS 3334 167 22 Tool Tool NNP 3334 167 23 used use VBD 3334 167 24 : : : 3334 167 25 Results result NNS 3334 167 26 - - HYPH 3334 167 27 ranking rank VBG 3334 167 28 improvement improvement NN 3334 167 29 A a DT 3334 167 30 user user NN 3334 167 31 requesting request VBG 3334 167 32 a a DT 3334 167 33 previous previous JJ 3334 167 34 year year NN 3334 167 35 ’s ’s POS 3334 167 36 forms form NNS 3334 167 37 ( ( -LRB- 3334 167 38 for for IN 3334 167 39 exam- exam- NNP 3334 167 40 ple ple NNP 3334 167 41 , , , 3334 167 42 2002 2002 CD 3334 167 43 1099misc 1099misc CD 3334 167 44 ) ) -RRB- 3334 167 45 is be VBZ 3334 167 46 now now RB 3334 167 47 presented present VBN 3334 167 48 with with IN 3334 167 49 a a DT 3334 167 50 link link NN 3334 167 51 directly directly RB 3334 167 52 to to IN 3334 167 53 the the DT 3334 167 54 page page NN 3334 167 55 of of IN 3334 167 56 forms form NNS 3334 167 57 for for IN 3334 167 58 that that DT 3334 167 59 specific specific JJ 3334 167 60 year year NN 3334 167 61 , , , 3334 167 62 as as IN 3334 167 63 follows follow VBZ 3334 167 64 : : : 3334 167 65 Recommendation(s recommendation(s CD 3334 167 66 ) ) -RRB- 3334 167 67 for for IN 3334 167 68 : : : 3334 167 69 2002 2002 CD 3334 167 70 1099misc 1099misc CD 3334 167 71 ■ ■ CD 3334 167 72 2002 2002 CD 3334 167 73 Forms Forms NNPS 3334 167 74 and and CC 3334 167 75 Publications Publications NNPS 3334 167 76 2002 2002 CD 3334 167 77 Forms Forms NNPS 3334 167 78 , , , 3334 167 79 instructions instruction NNS 3334 167 80 , , , 3334 167 81 and and CC 3334 167 82 publications publication NNS 3334 167 83 available available JJ 3334 167 84 in in IN 3334 167 85 PDF PDF NNP 3334 167 86 format format NN 3334 167 87 b b NN 3334 167 88 ) ) -RRB- 3334 167 89 Request request NN 3334 167 90 for for IN 3334 167 91 filing file VBG 3334 167 92 address address NN 3334 167 93 Tools tool NNS 3334 167 94 used use VBD 3334 167 95 : : : 3334 167 96 Document document NN 3334 167 97 engineering engineering NN 3334 167 98 and and CC 3334 167 99 query query NN 3334 167 100 en- en- CC 3334 167 101 hancement hancement NN 3334 167 102 A a DT 3334 167 103 new new JJ 3334 167 104 “ " `` 3334 167 105 where where WRB 3334 167 106 to to TO 3334 167 107 file file VB 3334 167 108 ” " '' 3334 167 109 page page NN 3334 167 110 was be VBD 3334 167 111 created create VBN 3334 167 112 . . . 3334 168 1 Synonyms Synonyms NNP 3334 168 2 were be VBD 3334 168 3 added add VBN 3334 168 4 to to IN 3334 168 5 the the DT 3334 168 6 thesaurus thesaurus NN 3334 168 7 to to TO 3334 168 8 accommodate accommodate VB 3334 168 9 the the DT 3334 168 10 varia- varia- JJ 3334 168 11 tions tion NNS 3334 168 12 on on IN 3334 168 13 how how WRB 3334 168 14 people people NNS 3334 168 15 make make VBP 3334 168 16 this this DT 3334 168 17 request request NN 3334 168 18 ( ( -LRB- 3334 168 19 address address NN 3334 168 20 , , , 3334 168 21 where where WRB 3334 168 22 to to TO 3334 168 23 send send VB 3334 168 24 , , , 3334 168 25 where where WRB 3334 168 26 to to TO 3334 168 27 mail mail NN 3334 168 28 ) ) -RRB- 3334 168 29 and and CC 3334 168 30 to to TO 3334 168 31 prioritize prioritize VB 3334 168 32 retrieval retrieval NN 3334 168 33 of of IN 3334 168 34 the the DT 3334 168 35 “ " `` 3334 168 36 where where WRB 3334 168 37 to to TO 3334 168 38 file file VB 3334 168 39 ” " '' 3334 168 40 page page NN 3334 168 41 . . . 3334 169 1 c c LS 3334 169 2 ) ) -RRB- 3334 169 3 Request request NN 3334 169 4 for for IN 3334 169 5 information information NN 3334 169 6 about about IN 3334 169 7 obtaining obtain VBG 3334 169 8 a a DT 3334 169 9 copy copy NN 3334 169 10 of of IN 3334 169 11 a a DT 3334 169 12 tax tax NN 3334 169 13 return return NN 3334 169 14 or or CC 3334 169 15 W-2 W-2 NNP 3334 169 16 form form NN 3334 169 17 Tools tool NNS 3334 169 18 used use VBD 3334 169 19 : : : 3334 169 20 Results result NNS 3334 169 21 - - HYPH 3334 169 22 ranking rank VBG 3334 169 23 improvement improvement NN 3334 169 24 and and CC 3334 169 25 query query NN 3334 169 26 enhancement enhancement NN 3334 169 27 A a DT 3334 169 28 “ " `` 3334 169 29 quick quick JJ 3334 169 30 link link NN 3334 169 31 ” " '' 3334 169 32 was be VBD 3334 169 33 created create VBN 3334 169 34 to to IN 3334 169 35 the the DT 3334 169 36 target target NN 3334 169 37 page page NN 3334 169 38 for for IN 3334 169 39 get- get- RB 3334 169 40 ting te VBG 3334 169 41 a a DT 3334 169 42 copy copy NN 3334 169 43 of of IN 3334 169 44 returns return NNS 3334 169 45 and and CC 3334 169 46 W-2 W-2 NNP 3334 169 47 forms form NNS 3334 169 48 and and CC 3334 169 49 synonyms synonyms NN 3334 169 50 were be VBD 3334 169 51 added add VBN 3334 169 52 to to IN 3334 169 53 the the DT 3334 169 54 thesaurus thesaurus NN 3334 169 55 to to TO 3334 169 56 prioritize prioritize VB 3334 169 57 related related JJ 3334 169 58 content content NN 3334 169 59 for for IN 3334 169 60 any any DT 3334 169 61 query query NN 3334 169 62 containing contain VBG 3334 169 63 the the DT 3334 169 64 word word NN 3334 169 65 “ " `` 3334 169 66 copy copy NN 3334 169 67 . . . 3334 169 68 ” " '' 3334 169 69 d d NN 3334 169 70 ) ) -RRB- 3334 169 71 Requests Requests NNPS 3334 169 72 for for IN 3334 169 73 1040X 1040x CD 3334 169 74 or or CC 3334 169 75 1040EZ 1040ez CD 3334 169 76 forms form NNS 3334 169 77 or or CC 3334 169 78 instructions instruction NNS 3334 169 79 Tool Tool NNP 3334 169 80 used use VBD 3334 169 81 : : : 3334 169 82 Query query NN 3334 169 83 enhancement enhancement NN 3334 169 84 Synonyms Synonyms NNP 3334 169 85 were be VBD 3334 169 86 added add VBN 3334 169 87 to to IN 3334 169 88 the the DT 3334 169 89 thesaurus thesaurus NNP 3334 169 90 to to TO 3334 169 91 address address VB 3334 169 92 both both CC 3334 169 93 the the DT 3334 169 94 variations variation NNS 3334 169 95 on on IN 3334 169 96 how how WRB 3334 169 97 users user NNS 3334 169 98 requested request VBD 3334 169 99 the the DT 3334 169 100 1040X 1040X NNP 3334 169 101 and and CC 3334 169 102 1040EZ 1040ez CD 3334 169 103 forms form NNS 3334 169 104 and and CC 3334 169 105 instructions instruction NNS 3334 169 106 , , , 3334 169 107 and and CC 3334 169 108 the the DT 3334 169 109 inconsisten- inconsisten- NN 3334 169 110 cies cie NNS 3334 169 111 in in IN 3334 169 112 the the DT 3334 169 113 titling titling NN 3334 169 114 of of IN 3334 169 115 these these DT 3334 169 116 documents document NNS 3334 169 117 ( ( -LRB- 3334 169 118 for for IN 3334 169 119 example example NN 3334 169 120 , , , 3334 169 121 the the DT 3334 169 122 form form NN 3334 169 123 and and CC 3334 169 124 the the DT 3334 169 125 instructions instruction NNS 3334 169 126 have have VBP 3334 169 127 different different JJ 3334 169 128 variations variation NNS 3334 169 129 of of IN 3334 169 130 the the DT 3334 169 131 compound compound NN 3334 169 132 name name NN 3334 169 133 ) ) -RRB- 3334 169 134 . . . 3334 170 1 ■ ■ NFP 3334 170 2 Results result NNS 3334 170 3 In in IN 3334 170 4 2004 2004 CD 3334 170 5 , , , 3334 170 6 approximately approximately RB 3334 170 7 4,200 4,200 CD 3334 170 8 contacts contact NNS 3334 170 9 were be VBD 3334 170 10 reviewed review VBN 3334 170 11 with with IN 3334 170 12 the the DT 3334 170 13 Help Help NNP 3334 170 14 Desk Desk NNP 3334 170 15 during during IN 3334 170 16 the the DT 3334 170 17 same same JJ 3334 170 18 time time NN 3334 170 19 period period NN 3334 170 20 ( ( -LRB- 3334 170 21 the the DT 3334 170 22 week week NN 3334 170 23 before before IN 3334 170 24 April April NNP 3334 170 25 15 15 CD 3334 170 26 ) ) -RRB- 3334 170 27 to to TO 3334 170 28 see see VB 3334 170 29 whether whether IN 3334 170 30 the the DT 3334 170 31 changes change NNS 3334 170 32 actually actually RB 3334 170 33 did do VBD 3334 170 34 help help VB 3334 170 35 users user NNS 3334 170 36 find find VB 3334 170 37 the the DT 3334 170 38 information information NN 3334 170 39 . . . 3334 171 1 It -PRON- PRP 3334 171 2 should should MD 3334 171 3 be be VB 3334 171 4 noted note VBN 3334 171 5 that that IN 3334 171 6 , , , 3334 171 7 during during IN 3334 171 8 this this DT 3334 171 9 period period NN 3334 171 10 from from IN 3334 171 11 April April NNP 3334 171 12 2003 2003 CD 3334 171 13 to to IN 3334 171 14 April April NNP 3334 171 15 2004 2004 CD 3334 171 16 , , , 3334 171 17 many many JJ 3334 171 18 other other JJ 3334 171 19 improvements improvement NNS 3334 171 20 to to IN 3334 171 21 the the DT 3334 171 22 user user NN 3334 171 23 search search NN 3334 171 24 experience experience NN 3334 171 25 based base VBN 3334 171 26 on on IN 3334 171 27 the the DT 3334 171 28 methodology methodology NN 3334 171 29 were be VBD 3334 171 30 deployed deploy VBN 3334 171 31 . . . 3334 172 1 Although although IN 3334 172 2 the the DT 3334 172 3 number number NN 3334 172 4 of of IN 3334 172 5 visits visit NNS 3334 172 6 to to IN 3334 172 7 IRS.gov irs.gov VB 3334 172 8 increased increase VBN 3334 172 9 by by IN 3334 172 10 approximately approximately RB 3334 172 11 50 50 CD 3334 172 12 percent percent NN 3334 172 13 compared compare VBN 3334 172 14 with with IN 3334 172 15 the the DT 3334 172 16 same same JJ 3334 172 17 period period NN 3334 172 18 in in IN 3334 172 19 2003 2003 CD 3334 172 20 , , , 3334 172 21 the the DT 3334 172 22 total total JJ 3334 172 23 number number NN 3334 172 24 of of IN 3334 172 25 contacts contact NNS 3334 172 26 with with IN 3334 172 27 the the DT 3334 172 28 Help Help NNP 3334 172 29 Desk Desk NNP 3334 172 30 decreased decrease VBD 3334 172 31 by by IN 3334 172 32 47 47 CD 3334 172 33 percent percent NN 3334 172 34 ( ( -LRB- 3334 172 35 there there EX 3334 172 36 were be VBD 3334 172 37 approximately approximately RB 3334 172 38 9,800 9,800 CD 3334 172 39 contacts contact NNS 3334 172 40 in in IN 3334 172 41 this this DT 3334 172 42 period period NN 3334 172 43 in in IN 3334 172 44 2003 2003 CD 3334 172 45 ) ) -RRB- 3334 172 46 . . . 3334 173 1 The the DT 3334 173 2 results result NNS 3334 173 3 for for IN 3334 173 4 the the DT 3334 173 5 specific specific JJ 3334 173 6 improvements improvement NNS 3334 173 7 are be VBP 3334 173 8 shown show VBN 3334 173 9 in in IN 3334 173 10 table table NN 3334 173 11 5 5 CD 3334 173 12 . . . 3334 174 1 The the DT 3334 174 2 average average JJ 3334 174 3 decrease decrease NN 3334 174 4 in in IN 3334 174 5 contacts contact NNS 3334 174 6 for for IN 3334 174 7 those those DT 3334 174 8 four four CD 3334 174 9 topics topic NNS 3334 174 10 was be VBD 3334 174 11 68 68 CD 3334 174 12 percent percent NN 3334 174 13 , , , 3334 174 14 compared compare VBN 3334 174 15 with with IN 3334 174 16 the the DT 3334 174 17 average average JJ 3334 174 18 decrease decrease NN 3334 174 19 of of IN 3334 174 20 47 47 CD 3334 174 21 percent percent NN 3334 174 22 . . . 3334 175 1 This this DT 3334 175 2 approach approach NN 3334 175 3 has have VBZ 3334 175 4 significantly significantly RB 3334 175 5 improved improve VBN 3334 175 6 the the DT 3334 175 7 user user NN 3334 175 8 experience experience NN 3334 175 9 by by IN 3334 175 10 identifying identify VBG 3334 175 11 and and CC 3334 175 12 addressing address VBG 3334 175 13 subject subject JJ 3334 175 14 areas area NNS 3334 175 15 users user NNS 3334 175 16 have have VBP 3334 175 17 trouble trouble NN 3334 175 18 finding find VBG 3334 175 19 or or CC 3334 175 20 understanding understanding NN 3334 175 21 on on IN 3334 175 22 IRS.gov IRS.gov NNP 3334 175 23 , , , 3334 175 24 eliminating eliminate VBG 3334 175 25 the the DT 3334 175 26 need need NN 3334 175 27 for for IN 3334 175 28 them -PRON- PRP 3334 175 29 to to TO 3334 175 30 contact contact VB 3334 175 31 the the DT 3334 175 32 Help Help NNP 3334 175 33 Desk Desk NNP 3334 175 34 . . . 3334 176 1 As as IN 3334 176 2 a a DT 3334 176 3 result result NN 3334 176 4 , , , 3334 176 5 an an DT 3334 176 6 increase increase NN 3334 176 7 of of IN 3334 176 8 resources resource NNS 3334 176 9 at at IN 3334 176 10 the the DT 3334 176 11 Help Help NNP 3334 176 12 Desk Desk NNP 3334 176 13 was be VBD 3334 176 14 avoided avoid VBN 3334 176 15 and and CC 3334 176 16 , , , 3334 176 17 hopefully hopefully RB 3334 176 18 , , , 3334 176 19 user user NN 3334 176 20 satisfaction satisfaction NN 3334 176 21 improved improve VBD 3334 176 22 . . . 3334 177 1 86 86 CD 3334 177 2 INFORMATION INFORMATION NNS 3334 177 3 TECHNOLOGY technology NN 3334 177 4 AND and CC 3334 177 5 LIBRARIES LIBRARIES NNP 3334 177 6 | | JJ 3334 177 7 JUNE JUNE NNP 3334 177 8 2006 2006 CD 3334 177 9 ■ ■ NFP 3334 177 10 Conclusions Conclusions NNPS 3334 177 11 While while IN 3334 177 12 the the DT 3334 177 13 case case NN 3334 177 14 presented present VBN 3334 177 15 in in IN 3334 177 16 this this DT 3334 177 17 article article NN 3334 177 18 was be VBD 3334 177 19 specific specific JJ 3334 177 20 to to IN 3334 177 21 IRS.gov IRS.gov NNP 3334 177 22 , , , 3334 177 23 the the DT 3334 177 24 methodol- methodol- JJ 3334 177 25 ogy ogy NN 3334 177 26 itself -PRON- PRP 3334 177 27 has have VBZ 3334 177 28 wide wide JJ 3334 177 29 appli- appli- NNP 3334 177 30 cation cation NN 3334 177 31 across across IN 3334 177 32 domains domain NNS 3334 177 33 . . . 3334 178 1 Customer customer NN 3334 178 2 service service NN 3334 178 3 for for IN 3334 178 4 most most JJS 3334 178 5 government government NN 3334 178 6 and and CC 3334 178 7 commercial commercial JJ 3334 178 8 organizations organization NNS 3334 178 9 depends depend VBZ 3334 178 10 on on IN 3334 178 11 providing provide VBG 3334 178 12 users user NNS 3334 178 13 with with IN 3334 178 14 relevant relevant JJ 3334 178 15 infor- infor- NNP 3334 178 16 mation mation NN 3334 178 17 effectively effectively RB 3334 178 18 and and CC 3334 178 19 efficiently efficiently RB 3334 178 20 . . . 3334 179 1 There there EX 3334 179 2 are be VBP 3334 179 3 many many JJ 3334 179 4 aspects aspect NNS 3334 179 5 to to IN 3334 179 6 achieving achieve VBG 3334 179 7 this this DT 3334 179 8 elusive elusive JJ 3334 179 9 goal goal NN 3334 179 10 of of IN 3334 179 11 matching match VBG 3334 179 12 users user NNS 3334 179 13 with with IN 3334 179 14 the the DT 3334 179 15 specific specific JJ 3334 179 16 information information NN 3334 179 17 they -PRON- PRP 3334 179 18 need need VBP 3334 179 19 . . . 3334 180 1 In in IN 3334 180 2 this this DT 3334 180 3 paper paper NN 3334 180 4 , , , 3334 180 5 it -PRON- PRP 3334 180 6 has have VBZ 3334 180 7 been be VBN 3334 180 8 demonstrated demonstrate VBN 3334 180 9 that that IN 3334 180 10 , , , 3334 180 11 rather rather RB 3334 180 12 than than IN 3334 180 13 focusing focus VBG 3334 180 14 just just RB 3334 180 15 on on IN 3334 180 16 optimizing optimize VBG 3334 180 17 the the DT 3334 180 18 search search NN 3334 180 19 engine engine NN 3334 180 20 or or CC 3334 180 21 developing develop VBG 3334 180 22 a a DT 3334 180 23 metadata metadata NN 3334 180 24 - - HYPH 3334 180 25 based base VBN 3334 180 26 solution solution NN 3334 180 27 , , , 3334 180 28 it -PRON- PRP 3334 180 29 is be VBZ 3334 180 30 essential essential JJ 3334 180 31 to to TO 3334 180 32 view view VB 3334 180 33 the the DT 3334 180 34 user user NN 3334 180 35 search search NN 3334 180 36 experience experience NN 3334 180 37 from from IN 3334 180 38 the the DT 3334 180 39 time time NN 3334 180 40 content content NN 3334 180 41 is be VBZ 3334 180 42 created create VBN 3334 180 43 to to IN 3334 180 44 the the DT 3334 180 45 moment moment NN 3334 180 46 when when WRB 3334 180 47 users user NNS 3334 180 48 have have VBP 3334 180 49 truly truly RB 3334 180 50 found find VBN 3334 180 51 the the DT 3334 180 52 answer answer NN 3334 180 53 to to IN 3334 180 54 their -PRON- PRP$ 3334 180 55 information information NN 3334 180 56 needs need NNS 3334 180 57 . . . 3334 181 1 There there EX 3334 181 2 is be VBZ 3334 181 3 no no DT 3334 181 4 one one CD 3334 181 5 surefire surefire NN 3334 181 6 solution solution NN 3334 181 7 , , , 3334 181 8 and and CC 3334 181 9 one one PRP 3334 181 10 should should MD 3334 181 11 not not RB 3334 181 12 assume assume VB 3334 181 13 that that IN 3334 181 14 enhanced enhanced JJ 3334 181 15 metadata metadata NN 3334 181 16 or or CC 3334 181 17 a a DT 3334 181 18 new new JJ 3334 181 19 search search NN 3334 181 20 engine engine NN 3334 181 21 is be VBZ 3334 181 22 the the DT 3334 181 23 only only JJ 3334 181 24 solution solution NN 3334 181 25 to to TO 3334 181 26 retrieval retrieval VB 3334 181 27 problems problem NNS 3334 181 28 . . . 3334 182 1 The the DT 3334 182 2 methodology methodology NN 3334 182 3 described describe VBN 3334 182 4 in in IN 3334 182 5 this this DT 3334 182 6 paper paper NN 3334 182 7 assumes assume VBZ 3334 182 8 that that IN 3334 182 9 users user NNS 3334 182 10 , , , 3334 182 11 especially especially RB 3334 182 12 infrequent infrequent JJ 3334 182 13 users user NNS 3334 182 14 of of IN 3334 182 15 public public JJ 3334 182 16 Web web NN 3334 182 17 sites site NNS 3334 182 18 , , , 3334 182 19 do do VBP 3334 182 20 not not RB 3334 182 21 wish wish VB 3334 182 22 to to TO 3334 182 23 become become VB 3334 182 24 search search NN 3334 182 25 experts expert NNS 3334 182 26 ; ; : 3334 182 27 that that IN 3334 182 28 intuitive intuitive JJ 3334 182 29 interfaces interface NNS 3334 182 30 and and CC 3334 182 31 meaningful meaningful JJ 3334 182 32 results result NNS 3334 182 33 displays display NNS 3334 182 34 contribute contribute VBP 3334 182 35 to to IN 3334 182 36 a a DT 3334 182 37 successful successful JJ 3334 182 38 user user NN 3334 182 39 experience experience NN 3334 182 40 ; ; , 3334 182 41 and and CC 3334 182 42 that that IN 3334 182 43 keeping keep VBG 3334 182 44 business business NN 3334 182 45 owners owner NNS 3334 182 46 involved involve VBN 3334 182 47 is be VBZ 3334 182 48 important important JJ 3334 182 49 . . . 3334 183 1 The the DT 3334 183 2 methodology methodology NN 3334 183 3 is be VBZ 3334 183 4 based base VBN 3334 183 5 on on IN 3334 183 6 understanding understand VBG 3334 183 7 the the DT 3334 183 8 behavior behavior NN 3334 183 9 of of IN 3334 183 10 a a DT 3334 183 11 site site NN 3334 183 12 ’s ’s POS 3334 183 13 users user NNS 3334 183 14 in in IN 3334 183 15 order order NN 3334 183 16 to to TO 3334 183 17 identify identify VB 3334 183 18 barriers barrier NNS 3334 183 19 to to IN 3334 183 20 a a DT 3334 183 21 successful successful JJ 3334 183 22 search search NN 3334 183 23 experience experience NN 3334 183 24 , , , 3334 183 25 and and CC 3334 183 26 on on IN 3334 183 27 understand- understand- NNP 3334 183 28 ing e VBG 3334 183 29 the the DT 3334 183 30 needs need NNS 3334 183 31 of of IN 3334 183 32 business business NN 3334 183 33 owners owner NNS 3334 183 34 . . . 3334 184 1 The the DT 3334 184 2 methodology methodology NN 3334 184 3 focuses focus VBZ 3334 184 4 on on IN 3334 184 5 adapting adapt VBG 3334 184 6 the the DT 3334 184 7 site site NN 3334 184 8 to to IN 3334 184 9 its -PRON- PRP$ 3334 184 10 users user NNS 3334 184 11 ( ( -LRB- 3334 184 12 rather rather RB 3334 184 13 than than IN 3334 184 14 vice vice NN 3334 184 15 versa versa RB 3334 184 16 ) ) -RRB- 3334 184 17 through through IN 3334 184 18 document document NN 3334 184 19 modification modification NN 3334 184 20 , , , 3334 184 21 improved improve VBN 3334 184 22 content content NN 3334 184 23 - - HYPH 3334 184 24 development development NN 3334 184 25 processes process NNS 3334 184 26 , , , 3334 184 27 query query NN 3334 184 28 enhancement enhancement NN 3334 184 29 , , , 3334 184 30 and and CC 3334 184 31 targeted target VBN 3334 184 32 search search NN 3334 184 33 improvement improvement NN 3334 184 34 . . . 3334 185 1 It -PRON- PRP 3334 185 2 includes include VBZ 3334 185 3 improve- improve- NN 3334 185 4 ments ment NNS 3334 185 5 to to IN 3334 185 6 the the DT 3334 185 7 results result NNS 3334 185 8 phase phase NN 3334 185 9 of of IN 3334 185 10 the the DT 3334 185 11 search search NN 3334 185 12 process process NN 3334 185 13 , , , 3334 185 14 such such JJ 3334 185 15 as as IN 3334 185 16 improved improved JJ 3334 185 17 titles title NNS 3334 185 18 and and CC 3334 185 19 summaries summary NNS 3334 185 20 , , , 3334 185 21 as as RB 3334 185 22 well well RB 3334 185 23 as as IN 3334 185 24 to to IN 3334 185 25 the the DT 3334 185 26 search- search- JJ 3334 185 27 and and CC 3334 185 28 - - HYPH 3334 185 29 retrieval retrieval NN 3334 185 30 phase phase NN 3334 185 31 . . . 3334 186 1 This this DT 3334 186 2 toolkit toolkit NN 3334 186 3 - - HYPH 3334 186 4 based base VBN 3334 186 5 approach approach NN 3334 186 6 is be VBZ 3334 186 7 effective effective JJ 3334 186 8 and and CC 3334 186 9 low low JJ 3334 186 10 - - HYPH 3334 186 11 cost cost NN 3334 186 12 . . . 3334 187 1 It -PRON- PRP 3334 187 2 has have VBZ 3334 187 3 been be VBN 3334 187 4 used use VBN 3334 187 5 over over IN 3334 187 6 the the DT 3334 187 7 past past JJ 3334 187 8 four four CD 3334 187 9 years year NNS 3334 187 10 to to TO 3334 187 11 improve improve VB 3334 187 12 the the DT 3334 187 13 user user NN 3334 187 14 search search NN 3334 187 15 experience experience NN 3334 187 16 significantly significantly RB 3334 187 17 for for IN 3334 187 18 the the DT 3334 187 19 millions million NNS 3334 187 20 of of IN 3334 187 21 IRS.gov IRS.gov NNP 3334 187 22 users user NNS 3334 187 23 . . . 3334 188 1 Interesting interesting JJ 3334 188 2 follow follow NN 3334 188 3 - - HYPH 3334 188 4 on on RP 3334 188 5 research research NN 3334 188 6 could could MD 3334 188 7 focus focus VB 3334 188 8 on on IN 3334 188 9 identifying identify VBG 3334 188 10 to to IN 3334 188 11 what what WDT 3334 188 12 degree degree NN 3334 188 13 this this DT 3334 188 14 methodology methodology NN 3334 188 15 can can MD 3334 188 16 be be VB 3334 188 17 automated automate VBN 3334 188 18 and and CC 3334 188 19 how how WRB 3334 188 20 to to TO 3334 188 21 leverage leverage VB 3334 188 22 new new JJ 3334 188 23 tools tool NNS 3334 188 24 to to TO 3334 188 25 pro- pro- VB 3334 188 26 vide vide NN 3334 188 27 automated automate VBN 3334 188 28 support support NN 3334 188 29 for for IN 3334 188 30 usage usage NN 3334 188 31 log log NN 3334 188 32 analysis analysis NN 3334 188 33 ( ( -LRB- 3334 188 34 such such JJ 3334 188 35 as as IN 3334 188 36 MondoSearch MondoSearch NNP 3334 188 37 by by IN 3334 188 38 Mondosoft Mondosoft NNP 3334 188 39 ) ) -RRB- 3334 188 40 . . . 3334 189 1 It -PRON- PRP 3334 189 2 is be VBZ 3334 189 3 clear clear JJ 3334 189 4 from from IN 3334 189 5 this this DT 3334 189 6 case case NN 3334 189 7 study study NN 3334 189 8 that that IN 3334 189 9 it -PRON- PRP 3334 189 10 is be VBZ 3334 189 11 time time NN 3334 189 12 to to TO 3334 189 13 apply apply VB 3334 189 14 systems system NNS 3334 189 15 engineering engineering NN 3334 189 16 rigor rigor NN 3334 189 17 to to IN 3334 189 18 search search NN 3334 189 19 - - HYPH 3334 189 20 experience experience NN 3334 189 21 improve- improve- NN 3334 189 22 ment ment NN 3334 189 23 . . . 3334 190 1 This this DT 3334 190 2 approach approach NN 3334 190 3 confirms confirm VBZ 3334 190 4 the the DT 3334 190 5 need need NN 3334 190 6 to to TO 3334 190 7 extend extend VB 3334 190 8 metrics metric NNS 3334 190 9 for for IN 3334 190 10 evaluating evaluate VBG 3334 190 11 search search NN 3334 190 12 beyond beyond IN 3334 190 13 precision precision NN 3334 190 14 and and CC 3334 190 15 recall recall NN 3334 190 16 to to TO 3334 190 17 include include VB 3334 190 18 the the DT 3334 190 19 totality totality NN 3334 190 20 of of IN 3334 190 21 the the DT 3334 190 22 search search NN 3334 190 23 experience experience NN 3334 190 24 . . . 3334 191 1 ■ ■ NFP 3334 191 2 Future future JJ 3334 191 3 work work NN 3334 191 4 Teleporting Teleporting NNP 3334 191 5 has have VBZ 3334 191 6 been be VBN 3334 191 7 defined define VBN 3334 191 8 as as IN 3334 191 9 an an DT 3334 191 10 approach approach NN 3334 191 11 in in IN 3334 191 12 which which WDT 3334 191 13 users user NNS 3334 191 14 try try VBP 3334 191 15 to to TO 3334 191 16 jump jump VB 3334 191 17 directly directly RB 3334 191 18 to to IN 3334 191 19 their -PRON- PRP$ 3334 191 20 information information NN 3334 191 21 targets.14 targets.14 NNP 3334 191 22 Trying try VBG 3334 191 23 to to TO 3334 191 24 achieve achieve VB 3334 191 25 perfect perfect JJ 3334 191 26 search search NN 3334 191 27 results result NNS 3334 191 28 supports support VBZ 3334 191 29 the the DT 3334 191 30 infor- infor- JJ 3334 191 31 mation mation NN 3334 191 32 - - HYPH 3334 191 33 seeking seek VBG 3334 191 34 strategy strategy NN 3334 191 35 of of IN 3334 191 36 teleporting teleporting NN 3334 191 37 . . . 3334 192 1 But but CC 3334 192 2 the the DT 3334 192 3 search search NN 3334 192 4 process process NN 3334 192 5 may may MD 3334 192 6 involve involve VB 3334 192 7 more more JJR 3334 192 8 than than IN 3334 192 9 a a DT 3334 192 10 single single JJ 3334 192 11 search search NN 3334 192 12 . . . 3334 193 1 People People NNS 3334 193 2 often often RB 3334 193 3 conduct conduct VBP 3334 193 4 “ " `` 3334 193 5 a a DT 3334 193 6 series series NN 3334 193 7 of of IN 3334 193 8 interconnected interconnected JJ 3334 193 9 but but CC 3334 193 10 diverse diverse JJ 3334 193 11 searches search NNS 3334 193 12 on on IN 3334 193 13 a a DT 3334 193 14 single single JJ 3334 193 15 , , , 3334 193 16 problem problem NN 3334 193 17 - - HYPH 3334 193 18 based base VBN 3334 193 19 theme theme NN 3334 193 20 , , , 3334 193 21 rather rather RB 3334 193 22 than than IN 3334 193 23 one one CD 3334 193 24 extended extend VBN 3334 193 25 search search NN 3334 193 26 session session NN 3334 193 27 per per IN 3334 193 28 task task NN 3334 193 29 . . . 3334 193 30 ”15 ”15 UH 3334 193 31 This this DT 3334 193 32 approach approach NN 3334 193 33 is be VBZ 3334 193 34 similar similar JJ 3334 193 35 to to IN 3334 193 36 the the DT 3334 193 37 sport sport NN 3334 193 38 of of IN 3334 193 39 orienteering orienteere VBG 3334 193 40 with with IN 3334 193 41 searchers searcher NNS 3334 193 42 using use VBG 3334 193 43 data datum NNS 3334 193 44 from from IN 3334 193 45 their -PRON- PRP$ 3334 193 46 present present JJ 3334 193 47 situation situation NN 3334 193 48 to to TO 3334 193 49 determine determine VB 3334 193 50 where where WRB 3334 193 51 to to TO 3334 193 52 go go VB 3334 193 53 next next RB 3334 193 54 — — : 3334 193 55 that that RB 3334 193 56 is is RB 3334 193 57 , , , 3334 193 58 looking look VBG 3334 193 59 for for IN 3334 193 60 an an DT 3334 193 61 overview overview NN 3334 193 62 first first RB 3334 193 63 and and CC 3334 193 64 then then RB 3334 193 65 submitting submit VBG 3334 193 66 more more RBR 3334 193 67 detailed detailed JJ 3334 193 68 searches search NNS 3334 193 69 . . . 3334 194 1 Given give VBN 3334 194 2 the the DT 3334 194 3 general general JJ 3334 194 4 , , , 3334 194 5 nonspecific nonspecific JJ 3334 194 6 nature nature NN 3334 194 7 of of IN 3334 194 8 the the DT 3334 194 9 short short JJ 3334 194 10 queries query NNS 3334 194 11 submitted submit VBN 3334 194 12 by by IN 3334 194 13 IRS.gov irs.gov NN 3334 194 14 users user NNS 3334 194 15 , , , 3334 194 16 the the DT 3334 194 17 orienteering orienteere VBG 3334 194 18 approach approach NN 3334 194 19 may may MD 3334 194 20 well well RB 3334 194 21 describe describe VB 3334 194 22 the the DT 3334 194 23 information information NN 3334 194 24 - - HYPH 3334 194 25 seeking seek VBG 3334 194 26 behaviors behavior NNS 3334 194 27 of of IN 3334 194 28 many many JJ 3334 194 29 users user NNS 3334 194 30 . . . 3334 195 1 This this DT 3334 195 2 paper paper NN 3334 195 3 is be VBZ 3334 195 4 limited limit VBN 3334 195 5 to to IN 3334 195 6 the the DT 3334 195 7 improvement improvement NN 3334 195 8 of of IN 3334 195 9 search search NN 3334 195 10 results result NNS 3334 195 11 for for IN 3334 195 12 individual individual JJ 3334 195 13 searches search NNS 3334 195 14 , , , 3334 195 15 but but CC 3334 195 16 the the DT 3334 195 17 need need NN 3334 195 18 to to TO 3334 195 19 investigate investigate VB 3334 195 20 improving improve VBG 3334 195 21 the the DT 3334 195 22 search search NN 3334 195 23 experience experience NN 3334 195 24 to to TO 3334 195 25 support support VB 3334 195 26 orienteering orienteere VBG 3334 195 27 behavior behavior NN 3334 195 28 is be VBZ 3334 195 29 acknowledged acknowledge VBN 3334 195 30 . . . 3334 196 1 Future future JJ 3334 196 2 research research NN 3334 196 3 will will MD 3334 196 4 investi- investi- VB 3334 196 5 gate gate VB 3334 196 6 how how WRB 3334 196 7 to to TO 3334 196 8 leverage leverage VB 3334 196 9 the the DT 3334 196 10 theoretical theoretical JJ 3334 196 11 models model NNS 3334 196 12 of of IN 3334 196 13 the the DT 3334 196 14 infor- infor- JJ 3334 196 15 mation mation NN 3334 196 16 - - HYPH 3334 196 17 search search NN 3334 196 18 process process NN 3334 196 19 , , , 3334 196 20 such such JJ 3334 196 21 as as IN 3334 196 22 the the DT 3334 196 23 anomalous anomalous JJ 3334 196 24 states state NNS 3334 196 25 of of IN 3334 196 26 knowledge knowledge NN 3334 196 27 ( ( -LRB- 3334 196 28 ASK ASK NNP 3334 196 29 ) ) -RRB- 3334 196 30 underlying underlie VBG 3334 196 31 information information NN 3334 196 32 needs need NNS 3334 196 33 and and CC 3334 196 34 the the DT 3334 196 35 Information Information NNP 3334 196 36 Search Search NNP 3334 196 37 Process Process NNP 3334 196 38 model.16 model.16 NNP 3334 196 39 References References NNPS 3334 196 40 and and CC 3334 196 41 notes note VBZ 3334 196 42 1 1 CD 3334 196 43 . . . 3334 197 1 “ " `` 3334 197 2 Common Common NNP 3334 197 3 Evaluation Evaluation NNP 3334 197 4 Measures measure NNS 3334 197 5 , , , 3334 197 6 ” " '' 3334 197 7 The the DT 3334 197 8 Thirteenth Thirteenth NNP 3334 197 9 Text Text NNP 3334 197 10 Retrieval Retrieval NNP 3334 197 11 Conference Conference NNP 3334 197 12 , , , 3334 197 13 NIST NIST NNP 3334 197 14 Special Special NNP 3334 197 15 Publication Publication NNP 3334 197 16 SP SP NNP 3334 197 17 500 500 CD 3334 197 18 - - SYM 3334 197 19 261 261 CD 3334 197 20 ( ( -LRB- 3334 197 21 Gaith- Gaith- NNP 3334 197 22 ersburg ersburg NN 3334 197 23 , , , 3334 197 24 Va. Virginia NNP 3334 197 25 : : : 3334 197 26 National National NNP 3334 197 27 Institute Institute NNP 3334 197 28 of of IN 3334 197 29 Standards Standards NNPS 3334 197 30 and and CC 3334 197 31 Technology Technology NNP 3334 197 32 , , , 3334 197 33 2004 2004 CD 3334 197 34 ) ) -RRB- 3334 197 35 , , , 3334 197 36 appendix appendix NNP 3334 197 37 A. A. NNP 3334 198 1 2 2 LS 3334 198 2 . . . 3334 199 1 Kalervo Kalervo NNP 3334 199 2 Jarvelin Jarvelin NNP 3334 199 3 and and CC 3334 199 4 Peter Peter NNP 3334 199 5 Ingwersen Ingwersen NNP 3334 199 6 , , , 3334 199 7 “ " `` 3334 199 8 Information Information NNP 3334 199 9 - - HYPH 3334 199 10 Seek- Seek- NNP 3334 199 11 ing ing NNP 3334 199 12 Research Research NNP 3334 199 13 Needs need VBZ 3334 199 14 Extension Extension NNP 3334 199 15 towards towards IN 3334 199 16 Tasks Tasks NNPS 3334 199 17 and and CC 3334 199 18 Technol- Technol- NNP 3334 199 19 ogy ogy NN 3334 199 20 , , , 3334 199 21 ” " '' 3334 199 22 Information Information NNP 3334 199 23 Research Research NNP 3334 199 24 10 10 CD 3334 199 25 , , , 3334 199 26 no no UH 3334 199 27 . . . 3334 200 1 1 1 CD 3334 200 2 ( ( -LRB- 3334 200 3 2004 2004 CD 3334 200 4 ) ) -RRB- 3334 200 5 , , , 3334 200 6 http://InformationR http://InformationR NNP 3334 200 7 .net .net . 3334 200 8 / / SYM 3334 200 9 ir/10 ir/10 NN 3334 200 10 - - HYPH 3334 200 11 1 1 CD 3334 200 12 / / SYM 3334 200 13 paper212.html paper212.html NNS 3334 200 14 ( ( -LRB- 3334 200 15 accessed access VBN 3334 200 16 Feb. February NNP 3334 200 17 2 2 CD 3334 200 18 , , , 3334 200 19 2006 2006 CD 3334 200 20 ) ) -RRB- 3334 200 21 ; ; : 3334 200 22 K. K. NNP 3334 200 23 Fisher Fisher NNP 3334 200 24 , , , 3334 200 25 S. S. NNP 3334 200 26 Erdelez Erdelez NNP 3334 200 27 , , , 3334 200 28 and and CC 3334 200 29 L. L. NNP 3334 200 30 McKechnie McKechnie NNP 3334 200 31 , , , 3334 200 32 eds eds NNP 3334 200 33 . . NN 3334 200 34 , , , 3334 200 35 Theories Theories NNPS 3334 200 36 of of IN 3334 200 37 Information Information NNP 3334 200 38 Behavior Behavior NNP 3334 200 39 ( ( -LRB- 3334 200 40 Medford Medford NNP 3334 200 41 , , , 3334 200 42 N.J. New Jersey NNP 3334 200 43 : : : 3334 200 44 Information Information NNP 3334 200 45 Today Today NNP 3334 200 46 , , , 3334 200 47 2005 2005 CD 3334 200 48 ) ) -RRB- 3334 200 49 ; ; : 3334 200 50 T. T. NNP 3334 200 51 Saracevic Saracevic NNP 3334 200 52 and and CC 3334 200 53 Paul Paul NNP 3334 200 54 B. B. NNP 3334 200 55 Kantor Kantor NNP 3334 200 56 , , , 3334 200 57 “ " `` 3334 200 58 Studying study VBG 3334 200 59 the the DT 3334 200 60 Value Value NNP 3334 200 61 of of IN 3334 200 62 Library Library NNP 3334 200 63 and and CC 3334 200 64 Information Information NNP 3334 200 65 Services Services NNPS 3334 200 66 , , , 3334 200 67 Part Part NNP 3334 200 68 I -PRON- PRP 3334 200 69 : : : 3334 200 70 Establishing establish VBG 3334 200 71 a a DT 3334 200 72 Theoretical Theoretical NNP 3334 200 73 Framework Framework NNP 3334 200 74 , , , 3334 200 75 ” " '' 3334 200 76 Journal Journal NNP 3334 200 77 of of IN 3334 200 78 the the DT 3334 200 79 Ameri- Ameri- NNP 3334 200 80 can can MD 3334 200 81 Society Society NNP 3334 200 82 for for IN 3334 200 83 Information Information NNP 3334 200 84 Science Science NNP 3334 200 85 . . . 3334 201 1 48 48 CD 3334 201 2 , , , 3334 201 3 no no UH 3334 201 4 . . . 3334 202 1 6 6 CD 3334 202 2 ( ( -LRB- 3334 202 3 1997 1997 CD 3334 202 4 ) ) -RRB- 3334 202 5 : : : 3334 202 6 527–42 527–42 CD 3334 202 7 . . . 3334 203 1 Table table NN 3334 203 2 5 5 CD 3334 203 3 . . . 3334 204 1 Comparison comparison NN 3334 204 2 of of IN 3334 204 3 2004 2004 CD 3334 204 4 and and CC 3334 204 5 2003 2003 CD 3334 204 6 Help Help NNP 3334 204 7 Desk Desk NNP 3334 204 8 contacts contact VBZ 3334 204 9 Problem problem NN 3334 204 10 area area NN 3334 204 11 Number Number NNP 3334 204 12 of of IN 3334 204 13 contacts contact NNS 3334 204 14 2003 2003 CD 3334 204 15 Number Number NNP 3334 204 16 of of IN 3334 204 17 contacts contact NNS 3334 204 18 2004 2004 CD 3334 204 19 Change Change NNP 3334 204 20 1040X 1040X NNP 3334 204 21 , , , 3334 204 22 1040EZ 1040ez CD 3334 204 23 77 77 CD 3334 204 24 19 19 CD 3334 204 25 -75 -75 CD 3334 204 26 % % NN 3334 204 27 Prior prior JJ 3334 204 28 year year NN 3334 204 29 forms form VBZ 3334 204 30 480 480 CD 3334 204 31 103 103 CD 3334 204 32 -78 -78 HYPH 3334 204 33 % % NN 3334 204 34 Copy Copy NNP 3334 204 35 of of IN 3334 204 36 return return NN 3334 204 37 170 170 CD 3334 204 38 91 91 CD 3334 204 39 -47 -47 HYPH 3334 204 40 % % NN 3334 204 41 Where where WRB 3334 204 42 to to TO 3334 204 43 file file VB 3334 204 44 250 250 CD 3334 204 45 104 104 CD 3334 204 46 -58 -58 NNP 3334 204 47 % % NN 3334 204 48 Total total JJ 3334 204 49 977 977 CD 3334 204 50 317 317 CD 3334 204 51 -68 -68 NN 3334 204 52 % % NN 3334 204 53 ARTICLE ARTICLE NNP 3334 204 54 TITLE TITLE NNP 3334 204 55 | | NNP 3334 204 56 AUTHOR AUTHOR NNP 3334 204 57 87A 87A NNP 3334 204 58 DYNAMIC dynamic NN 3334 204 59 METHODOLOGY methodology NN 3334 204 60 FOR for IN 3334 204 61 IMPROVING improve VBG 3334 204 62 THE the DT 3334 204 63 SEARCH SEARCH NNS 3334 204 64 EXPERIENCE EXPERIENCE NNP 3334 204 65 | | CD 3334 204 66 KERCHNER kerchner NN 3334 204 67 87 87 CD 3334 204 68 3 3 CD 3334 204 69 . . . 3334 205 1 Scott Scott NNP 3334 205 2 Nicholson Nicholson NNP 3334 205 3 , , , 3334 205 4 “ " `` 3334 205 5 A a DT 3334 205 6 Conceptual Conceptual NNP 3334 205 7 Framework Framework NNP 3334 205 8 for for IN 3334 205 9 the the DT 3334 205 10 Holistic Holistic NNP 3334 205 11 Measurement Measurement NNP 3334 205 12 and and CC 3334 205 13 Cumulative Cumulative NNP 3334 205 14 Evaluation Evaluation NNP 3334 205 15 of of IN 3334 205 16 Library Library NNP 3334 205 17 Services Services NNPS 3334 205 18 , , , 3334 205 19 ” " '' 3334 205 20 Journal Journal NNP 3334 205 21 of of IN 3334 205 22 Documentation Documentation NNP 3334 205 23 60 60 CD 3334 205 24 , , , 3334 205 25 no no UH 3334 205 26 . . . 3334 206 1 2 2 CD 3334 206 2 ( ( -LRB- 3334 206 3 2004 2004 CD 3334 206 4 ) ) -RRB- 3334 206 5 : : : 3334 206 6 164–82 164–82 CD 3334 206 7 . . . 3334 207 1 4 4 LS 3334 207 2 . . . 3334 208 1 Avra Avra NNP 3334 208 2 Michelson Michelson NNP 3334 208 3 and and CC 3334 208 4 Michael Michael NNP 3334 208 5 Olson Olson NNP 3334 208 6 , , , 3334 208 7 “ " `` 3334 208 8 Dynamically dynamically RB 3334 208 9 Enabling enable VBG 3334 208 10 Search Search NNP 3334 208 11 and and CC 3334 208 12 Discovery Discovery NNP 3334 208 13 TEM TEM NNP 3334 208 14 , , , 3334 208 15 ” " '' 3334 208 16 Internal internal JJ 3334 208 17 MITRE MITRE NNPS 3334 208 18 presen- presen- JJ 3334 208 19 tation tation NN 3334 208 20 , , , 3334 208 21 McLean McLean NNP 3334 208 22 , , , 3334 208 23 Va. Virginia NNP 3334 208 24 , , , 3334 208 25 Mar. March NNP 3334 209 1 30 30 CD 3334 209 2 , , , 3334 209 3 2005 2005 CD 3334 209 4 . . . 3334 210 1 5 5 CD 3334 210 2 . . . 3334 211 1 Lawrence Lawrence NNP 3334 211 2 E. E. NNP 3334 211 3 Leonard Leonard NNP 3334 211 4 , , , 3334 211 5 “ " `` 3334 211 6 Inter inter JJ 3334 211 7 - - HYPH 3334 211 8 indexer indexer NNP 3334 211 9 Consistency Consistency NNP 3334 211 10 Studies Studies NNPS 3334 211 11 , , , 3334 211 12 1954–1975 1954–1975 CD 3334 211 13 : : : 3334 211 14 A a DT 3334 211 15 Review Review NNP 3334 211 16 of of IN 3334 211 17 the the DT 3334 211 18 Literature Literature NNP 3334 211 19 and and CC 3334 211 20 Summary Summary NNP 3334 211 21 Of of IN 3334 211 22 Study Study NNP 3334 211 23 Results Results NNPS 3334 211 24 , , , 3334 211 25 ” " '' 3334 211 26 Occasional Occasional NNP 3334 211 27 Paper Paper NNP 3334 211 28 Series Series NNP 3334 211 29 , , , 3334 211 30 No no UH 3334 211 31 . . . 3334 212 1 131 131 CD 3334 212 2 , , , 3334 212 3 Graduate Graduate NNP 3334 212 4 School School NNP 3334 212 5 of of IN 3334 212 6 Library Library NNP 3334 212 7 Science Science NNP 3334 212 8 , , , 3334 212 9 University University NNP 3334 212 10 of of IN 3334 212 11 Illionois Illionois NNP 3334 212 12 , , , 3334 212 13 Urbana Urbana NNP 3334 212 14 - - HYPH 3334 212 15 Champaign Champaign NNP 3334 212 16 , , , 3334 212 17 1977 1977 CD 3334 212 18 ; ; : 3334 212 19 Tefko Tefko NNP 3334 212 20 Saracevic Saracevic NNP 3334 212 21 , , , 3334 212 22 “ " `` 3334 212 23 Individual individual JJ 3334 212 24 Differences difference NNS 3334 212 25 in in IN 3334 212 26 Organizing Organizing NNP 3334 212 27 , , , 3334 212 28 Searching search VBG 3334 212 29 and and CC 3334 212 30 Retrieving Retrieving NNP 3334 212 31 Information Information NNP 3334 212 32 , , , 3334 212 33 ” " '' 3334 212 34 in in IN 3334 212 35 Proceedings Proceedings NNP 3334 212 36 of of IN 3334 212 37 Ameri- Ameri- NNP 3334 212 38 can can MD 3334 212 39 Society Society NNP 3334 212 40 for for IN 3334 212 41 Information Information NNP 3334 212 42 Science Science NNP 3334 212 43 ’ ' '' 3334 212 44 91 91 CD 3334 212 45 ( ( -LRB- 3334 212 46 New New NNP 3334 212 47 York York NNP 3334 212 48 : : : 3334 212 49 John John NNP 3334 212 50 Wiley Wiley NNP 3334 212 51 , , , 3334 212 52 1991 1991 CD 3334 212 53 ) ) -RRB- 3334 212 54 , , , 3334 212 55 82–86 82–86 CD 3334 212 56 ; ; : 3334 212 57 G. G. NNP 3334 212 58 Furnas Furnas NNP 3334 212 59 et et NNP 3334 212 60 al al NNP 3334 212 61 . . NNP 3334 212 62 , , , 3334 212 63 ” " '' 3334 212 64 The the DT 3334 212 65 Vocabulary Vocabulary NNP 3334 212 66 Problem Problem NNP 3334 212 67 in in IN 3334 212 68 Human Human NNP 3334 212 69 - - HYPH 3334 212 70 System system NN 3334 212 71 Communication communication NN 3334 212 72 , , , 3334 212 73 ” " '' 3334 212 74 Communications communication NNS 3334 212 75 of of IN 3334 212 76 the the DT 3334 212 77 ACM ACM NNP 3334 212 78 30 30 CD 3334 212 79 , , , 3334 212 80 no no UH 3334 212 81 . . . 3334 213 1 11 11 CD 3334 213 2 ( ( -LRB- 3334 213 3 1987 1987 CD 3334 213 4 ) ) -RRB- 3334 213 5 : : : 3334 213 6 964–71 964–71 CD 3334 213 7 . . . 3334 214 1 6 6 CD 3334 214 2 . . . 3334 215 1 Rajiv Rajiv NNP 3334 215 2 Ramnath Ramnath NNP 3334 215 3 and and CC 3334 215 4 David David NNP 3334 215 5 Landsbergen Landsbergen NNP 3334 215 6 , , , 3334 215 7 “ " `` 3334 215 8 IT it NN 3334 215 9 - - HYPH 3334 215 10 enabled enable VBN 3334 215 11 Sense sense NN 3334 215 12 - - HYPH 3334 215 13 and and CC 3334 215 14 - - HYPH 3334 215 15 Respond Respond NNP 3334 215 16 Strategies Strategies NNP 3334 215 17 in in IN 3334 215 18 Complex complex JJ 3334 215 19 Public public JJ 3334 215 20 Organiza- Organiza- NNP 3334 215 21 tions tion NNS 3334 215 22 , , , 3334 215 23 ” " '' 3334 215 24 Communications communication NNS 3334 215 25 of of IN 3334 215 26 the the DT 3334 215 27 ACM ACM NNP 3334 215 28 48 48 CD 3334 215 29 , , , 3334 215 30 no no UH 3334 215 31 . . . 3334 216 1 5 5 CD 3334 216 2 ( ( -LRB- 3334 216 3 2005 2005 CD 3334 216 4 ) ) -RRB- 3334 216 5 : : : 3334 216 6 58–64 58–64 CD 3334 216 7 . . . 3334 217 1 7 7 LS 3334 217 2 . . . 3334 218 1 T. T. NNP 3334 218 2 L. L. NNP 3334 218 3 Brauen Brauen NNP 3334 218 4 et et NNP 3334 218 5 al al NNP 3334 218 6 . . NNP 3334 218 7 , , , 3334 218 8 “ " `` 3334 218 9 Document document NN 3334 218 10 Indexing indexing NN 3334 218 11 Based base VBN 3334 218 12 on on IN 3334 218 13 Rel- Rel- NNP 3334 218 14 evance evance NN 3334 218 15 Feedback Feedback NNP 3334 218 16 , , , 3334 218 17 ” " '' 3334 218 18 Report report NN 3334 218 19 No no UH 3334 218 20 . . . 3334 219 1 ISR-14 ISR-14 NNP 3334 219 2 to to IN 3334 219 3 the the DT 3334 219 4 National National NNP 3334 219 5 Science Science NNP 3334 219 6 Foundation Foundation NNP 3334 219 7 , , , 3334 219 8 Section Section NNP 3334 219 9 XI XI NNP 3334 219 10 , , , 3334 219 11 Department Department NNP 3334 219 12 of of IN 3334 219 13 Computer Computer NNP 3334 219 14 Science Science NNP 3334 219 15 , , , 3334 219 16 Cor- Cor- NNP 3334 219 17 nell nell NNP 3334 219 18 University University NNP 3334 219 19 , , , 3334 219 20 Ithaca Ithaca NNP 3334 219 21 , , , 3334 219 22 N.Y. New York NNP 3334 219 23 , , , 3334 219 24 1968 1968 CD 3334 219 25 ; ; : 3334 219 26 M. M. NNP 3334 219 27 C. C. NNP 3334 219 28 Davis Davis NNP 3334 219 29 , , , 3334 219 30 M. M. NNP 3334 219 31 D. D. NNP 3334 219 32 Linsky Linsky NNP 3334 219 33 , , , 3334 219 34 and and CC 3334 219 35 M. M. NNP 3334 219 36 V. V. NNP 3334 219 37 Zelkowitz Zelkowitz NNP 3334 219 38 , , , 3334 219 39 “ " `` 3334 219 40 A a DT 3334 219 41 Relevance Relevance NNP 3334 219 42 Feedback Feedback NNP 3334 219 43 System System NNP 3334 219 44 Employing employ VBG 3334 219 45 a a DT 3334 219 46 Dynamically dynamically RB 3334 219 47 Evolving Evolving NNP 3334 219 48 Document Document NNP 3334 219 49 Space space NN 3334 219 50 , , , 3334 219 51 ” " '' 3334 219 52 Report report NN 3334 219 53 No no UH 3334 219 54 . . . 3334 220 1 ISR-14 ISR-14 NNP 3334 220 2 to to IN 3334 220 3 the the DT 3334 220 4 National National NNP 3334 220 5 Science Science NNP 3334 220 6 Foundation Foundation NNP 3334 220 7 , , , 3334 220 8 Section Section NNP 3334 220 9 X X NNP 3334 220 10 , , , 3334 220 11 Department Department NNP 3334 220 12 of of IN 3334 220 13 Computer Computer NNP 3334 220 14 Science Science NNP 3334 220 15 , , , 3334 220 16 Cornell Cornell NNP 3334 220 17 University University NNP 3334 220 18 , , , 3334 220 19 Ithaca Ithaca NNP 3334 220 20 , , , 3334 220 21 N.Y. New York NNP 3334 220 22 , , , 3334 220 23 1968 1968 CD 3334 220 24 ; ; : 3334 220 25 Marcia Marcia NNP 3334 220 26 D. D. NNP 3334 220 27 Kerchner Kerchner NNP 3334 220 28 , , , 3334 220 29 Dynamic Dynamic NNP 3334 220 30 Document Document NNP 3334 220 31 Processing Processing NNP 3334 220 32 in in IN 3334 220 33 Clustered Clustered NNP 3334 220 34 Collec- Collec- NNP 3334 220 35 tions tion NNS 3334 220 36 , , , 3334 220 37 Report Report NNP 3334 220 38 No no UH 3334 220 39 . . . 3334 221 1 ISR-19 ISR-19 NNP 3334 221 2 to to IN 3334 221 3 the the DT 3334 221 4 National National NNP 3334 221 5 Science Science NNP 3334 221 6 Foundation Foundation NNP 3334 221 7 , , , 3334 221 8 Ph.D. ph.d. NN 3334 221 9 thesis thesis NN 3334 221 10 , , , 3334 221 11 Department Department NNP 3334 221 12 of of IN 3334 221 13 Computer Computer NNP 3334 221 14 Science Science NNP 3334 221 15 , , , 3334 221 16 Cornell Cornell NNP 3334 221 17 Univer- Univer- NNP 3334 221 18 sity sity NN 3334 221 19 , , , 3334 221 20 Ithaca Ithaca NNP 3334 221 21 , , , 3334 221 22 N.Y. New York NNP 3334 221 23 , , , 3334 221 24 1971 1971 CD 3334 221 25 . . . 3334 222 1 8 8 LS 3334 222 2 . . . 3334 223 1 Ibid ibid RB 3334 223 2 . . . 3334 224 1 9 9 CD 3334 224 2 . . . 3334 225 1 Gerard Gerard NNP 3334 225 2 S. S. NNP 3334 225 3 Salton Salton NNP 3334 225 4 , , , 3334 225 5 Dynamic Dynamic NNP 3334 225 6 Information Information NNP 3334 225 7 and and CC 3334 225 8 Library Library NNP 3334 225 9 Process- Process- NNP 3334 225 10 ing ing NNP 3334 225 11 ( ( -LRB- 3334 225 12 Englewood Englewood NNP 3334 225 13 Cliffs Cliffs NNPS 3334 225 14 , , , 3334 225 15 N.J. New Jersey NNP 3334 225 16 : : : 3334 225 17 Prentice Prentice NNP 3334 225 18 - - HYPH 3334 225 19 Hall Hall NNP 3334 225 20 , , , 3334 225 21 1975 1975 CD 3334 225 22 ) ) -RRB- 3334 225 23 . . . 3334 226 1 10 10 CD 3334 226 2 . . . 3334 227 1 P. P. NNP 3334 227 2 Borlund Borlund NNP 3334 227 3 , , , 3334 227 4 “ " `` 3334 227 5 The the DT 3334 227 6 IIR IIR NNP 3334 227 7 Evaluation Evaluation NNP 3334 227 8 Model Model NNP 3334 227 9 : : : 3334 227 10 A a DT 3334 227 11 Framework Framework NNP 3334 227 12 for for IN 3334 227 13 Evaluation Evaluation NNP 3334 227 14 of of IN 3334 227 15 Interactive Interactive NNP 3334 227 16 Information Information NNP 3334 227 17 Retrieval Retrieval NNP 3334 227 18 Systems Systems NNP 3334 227 19 , , , 3334 227 20 ” " '' 3334 227 21 Information Information NNP 3334 227 22 Research Research NNP 3334 227 23 8 8 CD 3334 227 24 , , , 3334 227 25 no no UH 3334 227 26 . . . 3334 228 1 3 3 CD 3334 228 2 ( ( -LRB- 3334 228 3 2003 2003 CD 3334 228 4 ) ) -RRB- 3334 228 5 , , , 3334 228 6 http://informationr.net/ir/8 http://informationr.net/ir/8 NNP 3334 228 7 -3 -3 : 3334 228 8 / / SYM 3334 228 9 paper152.html paper152.html NN 3334 228 10 ( ( -LRB- 3334 228 11 accessed access VBN 3334 228 12 Feb. February NNP 3334 228 13 15 15 CD 3334 228 14 , , , 3334 228 15 2006 2006 CD 3334 228 16 ) ) -RRB- 3334 228 17 . . . 3334 229 1 11 11 CD 3334 229 2 . . . 3334 230 1 Ian Ian NNP 3334 230 2 Ruthven Ruthven NNP 3334 230 3 , , , 3334 230 4 “ " `` 3334 230 5 Re Re NNS 3334 230 6 - - , 3334 230 7 examining examine VBG 3334 230 8 the the DT 3334 230 9 Effectiveness Effectiveness NNP 3334 230 10 of of IN 3334 230 11 Interac- Interac- NNP 3334 230 12 tive tive JJ 3334 230 13 Query Query NNP 3334 230 14 Expansion Expansion NNP 3334 230 15 , , , 3334 230 16 ” " '' 3334 230 17 in in IN 3334 230 18 Proceedings Proceedings NNP 3334 230 19 of of IN 3334 230 20 the the DT 3334 230 21 26th 26th JJ 3334 230 22 International International NNP 3334 230 23 ACM ACM NNP 3334 230 24 SIGIR SIGIR NNP 3334 230 25 Conference Conference NNP 3334 230 26 on on IN 3334 230 27 Research Research NNP 3334 230 28 and and CC 3334 230 29 Development Development NNP 3334 230 30 in in IN 3334 230 31 Information Information NNP 3334 230 32 Retrieval Retrieval NNP 3334 230 33 ( ( -LRB- 3334 230 34 New New NNP 3334 230 35 York York NNP 3334 230 36 : : : 3334 230 37 ACM ACM NNP 3334 230 38 Press Press NNP 3334 230 39 , , , 3334 230 40 2003 2003 CD 3334 230 41 ) ) -RRB- 3334 230 42 , , , 3334 230 43 213–20 213–20 CD 3334 230 44 . . . 3334 231 1 12 12 CD 3334 231 2 . . . 3334 232 1 Marc Marc NNP 3334 232 2 L. L. NNP 3334 232 3 Resnick Resnick NNP 3334 232 4 and and CC 3334 232 5 Rebecca Rebecca NNP 3334 232 6 Lergier Lergier NNP 3334 232 7 , , , 3334 232 8 “ " `` 3334 232 9 Things thing NNS 3334 232 10 You -PRON- PRP 3334 232 11 Might may MD 3334 232 12 Not not RB 3334 232 13 Know know VB 3334 232 14 about about IN 3334 232 15 How how WRB 3334 232 16 Real real JJ 3334 232 17 People People NNS 3334 232 18 Search Search NNP 3334 232 19 , , , 3334 232 20 ” " '' 3334 232 21 2002 2002 CD 3334 232 22 , , , 3334 232 23 www.search www.search NNP 3334 232 24 tools.com/analysis/how-people-search.html tools.com/analysis/how-people-search.html NNP 3334 232 25 ( ( -LRB- 3334 232 26 accessed access VBN 3334 232 27 Oct. October NNP 3334 232 28 1 1 CD 3334 232 29 , , , 3334 232 30 2005 2005 CD 3334 232 31 ) ) -RRB- 3334 232 32 . . . 3334 233 1 13 13 CD 3334 233 2 . . . 3334 234 1 Danny Danny NNP 3334 234 2 Sullivan Sullivan NNP 3334 234 3 , , , 3334 234 4 “ " `` 3334 234 5 WebTop WebTop NNP 3334 234 6 Search Search NNP 3334 234 7 Rage Rage NNP 3334 234 8 Study Study NNP 3334 234 9 , , , 3334 234 10 ” " '' 3334 234 11 The the DT 3334 234 12 Search Search NNP 3334 234 13 Engine Engine NNP 3334 234 14 Report Report NNP 3334 234 15 , , , 3334 234 16 2001 2001 CD 3334 234 17 , , , 3334 234 18 http://searchenginewatch.com/sereport/ http://searchenginewatch.com/sereport/ NNP 3334 234 19 article.php/2163451 article.php/2163451 NNP 3334 234 20 ( ( -LRB- 3334 234 21 accessed access VBN 3334 234 22 Sept. September NNP 3334 234 23 10 10 CD 3334 234 24 , , , 3334 234 25 2005 2005 CD 3334 234 26 ) ) -RRB- 3334 234 27 . . . 3334 235 1 14 14 CD 3334 235 2 . . . 3334 236 1 J. J. NNP 3334 236 2 Teevan Teevan NNP 3334 236 3 et et NNP 3334 236 4 al al NNP 3334 236 5 . . NNP 3334 236 6 , , , 3334 236 7 “ " `` 3334 236 8 The the DT 3334 236 9 Perfect Perfect NNP 3334 236 10 Search Search NNP 3334 236 11 Engine Engine NNP 3334 236 12 Is be VBZ 3334 236 13 Not not RB 3334 236 14 Enough enough JJ 3334 236 15 : : : 3334 236 16 A a DT 3334 236 17 Study Study NNP 3334 236 18 of of IN 3334 236 19 Orienteering orienteere VBG 3334 236 20 Behavior Behavior NNP 3334 236 21 in in IN 3334 236 22 Directed Directed NNP 3334 236 23 Search Search NNP 3334 236 24 , , , 3334 236 25 ” " '' 3334 236 26 in in IN 3334 236 27 Pro- Pro- NNP 3334 236 28 ceedings ceeding NNS 3334 236 29 of of IN 3334 236 30 Computer Computer NNP 3334 236 31 - - HYPH 3334 236 32 Human Human NNP 3334 236 33 Interaction Interaction NNP 3334 236 34 Conference Conference NNP 3334 236 35 ’ ' '' 3334 236 36 94 94 CD 3334 236 37 ( ( -LRB- 3334 236 38 New New NNP 3334 236 39 York York NNP 3334 236 40 : : : 3334 236 41 ACM ACM NNP 3334 236 42 Press Press NNP 3334 236 43 , , , 3334 236 44 2004 2004 CD 3334 236 45 ) ) -RRB- 3334 236 46 , , , 3334 236 47 415–22 415–22 CD 3334 236 48 . . . 3334 237 1 15 15 CD 3334 237 2 . . . 3334 238 1 Vicki Vicki NNP 3334 238 2 O’Day O’Day NNP 3334 238 3 and and CC 3334 238 4 Robin Robin NNP 3334 238 5 Jeffries Jeffries NNP 3334 238 6 , , , 3334 238 7 “ " `` 3334 238 8 Orienteering orienteere VBG 3334 238 9 in in IN 3334 238 10 an an DT 3334 238 11 Infor- Infor- NNP 3334 238 12 mation mation NN 3334 238 13 Landscape landscape NN 3334 238 14 : : : 3334 238 15 How how WRB 3334 238 16 Information information NN 3334 238 17 Seekers seeker NNS 3334 238 18 Get get VBP 3334 238 19 from from IN 3334 238 20 Here here RB 3334 238 21 to to IN 3334 238 22 There there RB 3334 238 23 , , , 3334 238 24 ” " '' 3334 238 25 in in IN 3334 238 26 Proceedings Proceedings NNP 3334 238 27 Interchi Interchi NNP 3334 238 28 ’ ' '' 3334 238 29 93 93 CD 3334 238 30 ( ( -LRB- 3334 238 31 New New NNP 3334 238 32 York York NNP 3334 238 33 ; ; : 3334 238 34 ACM ACM NNP 3334 238 35 Press Press NNP 3334 238 36 , , , 3334 238 37 1993 1993 CD 3334 238 38 ) ) -RRB- 3334 238 39 , , , 3334 238 40 438 438 CD 3334 238 41 . . . 3334 239 1 16 16 CD 3334 239 2 . . . 3334 240 1 N. N. NNP 3334 240 2 J. J. NNP 3334 240 3 Belkin Belkin NNP 3334 240 4 , , , 3334 240 5 R. R. NNP 3334 240 6 N. N. NNP 3334 240 7 Oddy Oddy NNP 3334 240 8 , , , 3334 240 9 and and CC 3334 240 10 H. H. NNP 3334 240 11 M. M. NNP 3334 240 12 Brooks Brooks NNP 3334 240 13 , , , 3334 240 14 “ " `` 3334 240 15 ASK ask VB 3334 240 16 for for IN 3334 240 17 Information Information NNP 3334 240 18 Retrieval Retrieval NNP 3334 240 19 , , , 3334 240 20 Part Part NNP 3334 240 21 I. I. NNP 3334 241 1 Background Background NNP 3334 241 2 and and CC 3334 241 3 Theory theory NN 3334 241 4 , , , 3334 241 5 ” " '' 3334 241 6 The the DT 3334 241 7 Journal Journal NNP 3334 241 8 of of IN 3334 241 9 Documentation Documentation NNP 3334 241 10 38 38 CD 3334 241 11 , , , 3334 241 12 no no UH 3334 241 13 . . . 3334 242 1 2 2 CD 3334 242 2 ( ( -LRB- 3334 242 3 1982 1982 CD 3334 242 4 ) ) -RRB- 3334 242 5 : : : 3334 242 6 61–71 61–71 CD 3334 242 7 ; ; : 3334 242 8 N. N. NNP 3334 242 9 J. J. NNP 3334 242 10 Belkin Belkin NNP 3334 242 11 , , , 3334 242 12 R. R. NNP 3334 242 13 N. N. NNP 3334 242 14 Oddy Oddy NNP 3334 242 15 , , , 3334 242 16 and and CC 3334 242 17 H. H. NNP 3334 242 18 M. M. NNP 3334 242 19 Brooks Brooks NNP 3334 242 20 , , , 3334 242 21 “ " `` 3334 242 22 ASK ask VB 3334 242 23 for for IN 3334 242 24 Information Information NNP 3334 242 25 Retrieval Retrieval NNP 3334 242 26 , , , 3334 242 27 Part Part NNP 3334 242 28 II II NNP 3334 242 29 . . . 3334 243 1 Results result NNS 3334 243 2 of of IN 3334 243 3 a a DT 3334 243 4 Design Design NNP 3334 243 5 Study Study NNP 3334 243 6 , , , 3334 243 7 ” " '' 3334 243 8 The the DT 3334 243 9 Journal Journal NNP 3334 243 10 of of IN 3334 243 11 Documentation Documentation NNP 3334 243 12 38 38 CD 3334 243 13 , , , 3334 243 14 no no UH 3334 243 15 . . . 3334 244 1 3 3 CD 3334 244 2 ( ( -LRB- 3334 244 3 1982 1982 CD 3334 244 4 ) ) -RRB- 3334 244 5 : : : 3334 244 6 145–64 145–64 CD 3334 244 7 ; ; : 3334 244 8 Carol Carol NNP 3334 244 9 C. C. NNP 3334 244 10 Kuhlthau Kuhlthau NNP 3334 244 11 , , , 3334 244 12 Seeking seek VBG 3334 244 13 Meaning meaning NN 3334 244 14 : : : 3334 244 15 A a DT 3334 244 16 Process Process NNP 3334 244 17 Approach Approach NNP 3334 244 18 ( ( -LRB- 3334 244 19 Norwood Norwood NNP 3334 244 20 , , , 3334 244 21 N.J. New Jersey NNP 3334 244 22 : : : 3334 244 23 Ablex Ablex NNP 3334 244 24 , , , 3334 244 25 1993 1993 CD 3334 244 26 ) ) -RRB- 3334 244 27 . . .