id sid tid token lemma pos blog-archive-org-5806 1 1 Robots.txt Robots.txt NNP blog-archive-org-5806 1 2 meant mean VBD blog-archive-org-5806 1 3 for for IN blog-archive-org-5806 1 4 search search NN blog-archive-org-5806 1 5 engines engine NNS blog-archive-org-5806 1 6 do do VBP blog-archive-org-5806 1 7 n’t not RB blog-archive-org-5806 1 8 work work VB blog-archive-org-5806 1 9 well well RB blog-archive-org-5806 1 10 for for IN blog-archive-org-5806 1 11 web web NN blog-archive-org-5806 1 12 archives archive NNS blog-archive-org-5806 1 13 - - HYPH blog-archive-org-5806 1 14 Internet internet NN blog-archive-org-5806 1 15 Archive Archive NNP blog-archive-org-5806 1 16 Blogs Blogs NNP blog-archive-org-5806 1 17 Internet Internet NNP blog-archive-org-5806 1 18 Archive Archive NNP blog-archive-org-5806 1 19 Blogs Blogs NNP blog-archive-org-5806 1 20 A a DT blog-archive-org-5806 1 21 blog blog NN blog-archive-org-5806 1 22 from from IN blog-archive-org-5806 1 23 the the DT blog-archive-org-5806 1 24 team team NN blog-archive-org-5806 1 25 at at IN blog-archive-org-5806 1 26 archive.org archive.org CD blog-archive-org-5806 1 27 Menu Menu NNP blog-archive-org-5806 1 28 Skip Skip NNP blog-archive-org-5806 1 29 to to TO blog-archive-org-5806 1 30 content content VB blog-archive-org-5806 1 31 Blog Blog NNP blog-archive-org-5806 1 32 Announcements Announcements NNP blog-archive-org-5806 1 33 Internet Internet NNP blog-archive-org-5806 1 34 Archive Archive NNP blog-archive-org-5806 1 35 Store Store NNP blog-archive-org-5806 1 36 archive.org archive.org NNP blog-archive-org-5806 1 37 About about IN blog-archive-org-5806 1 38 Events event NNS blog-archive-org-5806 1 39 Developers Developers NNPS blog-archive-org-5806 1 40 Donate Donate NNP blog-archive-org-5806 1 41 Robots.txt Robots.txt NNP blog-archive-org-5806 1 42 meant mean VBD blog-archive-org-5806 1 43 for for IN blog-archive-org-5806 1 44 search search NN blog-archive-org-5806 1 45 engines engine NNS blog-archive-org-5806 1 46 do do VBP blog-archive-org-5806 1 47 n’t not RB blog-archive-org-5806 1 48 work work VB blog-archive-org-5806 1 49 well well RB blog-archive-org-5806 1 50 for for IN blog-archive-org-5806 1 51 web web NN blog-archive-org-5806 1 52 archives archive NNS blog-archive-org-5806 1 53 Posted post VBN blog-archive-org-5806 1 54 on on IN blog-archive-org-5806 1 55 April April NNP blog-archive-org-5806 1 56 17 17 CD blog-archive-org-5806 1 57 , , , blog-archive-org-5806 1 58 2017 2017 CD blog-archive-org-5806 1 59 by by IN blog-archive-org-5806 1 60 Mark Mark NNP blog-archive-org-5806 1 61 Graham Graham NNP blog-archive-org-5806 1 62 Robots.txt Robots.txt NNP blog-archive-org-5806 1 63 files file NNS blog-archive-org-5806 1 64 were be VBD blog-archive-org-5806 1 65 invented invent VBN blog-archive-org-5806 1 66 20 20 CD blog-archive-org-5806 1 67 + + SYM blog-archive-org-5806 1 68 years year NNS blog-archive-org-5806 1 69 ago ago RB blog-archive-org-5806 1 70 to to TO blog-archive-org-5806 1 71 help help VB blog-archive-org-5806 1 72 advise advise VB blog-archive-org-5806 1 73 “ " `` blog-archive-org-5806 1 74 robots robot NNS blog-archive-org-5806 1 75 , , , blog-archive-org-5806 1 76 ” " '' blog-archive-org-5806 1 77 mostly mostly RB blog-archive-org-5806 1 78 search search NN blog-archive-org-5806 1 79 engine engine NN blog-archive-org-5806 1 80 web web NN blog-archive-org-5806 1 81 crawlers crawler NNS blog-archive-org-5806 1 82 , , , blog-archive-org-5806 1 83 which which WDT blog-archive-org-5806 1 84 sections section NNS blog-archive-org-5806 1 85 of of IN blog-archive-org-5806 1 86 a a DT blog-archive-org-5806 1 87 web web NN blog-archive-org-5806 1 88 site site NN blog-archive-org-5806 1 89 should should MD blog-archive-org-5806 1 90 be be VB blog-archive-org-5806 1 91 crawled crawl VBN blog-archive-org-5806 1 92 and and CC blog-archive-org-5806 1 93 indexed index VBN blog-archive-org-5806 1 94 for for IN blog-archive-org-5806 1 95 search search NN blog-archive-org-5806 1 96 . . . blog-archive-org-5806 2 1 Many many JJ blog-archive-org-5806 2 2 sites site NNS blog-archive-org-5806 2 3 use use VBP blog-archive-org-5806 2 4 their -PRON- PRP$ blog-archive-org-5806 2 5 robots.txt robots.txt NN blog-archive-org-5806 2 6 files file NNS blog-archive-org-5806 2 7 to to TO blog-archive-org-5806 2 8 improve improve VB blog-archive-org-5806 2 9 their -PRON- PRP$ blog-archive-org-5806 2 10 SEO seo NN blog-archive-org-5806 2 11 ( ( -LRB- blog-archive-org-5806 2 12 search search NN blog-archive-org-5806 2 13 engine engine NN blog-archive-org-5806 2 14 optimization optimization NN blog-archive-org-5806 2 15 ) ) -RRB- blog-archive-org-5806 2 16 by by IN blog-archive-org-5806 2 17 excluding exclude VBG blog-archive-org-5806 2 18 duplicate duplicate JJ blog-archive-org-5806 2 19 content content NN blog-archive-org-5806 2 20 like like IN blog-archive-org-5806 2 21 print print NN blog-archive-org-5806 2 22 versions version NNS blog-archive-org-5806 2 23 of of IN blog-archive-org-5806 2 24 recipes recipe NNS blog-archive-org-5806 2 25 , , , blog-archive-org-5806 2 26 excluding exclude VBG blog-archive-org-5806 2 27 search search NN blog-archive-org-5806 2 28 result result NN blog-archive-org-5806 2 29 pages page NNS blog-archive-org-5806 2 30 , , , blog-archive-org-5806 2 31 excluding exclude VBG blog-archive-org-5806 2 32 large large JJ blog-archive-org-5806 2 33 files file NNS blog-archive-org-5806 2 34 from from IN blog-archive-org-5806 2 35 crawling crawl VBG blog-archive-org-5806 2 36 to to TO blog-archive-org-5806 2 37 save save VB blog-archive-org-5806 2 38 on on IN blog-archive-org-5806 2 39 hosting host VBG blog-archive-org-5806 2 40 costs cost NNS blog-archive-org-5806 2 41 , , , blog-archive-org-5806 2 42 or or CC blog-archive-org-5806 2 43 “ " `` blog-archive-org-5806 2 44 hiding hide VBG blog-archive-org-5806 2 45 ” " '' blog-archive-org-5806 2 46 sensitive sensitive JJ blog-archive-org-5806 2 47 areas area NNS blog-archive-org-5806 2 48 of of IN blog-archive-org-5806 2 49 the the DT blog-archive-org-5806 2 50 site site NN blog-archive-org-5806 2 51 like like IN blog-archive-org-5806 2 52 administrative administrative JJ blog-archive-org-5806 2 53 pages page NNS blog-archive-org-5806 2 54 . . . blog-archive-org-5806 3 1 ( ( -LRB- blog-archive-org-5806 3 2 Of of RB blog-archive-org-5806 3 3 course course RB blog-archive-org-5806 3 4 , , , blog-archive-org-5806 3 5 over over IN blog-archive-org-5806 3 6 the the DT blog-archive-org-5806 3 7 years year NNS blog-archive-org-5806 3 8 malicious malicious JJ blog-archive-org-5806 3 9 actors actor NNS blog-archive-org-5806 3 10 have have VBP blog-archive-org-5806 3 11 also also RB blog-archive-org-5806 3 12 used use VBN blog-archive-org-5806 3 13 robots.txt robots.txt NN blog-archive-org-5806 3 14 files file NNS blog-archive-org-5806 3 15 to to TO blog-archive-org-5806 3 16 identify identify VB blog-archive-org-5806 3 17 those those DT blog-archive-org-5806 3 18 same same JJ blog-archive-org-5806 3 19 sensitive sensitive JJ blog-archive-org-5806 3 20 areas area NNS blog-archive-org-5806 3 21 ! ! . blog-archive-org-5806 3 22 ) ) -RRB- blog-archive-org-5806 4 1 Some some DT blog-archive-org-5806 4 2 crawlers crawler NNS blog-archive-org-5806 4 3 , , , blog-archive-org-5806 4 4 like like IN blog-archive-org-5806 4 5 Google Google NNP blog-archive-org-5806 4 6 , , , blog-archive-org-5806 4 7 pay pay VB blog-archive-org-5806 4 8 attention attention NN blog-archive-org-5806 4 9 to to IN blog-archive-org-5806 4 10 robots.txt robots.txt CD blog-archive-org-5806 4 11 directives directive NNS blog-archive-org-5806 4 12 , , , blog-archive-org-5806 4 13 while while IN blog-archive-org-5806 4 14 others other NNS blog-archive-org-5806 4 15 do do VBP blog-archive-org-5806 4 16 not not RB blog-archive-org-5806 4 17 . . . blog-archive-org-5806 5 1 Over over IN blog-archive-org-5806 5 2 time time NN blog-archive-org-5806 5 3 we -PRON- PRP blog-archive-org-5806 5 4 have have VBP blog-archive-org-5806 5 5 observed observe VBN blog-archive-org-5806 5 6 that that IN blog-archive-org-5806 5 7 the the DT blog-archive-org-5806 5 8 robots.txt robots.txt NN blog-archive-org-5806 5 9 files file NNS blog-archive-org-5806 5 10 that that WDT blog-archive-org-5806 5 11 are be VBP blog-archive-org-5806 5 12 geared gear VBN blog-archive-org-5806 5 13 toward toward IN blog-archive-org-5806 5 14 search search NN blog-archive-org-5806 5 15 engine engine NN blog-archive-org-5806 5 16 crawlers crawler NNS blog-archive-org-5806 5 17 do do VBP blog-archive-org-5806 5 18 not not RB blog-archive-org-5806 5 19 necessarily necessarily RB blog-archive-org-5806 5 20 serve serve VB blog-archive-org-5806 5 21 our -PRON- PRP$ blog-archive-org-5806 5 22 archival archival NN blog-archive-org-5806 5 23 purposes purpose NNS blog-archive-org-5806 5 24 . . . blog-archive-org-5806 6 1 Internet Internet NNP blog-archive-org-5806 6 2 Archive Archive NNP blog-archive-org-5806 6 3 ’s ’s POS blog-archive-org-5806 6 4 goal goal NN blog-archive-org-5806 6 5 is be VBZ blog-archive-org-5806 6 6 to to TO blog-archive-org-5806 6 7 create create VB blog-archive-org-5806 6 8 complete complete JJ blog-archive-org-5806 6 9 “ " `` blog-archive-org-5806 6 10 snapshots snapshot NNS blog-archive-org-5806 6 11 ” " '' blog-archive-org-5806 6 12 of of IN blog-archive-org-5806 6 13 web web NN blog-archive-org-5806 6 14 pages page NNS blog-archive-org-5806 6 15 , , , blog-archive-org-5806 6 16 including include VBG blog-archive-org-5806 6 17 the the DT blog-archive-org-5806 6 18 duplicate duplicate JJ blog-archive-org-5806 6 19 content content NN blog-archive-org-5806 6 20 and and CC blog-archive-org-5806 6 21 the the DT blog-archive-org-5806 6 22 large large JJ blog-archive-org-5806 6 23 versions version NNS blog-archive-org-5806 6 24 of of IN blog-archive-org-5806 6 25 files file NNS blog-archive-org-5806 6 26 . . . blog-archive-org-5806 7 1 We -PRON- PRP blog-archive-org-5806 7 2 have have VBP blog-archive-org-5806 7 3 also also RB blog-archive-org-5806 7 4 seen see VBN blog-archive-org-5806 7 5 an an DT blog-archive-org-5806 7 6 upsurge upsurge NN blog-archive-org-5806 7 7 of of IN blog-archive-org-5806 7 8 the the DT blog-archive-org-5806 7 9 use use NN blog-archive-org-5806 7 10 of of IN blog-archive-org-5806 7 11 robots.txt robots.txt JJ blog-archive-org-5806 7 12 files file NNS blog-archive-org-5806 7 13 to to TO blog-archive-org-5806 7 14 remove remove VB blog-archive-org-5806 7 15 entire entire JJ blog-archive-org-5806 7 16 domains domain NNS blog-archive-org-5806 7 17 from from IN blog-archive-org-5806 7 18 search search NN blog-archive-org-5806 7 19 engines engine NNS blog-archive-org-5806 7 20 when when WRB blog-archive-org-5806 7 21 they -PRON- PRP blog-archive-org-5806 7 22 transition transition VBP blog-archive-org-5806 7 23 from from IN blog-archive-org-5806 7 24 a a DT blog-archive-org-5806 7 25 live live JJ blog-archive-org-5806 7 26 web web NN blog-archive-org-5806 7 27 site site NN blog-archive-org-5806 7 28 into into IN blog-archive-org-5806 7 29 a a DT blog-archive-org-5806 7 30 parked park VBN blog-archive-org-5806 7 31 domain domain NN blog-archive-org-5806 7 32 , , , blog-archive-org-5806 7 33 which which WDT blog-archive-org-5806 7 34 has have VBZ blog-archive-org-5806 7 35 historically historically RB blog-archive-org-5806 7 36 also also RB blog-archive-org-5806 7 37 removed remove VBN blog-archive-org-5806 7 38 the the DT blog-archive-org-5806 7 39 entire entire JJ blog-archive-org-5806 7 40 domain domain NN blog-archive-org-5806 7 41 from from IN blog-archive-org-5806 7 42 view view NN blog-archive-org-5806 7 43 in in IN blog-archive-org-5806 7 44 the the DT blog-archive-org-5806 7 45 Wayback Wayback NNP blog-archive-org-5806 7 46 Machine Machine NNP blog-archive-org-5806 7 47 . . . blog-archive-org-5806 8 1 In in IN blog-archive-org-5806 8 2 other other JJ blog-archive-org-5806 8 3 words word NNS blog-archive-org-5806 8 4 , , , blog-archive-org-5806 8 5 a a DT blog-archive-org-5806 8 6 site site NN blog-archive-org-5806 8 7 goes go VBZ blog-archive-org-5806 8 8 out out IN blog-archive-org-5806 8 9 of of IN blog-archive-org-5806 8 10 business business NN blog-archive-org-5806 8 11 and and CC blog-archive-org-5806 8 12 then then RB blog-archive-org-5806 8 13 the the DT blog-archive-org-5806 8 14 parked park VBN blog-archive-org-5806 8 15 domain domain NN blog-archive-org-5806 8 16 is be VBZ blog-archive-org-5806 8 17 “ " `` blog-archive-org-5806 8 18 blocked block VBN blog-archive-org-5806 8 19 ” " '' blog-archive-org-5806 8 20 from from IN blog-archive-org-5806 8 21 search search NN blog-archive-org-5806 8 22 engines engine NNS blog-archive-org-5806 8 23 and and CC blog-archive-org-5806 8 24 no no DT blog-archive-org-5806 8 25 one one NN blog-archive-org-5806 8 26 can can MD blog-archive-org-5806 8 27 look look VB blog-archive-org-5806 8 28 at at IN blog-archive-org-5806 8 29 the the DT blog-archive-org-5806 8 30 history history NN blog-archive-org-5806 8 31 of of IN blog-archive-org-5806 8 32 that that DT blog-archive-org-5806 8 33 site site NN blog-archive-org-5806 8 34 in in IN blog-archive-org-5806 8 35 the the DT blog-archive-org-5806 8 36 Wayback Wayback NNP blog-archive-org-5806 8 37 Machine Machine NNP blog-archive-org-5806 8 38 anymore anymore RB blog-archive-org-5806 8 39 . . . blog-archive-org-5806 9 1 We -PRON- PRP blog-archive-org-5806 9 2 receive receive VBP blog-archive-org-5806 9 3 inquiries inquiry NNS blog-archive-org-5806 9 4 and and CC blog-archive-org-5806 9 5 complaints complaint NNS blog-archive-org-5806 9 6 on on IN blog-archive-org-5806 9 7 these these DT blog-archive-org-5806 9 8 “ " `` blog-archive-org-5806 9 9 disappeared disappear VBN blog-archive-org-5806 9 10 ” " '' blog-archive-org-5806 9 11 sites site NNS blog-archive-org-5806 9 12 almost almost RB blog-archive-org-5806 9 13 daily daily RB blog-archive-org-5806 9 14 . . . blog-archive-org-5806 10 1 A a DT blog-archive-org-5806 10 2 few few JJ blog-archive-org-5806 10 3 months month NNS blog-archive-org-5806 10 4 ago ago RB blog-archive-org-5806 10 5 we -PRON- PRP blog-archive-org-5806 10 6 stopped stop VBD blog-archive-org-5806 10 7 referring refer VBG blog-archive-org-5806 10 8 to to IN blog-archive-org-5806 10 9 robots.txt robots.txt VB blog-archive-org-5806 10 10 files file NNS blog-archive-org-5806 10 11 on on IN blog-archive-org-5806 10 12 U.S. U.S. NNP blog-archive-org-5806 10 13 government government NN blog-archive-org-5806 10 14 and and CC blog-archive-org-5806 10 15 military military NN blog-archive-org-5806 10 16 web web NN blog-archive-org-5806 10 17 sites site NNS blog-archive-org-5806 10 18 for for IN blog-archive-org-5806 10 19 both both CC blog-archive-org-5806 10 20 crawling crawling NN blog-archive-org-5806 10 21 and and CC blog-archive-org-5806 10 22 displaying display VBG blog-archive-org-5806 10 23 web web NN blog-archive-org-5806 10 24 pages page NNS blog-archive-org-5806 10 25 ( ( -LRB- blog-archive-org-5806 10 26 though though IN blog-archive-org-5806 10 27 we -PRON- PRP blog-archive-org-5806 10 28 respond respond VBP blog-archive-org-5806 10 29 to to IN blog-archive-org-5806 10 30 removal removal NN blog-archive-org-5806 10 31 requests request NNS blog-archive-org-5806 10 32 sent send VBN blog-archive-org-5806 10 33 to to IN blog-archive-org-5806 10 34 info@archive.org info@archive.org NNP blog-archive-org-5806 10 35 ) ) -RRB- blog-archive-org-5806 10 36 . . . blog-archive-org-5806 11 1 As as IN blog-archive-org-5806 11 2 we -PRON- PRP blog-archive-org-5806 11 3 have have VBP blog-archive-org-5806 11 4 moved move VBN blog-archive-org-5806 11 5 towards towards IN blog-archive-org-5806 11 6 broader broad JJR blog-archive-org-5806 11 7 access access NN blog-archive-org-5806 11 8 it -PRON- PRP blog-archive-org-5806 11 9 has have VBZ blog-archive-org-5806 11 10 not not RB blog-archive-org-5806 11 11 caused cause VBN blog-archive-org-5806 11 12 problems problem NNS blog-archive-org-5806 11 13 , , , blog-archive-org-5806 11 14 which which WDT blog-archive-org-5806 11 15 we -PRON- PRP blog-archive-org-5806 11 16 take take VBP blog-archive-org-5806 11 17 as as IN blog-archive-org-5806 11 18 a a DT blog-archive-org-5806 11 19 good good JJ blog-archive-org-5806 11 20 sign sign NN blog-archive-org-5806 11 21 . . . blog-archive-org-5806 12 1 We -PRON- PRP blog-archive-org-5806 12 2 are be VBP blog-archive-org-5806 12 3 now now RB blog-archive-org-5806 12 4 looking look VBG blog-archive-org-5806 12 5 to to TO blog-archive-org-5806 12 6 do do VB blog-archive-org-5806 12 7 this this DT blog-archive-org-5806 12 8 more more RBR blog-archive-org-5806 12 9 broadly broadly RB blog-archive-org-5806 12 10 . . . blog-archive-org-5806 13 1 We -PRON- PRP blog-archive-org-5806 13 2 see see VBP blog-archive-org-5806 13 3 the the DT blog-archive-org-5806 13 4 future future NN blog-archive-org-5806 13 5 of of IN blog-archive-org-5806 13 6 web web NN blog-archive-org-5806 13 7 archiving archive VBG blog-archive-org-5806 13 8 relying rely VBG blog-archive-org-5806 13 9 less less RBR blog-archive-org-5806 13 10 on on IN blog-archive-org-5806 13 11 robots.txt robots.txt CD blog-archive-org-5806 13 12 file file NN blog-archive-org-5806 13 13 declarations declaration NNS blog-archive-org-5806 13 14 geared gear VBN blog-archive-org-5806 13 15 toward toward IN blog-archive-org-5806 13 16 search search NN blog-archive-org-5806 13 17 engines engine NNS blog-archive-org-5806 13 18 , , , blog-archive-org-5806 13 19 and and CC blog-archive-org-5806 13 20 more more RBR blog-archive-org-5806 13 21 on on IN blog-archive-org-5806 13 22 representing represent VBG blog-archive-org-5806 13 23 the the DT blog-archive-org-5806 13 24 web web NN blog-archive-org-5806 13 25 as as IN blog-archive-org-5806 13 26 it -PRON- PRP blog-archive-org-5806 13 27 really really RB blog-archive-org-5806 13 28 was be VBD blog-archive-org-5806 13 29 , , , blog-archive-org-5806 13 30 and and CC blog-archive-org-5806 13 31 is be VBZ blog-archive-org-5806 13 32 , , , blog-archive-org-5806 13 33 from from IN blog-archive-org-5806 13 34 a a DT blog-archive-org-5806 13 35 user user NN blog-archive-org-5806 13 36 ’s ’s POS blog-archive-org-5806 13 37 perspective perspective NN blog-archive-org-5806 13 38 . . . blog-archive-org-5806 14 1 Posted post VBN blog-archive-org-5806 14 2 in in IN blog-archive-org-5806 14 3 Announcements Announcements NNP blog-archive-org-5806 14 4 , , , blog-archive-org-5806 14 5 News News NNP blog-archive-org-5806 14 6 | | NNP blog-archive-org-5806 14 7 34 34 CD blog-archive-org-5806 14 8 Replies Replies NNPS blog-archive-org-5806 14 9 Post Post NNP blog-archive-org-5806 14 10 navigation navigation NN blog-archive-org-5806 14 11 ← ← VBZ blog-archive-org-5806 14 12 A a DT blog-archive-org-5806 14 13 Few Few NNP blog-archive-org-5806 14 14 Advanced Advanced NNP blog-archive-org-5806 14 15 Search Search NNP blog-archive-org-5806 14 16 Tips Tips NNPS blog-archive-org-5806 14 17 DRM DRM NNP blog-archive-org-5806 14 18 for for IN blog-archive-org-5806 14 19 the the DT blog-archive-org-5806 14 20 Web web NN blog-archive-org-5806 14 21 is be VBZ blog-archive-org-5806 14 22 a a DT blog-archive-org-5806 14 23 Bad Bad NNP blog-archive-org-5806 14 24 Idea idea NN blog-archive-org-5806 14 25 → → SYM blog-archive-org-5806 14 26 34 34 CD blog-archive-org-5806 14 27 thoughts thought NNS blog-archive-org-5806 14 28 on on IN blog-archive-org-5806 14 29 “ " `` blog-archive-org-5806 14 30 Robots.txt Robots.txt NNP blog-archive-org-5806 14 31 meant mean VBN blog-archive-org-5806 14 32 for for IN blog-archive-org-5806 14 33 search search NN blog-archive-org-5806 14 34 engines engine NNS blog-archive-org-5806 14 35 do do VBP blog-archive-org-5806 14 36 n’t not RB blog-archive-org-5806 14 37 work work VB blog-archive-org-5806 14 38 well well RB blog-archive-org-5806 14 39 for for IN blog-archive-org-5806 14 40 web web NN blog-archive-org-5806 14 41 archives archive NNS blog-archive-org-5806 14 42 ” " '' blog-archive-org-5806 14 43 Daniel Daniel NNP blog-archive-org-5806 14 44 April April NNP blog-archive-org-5806 14 45 17 17 CD blog-archive-org-5806 14 46 , , , blog-archive-org-5806 14 47 2017 2017 CD blog-archive-org-5806 14 48 at at IN blog-archive-org-5806 14 49 2:18 2:18 CD blog-archive-org-5806 14 50 pm pm NN blog-archive-org-5806 14 51 So so RB blog-archive-org-5806 14 52 the the DT blog-archive-org-5806 14 53 plan plan NN blog-archive-org-5806 14 54 is be VBZ blog-archive-org-5806 14 55 to to TO blog-archive-org-5806 14 56 no no RB blog-archive-org-5806 14 57 longer long RBR blog-archive-org-5806 14 58 respect respect VB blog-archive-org-5806 14 59 robots.txt robots.txt NN blog-archive-org-5806 14 60 files file NNS blog-archive-org-5806 14 61 with with IN blog-archive-org-5806 14 62 directives directive NNS blog-archive-org-5806 14 63 that that WDT blog-archive-org-5806 14 64 explicitly explicitly RB blog-archive-org-5806 14 65 say say VBP blog-archive-org-5806 14 66 User User NNP blog-archive-org-5806 14 67 - - HYPH blog-archive-org-5806 14 68 Agent Agent NNP blog-archive-org-5806 14 69 : : : blog-archive-org-5806 14 70 ia_archiver ia_archiver NNP blog-archive-org-5806 14 71 ? ? . blog-archive-org-5806 15 1 or or CC blog-archive-org-5806 15 2 User User NNP blog-archive-org-5806 15 3 - - HYPH blog-archive-org-5806 15 4 Agent Agent NNP blog-archive-org-5806 15 5 : : : blog-archive-org-5806 15 6 * * NFP blog-archive-org-5806 15 7 ? ? . blog-archive-org-5806 16 1 Many many JJ blog-archive-org-5806 16 2 website website NN blog-archive-org-5806 16 3 explicitly explicitly RB blog-archive-org-5806 16 4 block block VBP blog-archive-org-5806 16 5 the the DT blog-archive-org-5806 16 6 Internet Internet NNP blog-archive-org-5806 16 7 Archive Archive NNP blog-archive-org-5806 16 8 ’s ’s , blog-archive-org-5806 16 9 ia_archiver ia_archiver NNP blog-archive-org-5806 16 10 crawler crawler NNP blog-archive-org-5806 16 11 while while IN blog-archive-org-5806 16 12 allowing allow VBG blog-archive-org-5806 16 13 other other JJ blog-archive-org-5806 16 14 crawlers crawler NNS blog-archive-org-5806 16 15 . . . blog-archive-org-5806 17 1 Have have VBP blog-archive-org-5806 17 2 you -PRON- PRP blog-archive-org-5806 17 3 considered consider VBN blog-archive-org-5806 17 4 adopting adopt VBG blog-archive-org-5806 17 5 AppleNewsBot applenewsbot NN blog-archive-org-5806 17 6 ’s ’s NN blog-archive-org-5806 17 7 policy policy NN blog-archive-org-5806 17 8 of of IN blog-archive-org-5806 17 9 pretending pretend VBG blog-archive-org-5806 17 10 to to TO blog-archive-org-5806 17 11 be be VB blog-archive-org-5806 17 12 Googlebot Googlebot NNP blog-archive-org-5806 17 13 ? ? . blog-archive-org-5806 18 1 Robots robot NNS blog-archive-org-5806 18 2 directives directive NNS blog-archive-org-5806 18 3 written write VBN blog-archive-org-5806 18 4 for for IN blog-archive-org-5806 18 5 Googlebot Googlebot NNP blog-archive-org-5806 18 6 is be VBZ blog-archive-org-5806 18 7 more more RBR blog-archive-org-5806 18 8 permissive permissive JJ blog-archive-org-5806 18 9 than than IN blog-archive-org-5806 18 10 rules rule NNS blog-archive-org-5806 18 11 for for IN blog-archive-org-5806 18 12 other other JJ blog-archive-org-5806 18 13 crawlers crawler NNS blog-archive-org-5806 18 14 . . . blog-archive-org-5806 19 1 Also also RB blog-archive-org-5806 19 2 , , , blog-archive-org-5806 19 3 many many JJ blog-archive-org-5806 19 4 sites site NNS blog-archive-org-5806 19 5 block block VBP blog-archive-org-5806 19 6 everything everything NN blog-archive-org-5806 19 7 but but IN blog-archive-org-5806 19 8 Googlebot Googlebot NNP blog-archive-org-5806 19 9 . . . blog-archive-org-5806 20 1 I -PRON- PRP blog-archive-org-5806 20 2 ’m be VBP blog-archive-org-5806 20 3 kind kind RB blog-archive-org-5806 20 4 of of RB blog-archive-org-5806 20 5 torn torn JJ blog-archive-org-5806 20 6 on on IN blog-archive-org-5806 20 7 whether whether IN blog-archive-org-5806 20 8 I -PRON- PRP blog-archive-org-5806 20 9 think think VBP blog-archive-org-5806 20 10 it -PRON- PRP blog-archive-org-5806 20 11 ’s ’ VBZ blog-archive-org-5806 20 12 a a DT blog-archive-org-5806 20 13 good good JJ blog-archive-org-5806 20 14 thing thing NN blog-archive-org-5806 20 15 if if IN blog-archive-org-5806 20 16 you -PRON- PRP blog-archive-org-5806 20 17 improve improve VBP blog-archive-org-5806 20 18 the the DT blog-archive-org-5806 20 19 archive archive NN blog-archive-org-5806 20 20 by by IN blog-archive-org-5806 20 21 ignoring ignore VBG blog-archive-org-5806 20 22 the the DT blog-archive-org-5806 20 23 wishes wish NNS blog-archive-org-5806 20 24 of of IN blog-archive-org-5806 20 25 webmasters webmaster NNS blog-archive-org-5806 20 26 or or CC blog-archive-org-5806 20 27 not not RB blog-archive-org-5806 20 28 . . . blog-archive-org-5806 21 1 I -PRON- PRP blog-archive-org-5806 21 2 often often RB blog-archive-org-5806 21 3 run run VBP blog-archive-org-5806 21 4 into into IN blog-archive-org-5806 21 5 issues issue NNS blog-archive-org-5806 21 6 with with IN blog-archive-org-5806 21 7 pages page NNS blog-archive-org-5806 21 8 missing miss VBG blog-archive-org-5806 21 9 from from IN blog-archive-org-5806 21 10 the the DT blog-archive-org-5806 21 11 archive archive NN blog-archive-org-5806 21 12 only only RB blog-archive-org-5806 21 13 to to TO blog-archive-org-5806 21 14 discover discover VB blog-archive-org-5806 21 15 that that IN blog-archive-org-5806 21 16 the the DT blog-archive-org-5806 21 17 website website NN blog-archive-org-5806 21 18 has have VBZ blog-archive-org-5806 21 19 specifically specifically RB blog-archive-org-5806 21 20 excluded exclude VBN blog-archive-org-5806 21 21 the the DT blog-archive-org-5806 21 22 ia_archiver ia_archiver NNP blog-archive-org-5806 21 23 . . . blog-archive-org-5806 22 1 However however RB blog-archive-org-5806 22 2 , , , blog-archive-org-5806 22 3 I -PRON- PRP blog-archive-org-5806 22 4 still still RB blog-archive-org-5806 22 5 believe believe VBP blog-archive-org-5806 22 6 it -PRON- PRP blog-archive-org-5806 22 7 ’s ’ VBZ blog-archive-org-5806 22 8 important important JJ blog-archive-org-5806 22 9 to to TO blog-archive-org-5806 22 10 preserve preserve VB blog-archive-org-5806 22 11 a a DT blog-archive-org-5806 22 12 standardized standardized JJ blog-archive-org-5806 22 13 mechanism mechanism NN blog-archive-org-5806 22 14 for for IN blog-archive-org-5806 22 15 controlling control VBG blog-archive-org-5806 22 16 crawlers crawler NNS blog-archive-org-5806 22 17 and and CC blog-archive-org-5806 22 18 bots bot NNS blog-archive-org-5806 22 19 of of IN blog-archive-org-5806 22 20 all all DT blog-archive-org-5806 22 21 kinds kind NNS blog-archive-org-5806 22 22 . . . blog-archive-org-5806 23 1 Pingback Pingback NNP blog-archive-org-5806 23 2 : : : blog-archive-org-5806 23 3 News News NNP blog-archive-org-5806 23 4 Roundup Roundup NNP blog-archive-org-5806 23 5 | | NNP blog-archive-org-5806 23 6 LJ LJ NNP blog-archive-org-5806 23 7 INFOdocket infodocket VBP blog-archive-org-5806 23 8 Joshua Joshua NNP blog-archive-org-5806 23 9 April April NNP blog-archive-org-5806 23 10 17 17 CD blog-archive-org-5806 23 11 , , , blog-archive-org-5806 23 12 2017 2017 CD blog-archive-org-5806 23 13 at at IN blog-archive-org-5806 23 14 11:31 11:31 CD blog-archive-org-5806 23 15 pm pm NN blog-archive-org-5806 23 16 A a DT blog-archive-org-5806 23 17 better well JJR blog-archive-org-5806 23 18 choice choice NN blog-archive-org-5806 23 19 would would MD blog-archive-org-5806 23 20 probably probably RB blog-archive-org-5806 23 21 have have VB blog-archive-org-5806 23 22 been be VBN blog-archive-org-5806 23 23 to to TO blog-archive-org-5806 23 24 respect respect VB blog-archive-org-5806 23 25 robots.txt robots.txt ADD blog-archive-org-5806 23 26 as as IN blog-archive-org-5806 23 27 of of IN blog-archive-org-5806 23 28 the the DT blog-archive-org-5806 23 29 time time NN blog-archive-org-5806 23 30 you -PRON- PRP blog-archive-org-5806 23 31 crawled crawl VBD blog-archive-org-5806 23 32 it -PRON- PRP blog-archive-org-5806 23 33 ; ; : blog-archive-org-5806 23 34 that that DT blog-archive-org-5806 23 35 is be VBZ blog-archive-org-5806 23 36 once once RB blog-archive-org-5806 23 37 archived archived JJ blog-archive-org-5806 23 38 changing change VBG blog-archive-org-5806 23 39 robots.txt robots.txt CD blog-archive-org-5806 23 40 later later RB blog-archive-org-5806 23 41 does do VBZ blog-archive-org-5806 23 42 n’t not RB blog-archive-org-5806 23 43 change change VB blog-archive-org-5806 23 44 its -PRON- PRP$ blog-archive-org-5806 23 45 visibility visibility NN blog-archive-org-5806 23 46 . . . blog-archive-org-5806 24 1 Oh oh UH blog-archive-org-5806 24 2 well well RB blog-archive-org-5806 24 3 . . . blog-archive-org-5806 25 1 MeditateOrDie MeditateOrDie NNP blog-archive-org-5806 25 2 April April NNP blog-archive-org-5806 25 3 18 18 CD blog-archive-org-5806 25 4 , , , blog-archive-org-5806 25 5 2017 2017 CD blog-archive-org-5806 25 6 at at IN blog-archive-org-5806 25 7 7:02 7:02 CD blog-archive-org-5806 25 8 am be VBP blog-archive-org-5806 25 9 I -PRON- PRP blog-archive-org-5806 25 10 agree agree VBP blog-archive-org-5806 25 11 with with IN blog-archive-org-5806 25 12 this this DT blog-archive-org-5806 25 13 mostly mostly RB blog-archive-org-5806 25 14 , , , blog-archive-org-5806 25 15 though though IN blog-archive-org-5806 25 16 some some DT blog-archive-org-5806 25 17 sites site NNS blog-archive-org-5806 25 18 seem seem VBP blog-archive-org-5806 25 19 to to TO blog-archive-org-5806 25 20 block block VB blog-archive-org-5806 25 21 archive.org archive.org NNP blog-archive-org-5806 25 22 for for IN blog-archive-org-5806 25 23 no no DT blog-archive-org-5806 25 24 sensible sensible JJ blog-archive-org-5806 25 25 reason reason NN blog-archive-org-5806 25 26 – – : blog-archive-org-5806 25 27 then then RB blog-archive-org-5806 25 28 when when WRB blog-archive-org-5806 25 29 their -PRON- PRP$ blog-archive-org-5806 25 30 site site NN blog-archive-org-5806 25 31 eventually eventually RB blog-archive-org-5806 25 32 dies die VBZ blog-archive-org-5806 25 33 , , , blog-archive-org-5806 25 34 as as IN blog-archive-org-5806 25 35 all all DT blog-archive-org-5806 25 36 sites site NNS blog-archive-org-5806 25 37 do do VBP blog-archive-org-5806 25 38 sooner soon RBR blog-archive-org-5806 25 39 or or CC blog-archive-org-5806 25 40 later later RBR blog-archive-org-5806 25 41 , , , blog-archive-org-5806 25 42 all all DT blog-archive-org-5806 25 43 of of IN blog-archive-org-5806 25 44 that that DT blog-archive-org-5806 25 45 good good JJ blog-archive-org-5806 25 46 , , , blog-archive-org-5806 25 47 useful useful JJ blog-archive-org-5806 25 48 info info NN blog-archive-org-5806 25 49 is be VBZ blog-archive-org-5806 25 50 lost lose VBN blog-archive-org-5806 25 51 forever forever RB blog-archive-org-5806 25 52 . . . blog-archive-org-5806 26 1 Perhaps perhaps RB blog-archive-org-5806 26 2 giving give VBG blog-archive-org-5806 26 3 more more RBR blog-archive-org-5806 26 4 advanced advanced JJ blog-archive-org-5806 26 5 users user NNS blog-archive-org-5806 26 6 a a DT blog-archive-org-5806 26 7 means means NN blog-archive-org-5806 26 8 of of IN blog-archive-org-5806 26 9 over over RB blog-archive-org-5806 26 10 - - HYPH blog-archive-org-5806 26 11 riding ride VBG blog-archive-org-5806 26 12 robots.txt robots.txt NN blog-archive-org-5806 26 13 on on IN blog-archive-org-5806 26 14 a a DT blog-archive-org-5806 26 15 per per IN blog-archive-org-5806 26 16 - - HYPH blog-archive-org-5806 26 17 save save NN blog-archive-org-5806 26 18 and and CC blog-archive-org-5806 26 19 per per IN blog-archive-org-5806 26 20 - - HYPH blog-archive-org-5806 26 21 read read VBN blog-archive-org-5806 26 22 basis basis NN blog-archive-org-5806 26 23 while while IN blog-archive-org-5806 26 24 still still RB blog-archive-org-5806 26 25 keeping keep VBG blog-archive-org-5806 26 26 the the DT blog-archive-org-5806 26 27 default default NN blog-archive-org-5806 26 28 behaviors behavior NNS blog-archive-org-5806 26 29 active active JJ blog-archive-org-5806 26 30 for for IN blog-archive-org-5806 26 31 general general JJ blog-archive-org-5806 26 32 use use NN blog-archive-org-5806 26 33 , , , blog-archive-org-5806 26 34 might may MD blog-archive-org-5806 26 35 be be VB blog-archive-org-5806 26 36 a a DT blog-archive-org-5806 26 37 compromise compromise NN blog-archive-org-5806 26 38 that that WDT blog-archive-org-5806 26 39 satisfies satisfy VBZ blog-archive-org-5806 26 40 the the DT blog-archive-org-5806 26 41 needs need NNS blog-archive-org-5806 26 42 of of IN blog-archive-org-5806 26 43 dutiful dutiful JJ blog-archive-org-5806 26 44 archivers archiver NNS blog-archive-org-5806 26 45 , , , blog-archive-org-5806 26 46 general general JJ blog-archive-org-5806 26 47 users user NNS blog-archive-org-5806 26 48 and and CC blog-archive-org-5806 26 49 webmasters webmaster NNS blog-archive-org-5806 26 50 . . . blog-archive-org-5806 27 1 Something something NN blog-archive-org-5806 27 2 like like IN blog-archive-org-5806 27 3 a a DT blog-archive-org-5806 27 4 URL url NN blog-archive-org-5806 27 5 modification modification NN blog-archive-org-5806 27 6 could could MD blog-archive-org-5806 27 7 be be VB blog-archive-org-5806 27 8 used use VBN blog-archive-org-5806 27 9 to to TO blog-archive-org-5806 27 10 do do VB blog-archive-org-5806 27 11 the the DT blog-archive-org-5806 27 12 trick trick NN blog-archive-org-5806 27 13 ( ( -LRB- blog-archive-org-5806 27 14 this this DT blog-archive-org-5806 27 15 used use VBN blog-archive-org-5806 27 16 to to TO blog-archive-org-5806 27 17 work work VB blog-archive-org-5806 27 18 in in IN blog-archive-org-5806 27 19 the the DT blog-archive-org-5806 27 20 past past NN blog-archive-org-5806 27 21 until until IN blog-archive-org-5806 27 22 this this DT blog-archive-org-5806 27 23 handy handy JJ blog-archive-org-5806 27 24 undocumented undocumented JJ blog-archive-org-5806 27 25 functionality functionality NN blog-archive-org-5806 27 26 was be VBD blog-archive-org-5806 27 27 removed remove VBN blog-archive-org-5806 27 28 ) ) -RRB- blog-archive-org-5806 27 29 . . . blog-archive-org-5806 28 1 eg eg XX blog-archive-org-5806 28 2 : : : blog-archive-org-5806 28 3 Additions addition NNS blog-archive-org-5806 28 4 of of IN blog-archive-org-5806 28 5 varying vary VBG blog-archive-org-5806 28 6 numbers number NNS blog-archive-org-5806 28 7 of of IN blog-archive-org-5806 28 8 “ " `` blog-archive-org-5806 28 9 . . . blog-archive-org-5806 28 10 ” " '' blog-archive-org-5806 28 11 in in IN blog-archive-org-5806 28 12 the the DT blog-archive-org-5806 28 13 right right JJ blog-archive-org-5806 28 14 parts part NNS blog-archive-org-5806 28 15 of of IN blog-archive-org-5806 28 16 a a DT blog-archive-org-5806 28 17 URL url NN blog-archive-org-5806 28 18 used use VBN blog-archive-org-5806 28 19 to to TO blog-archive-org-5806 28 20 work work VB blog-archive-org-5806 28 21 nicely nicely RB blog-archive-org-5806 28 22 for for IN blog-archive-org-5806 28 23 saves save NNS blog-archive-org-5806 28 24 and and CC blog-archive-org-5806 28 25 reads read NNS blog-archive-org-5806 28 26 , , , blog-archive-org-5806 28 27 until until IN blog-archive-org-5806 28 28 fairly fairly RB blog-archive-org-5806 28 29 recently recently RB blog-archive-org-5806 28 30 . . . blog-archive-org-5806 29 1 There there EX blog-archive-org-5806 29 2 ’s ’ VBZ blog-archive-org-5806 29 3 not not RB blog-archive-org-5806 29 4 much much JJ blog-archive-org-5806 29 5 point point NN blog-archive-org-5806 29 6 in in IN blog-archive-org-5806 29 7 us -PRON- PRP blog-archive-org-5806 29 8 ‘ ' `` blog-archive-org-5806 29 9 saving save VBG blog-archive-org-5806 29 10 the the DT blog-archive-org-5806 29 11 web web NN blog-archive-org-5806 29 12 ’ ' '' blog-archive-org-5806 29 13 if if IN blog-archive-org-5806 29 14 we -PRON- PRP blog-archive-org-5806 29 15 human human JJ blog-archive-org-5806 29 16 beings being NNS blog-archive-org-5806 29 17 can can MD blog-archive-org-5806 29 18 not not RB blog-archive-org-5806 29 19 access access VB blog-archive-org-5806 29 20 the the DT blog-archive-org-5806 29 21 archives archive NNS blog-archive-org-5806 29 22 because because IN blog-archive-org-5806 29 23 of of IN blog-archive-org-5806 29 24 our -PRON- PRP$ blog-archive-org-5806 29 25 robot[s.txt robot[s.txt NNP blog-archive-org-5806 29 26 ] ] -RRB- blog-archive-org-5806 29 27 overlords overlord NNS blog-archive-org-5806 29 28 ! ! . blog-archive-org-5806 30 1 https://web.archive.org/web/https://u.cubeupload.com/ZkJ7hq.gif https://web.archive.org/web/https://u.cubeupload.com/zkj7hq.gif ADD blog-archive-org-5806 30 2 🙂 🙂 NNP blog-archive-org-5806 30 3 Shannon Shannon NNP blog-archive-org-5806 30 4 April April NNP blog-archive-org-5806 30 5 18 18 CD blog-archive-org-5806 30 6 , , , blog-archive-org-5806 30 7 2017 2017 CD blog-archive-org-5806 30 8 at at IN blog-archive-org-5806 30 9 4:22 4:22 CD blog-archive-org-5806 30 10 pm pm NN blog-archive-org-5806 30 11 Yay Yay NNP blog-archive-org-5806 30 12 ! ! . blog-archive-org-5806 31 1 Sites site NNS blog-archive-org-5806 31 2 that that WDT blog-archive-org-5806 31 3 have have VBP blog-archive-org-5806 31 4 retroactively retroactively RB blog-archive-org-5806 31 5 changed change VBN blog-archive-org-5806 31 6 their -PRON- PRP$ blog-archive-org-5806 31 7 robots.txt robots.txt NNS blog-archive-org-5806 31 8 have have VBP blog-archive-org-5806 31 9 caused cause VBN blog-archive-org-5806 31 10 me -PRON- PRP blog-archive-org-5806 31 11 a a DT blog-archive-org-5806 31 12 * * NN blog-archive-org-5806 31 13 lot lot NN blog-archive-org-5806 31 14 * * NFP blog-archive-org-5806 31 15 of of IN blog-archive-org-5806 31 16 problems problem NNS blog-archive-org-5806 31 17 for for IN blog-archive-org-5806 31 18 ( ( -LRB- blog-archive-org-5806 31 19 recent recent JJ blog-archive-org-5806 31 20 ) ) -RRB- blog-archive-org-5806 31 21 historical historical JJ blog-archive-org-5806 31 22 research research NN blog-archive-org-5806 31 23 . . . blog-archive-org-5806 32 1 The the DT blog-archive-org-5806 32 2 info info NN blog-archive-org-5806 32 3 is be VBZ blog-archive-org-5806 32 4 often often RB blog-archive-org-5806 32 5 still still RB blog-archive-org-5806 32 6 out out RB blog-archive-org-5806 32 7 there there RB blog-archive-org-5806 32 8 , , , blog-archive-org-5806 32 9 but but CC blog-archive-org-5806 32 10 it -PRON- PRP blog-archive-org-5806 32 11 can can MD blog-archive-org-5806 32 12 take take VB blog-archive-org-5806 32 13 additional additional JJ blog-archive-org-5806 32 14 hours hour NNS blog-archive-org-5806 32 15 to to TO blog-archive-org-5806 32 16 find find VB blog-archive-org-5806 32 17 it -PRON- PRP blog-archive-org-5806 32 18 . . . blog-archive-org-5806 33 1 And and CC blog-archive-org-5806 33 2 sometimes sometimes RB blog-archive-org-5806 33 3 it -PRON- PRP blog-archive-org-5806 33 4 ’s ’ VBZ blog-archive-org-5806 33 5 just just RB blog-archive-org-5806 33 6 gone go VBN blog-archive-org-5806 33 7 instead instead RB blog-archive-org-5806 33 8 . . . blog-archive-org-5806 34 1 It -PRON- PRP blog-archive-org-5806 34 2 never never RB blog-archive-org-5806 34 3 made make VBD blog-archive-org-5806 34 4 any any DT blog-archive-org-5806 34 5 sense sense NN blog-archive-org-5806 34 6 to to TO blog-archive-org-5806 34 7 block block VB blog-archive-org-5806 34 8 access access NN blog-archive-org-5806 34 9 to to IN blog-archive-org-5806 34 10 the the DT blog-archive-org-5806 34 11 archives archive NNS blog-archive-org-5806 34 12 today today NN blog-archive-org-5806 34 13 when when WRB blog-archive-org-5806 34 14 the the DT blog-archive-org-5806 34 15 sites site NNS blog-archive-org-5806 34 16 had have VBD blog-archive-org-5806 34 17 allowed allow VBN blog-archive-org-5806 34 18 your -PRON- PRP$ blog-archive-org-5806 34 19 crawling crawling NN blog-archive-org-5806 34 20 yesterday yesterday NN blog-archive-org-5806 34 21 . . . blog-archive-org-5806 35 1 Adam Adam NNP blog-archive-org-5806 35 2 April April NNP blog-archive-org-5806 35 3 19 19 CD blog-archive-org-5806 35 4 , , , blog-archive-org-5806 35 5 2017 2017 CD blog-archive-org-5806 35 6 at at IN blog-archive-org-5806 35 7 12:55 12:55 CD blog-archive-org-5806 35 8 pm pm NN blog-archive-org-5806 35 9 There there EX blog-archive-org-5806 35 10 is be VBZ blog-archive-org-5806 35 11 another another DT blog-archive-org-5806 35 12 problem problem NN blog-archive-org-5806 35 13 with with IN blog-archive-org-5806 35 14 robots.txt robots.txt NN blog-archive-org-5806 35 15 that that IN blog-archive-org-5806 35 16 everyone everyone NN blog-archive-org-5806 35 17 on on IN blog-archive-org-5806 35 18 here here RB blog-archive-org-5806 35 19 should should MD blog-archive-org-5806 35 20 know know VB blog-archive-org-5806 35 21 . . . blog-archive-org-5806 36 1 There there EX blog-archive-org-5806 36 2 are be VBP blog-archive-org-5806 36 3 2 2 CD blog-archive-org-5806 36 4 ways way NNS blog-archive-org-5806 36 5 that that WDT blog-archive-org-5806 36 6 archive archive NN blog-archive-org-5806 36 7 could could MD blog-archive-org-5806 36 8 accidently accidently RB blog-archive-org-5806 36 9 be be VB blog-archive-org-5806 36 10 removed remove VBN blog-archive-org-5806 36 11 : : : blog-archive-org-5806 36 12 -If -If NNP blog-archive-org-5806 36 13 a a DT blog-archive-org-5806 36 14 website website NN blog-archive-org-5806 36 15 goes go VBZ blog-archive-org-5806 36 16 dead dead JJ blog-archive-org-5806 36 17 , , , blog-archive-org-5806 36 18 and and CC blog-archive-org-5806 36 19 a a DT blog-archive-org-5806 36 20 different different JJ blog-archive-org-5806 36 21 web web NN blog-archive-org-5806 36 22 owner owner NN blog-archive-org-5806 36 23 opens open VBZ blog-archive-org-5806 36 24 up up RP blog-archive-org-5806 36 25 his -PRON- PRP$ blog-archive-org-5806 36 26 / / SYM blog-archive-org-5806 36 27 her -PRON- PRP$ blog-archive-org-5806 36 28 website website NN blog-archive-org-5806 36 29 with with IN blog-archive-org-5806 36 30 the the DT blog-archive-org-5806 36 31 same same JJ blog-archive-org-5806 36 32 URL url NN blog-archive-org-5806 36 33 as as IN blog-archive-org-5806 36 34 the the DT blog-archive-org-5806 36 35 dead dead JJ blog-archive-org-5806 36 36 one one NN blog-archive-org-5806 36 37 with with IN blog-archive-org-5806 36 38 robots.txt robots.txt NN blog-archive-org-5806 36 39 , , , blog-archive-org-5806 36 40 the the DT blog-archive-org-5806 36 41 entire entire JJ blog-archive-org-5806 36 42 archive archive NN blog-archive-org-5806 36 43 , , , blog-archive-org-5806 36 44 including include VBG blog-archive-org-5806 36 45 the the DT blog-archive-org-5806 36 46 dead dead JJ blog-archive-org-5806 36 47 website website NN blog-archive-org-5806 36 48 , , , blog-archive-org-5806 36 49 will will MD blog-archive-org-5806 36 50 be be VB blog-archive-org-5806 36 51 removed remove VBN blog-archive-org-5806 36 52 . . . blog-archive-org-5806 37 1 Even even RB blog-archive-org-5806 37 2 if if IN blog-archive-org-5806 37 3 the the DT blog-archive-org-5806 37 4 new new JJ blog-archive-org-5806 37 5 owner owner NN blog-archive-org-5806 37 6 has have VBZ blog-archive-org-5806 37 7 nothing nothing NN blog-archive-org-5806 37 8 to to TO blog-archive-org-5806 37 9 own own VB blog-archive-org-5806 37 10 on on IN blog-archive-org-5806 37 11 the the DT blog-archive-org-5806 37 12 previous previous JJ blog-archive-org-5806 37 13 website website NN blog-archive-org-5806 37 14 . . . blog-archive-org-5806 38 1 -If -If : blog-archive-org-5806 38 2 a a DT blog-archive-org-5806 38 3 site site NN blog-archive-org-5806 38 4 gets get VBZ blog-archive-org-5806 38 5 hacked hack VBN blog-archive-org-5806 38 6 to to TO blog-archive-org-5806 38 7 have have VB blog-archive-org-5806 38 8 robots.txt robots.txt NNS blog-archive-org-5806 38 9 , , , blog-archive-org-5806 38 10 the the DT blog-archive-org-5806 38 11 same same JJ blog-archive-org-5806 38 12 thing thing NN blog-archive-org-5806 38 13 happened happen VBD blog-archive-org-5806 38 14 as as IN blog-archive-org-5806 38 15 above above RB blog-archive-org-5806 38 16 . . . blog-archive-org-5806 39 1 Web web NN blog-archive-org-5806 39 2 archive archive NN blog-archive-org-5806 39 3 should should MD blog-archive-org-5806 39 4 change change VB blog-archive-org-5806 39 5 their -PRON- PRP$ blog-archive-org-5806 39 6 system system NN blog-archive-org-5806 39 7 so so IN blog-archive-org-5806 39 8 that that IN blog-archive-org-5806 39 9 the the DT blog-archive-org-5806 39 10 machine machine NN blog-archive-org-5806 39 11 that that WDT blog-archive-org-5806 39 12 checks check VBZ blog-archive-org-5806 39 13 robots.txt robots.txt NNP blog-archive-org-5806 39 14 would would MD blog-archive-org-5806 39 15 not not RB blog-archive-org-5806 39 16 remove remove VB blog-archive-org-5806 39 17 already already RB blog-archive-org-5806 39 18 - - HYPH blog-archive-org-5806 39 19 archived archive VBN blog-archive-org-5806 39 20 pages page NNS blog-archive-org-5806 39 21 , , , blog-archive-org-5806 39 22 only only RB blog-archive-org-5806 39 23 disable disable VBP blog-archive-org-5806 39 24 the the DT blog-archive-org-5806 39 25 process process NN blog-archive-org-5806 39 26 of of IN blog-archive-org-5806 39 27 archiving archive VBG blog-archive-org-5806 39 28 of of IN blog-archive-org-5806 39 29 the the DT blog-archive-org-5806 39 30 page page NN blog-archive-org-5806 39 31 after after IN blog-archive-org-5806 39 32 robots.txt robots.txt CD blog-archive-org-5806 39 33 is be VBZ blog-archive-org-5806 39 34 established establish VBN blog-archive-org-5806 39 35 . . . blog-archive-org-5806 40 1 To to TO blog-archive-org-5806 40 2 remove remove VB blog-archive-org-5806 40 3 all all DT blog-archive-org-5806 40 4 history history NN blog-archive-org-5806 40 5 , , , blog-archive-org-5806 40 6 would would MD blog-archive-org-5806 40 7 require require VB blog-archive-org-5806 40 8 to to TO blog-archive-org-5806 40 9 talk talk VB blog-archive-org-5806 40 10 to to IN blog-archive-org-5806 40 11 archive.org archive.org NNP blog-archive-org-5806 40 12 to to IN blog-archive-org-5806 40 13 “ " `` blog-archive-org-5806 40 14 flag flag NN blog-archive-org-5806 40 15 ” " '' blog-archive-org-5806 40 16 that that WDT blog-archive-org-5806 40 17 site site NN blog-archive-org-5806 40 18 so so IN blog-archive-org-5806 40 19 that that IN blog-archive-org-5806 40 20 users user NNS blog-archive-org-5806 40 21 can can MD blog-archive-org-5806 40 22 not not RB blog-archive-org-5806 40 23 archive archive VB blog-archive-org-5806 40 24 it -PRON- PRP blog-archive-org-5806 40 25 . . . blog-archive-org-5806 41 1 Also also RB blog-archive-org-5806 41 2 have have VB blog-archive-org-5806 41 3 a a DT blog-archive-org-5806 41 4 protection protection NN blog-archive-org-5806 41 5 so so IN blog-archive-org-5806 41 6 that that IN blog-archive-org-5806 41 7 if if IN blog-archive-org-5806 41 8 web web NN blog-archive-org-5806 41 9 owners owner NNS blog-archive-org-5806 41 10 tries try VBZ blog-archive-org-5806 41 11 to to TO blog-archive-org-5806 41 12 remove remove VB blog-archive-org-5806 41 13 history history NN blog-archive-org-5806 41 14 that that WDT blog-archive-org-5806 41 15 is be VBZ blog-archive-org-5806 41 16 n’t not RB blog-archive-org-5806 41 17 theirs theirs JJ blog-archive-org-5806 41 18 , , , blog-archive-org-5806 41 19 would would MD blog-archive-org-5806 41 20 deny deny VB blog-archive-org-5806 41 21 them -PRON- PRP blog-archive-org-5806 41 22 ( ( -LRB- blog-archive-org-5806 41 23 they -PRON- PRP blog-archive-org-5806 41 24 are be VBP blog-archive-org-5806 41 25 required require VBN blog-archive-org-5806 41 26 to to TO blog-archive-org-5806 41 27 show show VB blog-archive-org-5806 41 28 proof proof NN blog-archive-org-5806 41 29 of of IN blog-archive-org-5806 41 30 it -PRON- PRP blog-archive-org-5806 41 31 ) ) -RRB- blog-archive-org-5806 41 32 from from IN blog-archive-org-5806 41 33 deleting delete VBG blog-archive-org-5806 41 34 the the DT blog-archive-org-5806 41 35 dead dead JJ blog-archive-org-5806 41 36 site site NN blog-archive-org-5806 41 37 . . . blog-archive-org-5806 42 1 Please please UH blog-archive-org-5806 42 2 let let VB blog-archive-org-5806 42 3 me -PRON- PRP blog-archive-org-5806 42 4 know know VB blog-archive-org-5806 42 5 by by IN blog-archive-org-5806 42 6 sending send VBG blog-archive-org-5806 42 7 an an DT blog-archive-org-5806 42 8 email email NN blog-archive-org-5806 42 9 to to IN blog-archive-org-5806 42 10 Adomsyik@gmail.com Adomsyik@gmail.com NNP blog-archive-org-5806 42 11 . . . blog-archive-org-5806 43 1 MKKLSDKLS MKKLSDKLS NNP blog-archive-org-5806 43 2 April April NNP blog-archive-org-5806 43 3 19 19 CD blog-archive-org-5806 43 4 , , , blog-archive-org-5806 43 5 2017 2017 CD blog-archive-org-5806 43 6 at at IN blog-archive-org-5806 43 7 9:16 9:16 CD blog-archive-org-5806 43 8 pm pm NN blog-archive-org-5806 43 9 As as IN blog-archive-org-5806 43 10 someone someone NN blog-archive-org-5806 43 11 who who WP blog-archive-org-5806 43 12 has have VBZ blog-archive-org-5806 43 13 seen see VBN blog-archive-org-5806 43 14 many many JJ blog-archive-org-5806 43 15 good good JJ blog-archive-org-5806 43 16 website website NN blog-archive-org-5806 43 17 be be VB blog-archive-org-5806 43 18 “ " `` blog-archive-org-5806 43 19 park park NN blog-archive-org-5806 43 20 - - HYPH blog-archive-org-5806 43 21 nuked nuke VBN blog-archive-org-5806 43 22 ” " '' blog-archive-org-5806 43 23 and and CC blog-archive-org-5806 43 24 kicked kick VBD blog-archive-org-5806 43 25 out out IN blog-archive-org-5806 43 26 of of IN blog-archive-org-5806 43 27 the the DT blog-archive-org-5806 43 28 publicly publicly RB blog-archive-org-5806 43 29 accessible accessible JJ blog-archive-org-5806 43 30 Archive Archive NNP blog-archive-org-5806 43 31 , , , blog-archive-org-5806 43 32 I -PRON- PRP blog-archive-org-5806 43 33 beg beg VBP blog-archive-org-5806 43 34 you -PRON- PRP blog-archive-org-5806 43 35 people people NNS blog-archive-org-5806 43 36 to to TO blog-archive-org-5806 43 37 ignore ignore VB blog-archive-org-5806 43 38 the the DT blog-archive-org-5806 43 39 parked parked JJ blog-archive-org-5806 43 40 website website NN blog-archive-org-5806 43 41 robots.txt robots.txt NN blog-archive-org-5806 43 42 ’s ’s POS blog-archive-org-5806 43 43 wishes wish NNS blog-archive-org-5806 43 44 . . . blog-archive-org-5806 44 1 If if IN blog-archive-org-5806 44 2 we -PRON- PRP blog-archive-org-5806 44 3 really really RB blog-archive-org-5806 44 4 want want VBP blog-archive-org-5806 44 5 to to TO blog-archive-org-5806 44 6 archive archive VB blog-archive-org-5806 44 7 the the DT blog-archive-org-5806 44 8 web web NN blog-archive-org-5806 44 9 , , , blog-archive-org-5806 44 10 people people NNS blog-archive-org-5806 44 11 who who WP blog-archive-org-5806 44 12 have have VBP blog-archive-org-5806 44 13 literally literally RB blog-archive-org-5806 44 14 no no DT blog-archive-org-5806 44 15 relation relation NN blog-archive-org-5806 44 16 to to IN blog-archive-org-5806 44 17 the the DT blog-archive-org-5806 44 18 previous previous JJ blog-archive-org-5806 44 19 website website NN blog-archive-org-5806 44 20 beyond beyond IN blog-archive-org-5806 44 21 usurping usurp VBG blog-archive-org-5806 44 22 the the DT blog-archive-org-5806 44 23 previous previous JJ blog-archive-org-5806 44 24 name name NN blog-archive-org-5806 44 25 via via IN blog-archive-org-5806 44 26 domain domain NN blog-archive-org-5806 44 27 - - HYPH blog-archive-org-5806 44 28 squatting squat VBG blog-archive-org-5806 44 29 should should MD blog-archive-org-5806 44 30 have have VB blog-archive-org-5806 44 31 no no DT blog-archive-org-5806 44 32 say say NN blog-archive-org-5806 44 33 in in IN blog-archive-org-5806 44 34 what what WP blog-archive-org-5806 44 35 is be VBZ blog-archive-org-5806 44 36 archived archive VBN blog-archive-org-5806 44 37 . . . blog-archive-org-5806 45 1 Andy Andy NNP blog-archive-org-5806 45 2 L L NNP blog-archive-org-5806 45 3 April April NNP blog-archive-org-5806 45 4 20 20 CD blog-archive-org-5806 45 5 , , , blog-archive-org-5806 45 6 2017 2017 CD blog-archive-org-5806 45 7 at at IN blog-archive-org-5806 45 8 6:56 6:56 CD blog-archive-org-5806 45 9 pm pm NN blog-archive-org-5806 45 10 I -PRON- PRP blog-archive-org-5806 45 11 ’m be VBP blog-archive-org-5806 45 12 happy happy JJ blog-archive-org-5806 45 13 to to TO blog-archive-org-5806 45 14 hear hear VB blog-archive-org-5806 45 15 about about IN blog-archive-org-5806 45 16 this this DT blog-archive-org-5806 45 17 change change NN blog-archive-org-5806 45 18 . . . blog-archive-org-5806 46 1 I -PRON- PRP blog-archive-org-5806 46 2 ’ve have VB blog-archive-org-5806 46 3 always always RB blog-archive-org-5806 46 4 thought think VBN blog-archive-org-5806 46 5 it -PRON- PRP blog-archive-org-5806 46 6 was be VBD blog-archive-org-5806 46 7 a a DT blog-archive-org-5806 46 8 shame shame NN blog-archive-org-5806 46 9 that that WDT blog-archive-org-5806 46 10 changes change VBZ blog-archive-org-5806 46 11 to to IN blog-archive-org-5806 46 12 the the DT blog-archive-org-5806 46 13 modern modern JJ blog-archive-org-5806 46 14 robot.txt robot.txt `` blog-archive-org-5806 46 15 files file NNS blog-archive-org-5806 46 16 are be VBP blog-archive-org-5806 46 17 able able JJ blog-archive-org-5806 46 18 to to TO blog-archive-org-5806 46 19 reach reach VB blog-archive-org-5806 46 20 back back RB blog-archive-org-5806 46 21 in in IN blog-archive-org-5806 46 22 time time NN blog-archive-org-5806 46 23 and and CC blog-archive-org-5806 46 24 scrub scrub VBD blog-archive-org-5806 46 25 the the DT blog-archive-org-5806 46 26 site site NN blog-archive-org-5806 46 27 from from IN blog-archive-org-5806 46 28 existence existence NN blog-archive-org-5806 46 29 . . . blog-archive-org-5806 47 1 I -PRON- PRP blog-archive-org-5806 47 2 guess guess VBP blog-archive-org-5806 47 3 I -PRON- PRP blog-archive-org-5806 47 4 understand understand VBP blog-archive-org-5806 47 5 why why WRB blog-archive-org-5806 47 6 that that DT blog-archive-org-5806 47 7 policy policy NN blog-archive-org-5806 47 8 was be VBD blog-archive-org-5806 47 9 put put VBN blog-archive-org-5806 47 10 into into IN blog-archive-org-5806 47 11 place place NN blog-archive-org-5806 47 12 , , , blog-archive-org-5806 47 13 but but CC blog-archive-org-5806 47 14 it -PRON- PRP blog-archive-org-5806 47 15 does do VBZ blog-archive-org-5806 47 16 n’t not RB blog-archive-org-5806 47 17 seem seem VB blog-archive-org-5806 47 18 to to TO blog-archive-org-5806 47 19 make make VB blog-archive-org-5806 47 20 sense sense NN blog-archive-org-5806 47 21 long long JJ blog-archive-org-5806 47 22 term term NN blog-archive-org-5806 47 23 . . . blog-archive-org-5806 48 1 For for IN blog-archive-org-5806 48 2 a a DT blog-archive-org-5806 48 3 convenient convenient JJ blog-archive-org-5806 48 4 domain domain NN blog-archive-org-5806 48 5 , , , blog-archive-org-5806 48 6 its -PRON- PRP$ blog-archive-org-5806 48 7 current current JJ blog-archive-org-5806 48 8 website website NN blog-archive-org-5806 48 9 and and CC blog-archive-org-5806 48 10 owner owner NN blog-archive-org-5806 48 11 might may MD blog-archive-org-5806 48 12 be be VB blog-archive-org-5806 48 13 completely completely RB blog-archive-org-5806 48 14 unrelated unrelated JJ blog-archive-org-5806 48 15 to to IN blog-archive-org-5806 48 16 the the DT blog-archive-org-5806 48 17 historic historic JJ blog-archive-org-5806 48 18 page page NN blog-archive-org-5806 48 19 that that WDT blog-archive-org-5806 48 20 was be VBD blog-archive-org-5806 48 21 there there RB blog-archive-org-5806 48 22 before before RB blog-archive-org-5806 48 23 . . . blog-archive-org-5806 49 1 Georgene Georgene NNP blog-archive-org-5806 49 2 Uddin Uddin NNP blog-archive-org-5806 49 3 April April NNP blog-archive-org-5806 49 4 20 20 CD blog-archive-org-5806 49 5 , , , blog-archive-org-5806 49 6 2017 2017 CD blog-archive-org-5806 49 7 at at IN blog-archive-org-5806 49 8 7:26 7:26 CD blog-archive-org-5806 49 9 pm pm NN blog-archive-org-5806 49 10 Hey hey UH blog-archive-org-5806 49 11 There there RB blog-archive-org-5806 49 12 . . . blog-archive-org-5806 50 1 I -PRON- PRP blog-archive-org-5806 50 2 discovered discover VBD blog-archive-org-5806 50 3 your -PRON- PRP$ blog-archive-org-5806 50 4 weblog weblog NN blog-archive-org-5806 50 5 the the DT blog-archive-org-5806 50 6 usage usage NN blog-archive-org-5806 50 7 of of IN blog-archive-org-5806 50 8 msn msn NNP blog-archive-org-5806 50 9 . . . blog-archive-org-5806 51 1 That that DT blog-archive-org-5806 51 2 is be VBZ blog-archive-org-5806 51 3 an an DT blog-archive-org-5806 51 4 extremely extremely RB blog-archive-org-5806 51 5 well well RB blog-archive-org-5806 51 6 written write VBN blog-archive-org-5806 51 7 article article NN blog-archive-org-5806 51 8 . . . blog-archive-org-5806 52 1 I -PRON- PRP blog-archive-org-5806 52 2 ’ll will MD blog-archive-org-5806 52 3 make make VB blog-archive-org-5806 52 4 sure sure JJ blog-archive-org-5806 52 5 to to TO blog-archive-org-5806 52 6 bookmark bookmark VB blog-archive-org-5806 52 7 it -PRON- PRP blog-archive-org-5806 52 8 and and CC blog-archive-org-5806 52 9 come come VB blog-archive-org-5806 52 10 back back RB blog-archive-org-5806 52 11 to to TO blog-archive-org-5806 52 12 read read VB blog-archive-org-5806 52 13 extra extra JJ blog-archive-org-5806 52 14 of of IN blog-archive-org-5806 52 15 your -PRON- PRP$ blog-archive-org-5806 52 16 useful useful JJ blog-archive-org-5806 52 17 information information NN blog-archive-org-5806 52 18 . . . blog-archive-org-5806 53 1 Thank thank VBP blog-archive-org-5806 53 2 you -PRON- PRP blog-archive-org-5806 53 3 for for IN blog-archive-org-5806 53 4 the the DT blog-archive-org-5806 53 5 post post NN blog-archive-org-5806 53 6 . . . blog-archive-org-5806 54 1 I -PRON- PRP blog-archive-org-5806 54 2 ’ll will MD blog-archive-org-5806 54 3 definitely definitely RB blog-archive-org-5806 54 4 return.| return.| VB blog-archive-org-5806 54 5 posty posty JJ blog-archive-org-5806 54 6 April April NNP blog-archive-org-5806 54 7 21 21 CD blog-archive-org-5806 54 8 , , , blog-archive-org-5806 54 9 2017 2017 CD blog-archive-org-5806 54 10 at at IN blog-archive-org-5806 54 11 8:20 8:20 CD blog-archive-org-5806 54 12 am be VBP blog-archive-org-5806 54 13 Could Could MD blog-archive-org-5806 54 14 we -PRON- PRP blog-archive-org-5806 54 15 expand expand VB blog-archive-org-5806 54 16 this this DT blog-archive-org-5806 54 17 to to IN blog-archive-org-5806 54 18 more more JJR blog-archive-org-5806 54 19 than than IN blog-archive-org-5806 54 20 just just RB blog-archive-org-5806 54 21 US US NNP blog-archive-org-5806 54 22 government government NN blog-archive-org-5806 54 23 websites website NNS blog-archive-org-5806 54 24 ? ? . blog-archive-org-5806 55 1 Australian australian JJ blog-archive-org-5806 55 2 government government NN blog-archive-org-5806 55 3 websites website NNS blog-archive-org-5806 55 4 do do VBP blog-archive-org-5806 55 5 this this DT blog-archive-org-5806 55 6 too too RB blog-archive-org-5806 55 7 . . . blog-archive-org-5806 56 1 eg eg NNP blog-archive-org-5806 56 2 : : : blog-archive-org-5806 56 3 http://operational.humanservices.gov.au/robots.txt http://operational.humanservices.gov.au/robots.txt NN blog-archive-org-5806 56 4 that that DT blog-archive-org-5806 56 5 website website NN blog-archive-org-5806 56 6 clearly clearly RB blog-archive-org-5806 56 7 details detail VBZ blog-archive-org-5806 56 8 how how WRB blog-archive-org-5806 56 9 our -PRON- PRP$ blog-archive-org-5806 56 10 governments government NNS blog-archive-org-5806 56 11 social social JJ blog-archive-org-5806 56 12 security security NN blog-archive-org-5806 56 13 system system NN blog-archive-org-5806 56 14 works work VBZ blog-archive-org-5806 56 15 , , , blog-archive-org-5806 56 16 which which WDT blog-archive-org-5806 56 17 changes change VBZ blog-archive-org-5806 56 18 and and CC blog-archive-org-5806 56 19 leaves leave VBZ blog-archive-org-5806 56 20 the the DT blog-archive-org-5806 56 21 public public NN blog-archive-org-5806 56 22 at at IN blog-archive-org-5806 56 23 a a DT blog-archive-org-5806 56 24 disadvantage disadvantage NN blog-archive-org-5806 56 25 . . . blog-archive-org-5806 57 1 Mark Mark NNP blog-archive-org-5806 57 2 Graham Graham NNP blog-archive-org-5806 57 3 Post Post NNP blog-archive-org-5806 57 4 authorApril authorApril NNP blog-archive-org-5806 57 5 25 25 CD blog-archive-org-5806 57 6 , , , blog-archive-org-5806 57 7 2017 2017 CD blog-archive-org-5806 57 8 at at IN blog-archive-org-5806 57 9 6:48 6:48 CD blog-archive-org-5806 57 10 pm pm NN blog-archive-org-5806 57 11 Yes yes UH blog-archive-org-5806 57 12 , , , blog-archive-org-5806 57 13 in in IN blog-archive-org-5806 57 14 general general JJ blog-archive-org-5806 57 15 terms term NNS blog-archive-org-5806 57 16 we -PRON- PRP blog-archive-org-5806 57 17 think think VBP blog-archive-org-5806 57 18 information information NN blog-archive-org-5806 57 19 produced produce VBN blog-archive-org-5806 57 20 by by IN blog-archive-org-5806 57 21 governments government NNS blog-archive-org-5806 57 22 around around IN blog-archive-org-5806 57 23 the the DT blog-archive-org-5806 57 24 world world NN blog-archive-org-5806 57 25 , , , blog-archive-org-5806 57 26 and and CC blog-archive-org-5806 57 27 published publish VBN blog-archive-org-5806 57 28 via via IN blog-archive-org-5806 57 29 public public JJ blog-archive-org-5806 57 30 websites website NNS blog-archive-org-5806 57 31 , , , blog-archive-org-5806 57 32 should should MD blog-archive-org-5806 57 33 be be VB blog-archive-org-5806 57 34 preserved preserve VBN blog-archive-org-5806 57 35 and and CC blog-archive-org-5806 57 36 made make VBN blog-archive-org-5806 57 37 available available JJ blog-archive-org-5806 57 38 via via IN blog-archive-org-5806 57 39 the the DT blog-archive-org-5806 57 40 Wayback Wayback NNP blog-archive-org-5806 57 41 Machine Machine NNP blog-archive-org-5806 57 42 . . . blog-archive-org-5806 58 1 Andre Andre NNP blog-archive-org-5806 58 2 Borie Borie NNP blog-archive-org-5806 58 3 April April NNP blog-archive-org-5806 58 4 21 21 CD blog-archive-org-5806 58 5 , , , blog-archive-org-5806 58 6 2017 2017 CD blog-archive-org-5806 58 7 at at IN blog-archive-org-5806 58 8 10:20 10:20 CD blog-archive-org-5806 58 9 am be VBP blog-archive-org-5806 58 10 I -PRON- PRP blog-archive-org-5806 58 11 really really RB blog-archive-org-5806 58 12 do do VBP blog-archive-org-5806 58 13 n’t not RB blog-archive-org-5806 58 14 see see VB blog-archive-org-5806 58 15 any any DT blog-archive-org-5806 58 16 problem problem NN blog-archive-org-5806 58 17 with with IN blog-archive-org-5806 58 18 this this DT blog-archive-org-5806 58 19 – – : blog-archive-org-5806 58 20 if if IN blog-archive-org-5806 58 21 a a DT blog-archive-org-5806 58 22 human human NN blog-archive-org-5806 58 23 can can MD blog-archive-org-5806 58 24 access access VB blog-archive-org-5806 58 25 it -PRON- PRP blog-archive-org-5806 58 26 , , , blog-archive-org-5806 58 27 so so RB blog-archive-org-5806 58 28 should should MD blog-archive-org-5806 58 29 the the DT blog-archive-org-5806 58 30 archive archive NN blog-archive-org-5806 58 31 be be VB blog-archive-org-5806 58 32 able able JJ blog-archive-org-5806 58 33 to to TO blog-archive-org-5806 58 34 – – : blog-archive-org-5806 58 35 anyone anyone NN blog-archive-org-5806 58 36 who who WP blog-archive-org-5806 58 37 does do VBZ blog-archive-org-5806 58 38 n’t not RB blog-archive-org-5806 58 39 want want VB blog-archive-org-5806 58 40 their -PRON- PRP$ blog-archive-org-5806 58 41 stuff stuff NN blog-archive-org-5806 58 42 being be VBG blog-archive-org-5806 58 43 searchable searchable JJ blog-archive-org-5806 58 44 / / SYM blog-archive-org-5806 58 45 archived archive VBN blog-archive-org-5806 58 46 online online RB blog-archive-org-5806 58 47 should should MD blog-archive-org-5806 58 48 just just RB blog-archive-org-5806 58 49 put put VB blog-archive-org-5806 58 50 a a DT blog-archive-org-5806 58 51 password password NN blog-archive-org-5806 58 52 on on IN blog-archive-org-5806 58 53 it -PRON- PRP blog-archive-org-5806 58 54 . . . blog-archive-org-5806 59 1 The the DT blog-archive-org-5806 59 2 only only JJ blog-archive-org-5806 59 3 good good JJ blog-archive-org-5806 59 4 thing thing NN blog-archive-org-5806 59 5 about about RB blog-archive-org-5806 59 6 robots.txt robots.txt CD blog-archive-org-5806 59 7 is be VBZ blog-archive-org-5806 59 8 the the DT blog-archive-org-5806 59 9 rate rate NN blog-archive-org-5806 59 10 - - HYPH blog-archive-org-5806 59 11 limiting limiting NN blog-archive-org-5806 59 12 , , , blog-archive-org-5806 59 13 so so RB blog-archive-org-5806 59 14 smaller small JJR blog-archive-org-5806 59 15 sites site NNS blog-archive-org-5806 59 16 can can MD blog-archive-org-5806 59 17 limit limit VB blog-archive-org-5806 59 18 the the DT blog-archive-org-5806 59 19 bandwidth bandwidth NN blog-archive-org-5806 59 20 allocated allocate VBN blog-archive-org-5806 59 21 to to IN blog-archive-org-5806 59 22 crawling crawl VBG blog-archive-org-5806 59 23 if if IN blog-archive-org-5806 59 24 they -PRON- PRP blog-archive-org-5806 59 25 wish wish VBP blog-archive-org-5806 59 26 . . . blog-archive-org-5806 60 1 By by IN blog-archive-org-5806 60 2 the the DT blog-archive-org-5806 60 3 way way NN blog-archive-org-5806 60 4 , , , blog-archive-org-5806 60 5 what what WP blog-archive-org-5806 60 6 does do VBZ blog-archive-org-5806 60 7 this this DT blog-archive-org-5806 60 8 mean mean VB blog-archive-org-5806 60 9 for for IN blog-archive-org-5806 60 10 previously previously RB blog-archive-org-5806 60 11 - - HYPH blog-archive-org-5806 60 12 archived archive VBN blog-archive-org-5806 60 13 sites site NNS blog-archive-org-5806 60 14 that that WDT blog-archive-org-5806 60 15 now now RB blog-archive-org-5806 60 16 changed change VBD blog-archive-org-5806 60 17 their -PRON- PRP$ blog-archive-org-5806 60 18 robots.txt robots.txt NN blog-archive-org-5806 60 19 to to TO blog-archive-org-5806 60 20 block block VB blog-archive-org-5806 60 21 the the DT blog-archive-org-5806 60 22 Archive Archive NNP blog-archive-org-5806 60 23 ? ? . blog-archive-org-5806 61 1 Do do VBP blog-archive-org-5806 61 2 you -PRON- PRP blog-archive-org-5806 61 3 still still RB blog-archive-org-5806 61 4 keep keep VB blog-archive-org-5806 61 5 the the DT blog-archive-org-5806 61 6 original original JJ blog-archive-org-5806 61 7 data datum NNS blog-archive-org-5806 61 8 , , , blog-archive-org-5806 61 9 and and CC blog-archive-org-5806 61 10 in in IN blog-archive-org-5806 61 11 which which WDT blog-archive-org-5806 61 12 case case NN blog-archive-org-5806 61 13 , , , blog-archive-org-5806 61 14 would would MD blog-archive-org-5806 61 15 you -PRON- PRP blog-archive-org-5806 61 16 be be VB blog-archive-org-5806 61 17 able able JJ blog-archive-org-5806 61 18 to to TO blog-archive-org-5806 61 19 restore restore VB blog-archive-org-5806 61 20 access access NN blog-archive-org-5806 61 21 to to IN blog-archive-org-5806 61 22 it -PRON- PRP blog-archive-org-5806 61 23 ? ? . blog-archive-org-5806 62 1 I -PRON- PRP blog-archive-org-5806 62 2 ’ve have VB blog-archive-org-5806 62 3 seen see VBN blog-archive-org-5806 62 4 a a DT blog-archive-org-5806 62 5 few few JJ blog-archive-org-5806 62 6 sites site NNS blog-archive-org-5806 62 7 where where WRB blog-archive-org-5806 62 8 they -PRON- PRP blog-archive-org-5806 62 9 used use VBD blog-archive-org-5806 62 10 to to TO blog-archive-org-5806 62 11 be be VB blog-archive-org-5806 62 12 accessible accessible JJ blog-archive-org-5806 62 13 on on IN blog-archive-org-5806 62 14 the the DT blog-archive-org-5806 62 15 Wayback Wayback NNP blog-archive-org-5806 62 16 machine machine NN blog-archive-org-5806 62 17 but but CC blog-archive-org-5806 62 18 are be VBP blog-archive-org-5806 62 19 not not RB blog-archive-org-5806 62 20 anymore anymore RB blog-archive-org-5806 62 21 due due JJ blog-archive-org-5806 62 22 to to IN blog-archive-org-5806 62 23 a a DT blog-archive-org-5806 62 24 recent recent JJ blog-archive-org-5806 62 25 robots.txt robots.txt NN blog-archive-org-5806 62 26 change change NN blog-archive-org-5806 62 27 , , , blog-archive-org-5806 62 28 and and CC blog-archive-org-5806 62 29 I -PRON- PRP blog-archive-org-5806 62 30 ’d ’d , blog-archive-org-5806 62 31 love love VB blog-archive-org-5806 62 32 to to TO blog-archive-org-5806 62 33 see see VB blog-archive-org-5806 62 34 them -PRON- PRP blog-archive-org-5806 62 35 available available JJ blog-archive-org-5806 62 36 again again RB blog-archive-org-5806 62 37 if if IN blog-archive-org-5806 62 38 the the DT blog-archive-org-5806 62 39 original original JJ blog-archive-org-5806 62 40 data datum NNS blog-archive-org-5806 62 41 was be VBD blog-archive-org-5806 62 42 n’t not RB blog-archive-org-5806 62 43 deleted delete VBN blog-archive-org-5806 62 44 . . . blog-archive-org-5806 63 1 Jim Jim NNP blog-archive-org-5806 63 2 Moores Moores NNP blog-archive-org-5806 63 3 April April NNP blog-archive-org-5806 63 4 21 21 CD blog-archive-org-5806 63 5 , , , blog-archive-org-5806 63 6 2017 2017 CD blog-archive-org-5806 63 7 at at IN blog-archive-org-5806 63 8 11:40 11:40 CD blog-archive-org-5806 63 9 am be VBP blog-archive-org-5806 63 10 I -PRON- PRP blog-archive-org-5806 63 11 ’ve have VB blog-archive-org-5806 63 12 found find VBN blog-archive-org-5806 63 13 that that IN blog-archive-org-5806 63 14 I -PRON- PRP blog-archive-org-5806 63 15 ca can MD blog-archive-org-5806 63 16 n’t not RB blog-archive-org-5806 63 17 access access VB blog-archive-org-5806 63 18 archive archive JJ blog-archive-org-5806 63 19 material material NN blog-archive-org-5806 63 20 that that WDT blog-archive-org-5806 63 21 I -PRON- PRP blog-archive-org-5806 63 22 myself -PRON- PRP blog-archive-org-5806 63 23 created create VBD blog-archive-org-5806 63 24 because because IN blog-archive-org-5806 63 25 I -PRON- PRP blog-archive-org-5806 63 26 let let VBD blog-archive-org-5806 63 27 a a DT blog-archive-org-5806 63 28 domain domain NN blog-archive-org-5806 63 29 I -PRON- PRP blog-archive-org-5806 63 30 was be VBD blog-archive-org-5806 63 31 no no RB blog-archive-org-5806 63 32 longer long RBR blog-archive-org-5806 63 33 using use VBG blog-archive-org-5806 63 34 expire expire NN blog-archive-org-5806 63 35 and and CC blog-archive-org-5806 63 36 now now RB blog-archive-org-5806 63 37 it -PRON- PRP blog-archive-org-5806 63 38 has have VBZ blog-archive-org-5806 63 39 a a DT blog-archive-org-5806 63 40 non non JJ blog-archive-org-5806 63 41 - - JJ blog-archive-org-5806 63 42 permissive permissive JJ blog-archive-org-5806 63 43 robots.txt robots.txt NN blog-archive-org-5806 63 44 . . . blog-archive-org-5806 64 1 At at IN blog-archive-org-5806 64 2 a a DT blog-archive-org-5806 64 3 minimum minimum NN blog-archive-org-5806 64 4 archive.org archive.org NN blog-archive-org-5806 64 5 needs need VBZ blog-archive-org-5806 64 6 to to TO blog-archive-org-5806 64 7 respect respect VB blog-archive-org-5806 64 8 the the DT blog-archive-org-5806 64 9 robots.txt robots.txt NN blog-archive-org-5806 64 10 only only RB blog-archive-org-5806 64 11 at at IN blog-archive-org-5806 64 12 the the DT blog-archive-org-5806 64 13 point point NN blog-archive-org-5806 64 14 of of IN blog-archive-org-5806 64 15 collection collection NN blog-archive-org-5806 64 16 , , , blog-archive-org-5806 64 17 but but CC blog-archive-org-5806 64 18 my -PRON- PRP$ blog-archive-org-5806 64 19 personal personal JJ blog-archive-org-5806 64 20 opinion opinion NN blog-archive-org-5806 64 21 is be VBZ blog-archive-org-5806 64 22 that that IN blog-archive-org-5806 64 23 it -PRON- PRP blog-archive-org-5806 64 24 should should MD blog-archive-org-5806 64 25 be be VB blog-archive-org-5806 64 26 ignored ignore VBN blog-archive-org-5806 64 27 completely completely RB blog-archive-org-5806 64 28 by by IN blog-archive-org-5806 64 29 archive.org archive.org CD blog-archive-org-5806 64 30 and and CC blog-archive-org-5806 64 31 allow allow VB blog-archive-org-5806 64 32 people people NNS blog-archive-org-5806 64 33 to to TO blog-archive-org-5806 64 34 actively actively RB blog-archive-org-5806 64 35 opt opt VB blog-archive-org-5806 64 36 out out RP blog-archive-org-5806 64 37 in in IN blog-archive-org-5806 64 38 some some DT blog-archive-org-5806 64 39 other other JJ blog-archive-org-5806 64 40 way way NN blog-archive-org-5806 64 41 . . . blog-archive-org-5806 65 1 Mo Mo NNP blog-archive-org-5806 65 2 April April NNP blog-archive-org-5806 65 3 21 21 CD blog-archive-org-5806 65 4 , , , blog-archive-org-5806 65 5 2017 2017 CD blog-archive-org-5806 65 6 at at IN blog-archive-org-5806 65 7 2:35 2:35 CD blog-archive-org-5806 65 8 pm pm NN blog-archive-org-5806 65 9 In in IN blog-archive-org-5806 65 10 my -PRON- PRP$ blog-archive-org-5806 65 11 case case NN blog-archive-org-5806 65 12 I -PRON- PRP blog-archive-org-5806 65 13 was be VBD blog-archive-org-5806 65 14 trying try VBG blog-archive-org-5806 65 15 to to TO blog-archive-org-5806 65 16 retrieve retrieve VB blog-archive-org-5806 65 17 an an DT blog-archive-org-5806 65 18 old old JJ blog-archive-org-5806 65 19 web web NN blog-archive-org-5806 65 20 site site NN blog-archive-org-5806 65 21 of of IN blog-archive-org-5806 65 22 mine -PRON- PRP blog-archive-org-5806 65 23 A a DT blog-archive-org-5806 65 24 cybersquatter cybersquatter NN blog-archive-org-5806 65 25 later later RB blog-archive-org-5806 65 26 bought buy VBD blog-archive-org-5806 65 27 the the DT blog-archive-org-5806 65 28 domain domain NN blog-archive-org-5806 65 29 and and CC blog-archive-org-5806 65 30 put put VB blog-archive-org-5806 65 31 up up RP blog-archive-org-5806 65 32 a a DT blog-archive-org-5806 65 33 robits.txt robits.txt NN blog-archive-org-5806 65 34 Now now RB blog-archive-org-5806 65 35 I -PRON- PRP blog-archive-org-5806 65 36 ca can MD blog-archive-org-5806 65 37 n’t not RB blog-archive-org-5806 65 38 see see VB blog-archive-org-5806 65 39 my -PRON- PRP$ blog-archive-org-5806 65 40 own own JJ blog-archive-org-5806 65 41 site site NN blog-archive-org-5806 65 42 The the DT blog-archive-org-5806 65 43 archive archive NN blog-archive-org-5806 65 44 respects respect VBZ blog-archive-org-5806 65 45 a a DT blog-archive-org-5806 65 46 new new JJ blog-archive-org-5806 65 47 robots.txt robots.txt NN blog-archive-org-5806 65 48 file file NN blog-archive-org-5806 65 49 iwned iwne VBN blog-archive-org-5806 65 50 by by IN blog-archive-org-5806 65 51 a a DT blog-archive-org-5806 65 52 squtter squtter NN blog-archive-org-5806 65 53 who who WP blog-archive-org-5806 65 54 is be VBZ blog-archive-org-5806 65 55 effectively effectively RB blog-archive-org-5806 65 56 blocking block VBG blog-archive-org-5806 65 57 a a DT blog-archive-org-5806 65 58 historical historical JJ blog-archive-org-5806 65 59 archive archive NN blog-archive-org-5806 65 60 they -PRON- PRP blog-archive-org-5806 65 61 had have VBD blog-archive-org-5806 65 62 NOTHING nothing NN blog-archive-org-5806 65 63 to to TO blog-archive-org-5806 65 64 do do VB blog-archive-org-5806 65 65 with with IN blog-archive-org-5806 65 66 . . . blog-archive-org-5806 66 1 That that DT blog-archive-org-5806 66 2 is be VBZ blog-archive-org-5806 66 3 INSANE insane JJ blog-archive-org-5806 66 4 . . . blog-archive-org-5806 67 1 Mark Mark NNP blog-archive-org-5806 67 2 Graham Graham NNP blog-archive-org-5806 67 3 Post Post NNP blog-archive-org-5806 67 4 authorApril authorApril NNP blog-archive-org-5806 67 5 25 25 CD blog-archive-org-5806 67 6 , , , blog-archive-org-5806 67 7 2017 2017 CD blog-archive-org-5806 67 8 at at IN blog-archive-org-5806 67 9 6:46 6:46 CD blog-archive-org-5806 67 10 pm pm NN blog-archive-org-5806 67 11 Thank thank VBP blog-archive-org-5806 67 12 you -PRON- PRP blog-archive-org-5806 67 13 Mo. Mo. NNP blog-archive-org-5806 68 1 People People NNS blog-archive-org-5806 68 2 write write VBP blog-archive-org-5806 68 3 to to IN blog-archive-org-5806 68 4 us -PRON- PRP blog-archive-org-5806 68 5 about about IN blog-archive-org-5806 68 6 the the DT blog-archive-org-5806 68 7 situation situation NN blog-archive-org-5806 68 8 you -PRON- PRP blog-archive-org-5806 68 9 describe describe VBP blog-archive-org-5806 68 10 every every DT blog-archive-org-5806 68 11 day day NN blog-archive-org-5806 68 12 . . . blog-archive-org-5806 69 1 In in IN blog-archive-org-5806 69 2 many many JJ blog-archive-org-5806 69 3 cases case NNS blog-archive-org-5806 69 4 they -PRON- PRP blog-archive-org-5806 69 5 implore implore VBP blog-archive-org-5806 69 6 us -PRON- PRP blog-archive-org-5806 69 7 to to TO blog-archive-org-5806 69 8 make make VB blog-archive-org-5806 69 9 their -PRON- PRP$ blog-archive-org-5806 69 10 content content NN blog-archive-org-5806 69 11 available available JJ blog-archive-org-5806 69 12 again again RB blog-archive-org-5806 69 13 . . . blog-archive-org-5806 70 1 This this DT blog-archive-org-5806 70 2 is be VBZ blog-archive-org-5806 70 3 exactly exactly RB blog-archive-org-5806 70 4 the the DT blog-archive-org-5806 70 5 harm harm NN blog-archive-org-5806 70 6 we -PRON- PRP blog-archive-org-5806 70 7 wish wish VBP blog-archive-org-5806 70 8 to to TO blog-archive-org-5806 70 9 address address VB blog-archive-org-5806 70 10 here here RB blog-archive-org-5806 70 11 . . . blog-archive-org-5806 71 1 And and CC blog-archive-org-5806 71 2 , , , blog-archive-org-5806 71 3 everyone everyone NN blog-archive-org-5806 71 4 , , , blog-archive-org-5806 71 5 please please UH blog-archive-org-5806 71 6 remember remember VB blog-archive-org-5806 71 7 you -PRON- PRP blog-archive-org-5806 71 8 can can MD blog-archive-org-5806 71 9 always always RB blog-archive-org-5806 71 10 write write VB blog-archive-org-5806 71 11 to to IN blog-archive-org-5806 71 12 info@archive.org info@archive.org PRP blog-archive-org-5806 71 13 if if IN blog-archive-org-5806 71 14 you -PRON- PRP blog-archive-org-5806 71 15 would would MD blog-archive-org-5806 71 16 like like VB blog-archive-org-5806 71 17 us -PRON- PRP blog-archive-org-5806 71 18 to to TO blog-archive-org-5806 71 19 not not RB blog-archive-org-5806 71 20 crawl crawl VB blog-archive-org-5806 71 21 your -PRON- PRP$ blog-archive-org-5806 71 22 site site NN blog-archive-org-5806 71 23 . . . blog-archive-org-5806 72 1 Ryan Ryan NNP blog-archive-org-5806 72 2 April April NNP blog-archive-org-5806 72 3 21 21 CD blog-archive-org-5806 72 4 , , , blog-archive-org-5806 72 5 2017 2017 CD blog-archive-org-5806 72 6 at at IN blog-archive-org-5806 72 7 10:06 10:06 CD blog-archive-org-5806 72 8 pm pm NN blog-archive-org-5806 72 9 Just just RB blog-archive-org-5806 72 10 this this DT blog-archive-org-5806 72 11 morning morning NN blog-archive-org-5806 72 12 ia_archiver ia_archiver NNP blog-archive-org-5806 72 13 submitted submit VBD blog-archive-org-5806 72 14 a a DT blog-archive-org-5806 72 15 form form NN blog-archive-org-5806 72 16 on on IN blog-archive-org-5806 72 17 my -PRON- PRP$ blog-archive-org-5806 72 18 site site NN blog-archive-org-5806 72 19 ( ( -LRB- blog-archive-org-5806 72 20 the the DT blog-archive-org-5806 72 21 form form NN blog-archive-org-5806 72 22 was be VBD blog-archive-org-5806 72 23 blank blank JJ blog-archive-org-5806 72 24 , , , blog-archive-org-5806 72 25 but but CC blog-archive-org-5806 72 26 the the DT blog-archive-org-5806 72 27 point point NN blog-archive-org-5806 72 28 is be VBZ blog-archive-org-5806 72 29 that that IN blog-archive-org-5806 72 30 it -PRON- PRP blog-archive-org-5806 72 31 clicked click VBD blog-archive-org-5806 72 32 submit submit NN blog-archive-org-5806 72 33 ) ) -RRB- blog-archive-org-5806 72 34 . . . blog-archive-org-5806 73 1 Any any DT blog-archive-org-5806 73 2 crawler crawler NN blog-archive-org-5806 73 3 that that WDT blog-archive-org-5806 73 4 submits submit VBZ blog-archive-org-5806 73 5 forms form NNS blog-archive-org-5806 73 6 is be VBZ blog-archive-org-5806 73 7 a a DT blog-archive-org-5806 73 8 jerk jerk NNP blog-archive-org-5806 73 9 crawler crawler NN blog-archive-org-5806 73 10 . . . blog-archive-org-5806 74 1 Would Would MD blog-archive-org-5806 74 2 you -PRON- PRP blog-archive-org-5806 74 3 consider consider VB blog-archive-org-5806 74 4 redesigning redesign VBG blog-archive-org-5806 74 5 your -PRON- PRP$ blog-archive-org-5806 74 6 crawler crawler NN blog-archive-org-5806 74 7 to to TO blog-archive-org-5806 74 8 be be VB blog-archive-org-5806 74 9 less less RBR blog-archive-org-5806 74 10 offensive offensive JJ blog-archive-org-5806 74 11 ? ? . blog-archive-org-5806 75 1 Mark Mark NNP blog-archive-org-5806 75 2 Graham Graham NNP blog-archive-org-5806 75 3 Post Post NNP blog-archive-org-5806 75 4 authorApril authorApril NNP blog-archive-org-5806 75 5 25 25 CD blog-archive-org-5806 75 6 , , , blog-archive-org-5806 75 7 2017 2017 CD blog-archive-org-5806 75 8 at at IN blog-archive-org-5806 75 9 6:42 6:42 CD blog-archive-org-5806 75 10 pm pm NN blog-archive-org-5806 75 11 The the DT blog-archive-org-5806 75 12 “ " `` blog-archive-org-5806 75 13 ia_archiver ia_archiver NN blog-archive-org-5806 75 14 ” " '' blog-archive-org-5806 75 15 User User NNP blog-archive-org-5806 75 16 Agent Agent NNP blog-archive-org-5806 75 17 is be VBZ blog-archive-org-5806 75 18 used use VBN blog-archive-org-5806 75 19 by by IN blog-archive-org-5806 75 20 Alexa Alexa NNP blog-archive-org-5806 75 21 Internet Internet NNP blog-archive-org-5806 75 22 , , , blog-archive-org-5806 75 23 not not RB blog-archive-org-5806 75 24 the the DT blog-archive-org-5806 75 25 Internet Internet NNP blog-archive-org-5806 75 26 Archive Archive NNP blog-archive-org-5806 75 27 . . . blog-archive-org-5806 76 1 Henrik Henrik NNP blog-archive-org-5806 76 2 April April NNP blog-archive-org-5806 76 3 23 23 CD blog-archive-org-5806 76 4 , , , blog-archive-org-5806 76 5 2017 2017 CD blog-archive-org-5806 76 6 at at IN blog-archive-org-5806 76 7 9:54 9:54 CD blog-archive-org-5806 76 8 am am NN blog-archive-org-5806 76 9 On on IN blog-archive-org-5806 76 10 tools.ietf.org tools.ietf.org NN blog-archive-org-5806 76 11 , , , blog-archive-org-5806 76 12 all all PDT blog-archive-org-5806 76 13 the the DT blog-archive-org-5806 76 14 information information NN blog-archive-org-5806 76 15 is be VBZ blog-archive-org-5806 76 16 public public JJ blog-archive-org-5806 76 17 . . . blog-archive-org-5806 77 1 I -PRON- PRP blog-archive-org-5806 77 2 use use VBP blog-archive-org-5806 77 3 robots.txt robots.txt NN blog-archive-org-5806 77 4 primarily primarily RB blog-archive-org-5806 77 5 to to TO blog-archive-org-5806 77 6 steer steer VB blog-archive-org-5806 77 7 web web NN blog-archive-org-5806 77 8 crawlers crawler NNS blog-archive-org-5806 77 9 away away RB blog-archive-org-5806 77 10 from from IN blog-archive-org-5806 77 11 pages page NNS blog-archive-org-5806 77 12 which which WDT blog-archive-org-5806 77 13 require require VBP blog-archive-org-5806 77 14 substantial substantial JJ blog-archive-org-5806 77 15 CPU CPU NNP blog-archive-org-5806 77 16 resources resource NNS blog-archive-org-5806 77 17 to to TO blog-archive-org-5806 77 18 generate generate VB blog-archive-org-5806 77 19 . . . blog-archive-org-5806 78 1 Background background NN blog-archive-org-5806 78 2 : : : blog-archive-org-5806 78 3 tools.ietf.org tools.ietf.org NN blog-archive-org-5806 78 4 has have VBZ blog-archive-org-5806 78 5 been be VBN blog-archive-org-5806 78 6 a a DT blog-archive-org-5806 78 7 pro pro JJ blog-archive-org-5806 78 8 - - JJ blog-archive-org-5806 78 9 bono bono JJ blog-archive-org-5806 78 10 activity activity NN blog-archive-org-5806 78 11 for for IN blog-archive-org-5806 78 12 15 15 CD blog-archive-org-5806 78 13 years year NNS blog-archive-org-5806 78 14 , , , blog-archive-org-5806 78 15 and and CC blog-archive-org-5806 78 16 runs run VBZ blog-archive-org-5806 78 17 on on IN blog-archive-org-5806 78 18 donated donate VBN blog-archive-org-5806 78 19 hardware hardware NN blog-archive-org-5806 78 20 ; ; : blog-archive-org-5806 78 21 I -PRON- PRP blog-archive-org-5806 78 22 do do VBP blog-archive-org-5806 78 23 n’t not RB blog-archive-org-5806 78 24 have have VB blog-archive-org-5806 78 25 the the DT blog-archive-org-5806 78 26 means mean NNS blog-archive-org-5806 78 27 to to TO blog-archive-org-5806 78 28 upgrade upgrade VB blog-archive-org-5806 78 29 to to IN blog-archive-org-5806 78 30 a a DT blog-archive-org-5806 78 31 level level NN blog-archive-org-5806 78 32 of of IN blog-archive-org-5806 78 33 CPU cpu NN blog-archive-org-5806 78 34 resources resource NNS blog-archive-org-5806 78 35 to to TO blog-archive-org-5806 78 36 be be VB blog-archive-org-5806 78 37 able able JJ blog-archive-org-5806 78 38 to to TO blog-archive-org-5806 78 39 serve serve VB blog-archive-org-5806 78 40 generated generate VBN blog-archive-org-5806 78 41 pages page NNS blog-archive-org-5806 78 42 at at IN blog-archive-org-5806 78 43 the the DT blog-archive-org-5806 78 44 rate rate NN blog-archive-org-5806 78 45 the the DT blog-archive-org-5806 78 46 searchbots searchbot NNS blog-archive-org-5806 78 47 can can MD blog-archive-org-5806 78 48 hit hit VB blog-archive-org-5806 78 49 them -PRON- PRP blog-archive-org-5806 78 50 . . . blog-archive-org-5806 79 1 The the DT blog-archive-org-5806 79 2 pages page NNS blog-archive-org-5806 79 3 I -PRON- PRP blog-archive-org-5806 79 4 steer steer VBP blog-archive-org-5806 79 5 robots robot NNS blog-archive-org-5806 79 6 away away RB blog-archive-org-5806 79 7 from from IN blog-archive-org-5806 79 8 are be VBP blog-archive-org-5806 79 9 for for IN blog-archive-org-5806 79 10 instance instance NN blog-archive-org-5806 79 11 source source NN blog-archive-org-5806 79 12 repository repository NN blog-archive-org-5806 79 13 diffs diff NNS blog-archive-org-5806 79 14 , , , blog-archive-org-5806 79 15 logs log NNS blog-archive-org-5806 79 16 , , , blog-archive-org-5806 79 17 commits commit VBZ blog-archive-org-5806 79 18 etc etc FW blog-archive-org-5806 79 19 . . . blog-archive-org-5806 79 20 , , , blog-archive-org-5806 79 21 served serve VBD blog-archive-org-5806 79 22 through through IN blog-archive-org-5806 79 23 Trac Trac NNP blog-archive-org-5806 79 24 . . . blog-archive-org-5806 80 1 If if IN blog-archive-org-5806 80 2 a a DT blog-archive-org-5806 80 3 crawler crawler NN blog-archive-org-5806 80 4 is be VBZ blog-archive-org-5806 80 5 sufficiently sufficiently RB blog-archive-org-5806 80 6 gentle gentle JJ blog-archive-org-5806 80 7 , , , blog-archive-org-5806 80 8 and and CC blog-archive-org-5806 80 9 is be VBZ blog-archive-org-5806 80 10 able able JJ blog-archive-org-5806 80 11 to to TO blog-archive-org-5806 80 12 back back VB blog-archive-org-5806 80 13 down down RP blog-archive-org-5806 80 14 the the DT blog-archive-org-5806 80 15 rate rate NN blog-archive-org-5806 80 16 of of IN blog-archive-org-5806 80 17 crawl crawl NN blog-archive-org-5806 80 18 if if IN blog-archive-org-5806 80 19 the the DT blog-archive-org-5806 80 20 time time NN blog-archive-org-5806 80 21 to to TO blog-archive-org-5806 80 22 serve serve VB blog-archive-org-5806 80 23 pages page NNS blog-archive-org-5806 80 24 is be VBZ blog-archive-org-5806 80 25 long long JJ blog-archive-org-5806 80 26 or or CC blog-archive-org-5806 80 27 go go VB blog-archive-org-5806 80 28 up up RP blog-archive-org-5806 80 29 , , , blog-archive-org-5806 80 30 I -PRON- PRP blog-archive-org-5806 80 31 ’m be VBP blog-archive-org-5806 80 32 perfectly perfectly RB blog-archive-org-5806 80 33 happy happy JJ blog-archive-org-5806 80 34 to to TO blog-archive-org-5806 80 35 have have VB blog-archive-org-5806 80 36 all all DT blog-archive-org-5806 80 37 of of IN blog-archive-org-5806 80 38 the the DT blog-archive-org-5806 80 39 pages page NNS blog-archive-org-5806 80 40 now now RB blog-archive-org-5806 80 41 denied deny VBN blog-archive-org-5806 80 42 by by IN blog-archive-org-5806 80 43 my -PRON- PRP$ blog-archive-org-5806 80 44 robots.txt robots.txt NN blog-archive-org-5806 80 45 crawled crawled NN blog-archive-org-5806 80 46 . . . blog-archive-org-5806 81 1 Chris Chris NNP blog-archive-org-5806 81 2 April April NNP blog-archive-org-5806 81 3 23 23 CD blog-archive-org-5806 81 4 , , , blog-archive-org-5806 81 5 2017 2017 CD blog-archive-org-5806 81 6 at at IN blog-archive-org-5806 81 7 6:38 6:38 CD blog-archive-org-5806 81 8 pm pm NN blog-archive-org-5806 81 9 I -PRON- PRP blog-archive-org-5806 81 10 ’d ’d NN blog-archive-org-5806 81 11 implore implore VB blog-archive-org-5806 81 12 you -PRON- PRP blog-archive-org-5806 81 13 to to TO blog-archive-org-5806 81 14 consider consider VB blog-archive-org-5806 81 15 recognizing recognize VBG blog-archive-org-5806 81 16 an an DT blog-archive-org-5806 81 17 “ " `` blog-archive-org-5806 81 18 archive.txt”-like archive.txt”-like NN blog-archive-org-5806 81 19 standard standard NN blog-archive-org-5806 81 20 then then RB blog-archive-org-5806 81 21 . . . blog-archive-org-5806 82 1 For for IN blog-archive-org-5806 82 2 people people NNS blog-archive-org-5806 82 3 like like IN blog-archive-org-5806 82 4 myself -PRON- PRP blog-archive-org-5806 82 5 who who WP blog-archive-org-5806 82 6 maintain maintain VBP blog-archive-org-5806 82 7 a a DT blog-archive-org-5806 82 8 personal personal JJ blog-archive-org-5806 82 9 website website NN blog-archive-org-5806 82 10 , , , blog-archive-org-5806 82 11 I -PRON- PRP blog-archive-org-5806 82 12 tend tend VBP blog-archive-org-5806 82 13 to to TO blog-archive-org-5806 82 14 use use VB blog-archive-org-5806 82 15 it -PRON- PRP blog-archive-org-5806 82 16 as as IN blog-archive-org-5806 82 17 a a DT blog-archive-org-5806 82 18 file file NN blog-archive-org-5806 82 19 server server NN blog-archive-org-5806 82 20 and and CC blog-archive-org-5806 82 21 would would MD blog-archive-org-5806 82 22 be be VB blog-archive-org-5806 82 23 quite quite RB blog-archive-org-5806 82 24 annoyed annoy VBN blog-archive-org-5806 82 25 if if IN blog-archive-org-5806 82 26 my -PRON- PRP$ blog-archive-org-5806 82 27 resume resume NN blog-archive-org-5806 82 28 ( ( -LRB- blog-archive-org-5806 82 29 which which WDT blog-archive-org-5806 82 30 contains contain VBZ blog-archive-org-5806 82 31 an an DT blog-archive-org-5806 82 32 email email NN blog-archive-org-5806 82 33 address address NN blog-archive-org-5806 82 34 and and CC blog-archive-org-5806 82 35 contact contact NN blog-archive-org-5806 82 36 phone phone NN blog-archive-org-5806 82 37 number number NN blog-archive-org-5806 82 38 ) ) -RRB- blog-archive-org-5806 82 39 ended end VBD blog-archive-org-5806 82 40 up up RP blog-archive-org-5806 82 41 archived archived JJ blog-archive-org-5806 82 42 . . . blog-archive-org-5806 83 1 The the DT blog-archive-org-5806 83 2 alternative alternative NN blog-archive-org-5806 83 3 would would MD blog-archive-org-5806 83 4 be be VB blog-archive-org-5806 83 5 I -PRON- PRP blog-archive-org-5806 83 6 remove remove VB blog-archive-org-5806 83 7 everything everything NN blog-archive-org-5806 83 8 I -PRON- PRP blog-archive-org-5806 83 9 do do VBP blog-archive-org-5806 83 10 n’t not RB blog-archive-org-5806 83 11 want want VB blog-archive-org-5806 83 12 archived archive VBN blog-archive-org-5806 83 13 . . . blog-archive-org-5806 84 1 I -PRON- PRP blog-archive-org-5806 84 2 do do VBP blog-archive-org-5806 84 3 n’t not RB blog-archive-org-5806 84 4 think think VB blog-archive-org-5806 84 5 that that DT blog-archive-org-5806 84 6 ’s ’ VBZ blog-archive-org-5806 84 7 your -PRON- PRP$ blog-archive-org-5806 84 8 intended intend VBN blog-archive-org-5806 84 9 goal goal NN blog-archive-org-5806 84 10 , , , blog-archive-org-5806 84 11 so so RB blog-archive-org-5806 84 12 please please UH blog-archive-org-5806 84 13 rethink rethink VB blog-archive-org-5806 84 14 this this DT blog-archive-org-5806 84 15 strategy strategy NN blog-archive-org-5806 84 16 . . . blog-archive-org-5806 85 1 Mark Mark NNP blog-archive-org-5806 85 2 Graham Graham NNP blog-archive-org-5806 85 3 Post Post NNP blog-archive-org-5806 85 4 authorApril authorApril NNP blog-archive-org-5806 85 5 25 25 CD blog-archive-org-5806 85 6 , , , blog-archive-org-5806 85 7 2017 2017 CD blog-archive-org-5806 85 8 at at IN blog-archive-org-5806 85 9 6:39 6:39 CD blog-archive-org-5806 85 10 pm pm NN blog-archive-org-5806 85 11 Thank thank VBP blog-archive-org-5806 85 12 you -PRON- PRP blog-archive-org-5806 85 13 for for IN blog-archive-org-5806 85 14 this this DT blog-archive-org-5806 85 15 Chris Chris NNP blog-archive-org-5806 85 16 . . . blog-archive-org-5806 86 1 Please please UH blog-archive-org-5806 86 2 do do VB blog-archive-org-5806 86 3 write write VB blog-archive-org-5806 86 4 to to IN blog-archive-org-5806 86 5 us -PRON- PRP blog-archive-org-5806 86 6 at at IN blog-archive-org-5806 86 7 info@archive.org info@archive.org ADD blog-archive-org-5806 86 8 about about IN blog-archive-org-5806 86 9 any any DT blog-archive-org-5806 86 10 sites site NNS blog-archive-org-5806 86 11 you -PRON- PRP blog-archive-org-5806 86 12 manage manage VBP blog-archive-org-5806 86 13 . . . blog-archive-org-5806 87 1 I -PRON- PRP blog-archive-org-5806 87 2 promise promise VBP blog-archive-org-5806 87 3 we -PRON- PRP blog-archive-org-5806 87 4 will will MD blog-archive-org-5806 87 5 be be VB blog-archive-org-5806 87 6 responsive responsive JJ blog-archive-org-5806 87 7 . . . blog-archive-org-5806 88 1 Ross Ross NNP blog-archive-org-5806 88 2 April April NNP blog-archive-org-5806 88 3 23 23 CD blog-archive-org-5806 88 4 , , , blog-archive-org-5806 88 5 2017 2017 CD blog-archive-org-5806 88 6 at at IN blog-archive-org-5806 88 7 8:13 8:13 CD blog-archive-org-5806 88 8 pm pm NN blog-archive-org-5806 88 9 Internet Internet NNP blog-archive-org-5806 88 10 Archive Archive NNP blog-archive-org-5806 88 11 , , , blog-archive-org-5806 88 12 thank thank VBP blog-archive-org-5806 88 13 you -PRON- PRP blog-archive-org-5806 88 14 for for IN blog-archive-org-5806 88 15 wanting want VBG blog-archive-org-5806 88 16 to to TO blog-archive-org-5806 88 17 archive archive VB blog-archive-org-5806 88 18 the the DT blog-archive-org-5806 88 19 web web NN blog-archive-org-5806 88 20 as as IN blog-archive-org-5806 88 21 users user NNS blog-archive-org-5806 88 22 see see VBP blog-archive-org-5806 88 23 it -PRON- PRP blog-archive-org-5806 88 24 , , , blog-archive-org-5806 88 25 which which WDT blog-archive-org-5806 88 26 is be VBZ blog-archive-org-5806 88 27 the the DT blog-archive-org-5806 88 28 whole whole JJ blog-archive-org-5806 88 29 point point NN blog-archive-org-5806 88 30 of of IN blog-archive-org-5806 88 31 “ " `` blog-archive-org-5806 88 32 Saving save VBG blog-archive-org-5806 88 33 the the DT blog-archive-org-5806 88 34 Web web NN blog-archive-org-5806 88 35 ! ! . blog-archive-org-5806 88 36 ” " '' blog-archive-org-5806 88 37 I -PRON- PRP blog-archive-org-5806 88 38 had have VBD blog-archive-org-5806 88 39 respect respect NN blog-archive-org-5806 88 40 for for IN blog-archive-org-5806 88 41 robots.txt robots.txt CD blog-archive-org-5806 88 42 20 20 CD blog-archive-org-5806 88 43 year year NN blog-archive-org-5806 88 44 ago ago RB blog-archive-org-5806 88 45 , , , blog-archive-org-5806 88 46 but but CC blog-archive-org-5806 88 47 it -PRON- PRP blog-archive-org-5806 88 48 ’s ’ VBZ blog-archive-org-5806 88 49 today today NN blog-archive-org-5806 88 50 clear clear JJ blog-archive-org-5806 88 51 that that IN blog-archive-org-5806 88 52 we -PRON- PRP blog-archive-org-5806 88 53 can can MD blog-archive-org-5806 88 54 not not RB blog-archive-org-5806 88 55 allow allow VB blog-archive-org-5806 88 56 site site NN blog-archive-org-5806 88 57 owners owner NNS blog-archive-org-5806 88 58 to to TO blog-archive-org-5806 88 59 affect affect VB blog-archive-org-5806 88 60 the the DT blog-archive-org-5806 88 61 public public JJ blog-archive-org-5806 88 62 record record NN blog-archive-org-5806 88 63 by by IN blog-archive-org-5806 88 64 their -PRON- PRP$ blog-archive-org-5806 88 65 own own JJ blog-archive-org-5806 88 66 selfish selfish JJ blog-archive-org-5806 88 67 choices choice NNS blog-archive-org-5806 88 68 . . . blog-archive-org-5806 89 1 Stay stay VB blog-archive-org-5806 89 2 the the DT blog-archive-org-5806 89 3 course course NN blog-archive-org-5806 89 4 , , , blog-archive-org-5806 89 5 thanks thank NNS blog-archive-org-5806 89 6 again again RB blog-archive-org-5806 89 7 ! ! . blog-archive-org-5806 90 1 vinz vinz NNP blog-archive-org-5806 90 2 April April NNP blog-archive-org-5806 90 3 24 24 CD blog-archive-org-5806 90 4 , , , blog-archive-org-5806 90 5 2017 2017 CD blog-archive-org-5806 90 6 at at IN blog-archive-org-5806 90 7 2:20 2:20 CD blog-archive-org-5806 90 8 am am NN blog-archive-org-5806 90 9 alas alas NNP blog-archive-org-5806 90 10 , , , blog-archive-org-5806 90 11 this this DT blog-archive-org-5806 90 12 comes come VBZ blog-archive-org-5806 90 13 too too RB blog-archive-org-5806 90 14 late late RB blog-archive-org-5806 90 15 for for IN blog-archive-org-5806 90 16 many many JJ blog-archive-org-5806 90 17 of of IN blog-archive-org-5806 90 18 my -PRON- PRP$ blog-archive-org-5806 90 19 favourite favourite JJ blog-archive-org-5806 90 20 sites site NNS blog-archive-org-5806 90 21 … … NFP blog-archive-org-5806 90 22 .2014 .2014 NFP blog-archive-org-5806 90 23 - - : blog-archive-org-5806 90 24 2015 2015 CD blog-archive-org-5806 90 25 took take VBD blog-archive-org-5806 90 26 out out RP blog-archive-org-5806 90 27 a a DT blog-archive-org-5806 90 28 lot lot NN blog-archive-org-5806 90 29 for for IN blog-archive-org-5806 90 30 some some DT blog-archive-org-5806 90 31 reason reason NN blog-archive-org-5806 90 32 , , , blog-archive-org-5806 90 33 as as IN blog-archive-org-5806 90 34 did do VBD blog-archive-org-5806 90 35 mid-2008 mid-2008 NN blog-archive-org-5806 90 36 I -PRON- PRP blog-archive-org-5806 90 37 guess guess VBP blog-archive-org-5806 90 38 I -PRON- PRP blog-archive-org-5806 90 39 ’ll will MD blog-archive-org-5806 90 40 have have VB blog-archive-org-5806 90 41 to to TO blog-archive-org-5806 90 42 hold hold VB blog-archive-org-5806 90 43 out out RP blog-archive-org-5806 90 44 until until IN blog-archive-org-5806 90 45 computers computer NNS blog-archive-org-5806 90 46 can can MD blog-archive-org-5806 90 47 reconstruct reconstruct VB blog-archive-org-5806 90 48 things thing NNS blog-archive-org-5806 90 49 straight straight RB blog-archive-org-5806 90 50 from from IN blog-archive-org-5806 90 51 memory memory NN blog-archive-org-5806 90 52 then then RB blog-archive-org-5806 90 53 do do VBP blog-archive-org-5806 90 54 a a DT blog-archive-org-5806 90 55 big big JJ blog-archive-org-5806 90 56 ol’ old JJ blog-archive-org-5806 90 57 rip rip NN blog-archive-org-5806 90 58 . . . blog-archive-org-5806 91 1 also also RB blog-archive-org-5806 91 2 wish wish VBP blog-archive-org-5806 91 3 I -PRON- PRP blog-archive-org-5806 91 4 knew know VBD blog-archive-org-5806 91 5 why why WRB blog-archive-org-5806 91 6 it -PRON- PRP blog-archive-org-5806 91 7 does do VBZ blog-archive-org-5806 91 8 n’t not RB blog-archive-org-5806 91 9 save save VB blog-archive-org-5806 91 10 images image NNS blog-archive-org-5806 91 11 properly properly RB blog-archive-org-5806 91 12 sometimes sometimes RB blog-archive-org-5806 91 13 , , , blog-archive-org-5806 91 14 I -PRON- PRP blog-archive-org-5806 91 15 run run VBP blog-archive-org-5806 91 16 into into IN blog-archive-org-5806 91 17 a a DT blog-archive-org-5806 91 18 lot lot NN blog-archive-org-5806 91 19 of of IN blog-archive-org-5806 91 20 those those DT blog-archive-org-5806 91 21 at at IN blog-archive-org-5806 91 22 self self NN blog-archive-org-5806 91 23 - - HYPH blog-archive-org-5806 91 24 hosted host VBN blog-archive-org-5806 91 25 sites site NNS blog-archive-org-5806 91 26 , , , blog-archive-org-5806 91 27 unless unless IN blog-archive-org-5806 91 28 the the DT blog-archive-org-5806 91 29 crawler crawler NN blog-archive-org-5806 91 30 just just RB blog-archive-org-5806 91 31 happened happen VBD blog-archive-org-5806 91 32 to to TO blog-archive-org-5806 91 33 hit hit VB blog-archive-org-5806 91 34 it -PRON- PRP blog-archive-org-5806 91 35 while while IN blog-archive-org-5806 91 36 a a DT blog-archive-org-5806 91 37 file file NN blog-archive-org-5806 91 38 was be VBD blog-archive-org-5806 91 39 broken break VBN blog-archive-org-5806 91 40 . . . blog-archive-org-5806 92 1 Darren Darren NNP blog-archive-org-5806 92 2 Duncan Duncan NNP blog-archive-org-5806 92 3 April April NNP blog-archive-org-5806 92 4 24 24 CD blog-archive-org-5806 92 5 , , , blog-archive-org-5806 92 6 2017 2017 CD blog-archive-org-5806 92 7 at at IN blog-archive-org-5806 92 8 8:50 8:50 CD blog-archive-org-5806 92 9 am am NN blog-archive-org-5806 92 10 This this DT blog-archive-org-5806 92 11 is be VBZ blog-archive-org-5806 92 12 a a DT blog-archive-org-5806 92 13 good good JJ blog-archive-org-5806 92 14 move move NN blog-archive-org-5806 92 15 on on IN blog-archive-org-5806 92 16 the the DT blog-archive-org-5806 92 17 part part NN blog-archive-org-5806 92 18 of of IN blog-archive-org-5806 92 19 the the DT blog-archive-org-5806 92 20 Internet Internet NNP blog-archive-org-5806 92 21 Archive Archive NNP blog-archive-org-5806 92 22 in in IN blog-archive-org-5806 92 23 principle principle NN blog-archive-org-5806 92 24 . . . blog-archive-org-5806 93 1 At at IN blog-archive-org-5806 93 2 the the DT blog-archive-org-5806 93 3 very very RB blog-archive-org-5806 93 4 least least JJS blog-archive-org-5806 93 5 , , , blog-archive-org-5806 93 6 something something NN blog-archive-org-5806 93 7 I -PRON- PRP blog-archive-org-5806 93 8 remember remember VBP blog-archive-org-5806 93 9 requesting request VBG blog-archive-org-5806 93 10 of of IN blog-archive-org-5806 93 11 the the DT blog-archive-org-5806 93 12 Internet Internet NNP blog-archive-org-5806 93 13 Archive Archive NNP blog-archive-org-5806 93 14 years year NNS blog-archive-org-5806 93 15 ago ago RB blog-archive-org-5806 93 16 , , , blog-archive-org-5806 93 17 is be VBZ blog-archive-org-5806 93 18 that that DT blog-archive-org-5806 93 19 any any DT blog-archive-org-5806 93 20 respect respect NN blog-archive-org-5806 93 21 they -PRON- PRP blog-archive-org-5806 93 22 give give VBP blog-archive-org-5806 93 23 robots.txt robots.txt NN blog-archive-org-5806 93 24 should should MD blog-archive-org-5806 93 25 be be VB blog-archive-org-5806 93 26 time time NN blog-archive-org-5806 93 27 sensitive sensitive JJ blog-archive-org-5806 93 28 . . . blog-archive-org-5806 94 1 If if IN blog-archive-org-5806 94 2 a a DT blog-archive-org-5806 94 3 domain domain NN blog-archive-org-5806 94 4 ’s ’s NN blog-archive-org-5806 94 5 robots.txt robots.txt NN blog-archive-org-5806 94 6 allows allow VBZ blog-archive-org-5806 94 7 archiving archive VBG blog-archive-org-5806 94 8 in in IN blog-archive-org-5806 94 9 the the DT blog-archive-org-5806 94 10 present present NN blog-archive-org-5806 94 11 , , , blog-archive-org-5806 94 12 then then RB blog-archive-org-5806 94 13 the the DT blog-archive-org-5806 94 14 Internet internet NN blog-archive-org-5806 94 15 Archive Archive NNP blog-archive-org-5806 94 16 should should MD blog-archive-org-5806 94 17 always always RB blog-archive-org-5806 94 18 make make VB blog-archive-org-5806 94 19 today today NN blog-archive-org-5806 94 20 ’s ’s POS blog-archive-org-5806 94 21 version version NN blog-archive-org-5806 94 22 of of IN blog-archive-org-5806 94 23 that that DT blog-archive-org-5806 94 24 content content NN blog-archive-org-5806 94 25 available available JJ blog-archive-org-5806 94 26 in in IN blog-archive-org-5806 94 27 perpetuity perpetuity NN blog-archive-org-5806 94 28 , , , blog-archive-org-5806 94 29 even even RB blog-archive-org-5806 94 30 if if IN blog-archive-org-5806 94 31 tomorrow tomorrow NN blog-archive-org-5806 94 32 ’s ’s POS blog-archive-org-5806 94 33 robots.txt robots.txt NN blog-archive-org-5806 94 34 for for IN blog-archive-org-5806 94 35 that that DT blog-archive-org-5806 94 36 domain domain NN blog-archive-org-5806 94 37 denies deny VBZ blog-archive-org-5806 94 38 archiving archive VBG blog-archive-org-5806 94 39 . . . blog-archive-org-5806 95 1 I -PRON- PRP blog-archive-org-5806 95 2 would would MD blog-archive-org-5806 95 3 want want VB blog-archive-org-5806 95 4 any any DT blog-archive-org-5806 95 5 website website NN blog-archive-org-5806 95 6 I -PRON- PRP blog-archive-org-5806 95 7 operate operate VBP blog-archive-org-5806 95 8 to to TO blog-archive-org-5806 95 9 be be VB blog-archive-org-5806 95 10 archived archive VBN blog-archive-org-5806 95 11 , , , blog-archive-org-5806 95 12 and and CC blog-archive-org-5806 95 13 if if IN blog-archive-org-5806 95 14 I -PRON- PRP blog-archive-org-5806 95 15 gave give VBD blog-archive-org-5806 95 16 up up RP blog-archive-org-5806 95 17 any any DT blog-archive-org-5806 95 18 of of IN blog-archive-org-5806 95 19 my -PRON- PRP$ blog-archive-org-5806 95 20 domain domain NN blog-archive-org-5806 95 21 names name NNS blog-archive-org-5806 95 22 in in IN blog-archive-org-5806 95 23 the the DT blog-archive-org-5806 95 24 future future NN blog-archive-org-5806 95 25 , , , blog-archive-org-5806 95 26 I -PRON- PRP blog-archive-org-5806 95 27 would would MD blog-archive-org-5806 95 28 not not RB blog-archive-org-5806 95 29 want want VB blog-archive-org-5806 95 30 the the DT blog-archive-org-5806 95 31 future future JJ blog-archive-org-5806 95 32 owners owner NNS blog-archive-org-5806 95 33 of of IN blog-archive-org-5806 95 34 those those DT blog-archive-org-5806 95 35 domain domain NN blog-archive-org-5806 95 36 names name NNS blog-archive-org-5806 95 37 to to TO blog-archive-org-5806 95 38 be be VB blog-archive-org-5806 95 39 able able JJ blog-archive-org-5806 95 40 to to TO blog-archive-org-5806 95 41 cause cause VB blog-archive-org-5806 95 42 the the DT blog-archive-org-5806 95 43 Internet internet NN blog-archive-org-5806 95 44 Archive Archive NNP blog-archive-org-5806 95 45 to to TO blog-archive-org-5806 95 46 stop stop VB blog-archive-org-5806 95 47 displaying display VBG blog-archive-org-5806 95 48 the the DT blog-archive-org-5806 95 49 versions version NNS blog-archive-org-5806 95 50 of of IN blog-archive-org-5806 95 51 the the DT blog-archive-org-5806 95 52 domain domain NN blog-archive-org-5806 95 53 that that WDT blog-archive-org-5806 95 54 existed exist VBD blog-archive-org-5806 95 55 while while IN blog-archive-org-5806 95 56 I -PRON- PRP blog-archive-org-5806 95 57 controlled control VBD blog-archive-org-5806 95 58 it -PRON- PRP blog-archive-org-5806 95 59 . . . blog-archive-org-5806 96 1 Vix Vix NNP blog-archive-org-5806 96 2 April April NNP blog-archive-org-5806 96 3 24 24 CD blog-archive-org-5806 96 4 , , , blog-archive-org-5806 96 5 2017 2017 CD blog-archive-org-5806 96 6 at at IN blog-archive-org-5806 96 7 9:40 9:40 CD blog-archive-org-5806 96 8 am am NN blog-archive-org-5806 96 9 “ " `` blog-archive-org-5806 96 10 Archiving archive VBG blog-archive-org-5806 96 11 relying rely VBG blog-archive-org-5806 96 12 ( ( -LRB- blog-archive-org-5806 96 13 .. .. NFP blog-archive-org-5806 96 14 ) ) -RRB- blog-archive-org-5806 96 15 more more RBR blog-archive-org-5806 96 16 on on IN blog-archive-org-5806 96 17 representing represent VBG blog-archive-org-5806 96 18 the the DT blog-archive-org-5806 96 19 web web NN blog-archive-org-5806 96 20 as as IN blog-archive-org-5806 96 21 it -PRON- PRP blog-archive-org-5806 96 22 really really RB blog-archive-org-5806 96 23 was be VBD blog-archive-org-5806 96 24 , , , blog-archive-org-5806 96 25 and and CC blog-archive-org-5806 96 26 is be VBZ blog-archive-org-5806 96 27 , , , blog-archive-org-5806 96 28 from from IN blog-archive-org-5806 96 29 a a DT blog-archive-org-5806 96 30 user user NN blog-archive-org-5806 96 31 ’s ’s POS blog-archive-org-5806 96 32 perspective perspective NN blog-archive-org-5806 96 33 . . . blog-archive-org-5806 96 34 ” " '' blog-archive-org-5806 96 35 I -PRON- PRP blog-archive-org-5806 96 36 agree agree VBP blog-archive-org-5806 96 37 100 100 CD blog-archive-org-5806 96 38 % % NN blog-archive-org-5806 96 39 . . . blog-archive-org-5806 97 1 Robots.txt Robots.txt NNP blog-archive-org-5806 97 2 are be VBP blog-archive-org-5806 97 3 n’t not RB blog-archive-org-5806 97 4 limiting limit VBG blog-archive-org-5806 97 5 regular regular JJ blog-archive-org-5806 97 6 users user NNS blog-archive-org-5806 97 7 and and CC blog-archive-org-5806 97 8 archiving archive VBG blog-archive-org-5806 97 9 purpose purpose NN blog-archive-org-5806 97 10 is be VBZ blog-archive-org-5806 97 11 to to TO blog-archive-org-5806 97 12 reflect reflect VB blog-archive-org-5806 97 13 the the DT blog-archive-org-5806 97 14 users user NNS blog-archive-org-5806 97 15 ’ ’ POS blog-archive-org-5806 97 16 perspective perspective NN blog-archive-org-5806 97 17 , , , blog-archive-org-5806 97 18 not not RB blog-archive-org-5806 97 19 SEO seo NN blog-archive-org-5806 97 20 crawling crawling NN blog-archive-org-5806 97 21 . . . blog-archive-org-5806 98 1 Go go VB blog-archive-org-5806 98 2 for for IN blog-archive-org-5806 98 3 it -PRON- PRP blog-archive-org-5806 98 4 ! ! . blog-archive-org-5806 99 1 Michael Michael NNP blog-archive-org-5806 99 2 Martinez Martinez NNP blog-archive-org-5806 99 3 April April NNP blog-archive-org-5806 99 4 24 24 CD blog-archive-org-5806 99 5 , , , blog-archive-org-5806 99 6 2017 2017 CD blog-archive-org-5806 99 7 at at IN blog-archive-org-5806 99 8 3:29 3:29 CD blog-archive-org-5806 99 9 pm pm NN blog-archive-org-5806 99 10 If if IN blog-archive-org-5806 99 11 you -PRON- PRP blog-archive-org-5806 99 12 ignore ignore VBP blog-archive-org-5806 99 13 “ " `` blog-archive-org-5806 99 14 robots.txt robots.txt NN blog-archive-org-5806 99 15 ” " '' blog-archive-org-5806 99 16 directives directive VBZ blog-archive-org-5806 99 17 people people NNS blog-archive-org-5806 99 18 will will MD blog-archive-org-5806 99 19 find find VB blog-archive-org-5806 99 20 other other JJ blog-archive-org-5806 99 21 ways way NNS blog-archive-org-5806 99 22 to to TO blog-archive-org-5806 99 23 block block VB blog-archive-org-5806 99 24 you -PRON- PRP blog-archive-org-5806 99 25 . . . blog-archive-org-5806 100 1 While while IN blog-archive-org-5806 100 2 it -PRON- PRP blog-archive-org-5806 100 3 ’s ’ VBZ blog-archive-org-5806 100 4 unfortunate unfortunate JJ blog-archive-org-5806 100 5 that that IN blog-archive-org-5806 100 6 you -PRON- PRP blog-archive-org-5806 100 7 do do VBP blog-archive-org-5806 100 8 n’t not RB blog-archive-org-5806 100 9 keep keep VB blog-archive-org-5806 100 10 data datum NNS blog-archive-org-5806 100 11 live live RB blog-archive-org-5806 100 12 after after IN blog-archive-org-5806 100 13 a a DT blog-archive-org-5806 100 14 “ " `` blog-archive-org-5806 100 15 robots.txt robots.txt NN blog-archive-org-5806 100 16 ” " '' blog-archive-org-5806 100 17 change change NN blog-archive-org-5806 100 18 , , , blog-archive-org-5806 100 19 that that RB blog-archive-org-5806 100 20 is be VBZ blog-archive-org-5806 100 21 your -PRON- PRP$ blog-archive-org-5806 100 22 own own JJ blog-archive-org-5806 100 23 bad bad JJ blog-archive-org-5806 100 24 policy policy NN blog-archive-org-5806 100 25 . . . blog-archive-org-5806 101 1 The the DT blog-archive-org-5806 101 2 Robots Robots NNP blog-archive-org-5806 101 3 Exclusion Exclusion NNP blog-archive-org-5806 101 4 “ " `` blog-archive-org-5806 101 5 standard standard NN blog-archive-org-5806 101 6 ” " '' blog-archive-org-5806 101 7 is be VBZ blog-archive-org-5806 101 8 NOT not RB blog-archive-org-5806 101 9 a a DT blog-archive-org-5806 101 10 standard standard NN blog-archive-org-5806 101 11 , , , blog-archive-org-5806 101 12 it -PRON- PRP blog-archive-org-5806 101 13 ’s ’ VBZ blog-archive-org-5806 101 14 an an DT blog-archive-org-5806 101 15 arbitrary arbitrary JJ blog-archive-org-5806 101 16 and and CC blog-archive-org-5806 101 17 voluntary voluntary JJ blog-archive-org-5806 101 18 set set NN blog-archive-org-5806 101 19 of of IN blog-archive-org-5806 101 20 guidelines guideline NNS blog-archive-org-5806 101 21 . . . blog-archive-org-5806 102 1 No no DT blog-archive-org-5806 102 2 one one NN blog-archive-org-5806 102 3 forced force VBD blog-archive-org-5806 102 4 the the DT blog-archive-org-5806 102 5 archive archive NN blog-archive-org-5806 102 6 to to TO blog-archive-org-5806 102 7 take take VB blog-archive-org-5806 102 8 content content NN blog-archive-org-5806 102 9 offline offline NN blog-archive-org-5806 102 10 after after IN blog-archive-org-5806 102 11 domain domain NN blog-archive-org-5806 102 12 names name NNS blog-archive-org-5806 102 13 changed change VBD blog-archive-org-5806 102 14 hands hand NNS blog-archive-org-5806 102 15 . . . blog-archive-org-5806 103 1 You -PRON- PRP blog-archive-org-5806 103 2 can can MD blog-archive-org-5806 103 3 easily easily RB blog-archive-org-5806 103 4 correct correct VB blog-archive-org-5806 103 5 that that DT blog-archive-org-5806 103 6 bad bad JJ blog-archive-org-5806 103 7 practice practice NN blog-archive-org-5806 103 8 by by IN blog-archive-org-5806 103 9 changing change VBG blog-archive-org-5806 103 10 your -PRON- PRP$ blog-archive-org-5806 103 11 policy policy NN blog-archive-org-5806 103 12 rather rather RB blog-archive-org-5806 103 13 than than IN blog-archive-org-5806 103 14 blaming blame VBG blog-archive-org-5806 103 15 the the DT blog-archive-org-5806 103 16 non non JJ blog-archive-org-5806 103 17 - - JJ blog-archive-org-5806 103 18 standard standard JJ blog-archive-org-5806 103 19 “ " `` blog-archive-org-5806 103 20 standard standard NN blog-archive-org-5806 103 21 ” " '' blog-archive-org-5806 103 22 ( ( -LRB- blog-archive-org-5806 103 23 of of IN blog-archive-org-5806 103 24 which which WDT blog-archive-org-5806 103 25 MOST MOST JJS blog-archive-org-5806 103 26 PEOPLE PEOPLE NNS blog-archive-org-5806 103 27 are be VBP blog-archive-org-5806 103 28 unaware unaware JJ blog-archive-org-5806 103 29 ) ) -RRB- blog-archive-org-5806 103 30 for for IN blog-archive-org-5806 103 31 the the DT blog-archive-org-5806 103 32 issue issue NN blog-archive-org-5806 103 33 . . . blog-archive-org-5806 104 1 While while IN blog-archive-org-5806 104 2 you -PRON- PRP blog-archive-org-5806 104 3 ’re be VBP blog-archive-org-5806 104 4 fixing fix VBG blog-archive-org-5806 104 5 the the DT blog-archive-org-5806 104 6 problems problem NNS blog-archive-org-5806 104 7 with with IN blog-archive-org-5806 104 8 your -PRON- PRP$ blog-archive-org-5806 104 9 system system NN blog-archive-org-5806 104 10 , , , blog-archive-org-5806 104 11 you -PRON- PRP blog-archive-org-5806 104 12 could could MD blog-archive-org-5806 104 13 also also RB blog-archive-org-5806 104 14 make make VB blog-archive-org-5806 104 15 it -PRON- PRP blog-archive-org-5806 104 16 easier easy JJR blog-archive-org-5806 104 17 for for IN blog-archive-org-5806 104 18 Webmasters webmaster NNS blog-archive-org-5806 104 19 who who WP blog-archive-org-5806 104 20 do do VBP blog-archive-org-5806 104 21 know know VB blog-archive-org-5806 104 22 about about IN blog-archive-org-5806 104 23 both both CC blog-archive-org-5806 104 24 the the DT blog-archive-org-5806 104 25 “ " `` blog-archive-org-5806 104 26 robots.txt robots.txt NNP blog-archive-org-5806 104 27 ” " '' blog-archive-org-5806 104 28 file file NN blog-archive-org-5806 104 29 and and CC blog-archive-org-5806 104 30 your -PRON- PRP$ blog-archive-org-5806 104 31 archive archive NN blog-archive-org-5806 104 32 to to TO blog-archive-org-5806 104 33 correct correct VB blog-archive-org-5806 104 34 errors error NNS blog-archive-org-5806 104 35 rather rather RB blog-archive-org-5806 104 36 than than IN blog-archive-org-5806 104 37 have have VB blog-archive-org-5806 104 38 to to TO blog-archive-org-5806 104 39 wait wait VB blog-archive-org-5806 104 40 24 24 CD blog-archive-org-5806 104 41 hours hour NNS blog-archive-org-5806 104 42 or or CC blog-archive-org-5806 104 43 longer long JJR blog-archive-org-5806 104 44 for for IN blog-archive-org-5806 104 45 your -PRON- PRP$ blog-archive-org-5806 104 46 crawler crawler NN blog-archive-org-5806 104 47 to to TO blog-archive-org-5806 104 48 see see VB blog-archive-org-5806 104 49 changes change NNS blog-archive-org-5806 104 50 . . . blog-archive-org-5806 105 1 Mark Mark NNP blog-archive-org-5806 105 2 Graham Graham NNP blog-archive-org-5806 105 3 Post Post NNP blog-archive-org-5806 105 4 authorApril authorApril NNP blog-archive-org-5806 105 5 25 25 CD blog-archive-org-5806 105 6 , , , blog-archive-org-5806 105 7 2017 2017 CD blog-archive-org-5806 105 8 at at IN blog-archive-org-5806 105 9 6:37 6:37 CD blog-archive-org-5806 105 10 pm pm NN blog-archive-org-5806 105 11 Thank thank VBP blog-archive-org-5806 105 12 you -PRON- PRP blog-archive-org-5806 105 13 Michael Michael NNP blog-archive-org-5806 105 14 . . . blog-archive-org-5806 106 1 We -PRON- PRP blog-archive-org-5806 106 2 encourage encourage VBP blog-archive-org-5806 106 3 people people NNS blog-archive-org-5806 106 4 to to TO blog-archive-org-5806 106 5 write write VB blog-archive-org-5806 106 6 to to IN blog-archive-org-5806 106 7 us -PRON- PRP blog-archive-org-5806 106 8 at at IN blog-archive-org-5806 106 9 info@archive.org info@archive.org PRP blog-archive-org-5806 106 10 to to TO blog-archive-org-5806 106 11 report report VB blog-archive-org-5806 106 12 bugs bug NNS blog-archive-org-5806 106 13 , , , blog-archive-org-5806 106 14 make make VB blog-archive-org-5806 106 15 requests request NNS blog-archive-org-5806 106 16 ( ( -LRB- blog-archive-org-5806 106 17 include include VB blog-archive-org-5806 106 18 for for IN blog-archive-org-5806 106 19 content content NN blog-archive-org-5806 106 20 to to TO blog-archive-org-5806 106 21 be be VB blog-archive-org-5806 106 22 removed remove VBN blog-archive-org-5806 106 23 from from IN blog-archive-org-5806 106 24 the the DT blog-archive-org-5806 106 25 Wayback Wayback NNP blog-archive-org-5806 106 26 Machine Machine NNP blog-archive-org-5806 106 27 and and CC blog-archive-org-5806 106 28 for for IN blog-archive-org-5806 106 29 sites site NNS blog-archive-org-5806 106 30 to to TO blog-archive-org-5806 106 31 not not RB blog-archive-org-5806 106 32 be be VB blog-archive-org-5806 106 33 crawled crawl VBN blog-archive-org-5806 106 34 . . . blog-archive-org-5806 106 35 ) ) -RRB- blog-archive-org-5806 107 1 I -PRON- PRP blog-archive-org-5806 107 2 assure assure VBP blog-archive-org-5806 107 3 you -PRON- PRP blog-archive-org-5806 107 4 we -PRON- PRP blog-archive-org-5806 107 5 read read VBP blog-archive-org-5806 107 6 every every DT blog-archive-org-5806 107 7 message message NN blog-archive-org-5806 107 8 sent send VBN blog-archive-org-5806 107 9 to to IN blog-archive-org-5806 107 10 us -PRON- PRP blog-archive-org-5806 107 11 , , , blog-archive-org-5806 107 12 and and CC blog-archive-org-5806 107 13 act act VB blog-archive-org-5806 107 14 on on IN blog-archive-org-5806 107 15 them -PRON- PRP blog-archive-org-5806 107 16 as as IN blog-archive-org-5806 107 17 appropriate appropriate JJ blog-archive-org-5806 107 18 . . . blog-archive-org-5806 108 1 Many many JJ blog-archive-org-5806 108 2 of of IN blog-archive-org-5806 108 3 the the DT blog-archive-org-5806 108 4 features feature NNS blog-archive-org-5806 108 5 we -PRON- PRP blog-archive-org-5806 108 6 add add VBP blog-archive-org-5806 108 7 , , , blog-archive-org-5806 108 8 and and CC blog-archive-org-5806 108 9 bugs bug NNS blog-archive-org-5806 108 10 we -PRON- PRP blog-archive-org-5806 108 11 fix fix VBP blog-archive-org-5806 108 12 , , , blog-archive-org-5806 108 13 are be VBP blog-archive-org-5806 108 14 a a DT blog-archive-org-5806 108 15 direct direct JJ blog-archive-org-5806 108 16 result result NN blog-archive-org-5806 108 17 of of IN blog-archive-org-5806 108 18 user user NN blog-archive-org-5806 108 19 feedback feedback NN blog-archive-org-5806 108 20 . . . blog-archive-org-5806 109 1 Pingback Pingback NNP blog-archive-org-5806 109 2 : : : blog-archive-org-5806 109 3 The the DT blog-archive-org-5806 109 4 Internet Internet NNP blog-archive-org-5806 109 5 Archive Archive NNP blog-archive-org-5806 109 6 and and CC blog-archive-org-5806 109 7 robots.txt robots.txt NN blog-archive-org-5806 109 8 — — : blog-archive-org-5806 109 9 Pixel Pixel NNP blog-archive-org-5806 109 10 Envy Envy NNP blog-archive-org-5806 109 11 nascent nascent NN blog-archive-org-5806 109 12 April April NNP blog-archive-org-5806 109 13 25 25 CD blog-archive-org-5806 109 14 , , , blog-archive-org-5806 109 15 2017 2017 CD blog-archive-org-5806 109 16 at at IN blog-archive-org-5806 109 17 1:04 1:04 CD blog-archive-org-5806 109 18 pm pm NN blog-archive-org-5806 109 19 There there EX blog-archive-org-5806 109 20 still still RB blog-archive-org-5806 109 21 needs need VBZ blog-archive-org-5806 109 22 to to TO blog-archive-org-5806 109 23 be be VB blog-archive-org-5806 109 24 a a DT blog-archive-org-5806 109 25 way way NN blog-archive-org-5806 109 26 of of IN blog-archive-org-5806 109 27 specifically specifically RB blog-archive-org-5806 109 28 preventing prevent VBG blog-archive-org-5806 109 29 IA IA NNP blog-archive-org-5806 109 30 from from IN blog-archive-org-5806 109 31 archiving archive VBG blog-archive-org-5806 109 32 a a DT blog-archive-org-5806 109 33 domain domain NN blog-archive-org-5806 109 34 . . . blog-archive-org-5806 110 1 Mark Mark NNP blog-archive-org-5806 110 2 Graham Graham NNP blog-archive-org-5806 110 3 Post Post NNP blog-archive-org-5806 110 4 authorApril authorApril NNP blog-archive-org-5806 110 5 25 25 CD blog-archive-org-5806 110 6 , , , blog-archive-org-5806 110 7 2017 2017 CD blog-archive-org-5806 110 8 at at IN blog-archive-org-5806 110 9 6:33 6:33 CD blog-archive-org-5806 110 10 pm pm NN blog-archive-org-5806 110 11 Please please UH blog-archive-org-5806 110 12 know know VB blog-archive-org-5806 110 13 that that IN blog-archive-org-5806 110 14 site site NN blog-archive-org-5806 110 15 owners owner NNS blog-archive-org-5806 110 16 can can MD blog-archive-org-5806 110 17 always always RB blog-archive-org-5806 110 18 write write VB blog-archive-org-5806 110 19 to to IN blog-archive-org-5806 110 20 info@archive.org info@archive.org XX blog-archive-org-5806 110 21 and and CC blog-archive-org-5806 110 22 request request VB blog-archive-org-5806 110 23 that that DT blog-archive-org-5806 110 24 content content NN blog-archive-org-5806 110 25 from from IN blog-archive-org-5806 110 26 a a DT blog-archive-org-5806 110 27 site site NN blog-archive-org-5806 110 28 be be VB blog-archive-org-5806 110 29 removed remove VBN blog-archive-org-5806 110 30 from from IN blog-archive-org-5806 110 31 the the DT blog-archive-org-5806 110 32 Wayback Wayback NNP blog-archive-org-5806 110 33 Machine Machine NNP blog-archive-org-5806 110 34 and and CC blog-archive-org-5806 110 35 from from IN blog-archive-org-5806 110 36 future future JJ blog-archive-org-5806 110 37 crawling crawling NN blog-archive-org-5806 110 38 . . . blog-archive-org-5806 111 1 We -PRON- PRP blog-archive-org-5806 111 2 process process VBP blog-archive-org-5806 111 3 requests request NNS blog-archive-org-5806 111 4 like like IN blog-archive-org-5806 111 5 that that DT blog-archive-org-5806 111 6 every every DT blog-archive-org-5806 111 7 day day NN blog-archive-org-5806 111 8 . . . blog-archive-org-5806 112 1 Pingback Pingback NNP blog-archive-org-5806 112 2 : : : blog-archive-org-5806 112 3 Editors Editors NNP blog-archive-org-5806 112 4 ’ ’ POS blog-archive-org-5806 112 5 Choice choice NN blog-archive-org-5806 112 6 : : : blog-archive-org-5806 112 7 Robots.txt Robots.txt NNP blog-archive-org-5806 112 8 Adam Adam NNP blog-archive-org-5806 112 9 April April NNP blog-archive-org-5806 112 10 25 25 CD blog-archive-org-5806 112 11 , , , blog-archive-org-5806 112 12 2017 2017 CD blog-archive-org-5806 112 13 at at IN blog-archive-org-5806 112 14 6:25 6:25 CD blog-archive-org-5806 112 15 pm pm NN blog-archive-org-5806 112 16 Its -PRON- PRP$ blog-archive-org-5806 112 17 bad bad JJ blog-archive-org-5806 112 18 enough enough RB blog-archive-org-5806 112 19 that that IN blog-archive-org-5806 112 20 robots.txt robots.txt NN blog-archive-org-5806 112 21 not not RB blog-archive-org-5806 112 22 only only RB blog-archive-org-5806 112 23 prevents prevent NNS blog-archive-org-5806 112 24 archiving archive VBG blog-archive-org-5806 112 25 , , , blog-archive-org-5806 112 26 it -PRON- PRP blog-archive-org-5806 112 27 also also RB blog-archive-org-5806 112 28 deletes delete VBZ blog-archive-org-5806 112 29 the the DT blog-archive-org-5806 112 30 entire entire JJ blog-archive-org-5806 112 31 achieve achieve NN blog-archive-org-5806 112 32 ( ( -LRB- blog-archive-org-5806 112 33 in in IN blog-archive-org-5806 112 34 other other JJ blog-archive-org-5806 112 35 words word NNS blog-archive-org-5806 112 36 if if IN blog-archive-org-5806 112 37 you -PRON- PRP blog-archive-org-5806 112 38 archive archive VBP blog-archive-org-5806 112 39 it -PRON- PRP blog-archive-org-5806 112 40 , , , blog-archive-org-5806 112 41 and and CC blog-archive-org-5806 112 42 later later RB blog-archive-org-5806 112 43 employs employ VBZ blog-archive-org-5806 112 44 robots.txt robots.txt CD blog-archive-org-5806 112 45 , , , blog-archive-org-5806 112 46 will will MD blog-archive-org-5806 112 47 delete delete VB blog-archive-org-5806 112 48 it -PRON- PRP blog-archive-org-5806 112 49 ) ) -RRB- blog-archive-org-5806 112 50 . . . blog-archive-org-5806 113 1 Including include VBG blog-archive-org-5806 113 2 a a DT blog-archive-org-5806 113 3 website website NN blog-archive-org-5806 113 4 being be VBG blog-archive-org-5806 113 5 hacked hack VBN blog-archive-org-5806 113 6 to to TO blog-archive-org-5806 113 7 include include VB blog-archive-org-5806 113 8 robots.txt robots.txt ADD blog-archive-org-5806 113 9 . . . blog-archive-org-5806 114 1 John John NNP blog-archive-org-5806 114 2 April April NNP blog-archive-org-5806 114 3 26 26 CD blog-archive-org-5806 114 4 , , , blog-archive-org-5806 114 5 2017 2017 CD blog-archive-org-5806 114 6 at at IN blog-archive-org-5806 114 7 3:23 3:23 CD blog-archive-org-5806 114 8 pm pm NN blog-archive-org-5806 114 9 Then then RB blog-archive-org-5806 114 10 please please UH blog-archive-org-5806 114 11 explain explain VB blog-archive-org-5806 114 12 how how WRB blog-archive-org-5806 114 13 I -PRON- PRP blog-archive-org-5806 114 14 can can MD blog-archive-org-5806 114 15 keep keep VB blog-archive-org-5806 114 16 a a DT blog-archive-org-5806 114 17 site site NN blog-archive-org-5806 114 18 ephemeral ephemeral JJ blog-archive-org-5806 114 19 , , , blog-archive-org-5806 114 20 as as IN blog-archive-org-5806 114 21 intended intend VBN blog-archive-org-5806 114 22 . . . blog-archive-org-5806 115 1 Are be VBP blog-archive-org-5806 115 2 there there EX blog-archive-org-5806 115 3 IP IP NNP blog-archive-org-5806 115 4 address address NN blog-archive-org-5806 115 5 ranges range VBZ blog-archive-org-5806 115 6 , , , blog-archive-org-5806 115 7 HTTP HTTP NNP blog-archive-org-5806 115 8 headers header NNS blog-archive-org-5806 115 9 , , , blog-archive-org-5806 115 10 etc etc FW blog-archive-org-5806 115 11 , , , blog-archive-org-5806 115 12 that that WDT blog-archive-org-5806 115 13 can can MD blog-archive-org-5806 115 14 be be VB blog-archive-org-5806 115 15 used use VBN blog-archive-org-5806 115 16 to to TO blog-archive-org-5806 115 17 forbid forbid VB blog-archive-org-5806 115 18 access access NN blog-archive-org-5806 115 19 ? ? . blog-archive-org-5806 116 1 What what WP blog-archive-org-5806 116 2 is be VBZ blog-archive-org-5806 116 3 the the DT blog-archive-org-5806 116 4 way way NN blog-archive-org-5806 116 5 to to TO blog-archive-org-5806 116 6 reliably reliably RB blog-archive-org-5806 116 7 keep keep VB blog-archive-org-5806 116 8 sites site NNS blog-archive-org-5806 116 9 out out IN blog-archive-org-5806 116 10 of of IN blog-archive-org-5806 116 11 the the DT blog-archive-org-5806 116 12 archive archive NN blog-archive-org-5806 116 13 for for IN blog-archive-org-5806 116 14 the the DT blog-archive-org-5806 116 15 time time NN blog-archive-org-5806 116 16 you -PRON- PRP blog-archive-org-5806 116 17 respected respect VBD blog-archive-org-5806 116 18 robots.txt robots.txt NN blog-archive-org-5806 116 19 , , , blog-archive-org-5806 116 20 now now RB blog-archive-org-5806 116 21 , , , blog-archive-org-5806 116 22 and and CC blog-archive-org-5806 116 23 forever forever RB blog-archive-org-5806 116 24 ? ? . blog-archive-org-5806 117 1 My -PRON- PRP$ blog-archive-org-5806 117 2 sites site NNS blog-archive-org-5806 117 3 explicitly explicitly RB blog-archive-org-5806 117 4 tell tell VBP blog-archive-org-5806 117 5 robots robot NNS blog-archive-org-5806 117 6 “ " `` blog-archive-org-5806 117 7 NOARCHIVE noarchive JJ blog-archive-org-5806 117 8 ” " '' blog-archive-org-5806 117 9 . . . blog-archive-org-5806 118 1 You -PRON- PRP blog-archive-org-5806 118 2 should should MD blog-archive-org-5806 118 3 n’t not RB blog-archive-org-5806 118 4 even even RB blog-archive-org-5806 118 5 have have VB blog-archive-org-5806 118 6 the the DT blog-archive-org-5806 118 7 files file NNS blog-archive-org-5806 118 8 on on IN blog-archive-org-5806 118 9 your -PRON- PRP$ blog-archive-org-5806 118 10 systems system NNS blog-archive-org-5806 118 11 . . . blog-archive-org-5806 119 1 Retroactively retroactively RB blog-archive-org-5806 119 2 making make VBG blog-archive-org-5806 119 3 archives archive NNS blog-archive-org-5806 119 4 public public NN blog-archive-org-5806 119 5 is be VBZ blog-archive-org-5806 119 6 a a DT blog-archive-org-5806 119 7 dick dick JJ blog-archive-org-5806 119 8 move move NN blog-archive-org-5806 119 9 . . . blog-archive-org-5806 120 1 Mark Mark NNP blog-archive-org-5806 120 2 Graham Graham NNP blog-archive-org-5806 120 3 Post Post NNP blog-archive-org-5806 120 4 authorApril authorApril NNP blog-archive-org-5806 120 5 26 26 CD blog-archive-org-5806 120 6 , , , blog-archive-org-5806 120 7 2017 2017 CD blog-archive-org-5806 120 8 at at IN blog-archive-org-5806 120 9 3:54 3:54 CD blog-archive-org-5806 120 10 pm pm NN blog-archive-org-5806 120 11 Hi hi UH blog-archive-org-5806 120 12 John John NNP blog-archive-org-5806 120 13 , , , blog-archive-org-5806 120 14 Please please UH blog-archive-org-5806 120 15 email email VB blog-archive-org-5806 120 16 your -PRON- PRP$ blog-archive-org-5806 120 17 request request NN blog-archive-org-5806 120 18 to to IN blog-archive-org-5806 120 19 info@archive.org info@archive.org NNP blog-archive-org-5806 120 20 and and CC blog-archive-org-5806 120 21 we -PRON- PRP blog-archive-org-5806 120 22 will will MD blog-archive-org-5806 120 23 promptly promptly RB blog-archive-org-5806 120 24 process process VB blog-archive-org-5806 120 25 it -PRON- PRP blog-archive-org-5806 120 26 . . . blog-archive-org-5806 121 1 Chris Chris NNP blog-archive-org-5806 121 2 Haines Haines NNP blog-archive-org-5806 121 3 April April NNP blog-archive-org-5806 121 4 26 26 CD blog-archive-org-5806 121 5 , , , blog-archive-org-5806 121 6 2017 2017 CD blog-archive-org-5806 121 7 at at IN blog-archive-org-5806 121 8 3:33 3:33 CD blog-archive-org-5806 121 9 pm pm NN blog-archive-org-5806 121 10 “ " `` blog-archive-org-5806 121 11 We -PRON- PRP blog-archive-org-5806 121 12 see see VBP blog-archive-org-5806 121 13 the the DT blog-archive-org-5806 121 14 future future NN blog-archive-org-5806 121 15 of of IN blog-archive-org-5806 121 16 web web NN blog-archive-org-5806 121 17 archiving archive VBG blog-archive-org-5806 121 18 relying rely VBG blog-archive-org-5806 121 19 less less RBR blog-archive-org-5806 121 20 on on IN blog-archive-org-5806 121 21 robots.txt robots.txt CD blog-archive-org-5806 121 22 file file NN blog-archive-org-5806 121 23 declarations declaration NNS blog-archive-org-5806 121 24 geared gear VBN blog-archive-org-5806 121 25 toward toward IN blog-archive-org-5806 121 26 search search NN blog-archive-org-5806 121 27 engines engine NNS blog-archive-org-5806 121 28 , , , blog-archive-org-5806 121 29 and and CC blog-archive-org-5806 121 30 more more RBR blog-archive-org-5806 121 31 on on IN blog-archive-org-5806 121 32 representing represent VBG blog-archive-org-5806 121 33 the the DT blog-archive-org-5806 121 34 web web NN blog-archive-org-5806 121 35 as as IN blog-archive-org-5806 121 36 it -PRON- PRP blog-archive-org-5806 121 37 really really RB blog-archive-org-5806 121 38 was be VBD blog-archive-org-5806 121 39 , , , blog-archive-org-5806 121 40 and and CC blog-archive-org-5806 121 41 is be VBZ blog-archive-org-5806 121 42 , , , blog-archive-org-5806 121 43 from from IN blog-archive-org-5806 121 44 a a DT blog-archive-org-5806 121 45 user user NN blog-archive-org-5806 121 46 ’s ’s POS blog-archive-org-5806 121 47 perspective perspective NN blog-archive-org-5806 121 48 . . . blog-archive-org-5806 121 49 ” " '' blog-archive-org-5806 121 50 – – : blog-archive-org-5806 121 51 I -PRON- PRP blog-archive-org-5806 121 52 agree agree VBP blog-archive-org-5806 121 53 . . . blog-archive-org-5806 122 1 I -PRON- PRP blog-archive-org-5806 122 2 think think VBP blog-archive-org-5806 122 3 times time NNS blog-archive-org-5806 122 4 have have VBP blog-archive-org-5806 122 5 changed change VBN blog-archive-org-5806 122 6 , , , blog-archive-org-5806 122 7 and and CC blog-archive-org-5806 122 8 this this DT blog-archive-org-5806 122 9 reflects reflect VBZ blog-archive-org-5806 122 10 what what WP blog-archive-org-5806 122 11 users user NNS blog-archive-org-5806 122 12 want want VBP blog-archive-org-5806 122 13 from from IN blog-archive-org-5806 122 14 a a DT blog-archive-org-5806 122 15 web web NN blog-archive-org-5806 122 16 archive archive NN blog-archive-org-5806 122 17 these these DT blog-archive-org-5806 122 18 days day NNS blog-archive-org-5806 122 19 . . . blog-archive-org-5806 123 1 Comments comment NNS blog-archive-org-5806 123 2 are be VBP blog-archive-org-5806 123 3 closed closed JJ blog-archive-org-5806 123 4 . . . blog-archive-org-5806 124 1 Search search VB blog-archive-org-5806 124 2 for for IN blog-archive-org-5806 124 3 : : : blog-archive-org-5806 124 4 Recent Recent NNP blog-archive-org-5806 124 5 Posts Posts NNPS blog-archive-org-5806 124 6 Holiday Holiday NNP blog-archive-org-5806 124 7 Cheer Cheer NNP blog-archive-org-5806 124 8 for for IN blog-archive-org-5806 124 9 a a DT blog-archive-org-5806 124 10 Good Good NNP blog-archive-org-5806 124 11 Cause Cause NNP blog-archive-org-5806 124 12 Library Library NNP blog-archive-org-5806 124 13 Digital Digital NNP blog-archive-org-5806 124 14 Lending Lending NNP blog-archive-org-5806 124 15 Empowers Empowers NNPS blog-archive-org-5806 124 16 People People NNS blog-archive-org-5806 124 17 Worldwide Worldwide NNP blog-archive-org-5806 124 18 During during IN blog-archive-org-5806 124 19 COVID-19 COVID-19 NNP blog-archive-org-5806 124 20 Pandemic Pandemic NNP blog-archive-org-5806 124 21 Leaders Leaders NNPS blog-archive-org-5806 124 22 in in IN blog-archive-org-5806 124 23 the the DT blog-archive-org-5806 124 24 Open Open NNP blog-archive-org-5806 124 25 World World NNP blog-archive-org-5806 124 26 , , , blog-archive-org-5806 124 27 Intellectual Intellectual NNP blog-archive-org-5806 124 28 Property Property NNP blog-archive-org-5806 124 29 , , , blog-archive-org-5806 124 30 and and CC blog-archive-org-5806 124 31 Social Social NNP blog-archive-org-5806 124 32 Justice Justice NNP blog-archive-org-5806 124 33 Join join VBP blog-archive-org-5806 124 34 Our -PRON- PRP$ blog-archive-org-5806 124 35 Public Public NNP blog-archive-org-5806 124 36 Domain Domain NNP blog-archive-org-5806 124 37 Day Day NNP blog-archive-org-5806 124 38 Celebration Celebration NNP blog-archive-org-5806 124 39 Dweb Dweb NNP blog-archive-org-5806 124 40 Meetup Meetup NNP blog-archive-org-5806 124 41 : : : blog-archive-org-5806 124 42 The the DT blog-archive-org-5806 124 43 Latest late JJS blog-archive-org-5806 124 44 in in IN blog-archive-org-5806 124 45 the the DT blog-archive-org-5806 124 46 DWeb DWeb NNP blog-archive-org-5806 124 47 Ecosystem Ecosystem NNP blog-archive-org-5806 124 48 Community Community NNP blog-archive-org-5806 124 49 Webs Webs NNP blog-archive-org-5806 124 50 Program Program NNP blog-archive-org-5806 124 51 Receives receive VBZ blog-archive-org-5806 124 52 $ $ $ blog-archive-org-5806 124 53 1,130,000 1,130,000 CD blog-archive-org-5806 124 54 Andrew Andrew NNP blog-archive-org-5806 124 55 W. W. NNP blog-archive-org-5806 124 56 Mellon Mellon NNP blog-archive-org-5806 124 57 Foundation Foundation NNP blog-archive-org-5806 124 58 Award Award NNP blog-archive-org-5806 124 59 for for IN blog-archive-org-5806 124 60 a a DT blog-archive-org-5806 124 61 National National NNP blog-archive-org-5806 124 62 Network Network NNP blog-archive-org-5806 124 63 of of IN blog-archive-org-5806 124 64 Public Public NNP blog-archive-org-5806 124 65 Libraries Libraries NNPS blog-archive-org-5806 124 66 Building Building NNP blog-archive-org-5806 124 67 Local Local NNP blog-archive-org-5806 124 68 History history NN blog-archive-org-5806 124 69 Web web NN blog-archive-org-5806 124 70 Archives archive NNS blog-archive-org-5806 124 71 Recent Recent NNP blog-archive-org-5806 124 72 Comments Comments NNPS blog-archive-org-5806 124 73 giso giso NN blog-archive-org-5806 124 74 on on IN blog-archive-org-5806 124 75 Discogs discog NNS blog-archive-org-5806 124 76 Thank thank VBP blog-archive-org-5806 124 77 You -PRON- PRP blog-archive-org-5806 124 78 ! ! . blog-archive-org-5806 125 1 A a DT blog-archive-org-5806 125 2 commercial commercial JJ blog-archive-org-5806 125 3 community community NN blog-archive-org-5806 125 4 site site NN blog-archive-org-5806 125 5 with with IN blog-archive-org-5806 125 6 bulk bulk JJ blog-archive-org-5806 125 7 data data NN blog-archive-org-5806 125 8 access access NN blog-archive-org-5806 125 9 Alvaro Alvaro NNP blog-archive-org-5806 125 10 Muñoz Muñoz NNP blog-archive-org-5806 125 11 Brandon Brandon NNP blog-archive-org-5806 125 12 on on IN blog-archive-org-5806 125 13 Contest contest NN blog-archive-org-5806 125 14 : : : blog-archive-org-5806 125 15 The the DT blog-archive-org-5806 125 16 Internet internet NN blog-archive-org-5806 125 17 Archive Archive NNP blog-archive-org-5806 125 18 is be VBZ blog-archive-org-5806 125 19 Looking look VBG blog-archive-org-5806 125 20 For for IN blog-archive-org-5806 125 21 Creative creative JJ blog-archive-org-5806 125 22 Short short JJ blog-archive-org-5806 125 23 Films film NNS blog-archive-org-5806 125 24 Made make VBN blog-archive-org-5806 125 25 By by IN blog-archive-org-5806 125 26 You -PRON- PRP blog-archive-org-5806 125 27 ! ! . blog-archive-org-5806 126 1 doug doug NNP blog-archive-org-5806 126 2 on on IN blog-archive-org-5806 126 3 Discogs discog NNS blog-archive-org-5806 126 4 Thank thank VBP blog-archive-org-5806 126 5 You -PRON- PRP blog-archive-org-5806 126 6 ! ! . blog-archive-org-5806 127 1 A a DT blog-archive-org-5806 127 2 commercial commercial JJ blog-archive-org-5806 127 3 community community NN blog-archive-org-5806 127 4 site site NN blog-archive-org-5806 127 5 with with IN blog-archive-org-5806 127 6 bulk bulk JJ blog-archive-org-5806 127 7 data data NN blog-archive-org-5806 127 8 access access NN blog-archive-org-5806 127 9 Skevos Skevos NNP blog-archive-org-5806 127 10 Mavros Mavros NNP blog-archive-org-5806 127 11 on on IN blog-archive-org-5806 127 12 Contest contest NN blog-archive-org-5806 127 13 : : : blog-archive-org-5806 127 14 The the DT blog-archive-org-5806 127 15 Internet internet NN blog-archive-org-5806 127 16 Archive Archive NNP blog-archive-org-5806 127 17 is be VBZ blog-archive-org-5806 127 18 Looking look VBG blog-archive-org-5806 127 19 For for IN blog-archive-org-5806 127 20 Creative creative JJ blog-archive-org-5806 127 21 Short short JJ blog-archive-org-5806 127 22 Films film NNS blog-archive-org-5806 127 23 Made make VBN blog-archive-org-5806 127 24 By by IN blog-archive-org-5806 127 25 You -PRON- PRP blog-archive-org-5806 127 26 ! ! . blog-archive-org-5806 128 1 seo seo NN blog-archive-org-5806 128 2 on on IN blog-archive-org-5806 128 3 Discogs discog NNS blog-archive-org-5806 128 4 Thank thank VBP blog-archive-org-5806 128 5 You -PRON- PRP blog-archive-org-5806 128 6 ! ! . blog-archive-org-5806 129 1 A a DT blog-archive-org-5806 129 2 commercial commercial JJ blog-archive-org-5806 129 3 community community NN blog-archive-org-5806 129 4 site site NN blog-archive-org-5806 129 5 with with IN blog-archive-org-5806 129 6 bulk bulk JJ blog-archive-org-5806 129 7 data data NN blog-archive-org-5806 129 8 access access NN blog-archive-org-5806 129 9 Categories category NNS blog-archive-org-5806 129 10 78rpm 78rpm VBP blog-archive-org-5806 129 11 Announcements Announcements NNPS blog-archive-org-5806 129 12 Archive Archive NNP blog-archive-org-5806 129 13 Version Version NNP blog-archive-org-5806 129 14 2 2 CD blog-archive-org-5806 129 15 Archive Archive NNP blog-archive-org-5806 129 16 - - HYPH blog-archive-org-5806 129 17 It It NNP blog-archive-org-5806 129 18 Audio Audio NNP blog-archive-org-5806 129 19 Archive Archive NNP blog-archive-org-5806 129 20 Books Books NNPS blog-archive-org-5806 129 21 Archive Archive NNP blog-archive-org-5806 129 22 Cool Cool NNP blog-archive-org-5806 129 23 items item NNS blog-archive-org-5806 129 24 Education Education NNP blog-archive-org-5806 129 25 Archive Archive NNP blog-archive-org-5806 129 26 Emulation Emulation NNP blog-archive-org-5806 129 27 Event Event NNP blog-archive-org-5806 129 28 Image Image NNP blog-archive-org-5806 129 29 Archive Archive NNP blog-archive-org-5806 129 30 Jobs Jobs NNP blog-archive-org-5806 129 31 Lending lend VBG blog-archive-org-5806 129 32 Books book NNS blog-archive-org-5806 129 33 Live live VBP blog-archive-org-5806 129 34 Music Music NNP blog-archive-org-5806 129 35 Archive Archive NNP blog-archive-org-5806 129 36 Movie Movie NNP blog-archive-org-5806 129 37 Archive Archive NNP blog-archive-org-5806 129 38 Music Music NNP blog-archive-org-5806 129 39 News News NNP blog-archive-org-5806 129 40 Newsletter Newsletter NNP blog-archive-org-5806 129 41 Open Open NNP blog-archive-org-5806 129 42 Library Library NNP blog-archive-org-5806 129 43 Past Past NNP blog-archive-org-5806 129 44 Event Event NNP blog-archive-org-5806 129 45 Software Software NNP blog-archive-org-5806 129 46 Archive Archive NNP blog-archive-org-5806 129 47 Technical Technical NNP blog-archive-org-5806 129 48 Television Television NNP blog-archive-org-5806 129 49 Archive Archive NNP blog-archive-org-5806 129 50 Upcoming Upcoming NNP blog-archive-org-5806 129 51 Event Event NNP blog-archive-org-5806 129 52 Video video NN blog-archive-org-5806 129 53 Archive Archive NNP blog-archive-org-5806 129 54 Wayback Wayback NNP blog-archive-org-5806 129 55 Machine Machine NNP blog-archive-org-5806 129 56 – – : blog-archive-org-5806 129 57 Web Web NNP blog-archive-org-5806 129 58 Archive Archive NNP blog-archive-org-5806 129 59 Web Web NNP blog-archive-org-5806 129 60 & & CC blog-archive-org-5806 129 61 Data Data NNP blog-archive-org-5806 129 62 Services Services NNPS blog-archive-org-5806 129 63 Archives Archives NNP blog-archive-org-5806 129 64 Archives Archives NNPS blog-archive-org-5806 129 65 Select Select NNP blog-archive-org-5806 129 66 Month Month NNP blog-archive-org-5806 129 67 December December NNP blog-archive-org-5806 129 68 2020 2020 CD blog-archive-org-5806 129 69 November November NNP blog-archive-org-5806 129 70 2020 2020 CD blog-archive-org-5806 129 71 October October NNP blog-archive-org-5806 129 72 2020 2020 CD blog-archive-org-5806 129 73 September September NNP blog-archive-org-5806 129 74 2020 2020 CD blog-archive-org-5806 129 75 August August NNP blog-archive-org-5806 129 76 2020 2020 CD blog-archive-org-5806 129 77 July July NNP blog-archive-org-5806 129 78 2020 2020 CD blog-archive-org-5806 129 79 June June NNP blog-archive-org-5806 129 80 2020 2020 CD blog-archive-org-5806 129 81 May May NNP blog-archive-org-5806 129 82 2020 2020 CD blog-archive-org-5806 129 83 April April NNP blog-archive-org-5806 129 84 2020 2020 CD blog-archive-org-5806 129 85 March March NNP blog-archive-org-5806 129 86 2020 2020 CD blog-archive-org-5806 129 87 February February NNP blog-archive-org-5806 129 88 2020 2020 CD blog-archive-org-5806 129 89 January January NNP blog-archive-org-5806 129 90 2020 2020 CD blog-archive-org-5806 129 91 December December NNP blog-archive-org-5806 129 92 2019 2019 CD blog-archive-org-5806 129 93 November November NNP blog-archive-org-5806 129 94 2019 2019 CD blog-archive-org-5806 129 95 October October NNP blog-archive-org-5806 129 96 2019 2019 CD blog-archive-org-5806 129 97 September September NNP blog-archive-org-5806 129 98 2019 2019 CD blog-archive-org-5806 129 99 August August NNP blog-archive-org-5806 129 100 2019 2019 CD blog-archive-org-5806 129 101 July July NNP blog-archive-org-5806 129 102 2019 2019 CD blog-archive-org-5806 129 103 June June NNP blog-archive-org-5806 129 104 2019 2019 CD blog-archive-org-5806 129 105 May May NNP blog-archive-org-5806 129 106 2019 2019 CD blog-archive-org-5806 129 107 April April NNP blog-archive-org-5806 129 108 2019 2019 CD blog-archive-org-5806 129 109 March March NNP blog-archive-org-5806 129 110 2019 2019 CD blog-archive-org-5806 129 111 February February NNP blog-archive-org-5806 129 112 2019 2019 CD blog-archive-org-5806 129 113 January January NNP blog-archive-org-5806 129 114 2019 2019 CD blog-archive-org-5806 129 115 December December NNP blog-archive-org-5806 129 116 2018 2018 CD blog-archive-org-5806 129 117 November November NNP blog-archive-org-5806 129 118 2018 2018 CD blog-archive-org-5806 129 119 October October NNP blog-archive-org-5806 129 120 2018 2018 CD blog-archive-org-5806 129 121 September September NNP blog-archive-org-5806 129 122 2018 2018 CD blog-archive-org-5806 129 123 August August NNP blog-archive-org-5806 129 124 2018 2018 CD blog-archive-org-5806 129 125 July July NNP blog-archive-org-5806 129 126 2018 2018 CD blog-archive-org-5806 129 127 June June NNP blog-archive-org-5806 129 128 2018 2018 CD blog-archive-org-5806 129 129 May May NNP blog-archive-org-5806 129 130 2018 2018 CD blog-archive-org-5806 129 131 April April NNP blog-archive-org-5806 129 132 2018 2018 CD blog-archive-org-5806 129 133 March March NNP blog-archive-org-5806 129 134 2018 2018 CD blog-archive-org-5806 129 135 February February NNP blog-archive-org-5806 129 136 2018 2018 CD blog-archive-org-5806 129 137 January January NNP blog-archive-org-5806 129 138 2018 2018 CD blog-archive-org-5806 129 139 December December NNP blog-archive-org-5806 129 140 2017 2017 CD blog-archive-org-5806 129 141 November November NNP blog-archive-org-5806 129 142 2017 2017 CD blog-archive-org-5806 129 143 October October NNP blog-archive-org-5806 129 144 2017 2017 CD blog-archive-org-5806 129 145 September September NNP blog-archive-org-5806 129 146 2017 2017 CD blog-archive-org-5806 129 147 August August NNP blog-archive-org-5806 129 148 2017 2017 CD blog-archive-org-5806 129 149 July July NNP blog-archive-org-5806 129 150 2017 2017 CD blog-archive-org-5806 129 151 June June NNP blog-archive-org-5806 129 152 2017 2017 CD blog-archive-org-5806 129 153 May May NNP blog-archive-org-5806 129 154 2017 2017 CD blog-archive-org-5806 129 155 April April NNP blog-archive-org-5806 129 156 2017 2017 CD blog-archive-org-5806 129 157 March March NNP blog-archive-org-5806 129 158 2017 2017 CD blog-archive-org-5806 129 159 February February NNP blog-archive-org-5806 129 160 2017 2017 CD blog-archive-org-5806 129 161 January January NNP blog-archive-org-5806 129 162 2017 2017 CD blog-archive-org-5806 129 163 December December NNP blog-archive-org-5806 129 164 2016 2016 CD blog-archive-org-5806 129 165 November November NNP blog-archive-org-5806 129 166 2016 2016 CD blog-archive-org-5806 129 167 October October NNP blog-archive-org-5806 129 168 2016 2016 CD blog-archive-org-5806 129 169 September September NNP blog-archive-org-5806 129 170 2016 2016 CD blog-archive-org-5806 129 171 August August NNP blog-archive-org-5806 129 172 2016 2016 CD blog-archive-org-5806 129 173 July July NNP blog-archive-org-5806 129 174 2016 2016 CD blog-archive-org-5806 129 175 June June NNP blog-archive-org-5806 129 176 2016 2016 CD blog-archive-org-5806 129 177 May May NNP blog-archive-org-5806 129 178 2016 2016 CD blog-archive-org-5806 129 179 April April NNP blog-archive-org-5806 129 180 2016 2016 CD blog-archive-org-5806 129 181 March March NNP blog-archive-org-5806 129 182 2016 2016 CD blog-archive-org-5806 129 183 February February NNP blog-archive-org-5806 129 184 2016 2016 CD blog-archive-org-5806 129 185 January January NNP blog-archive-org-5806 129 186 2016 2016 CD blog-archive-org-5806 129 187 December December NNP blog-archive-org-5806 129 188 2015 2015 CD blog-archive-org-5806 129 189 November November NNP blog-archive-org-5806 129 190 2015 2015 CD blog-archive-org-5806 129 191 October October NNP blog-archive-org-5806 129 192 2015 2015 CD blog-archive-org-5806 129 193 September September NNP blog-archive-org-5806 129 194 2015 2015 CD blog-archive-org-5806 129 195 July July NNP blog-archive-org-5806 129 196 2015 2015 CD blog-archive-org-5806 129 197 June June NNP blog-archive-org-5806 129 198 2015 2015 CD blog-archive-org-5806 129 199 May May NNP blog-archive-org-5806 129 200 2015 2015 CD blog-archive-org-5806 129 201 April April NNP blog-archive-org-5806 129 202 2015 2015 CD blog-archive-org-5806 129 203 March March NNP blog-archive-org-5806 129 204 2015 2015 CD blog-archive-org-5806 129 205 February February NNP blog-archive-org-5806 129 206 2015 2015 CD blog-archive-org-5806 129 207 January January NNP blog-archive-org-5806 129 208 2015 2015 CD blog-archive-org-5806 129 209 December December NNP blog-archive-org-5806 129 210 2014 2014 CD blog-archive-org-5806 129 211 November November NNP blog-archive-org-5806 129 212 2014 2014 CD blog-archive-org-5806 129 213 October October NNP blog-archive-org-5806 129 214 2014 2014 CD blog-archive-org-5806 129 215 September September NNP blog-archive-org-5806 129 216 2014 2014 CD blog-archive-org-5806 129 217 August August NNP blog-archive-org-5806 129 218 2014 2014 CD blog-archive-org-5806 129 219 July July NNP blog-archive-org-5806 129 220 2014 2014 CD blog-archive-org-5806 129 221 June June NNP blog-archive-org-5806 129 222 2014 2014 CD blog-archive-org-5806 129 223 May May NNP blog-archive-org-5806 129 224 2014 2014 CD blog-archive-org-5806 129 225 April April NNP blog-archive-org-5806 129 226 2014 2014 CD blog-archive-org-5806 129 227 March March NNP blog-archive-org-5806 129 228 2014 2014 CD blog-archive-org-5806 129 229 February February NNP blog-archive-org-5806 129 230 2014 2014 CD blog-archive-org-5806 129 231 January January NNP blog-archive-org-5806 129 232 2014 2014 CD blog-archive-org-5806 129 233 December December NNP blog-archive-org-5806 129 234 2013 2013 CD blog-archive-org-5806 129 235 November November NNP blog-archive-org-5806 129 236 2013 2013 CD blog-archive-org-5806 129 237 October October NNP blog-archive-org-5806 129 238 2013 2013 CD blog-archive-org-5806 129 239 September September NNP blog-archive-org-5806 129 240 2013 2013 CD blog-archive-org-5806 129 241 August August NNP blog-archive-org-5806 129 242 2013 2013 CD blog-archive-org-5806 129 243 July July NNP blog-archive-org-5806 129 244 2013 2013 CD blog-archive-org-5806 129 245 June June NNP blog-archive-org-5806 129 246 2013 2013 CD blog-archive-org-5806 129 247 May May NNP blog-archive-org-5806 129 248 2013 2013 CD blog-archive-org-5806 129 249 April April NNP blog-archive-org-5806 129 250 2013 2013 CD blog-archive-org-5806 129 251 March March NNP blog-archive-org-5806 129 252 2013 2013 CD blog-archive-org-5806 129 253 February February NNP blog-archive-org-5806 129 254 2013 2013 CD blog-archive-org-5806 129 255 January January NNP blog-archive-org-5806 129 256 2013 2013 CD blog-archive-org-5806 129 257 December December NNP blog-archive-org-5806 129 258 2012 2012 CD blog-archive-org-5806 129 259 November November NNP blog-archive-org-5806 129 260 2012 2012 CD blog-archive-org-5806 129 261 October October NNP blog-archive-org-5806 129 262 2012 2012 CD blog-archive-org-5806 129 263 September September NNP blog-archive-org-5806 129 264 2012 2012 CD blog-archive-org-5806 129 265 August August NNP blog-archive-org-5806 129 266 2012 2012 CD blog-archive-org-5806 129 267 July July NNP blog-archive-org-5806 129 268 2012 2012 CD blog-archive-org-5806 129 269 June June NNP blog-archive-org-5806 129 270 2012 2012 CD blog-archive-org-5806 129 271 May May NNP blog-archive-org-5806 129 272 2012 2012 CD blog-archive-org-5806 129 273 April April NNP blog-archive-org-5806 129 274 2012 2012 CD blog-archive-org-5806 129 275 March March NNP blog-archive-org-5806 129 276 2012 2012 CD blog-archive-org-5806 129 277 February February NNP blog-archive-org-5806 129 278 2012 2012 CD blog-archive-org-5806 129 279 January January NNP blog-archive-org-5806 129 280 2012 2012 CD blog-archive-org-5806 129 281 December December NNP blog-archive-org-5806 129 282 2011 2011 CD blog-archive-org-5806 129 283 November November NNP blog-archive-org-5806 129 284 2011 2011 CD blog-archive-org-5806 129 285 October October NNP blog-archive-org-5806 129 286 2011 2011 CD blog-archive-org-5806 129 287 September September NNP blog-archive-org-5806 129 288 2011 2011 CD blog-archive-org-5806 129 289 August August NNP blog-archive-org-5806 129 290 2011 2011 CD blog-archive-org-5806 129 291 July July NNP blog-archive-org-5806 129 292 2011 2011 CD blog-archive-org-5806 129 293 June June NNP blog-archive-org-5806 129 294 2011 2011 CD blog-archive-org-5806 129 295 May May NNP blog-archive-org-5806 129 296 2011 2011 CD blog-archive-org-5806 129 297 April April NNP blog-archive-org-5806 129 298 2011 2011 CD blog-archive-org-5806 129 299 March March NNP blog-archive-org-5806 129 300 2011 2011 CD blog-archive-org-5806 129 301 February February NNP blog-archive-org-5806 129 302 2011 2011 CD blog-archive-org-5806 129 303 January January NNP blog-archive-org-5806 129 304 2011 2011 CD blog-archive-org-5806 129 305 December December NNP blog-archive-org-5806 129 306 2010 2010 CD blog-archive-org-5806 129 307 November November NNP blog-archive-org-5806 129 308 2010 2010 CD blog-archive-org-5806 129 309 October October NNP blog-archive-org-5806 129 310 2010 2010 CD blog-archive-org-5806 129 311 September September NNP blog-archive-org-5806 129 312 2010 2010 CD blog-archive-org-5806 129 313 August August NNP blog-archive-org-5806 129 314 2010 2010 CD blog-archive-org-5806 129 315 July July NNP blog-archive-org-5806 129 316 2010 2010 CD blog-archive-org-5806 129 317 June June NNP blog-archive-org-5806 129 318 2010 2010 CD blog-archive-org-5806 129 319 May May NNP blog-archive-org-5806 129 320 2010 2010 CD blog-archive-org-5806 129 321 April April NNP blog-archive-org-5806 129 322 2010 2010 CD blog-archive-org-5806 129 323 March March NNP blog-archive-org-5806 129 324 2010 2010 CD blog-archive-org-5806 129 325 February February NNP blog-archive-org-5806 129 326 2010 2010 CD blog-archive-org-5806 129 327 January January NNP blog-archive-org-5806 129 328 2010 2010 CD blog-archive-org-5806 129 329 December December NNP blog-archive-org-5806 129 330 2009 2009 CD blog-archive-org-5806 129 331 October October NNP blog-archive-org-5806 129 332 2009 2009 CD blog-archive-org-5806 129 333 September September NNP blog-archive-org-5806 129 334 2009 2009 CD blog-archive-org-5806 129 335 August August NNP blog-archive-org-5806 129 336 2009 2009 CD blog-archive-org-5806 129 337 July July NNP blog-archive-org-5806 129 338 2009 2009 CD blog-archive-org-5806 129 339 June June NNP blog-archive-org-5806 129 340 2009 2009 CD blog-archive-org-5806 129 341 May May NNP blog-archive-org-5806 129 342 2009 2009 CD blog-archive-org-5806 129 343 April April NNP blog-archive-org-5806 129 344 2009 2009 CD blog-archive-org-5806 129 345 March March NNP blog-archive-org-5806 129 346 2009 2009 CD blog-archive-org-5806 129 347 February February NNP blog-archive-org-5806 129 348 2009 2009 CD blog-archive-org-5806 129 349 January January NNP blog-archive-org-5806 129 350 2009 2009 CD blog-archive-org-5806 129 351 December December NNP blog-archive-org-5806 129 352 2008 2008 CD blog-archive-org-5806 129 353 November November NNP blog-archive-org-5806 129 354 2008 2008 CD blog-archive-org-5806 129 355 September September NNP blog-archive-org-5806 129 356 2008 2008 CD blog-archive-org-5806 129 357 August August NNP blog-archive-org-5806 129 358 2008 2008 CD blog-archive-org-5806 129 359 June June NNP blog-archive-org-5806 129 360 2008 2008 CD blog-archive-org-5806 129 361 May May NNP blog-archive-org-5806 129 362 2008 2008 CD blog-archive-org-5806 129 363 April April NNP blog-archive-org-5806 129 364 2008 2008 CD blog-archive-org-5806 129 365 March March NNP blog-archive-org-5806 129 366 2008 2008 CD blog-archive-org-5806 129 367 February February NNP blog-archive-org-5806 129 368 2008 2008 CD blog-archive-org-5806 129 369 January January NNP blog-archive-org-5806 129 370 2008 2008 CD blog-archive-org-5806 129 371 December December NNP blog-archive-org-5806 129 372 2007 2007 CD blog-archive-org-5806 129 373 October October NNP blog-archive-org-5806 129 374 2007 2007 CD blog-archive-org-5806 129 375 September September NNP blog-archive-org-5806 129 376 2007 2007 CD blog-archive-org-5806 129 377 August August NNP blog-archive-org-5806 129 378 2007 2007 CD blog-archive-org-5806 129 379 July July NNP blog-archive-org-5806 129 380 2007 2007 CD blog-archive-org-5806 129 381 June June NNP blog-archive-org-5806 129 382 2007 2007 CD blog-archive-org-5806 129 383 May May NNP blog-archive-org-5806 129 384 2007 2007 CD blog-archive-org-5806 129 385 April April NNP blog-archive-org-5806 129 386 2007 2007 CD blog-archive-org-5806 129 387 March March NNP blog-archive-org-5806 129 388 2007 2007 CD blog-archive-org-5806 129 389 February February NNP blog-archive-org-5806 129 390 2007 2007 CD blog-archive-org-5806 129 391 January January NNP blog-archive-org-5806 129 392 2007 2007 CD blog-archive-org-5806 129 393 December December NNP blog-archive-org-5806 129 394 2006 2006 CD blog-archive-org-5806 129 395 November November NNP blog-archive-org-5806 129 396 2006 2006 CD blog-archive-org-5806 129 397 October October NNP blog-archive-org-5806 129 398 2006 2006 CD blog-archive-org-5806 129 399 September September NNP blog-archive-org-5806 129 400 2006 2006 CD blog-archive-org-5806 129 401 August August NNP blog-archive-org-5806 129 402 2006 2006 CD blog-archive-org-5806 129 403 February February NNP blog-archive-org-5806 129 404 2006 2006 CD blog-archive-org-5806 129 405 November November NNP blog-archive-org-5806 129 406 2005 2005 CD blog-archive-org-5806 129 407 October October NNP blog-archive-org-5806 129 408 2005 2005 CD blog-archive-org-5806 129 409 September September NNP blog-archive-org-5806 129 410 2005 2005 CD blog-archive-org-5806 129 411 March March NNP blog-archive-org-5806 129 412 2005 2005 CD blog-archive-org-5806 129 413 February February NNP blog-archive-org-5806 129 414 2005 2005 CD blog-archive-org-5806 129 415 January January NNP blog-archive-org-5806 129 416 2005 2005 CD blog-archive-org-5806 129 417 December December NNP blog-archive-org-5806 129 418 2004 2004 CD blog-archive-org-5806 129 419 October October NNP blog-archive-org-5806 129 420 2004 2004 CD blog-archive-org-5806 129 421 March March NNP blog-archive-org-5806 129 422 2004 2004 CD blog-archive-org-5806 129 423 Meta Meta NNP blog-archive-org-5806 129 424 Log Log NNP blog-archive-org-5806 129 425 in in IN blog-archive-org-5806 129 426 Entries entry NNS blog-archive-org-5806 129 427 feed feed VBP blog-archive-org-5806 129 428 Comments comment NNS blog-archive-org-5806 129 429 feed feed VB blog-archive-org-5806 129 430 WordPress.org WordPress.org -LRB- blog-archive-org-5806 129 431 Proudly proudly RB blog-archive-org-5806 129 432 powered power VBN blog-archive-org-5806 129 433 by by IN blog-archive-org-5806 129 434 WordPress WordPress NNP