id sid tid token lemma pos news-docnow-io-1641 1 1 twarc2 twarc2 NNP news-docnow-io-1641 1 2 . . . news-docnow-io-1641 2 1 twarc twarc NNP news-docnow-io-1641 2 2 has have VBZ news-docnow-io-1641 2 3 been be VBN news-docnow-io-1641 2 4 redesigned redesign VBN news-docnow-io-1641 2 5 from from IN news-docnow-io-1641 2 6 the the DT news-docnow-io-1641 2 7 … … SYM news-docnow-io-1641 2 8 | | NN news-docnow-io-1641 2 9 by by IN news-docnow-io-1641 2 10 Ed Ed NNP news-docnow-io-1641 2 11 Summers Summers NNP news-docnow-io-1641 2 12 | | NNP news-docnow-io-1641 2 13 Apr Apr NNP news-docnow-io-1641 2 14 , , , news-docnow-io-1641 2 15 2021 2021 CD news-docnow-io-1641 2 16 | | NN news-docnow-io-1641 2 17 Documenting document VBG news-docnow-io-1641 2 18 DocNow DocNow NNP news-docnow-io-1641 2 19 Sign Sign NNP news-docnow-io-1641 2 20 in in IN news-docnow-io-1641 2 21 Tweets Tweets NNPS news-docnow-io-1641 2 22 + + SYM news-docnow-io-1641 2 23 Python Python NNP news-docnow-io-1641 2 24 + + SYM news-docnow-io-1641 2 25 Data datum NNS news-docnow-io-1641 2 26 = = SYM news-docnow-io-1641 2 27 twarctwarc2 twarctwarc2 NN news-docnow-io-1641 2 28 Ed Ed NNP news-docnow-io-1641 2 29 SummersFollow SummersFollow NNP news-docnow-io-1641 2 30 Apr Apr NNP news-docnow-io-1641 2 31 7 7 CD news-docnow-io-1641 2 32 · · SYM news-docnow-io-1641 2 33 11 11 CD news-docnow-io-1641 2 34 min min NN news-docnow-io-1641 2 35 read read VBD news-docnow-io-1641 2 36 twarc twarc NNP news-docnow-io-1641 2 37 has have VBZ news-docnow-io-1641 2 38 been be VBN news-docnow-io-1641 2 39 redesigned redesign VBN news-docnow-io-1641 2 40 from from IN news-docnow-io-1641 2 41 the the DT news-docnow-io-1641 2 42 ground ground NN news-docnow-io-1641 2 43 up up RP news-docnow-io-1641 2 44 to to TO news-docnow-io-1641 2 45 work work VB news-docnow-io-1641 2 46 with with IN news-docnow-io-1641 2 47 the the DT news-docnow-io-1641 2 48 new new JJ news-docnow-io-1641 2 49 Twitter Twitter NNP news-docnow-io-1641 2 50 v2 v2 NN news-docnow-io-1641 2 51 API api NN news-docnow-io-1641 2 52 and and CC news-docnow-io-1641 2 53 their -PRON- PRP$ news-docnow-io-1641 2 54 Academic Academic NNP news-docnow-io-1641 2 55 Research Research NNP news-docnow-io-1641 2 56 track track NN news-docnow-io-1641 2 57 . . . news-docnow-io-1641 3 1 Many many JJ news-docnow-io-1641 3 2 thanks thank NNS news-docnow-io-1641 3 3 for for IN news-docnow-io-1641 3 4 the the DT news-docnow-io-1641 3 5 code code NN news-docnow-io-1641 3 6 and and CC news-docnow-io-1641 3 7 design design NN news-docnow-io-1641 3 8 contributions contribution NNS news-docnow-io-1641 3 9 of of IN news-docnow-io-1641 3 10 Betsy Betsy NNP news-docnow-io-1641 3 11 Alpert Alpert NNP news-docnow-io-1641 3 12 , , , news-docnow-io-1641 3 13 Igor Igor NNP news-docnow-io-1641 3 14 Brigadir Brigadir NNP news-docnow-io-1641 3 15 , , , news-docnow-io-1641 3 16 Sam Sam NNP news-docnow-io-1641 3 17 Hames Hames NNP news-docnow-io-1641 3 18 , , , news-docnow-io-1641 3 19 Jeff Jeff NNP news-docnow-io-1641 3 20 Sauer Sauer NNP news-docnow-io-1641 3 21 , , , news-docnow-io-1641 3 22 and and CC news-docnow-io-1641 3 23 Daniel Daniel NNP news-docnow-io-1641 3 24 Verdeer Verdeer NNP news-docnow-io-1641 3 25 that that WDT news-docnow-io-1641 3 26 have have VBP news-docnow-io-1641 3 27 made make VBN news-docnow-io-1641 3 28 twarc2 twarc2 NN news-docnow-io-1641 3 29 possible possible JJ news-docnow-io-1641 3 30 , , , news-docnow-io-1641 3 31 as as RB news-docnow-io-1641 3 32 well well RB news-docnow-io-1641 3 33 as as IN news-docnow-io-1641 3 34 early early JJ news-docnow-io-1641 3 35 feedback feedback NN news-docnow-io-1641 3 36 from from IN news-docnow-io-1641 3 37 Dan Dan NNP news-docnow-io-1641 3 38 Kerchner Kerchner NNP news-docnow-io-1641 3 39 , , , news-docnow-io-1641 3 40 Shane Shane NNP news-docnow-io-1641 3 41 Lin Lin NNP news-docnow-io-1641 3 42 , , , news-docnow-io-1641 3 43 Miles Miles NNP news-docnow-io-1641 3 44 McCain McCain NNP news-docnow-io-1641 3 45 , , , news-docnow-io-1641 3 46 李荣蓬 李荣蓬 CC news-docnow-io-1641 3 47 , , , news-docnow-io-1641 3 48 David David NNP news-docnow-io-1641 3 49 Thiel Thiel NNP news-docnow-io-1641 3 50 , , , news-docnow-io-1641 3 51 Melanie Melanie NNP news-docnow-io-1641 3 52 Walsh Walsh NNP news-docnow-io-1641 3 53 and and CC news-docnow-io-1641 3 54 Laura Laura NNP news-docnow-io-1641 3 55 Wrubel Wrubel NNP news-docnow-io-1641 3 56 . . . news-docnow-io-1641 4 1 Extra extra JJ news-docnow-io-1641 4 2 special special JJ news-docnow-io-1641 4 3 thanks thank NNS news-docnow-io-1641 4 4 to to IN news-docnow-io-1641 4 5 the the DT news-docnow-io-1641 4 6 Institute Institute NNP news-docnow-io-1641 4 7 for for IN news-docnow-io-1641 4 8 Future Future NNP news-docnow-io-1641 4 9 Environments Environments NNP news-docnow-io-1641 4 10 at at IN news-docnow-io-1641 4 11 Queensland Queensland NNP news-docnow-io-1641 4 12 University University NNP news-docnow-io-1641 4 13 of of IN news-docnow-io-1641 4 14 Technology Technology NNP news-docnow-io-1641 4 15 for for IN news-docnow-io-1641 4 16 supporting support VBG news-docnow-io-1641 4 17 Betsy Betsy NNP news-docnow-io-1641 4 18 and and CC news-docnow-io-1641 4 19 Sam Sam NNP news-docnow-io-1641 4 20 in in IN news-docnow-io-1641 4 21 their -PRON- PRP$ news-docnow-io-1641 4 22 work work NN news-docnow-io-1641 4 23 , , , news-docnow-io-1641 4 24 and and CC news-docnow-io-1641 4 25 for for IN news-docnow-io-1641 4 26 the the DT news-docnow-io-1641 4 27 continued continue VBN news-docnow-io-1641 4 28 support support NN news-docnow-io-1641 4 29 of of IN news-docnow-io-1641 4 30 the the DT news-docnow-io-1641 4 31 Mellon Mellon NNP news-docnow-io-1641 4 32 Foundation Foundation NNP news-docnow-io-1641 4 33 . . . news-docnow-io-1641 5 1 Back back RB news-docnow-io-1641 5 2 in in IN news-docnow-io-1641 5 3 August August NNP news-docnow-io-1641 5 4 of of IN news-docnow-io-1641 5 5 last last JJ news-docnow-io-1641 5 6 year year NN news-docnow-io-1641 5 7 Twitter Twitter NNP news-docnow-io-1641 5 8 announced announce VBD news-docnow-io-1641 5 9 early early JJ news-docnow-io-1641 5 10 access access NN news-docnow-io-1641 5 11 to to IN news-docnow-io-1641 5 12 their -PRON- PRP$ news-docnow-io-1641 5 13 new new JJ news-docnow-io-1641 5 14 v2 v2 NN news-docnow-io-1641 5 15 API api NN news-docnow-io-1641 5 16 , , , news-docnow-io-1641 5 17 and and CC news-docnow-io-1641 5 18 their -PRON- PRP$ news-docnow-io-1641 5 19 plans plan NNS news-docnow-io-1641 5 20 to to TO news-docnow-io-1641 5 21 sunset sunset VB news-docnow-io-1641 5 22 the the DT news-docnow-io-1641 5 23 v1.1 v1.1 NN news-docnow-io-1641 5 24 API api NN news-docnow-io-1641 5 25 that that WDT news-docnow-io-1641 5 26 has have VBZ news-docnow-io-1641 5 27 been be VBN news-docnow-io-1641 5 28 active active JJ news-docnow-io-1641 5 29 for for IN news-docnow-io-1641 5 30 almost almost RB news-docnow-io-1641 5 31 the the DT news-docnow-io-1641 5 32 last last JJ news-docnow-io-1641 5 33 10 10 CD news-docnow-io-1641 5 34 years year NNS news-docnow-io-1641 5 35 . . . news-docnow-io-1641 6 1 Over over IN news-docnow-io-1641 6 2 the the DT news-docnow-io-1641 6 3 lifetime lifetime NN news-docnow-io-1641 6 4 of of IN news-docnow-io-1641 6 5 their -PRON- PRP$ news-docnow-io-1641 6 6 v1.1 v1.1 NN news-docnow-io-1641 6 7 API API NNP news-docnow-io-1641 6 8 Twitter Twitter NNP news-docnow-io-1641 6 9 has have VBZ news-docnow-io-1641 6 10 become become VBN news-docnow-io-1641 6 11 deeply deeply RB news-docnow-io-1641 6 12 embedded embed VBN news-docnow-io-1641 6 13 in in IN news-docnow-io-1641 6 14 the the DT news-docnow-io-1641 6 15 media medium NNS news-docnow-io-1641 6 16 landscape landscape NN news-docnow-io-1641 6 17 . . . news-docnow-io-1641 7 1 As as IN news-docnow-io-1641 7 2 magazines magazine NNS news-docnow-io-1641 7 3 , , , news-docnow-io-1641 7 4 newspapers newspaper NNS news-docnow-io-1641 7 5 and and CC news-docnow-io-1641 7 6 television television NN news-docnow-io-1641 7 7 have have VBP news-docnow-io-1641 7 8 moved move VBN news-docnow-io-1641 7 9 onto onto IN news-docnow-io-1641 7 10 the the DT news-docnow-io-1641 7 11 web web NN news-docnow-io-1641 7 12 they -PRON- PRP news-docnow-io-1641 7 13 have have VBP news-docnow-io-1641 7 14 increasingly increasingly RB news-docnow-io-1641 7 15 adopted adopt VBN news-docnow-io-1641 7 16 tweets tweet NNS news-docnow-io-1641 7 17 as as IN news-docnow-io-1641 7 18 a a DT news-docnow-io-1641 7 19 mechanism mechanism NN news-docnow-io-1641 7 20 for for IN news-docnow-io-1641 7 21 citing cite VBG news-docnow-io-1641 7 22 politicians politician NNS news-docnow-io-1641 7 23 , , , news-docnow-io-1641 7 24 celebrities celebrity NNS news-docnow-io-1641 7 25 and and CC news-docnow-io-1641 7 26 organizations organization NNS news-docnow-io-1641 7 27 , , , news-docnow-io-1641 7 28 while while IN news-docnow-io-1641 7 29 also also RB news-docnow-io-1641 7 30 using use VBG news-docnow-io-1641 7 31 them -PRON- PRP news-docnow-io-1641 7 32 to to TO news-docnow-io-1641 7 33 document document VB news-docnow-io-1641 7 34 current current JJ news-docnow-io-1641 7 35 events event NNS news-docnow-io-1641 7 36 , , , news-docnow-io-1641 7 37 generate generate VBP news-docnow-io-1641 7 38 leads lead NNS news-docnow-io-1641 7 39 and and CC news-docnow-io-1641 7 40 gather gather VB news-docnow-io-1641 7 41 feedback feedback NN news-docnow-io-1641 7 42 for for IN news-docnow-io-1641 7 43 evolving evolve VBG news-docnow-io-1641 7 44 stories story NNS news-docnow-io-1641 7 45 . . . news-docnow-io-1641 8 1 As as IN news-docnow-io-1641 8 2 a a DT news-docnow-io-1641 8 3 result result NN news-docnow-io-1641 8 4 Twitter Twitter NNP news-docnow-io-1641 8 5 has have VBZ news-docnow-io-1641 8 6 also also RB news-docnow-io-1641 8 7 become become VBN news-docnow-io-1641 8 8 a a DT news-docnow-io-1641 8 9 popular popular JJ news-docnow-io-1641 8 10 object object NN news-docnow-io-1641 8 11 of of IN news-docnow-io-1641 8 12 study study NN news-docnow-io-1641 8 13 for for IN news-docnow-io-1641 8 14 humanities humanity NNS news-docnow-io-1641 8 15 and and CC news-docnow-io-1641 8 16 social social JJ news-docnow-io-1641 8 17 science science NN news-docnow-io-1641 8 18 researchers researcher NNS news-docnow-io-1641 8 19 looking look VBG news-docnow-io-1641 8 20 to to TO news-docnow-io-1641 8 21 understand understand VB news-docnow-io-1641 8 22 the the DT news-docnow-io-1641 8 23 world world NN news-docnow-io-1641 8 24 as as IN news-docnow-io-1641 8 25 reflected reflect VBN news-docnow-io-1641 8 26 , , , news-docnow-io-1641 8 27 refracted refract VBN news-docnow-io-1641 8 28 and and CC news-docnow-io-1641 8 29 distorted distort VBN news-docnow-io-1641 8 30 by by IN news-docnow-io-1641 8 31 / / SYM news-docnow-io-1641 8 32 in in IN news-docnow-io-1641 8 33 social social JJ news-docnow-io-1641 8 34 media medium NNS news-docnow-io-1641 8 35 . . . news-docnow-io-1641 9 1 On on IN news-docnow-io-1641 9 2 the the DT news-docnow-io-1641 9 3 surface surface NN news-docnow-io-1641 9 4 the the DT news-docnow-io-1641 9 5 v2 v2 NN news-docnow-io-1641 9 6 API API NNP news-docnow-io-1641 9 7 update update NN news-docnow-io-1641 9 8 seems seem VBZ news-docnow-io-1641 9 9 pretty pretty RB news-docnow-io-1641 9 10 insignificant insignificant JJ news-docnow-io-1641 9 11 since since IN news-docnow-io-1641 9 12 the the DT news-docnow-io-1641 9 13 shape shape NN news-docnow-io-1641 9 14 of of IN news-docnow-io-1641 9 15 a a DT news-docnow-io-1641 9 16 tweet tweet NN news-docnow-io-1641 9 17 , , , news-docnow-io-1641 9 18 its -PRON- PRP$ news-docnow-io-1641 9 19 parts part NNS news-docnow-io-1641 9 20 , , , news-docnow-io-1641 9 21 properties property NNS news-docnow-io-1641 9 22 and and CC news-docnow-io-1641 9 23 affordances affordance NNS news-docnow-io-1641 9 24 , , , news-docnow-io-1641 9 25 are be VBP news-docnow-io-1641 9 26 n’t not RB news-docnow-io-1641 9 27 changing change VBG news-docnow-io-1641 9 28 at at RB news-docnow-io-1641 9 29 all all RB news-docnow-io-1641 9 30 . . . news-docnow-io-1641 10 1 Tweets tweet NNS news-docnow-io-1641 10 2 with with IN news-docnow-io-1641 10 3 280 280 CD news-docnow-io-1641 10 4 characters character NNS news-docnow-io-1641 10 5 of of IN news-docnow-io-1641 10 6 text text NN news-docnow-io-1641 10 7 , , , news-docnow-io-1641 10 8 images image NNS news-docnow-io-1641 10 9 and and CC news-docnow-io-1641 10 10 video video NN news-docnow-io-1641 10 11 will will MD news-docnow-io-1641 10 12 continue continue VB news-docnow-io-1641 10 13 to to TO news-docnow-io-1641 10 14 be be VB news-docnow-io-1641 10 15 posted post VBN news-docnow-io-1641 10 16 , , , news-docnow-io-1641 10 17 retweeted retweete VBN news-docnow-io-1641 10 18 and and CC news-docnow-io-1641 10 19 quoted quote VBN news-docnow-io-1641 10 20 . . . news-docnow-io-1641 11 1 However however RB news-docnow-io-1641 11 2 behind behind IN news-docnow-io-1641 11 3 the the DT news-docnow-io-1641 11 4 scenes scene NNS news-docnow-io-1641 11 5 the the DT news-docnow-io-1641 11 6 representation representation NN news-docnow-io-1641 11 7 of of IN news-docnow-io-1641 11 8 a a DT news-docnow-io-1641 11 9 tweet tweet NN news-docnow-io-1641 11 10 as as IN news-docnow-io-1641 11 11 data datum NNS news-docnow-io-1641 11 12 , , , news-docnow-io-1641 11 13 and and CC news-docnow-io-1641 11 14 the the DT news-docnow-io-1641 11 15 quotas quota NNS news-docnow-io-1641 11 16 that that WDT news-docnow-io-1641 11 17 control control VBP news-docnow-io-1641 11 18 the the DT news-docnow-io-1641 11 19 rates rate NNS news-docnow-io-1641 11 20 at at IN news-docnow-io-1641 11 21 which which WDT news-docnow-io-1641 11 22 this this DT news-docnow-io-1641 11 23 data data NN news-docnow-io-1641 11 24 can can MD news-docnow-io-1641 11 25 flow flow VB news-docnow-io-1641 11 26 between between IN news-docnow-io-1641 11 27 apps app NNS news-docnow-io-1641 11 28 and and CC news-docnow-io-1641 11 29 other other JJ news-docnow-io-1641 11 30 third third JJ news-docnow-io-1641 11 31 party party NN news-docnow-io-1641 11 32 services service NNS news-docnow-io-1641 11 33 will will MD news-docnow-io-1641 11 34 be be VB news-docnow-io-1641 11 35 greatly greatly RB news-docnow-io-1641 11 36 transformed transform VBN news-docnow-io-1641 11 37 . . . news-docnow-io-1641 12 1 Needless needless JJ news-docnow-io-1641 12 2 to to TO news-docnow-io-1641 12 3 say say VB news-docnow-io-1641 12 4 , , , news-docnow-io-1641 12 5 v2 v2 NN news-docnow-io-1641 12 6 represents represent VBZ news-docnow-io-1641 12 7 a a DT news-docnow-io-1641 12 8 big big JJ news-docnow-io-1641 12 9 change change NN news-docnow-io-1641 12 10 for for IN news-docnow-io-1641 12 11 the the DT news-docnow-io-1641 12 12 Documenting Documenting NNP news-docnow-io-1641 12 13 the the DT news-docnow-io-1641 12 14 Now Now NNP news-docnow-io-1641 12 15 project project NN news-docnow-io-1641 12 16 . . . news-docnow-io-1641 13 1 Along along IN news-docnow-io-1641 13 2 with with IN news-docnow-io-1641 13 3 community community NN news-docnow-io-1641 13 4 members member NNS news-docnow-io-1641 13 5 we -PRON- PRP news-docnow-io-1641 13 6 ’ve have VB news-docnow-io-1641 13 7 developed develop VBN news-docnow-io-1641 13 8 and and CC news-docnow-io-1641 13 9 maintained maintain VBN news-docnow-io-1641 13 10 open open JJ news-docnow-io-1641 13 11 source source NN news-docnow-io-1641 13 12 tools tool NNS news-docnow-io-1641 13 13 like like IN news-docnow-io-1641 13 14 twarc twarc NN news-docnow-io-1641 13 15 that that DT news-docnow-io-1641 13 16 talk talk NN news-docnow-io-1641 13 17 directly directly RB news-docnow-io-1641 13 18 to to IN news-docnow-io-1641 13 19 the the DT news-docnow-io-1641 13 20 Twitter Twitter NNP news-docnow-io-1641 13 21 API API NNP news-docnow-io-1641 13 22 to to TO news-docnow-io-1641 13 23 help help VB news-docnow-io-1641 13 24 users user NNS news-docnow-io-1641 13 25 to to TO news-docnow-io-1641 13 26 search search VB news-docnow-io-1641 13 27 for for IN news-docnow-io-1641 13 28 and and CC news-docnow-io-1641 13 29 collect collect VB news-docnow-io-1641 13 30 live live JJ news-docnow-io-1641 13 31 tweets tweet NNS news-docnow-io-1641 13 32 that that WDT news-docnow-io-1641 13 33 match match VBP news-docnow-io-1641 13 34 criteria criterion NNS news-docnow-io-1641 13 35 like like IN news-docnow-io-1641 13 36 hashtags hashtag NNS news-docnow-io-1641 13 37 , , , news-docnow-io-1641 13 38 names name NNS news-docnow-io-1641 13 39 and and CC news-docnow-io-1641 13 40 geographic geographic JJ news-docnow-io-1641 13 41 locations location NNS news-docnow-io-1641 13 42 . . . news-docnow-io-1641 14 1 Today today NN news-docnow-io-1641 14 2 we -PRON- PRP news-docnow-io-1641 14 3 ’re be VBP news-docnow-io-1641 14 4 excited excited JJ news-docnow-io-1641 14 5 to to TO news-docnow-io-1641 14 6 announce announce VB news-docnow-io-1641 14 7 the the DT news-docnow-io-1641 14 8 release release NN news-docnow-io-1641 14 9 of of IN news-docnow-io-1641 14 10 twarc twarc NN news-docnow-io-1641 14 11 v2 v2 NN news-docnow-io-1641 14 12 which which WDT news-docnow-io-1641 14 13 has have VBZ news-docnow-io-1641 14 14 been be VBN news-docnow-io-1641 14 15 designed design VBN news-docnow-io-1641 14 16 from from IN news-docnow-io-1641 14 17 the the DT news-docnow-io-1641 14 18 ground ground NN news-docnow-io-1641 14 19 up up RP news-docnow-io-1641 14 20 to to TO news-docnow-io-1641 14 21 work work VB news-docnow-io-1641 14 22 with with IN news-docnow-io-1641 14 23 the the DT news-docnow-io-1641 14 24 v2 v2 NN news-docnow-io-1641 14 25 API API NNP news-docnow-io-1641 14 26 and and CC news-docnow-io-1641 14 27 Twitter Twitter NNP news-docnow-io-1641 14 28 ’s ’s POS news-docnow-io-1641 14 29 new new JJ news-docnow-io-1641 14 30 Academic Academic NNP news-docnow-io-1641 14 31 Research Research NNP news-docnow-io-1641 14 32 track track NN news-docnow-io-1641 14 33 . . . news-docnow-io-1641 15 1 Clearly clearly RB news-docnow-io-1641 15 2 it -PRON- PRP news-docnow-io-1641 15 3 ’s ’ VBZ news-docnow-io-1641 15 4 extremely extremely RB news-docnow-io-1641 15 5 problematic problematic JJ news-docnow-io-1641 15 6 having have VBG news-docnow-io-1641 15 7 a a DT news-docnow-io-1641 15 8 multi multi JJ news-docnow-io-1641 15 9 - - JJ news-docnow-io-1641 15 10 national national JJ news-docnow-io-1641 15 11 corporation corporation NNP news-docnow-io-1641 15 12 act act NNP news-docnow-io-1641 15 13 as as IN news-docnow-io-1641 15 14 a a DT news-docnow-io-1641 15 15 gatekeeper gatekeeper NN news-docnow-io-1641 15 16 for for IN news-docnow-io-1641 15 17 who who WP news-docnow-io-1641 15 18 counts count VBZ news-docnow-io-1641 15 19 as as IN news-docnow-io-1641 15 20 an an DT news-docnow-io-1641 15 21 academic academic JJ news-docnow-io-1641 15 22 researcher researcher NN news-docnow-io-1641 15 23 , , , news-docnow-io-1641 15 24 and and CC news-docnow-io-1641 15 25 what what WP news-docnow-io-1641 15 26 constitutes constitute VBZ news-docnow-io-1641 15 27 academic academic JJ news-docnow-io-1641 15 28 research research NN news-docnow-io-1641 15 29 . . . news-docnow-io-1641 16 1 We -PRON- PRP news-docnow-io-1641 16 2 need need VBP news-docnow-io-1641 16 3 look look VB news-docnow-io-1641 16 4 no no RB news-docnow-io-1641 16 5 further further RB news-docnow-io-1641 16 6 than than IN news-docnow-io-1641 16 7 the the DT news-docnow-io-1641 16 8 recent recent JJ news-docnow-io-1641 16 9 experiences experience NNS news-docnow-io-1641 16 10 of of IN news-docnow-io-1641 16 11 Timnit Timnit NNP news-docnow-io-1641 16 12 Gebru Gebru NNP news-docnow-io-1641 16 13 and and CC news-docnow-io-1641 16 14 Margaret Margaret NNP news-docnow-io-1641 16 15 Mitchell Mitchell NNP news-docnow-io-1641 16 16 at at IN news-docnow-io-1641 16 17 Google Google NNP news-docnow-io-1641 16 18 for for IN news-docnow-io-1641 16 19 an an DT news-docnow-io-1641 16 20 example example NN news-docnow-io-1641 16 21 of of IN news-docnow-io-1641 16 22 what what WP news-docnow-io-1641 16 23 happens happen VBZ news-docnow-io-1641 16 24 when when WRB news-docnow-io-1641 16 25 research research NN news-docnow-io-1641 16 26 questions question NNS news-docnow-io-1641 16 27 run run VBP news-docnow-io-1641 16 28 up up RP news-docnow-io-1641 16 29 against against IN news-docnow-io-1641 16 30 the the DT news-docnow-io-1641 16 31 business business NN news-docnow-io-1641 16 32 objectives objective NNS news-docnow-io-1641 16 33 of of IN news-docnow-io-1641 16 34 capital capital NN news-docnow-io-1641 16 35 . . . news-docnow-io-1641 17 1 We -PRON- PRP news-docnow-io-1641 17 2 only only RB news-docnow-io-1641 17 3 know know VBP news-docnow-io-1641 17 4 their -PRON- PRP$ news-docnow-io-1641 17 5 stories story NNS news-docnow-io-1641 17 6 because because IN news-docnow-io-1641 17 7 Gebru Gebru NNP news-docnow-io-1641 17 8 and and CC news-docnow-io-1641 17 9 Mitchell Mitchell NNP news-docnow-io-1641 17 10 ’s ’s POS news-docnow-io-1641 17 11 bravely bravely RB news-docnow-io-1641 17 12 took take VBD news-docnow-io-1641 17 13 a a DT news-docnow-io-1641 17 14 principled principle VBN news-docnow-io-1641 17 15 approach approach NN news-docnow-io-1641 17 16 , , , news-docnow-io-1641 17 17 where where WRB news-docnow-io-1641 17 18 many many JJ news-docnow-io-1641 17 19 researchers researcher NNS news-docnow-io-1641 17 20 would would MD news-docnow-io-1641 17 21 have have VB news-docnow-io-1641 17 22 knowingly knowingly RB news-docnow-io-1641 17 23 or or CC news-docnow-io-1641 17 24 unknowingly unknowingly RB news-docnow-io-1641 17 25 shaped shape VBD news-docnow-io-1641 17 26 their -PRON- PRP$ news-docnow-io-1641 17 27 research research NN news-docnow-io-1641 17 28 to to TO news-docnow-io-1641 17 29 better well RBR news-docnow-io-1641 17 30 fit fit VB news-docnow-io-1641 17 31 the the DT news-docnow-io-1641 17 32 needs need NNS news-docnow-io-1641 17 33 of of IN news-docnow-io-1641 17 34 the the DT news-docnow-io-1641 17 35 company company NN news-docnow-io-1641 17 36 . . . news-docnow-io-1641 18 1 So so CC news-docnow-io-1641 18 2 it -PRON- PRP news-docnow-io-1641 18 3 is be VBZ news-docnow-io-1641 18 4 important important JJ news-docnow-io-1641 18 5 for for IN news-docnow-io-1641 18 6 us -PRON- PRP news-docnow-io-1641 18 7 that that WDT news-docnow-io-1641 18 8 twarc twarc NNP news-docnow-io-1641 18 9 still still RB news-docnow-io-1641 18 10 be be VB news-docnow-io-1641 18 11 usable usable JJ news-docnow-io-1641 18 12 by by IN news-docnow-io-1641 18 13 people people NNS news-docnow-io-1641 18 14 with with IN news-docnow-io-1641 18 15 and and CC news-docnow-io-1641 18 16 without without IN news-docnow-io-1641 18 17 access access NN news-docnow-io-1641 18 18 to to IN news-docnow-io-1641 18 19 the the DT news-docnow-io-1641 18 20 Academic Academic NNP news-docnow-io-1641 18 21 Research Research NNP news-docnow-io-1641 18 22 Track Track NNP news-docnow-io-1641 18 23 . . . news-docnow-io-1641 19 1 But but CC news-docnow-io-1641 19 2 we -PRON- PRP news-docnow-io-1641 19 3 have have VBP news-docnow-io-1641 19 4 heard hear VBN news-docnow-io-1641 19 5 from from IN news-docnow-io-1641 19 6 many many JJ news-docnow-io-1641 19 7 users user NNS news-docnow-io-1641 19 8 that that WDT news-docnow-io-1641 19 9 the the DT news-docnow-io-1641 19 10 Academic Academic NNP news-docnow-io-1641 19 11 Research Research NNP news-docnow-io-1641 19 12 Track Track NNP news-docnow-io-1641 19 13 presents present VBZ news-docnow-io-1641 19 14 new new JJ news-docnow-io-1641 19 15 opportunities opportunity NNS news-docnow-io-1641 19 16 for for IN news-docnow-io-1641 19 17 Twitter Twitter NNP news-docnow-io-1641 19 18 data datum NNS news-docnow-io-1641 19 19 collection collection NN news-docnow-io-1641 19 20 that that WDT news-docnow-io-1641 19 21 are be VBP news-docnow-io-1641 19 22 essential essential JJ news-docnow-io-1641 19 23 for for IN news-docnow-io-1641 19 24 researchers researcher NNS news-docnow-io-1641 19 25 interested interest VBN news-docnow-io-1641 19 26 in in IN news-docnow-io-1641 19 27 the the DT news-docnow-io-1641 19 28 observability observability NN news-docnow-io-1641 19 29 of of IN news-docnow-io-1641 19 30 social social JJ news-docnow-io-1641 19 31 media medium NNS news-docnow-io-1641 19 32 platforms platform NNS news-docnow-io-1641 19 33 . . . news-docnow-io-1641 20 1 Twitter Twitter NNP news-docnow-io-1641 20 2 is be VBZ news-docnow-io-1641 20 3 making make VBG news-docnow-io-1641 20 4 a a DT news-docnow-io-1641 20 5 good good JJ news-docnow-io-1641 20 6 faith faith NN news-docnow-io-1641 20 7 effort effort NN news-docnow-io-1641 20 8 to to TO news-docnow-io-1641 20 9 work work VB news-docnow-io-1641 20 10 with with IN news-docnow-io-1641 20 11 the the DT news-docnow-io-1641 20 12 academic academic JJ news-docnow-io-1641 20 13 research research NN news-docnow-io-1641 20 14 community community NN news-docnow-io-1641 20 15 , , , news-docnow-io-1641 20 16 and and CC news-docnow-io-1641 20 17 we -PRON- PRP news-docnow-io-1641 20 18 thought think VBD news-docnow-io-1641 20 19 twarc twarc NNP news-docnow-io-1641 20 20 should should MD news-docnow-io-1641 20 21 support support VB news-docnow-io-1641 20 22 it -PRON- PRP news-docnow-io-1641 20 23 , , , news-docnow-io-1641 20 24 even even RB news-docnow-io-1641 20 25 if if IN news-docnow-io-1641 20 26 big big JJ news-docnow-io-1641 20 27 challenges challenge NNS news-docnow-io-1641 20 28 lie lie VBP news-docnow-io-1641 20 29 ahead ahead RB news-docnow-io-1641 20 30 . . . news-docnow-io-1641 21 1 So so RB news-docnow-io-1641 21 2 why why WRB news-docnow-io-1641 21 3 are be VBP news-docnow-io-1641 21 4 people people NNS news-docnow-io-1641 21 5 interested interested JJ news-docnow-io-1641 21 6 in in IN news-docnow-io-1641 21 7 the the DT news-docnow-io-1641 21 8 Academic Academic NNP news-docnow-io-1641 21 9 Research Research NNP news-docnow-io-1641 21 10 Track Track NNP news-docnow-io-1641 21 11 ? ? . news-docnow-io-1641 22 1 Once once IN news-docnow-io-1641 22 2 your -PRON- PRP$ news-docnow-io-1641 22 3 application application NN news-docnow-io-1641 22 4 has have VBZ news-docnow-io-1641 22 5 been be VBN news-docnow-io-1641 22 6 approved approve VBN news-docnow-io-1641 22 7 you -PRON- PRP news-docnow-io-1641 22 8 are be VBP news-docnow-io-1641 22 9 able able JJ news-docnow-io-1641 22 10 to to TO news-docnow-io-1641 22 11 collect collect VB news-docnow-io-1641 22 12 data datum NNS news-docnow-io-1641 22 13 from from IN news-docnow-io-1641 22 14 the the DT news-docnow-io-1641 22 15 full full JJ news-docnow-io-1641 22 16 history history NN news-docnow-io-1641 22 17 of of IN news-docnow-io-1641 22 18 Tweets Tweets NNPS news-docnow-io-1641 22 19 , , , news-docnow-io-1641 22 20 at at IN news-docnow-io-1641 22 21 no no DT news-docnow-io-1641 22 22 cost cost NN news-docnow-io-1641 22 23 . . . news-docnow-io-1641 23 1 This this DT news-docnow-io-1641 23 2 is be VBZ news-docnow-io-1641 23 3 a a DT news-docnow-io-1641 23 4 massive massive JJ news-docnow-io-1641 23 5 improvement improvement NN news-docnow-io-1641 23 6 over over IN news-docnow-io-1641 23 7 the the DT news-docnow-io-1641 23 8 v1.1 v1.1 NNP news-docnow-io-1641 23 9 access access NN news-docnow-io-1641 23 10 which which WDT news-docnow-io-1641 23 11 was be VBD news-docnow-io-1641 23 12 limited limit VBN news-docnow-io-1641 23 13 to to IN news-docnow-io-1641 23 14 a a DT news-docnow-io-1641 23 15 one one CD news-docnow-io-1641 23 16 week week NN news-docnow-io-1641 23 17 window window NN news-docnow-io-1641 23 18 and and CC news-docnow-io-1641 23 19 researchers researcher NNS news-docnow-io-1641 23 20 had have VBD news-docnow-io-1641 23 21 to to TO news-docnow-io-1641 23 22 pay pay VB news-docnow-io-1641 23 23 for for IN news-docnow-io-1641 23 24 access access NN news-docnow-io-1641 23 25 . . . news-docnow-io-1641 24 1 Access access NN news-docnow-io-1641 24 2 to to IN news-docnow-io-1641 24 3 the the DT news-docnow-io-1641 24 4 full full JJ news-docnow-io-1641 24 5 archive archive NN news-docnow-io-1641 24 6 means mean VBZ news-docnow-io-1641 24 7 it -PRON- PRP news-docnow-io-1641 24 8 ’s ’ VBZ news-docnow-io-1641 24 9 now now RB news-docnow-io-1641 24 10 possible possible JJ news-docnow-io-1641 24 11 to to TO news-docnow-io-1641 24 12 study study VB news-docnow-io-1641 24 13 events event NNS news-docnow-io-1641 24 14 that that WDT news-docnow-io-1641 24 15 have have VBP news-docnow-io-1641 24 16 happened happen VBN news-docnow-io-1641 24 17 in in IN news-docnow-io-1641 24 18 the the DT news-docnow-io-1641 24 19 past past NN news-docnow-io-1641 24 20 back back RB news-docnow-io-1641 24 21 to to IN news-docnow-io-1641 24 22 the the DT news-docnow-io-1641 24 23 beginning beginning NN news-docnow-io-1641 24 24 of of IN news-docnow-io-1641 24 25 Twitter Twitter NNP news-docnow-io-1641 24 26 in in IN news-docnow-io-1641 24 27 2006 2006 CD news-docnow-io-1641 24 28 . . . news-docnow-io-1641 25 1 If if IN news-docnow-io-1641 25 2 you -PRON- PRP news-docnow-io-1641 25 3 do do VBP news-docnow-io-1641 25 4 create create VB news-docnow-io-1641 25 5 any any DT news-docnow-io-1641 25 6 historical historical JJ news-docnow-io-1641 25 7 datasets dataset NNS news-docnow-io-1641 25 8 we -PRON- PRP news-docnow-io-1641 25 9 ’d ’d , news-docnow-io-1641 25 10 love love VB news-docnow-io-1641 25 11 for for IN news-docnow-io-1641 25 12 you -PRON- PRP news-docnow-io-1641 25 13 to to TO news-docnow-io-1641 25 14 share share VB news-docnow-io-1641 25 15 the the DT news-docnow-io-1641 25 16 tweet tweet JJ news-docnow-io-1641 25 17 identifier identifier NN news-docnow-io-1641 25 18 datasets dataset NNS news-docnow-io-1641 25 19 in in IN news-docnow-io-1641 25 20 The the DT news-docnow-io-1641 25 21 Catalog Catalog NNP news-docnow-io-1641 25 22 . . . news-docnow-io-1641 26 1 However however RB news-docnow-io-1641 26 2 this this DT news-docnow-io-1641 26 3 opening opening NN news-docnow-io-1641 26 4 up up RP news-docnow-io-1641 26 5 of of IN news-docnow-io-1641 26 6 access access NN news-docnow-io-1641 26 7 on on IN news-docnow-io-1641 26 8 the the DT news-docnow-io-1641 26 9 one one CD news-docnow-io-1641 26 10 hand hand NN news-docnow-io-1641 26 11 comes come VBZ news-docnow-io-1641 26 12 with with IN news-docnow-io-1641 26 13 a a DT news-docnow-io-1641 26 14 simultaneous simultaneous JJ news-docnow-io-1641 26 15 contraction contraction NN news-docnow-io-1641 26 16 in in IN news-docnow-io-1641 26 17 terms term NNS news-docnow-io-1641 26 18 of of IN news-docnow-io-1641 26 19 how how WRB news-docnow-io-1641 26 20 much much JJ news-docnow-io-1641 26 21 data datum NNS news-docnow-io-1641 26 22 can can MD news-docnow-io-1641 26 23 be be VB news-docnow-io-1641 26 24 collected collect VBN news-docnow-io-1641 26 25 at at IN news-docnow-io-1641 26 26 one one CD news-docnow-io-1641 26 27 time time NN news-docnow-io-1641 26 28 . . . news-docnow-io-1641 27 1 The the DT news-docnow-io-1641 27 2 remainder remainder NN news-docnow-io-1641 27 3 of of IN news-docnow-io-1641 27 4 this this DT news-docnow-io-1641 27 5 post post NN news-docnow-io-1641 27 6 describes describe VBZ news-docnow-io-1641 27 7 some some DT news-docnow-io-1641 27 8 of of IN news-docnow-io-1641 27 9 the the DT news-docnow-io-1641 27 10 details detail NNS news-docnow-io-1641 27 11 and and CC news-docnow-io-1641 27 12 the the DT news-docnow-io-1641 27 13 design design NN news-docnow-io-1641 27 14 decisions decision NNS news-docnow-io-1641 27 15 we -PRON- PRP news-docnow-io-1641 27 16 have have VBP news-docnow-io-1641 27 17 made make VBN news-docnow-io-1641 27 18 with with IN news-docnow-io-1641 27 19 twarc2 twarc2 NN news-docnow-io-1641 27 20 to to TO news-docnow-io-1641 27 21 address address VB news-docnow-io-1641 27 22 them -PRON- PRP news-docnow-io-1641 27 23 . . . news-docnow-io-1641 28 1 If if IN news-docnow-io-1641 28 2 you -PRON- PRP news-docnow-io-1641 28 3 would would MD news-docnow-io-1641 28 4 prefer prefer VB news-docnow-io-1641 28 5 to to TO news-docnow-io-1641 28 6 watch watch VB news-docnow-io-1641 28 7 a a DT news-docnow-io-1641 28 8 quick quick JJ news-docnow-io-1641 28 9 introduction introduction NN news-docnow-io-1641 28 10 to to IN news-docnow-io-1641 28 11 using use VBG news-docnow-io-1641 28 12 twarc twarc NNP news-docnow-io-1641 28 13 v2 v2 NN news-docnow-io-1641 28 14 please please UH news-docnow-io-1641 28 15 check check VB news-docnow-io-1641 28 16 out out RP news-docnow-io-1641 28 17 this this DT news-docnow-io-1641 28 18 short short JJ news-docnow-io-1641 28 19 video video NN news-docnow-io-1641 28 20 : : : news-docnow-io-1641 28 21 Installation installation NN news-docnow-io-1641 28 22 If if IN news-docnow-io-1641 28 23 you -PRON- PRP news-docnow-io-1641 28 24 are be VBP news-docnow-io-1641 28 25 familiar familiar JJ news-docnow-io-1641 28 26 with with IN news-docnow-io-1641 28 27 installing instal VBG news-docnow-io-1641 28 28 twarc twarc NNP news-docnow-io-1641 28 29 nothing nothing NN news-docnow-io-1641 28 30 is be VBZ news-docnow-io-1641 28 31 changed change VBN news-docnow-io-1641 28 32 . . . news-docnow-io-1641 29 1 You -PRON- PRP news-docnow-io-1641 29 2 still still RB news-docnow-io-1641 29 3 install install VBP news-docnow-io-1641 29 4 ( ( -LRB- news-docnow-io-1641 29 5 or or CC news-docnow-io-1641 29 6 upgrade upgrade VB news-docnow-io-1641 29 7 ) ) -RRB- news-docnow-io-1641 29 8 with with IN news-docnow-io-1641 29 9 pip pip NNP news-docnow-io-1641 29 10 as as IN news-docnow-io-1641 29 11 you -PRON- PRP news-docnow-io-1641 29 12 did do VBD news-docnow-io-1641 29 13 before before RB news-docnow-io-1641 29 14 : : : news-docnow-io-1641 29 15 $ $ $ news-docnow-io-1641 29 16 pip pip NN news-docnow-io-1641 29 17 install install NN news-docnow-io-1641 29 18 --upgrade --upgrade NN news-docnow-io-1641 29 19 twarc twarc NN news-docnow-io-1641 29 20 In in IN news-docnow-io-1641 29 21 fact fact NN news-docnow-io-1641 29 22 you -PRON- PRP news-docnow-io-1641 29 23 will will MD news-docnow-io-1641 29 24 still still RB news-docnow-io-1641 29 25 have have VB news-docnow-io-1641 29 26 full full JJ news-docnow-io-1641 29 27 access access NN news-docnow-io-1641 29 28 to to IN news-docnow-io-1641 29 29 the the DT news-docnow-io-1641 29 30 v1.1 v1.1 NN news-docnow-io-1641 29 31 API api NN news-docnow-io-1641 29 32 just just RB news-docnow-io-1641 29 33 as as IN news-docnow-io-1641 29 34 you -PRON- PRP news-docnow-io-1641 29 35 did do VBD news-docnow-io-1641 29 36 before before RB news-docnow-io-1641 29 37 . . . news-docnow-io-1641 30 1 So so RB news-docnow-io-1641 30 2 the the DT news-docnow-io-1641 30 3 old old JJ news-docnow-io-1641 30 4 commands command NNS news-docnow-io-1641 30 5 will will MD news-docnow-io-1641 30 6 continue continue VB news-docnow-io-1641 30 7 to to TO news-docnow-io-1641 30 8 work work VB news-docnow-io-1641 30 9 as as IN news-docnow-io-1641 30 10 they -PRON- PRP news-docnow-io-1641 30 11 did¹ did¹ VBP news-docnow-io-1641 30 12 $ $ $ news-docnow-io-1641 30 13 twarc twarc NN news-docnow-io-1641 30 14 search search NN news-docnow-io-1641 30 15 blacklivesmatter blacklivesmatter NN news-docnow-io-1641 30 16 > > NFP news-docnow-io-1641 30 17 tweets.jsonl tweets.jsonl NNP news-docnow-io-1641 30 18 twarc2 twarc2 NN news-docnow-io-1641 30 19 was be VBD news-docnow-io-1641 30 20 designed design VBN news-docnow-io-1641 30 21 to to TO news-docnow-io-1641 30 22 let let VB news-docnow-io-1641 30 23 you -PRON- PRP news-docnow-io-1641 30 24 to to TO news-docnow-io-1641 30 25 continue continue VB news-docnow-io-1641 30 26 to to TO news-docnow-io-1641 30 27 use use VB news-docnow-io-1641 30 28 Twitter Twitter NNP news-docnow-io-1641 30 29 ’s ’s POS news-docnow-io-1641 30 30 v1.1 v1.1 JJ news-docnow-io-1641 30 31 API api NN news-docnow-io-1641 30 32 undisturbed undisturbed JJ news-docnow-io-1641 30 33 until until IN news-docnow-io-1641 30 34 it -PRON- PRP news-docnow-io-1641 30 35 is be VBZ news-docnow-io-1641 30 36 finally finally RB news-docnow-io-1641 30 37 turned turn VBN news-docnow-io-1641 30 38 off off RP news-docnow-io-1641 30 39 by by IN news-docnow-io-1641 30 40 Twitter Twitter NNP news-docnow-io-1641 30 41 , , , news-docnow-io-1641 30 42 at at IN news-docnow-io-1641 30 43 which which WDT news-docnow-io-1641 30 44 point point NN news-docnow-io-1641 30 45 the the DT news-docnow-io-1641 30 46 functionality functionality NN news-docnow-io-1641 30 47 will will MD news-docnow-io-1641 30 48 be be VB news-docnow-io-1641 30 49 removed remove VBN news-docnow-io-1641 30 50 from from IN news-docnow-io-1641 30 51 twarc twarc NN news-docnow-io-1641 30 52 . . . news-docnow-io-1641 31 1 All all PDT news-docnow-io-1641 31 2 the the DT news-docnow-io-1641 31 3 support support NN news-docnow-io-1641 31 4 for for IN news-docnow-io-1641 31 5 the the DT news-docnow-io-1641 31 6 v2 v2 NN news-docnow-io-1641 31 7 API API NNP news-docnow-io-1641 31 8 is be VBZ news-docnow-io-1641 31 9 mediated mediate VBN news-docnow-io-1641 31 10 by by IN news-docnow-io-1641 31 11 a a DT news-docnow-io-1641 31 12 new new JJ news-docnow-io-1641 31 13 command command NN news-docnow-io-1641 31 14 line line NN news-docnow-io-1641 31 15 utility utility NN news-docnow-io-1641 31 16 twarc2 twarc2 NN news-docnow-io-1641 31 17 . . . news-docnow-io-1641 32 1 For for IN news-docnow-io-1641 32 2 example example NN news-docnow-io-1641 32 3 to to TO news-docnow-io-1641 32 4 search search VB news-docnow-io-1641 32 5 for for IN news-docnow-io-1641 32 6 blacklivesmatter blacklivesmatter NN news-docnow-io-1641 32 7 tweets tweet NNS news-docnow-io-1641 32 8 and and CC news-docnow-io-1641 32 9 write write VB news-docnow-io-1641 32 10 them -PRON- PRP news-docnow-io-1641 32 11 to to IN news-docnow-io-1641 32 12 a a DT news-docnow-io-1641 32 13 file file NN news-docnow-io-1641 32 14 tweets.jsonl tweets.jsonl NN news-docnow-io-1641 32 15 * * NFP news-docnow-io-1641 32 16 $ $ $ news-docnow-io-1641 32 17 twarc2 twarc2 NN news-docnow-io-1641 32 18 search search NN news-docnow-io-1641 32 19 blacklivesmatter blacklivesmatter NN news-docnow-io-1641 32 20 > > XX news-docnow-io-1641 32 21 tweets.jsonl tweets.jsonl NNP news-docnow-io-1641 32 22 All all PDT news-docnow-io-1641 32 23 the the DT news-docnow-io-1641 32 24 usual usual JJ news-docnow-io-1641 32 25 twarc twarc NN news-docnow-io-1641 32 26 functionality functionality NN news-docnow-io-1641 32 27 such such JJ news-docnow-io-1641 32 28 as as IN news-docnow-io-1641 32 29 searching search VBG news-docnow-io-1641 32 30 for for IN news-docnow-io-1641 32 31 tweets tweet NNS news-docnow-io-1641 32 32 , , , news-docnow-io-1641 32 33 collecting collect VBG news-docnow-io-1641 32 34 live live JJ news-docnow-io-1641 32 35 tweets tweet NNS news-docnow-io-1641 32 36 from from IN news-docnow-io-1641 32 37 the the DT news-docnow-io-1641 32 38 streaming stream VBG news-docnow-io-1641 32 39 API API NNP news-docnow-io-1641 32 40 endpoint endpoint NN news-docnow-io-1641 32 41 , , , news-docnow-io-1641 32 42 requesting request VBG news-docnow-io-1641 32 43 user user NN news-docnow-io-1641 32 44 timelines timeline NNS news-docnow-io-1641 32 45 and and CC news-docnow-io-1641 32 46 user user NN news-docnow-io-1641 32 47 metadata metadata NN news-docnow-io-1641 32 48 are be VBP news-docnow-io-1641 32 49 all all DT news-docnow-io-1641 32 50 still still RB news-docnow-io-1641 32 51 there there RB news-docnow-io-1641 32 52 , , , news-docnow-io-1641 32 53 twarc2 twarc2 NN news-docnow-io-1641 32 54 --help --help NN news-docnow-io-1641 32 55 gives give VBZ news-docnow-io-1641 32 56 you -PRON- PRP news-docnow-io-1641 32 57 the the DT news-docnow-io-1641 32 58 details detail NNS news-docnow-io-1641 32 59 . . . news-docnow-io-1641 33 1 But but CC news-docnow-io-1641 33 2 while while IN news-docnow-io-1641 33 3 the the DT news-docnow-io-1641 33 4 interface interface NN news-docnow-io-1641 33 5 looks look VBZ news-docnow-io-1641 33 6 the the DT news-docnow-io-1641 33 7 same same JJ news-docnow-io-1641 33 8 there there EX news-docnow-io-1641 33 9 's be VBZ news-docnow-io-1641 33 10 quite quite PDT news-docnow-io-1641 33 11 a a DT news-docnow-io-1641 33 12 bit bit NN news-docnow-io-1641 33 13 different different JJ news-docnow-io-1641 33 14 going go VBG news-docnow-io-1641 33 15 on on RP news-docnow-io-1641 33 16 behind behind IN news-docnow-io-1641 33 17 the the DT news-docnow-io-1641 33 18 scenes scene NNS news-docnow-io-1641 33 19 . . . news-docnow-io-1641 34 1 Representation representation NN news-docnow-io-1641 34 2 Truth truth NN news-docnow-io-1641 34 3 be be VB news-docnow-io-1641 34 4 told tell VBN news-docnow-io-1641 34 5 , , , news-docnow-io-1641 34 6 there there EX news-docnow-io-1641 34 7 is be VBZ news-docnow-io-1641 34 8 no no DT news-docnow-io-1641 34 9 shortage shortage NN news-docnow-io-1641 34 10 of of IN news-docnow-io-1641 34 11 open open JJ news-docnow-io-1641 34 12 source source NN news-docnow-io-1641 34 13 libraries library NNS news-docnow-io-1641 34 14 and and CC news-docnow-io-1641 34 15 tools tool NNS news-docnow-io-1641 34 16 for for IN news-docnow-io-1641 34 17 interacting interact VBG news-docnow-io-1641 34 18 with with IN news-docnow-io-1641 34 19 the the DT news-docnow-io-1641 34 20 Twitter Twitter NNP news-docnow-io-1641 34 21 API API NNP news-docnow-io-1641 34 22 . . . news-docnow-io-1641 35 1 In in IN news-docnow-io-1641 35 2 the the DT news-docnow-io-1641 35 3 past past NN news-docnow-io-1641 35 4 twarc twarc NNP news-docnow-io-1641 35 5 has have VBZ news-docnow-io-1641 35 6 made make VBN news-docnow-io-1641 35 7 a a DT news-docnow-io-1641 35 8 bit bit NN news-docnow-io-1641 35 9 of of IN news-docnow-io-1641 35 10 a a DT news-docnow-io-1641 35 11 name name NN news-docnow-io-1641 35 12 for for IN news-docnow-io-1641 35 13 itself -PRON- PRP news-docnow-io-1641 35 14 by by IN news-docnow-io-1641 35 15 catering cater VBG news-docnow-io-1641 35 16 to to IN news-docnow-io-1641 35 17 a a DT news-docnow-io-1641 35 18 niche niche NN news-docnow-io-1641 35 19 group group NN news-docnow-io-1641 35 20 of of IN news-docnow-io-1641 35 21 users user NNS news-docnow-io-1641 35 22 who who WP news-docnow-io-1641 35 23 want want VBP news-docnow-io-1641 35 24 a a DT news-docnow-io-1641 35 25 reliable reliable JJ news-docnow-io-1641 35 26 , , , news-docnow-io-1641 35 27 programmable programmable JJ news-docnow-io-1641 35 28 way way NN news-docnow-io-1641 35 29 to to TO news-docnow-io-1641 35 30 collect collect VB news-docnow-io-1641 35 31 the the DT news-docnow-io-1641 35 32 canonical canonical JJ news-docnow-io-1641 35 33 JSON JSON NNP news-docnow-io-1641 35 34 representation representation NN news-docnow-io-1641 35 35 of of IN news-docnow-io-1641 35 36 a a DT news-docnow-io-1641 35 37 tweet tweet NN news-docnow-io-1641 35 38 . . . news-docnow-io-1641 36 1 JavaScript JavaScript NNP news-docnow-io-1641 36 2 Object Object NNP news-docnow-io-1641 36 3 Notation notation NN news-docnow-io-1641 36 4 ( ( -LRB- news-docnow-io-1641 36 5 JSON JSON NNP news-docnow-io-1641 36 6 ) ) -RRB- news-docnow-io-1641 36 7 is be VBZ news-docnow-io-1641 36 8 the the DT news-docnow-io-1641 36 9 language language NN news-docnow-io-1641 36 10 of of IN news-docnow-io-1641 36 11 Web web NN news-docnow-io-1641 36 12 APIs api NNS news-docnow-io-1641 36 13 , , , news-docnow-io-1641 36 14 and and CC news-docnow-io-1641 36 15 Twitter Twitter NNP news-docnow-io-1641 36 16 has have VBZ news-docnow-io-1641 36 17 kept keep VBN news-docnow-io-1641 36 18 its -PRON- PRP$ news-docnow-io-1641 36 19 JSON JSON NNP news-docnow-io-1641 36 20 representation representation NN news-docnow-io-1641 36 21 of of IN news-docnow-io-1641 36 22 a a DT news-docnow-io-1641 36 23 tweet tweet NN news-docnow-io-1641 36 24 relatively relatively RB news-docnow-io-1641 36 25 stable stable JJ news-docnow-io-1641 36 26 over over IN news-docnow-io-1641 36 27 the the DT news-docnow-io-1641 36 28 years year NNS news-docnow-io-1641 36 29 . . . news-docnow-io-1641 37 1 Rather rather RB news-docnow-io-1641 37 2 than than IN news-docnow-io-1641 37 3 making make VBG news-docnow-io-1641 37 4 lots lot NNS news-docnow-io-1641 37 5 of of IN news-docnow-io-1641 37 6 decisions decision NNS news-docnow-io-1641 37 7 about about IN news-docnow-io-1641 37 8 the the DT news-docnow-io-1641 37 9 many many JJ news-docnow-io-1641 37 10 ways way NNS news-docnow-io-1641 37 11 you -PRON- PRP news-docnow-io-1641 37 12 might may MD news-docnow-io-1641 37 13 want want VB news-docnow-io-1641 37 14 to to TO news-docnow-io-1641 37 15 collect collect VB news-docnow-io-1641 37 16 , , , news-docnow-io-1641 37 17 model model VB news-docnow-io-1641 37 18 and and CC news-docnow-io-1641 37 19 analyze analyze VB news-docnow-io-1641 37 20 tweets tweet NNS news-docnow-io-1641 37 21 twarc twarc NNP news-docnow-io-1641 37 22 has have VBZ news-docnow-io-1641 37 23 tried try VBN news-docnow-io-1641 37 24 to to TO news-docnow-io-1641 37 25 do do VB news-docnow-io-1641 37 26 one one CD news-docnow-io-1641 37 27 thing thing NN news-docnow-io-1641 37 28 and and CC news-docnow-io-1641 37 29 do do VB news-docnow-io-1641 37 30 it -PRON- PRP news-docnow-io-1641 37 31 well well RB news-docnow-io-1641 37 32 ( ( -LRB- news-docnow-io-1641 37 33 data datum NNS news-docnow-io-1641 37 34 collection collection NN news-docnow-io-1641 37 35 ) ) -RRB- news-docnow-io-1641 37 36 and and CC news-docnow-io-1641 37 37 get get VB news-docnow-io-1641 37 38 out out IN news-docnow-io-1641 37 39 of of IN news-docnow-io-1641 37 40 the the DT news-docnow-io-1641 37 41 way way NN news-docnow-io-1641 37 42 so so IN news-docnow-io-1641 37 43 that that IN news-docnow-io-1641 37 44 you -PRON- PRP news-docnow-io-1641 37 45 can can MD news-docnow-io-1641 37 46 use use VB news-docnow-io-1641 37 47 ( ( -LRB- news-docnow-io-1641 37 48 or or CC news-docnow-io-1641 37 49 create create VB news-docnow-io-1641 37 50 ) ) -RRB- news-docnow-io-1641 37 51 the the DT news-docnow-io-1641 37 52 tools tool NNS news-docnow-io-1641 37 53 for for IN news-docnow-io-1641 37 54 putting put VBG news-docnow-io-1641 37 55 this this DT news-docnow-io-1641 37 56 data datum NNS news-docnow-io-1641 37 57 to to TO news-docnow-io-1641 37 58 use use VB news-docnow-io-1641 37 59 . . . news-docnow-io-1641 38 1 But but CC news-docnow-io-1641 38 2 the the DT news-docnow-io-1641 38 3 JSON JSON NNP news-docnow-io-1641 38 4 representation representation NN news-docnow-io-1641 38 5 of of IN news-docnow-io-1641 38 6 a a DT news-docnow-io-1641 38 7 tweet tweet NN news-docnow-io-1641 38 8 in in IN news-docnow-io-1641 38 9 the the DT news-docnow-io-1641 38 10 Twitter Twitter NNP news-docnow-io-1641 38 11 v2 v2 NN news-docnow-io-1641 38 12 API API NNP news-docnow-io-1641 38 13 is be VBZ news-docnow-io-1641 38 14 completely completely RB news-docnow-io-1641 38 15 burst burst VBN news-docnow-io-1641 38 16 apart apart RB news-docnow-io-1641 38 17 . . . news-docnow-io-1641 39 1 The the DT news-docnow-io-1641 39 2 v2 v2 NN news-docnow-io-1641 39 3 base base NN news-docnow-io-1641 39 4 representation representation NN news-docnow-io-1641 39 5 of of IN news-docnow-io-1641 39 6 a a DT news-docnow-io-1641 39 7 tweet tweet NN news-docnow-io-1641 39 8 is be VBZ news-docnow-io-1641 39 9 extremely extremely RB news-docnow-io-1641 39 10 lean lean JJ news-docnow-io-1641 39 11 and and CC news-docnow-io-1641 39 12 minimal minimal JJ news-docnow-io-1641 39 13 , , , news-docnow-io-1641 39 14 and and CC news-docnow-io-1641 39 15 just just RB news-docnow-io-1641 39 16 includes include VBZ news-docnow-io-1641 39 17 the the DT news-docnow-io-1641 39 18 text text NN news-docnow-io-1641 39 19 of of IN news-docnow-io-1641 39 20 the the DT news-docnow-io-1641 39 21 tweet tweet NNP news-docnow-io-1641 39 22 its -PRON- PRP$ news-docnow-io-1641 39 23 identifier identifier NN news-docnow-io-1641 39 24 and and CC news-docnow-io-1641 39 25 a a DT news-docnow-io-1641 39 26 handful handful NN news-docnow-io-1641 39 27 of of IN news-docnow-io-1641 39 28 other other JJ news-docnow-io-1641 39 29 things thing NNS news-docnow-io-1641 39 30 . . . news-docnow-io-1641 40 1 All all PDT news-docnow-io-1641 40 2 the the DT news-docnow-io-1641 40 3 details detail NNS news-docnow-io-1641 40 4 about about IN news-docnow-io-1641 40 5 the the DT news-docnow-io-1641 40 6 user user NN news-docnow-io-1641 40 7 who who WP news-docnow-io-1641 40 8 created create VBD news-docnow-io-1641 40 9 the the DT news-docnow-io-1641 40 10 tweet tweet NN news-docnow-io-1641 40 11 , , , news-docnow-io-1641 40 12 embedded embed VBN news-docnow-io-1641 40 13 media medium NNS news-docnow-io-1641 40 14 , , , news-docnow-io-1641 40 15 and and CC news-docnow-io-1641 40 16 more more JJR news-docnow-io-1641 40 17 are be VBP news-docnow-io-1641 40 18 not not RB news-docnow-io-1641 40 19 included include VBN news-docnow-io-1641 40 20 . . . news-docnow-io-1641 41 1 Fortunately fortunately RB news-docnow-io-1641 41 2 this this DT news-docnow-io-1641 41 3 information information NN news-docnow-io-1641 41 4 is be VBZ news-docnow-io-1641 41 5 still still RB news-docnow-io-1641 41 6 available available JJ news-docnow-io-1641 41 7 , , , news-docnow-io-1641 41 8 but but CC news-docnow-io-1641 41 9 the the DT news-docnow-io-1641 41 10 user user NN news-docnow-io-1641 41 11 needs need VBZ news-docnow-io-1641 41 12 to to TO news-docnow-io-1641 41 13 craft craft VB news-docnow-io-1641 41 14 their -PRON- PRP$ news-docnow-io-1641 41 15 API API NNP news-docnow-io-1641 41 16 request request NN news-docnow-io-1641 41 17 to to TO news-docnow-io-1641 41 18 request request VB news-docnow-io-1641 41 19 tweets tweet NNS news-docnow-io-1641 41 20 using use VBG news-docnow-io-1641 41 21 a a DT news-docnow-io-1641 41 22 set set NN news-docnow-io-1641 41 23 of of IN news-docnow-io-1641 41 24 expansions expansion NNS news-docnow-io-1641 41 25 that that WDT news-docnow-io-1641 41 26 tell tell VBP news-docnow-io-1641 41 27 the the DT news-docnow-io-1641 41 28 Twitter Twitter NNP news-docnow-io-1641 41 29 API api NN news-docnow-io-1641 41 30 what what WDT news-docnow-io-1641 41 31 additional additional JJ news-docnow-io-1641 41 32 entities entity NNS news-docnow-io-1641 41 33 to to TO news-docnow-io-1641 41 34 include include VB news-docnow-io-1641 41 35 . . . news-docnow-io-1641 42 1 In in IN news-docnow-io-1641 42 2 addition addition NN news-docnow-io-1641 42 3 for for IN news-docnow-io-1641 42 4 each each DT news-docnow-io-1641 42 5 expansion expansion NN news-docnow-io-1641 42 6 there there EX news-docnow-io-1641 42 7 are be VBP news-docnow-io-1641 42 8 a a DT news-docnow-io-1641 42 9 set set NN news-docnow-io-1641 42 10 of of IN news-docnow-io-1641 42 11 field field NN news-docnow-io-1641 42 12 options option NNS news-docnow-io-1641 42 13 to to TO news-docnow-io-1641 42 14 include include VB news-docnow-io-1641 42 15 that that DT news-docnow-io-1641 42 16 control control NN news-docnow-io-1641 42 17 what what WP news-docnow-io-1641 42 18 of of IN news-docnow-io-1641 42 19 these these DT news-docnow-io-1641 42 20 expansions expansion NNS news-docnow-io-1641 42 21 is be VBZ news-docnow-io-1641 42 22 returned return VBN news-docnow-io-1641 42 23 . . . news-docnow-io-1641 43 1 So so RB news-docnow-io-1641 43 2 rather rather RB news-docnow-io-1641 43 3 than than IN news-docnow-io-1641 43 4 there there EX news-docnow-io-1641 43 5 being be VBG news-docnow-io-1641 43 6 a a DT news-docnow-io-1641 43 7 single single JJ news-docnow-io-1641 43 8 JSON JSON NNP news-docnow-io-1641 43 9 representation representation NN news-docnow-io-1641 43 10 of of IN news-docnow-io-1641 43 11 a a DT news-docnow-io-1641 43 12 tweet tweet JJ news-docnow-io-1641 43 13 API api NN news-docnow-io-1641 43 14 users user NNS news-docnow-io-1641 43 15 now now RB news-docnow-io-1641 43 16 have have VBP news-docnow-io-1641 43 17 the the DT news-docnow-io-1641 43 18 ability ability NN news-docnow-io-1641 43 19 to to TO news-docnow-io-1641 43 20 shape shape VB news-docnow-io-1641 43 21 the the DT news-docnow-io-1641 43 22 data datum NNS news-docnow-io-1641 43 23 based base VBN news-docnow-io-1641 43 24 on on IN news-docnow-io-1641 43 25 what what WP news-docnow-io-1641 43 26 they -PRON- PRP news-docnow-io-1641 43 27 need need VBP news-docnow-io-1641 43 28 , , , news-docnow-io-1641 43 29 much much RB news-docnow-io-1641 43 30 like like IN news-docnow-io-1641 43 31 how how WRB news-docnow-io-1641 43 32 GraphQL GraphQL NNP news-docnow-io-1641 43 33 APIs api NNS news-docnow-io-1641 43 34 work work VBP news-docnow-io-1641 43 35 . . . news-docnow-io-1641 44 1 This this DT news-docnow-io-1641 44 2 kind kind NN news-docnow-io-1641 44 3 of of RB news-docnow-io-1641 44 4 makes make VBZ news-docnow-io-1641 44 5 you -PRON- PRP news-docnow-io-1641 44 6 wonder wonder VB news-docnow-io-1641 44 7 why why WRB news-docnow-io-1641 44 8 Twitter Twitter NNP news-docnow-io-1641 44 9 did do VBD news-docnow-io-1641 44 10 n’t not RB news-docnow-io-1641 44 11 make make VB news-docnow-io-1641 44 12 their -PRON- PRP$ news-docnow-io-1641 44 13 GraphQL GraphQL NNP news-docnow-io-1641 44 14 API api NN news-docnow-io-1641 44 15 available available JJ news-docnow-io-1641 44 16 . . . news-docnow-io-1641 45 1 For for IN news-docnow-io-1641 45 2 specific specific JJ news-docnow-io-1641 45 3 use use NN news-docnow-io-1641 45 4 cases case NNS news-docnow-io-1641 45 5 this this DT news-docnow-io-1641 45 6 customizability customizability NN news-docnow-io-1641 45 7 is be VBZ news-docnow-io-1641 45 8 very very RB news-docnow-io-1641 45 9 useful useful JJ news-docnow-io-1641 45 10 , , , news-docnow-io-1641 45 11 but but CC news-docnow-io-1641 45 12 the the DT news-docnow-io-1641 45 13 mutability mutability NN news-docnow-io-1641 45 14 of of IN news-docnow-io-1641 45 15 the the DT news-docnow-io-1641 45 16 representation representation NN news-docnow-io-1641 45 17 of of IN news-docnow-io-1641 45 18 a a DT news-docnow-io-1641 45 19 tweet tweet JJ news-docnow-io-1641 45 20 presents present NNS news-docnow-io-1641 45 21 challenges challenge NNS news-docnow-io-1641 45 22 when when WRB news-docnow-io-1641 45 23 collecting collect VBG news-docnow-io-1641 45 24 data datum NNS news-docnow-io-1641 45 25 for for IN news-docnow-io-1641 45 26 future future JJ news-docnow-io-1641 45 27 use use NN news-docnow-io-1641 45 28 . . . news-docnow-io-1641 46 1 If if IN news-docnow-io-1641 46 2 you -PRON- PRP news-docnow-io-1641 46 3 did do VBD news-docnow-io-1641 46 4 n’t not RB news-docnow-io-1641 46 5 request request VB news-docnow-io-1641 46 6 the the DT news-docnow-io-1641 46 7 right right JJ news-docnow-io-1641 46 8 expansions expansion NNS news-docnow-io-1641 46 9 or or CC news-docnow-io-1641 46 10 fields field NNS news-docnow-io-1641 46 11 when when WRB news-docnow-io-1641 46 12 collecting collect VBG news-docnow-io-1641 46 13 the the DT news-docnow-io-1641 46 14 data datum NNS news-docnow-io-1641 46 15 then then RB news-docnow-io-1641 46 16 you -PRON- PRP news-docnow-io-1641 46 17 wo will MD news-docnow-io-1641 46 18 n’t not RB news-docnow-io-1641 46 19 be be VB news-docnow-io-1641 46 20 able able JJ news-docnow-io-1641 46 21 to to TO news-docnow-io-1641 46 22 analyze analyze VB news-docnow-io-1641 46 23 that that DT news-docnow-io-1641 46 24 data datum NNS news-docnow-io-1641 46 25 later later RB news-docnow-io-1641 46 26 when when WRB news-docnow-io-1641 46 27 doing do VBG news-docnow-io-1641 46 28 your -PRON- PRP$ news-docnow-io-1641 46 29 research research NN news-docnow-io-1641 46 30 . . . news-docnow-io-1641 47 1 To to TO news-docnow-io-1641 47 2 solve solve VB news-docnow-io-1641 47 3 for for IN news-docnow-io-1641 47 4 this this DT news-docnow-io-1641 47 5 twarc2 twarc2 NN news-docnow-io-1641 47 6 has have VBZ news-docnow-io-1641 47 7 been be VBN news-docnow-io-1641 47 8 designed design VBN news-docnow-io-1641 47 9 to to TO news-docnow-io-1641 47 10 collect collect VB news-docnow-io-1641 47 11 the the DT news-docnow-io-1641 47 12 richest rich JJS news-docnow-io-1641 47 13 possible possible JJ news-docnow-io-1641 47 14 representation representation NN news-docnow-io-1641 47 15 for for IN news-docnow-io-1641 47 16 a a DT news-docnow-io-1641 47 17 tweet tweet NN news-docnow-io-1641 47 18 , , , news-docnow-io-1641 47 19 by by IN news-docnow-io-1641 47 20 requesting request VBG news-docnow-io-1641 47 21 all all DT news-docnow-io-1641 47 22 possible possible JJ news-docnow-io-1641 47 23 expansions expansion NNS news-docnow-io-1641 47 24 and and CC news-docnow-io-1641 47 25 field field NN news-docnow-io-1641 47 26 combinations combination NNS news-docnow-io-1641 47 27 for for IN news-docnow-io-1641 47 28 tweets tweet NNS news-docnow-io-1641 47 29 . . . news-docnow-io-1641 48 1 See see VB news-docnow-io-1641 48 2 the the DT news-docnow-io-1641 48 3 expansions expansion NNS news-docnow-io-1641 48 4 module module NN news-docnow-io-1641 48 5 for for IN news-docnow-io-1641 48 6 the the DT news-docnow-io-1641 48 7 details detail NNS news-docnow-io-1641 48 8 if if IN news-docnow-io-1641 48 9 you -PRON- PRP news-docnow-io-1641 48 10 are be VBP news-docnow-io-1641 48 11 interested interested JJ news-docnow-io-1641 48 12 . . . news-docnow-io-1641 49 1 This this DT news-docnow-io-1641 49 2 takes take VBZ news-docnow-io-1641 49 3 a a DT news-docnow-io-1641 49 4 significant significant JJ news-docnow-io-1641 49 5 burden burden NN news-docnow-io-1641 49 6 off off IN news-docnow-io-1641 49 7 of of IN news-docnow-io-1641 49 8 users user NNS news-docnow-io-1641 49 9 to to TO news-docnow-io-1641 49 10 digest digest VB news-docnow-io-1641 49 11 the the DT news-docnow-io-1641 49 12 API API NNP news-docnow-io-1641 49 13 documentation documentation NN news-docnow-io-1641 49 14 , , , news-docnow-io-1641 49 15 and and CC news-docnow-io-1641 49 16 craft craft VB news-docnow-io-1641 49 17 the the DT news-docnow-io-1641 49 18 correct correct JJ news-docnow-io-1641 49 19 API API NNP news-docnow-io-1641 49 20 requests request NNS news-docnow-io-1641 49 21 themselves -PRON- PRP news-docnow-io-1641 49 22 . . . news-docnow-io-1641 50 1 In in IN news-docnow-io-1641 50 2 addition addition NN news-docnow-io-1641 50 3 the the DT news-docnow-io-1641 50 4 twarc twarc NNP news-docnow-io-1641 50 5 community community NN news-docnow-io-1641 50 6 will will MD news-docnow-io-1641 50 7 be be VB news-docnow-io-1641 50 8 monitoring monitor VBG news-docnow-io-1641 50 9 the the DT news-docnow-io-1641 50 10 Twitter Twitter NNP news-docnow-io-1641 50 11 API API NNP news-docnow-io-1641 50 12 documentation documentation NN news-docnow-io-1641 50 13 going go VBG news-docnow-io-1641 50 14 forward forward RB news-docnow-io-1641 50 15 to to TO news-docnow-io-1641 50 16 incorporate incorporate VB news-docnow-io-1641 50 17 new new JJ news-docnow-io-1641 50 18 expansions expansion NNS news-docnow-io-1641 50 19 and and CC news-docnow-io-1641 50 20 fields field NNS news-docnow-io-1641 50 21 as as IN news-docnow-io-1641 50 22 they -PRON- PRP news-docnow-io-1641 50 23 will will MD news-docnow-io-1641 50 24 inevitably inevitably RB news-docnow-io-1641 50 25 be be VB news-docnow-io-1641 50 26 added add VBN news-docnow-io-1641 50 27 in in IN news-docnow-io-1641 50 28 the the DT news-docnow-io-1641 50 29 future future NN news-docnow-io-1641 50 30 . . . news-docnow-io-1641 51 1 Flattening flatten VBG news-docnow-io-1641 51 2 This this DT news-docnow-io-1641 51 3 is be VBZ news-docnow-io-1641 51 4 diving dive VBG news-docnow-io-1641 51 5 into into IN news-docnow-io-1641 51 6 the the DT news-docnow-io-1641 51 7 weeds weed NNS news-docnow-io-1641 51 8 a a DT news-docnow-io-1641 51 9 little little JJ news-docnow-io-1641 51 10 bit bit NN news-docnow-io-1641 51 11 , , , news-docnow-io-1641 51 12 but but CC news-docnow-io-1641 51 13 it -PRON- PRP news-docnow-io-1641 51 14 ’s ’ VBZ news-docnow-io-1641 51 15 worth worth JJ news-docnow-io-1641 51 16 noting note VBG news-docnow-io-1641 51 17 here here RB news-docnow-io-1641 51 18 that that IN news-docnow-io-1641 51 19 Twitter Twitter NNP news-docnow-io-1641 51 20 ’s ’s POS news-docnow-io-1641 51 21 introduction introduction NN news-docnow-io-1641 51 22 of of IN news-docnow-io-1641 51 23 expansions expansion NNS news-docnow-io-1641 51 24 allows allow VBZ news-docnow-io-1641 51 25 data datum NNS news-docnow-io-1641 51 26 that that WDT news-docnow-io-1641 51 27 was be VBD news-docnow-io-1641 51 28 once once RB news-docnow-io-1641 51 29 duplicated duplicate VBN news-docnow-io-1641 51 30 across across IN news-docnow-io-1641 51 31 multiple multiple JJ news-docnow-io-1641 51 32 tweets tweet NNS news-docnow-io-1641 51 33 ( ( -LRB- news-docnow-io-1641 51 34 such such JJ news-docnow-io-1641 51 35 as as IN news-docnow-io-1641 51 36 user user NN news-docnow-io-1641 51 37 information information NN news-docnow-io-1641 51 38 , , , news-docnow-io-1641 51 39 media medium NNS news-docnow-io-1641 51 40 , , , news-docnow-io-1641 51 41 retweets retweet NNS news-docnow-io-1641 51 42 , , , news-docnow-io-1641 51 43 etc etc FW news-docnow-io-1641 51 44 ) ) -RRB- news-docnow-io-1641 51 45 to to TO news-docnow-io-1641 51 46 be be VB news-docnow-io-1641 51 47 included include VBN news-docnow-io-1641 51 48 once once RB news-docnow-io-1641 51 49 per per IN news-docnow-io-1641 51 50 response response NN news-docnow-io-1641 51 51 from from IN news-docnow-io-1641 51 52 the the DT news-docnow-io-1641 51 53 API API NNP news-docnow-io-1641 51 54 . . . news-docnow-io-1641 52 1 This this DT news-docnow-io-1641 52 2 means mean VBZ news-docnow-io-1641 52 3 that that IN news-docnow-io-1641 52 4 instead instead RB news-docnow-io-1641 52 5 of of IN news-docnow-io-1641 52 6 seeing see VBG news-docnow-io-1641 52 7 information information NN news-docnow-io-1641 52 8 about about IN news-docnow-io-1641 52 9 the the DT news-docnow-io-1641 52 10 user user NN news-docnow-io-1641 52 11 who who WP news-docnow-io-1641 52 12 created create VBD news-docnow-io-1641 52 13 a a DT news-docnow-io-1641 52 14 tweet tweet NN news-docnow-io-1641 52 15 in in IN news-docnow-io-1641 52 16 the the DT news-docnow-io-1641 52 17 context context NN news-docnow-io-1641 52 18 of of IN news-docnow-io-1641 52 19 their -PRON- PRP$ news-docnow-io-1641 52 20 tweet tweet NN news-docnow-io-1641 52 21 the the DT news-docnow-io-1641 52 22 user user NN news-docnow-io-1641 52 23 will will MD news-docnow-io-1641 52 24 be be VB news-docnow-io-1641 52 25 referenced reference VBN news-docnow-io-1641 52 26 using use VBG news-docnow-io-1641 52 27 an an DT news-docnow-io-1641 52 28 identifier identifier NN news-docnow-io-1641 52 29 , , , news-docnow-io-1641 52 30 and and CC news-docnow-io-1641 52 31 this this DT news-docnow-io-1641 52 32 identifier identifier NN news-docnow-io-1641 52 33 will will MD news-docnow-io-1641 52 34 map map VB news-docnow-io-1641 52 35 to to TO news-docnow-io-1641 52 36 user user VB news-docnow-io-1641 52 37 metadata metadata NN news-docnow-io-1641 52 38 in in IN news-docnow-io-1641 52 39 the the DT news-docnow-io-1641 52 40 outer outer JJ news-docnow-io-1641 52 41 envelope envelope NN news-docnow-io-1641 52 42 of of IN news-docnow-io-1641 52 43 the the DT news-docnow-io-1641 52 44 response response NN news-docnow-io-1641 52 45 . . . news-docnow-io-1641 53 1 It -PRON- PRP news-docnow-io-1641 53 2 makes make VBZ news-docnow-io-1641 53 3 sense sense NN news-docnow-io-1641 53 4 why why WRB news-docnow-io-1641 53 5 Twitter Twitter NNP news-docnow-io-1641 53 6 have have VBP news-docnow-io-1641 53 7 introduced introduce VBN news-docnow-io-1641 53 8 expansions expansion NNS news-docnow-io-1641 53 9 since since IN news-docnow-io-1641 53 10 it -PRON- PRP news-docnow-io-1641 53 11 means mean VBZ news-docnow-io-1641 53 12 in in IN news-docnow-io-1641 53 13 a a DT news-docnow-io-1641 53 14 set set NN news-docnow-io-1641 53 15 of of IN news-docnow-io-1641 53 16 100 100 CD news-docnow-io-1641 53 17 tweets tweet NNS news-docnow-io-1641 53 18 from from IN news-docnow-io-1641 53 19 a a DT news-docnow-io-1641 53 20 given give VBN news-docnow-io-1641 53 21 user user NN news-docnow-io-1641 53 22 the the DT news-docnow-io-1641 53 23 user user NN news-docnow-io-1641 53 24 information information NN news-docnow-io-1641 53 25 will will MD news-docnow-io-1641 53 26 just just RB news-docnow-io-1641 53 27 be be VB news-docnow-io-1641 53 28 included include VBN news-docnow-io-1641 53 29 once once RB news-docnow-io-1641 53 30 rather rather RB news-docnow-io-1641 53 31 than than IN news-docnow-io-1641 53 32 repeated repeat VBN news-docnow-io-1641 53 33 100 100 CD news-docnow-io-1641 53 34 times time NNS news-docnow-io-1641 53 35 , , , news-docnow-io-1641 53 36 which which WDT news-docnow-io-1641 53 37 means mean VBZ news-docnow-io-1641 53 38 less less JJR news-docnow-io-1641 53 39 data datum NNS news-docnow-io-1641 53 40 , , , news-docnow-io-1641 53 41 less less JJR news-docnow-io-1641 53 42 network network NN news-docnow-io-1641 53 43 traffic traffic NN news-docnow-io-1641 53 44 and and CC news-docnow-io-1641 53 45 less less JJR news-docnow-io-1641 53 46 money money NN news-docnow-io-1641 53 47 . . . news-docnow-io-1641 54 1 It -PRON- PRP news-docnow-io-1641 54 2 ’s ’ VBZ news-docnow-io-1641 54 3 even even RB news-docnow-io-1641 54 4 more more RBR news-docnow-io-1641 54 5 significant significant JJ news-docnow-io-1641 54 6 when when WRB news-docnow-io-1641 54 7 consider consider VB news-docnow-io-1641 54 8 the the DT news-docnow-io-1641 54 9 large large JJ news-docnow-io-1641 54 10 number number NN news-docnow-io-1641 54 11 of of IN news-docnow-io-1641 54 12 possible possible JJ news-docnow-io-1641 54 13 expansions expansion NNS news-docnow-io-1641 54 14 . . . news-docnow-io-1641 55 1 However however RB news-docnow-io-1641 55 2 this this DT news-docnow-io-1641 55 3 pass pass NN news-docnow-io-1641 55 4 by by IN news-docnow-io-1641 55 5 - - HYPH news-docnow-io-1641 55 6 reference reference NN news-docnow-io-1641 55 7 rather rather RB news-docnow-io-1641 55 8 than than IN news-docnow-io-1641 55 9 by by IN news-docnow-io-1641 55 10 - - HYPH news-docnow-io-1641 55 11 value value NN news-docnow-io-1641 55 12 presents present VBZ news-docnow-io-1641 55 13 some some DT news-docnow-io-1641 55 14 challenges challenge NNS news-docnow-io-1641 55 15 for for IN news-docnow-io-1641 55 16 stream stream NN news-docnow-io-1641 55 17 based base VBN news-docnow-io-1641 55 18 processing processing NN news-docnow-io-1641 55 19 which which WDT news-docnow-io-1641 55 20 expects expect VBZ news-docnow-io-1641 55 21 each each DT news-docnow-io-1641 55 22 tweet tweet NN news-docnow-io-1641 55 23 to to TO news-docnow-io-1641 55 24 be be VB news-docnow-io-1641 55 25 self self NN news-docnow-io-1641 55 26 - - HYPH news-docnow-io-1641 55 27 contained contain VBN news-docnow-io-1641 55 28 . . . news-docnow-io-1641 56 1 For for IN news-docnow-io-1641 56 2 this this DT news-docnow-io-1641 56 3 reason reason NN news-docnow-io-1641 56 4 we -PRON- PRP news-docnow-io-1641 56 5 ’ve have VB news-docnow-io-1641 56 6 introduce introduce VB news-docnow-io-1641 56 7 the the DT news-docnow-io-1641 56 8 idea idea NN news-docnow-io-1641 56 9 of of IN news-docnow-io-1641 56 10 flattening flatten VBG news-docnow-io-1641 56 11 the the DT news-docnow-io-1641 56 12 response response NN news-docnow-io-1641 56 13 data datum NNS news-docnow-io-1641 56 14 when when WRB news-docnow-io-1641 56 15 persisting persist VBG news-docnow-io-1641 56 16 the the DT news-docnow-io-1641 56 17 JSON JSON NNP news-docnow-io-1641 56 18 to to TO news-docnow-io-1641 56 19 disk disk NN news-docnow-io-1641 56 20 . . . news-docnow-io-1641 57 1 This this DT news-docnow-io-1641 57 2 means mean VBZ news-docnow-io-1641 57 3 that that IN news-docnow-io-1641 57 4 tools tool NNS news-docnow-io-1641 57 5 and and CC news-docnow-io-1641 57 6 data datum NNS news-docnow-io-1641 57 7 pipelines pipeline NNS news-docnow-io-1641 57 8 that that WDT news-docnow-io-1641 57 9 expect expect VBP news-docnow-io-1641 57 10 to to TO news-docnow-io-1641 57 11 operate operate VB news-docnow-io-1641 57 12 on on IN news-docnow-io-1641 57 13 a a DT news-docnow-io-1641 57 14 stream stream NN news-docnow-io-1641 57 15 of of IN news-docnow-io-1641 57 16 tweets tweet NNS news-docnow-io-1641 57 17 can can MD news-docnow-io-1641 57 18 continue continue VB news-docnow-io-1641 57 19 to to TO news-docnow-io-1641 57 20 do do VB news-docnow-io-1641 57 21 so so RB news-docnow-io-1641 57 22 . . . news-docnow-io-1641 58 1 Since since IN news-docnow-io-1641 58 2 the the DT news-docnow-io-1641 58 3 representation representation NN news-docnow-io-1641 58 4 of of IN news-docnow-io-1641 58 5 a a DT news-docnow-io-1641 58 6 tweet tweet NN news-docnow-io-1641 58 7 is be VBZ news-docnow-io-1641 58 8 so so RB news-docnow-io-1641 58 9 dependent dependent JJ news-docnow-io-1641 58 10 on on IN news-docnow-io-1641 58 11 how how WRB news-docnow-io-1641 58 12 data datum NNS news-docnow-io-1641 58 13 is be VBZ news-docnow-io-1641 58 14 requested request VBN news-docnow-io-1641 58 15 we -PRON- PRP news-docnow-io-1641 58 16 ’ve have VB news-docnow-io-1641 58 17 taken take VBN news-docnow-io-1641 58 18 the the DT news-docnow-io-1641 58 19 opportunity opportunity NN news-docnow-io-1641 58 20 to to TO news-docnow-io-1641 58 21 introduce introduce VB news-docnow-io-1641 58 22 a a DT news-docnow-io-1641 58 23 small small JJ news-docnow-io-1641 58 24 stanza stanza NN news-docnow-io-1641 58 25 of of IN news-docnow-io-1641 58 26 twarc twarc NNP news-docnow-io-1641 58 27 specific specific JJ news-docnow-io-1641 58 28 metadata metadata NN news-docnow-io-1641 58 29 using use VBG news-docnow-io-1641 58 30 the the DT news-docnow-io-1641 58 31 _ _ NNP news-docnow-io-1641 58 32 _ _ NNP news-docnow-io-1641 58 33 twarc twarc NN news-docnow-io-1641 58 34 prefix prefix NN news-docnow-io-1641 58 35 . . . news-docnow-io-1641 59 1 This this DT news-docnow-io-1641 59 2 metadata metadata NN news-docnow-io-1641 59 3 records record VBZ news-docnow-io-1641 59 4 what what WP news-docnow-io-1641 59 5 API API NNP news-docnow-io-1641 59 6 endpoint endpoint NN news-docnow-io-1641 59 7 the the DT news-docnow-io-1641 59 8 data datum NNS news-docnow-io-1641 59 9 was be VBD news-docnow-io-1641 59 10 requested request VBN news-docnow-io-1641 59 11 from from IN news-docnow-io-1641 59 12 , , , news-docnow-io-1641 59 13 and and CC news-docnow-io-1641 59 14 when when WRB news-docnow-io-1641 59 15 . . . news-docnow-io-1641 60 1 This this DT news-docnow-io-1641 60 2 information information NN news-docnow-io-1641 60 3 is be VBZ news-docnow-io-1641 60 4 critically critically RB news-docnow-io-1641 60 5 important important JJ news-docnow-io-1641 60 6 when when WRB news-docnow-io-1641 60 7 interpreting interpret VBG news-docnow-io-1641 60 8 the the DT news-docnow-io-1641 60 9 data datum NNS news-docnow-io-1641 60 10 , , , news-docnow-io-1641 60 11 because because IN news-docnow-io-1641 60 12 some some DT news-docnow-io-1641 60 13 information information NN news-docnow-io-1641 60 14 about about IN news-docnow-io-1641 60 15 a a DT news-docnow-io-1641 60 16 tweet tweet NN news-docnow-io-1641 60 17 like like IN news-docnow-io-1641 60 18 its -PRON- PRP$ news-docnow-io-1641 60 19 retweet retweet NN news-docnow-io-1641 60 20 and and CC news-docnow-io-1641 60 21 quote quote NN news-docnow-io-1641 60 22 counts count NNS news-docnow-io-1641 60 23 are be VBP news-docnow-io-1641 60 24 constantly constantly RB news-docnow-io-1641 60 25 changing change VBG news-docnow-io-1641 60 26 . . . news-docnow-io-1641 61 1 Data datum NNS news-docnow-io-1641 61 2 Flows Flows NNP news-docnow-io-1641 61 3 As as IN news-docnow-io-1641 61 4 mentioned mention VBN news-docnow-io-1641 61 5 above above IN news-docnow-io-1641 61 6 you -PRON- PRP news-docnow-io-1641 61 7 can can MD news-docnow-io-1641 61 8 still still RB news-docnow-io-1641 61 9 collect collect VB news-docnow-io-1641 61 10 tweets tweet NNS news-docnow-io-1641 61 11 from from IN news-docnow-io-1641 61 12 the the DT news-docnow-io-1641 61 13 search search NN news-docnow-io-1641 61 14 and and CC news-docnow-io-1641 61 15 streaming stream VBG news-docnow-io-1641 61 16 API API NNP news-docnow-io-1641 61 17 endpoints endpoint NNS news-docnow-io-1641 61 18 in in IN news-docnow-io-1641 61 19 a a DT news-docnow-io-1641 61 20 way way NN news-docnow-io-1641 61 21 that that WDT news-docnow-io-1641 61 22 seems seem VBZ news-docnow-io-1641 61 23 quite quite RB news-docnow-io-1641 61 24 similar similar JJ news-docnow-io-1641 61 25 to to IN news-docnow-io-1641 61 26 the the DT news-docnow-io-1641 61 27 v1 v1 NN news-docnow-io-1641 61 28 API API NNP news-docnow-io-1641 61 29 . . . news-docnow-io-1641 62 1 The the DT news-docnow-io-1641 62 2 big big JJ news-docnow-io-1641 62 3 changes change NNS news-docnow-io-1641 62 4 however however RB news-docnow-io-1641 62 5 are be VBP news-docnow-io-1641 62 6 the the DT news-docnow-io-1641 62 7 quotas quota NNS news-docnow-io-1641 62 8 associated associate VBN news-docnow-io-1641 62 9 with with IN news-docnow-io-1641 62 10 these these DT news-docnow-io-1641 62 11 endpoints endpoint NNS news-docnow-io-1641 62 12 which which WDT news-docnow-io-1641 62 13 govern govern VBP news-docnow-io-1641 62 14 how how WRB news-docnow-io-1641 62 15 much much JJ news-docnow-io-1641 62 16 can can MD news-docnow-io-1641 62 17 be be VB news-docnow-io-1641 62 18 collected collect VBN news-docnow-io-1641 62 19 . . . news-docnow-io-1641 63 1 These these DT news-docnow-io-1641 63 2 quotas quota NNS news-docnow-io-1641 63 3 control control VBP news-docnow-io-1641 63 4 how how WRB news-docnow-io-1641 63 5 many many JJ news-docnow-io-1641 63 6 requests request NNS news-docnow-io-1641 63 7 can can MD news-docnow-io-1641 63 8 be be VB news-docnow-io-1641 63 9 sent send VBN news-docnow-io-1641 63 10 to to IN news-docnow-io-1641 63 11 Twitter Twitter NNP news-docnow-io-1641 63 12 in in IN news-docnow-io-1641 63 13 15 15 CD news-docnow-io-1641 63 14 minute minute NN news-docnow-io-1641 63 15 intervals interval NNS news-docnow-io-1641 63 16 . . . news-docnow-io-1641 64 1 In in IN news-docnow-io-1641 64 2 fact fact NN news-docnow-io-1641 64 3 these these DT news-docnow-io-1641 64 4 quotas quota NNS news-docnow-io-1641 64 5 are be VBP news-docnow-io-1641 64 6 not not RB news-docnow-io-1641 64 7 much much RB news-docnow-io-1641 64 8 changed change VBN news-docnow-io-1641 64 9 , , , news-docnow-io-1641 64 10 but but CC news-docnow-io-1641 64 11 what what WP news-docnow-io-1641 64 12 ’s ’ VBZ news-docnow-io-1641 64 13 new new JJ news-docnow-io-1641 64 14 are be VBP news-docnow-io-1641 64 15 app app NN news-docnow-io-1641 64 16 wide wide JJ news-docnow-io-1641 64 17 quotas quota NNS news-docnow-io-1641 64 18 that that WDT news-docnow-io-1641 64 19 constrain constrain VBP news-docnow-io-1641 64 20 how how WRB news-docnow-io-1641 64 21 many many JJ news-docnow-io-1641 64 22 tweets tweet NNS news-docnow-io-1641 64 23 a a DT news-docnow-io-1641 64 24 given give VBN news-docnow-io-1641 64 25 application application NN news-docnow-io-1641 64 26 ( ( -LRB- news-docnow-io-1641 64 27 app app NN news-docnow-io-1641 64 28 ) ) -RRB- news-docnow-io-1641 64 29 can can MD news-docnow-io-1641 64 30 collect collect VB news-docnow-io-1641 64 31 every every DT news-docnow-io-1641 64 32 month month NN news-docnow-io-1641 64 33 . . . news-docnow-io-1641 65 1 An an DT news-docnow-io-1641 65 2 app app NN news-docnow-io-1641 65 3 in in IN news-docnow-io-1641 65 4 this this DT news-docnow-io-1641 65 5 context context NN news-docnow-io-1641 65 6 is be VBZ news-docnow-io-1641 65 7 a a DT news-docnow-io-1641 65 8 piece piece NN news-docnow-io-1641 65 9 of of IN news-docnow-io-1641 65 10 software software NN news-docnow-io-1641 65 11 ( ( -LRB- news-docnow-io-1641 65 12 e.g. e.g. RB news-docnow-io-1641 66 1 your -PRON- PRP$ news-docnow-io-1641 66 2 twarc twarc NNP news-docnow-io-1641 66 3 software software NN news-docnow-io-1641 66 4 ) ) -RRB- news-docnow-io-1641 66 5 identified identify VBN news-docnow-io-1641 66 6 by by IN news-docnow-io-1641 66 7 unique unique JJ news-docnow-io-1641 66 8 API API NNP news-docnow-io-1641 66 9 keys key NNS news-docnow-io-1641 66 10 set set VBD news-docnow-io-1641 66 11 up up RP news-docnow-io-1641 66 12 in in IN news-docnow-io-1641 66 13 the the DT news-docnow-io-1641 66 14 Twitter Twitter NNP news-docnow-io-1641 66 15 Developer Developer NNP news-docnow-io-1641 66 16 Portal Portal NNP news-docnow-io-1641 66 17 . . . news-docnow-io-1641 67 1 The the DT news-docnow-io-1641 67 2 standard standard JJ news-docnow-io-1641 67 3 API api NN news-docnow-io-1641 67 4 access access NN news-docnow-io-1641 67 5 sets set VBZ news-docnow-io-1641 67 6 a a DT news-docnow-io-1641 67 7 500,000 500,000 CD news-docnow-io-1641 67 8 tweet tweet NN news-docnow-io-1641 67 9 per per IN news-docnow-io-1641 67 10 month month NN news-docnow-io-1641 67 11 limit limit NN news-docnow-io-1641 67 12 . . . news-docnow-io-1641 68 1 This this DT news-docnow-io-1641 68 2 is be VBZ news-docnow-io-1641 68 3 a a DT news-docnow-io-1641 68 4 huge huge JJ news-docnow-io-1641 68 5 change change NN news-docnow-io-1641 68 6 considering consider VBG news-docnow-io-1641 68 7 there there EX news-docnow-io-1641 68 8 were be VBD news-docnow-io-1641 68 9 no no DT news-docnow-io-1641 68 10 monthly monthly JJ news-docnow-io-1641 68 11 app app NN news-docnow-io-1641 68 12 limits limit NNS news-docnow-io-1641 68 13 before before RB news-docnow-io-1641 68 14 . . . news-docnow-io-1641 69 1 If if IN news-docnow-io-1641 69 2 you -PRON- PRP news-docnow-io-1641 69 3 get get VBP news-docnow-io-1641 69 4 approved approve VBN news-docnow-io-1641 69 5 for for IN news-docnow-io-1641 69 6 the the DT news-docnow-io-1641 69 7 Academic Academic NNP news-docnow-io-1641 69 8 Research Research NNP news-docnow-io-1641 69 9 track track VB news-docnow-io-1641 69 10 your -PRON- PRP$ news-docnow-io-1641 69 11 app app NN news-docnow-io-1641 69 12 quota quota NN news-docnow-io-1641 69 13 is be VBZ news-docnow-io-1641 69 14 increased increase VBN news-docnow-io-1641 69 15 to to IN news-docnow-io-1641 69 16 10 10 CD news-docnow-io-1641 69 17 million million CD news-docnow-io-1641 69 18 per per IN news-docnow-io-1641 69 19 month month NN news-docnow-io-1641 69 20 . . . news-docnow-io-1641 70 1 This this DT news-docnow-io-1641 70 2 is be VBZ news-docnow-io-1641 70 3 markedly markedly RB news-docnow-io-1641 70 4 better well JJR news-docnow-io-1641 70 5 but but CC news-docnow-io-1641 70 6 the the DT news-docnow-io-1641 70 7 achievable achievable JJ news-docnow-io-1641 70 8 data data NN news-docnow-io-1641 70 9 volume volume NN news-docnow-io-1641 70 10 is be VBZ news-docnow-io-1641 70 11 still still RB news-docnow-io-1641 70 12 nothing nothing NN news-docnow-io-1641 70 13 like like IN news-docnow-io-1641 70 14 the the DT news-docnow-io-1641 70 15 v1.1 v1.1 NNP news-docnow-io-1641 70 16 API API NNP news-docnow-io-1641 70 17 , , , news-docnow-io-1641 70 18 as as IN news-docnow-io-1641 70 19 these these DT news-docnow-io-1641 70 20 graphs graphs JJ news-docnow-io-1641 70 21 attempt attempt NN news-docnow-io-1641 70 22 to to TO news-docnow-io-1641 70 23 illustrate illustrate VB news-docnow-io-1641 70 24 : : : news-docnow-io-1641 70 25 Monthly Monthly NNP news-docnow-io-1641 70 26 Data Data NNP news-docnow-io-1641 70 27 Collection Collection NNP news-docnow-io-1641 70 28 for for IN news-docnow-io-1641 70 29 Apps Apps NNP news-docnow-io-1641 70 30 from from IN news-docnow-io-1641 70 31 Search Search NNP news-docnow-io-1641 70 32 Monthly Monthly NNP news-docnow-io-1641 70 33 Data Data NNP news-docnow-io-1641 70 34 Collection Collection NNP news-docnow-io-1641 70 35 for for IN news-docnow-io-1641 70 36 Apps Apps NNP news-docnow-io-1641 70 37 from from IN news-docnow-io-1641 70 38 the the DT news-docnow-io-1641 70 39 Streamtwarc2 Streamtwarc2 NNP news-docnow-io-1641 70 40 will will MD news-docnow-io-1641 70 41 still still RB news-docnow-io-1641 70 42 observe observe VB news-docnow-io-1641 70 43 the the DT news-docnow-io-1641 70 44 same same JJ news-docnow-io-1641 70 45 rate rate NN news-docnow-io-1641 70 46 limits limit NNS news-docnow-io-1641 70 47 , , , news-docnow-io-1641 70 48 but but CC news-docnow-io-1641 70 49 once once IN news-docnow-io-1641 70 50 you -PRON- PRP news-docnow-io-1641 70 51 ’ve have VB news-docnow-io-1641 70 52 collected collect VBN news-docnow-io-1641 70 53 your -PRON- PRP$ news-docnow-io-1641 70 54 portion portion NN news-docnow-io-1641 70 55 for for IN news-docnow-io-1641 70 56 the the DT news-docnow-io-1641 70 57 month month NN news-docnow-io-1641 70 58 there there EX news-docnow-io-1641 70 59 ’s ’ VBZ news-docnow-io-1641 70 60 not not RB news-docnow-io-1641 70 61 much much JJ news-docnow-io-1641 70 62 that that WDT news-docnow-io-1641 70 63 can can MD news-docnow-io-1641 70 64 be be VB news-docnow-io-1641 70 65 done do VBN news-docnow-io-1641 70 66 , , , news-docnow-io-1641 70 67 for for IN news-docnow-io-1641 70 68 that that DT news-docnow-io-1641 70 69 app app NN news-docnow-io-1641 70 70 at at IN news-docnow-io-1641 70 71 least least JJS news-docnow-io-1641 70 72 . . . news-docnow-io-1641 71 1 Apart apart RB news-docnow-io-1641 71 2 from from IN news-docnow-io-1641 71 3 the the DT news-docnow-io-1641 71 4 quotas quota NNS news-docnow-io-1641 71 5 Twitter Twitter NNP news-docnow-io-1641 71 6 ’s ’s POS news-docnow-io-1641 71 7 streaming streaming NN news-docnow-io-1641 71 8 endpoint endpoint NN news-docnow-io-1641 71 9 in in IN news-docnow-io-1641 71 10 v2 v2 NN news-docnow-io-1641 71 11 is be VBZ news-docnow-io-1641 71 12 substantially substantially RB news-docnow-io-1641 71 13 changed change VBN news-docnow-io-1641 71 14 which which WDT news-docnow-io-1641 71 15 impacts impact VBZ news-docnow-io-1641 71 16 how how WRB news-docnow-io-1641 71 17 users user NNS news-docnow-io-1641 71 18 interact interact VBP news-docnow-io-1641 71 19 with with IN news-docnow-io-1641 71 20 twarc twarc NN news-docnow-io-1641 71 21 . . . news-docnow-io-1641 72 1 Previously previously RB news-docnow-io-1641 72 2 twarc twarc JJ news-docnow-io-1641 72 3 users user NNS news-docnow-io-1641 72 4 would would MD news-docnow-io-1641 72 5 be be VB news-docnow-io-1641 72 6 able able JJ news-docnow-io-1641 72 7 to to TO news-docnow-io-1641 72 8 create create VB news-docnow-io-1641 72 9 up up RP news-docnow-io-1641 72 10 to to IN news-docnow-io-1641 72 11 to to IN news-docnow-io-1641 72 12 two two CD news-docnow-io-1641 72 13 connections connection NNS news-docnow-io-1641 72 14 to to IN news-docnow-io-1641 72 15 the the DT news-docnow-io-1641 72 16 filter filter NN news-docnow-io-1641 72 17 stream stream NN news-docnow-io-1641 72 18 API api NN news-docnow-io-1641 72 19 . . . news-docnow-io-1641 73 1 This this DT news-docnow-io-1641 73 2 could could MD news-docnow-io-1641 73 3 be be VB news-docnow-io-1641 73 4 done do VBN news-docnow-io-1641 73 5 by by IN news-docnow-io-1641 73 6 simply simply RB news-docnow-io-1641 73 7 : : : news-docnow-io-1641 73 8 twarc twarc NNP news-docnow-io-1641 73 9 filter filter NNP news-docnow-io-1641 73 10 obama obama NNP news-docnow-io-1641 73 11 > > XX news-docnow-io-1641 73 12 obama.jsonl obama.jsonl NNP news-docnow-io-1641 73 13 However however RB news-docnow-io-1641 73 14 in in IN news-docnow-io-1641 73 15 the the DT news-docnow-io-1641 73 16 Twitter Twitter NNP news-docnow-io-1641 73 17 v2 v2 NN news-docnow-io-1641 73 18 API API NNP news-docnow-io-1641 73 19 only only RB news-docnow-io-1641 73 20 apps app NNS news-docnow-io-1641 73 21 can can MD news-docnow-io-1641 73 22 connect connect VB news-docnow-io-1641 73 23 to to IN news-docnow-io-1641 73 24 the the DT news-docnow-io-1641 73 25 filter filter NN news-docnow-io-1641 73 26 stream stream NN news-docnow-io-1641 73 27 , , , news-docnow-io-1641 73 28 and and CC news-docnow-io-1641 73 29 they -PRON- PRP news-docnow-io-1641 73 30 can can MD news-docnow-io-1641 73 31 only only RB news-docnow-io-1641 73 32 connect connect VB news-docnow-io-1641 73 33 once once RB news-docnow-io-1641 73 34 . . . news-docnow-io-1641 74 1 At at IN news-docnow-io-1641 74 2 first first RB news-docnow-io-1641 74 3 this this DT news-docnow-io-1641 74 4 seems seem VBZ news-docnow-io-1641 74 5 like like IN news-docnow-io-1641 74 6 a a DT news-docnow-io-1641 74 7 major major JJ news-docnow-io-1641 74 8 limitation limitation NN news-docnow-io-1641 74 9 but but CC news-docnow-io-1641 74 10 rather rather RB news-docnow-io-1641 74 11 than than IN news-docnow-io-1641 74 12 creating create VBG news-docnow-io-1641 74 13 a a DT news-docnow-io-1641 74 14 connection connection NN news-docnow-io-1641 74 15 per per IN news-docnow-io-1641 74 16 query query NN news-docnow-io-1641 74 17 the the DT news-docnow-io-1641 74 18 v2 v2 NN news-docnow-io-1641 74 19 API API NNP news-docnow-io-1641 74 20 allows allow VBZ news-docnow-io-1641 74 21 you -PRON- PRP news-docnow-io-1641 74 22 to to TO news-docnow-io-1641 74 23 build build VB news-docnow-io-1641 74 24 a a DT news-docnow-io-1641 74 25 set set NN news-docnow-io-1641 74 26 of of IN news-docnow-io-1641 74 27 rules rule NNS news-docnow-io-1641 74 28 for for IN news-docnow-io-1641 74 29 tweets tweet NNS news-docnow-io-1641 74 30 to to TO news-docnow-io-1641 74 31 match match VB news-docnow-io-1641 74 32 , , , news-docnow-io-1641 74 33 which which WDT news-docnow-io-1641 74 34 in in IN news-docnow-io-1641 74 35 turns turn VBZ news-docnow-io-1641 74 36 controls control NNS news-docnow-io-1641 74 37 what what WP news-docnow-io-1641 74 38 tweets tweet NNS news-docnow-io-1641 74 39 are be VBP news-docnow-io-1641 74 40 included include VBN news-docnow-io-1641 74 41 in in IN news-docnow-io-1641 74 42 the the DT news-docnow-io-1641 74 43 stream stream NN news-docnow-io-1641 74 44 . . . news-docnow-io-1641 75 1 This this DT news-docnow-io-1641 75 2 means mean VBZ news-docnow-io-1641 75 3 you -PRON- PRP news-docnow-io-1641 75 4 can can MD news-docnow-io-1641 75 5 collect collect VB news-docnow-io-1641 75 6 for for IN news-docnow-io-1641 75 7 multiple multiple JJ news-docnow-io-1641 75 8 types type NNS news-docnow-io-1641 75 9 of of IN news-docnow-io-1641 75 10 queries query NNS news-docnow-io-1641 75 11 at at IN news-docnow-io-1641 75 12 the the DT news-docnow-io-1641 75 13 same same JJ news-docnow-io-1641 75 14 time time NN news-docnow-io-1641 75 15 , , , news-docnow-io-1641 75 16 and and CC news-docnow-io-1641 75 17 the the DT news-docnow-io-1641 75 18 tweets tweet NNS news-docnow-io-1641 75 19 will will MD news-docnow-io-1641 75 20 come come VB news-docnow-io-1641 75 21 back back RB news-docnow-io-1641 75 22 with with IN news-docnow-io-1641 75 23 a a DT news-docnow-io-1641 75 24 piece piece NN news-docnow-io-1641 75 25 of of IN news-docnow-io-1641 75 26 metadata metadata NN news-docnow-io-1641 75 27 indicating indicate VBG news-docnow-io-1641 75 28 what what WP news-docnow-io-1641 75 29 rule rule NN news-docnow-io-1641 75 30 caused cause VBD news-docnow-io-1641 75 31 its -PRON- PRP$ news-docnow-io-1641 75 32 inclusion inclusion NN news-docnow-io-1641 75 33 . . . news-docnow-io-1641 76 1 This this DT news-docnow-io-1641 76 2 translates translate VBZ news-docnow-io-1641 76 3 into into IN news-docnow-io-1641 76 4 a a DT news-docnow-io-1641 76 5 markedly markedly RB news-docnow-io-1641 76 6 different different JJ news-docnow-io-1641 76 7 set set NN news-docnow-io-1641 76 8 of of IN news-docnow-io-1641 76 9 interactions interaction NNS news-docnow-io-1641 76 10 at at IN news-docnow-io-1641 76 11 the the DT news-docnow-io-1641 76 12 command command NN news-docnow-io-1641 76 13 line line NN news-docnow-io-1641 76 14 for for IN news-docnow-io-1641 76 15 collecting collect VBG news-docnow-io-1641 76 16 from from IN news-docnow-io-1641 76 17 the the DT news-docnow-io-1641 76 18 stream stream NN news-docnow-io-1641 76 19 where where WRB news-docnow-io-1641 76 20 you -PRON- PRP news-docnow-io-1641 76 21 first first RB news-docnow-io-1641 76 22 need need VBP news-docnow-io-1641 76 23 to to TO news-docnow-io-1641 76 24 set set VB news-docnow-io-1641 76 25 your -PRON- PRP$ news-docnow-io-1641 76 26 stream stream NN news-docnow-io-1641 76 27 rules rule NNS news-docnow-io-1641 76 28 and and CC news-docnow-io-1641 76 29 then then RB news-docnow-io-1641 76 30 open open VB news-docnow-io-1641 76 31 a a DT news-docnow-io-1641 76 32 connection connection NN news-docnow-io-1641 76 33 to to TO news-docnow-io-1641 76 34 fetch fetch VB news-docnow-io-1641 76 35 it -PRON- PRP news-docnow-io-1641 76 36 . . . news-docnow-io-1641 77 1 twarc2 twarc2 NNP news-docnow-io-1641 77 2 stream stream NN news-docnow-io-1641 77 3 - - HYPH news-docnow-io-1641 77 4 rules rule NNS news-docnow-io-1641 77 5 add add VBP news-docnow-io-1641 77 6 blacklivesmatter blacklivesmatter NN news-docnow-io-1641 77 7 twarc2 twarc2 NN news-docnow-io-1641 77 8 stream stream NN news-docnow-io-1641 77 9 > > XX news-docnow-io-1641 77 10 tweets.jsonl tweets.jsonl NNP news-docnow-io-1641 77 11 One one CD news-docnow-io-1641 77 12 useful useful JJ news-docnow-io-1641 77 13 side side NN news-docnow-io-1641 77 14 effect effect NN news-docnow-io-1641 77 15 of of IN news-docnow-io-1641 77 16 this this DT news-docnow-io-1641 77 17 is be VBZ news-docnow-io-1641 77 18 that that IN news-docnow-io-1641 77 19 you -PRON- PRP news-docnow-io-1641 77 20 can can MD news-docnow-io-1641 77 21 update update VB news-docnow-io-1641 77 22 the the DT news-docnow-io-1641 77 23 stream stream NN news-docnow-io-1641 77 24 ( ( -LRB- news-docnow-io-1641 77 25 add add VB news-docnow-io-1641 77 26 and and CC news-docnow-io-1641 77 27 remove remove VB news-docnow-io-1641 77 28 rules rule NNS news-docnow-io-1641 77 29 ) ) -RRB- news-docnow-io-1641 77 30 while while IN news-docnow-io-1641 77 31 the the DT news-docnow-io-1641 77 32 stream stream NN news-docnow-io-1641 77 33 is be VBZ news-docnow-io-1641 77 34 in in IN news-docnow-io-1641 77 35 motion motion NN news-docnow-io-1641 77 36 : : : news-docnow-io-1641 77 37 twarc2 twarc2 JJ news-docnow-io-1641 77 38 stream stream NN news-docnow-io-1641 77 39 - - HYPH news-docnow-io-1641 77 40 rules rule NNS news-docnow-io-1641 77 41 add add VBP news-docnow-io-1641 77 42 blm blm NN news-docnow-io-1641 77 43 While while IN news-docnow-io-1641 77 44 you -PRON- PRP news-docnow-io-1641 77 45 are be VBP news-docnow-io-1641 77 46 limited limit VBN news-docnow-io-1641 77 47 by by IN news-docnow-io-1641 77 48 the the DT news-docnow-io-1641 77 49 API API NNP news-docnow-io-1641 77 50 quota quota NN news-docnow-io-1641 77 51 in in IN news-docnow-io-1641 77 52 terms term NNS news-docnow-io-1641 77 53 of of IN news-docnow-io-1641 77 54 how how WRB news-docnow-io-1641 77 55 many many JJ news-docnow-io-1641 77 56 tweets tweet NNS news-docnow-io-1641 77 57 you -PRON- PRP news-docnow-io-1641 77 58 can can MD news-docnow-io-1641 77 59 collect collect VB news-docnow-io-1641 77 60 , , , news-docnow-io-1641 77 61 tweets tweet NNS news-docnow-io-1641 77 62 are be VBP news-docnow-io-1641 77 63 not not RB news-docnow-io-1641 77 64 “ " `` news-docnow-io-1641 77 65 dropped drop VBD news-docnow-io-1641 77 66 on on IN news-docnow-io-1641 77 67 the the DT news-docnow-io-1641 77 68 floor floor NN news-docnow-io-1641 77 69 ” " '' news-docnow-io-1641 77 70 when when WRB news-docnow-io-1641 77 71 the the DT news-docnow-io-1641 77 72 volume volume NN news-docnow-io-1641 77 73 gets get VBZ news-docnow-io-1641 77 74 too too RB news-docnow-io-1641 77 75 high high JJ news-docnow-io-1641 77 76 . . . news-docnow-io-1641 78 1 Once once IN news-docnow-io-1641 78 2 upon upon IN news-docnow-io-1641 78 3 a a DT news-docnow-io-1641 78 4 time time NN news-docnow-io-1641 78 5 the the DT news-docnow-io-1641 78 6 v1.1 v1.1 NNP news-docnow-io-1641 78 7 filter filter NNP news-docnow-io-1641 78 8 stream stream NN news-docnow-io-1641 78 9 was be VBD news-docnow-io-1641 78 10 rumored rumor VBN news-docnow-io-1641 78 11 to to TO news-docnow-io-1641 78 12 be be VB news-docnow-io-1641 78 13 rate rate NN news-docnow-io-1641 78 14 limited limit VBN news-docnow-io-1641 78 15 when when WRB news-docnow-io-1641 78 16 your -PRON- PRP$ news-docnow-io-1641 78 17 stream stream NN news-docnow-io-1641 78 18 exceeds exceed VBZ news-docnow-io-1641 78 19 1 1 CD news-docnow-io-1641 78 20 % % NN news-docnow-io-1641 78 21 of of IN news-docnow-io-1641 78 22 the the DT news-docnow-io-1641 78 23 total total JJ news-docnow-io-1641 78 24 volume volume NN news-docnow-io-1641 78 25 of of IN news-docnow-io-1641 78 26 new new JJ news-docnow-io-1641 78 27 tweets tweet NNS news-docnow-io-1641 78 28 . . . news-docnow-io-1641 79 1 Plugins plugin NNS news-docnow-io-1641 79 2 In in IN news-docnow-io-1641 79 3 addition addition NN news-docnow-io-1641 79 4 to to IN news-docnow-io-1641 79 5 twarc twarc NN news-docnow-io-1641 79 6 helping help VBG news-docnow-io-1641 79 7 you -PRON- PRP news-docnow-io-1641 79 8 collect collect VB news-docnow-io-1641 79 9 tweets tweet NNS news-docnow-io-1641 79 10 the the DT news-docnow-io-1641 79 11 GitHub GitHub NNP news-docnow-io-1641 79 12 repository repository NN news-docnow-io-1641 79 13 has have VBZ news-docnow-io-1641 79 14 also also RB news-docnow-io-1641 79 15 been be VBN news-docnow-io-1641 79 16 a a DT news-docnow-io-1641 79 17 place place NN news-docnow-io-1641 79 18 to to TO news-docnow-io-1641 79 19 collect collect VB news-docnow-io-1641 79 20 a a DT news-docnow-io-1641 79 21 set set NN news-docnow-io-1641 79 22 of of IN news-docnow-io-1641 79 23 utilities utility NNS news-docnow-io-1641 79 24 for for IN news-docnow-io-1641 79 25 working work VBG news-docnow-io-1641 79 26 with with IN news-docnow-io-1641 79 27 the the DT news-docnow-io-1641 79 28 data datum NNS news-docnow-io-1641 79 29 . . . news-docnow-io-1641 80 1 For for IN news-docnow-io-1641 80 2 example example NN news-docnow-io-1641 80 3 there there EX news-docnow-io-1641 80 4 are be VBP news-docnow-io-1641 80 5 scripts script NNS news-docnow-io-1641 80 6 for for IN news-docnow-io-1641 80 7 extracting extract VBG news-docnow-io-1641 80 8 and and CC news-docnow-io-1641 80 9 unshortening unshortening JJ news-docnow-io-1641 80 10 urls urls JJ news-docnow-io-1641 80 11 , , , news-docnow-io-1641 80 12 identifying identify VBG news-docnow-io-1641 80 13 suspended suspend VBN news-docnow-io-1641 80 14 / / SYM news-docnow-io-1641 80 15 deleted delete VBN news-docnow-io-1641 80 16 content content NN news-docnow-io-1641 80 17 , , , news-docnow-io-1641 80 18 extracting extract VBG news-docnow-io-1641 80 19 videos video NNS news-docnow-io-1641 80 20 , , , news-docnow-io-1641 80 21 buiding buide VBG news-docnow-io-1641 80 22 wordclouds wordcloud NNS news-docnow-io-1641 80 23 , , , news-docnow-io-1641 80 24 putting put VBG news-docnow-io-1641 80 25 tweets tweet NNS news-docnow-io-1641 80 26 on on IN news-docnow-io-1641 80 27 maps map NNS news-docnow-io-1641 80 28 , , , news-docnow-io-1641 80 29 displaying display VBG news-docnow-io-1641 80 30 network network NN news-docnow-io-1641 80 31 graph graph NN news-docnow-io-1641 80 32 visualizations visualization NNS news-docnow-io-1641 80 33 , , , news-docnow-io-1641 80 34 counting count VBG news-docnow-io-1641 80 35 hashtags hashtag NNS news-docnow-io-1641 80 36 , , , news-docnow-io-1641 80 37 and and CC news-docnow-io-1641 80 38 more more JJR news-docnow-io-1641 80 39 . . . news-docnow-io-1641 81 1 These these DT news-docnow-io-1641 81 2 utilities utility NNS news-docnow-io-1641 81 3 all all DT news-docnow-io-1641 81 4 work work VBP news-docnow-io-1641 81 5 like like IN news-docnow-io-1641 81 6 Unix Unix NNP news-docnow-io-1641 81 7 filters filter NNS news-docnow-io-1641 81 8 where where WRB news-docnow-io-1641 81 9 the the DT news-docnow-io-1641 81 10 input input NN news-docnow-io-1641 81 11 is be VBZ news-docnow-io-1641 81 12 a a DT news-docnow-io-1641 81 13 stream stream NN news-docnow-io-1641 81 14 of of IN news-docnow-io-1641 81 15 tweets tweet NNS news-docnow-io-1641 81 16 and and CC news-docnow-io-1641 81 17 the the DT news-docnow-io-1641 81 18 output output NN news-docnow-io-1641 81 19 varies vary VBZ news-docnow-io-1641 81 20 depending depend VBG news-docnow-io-1641 81 21 on on IN news-docnow-io-1641 81 22 what what WP news-docnow-io-1641 81 23 the the DT news-docnow-io-1641 81 24 utility utility NN news-docnow-io-1641 81 25 is be VBZ news-docnow-io-1641 81 26 doing do VBG news-docnow-io-1641 81 27 , , , news-docnow-io-1641 81 28 e.g. e.g. RB news-docnow-io-1641 82 1 a a DT news-docnow-io-1641 82 2 Gephi Gephi NNP news-docnow-io-1641 82 3 file file NN news-docnow-io-1641 82 4 for for IN news-docnow-io-1641 82 5 a a DT news-docnow-io-1641 82 6 network network NN news-docnow-io-1641 82 7 visualization visualization NN news-docnow-io-1641 82 8 , , , news-docnow-io-1641 82 9 or or CC news-docnow-io-1641 82 10 a a DT news-docnow-io-1641 82 11 folder folder NN news-docnow-io-1641 82 12 of of IN news-docnow-io-1641 82 13 mp4 mp4 JJ news-docnow-io-1641 82 14 files file NNS news-docnow-io-1641 82 15 for for IN news-docnow-io-1641 82 16 video video NN news-docnow-io-1641 82 17 extraction extraction NN news-docnow-io-1641 82 18 . . . news-docnow-io-1641 83 1 While while IN news-docnow-io-1641 83 2 this this DT news-docnow-io-1641 83 3 has have VBZ news-docnow-io-1641 83 4 worked work VBN news-docnow-io-1641 83 5 well well RB news-docnow-io-1641 83 6 in in IN news-docnow-io-1641 83 7 general general JJ news-docnow-io-1641 83 8 the the DT news-docnow-io-1641 83 9 kitchen kitchen NN news-docnow-io-1641 83 10 sink sink NN news-docnow-io-1641 83 11 approach approach NN news-docnow-io-1641 83 12 has have VBZ news-docnow-io-1641 83 13 been be VBN news-docnow-io-1641 83 14 difficult difficult JJ news-docnow-io-1641 83 15 to to TO news-docnow-io-1641 83 16 manage manage VB news-docnow-io-1641 83 17 from from IN news-docnow-io-1641 83 18 a a DT news-docnow-io-1641 83 19 configuration configuration NN news-docnow-io-1641 83 20 management management NN news-docnow-io-1641 83 21 perspective perspective NN news-docnow-io-1641 83 22 . . . news-docnow-io-1641 84 1 Users user NNS news-docnow-io-1641 84 2 have have VBP news-docnow-io-1641 84 3 to to TO news-docnow-io-1641 84 4 download download VB news-docnow-io-1641 84 5 these these DT news-docnow-io-1641 84 6 scripts script NNS news-docnow-io-1641 84 7 manually manually RB news-docnow-io-1641 84 8 from from IN news-docnow-io-1641 84 9 GitHub GitHub NNP news-docnow-io-1641 84 10 or or CC news-docnow-io-1641 84 11 by by IN news-docnow-io-1641 84 12 cloning clone VBG news-docnow-io-1641 84 13 the the DT news-docnow-io-1641 84 14 repository repository NN news-docnow-io-1641 84 15 . . . news-docnow-io-1641 85 1 For for IN news-docnow-io-1641 85 2 some some DT news-docnow-io-1641 85 3 users user NNS news-docnow-io-1641 85 4 this this DT news-docnow-io-1641 85 5 is be VBZ news-docnow-io-1641 85 6 fine fine JJ news-docnow-io-1641 85 7 , , , news-docnow-io-1641 85 8 but but CC news-docnow-io-1641 85 9 it -PRON- PRP news-docnow-io-1641 85 10 ’s ’ VBZ news-docnow-io-1641 85 11 a a DT news-docnow-io-1641 85 12 bit bit NN news-docnow-io-1641 85 13 of of IN news-docnow-io-1641 85 14 a a DT news-docnow-io-1641 85 15 barrier barrier NN news-docnow-io-1641 85 16 to to IN news-docnow-io-1641 85 17 entry entry NN news-docnow-io-1641 85 18 for for IN news-docnow-io-1641 85 19 users user NNS news-docnow-io-1641 85 20 who who WP news-docnow-io-1641 85 21 have have VBP news-docnow-io-1641 85 22 just just RB news-docnow-io-1641 85 23 installed instal VBN news-docnow-io-1641 85 24 twarc twarc NN news-docnow-io-1641 85 25 with with IN news-docnow-io-1641 85 26 pip pip NNP news-docnow-io-1641 85 27 . . . news-docnow-io-1641 86 1 Furthermore furthermore RB news-docnow-io-1641 86 2 these these DT news-docnow-io-1641 86 3 plugins plugin NNS news-docnow-io-1641 86 4 often often RB news-docnow-io-1641 86 5 have have VBP news-docnow-io-1641 86 6 their -PRON- PRP$ news-docnow-io-1641 86 7 own own JJ news-docnow-io-1641 86 8 dependencies dependency NNS news-docnow-io-1641 86 9 which which WDT news-docnow-io-1641 86 10 twarc twarc NNP news-docnow-io-1641 86 11 itself -PRON- PRP news-docnow-io-1641 86 12 does do VBZ news-docnow-io-1641 86 13 not not RB news-docnow-io-1641 86 14 . . . news-docnow-io-1641 87 1 This this DT news-docnow-io-1641 87 2 lets let VBZ news-docnow-io-1641 87 3 twarc twarc NN news-docnow-io-1641 87 4 can can MD news-docnow-io-1641 87 5 stay stay VB news-docnow-io-1641 87 6 pretty pretty RB news-docnow-io-1641 87 7 lean lean JJ news-docnow-io-1641 87 8 , , , news-docnow-io-1641 87 9 and and CC news-docnow-io-1641 87 10 things thing NNS news-docnow-io-1641 87 11 like like IN news-docnow-io-1641 87 12 youtube_dl youtube_dl NNP news-docnow-io-1641 87 13 , , , news-docnow-io-1641 87 14 NetworkX NetworkX NNP news-docnow-io-1641 87 15 or or CC news-docnow-io-1641 87 16 Pandas Pandas NNP news-docnow-io-1641 87 17 can can MD news-docnow-io-1641 87 18 be be VB news-docnow-io-1641 87 19 installed instal VBN news-docnow-io-1641 87 20 by by IN news-docnow-io-1641 87 21 people people NNS news-docnow-io-1641 87 22 that that WDT news-docnow-io-1641 87 23 want want VBP news-docnow-io-1641 87 24 to to TO news-docnow-io-1641 87 25 use use VB news-docnow-io-1641 87 26 utilities utility NNS news-docnow-io-1641 87 27 that that WDT news-docnow-io-1641 87 28 need need VBP news-docnow-io-1641 87 29 them -PRON- PRP news-docnow-io-1641 87 30 . . . news-docnow-io-1641 88 1 But but CC news-docnow-io-1641 88 2 since since IN news-docnow-io-1641 88 3 there there EX news-docnow-io-1641 88 4 is be VBZ news-docnow-io-1641 88 5 no no DT news-docnow-io-1641 88 6 way way NN news-docnow-io-1641 88 7 to to TO news-docnow-io-1641 88 8 install install VB news-docnow-io-1641 88 9 the the DT news-docnow-io-1641 88 10 utilities utility NNS news-docnow-io-1641 88 11 there there EX news-docnow-io-1641 88 12 is be VBZ news-docnow-io-1641 88 13 n’t not RB news-docnow-io-1641 88 14 a a DT news-docnow-io-1641 88 15 way way NN news-docnow-io-1641 88 16 to to TO news-docnow-io-1641 88 17 ensure ensure VB news-docnow-io-1641 88 18 that that IN news-docnow-io-1641 88 19 the the DT news-docnow-io-1641 88 20 dependencies dependency NNS news-docnow-io-1641 88 21 are be VBP news-docnow-io-1641 88 22 installed instal VBN news-docnow-io-1641 88 23 , , , news-docnow-io-1641 88 24 which which WDT news-docnow-io-1641 88 25 can can MD news-docnow-io-1641 88 26 lead lead VB news-docnow-io-1641 88 27 to to IN news-docnow-io-1641 88 28 users user NNS news-docnow-io-1641 88 29 needing need VBG news-docnow-io-1641 88 30 to to TO news-docnow-io-1641 88 31 diagnose diagnose VB news-docnow-io-1641 88 32 missing miss VBG news-docnow-io-1641 88 33 libraries library NNS news-docnow-io-1641 88 34 themselves -PRON- PRP news-docnow-io-1641 88 35 . . . news-docnow-io-1641 89 1 Finally finally RB news-docnow-io-1641 89 2 the the DT news-docnow-io-1641 89 3 plugins plugin NNS news-docnow-io-1641 89 4 have have VBP news-docnow-io-1641 89 5 typically typically RB news-docnow-io-1641 89 6 lacked lack VBN news-docnow-io-1641 89 7 their -PRON- PRP$ news-docnow-io-1641 89 8 own own JJ news-docnow-io-1641 89 9 tests test NNS news-docnow-io-1641 89 10 . . . news-docnow-io-1641 90 1 twarc twarc NNP news-docnow-io-1641 90 2 ’s ’s POS news-docnow-io-1641 90 3 test test NNP news-docnow-io-1641 90 4 suite suite NN news-docnow-io-1641 90 5 has have VBZ news-docnow-io-1641 90 6 really really RB news-docnow-io-1641 90 7 helped help VBN news-docnow-io-1641 90 8 us -PRON- PRP news-docnow-io-1641 90 9 track track VB news-docnow-io-1641 90 10 changes change NNS news-docnow-io-1641 90 11 to to IN news-docnow-io-1641 90 12 the the DT news-docnow-io-1641 90 13 Twitter Twitter NNP news-docnow-io-1641 90 14 API API NNP news-docnow-io-1641 90 15 and and CC news-docnow-io-1641 90 16 to to TO news-docnow-io-1641 90 17 make make VB news-docnow-io-1641 90 18 sure sure JJ news-docnow-io-1641 90 19 that that IN news-docnow-io-1641 90 20 it -PRON- PRP news-docnow-io-1641 90 21 continues continue VBZ news-docnow-io-1641 90 22 to to TO news-docnow-io-1641 90 23 operate operate VB news-docnow-io-1641 90 24 properly properly RB news-docnow-io-1641 90 25 as as IN news-docnow-io-1641 90 26 new new JJ news-docnow-io-1641 90 27 functionality functionality NN news-docnow-io-1641 90 28 has have VBZ news-docnow-io-1641 90 29 been be VBN news-docnow-io-1641 90 30 added add VBN news-docnow-io-1641 90 31 . . . news-docnow-io-1641 91 1 But but CC news-docnow-io-1641 91 2 nothing nothing NN news-docnow-io-1641 91 3 like like IN news-docnow-io-1641 91 4 this this DT news-docnow-io-1641 91 5 has have VBZ news-docnow-io-1641 91 6 existed exist VBN news-docnow-io-1641 91 7 for for IN news-docnow-io-1641 91 8 the the DT news-docnow-io-1641 91 9 utilities utility NNS news-docnow-io-1641 91 10 . . . news-docnow-io-1641 92 1 We -PRON- PRP news-docnow-io-1641 92 2 ’ve have VB news-docnow-io-1641 92 3 noticed notice VBN news-docnow-io-1641 92 4 that that IN news-docnow-io-1641 92 5 over over IN news-docnow-io-1641 92 6 time time NN news-docnow-io-1641 92 7 some some DT news-docnow-io-1641 92 8 of of IN news-docnow-io-1641 92 9 them -PRON- PRP news-docnow-io-1641 92 10 need need VBP news-docnow-io-1641 92 11 updating update VBG news-docnow-io-1641 92 12 . . . news-docnow-io-1641 93 1 Also also RB news-docnow-io-1641 93 2 their -PRON- PRP$ news-docnow-io-1641 93 3 command command NN news-docnow-io-1641 93 4 line line NN news-docnow-io-1641 93 5 arguments argument NNS news-docnow-io-1641 93 6 have have VBP news-docnow-io-1641 93 7 drifted drift VBN news-docnow-io-1641 93 8 over over IN news-docnow-io-1641 93 9 time time NN news-docnow-io-1641 93 10 which which WDT news-docnow-io-1641 93 11 can can MD news-docnow-io-1641 93 12 lead lead VB news-docnow-io-1641 93 13 to to IN news-docnow-io-1641 93 14 some some DT news-docnow-io-1641 93 15 inconsistencies inconsistency NNS news-docnow-io-1641 93 16 in in IN news-docnow-io-1641 93 17 how how WRB news-docnow-io-1641 93 18 they -PRON- PRP news-docnow-io-1641 93 19 are be VBP news-docnow-io-1641 93 20 used use VBN news-docnow-io-1641 93 21 . . . news-docnow-io-1641 94 1 So so CC news-docnow-io-1641 94 2 with with IN news-docnow-io-1641 94 3 twarc2 twarc2 NN news-docnow-io-1641 94 4 we -PRON- PRP news-docnow-io-1641 94 5 ’ve have VB news-docnow-io-1641 94 6 introduced introduce VBN news-docnow-io-1641 94 7 the the DT news-docnow-io-1641 94 8 idea idea NN news-docnow-io-1641 94 9 of of IN news-docnow-io-1641 94 10 plugins plugin NNS news-docnow-io-1641 94 11 which which WDT news-docnow-io-1641 94 12 extend extend VBP news-docnow-io-1641 94 13 the the DT news-docnow-io-1641 94 14 functionality functionality NN news-docnow-io-1641 94 15 of of IN news-docnow-io-1641 94 16 the the DT news-docnow-io-1641 94 17 twarc2 twarc2 NNP news-docnow-io-1641 94 18 command command NN news-docnow-io-1641 94 19 , , , news-docnow-io-1641 94 20 are be VBP news-docnow-io-1641 94 21 distributed distribute VBN news-docnow-io-1641 94 22 on on IN news-docnow-io-1641 94 23 PyPI pypi NN news-docnow-io-1641 94 24 separately separately RB news-docnow-io-1641 94 25 from from IN news-docnow-io-1641 94 26 twarc twarc NNP news-docnow-io-1641 94 27 , , , news-docnow-io-1641 94 28 and and CC news-docnow-io-1641 94 29 exist exist VB news-docnow-io-1641 94 30 in in IN news-docnow-io-1641 94 31 their -PRON- PRP$ news-docnow-io-1641 94 32 own own JJ news-docnow-io-1641 94 33 GitHub GitHub NNP news-docnow-io-1641 94 34 repositories repository NNS news-docnow-io-1641 94 35 where where WRB news-docnow-io-1641 94 36 they -PRON- PRP news-docnow-io-1641 94 37 can can MD news-docnow-io-1641 94 38 be be VB news-docnow-io-1641 94 39 developed develop VBN news-docnow-io-1641 94 40 and and CC news-docnow-io-1641 94 41 tested test VBN news-docnow-io-1641 94 42 independently independently RB news-docnow-io-1641 94 43 of of IN news-docnow-io-1641 94 44 twarc twarc NNP news-docnow-io-1641 94 45 itself -PRON- PRP news-docnow-io-1641 94 46 . . . news-docnow-io-1641 95 1 This this DT news-docnow-io-1641 95 2 is be VBZ news-docnow-io-1641 95 3 all all DT news-docnow-io-1641 95 4 achieved achieve VBN news-docnow-io-1641 95 5 through through IN news-docnow-io-1641 95 6 twarc2 twarc2 NN news-docnow-io-1641 95 7 ’s ’s POS news-docnow-io-1641 95 8 use use NN news-docnow-io-1641 95 9 of of IN news-docnow-io-1641 95 10 the the DT news-docnow-io-1641 95 11 click click JJ news-docnow-io-1641 95 12 library library NN news-docnow-io-1641 95 13 and and CC news-docnow-io-1641 95 14 specifically specifically RB news-docnow-io-1641 95 15 click click NN news-docnow-io-1641 95 16 - - HYPH news-docnow-io-1641 95 17 plugins plugin NNS news-docnow-io-1641 95 18 . . . news-docnow-io-1641 96 1 So so RB news-docnow-io-1641 96 2 now now RB news-docnow-io-1641 96 3 if if IN news-docnow-io-1641 96 4 you -PRON- PRP news-docnow-io-1641 96 5 would would MD news-docnow-io-1641 96 6 like like VB news-docnow-io-1641 96 7 to to TO news-docnow-io-1641 96 8 convert convert VB news-docnow-io-1641 96 9 your -PRON- PRP$ news-docnow-io-1641 96 10 collected collect VBN news-docnow-io-1641 96 11 tweets tweet NNS news-docnow-io-1641 96 12 to to IN news-docnow-io-1641 96 13 CSV CSV NNP news-docnow-io-1641 96 14 you -PRON- PRP news-docnow-io-1641 96 15 can can MD news-docnow-io-1641 96 16 install install VB news-docnow-io-1641 96 17 the the DT news-docnow-io-1641 96 18 twarc twarc NN news-docnow-io-1641 96 19 - - HYPH news-docnow-io-1641 96 20 csv csv NN news-docnow-io-1641 96 21 : : : news-docnow-io-1641 96 22 $ $ $ news-docnow-io-1641 96 23 pip pip NN news-docnow-io-1641 96 24 install install VB news-docnow-io-1641 96 25 twarc twarc NN news-docnow-io-1641 96 26 - - HYPH news-docnow-io-1641 96 27 csv csv NN news-docnow-io-1641 96 28 $ $ $ news-docnow-io-1641 96 29 twarc2 twarc2 NN news-docnow-io-1641 96 30 search search NN news-docnow-io-1641 96 31 covid19 covid19 NNS news-docnow-io-1641 96 32 > > XX news-docnow-io-1641 96 33 covid19.jsonl covid19.jsonl NNP news-docnow-io-1641 96 34 $ $ $ news-docnow-io-1641 96 35 twarc2 twarc2 NN news-docnow-io-1641 96 36 csv csv NN news-docnow-io-1641 96 37 covid19.jsonl covid19.jsonl NNP news-docnow-io-1641 96 38 > > XX news-docnow-io-1641 96 39 covid19.csv covid19.csv NNP news-docnow-io-1641 96 40 Or or CC news-docnow-io-1641 96 41 if if IN news-docnow-io-1641 96 42 you -PRON- PRP news-docnow-io-1641 96 43 want want VBP news-docnow-io-1641 96 44 to to TO news-docnow-io-1641 96 45 extract extract VB news-docnow-io-1641 96 46 embedded embed VBN news-docnow-io-1641 96 47 and and CC news-docnow-io-1641 96 48 referenced referenced JJ news-docnow-io-1641 96 49 videos video NNS news-docnow-io-1641 96 50 from from IN news-docnow-io-1641 96 51 tweets tweet NNS news-docnow-io-1641 96 52 you -PRON- PRP news-docnow-io-1641 96 53 can can MD news-docnow-io-1641 96 54 install install VB news-docnow-io-1641 96 55 twarc twarc NN news-docnow-io-1641 96 56 - - HYPH news-docnow-io-1641 96 57 videos video NNS news-docnow-io-1641 96 58 which which WDT news-docnow-io-1641 96 59 will will MD news-docnow-io-1641 96 60 write write VB news-docnow-io-1641 96 61 all all PDT news-docnow-io-1641 96 62 the the DT news-docnow-io-1641 96 63 videos video NNS news-docnow-io-1641 96 64 to to IN news-docnow-io-1641 96 65 a a DT news-docnow-io-1641 96 66 directory directory NN news-docnow-io-1641 96 67 : : : news-docnow-io-1641 96 68 $ $ $ news-docnow-io-1641 96 69 pip pip NN news-docnow-io-1641 96 70 install install VB news-docnow-io-1641 96 71 twarc twarc NN news-docnow-io-1641 96 72 - - HYPH news-docnow-io-1641 96 73 videos video NNS news-docnow-io-1641 96 74 $ $ $ news-docnow-io-1641 96 75 twarc2 twarc2 NN news-docnow-io-1641 96 76 videos video NNS news-docnow-io-1641 96 77 covid19.jsonl covid19.jsonl NNP news-docnow-io-1641 96 78 --download --download NN news-docnow-io-1641 96 79 - - HYPH news-docnow-io-1641 96 80 dir dir NNS news-docnow-io-1641 96 81 covid19-videos covid19-video NNS news-docnow-io-1641 96 82 You -PRON- PRP news-docnow-io-1641 96 83 can can MD news-docnow-io-1641 96 84 write write VB news-docnow-io-1641 96 85 these these DT news-docnow-io-1641 96 86 plugins plugin NNS news-docnow-io-1641 96 87 yourself -PRON- PRP news-docnow-io-1641 96 88 and and CC news-docnow-io-1641 96 89 release release VB news-docnow-io-1641 96 90 them -PRON- PRP news-docnow-io-1641 96 91 as as IN news-docnow-io-1641 96 92 needed need VBN news-docnow-io-1641 96 93 . . . news-docnow-io-1641 97 1 Check check VB news-docnow-io-1641 97 2 out out RP news-docnow-io-1641 97 3 the the DT news-docnow-io-1641 97 4 plugin plugin NN news-docnow-io-1641 97 5 reference reference NN news-docnow-io-1641 97 6 implementation implementation NN news-docnow-io-1641 97 7 tweet tweet NNP news-docnow-io-1641 97 8 - - HYPH news-docnow-io-1641 97 9 ids ids NNP news-docnow-io-1641 97 10 for for IN news-docnow-io-1641 97 11 a a DT news-docnow-io-1641 97 12 simple simple JJ news-docnow-io-1641 97 13 example example NN news-docnow-io-1641 97 14 to to TO news-docnow-io-1641 97 15 adapt adapt VB news-docnow-io-1641 97 16 . . . news-docnow-io-1641 98 1 We -PRON- PRP news-docnow-io-1641 98 2 ’re be VBZ news-docnow-io-1641 98 3 still still RB news-docnow-io-1641 98 4 in in IN news-docnow-io-1641 98 5 the the DT news-docnow-io-1641 98 6 process process NN news-docnow-io-1641 98 7 of of IN news-docnow-io-1641 98 8 porting port VBG news-docnow-io-1641 98 9 some some DT news-docnow-io-1641 98 10 of of IN news-docnow-io-1641 98 11 the the DT news-docnow-io-1641 98 12 most most RBS news-docnow-io-1641 98 13 useful useful JJ news-docnow-io-1641 98 14 utilities utility NNS news-docnow-io-1641 98 15 over over RB news-docnow-io-1641 98 16 and and CC news-docnow-io-1641 98 17 would would MD news-docnow-io-1641 98 18 love love VB news-docnow-io-1641 98 19 to to TO news-docnow-io-1641 98 20 see see VB news-docnow-io-1641 98 21 ideas idea NNS news-docnow-io-1641 98 22 for for IN news-docnow-io-1641 98 23 new new JJ news-docnow-io-1641 98 24 plugins plugin NNS news-docnow-io-1641 98 25 . . . news-docnow-io-1641 99 1 Check check VB news-docnow-io-1641 99 2 out out RP news-docnow-io-1641 99 3 the the DT news-docnow-io-1641 99 4 current current JJ news-docnow-io-1641 99 5 list list NN news-docnow-io-1641 99 6 of of IN news-docnow-io-1641 99 7 twarc2 twarc2 NN news-docnow-io-1641 99 8 plugins plugin NNS news-docnow-io-1641 99 9 and and CC news-docnow-io-1641 99 10 use use VB news-docnow-io-1641 99 11 the the DT news-docnow-io-1641 99 12 twarc twarc NNP news-docnow-io-1641 99 13 issue issue NN news-docnow-io-1641 99 14 tracker tracker NN news-docnow-io-1641 99 15 on on IN news-docnow-io-1641 99 16 GitHub GitHub NNP news-docnow-io-1641 99 17 to to TO news-docnow-io-1641 99 18 join join VB news-docnow-io-1641 99 19 the the DT news-docnow-io-1641 99 20 discussion discussion NN news-docnow-io-1641 99 21 . . . news-docnow-io-1641 100 1 You -PRON- PRP news-docnow-io-1641 100 2 may may MD news-docnow-io-1641 100 3 notice notice VB news-docnow-io-1641 100 4 from from IN news-docnow-io-1641 100 5 the the DT news-docnow-io-1641 100 6 list list NN news-docnow-io-1641 100 7 of of IN news-docnow-io-1641 100 8 plugins plugin NNS news-docnow-io-1641 100 9 that that WDT news-docnow-io-1641 100 10 twarc twarc NNP news-docnow-io-1641 100 11 now now RB news-docnow-io-1641 100 12 ( ( -LRB- news-docnow-io-1641 100 13 finally finally RB news-docnow-io-1641 100 14 ) ) -RRB- news-docnow-io-1641 100 15 has have VBZ news-docnow-io-1641 100 16 documentation documentation NN news-docnow-io-1641 100 17 on on IN news-docnow-io-1641 100 18 ReadTheDocs readthedocs CD news-docnow-io-1641 100 19 external external JJ news-docnow-io-1641 100 20 from from IN news-docnow-io-1641 100 21 the the DT news-docnow-io-1641 100 22 documentation documentation NN news-docnow-io-1641 100 23 that that WDT news-docnow-io-1641 100 24 was be VBD news-docnow-io-1641 100 25 previously previously RB news-docnow-io-1641 100 26 only only RB news-docnow-io-1641 100 27 available available JJ news-docnow-io-1641 100 28 on on IN news-docnow-io-1641 100 29 GitHub GitHub NNP news-docnow-io-1641 100 30 . . . news-docnow-io-1641 101 1 We -PRON- PRP news-docnow-io-1641 101 2 got get VBD news-docnow-io-1641 101 3 by by RP news-docnow-io-1641 101 4 with with IN news-docnow-io-1641 101 5 GitHub GitHub NNP news-docnow-io-1641 101 6 ’s ’s POS news-docnow-io-1641 101 7 rendering rendering NN news-docnow-io-1641 101 8 of of IN news-docnow-io-1641 101 9 Markdown Markdown NNP news-docnow-io-1641 101 10 documents document NNS news-docnow-io-1641 101 11 for for IN news-docnow-io-1641 101 12 a a DT news-docnow-io-1641 101 13 while while NN news-docnow-io-1641 101 14 , , , news-docnow-io-1641 101 15 but but CC news-docnow-io-1641 101 16 GitHub GitHub NNP news-docnow-io-1641 101 17 ’s ’s POS news-docnow-io-1641 101 18 boilerplate boilerplate NN news-docnow-io-1641 101 19 designed design VBN news-docnow-io-1641 101 20 for for IN news-docnow-io-1641 101 21 developers developer NNS news-docnow-io-1641 101 22 can can MD news-docnow-io-1641 101 23 prove prove VB news-docnow-io-1641 101 24 to to TO news-docnow-io-1641 101 25 be be VB news-docnow-io-1641 101 26 quite quite RB news-docnow-io-1641 101 27 confusing confusing JJ news-docnow-io-1641 101 28 for for IN news-docnow-io-1641 101 29 users user NNS news-docnow-io-1641 101 30 who who WP news-docnow-io-1641 101 31 are be VBP news-docnow-io-1641 101 32 n’t not RB news-docnow-io-1641 101 33 used use VBN news-docnow-io-1641 101 34 to to TO news-docnow-io-1641 101 35 selectively selectively RB news-docnow-io-1641 101 36 ignoring ignore VBG news-docnow-io-1641 101 37 it -PRON- PRP news-docnow-io-1641 101 38 . . . news-docnow-io-1641 102 1 ReadTheDocs ReadTheDocs NNP news-docnow-io-1641 102 2 allows allow VBZ news-docnow-io-1641 102 3 us -PRON- PRP news-docnow-io-1641 102 4 to to TO news-docnow-io-1641 102 5 manage manage VB news-docnow-io-1641 102 6 the the DT news-docnow-io-1641 102 7 command command NN news-docnow-io-1641 102 8 line line NN news-docnow-io-1641 102 9 and and CC news-docnow-io-1641 102 10 API api NN news-docnow-io-1641 102 11 documentation documentation NN news-docnow-io-1641 102 12 for for IN news-docnow-io-1641 102 13 twarc twarc NNP news-docnow-io-1641 102 14 , , , news-docnow-io-1641 102 15 and and CC news-docnow-io-1641 102 16 to to TO news-docnow-io-1641 102 17 showcase showcase VB news-docnow-io-1641 102 18 the the DT news-docnow-io-1641 102 19 work work NN news-docnow-io-1641 102 20 that that WDT news-docnow-io-1641 102 21 has have VBZ news-docnow-io-1641 102 22 gone go VBN news-docnow-io-1641 102 23 into into IN news-docnow-io-1641 102 24 the the DT news-docnow-io-1641 102 25 Spanish spanish JJ news-docnow-io-1641 102 26 , , , news-docnow-io-1641 102 27 Japanese japanese JJ news-docnow-io-1641 102 28 , , , news-docnow-io-1641 102 29 Portuguese portuguese JJ news-docnow-io-1641 102 30 , , , news-docnow-io-1641 102 31 Swedish swedish JJ news-docnow-io-1641 102 32 , , , news-docnow-io-1641 102 33 Swahili Swahili NNP news-docnow-io-1641 102 34 and and CC news-docnow-io-1641 102 35 Chinese chinese JJ news-docnow-io-1641 102 36 translations translation NNS news-docnow-io-1641 102 37 . . . news-docnow-io-1641 103 1 Feedback feedback NN news-docnow-io-1641 103 2 Thanks thank NNS news-docnow-io-1641 103 3 for for IN news-docnow-io-1641 103 4 reading read VBG news-docnow-io-1641 103 5 this this DT news-docnow-io-1641 103 6 far far RB news-docnow-io-1641 103 7 ! ! . news-docnow-io-1641 104 1 We -PRON- PRP news-docnow-io-1641 104 2 hope hope VBP news-docnow-io-1641 104 3 you -PRON- PRP news-docnow-io-1641 104 4 will will MD news-docnow-io-1641 104 5 give give VB news-docnow-io-1641 104 6 twarc2 twarc2 PRP news-docnow-io-1641 104 7 a a DT news-docnow-io-1641 104 8 try try NN news-docnow-io-1641 104 9 . . . news-docnow-io-1641 105 1 Let let VB news-docnow-io-1641 105 2 us -PRON- PRP news-docnow-io-1641 105 3 know know VB news-docnow-io-1641 105 4 what what WP news-docnow-io-1641 105 5 you -PRON- PRP news-docnow-io-1641 105 6 think think VBP news-docnow-io-1641 105 7 either either CC news-docnow-io-1641 105 8 in in IN news-docnow-io-1641 105 9 comments comment NNS news-docnow-io-1641 105 10 here here RB news-docnow-io-1641 105 11 , , , news-docnow-io-1641 105 12 in in IN news-docnow-io-1641 105 13 the the DT news-docnow-io-1641 105 14 DocNow DocNow NNP news-docnow-io-1641 105 15 Slack Slack NNP news-docnow-io-1641 105 16 or or CC news-docnow-io-1641 105 17 over over RB news-docnow-io-1641 105 18 on on IN news-docnow-io-1641 105 19 GitHub GitHub NNP news-docnow-io-1641 105 20 . . . news-docnow-io-1641 106 1 ✨ ✨ NNP news-docnow-io-1641 106 2 ✨ ✨ NNP news-docnow-io-1641 106 3 Happy happy JJ news-docnow-io-1641 106 4 twarcing twarcing NN news-docnow-io-1641 106 5 ! ! . news-docnow-io-1641 107 1 ✨ ✨ NNP news-docnow-io-1641 107 2 ✨ ✨ NNP news-docnow-io-1641 107 3 ✨ ✨ NNP news-docnow-io-1641 107 4 Windows Windows NNP news-docnow-io-1641 107 5 users user NNS news-docnow-io-1641 107 6 will will MD news-docnow-io-1641 107 7 want want VB news-docnow-io-1641 107 8 to to TO news-docnow-io-1641 107 9 indicate indicate VB news-docnow-io-1641 107 10 the the DT news-docnow-io-1641 107 11 output output NN news-docnow-io-1641 107 12 file file NN news-docnow-io-1641 107 13 using use VBG news-docnow-io-1641 107 14 a a DT news-docnow-io-1641 107 15 second second JJ news-docnow-io-1641 107 16 argument argument NN news-docnow-io-1641 107 17 rather rather RB news-docnow-io-1641 107 18 than than IN news-docnow-io-1641 107 19 redirecting redirect VBG news-docnow-io-1641 107 20 output output NN news-docnow-io-1641 107 21 with with IN news-docnow-io-1641 107 22 > > XX news-docnow-io-1641 107 23 . . . news-docnow-io-1641 108 1 See see VB news-docnow-io-1641 108 2 this this DT news-docnow-io-1641 108 3 page page NN news-docnow-io-1641 108 4 for for IN news-docnow-io-1641 108 5 details detail NNS news-docnow-io-1641 108 6 . . . news-docnow-io-1641 109 1 Documenting document VBG news-docnow-io-1641 109 2 DocNow DocNow NNP news-docnow-io-1641 109 3 News News NNP news-docnow-io-1641 109 4 from from IN news-docnow-io-1641 109 5 the the DT news-docnow-io-1641 109 6 Documenting Documenting NNP news-docnow-io-1641 109 7 the the DT news-docnow-io-1641 109 8 Now Now NNP news-docnow-io-1641 109 9 Project Project NNP news-docnow-io-1641 109 10 Follow Follow NNP news-docnow-io-1641 109 11 15 15 CD news-docnow-io-1641 109 12 2 2 CD news-docnow-io-1641 109 13 Some some DT news-docnow-io-1641 109 14 rights right NNS news-docnow-io-1641 109 15 reserved reserve VBD news-docnow-io-1641 109 16 Twitter Twitter NNP news-docnow-io-1641 109 17 Social Social NNP news-docnow-io-1641 109 18 Media Media NNP news-docnow-io-1641 109 19 Archive Archive NNP news-docnow-io-1641 109 20 Research Research NNP news-docnow-io-1641 109 21 Python Python NNP news-docnow-io-1641 109 22 15 15 CD news-docnow-io-1641 109 23   _SP news-docnow-io-1641 109 24 claps clap VBZ news-docnow-io-1641 109 25 15 15 CD news-docnow-io-1641 109 26 2 2 CD news-docnow-io-1641 109 27 Written write VBN news-docnow-io-1641 109 28 by by IN news-docnow-io-1641 109 29 Ed Ed NNP news-docnow-io-1641 109 30 Summers Summers NNP news-docnow-io-1641 109 31 Follow Follow NNP news-docnow-io-1641 109 32 I -PRON- PRP news-docnow-io-1641 109 33 ’m be VBP news-docnow-io-1641 109 34 a a DT news-docnow-io-1641 109 35 software software NN news-docnow-io-1641 109 36 developer developer NN news-docnow-io-1641 109 37 at at IN news-docnow-io-1641 109 38 @umd_mith @umd_mith NNP news-docnow-io-1641 109 39 & & CC news-docnow-io-1641 109 40 study study NNP news-docnow-io-1641 109 41 archives archive NNS news-docnow-io-1641 109 42 on on IN news-docnow-io-1641 109 43 / / SYM news-docnow-io-1641 109 44 of of IN news-docnow-io-1641 109 45 the the DT news-docnow-io-1641 109 46 web web NN news-docnow-io-1641 109 47 at at IN news-docnow-io-1641 109 48 @iSchoolUMD @ischoolumd NN news-docnow-io-1641 109 49 Follow Follow NNP news-docnow-io-1641 109 50 Documenting Documenting NNP news-docnow-io-1641 109 51 DocNow DocNow NNP news-docnow-io-1641 109 52 Follow Follow NNP news-docnow-io-1641 109 53 News News NNP news-docnow-io-1641 109 54 from from IN news-docnow-io-1641 109 55 the the DT news-docnow-io-1641 109 56 Documenting Documenting NNP news-docnow-io-1641 109 57 the the DT news-docnow-io-1641 109 58 Now Now NNP news-docnow-io-1641 109 59 Project Project NNP news-docnow-io-1641 109 60 Follow follow NN news-docnow-io-1641 109 61 Written write VBN news-docnow-io-1641 109 62 by by IN news-docnow-io-1641 109 63 Ed Ed NNP news-docnow-io-1641 109 64 Summers Summers NNP news-docnow-io-1641 109 65 Follow Follow NNP news-docnow-io-1641 109 66 I -PRON- PRP news-docnow-io-1641 109 67 ’m be VBP news-docnow-io-1641 109 68 a a DT news-docnow-io-1641 109 69 software software NN news-docnow-io-1641 109 70 developer developer NN news-docnow-io-1641 109 71 at at IN news-docnow-io-1641 109 72 @umd_mith @umd_mith NNP news-docnow-io-1641 109 73 & & CC news-docnow-io-1641 109 74 study study NNP news-docnow-io-1641 109 75 archives archive NNS news-docnow-io-1641 109 76 on on IN news-docnow-io-1641 109 77 / / SYM news-docnow-io-1641 109 78 of of IN news-docnow-io-1641 109 79 the the DT news-docnow-io-1641 109 80 web web NN news-docnow-io-1641 109 81 at at IN news-docnow-io-1641 109 82 @iSchoolUMD @ischoolumd NN news-docnow-io-1641 109 83 Documenting Documenting NNP news-docnow-io-1641 109 84 DocNow DocNow NNP news-docnow-io-1641 109 85 Follow Follow NNP news-docnow-io-1641 109 86 News News NNP news-docnow-io-1641 109 87 from from IN news-docnow-io-1641 109 88 the the DT news-docnow-io-1641 109 89 Documenting Documenting NNP news-docnow-io-1641 109 90 the the DT news-docnow-io-1641 109 91 Now Now NNP news-docnow-io-1641 109 92 Project project NN news-docnow-io-1641 109 93 More More JJR news-docnow-io-1641 109 94 From from IN news-docnow-io-1641 109 95 Medium Medium NNP news-docnow-io-1641 109 96 Streams Streams NNPS news-docnow-io-1641 109 97 Ed Ed NNP news-docnow-io-1641 109 98 Summers Summers NNP news-docnow-io-1641 109 99 in in IN news-docnow-io-1641 109 100 Documenting document VBG news-docnow-io-1641 109 101 DocNow DocNow NNP news-docnow-io-1641 109 102 Remembering Remembering NNP news-docnow-io-1641 109 103 Bassem Bassem NNP news-docnow-io-1641 109 104 Masri Masri NNP news-docnow-io-1641 109 105 Ed Ed NNP news-docnow-io-1641 109 106 Summers Summers NNP news-docnow-io-1641 109 107 in in IN news-docnow-io-1641 109 108 Documenting Documenting NNP news-docnow-io-1641 109 109 DocNow DocNow NNP news-docnow-io-1641 109 110 Trump Trump NNP news-docnow-io-1641 109 111 ’s ’s POS news-docnow-io-1641 109 112 Tweets Tweets NNPS news-docnow-io-1641 109 113 Ed Ed NNP news-docnow-io-1641 109 114 Summers Summers NNP news-docnow-io-1641 109 115 in in IN news-docnow-io-1641 109 116 Documenting Documenting NNP news-docnow-io-1641 109 117 DocNow DocNow NNP news-docnow-io-1641 109 118 Twint Twint NNP news-docnow-io-1641 109 119 : : : news-docnow-io-1641 109 120 Twitter twitter NN news-docnow-io-1641 109 121 Scraping scrape VBG news-docnow-io-1641 109 122 Without without IN news-docnow-io-1641 109 123 Twitter Twitter NNP news-docnow-io-1641 109 124 ’s ’s , news-docnow-io-1641 109 125 API API NNP news-docnow-io-1641 109 126 Basil Basil NNP news-docnow-io-1641 109 127 K K NNP news-docnow-io-1641 109 128 Jose Jose NNP news-docnow-io-1641 109 129 in in IN news-docnow-io-1641 109 130 Analytics Analytics NNP news-docnow-io-1641 109 131 Vidhya Vidhya NNP news-docnow-io-1641 109 132 Headlines Headlines NNPS news-docnow-io-1641 109 133 and and CC news-docnow-io-1641 109 134 Congressional Congressional NNP news-docnow-io-1641 109 135 Twitter Twitter NNP news-docnow-io-1641 109 136 : : : news-docnow-io-1641 109 137 Sentiment Sentiment NNP news-docnow-io-1641 109 138 and and CC news-docnow-io-1641 109 139 Topic Topic NNP news-docnow-io-1641 109 140 Analysis Analysis NNP news-docnow-io-1641 109 141 Adhitya Adhitya NNP news-docnow-io-1641 109 142 Venkatraman Venkatraman NNP news-docnow-io-1641 109 143 in in IN news-docnow-io-1641 109 144 Towards Towards NNP news-docnow-io-1641 109 145 Data Data NNP news-docnow-io-1641 109 146 Science Science NNP news-docnow-io-1641 109 147 What what WP news-docnow-io-1641 109 148 do do VBP news-docnow-io-1641 109 149 Twitter Twitter NNP news-docnow-io-1641 109 150 users user NNS news-docnow-io-1641 109 151 think think VB news-docnow-io-1641 109 152 about about IN news-docnow-io-1641 109 153 the the DT news-docnow-io-1641 109 154 Nagorno Nagorno NNP news-docnow-io-1641 109 155 Karabakh Karabakh NNP news-docnow-io-1641 109 156 War War NNP news-docnow-io-1641 109 157 ? ? . news-docnow-io-1641 110 1 Kaustav Kaustav NNP news-docnow-io-1641 110 2 Bhattacharjee Bhattacharjee NNP news-docnow-io-1641 110 3 in in IN news-docnow-io-1641 110 4 Social Social NNP news-docnow-io-1641 110 5 Media Media NNPS news-docnow-io-1641 110 6 : : : news-docnow-io-1641 110 7 Theories theory NNS news-docnow-io-1641 110 8 , , , news-docnow-io-1641 110 9 Ethics Ethics NNP news-docnow-io-1641 110 10 , , , news-docnow-io-1641 110 11 and and CC news-docnow-io-1641 110 12 Analytics Analytics NNP news-docnow-io-1641 110 13 A A NNP news-docnow-io-1641 110 14 Bigram Bigram NNP news-docnow-io-1641 110 15 Analysis Analysis NNP news-docnow-io-1641 110 16 of of IN news-docnow-io-1641 110 17 the the DT news-docnow-io-1641 110 18 EU EU NNP news-docnow-io-1641 110 19 General General NNP news-docnow-io-1641 110 20 Data Data NNP news-docnow-io-1641 110 21 Protection Protection NNP news-docnow-io-1641 110 22 Regulation Regulation NNP news-docnow-io-1641 110 23 Henson Henson NNP news-docnow-io-1641 110 24 Lee Lee NNP news-docnow-io-1641 110 25 in in IN news-docnow-io-1641 110 26 Towards Towards NNP news-docnow-io-1641 110 27 Data Data NNP news-docnow-io-1641 110 28 Science Science NNP news-docnow-io-1641 110 29 Twitter Twitter NNP news-docnow-io-1641 110 30 analysis analysis NN news-docnow-io-1641 110 31 of of IN news-docnow-io-1641 110 32 the the DT news-docnow-io-1641 110 33 current current JJ news-docnow-io-1641 110 34 political political JJ news-docnow-io-1641 110 35 situation situation NN news-docnow-io-1641 110 36 in in IN news-docnow-io-1641 110 37 Belarus Belarus NNP news-docnow-io-1641 110 38 Daria Daria NNP news-docnow-io-1641 110 39 Minsky Minsky NNP news-docnow-io-1641 110 40 in in IN news-docnow-io-1641 110 41 Towards Towards NNP news-docnow-io-1641 110 42 Data Data NNP news-docnow-io-1641 110 43 Science Science NNP news-docnow-io-1641 110 44 Learn learn VBP news-docnow-io-1641 110 45 more more JJR news-docnow-io-1641 110 46 . . . news-docnow-io-1641 111 1 Medium Medium NNP news-docnow-io-1641 111 2 is be VBZ news-docnow-io-1641 111 3 an an DT news-docnow-io-1641 111 4 open open JJ news-docnow-io-1641 111 5 platform platform NN news-docnow-io-1641 111 6 where where WRB news-docnow-io-1641 111 7 170 170 CD news-docnow-io-1641 111 8 million million CD news-docnow-io-1641 111 9 readers reader NNS news-docnow-io-1641 111 10 come come VBP news-docnow-io-1641 111 11 to to TO news-docnow-io-1641 111 12 find find VB news-docnow-io-1641 111 13 insightful insightful JJ news-docnow-io-1641 111 14 and and CC news-docnow-io-1641 111 15 dynamic dynamic JJ news-docnow-io-1641 111 16 thinking thinking NN news-docnow-io-1641 111 17 . . . news-docnow-io-1641 112 1 Here here RB news-docnow-io-1641 112 2 , , , news-docnow-io-1641 112 3 expert expert NN news-docnow-io-1641 112 4 and and CC news-docnow-io-1641 112 5 undiscovered undiscovered JJ news-docnow-io-1641 112 6 voices voice NNS news-docnow-io-1641 112 7 alike alike RB news-docnow-io-1641 112 8 dive dive VBP news-docnow-io-1641 112 9 into into IN news-docnow-io-1641 112 10 the the DT news-docnow-io-1641 112 11 heart heart NN news-docnow-io-1641 112 12 of of IN news-docnow-io-1641 112 13 any any DT news-docnow-io-1641 112 14 topic topic NN news-docnow-io-1641 112 15 and and CC news-docnow-io-1641 112 16 bring bring VB news-docnow-io-1641 112 17 new new JJ news-docnow-io-1641 112 18 ideas idea NNS news-docnow-io-1641 112 19 to to IN news-docnow-io-1641 112 20 the the DT news-docnow-io-1641 112 21 surface surface NN news-docnow-io-1641 112 22 . . . news-docnow-io-1641 113 1 Learn learn VB news-docnow-io-1641 113 2 more more RBR news-docnow-io-1641 113 3 Make make VB news-docnow-io-1641 113 4 Medium Medium NNP news-docnow-io-1641 113 5 yours -PRON- PRP news-docnow-io-1641 113 6 . . . news-docnow-io-1641 114 1 Follow follow VB news-docnow-io-1641 114 2 the the DT news-docnow-io-1641 114 3 writers writer NNS news-docnow-io-1641 114 4 , , , news-docnow-io-1641 114 5 publications publication NNS news-docnow-io-1641 114 6 , , , news-docnow-io-1641 114 7 and and CC news-docnow-io-1641 114 8 topics topic NNS news-docnow-io-1641 114 9 that that WDT news-docnow-io-1641 114 10 matter matter VBP news-docnow-io-1641 114 11 to to IN news-docnow-io-1641 114 12 you -PRON- PRP news-docnow-io-1641 114 13 , , , news-docnow-io-1641 114 14 and and CC news-docnow-io-1641 114 15 you -PRON- PRP news-docnow-io-1641 114 16 ’ll will MD news-docnow-io-1641 114 17 see see VB news-docnow-io-1641 114 18 them -PRON- PRP news-docnow-io-1641 114 19 on on IN news-docnow-io-1641 114 20 your -PRON- PRP$ news-docnow-io-1641 114 21 homepage homepage NN news-docnow-io-1641 114 22 and and CC news-docnow-io-1641 114 23 in in IN news-docnow-io-1641 114 24 your -PRON- PRP$ news-docnow-io-1641 114 25 inbox inbox NN news-docnow-io-1641 114 26 . . . news-docnow-io-1641 115 1 Explore explore VB news-docnow-io-1641 115 2 Share share NN news-docnow-io-1641 115 3 your -PRON- PRP$ news-docnow-io-1641 115 4 thinking thinking NN news-docnow-io-1641 115 5 . . . news-docnow-io-1641 116 1 If if IN news-docnow-io-1641 116 2 you -PRON- PRP news-docnow-io-1641 116 3 have have VBP news-docnow-io-1641 116 4 a a DT news-docnow-io-1641 116 5 story story NN news-docnow-io-1641 116 6 to to TO news-docnow-io-1641 116 7 tell tell VB news-docnow-io-1641 116 8 , , , news-docnow-io-1641 116 9 knowledge knowledge NN news-docnow-io-1641 116 10 to to TO news-docnow-io-1641 116 11 share share VB news-docnow-io-1641 116 12 , , , news-docnow-io-1641 116 13 or or CC news-docnow-io-1641 116 14 a a DT news-docnow-io-1641 116 15 perspective perspective NN news-docnow-io-1641 116 16 to to TO news-docnow-io-1641 116 17 offer offer VB news-docnow-io-1641 116 18 — — : news-docnow-io-1641 116 19 welcome welcome VB news-docnow-io-1641 116 20 home home NN news-docnow-io-1641 116 21 . . . news-docnow-io-1641 117 1 It -PRON- PRP news-docnow-io-1641 117 2 ’s ’ VBZ news-docnow-io-1641 117 3 easy easy JJ news-docnow-io-1641 117 4 and and CC news-docnow-io-1641 117 5 free free JJ news-docnow-io-1641 117 6 to to TO news-docnow-io-1641 117 7 post post VB news-docnow-io-1641 117 8 your -PRON- PRP$ news-docnow-io-1641 117 9 thinking thinking NN news-docnow-io-1641 117 10 on on IN news-docnow-io-1641 117 11 any any DT news-docnow-io-1641 117 12 topic topic NN news-docnow-io-1641 117 13 . . . news-docnow-io-1641 118 1 Write write VB news-docnow-io-1641 118 2 on on IN news-docnow-io-1641 118 3 Medium medium NN news-docnow-io-1641 118 4 About about IN news-docnow-io-1641 118 5 Help help VB news-docnow-io-1641 118 6 Legal Legal NNP news-docnow-io-1641 118 7 Get get VB news-docnow-io-1641 118 8 the the DT news-docnow-io-1641 118 9 Medium medium JJ news-docnow-io-1641 118 10 app app NN