id sid tid token lemma pos 1r66j100s65 1 1 the the DET 1r66j100s65 1 2 latest late ADJ 1r66j100s65 1 3 advances advance NOUN 1r66j100s65 1 4 in in ADP 1r66j100s65 1 5 information information NOUN 1r66j100s65 1 6 and and CCONJ 1r66j100s65 1 7 communication communication NOUN 1r66j100s65 1 8 technology technology NOUN 1r66j100s65 1 9 have have AUX 1r66j100s65 1 10 made make VERB 1r66j100s65 1 11 it it PRON 1r66j100s65 1 12 possible possible ADJ 1r66j100s65 1 13 for for SCONJ 1r66j100s65 1 14 researchers researcher NOUN 1r66j100s65 1 15 to to PART 1r66j100s65 1 16 design design VERB 1r66j100s65 1 17 innovative innovative ADJ 1r66j100s65 1 18 crowdsourcing crowdsourcing NOUN 1r66j100s65 1 19 systems system NOUN 1r66j100s65 1 20 that that PRON 1r66j100s65 1 21 can can AUX 1r66j100s65 1 22 harness harness VERB 1r66j100s65 1 23 the the DET 1r66j100s65 1 24 human human ADJ 1r66j100s65 1 25 intelligence intelligence NOUN 1r66j100s65 1 26 of of ADP 1r66j100s65 1 27 online online ADJ 1r66j100s65 1 28 communities community NOUN 1r66j100s65 1 29 . . PUNCT 1r66j100s65 2 1 while while SCONJ 1r66j100s65 2 2 crowdsourcing crowdsource VERB 1r66j100s65 2 3 system system NOUN 1r66j100s65 2 4 designs design NOUN 1r66j100s65 2 5 have have AUX 1r66j100s65 2 6 progressed progress VERB 1r66j100s65 2 7 substantially substantially ADV 1r66j100s65 2 8 through through ADP 1r66j100s65 2 9 engineering engineering NOUN 1r66j100s65 2 10 breakthroughs breakthrough NOUN 1r66j100s65 2 11 , , PUNCT 1r66j100s65 2 12 some some DET 1r66j100s65 2 13 challenges challenge NOUN 1r66j100s65 2 14 in in ADP 1r66j100s65 2 15 the the DET 1r66j100s65 2 16 crowdsourcing crowdsourcing NOUN 1r66j100s65 2 17 model model NOUN 1r66j100s65 2 18 however however ADV 1r66j100s65 2 19 remain remain VERB 1r66j100s65 2 20 unanswered unanswered ADJ 1r66j100s65 2 21 , , PUNCT 1r66j100s65 2 22 such such ADJ 1r66j100s65 2 23 as as ADP 1r66j100s65 2 24 ( ( PUNCT 1r66j100s65 2 25 1)system 1)system NUM 1r66j100s65 2 26 design design NOUN 1r66j100s65 2 27 : : PUNCT 1r66j100s65 2 28 in in ADP 1r66j100s65 2 29 various various ADJ 1r66j100s65 2 30 crowdsourcing crowdsourcing NOUN 1r66j100s65 2 31 systems system NOUN 1r66j100s65 2 32 , , PUNCT 1r66j100s65 2 33 what what DET 1r66j100s65 2 34 roles role NOUN 1r66j100s65 2 35 can can AUX 1r66j100s65 2 36 crowds crowd NOUN 1r66j100s65 2 37 play play VERB 1r66j100s65 2 38 and and CCONJ 1r66j100s65 2 39 what what DET 1r66j100s65 2 40 contributions contribution NOUN 1r66j100s65 2 41 can can AUX 1r66j100s65 2 42 they they PRON 1r66j100s65 2 43 make make VERB 1r66j100s65 2 44 ? ? PUNCT 1r66j100s65 3 1 ( ( PUNCT 1r66j100s65 3 2 2 2 X 1r66j100s65 3 3 ) ) PUNCT 1r66j100s65 3 4 data datum NOUN 1r66j100s65 3 5 analysis analysis NOUN 1r66j100s65 3 6 : : PUNCT 1r66j100s65 3 7 how how SCONJ 1r66j100s65 3 8 can can AUX 1r66j100s65 3 9 the the DET 1r66j100s65 3 10 human human ADJ 1r66j100s65 3 11 inputs input NOUN 1r66j100s65 3 12 with with ADP 1r66j100s65 3 13 varied varied ADJ 1r66j100s65 3 14 qualities quality NOUN 1r66j100s65 3 15 be be AUX 1r66j100s65 3 16 properly properly ADV 1r66j100s65 3 17 cleansed cleanse VERB 1r66j100s65 3 18 , , PUNCT 1r66j100s65 3 19 and and CCONJ 1r66j100s65 3 20 how how SCONJ 1r66j100s65 3 21 can can AUX 1r66j100s65 3 22 trustworthy trustworthy ADJ 1r66j100s65 3 23 results result NOUN 1r66j100s65 3 24 be be AUX 1r66j100s65 3 25 effectively effectively ADV 1r66j100s65 3 26 generated generate VERB 1r66j100s65 3 27 from from ADP 1r66j100s65 3 28 their their PRON 1r66j100s65 3 29 myriad myriad ADJ 1r66j100s65 3 30 inputs input NOUN 1r66j100s65 3 31 ? ? PUNCT 1r66j100s65 4 1 ( ( PUNCT 1r66j100s65 4 2 3 3 X 1r66j100s65 4 3 ) ) PUNCT 1r66j100s65 4 4 human human ADJ 1r66j100s65 4 5 computation computation NOUN 1r66j100s65 4 6 theory theory NOUN 1r66j100s65 4 7 : : PUNCT 1r66j100s65 4 8 at at ADP 1r66j100s65 4 9 a a DET 1r66j100s65 4 10 higher high ADJ 1r66j100s65 4 11 level level NOUN 1r66j100s65 4 12 , , PUNCT 1r66j100s65 4 13 what what PRON 1r66j100s65 4 14 is be AUX 1r66j100s65 4 15 the the DET 1r66j100s65 4 16 symbiosis symbiosis NOUN 1r66j100s65 4 17 between between ADP 1r66j100s65 4 18 human human ADJ 1r66j100s65 4 19 intelligence intelligence NOUN 1r66j100s65 4 20 and and CCONJ 1r66j100s65 4 21 artificial artificial ADJ 1r66j100s65 4 22 intelligence intelligence NOUN 1r66j100s65 4 23 ? ? PUNCT 1r66j100s65 5 1 with with ADP 1r66j100s65 5 2 lessons lesson NOUN 1r66j100s65 5 3 learned learn VERB 1r66j100s65 5 4 and and CCONJ 1r66j100s65 5 5 experiences experience NOUN 1r66j100s65 5 6 gained gain VERB 1r66j100s65 5 7 from from ADP 1r66j100s65 5 8 four four NUM 1r66j100s65 5 9 projects project NOUN 1r66j100s65 5 10 , , PUNCT 1r66j100s65 5 11 this this DET 1r66j100s65 5 12 dissertation dissertation NOUN 1r66j100s65 5 13 aims aim VERB 1r66j100s65 5 14 to to PART 1r66j100s65 5 15 provide provide VERB 1r66j100s65 5 16 new new ADJ 1r66j100s65 5 17 perspectives perspective NOUN 1r66j100s65 5 18 and and CCONJ 1r66j100s65 5 19 insights insight NOUN 1r66j100s65 5 20 into into ADP 1r66j100s65 5 21 answering answer VERB 1r66j100s65 5 22 these these DET 1r66j100s65 5 23 questions question NOUN 1r66j100s65 5 24 . . PUNCT 1r66j100s65 6 1 when when SCONJ 1r66j100s65 6 2 presenting present VERB 1r66j100s65 6 3 research research NOUN 1r66j100s65 6 4 observations observation NOUN 1r66j100s65 6 5 and and CCONJ 1r66j100s65 6 6 results result NOUN 1r66j100s65 6 7 , , PUNCT 1r66j100s65 6 8 we we PRON 1r66j100s65 6 9 discuss discuss VERB 1r66j100s65 6 10 a a DET 1r66j100s65 6 11 variety variety NOUN 1r66j100s65 6 12 of of ADP 1r66j100s65 6 13 technological technological ADJ 1r66j100s65 6 14 and and CCONJ 1r66j100s65 6 15 organizational organizational ADJ 1r66j100s65 6 16 considerations consideration NOUN 1r66j100s65 6 17 in in ADP 1r66j100s65 6 18 crowdsourcing crowdsource VERB 1r66j100s65 6 19 system system NOUN 1r66j100s65 6 20 designs design NOUN 1r66j100s65 6 21 . . PUNCT