mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-amazonRiverValley-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/14898.txt inflating: ./tmp/input/input-file/24522.txt inflating: ./tmp/input/input-file/2440.txt inflating: ./tmp/input/input-file/42193.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-amazonRiverValley-gutenberg FILE: cache/24522.txt OUTPUT: txt/24522.txt FILE: cache/14898.txt OUTPUT: txt/14898.txt FILE: cache/2440.txt OUTPUT: txt/2440.txt FILE: cache/42193.txt OUTPUT: txt/42193.txt === file2bib.sh === id: 2440 author: Bates, Henry Walter title: The Naturalist on the River Amazons date: pages: extension: .txt txt: ./txt/2440.txt cache: ./cache/2440.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'2440.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24522 txt/../ent/24522.ent 24522 txt/../pos/24522.pos 2440 txt/../wrd/2440.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point === file2bib.sh === id: 24522 author: Miller, Leo E. (Leo Edward) title: The Black Phantom date: pages: extension: .txt txt: ./txt/24522.txt cache: ./cache/24522.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24522.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 2440 txt/../pos/2440.pos 24522 txt/../wrd/24522.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2440 txt/../ent/2440.ent 14898 txt/../pos/14898.pos 14898 txt/../wrd/14898.wrd 42193 txt/../pos/42193.pos 14898 txt/../ent/14898.ent 42193 txt/../wrd/42193.wrd 42193 txt/../ent/42193.ent === file2bib.sh === id: 14898 author: Lange, Algot title: In the Amazon Jungle Adventures in Remote Parts of the Upper Amazon River, Including a Sojourn Among Cannibal Indians date: pages: extension: .txt txt: ./txt/14898.txt cache: ./cache/14898.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'14898.txt' === file2bib.sh === id: 42193 author: Scoville, Samuel title: The Inca Emerald date: pages: extension: .txt txt: ./txt/42193.txt cache: ./cache/42193.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'42193.txt' Done mapping. Reducing subject-amazonRiverValley-gutenberg === reduce.pl bib === id = 14898 author = Lange, Algot title = In the Amazon Jungle Adventures in Remote Parts of the Upper Amazon River, Including a Sojourn Among Cannibal Indians date = pages = extension = .txt mime = text/plain words = 47673 sentences = 2274 flesch = 76 summary = annually, like most of the Amazon basin, and at time of high water into the forest, was, in broad day, playing in the shade of the trees, the right the Javary River, while the little house that I was heading I intended to go up the Javary River, to a place called Remate de the rubber-workers, is a worthy-looking man, who wears a dark-brown Slowly the days went by and, with their passing, the river fell lower afternoon of this day, we arrived at a small rubber estate called Boa One of the men took good aim and fired, crushing the head of the snake, we came to the hut of the rubber-worker a large dog greeted us. I know that during the time to come I was to look back upon this day men brought in at all times of the day. canoe were four men armed with bows and arrows and blow-guns, and a cache = ./cache/14898.txt txt = ./txt/14898.txt === reduce.pl bib === id = 42193 author = Scoville, Samuel title = The Inca Emerald date = pages = extension = .txt mime = text/plain words = 53556 sentences = 2881 flesch = 84 summary = That evening, after dinner, Professor Ditson took Jud and the boys out "That thicket must be chuck-full of birds," whispered Jud. Professor Ditson shook his head. When Jud opened his eyes Professor Ditson's hammock was "It was the palm-snake," said Professor Ditson, after Jud told them of "What do you think?" whispered Will to Joe. The Indian boy, who had paddled long journeys on the rivers and seas of "I'll say the man is right," said Jud, shivering a little in his wet boy had gained the safety of Jud's tree and gripped the old man's hand was alive with a furious rush of the short, deep-bodied fish toward Jud. As they approached, the old man noticed uneasily their staring, "I told you strange water not safe," said Pinto, as Professor Ditson By the time Jud was patched up, Pinto came back trailing behind him a that day Jud and Pinto and the professor took turns in standing guard cache = ./cache/42193.txt txt = ./txt/42193.txt === reduce.pl bib === === reduce.pl bib === Building ./etc/reader.txt 42193 14898 24522 42193 14898 24522 number of items: 4 sum of words: 101,229 average size in words: 50,614 average readability score: 80 nouns: man; feet; time; water; men; day; tree; river; head; night; way; party; forest; life; one; body; rubber; jungle; ground; trees; hand; side; professor; eyes; snake; face; days; death; bird; place; fish; hammock; boy; trail; nothing; end; air; length; sight; scientist; hands; foot; house; fire; boat; part; moment; rest; gold; blow verbs: was; had; were; is; be; have; are; been; came; said; went; made; do; found; seemed; ''s; did; see; returned; saw; showed; go; come; looked; take; heard; called; reached; get; began; has; left; took; make; being; cut; know; seen; used; told; turned; got; followed; stood; find; brought; set; started; caught; carried adjectives: little; great; long; other; old; white; black; last; few; large; first; more; same; dark; full; small; next; good; several; many; whole; green; deep; big; much; strange; own; dead; beautiful; red; high; right; only; heavy; wild; such; indian; short; thick; able; open; narrow; young; second; possible; human; yellow; vast; low; huge adverbs: not; up; out; then; so; down; even; back; only; as; now; again; on; away; here; never; off; more; very; n''t; far; just; there; suddenly; once; about; always; still; too; most; soon; over; later; ever; well; almost; all; in; much; nearly; long; first; however; finally; together; close; around; also; enough; slowly pronouns: i; he; it; his; they; my; we; their; its; me; him; you; them; our; us; her; himself; your; she; itself; themselves; myself; one; ''em; ourselves; ''s; yourself; yours; herself; em; hisself; theirs; ours; oneself; mine; flinty proper nouns: _; jud; professor; ditson; pinto; will; hen; joe; chief; indians; amazon; river; indian; males; remate; mr.; itecoahy; hut; floresta; new; mangeromas; jerome; javary; donegan; south; peruvians; coronel; trail; jaguar; jim; york; mundurucu; inca; dawson; da; america; incas; brazil; silva; pine; peru; lake; eldorado; cornwall; miranhas; de; big; maya; francisco; scar keywords: man; york; trail; south; silva; river; remate; professor; pinto; peruvians; new; mundurucu; mr.; mangeromas; males; like; jud; joe; jim; jerome; javary; itecoahy; indians; indian; hen; great; floresta; donegan; ditson; dawson; coronel; chief; brazilian; american; amazon one topic; one dimension: jud file(s): titles(s): The Black Phantom three topics; one dimension: jud; harbour; harbour file(s): ./cache/42193.txt, , titles(s): The Inca Emerald | The Black Phantom | The Black Phantom five topics; three dimensions: jud professor like; restraint desires raving; restraint desires raving; restraint desires raving; restraint desires raving file(s): ./cache/42193.txt, , , , titles(s): The Inca Emerald | The Black Phantom | The Black Phantom | The Black Phantom | The Black Phantom Type: gutenberg title: subject-amazonRiverValley-gutenberg date: 2021-05-31 time: 16:05 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Amazon River Valley" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 2440 author: Bates, Henry Walter title: The Naturalist on the River Amazons date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 14898 author: Lange, Algot title: In the Amazon Jungle Adventures in Remote Parts of the Upper Amazon River, Including a Sojourn Among Cannibal Indians date: words: 47673.0 sentences: 2274.0 pages: flesch: 76.0 cache: ./cache/14898.txt txt: ./txt/14898.txt summary: annually, like most of the Amazon basin, and at time of high water into the forest, was, in broad day, playing in the shade of the trees, the right the Javary River, while the little house that I was heading I intended to go up the Javary River, to a place called Remate de the rubber-workers, is a worthy-looking man, who wears a dark-brown Slowly the days went by and, with their passing, the river fell lower afternoon of this day, we arrived at a small rubber estate called Boa One of the men took good aim and fired, crushing the head of the snake, we came to the hut of the rubber-worker a large dog greeted us. I know that during the time to come I was to look back upon this day men brought in at all times of the day. canoe were four men armed with bows and arrows and blow-guns, and a id: 24522 author: Miller, Leo E. (Leo Edward) title: The Black Phantom date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 42193 author: Scoville, Samuel title: The Inca Emerald date: words: 53556.0 sentences: 2881.0 pages: flesch: 84.0 cache: ./cache/42193.txt txt: ./txt/42193.txt summary: That evening, after dinner, Professor Ditson took Jud and the boys out "That thicket must be chuck-full of birds," whispered Jud. Professor Ditson shook his head. When Jud opened his eyes Professor Ditson''s hammock was "It was the palm-snake," said Professor Ditson, after Jud told them of "What do you think?" whispered Will to Joe. The Indian boy, who had paddled long journeys on the rivers and seas of "I''ll say the man is right," said Jud, shivering a little in his wet boy had gained the safety of Jud''s tree and gripped the old man''s hand was alive with a furious rush of the short, deep-bodied fish toward Jud. As they approached, the old man noticed uneasily their staring, "I told you strange water not safe," said Pinto, as Professor Ditson By the time Jud was patched up, Pinto came back trailing behind him a that day Jud and Pinto and the professor took turns in standing guard ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel