mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-amazonRiver-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/19209.txt inflating: ./tmp/input/input-file/21385.txt inflating: ./tmp/input/input-file/27101.txt inflating: ./tmp/input/input-file/24814.txt inflating: ./tmp/input/input-file/38774.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-amazonRiver-gutenberg FILE: cache/24814.txt OUTPUT: txt/24814.txt FILE: cache/27101.txt OUTPUT: txt/27101.txt FILE: cache/19209.txt OUTPUT: txt/19209.txt FILE: cache/38774.txt OUTPUT: txt/38774.txt FILE: cache/21385.txt OUTPUT: txt/21385.txt === file2bib.sh === id: 24814 author: Reid, Mayne title: The Forest Exiles: The Perils of a Peruvian Family in the Wilds of the Amazon date: pages: extension: .txt txt: ./txt/24814.txt cache: ./cache/24814.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24814.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24814 txt/../pos/24814.pos 24814 txt/../wrd/24814.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24814 txt/../ent/24814.ent 27101 txt/../pos/27101.pos 27101 txt/../wrd/27101.wrd 27101 txt/../ent/27101.ent === file2bib.sh === id: 27101 author: Rochelle, James Henry title: Life of Rear Admiral John Randolph Tucker date: pages: extension: .txt txt: ./txt/27101.txt cache: ./cache/27101.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'27101.txt' 38774 txt/../pos/38774.pos 19209 txt/../pos/19209.pos 38774 txt/../wrd/38774.wrd 38774 txt/../ent/38774.ent 19209 txt/../wrd/19209.wrd 21385 txt/../pos/21385.pos 21385 txt/../wrd/21385.wrd 19209 txt/../ent/19209.ent 21385 txt/../ent/21385.ent === file2bib.sh === id: 38774 author: Bulfinch, Thomas title: Oregon and Eldorado; or, Romance of the Rivers date: pages: extension: .txt txt: ./txt/38774.txt cache: ./cache/38774.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'38774.txt' === file2bib.sh === id: 19209 author: Orton, James title: The Andes and the Amazon; Or, Across the Continent of South America date: pages: extension: .txt txt: ./txt/19209.txt cache: ./cache/19209.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 10 resourceName b'19209.txt' === file2bib.sh === id: 21385 author: Kingston, William Henry Giles title: On the Banks of the Amazon date: pages: extension: .txt txt: ./txt/21385.txt cache: ./cache/21385.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'21385.txt' Done mapping. Reducing subject-amazonRiver-gutenberg === reduce.pl bib === id = 21385 author = Kingston, William Henry Giles title = On the Banks of the Amazon date = pages = extension = .txt mime = text/plain words = 132231 sentences = 7610 flesch = 84 summary = my friends, Tony and Arthur Mallet, and as soon as I had time I sat down "Yes," said John, "I believe that for a very long time a very strong joined by my companions, and in a little time Ellen and Maria came said Domingos to John and me, while Don Jose was at a little distance. Jose and John helping up Ellen, Domingos assisting Maria, Arthur and I time, I called Ellen and Arthur to look at them. rocky point, I caught sight of the huts, and saw Arthur running towards We had gone on some way, when, passing round a clump of trees, we saw "I will do as you wish," said Arthur; "but I do not like running away turn the canoe round," said John, "and let the raft go first. John, placing Arthur at a little distance, came back to our turning the canoe's head round, proceeded after our Indian friends. cache = ./cache/21385.txt txt = ./txt/21385.txt === reduce.pl bib === id = 19209 author = Orton, James title = The Andes and the Amazon; Or, Across the Continent of South America date = pages = extension = .txt mime = text/plain words = 100759 sentences = 6952 flesch = 79 summary = and finishing it where the great river appears a fresh-water ocean. Down the Amazon.--Steam on the Great River.--Loreto.--San Antonio.--Tabatinga. Life within the Great River.--Fishes.--Alligators.--Turtles.--Porpoises Life around the Great River.--Origin of the Red Man.--General Characteristics bank of the River Guayas, sixty miles from the ocean, and but a few feet The coffee-tree is about eight feet high, and has dark green leaves, Captain Lee's little steamers to Bodegas, seventy miles up the river. Quito, though not the highest city on the globe, is two thousand feet Quito.--Primeval Inhabitants of the Andes.--Quichua Indians. The moment the Andes arose, the great continental valley of the Amazon Sea-Cows and Turtles' Eggs.--The Forest.--Peccaries.--Indian Tribes Sea-Cows and Turtles' Eggs.--The Forest.--Peccaries.--Indian Tribes Down the Amazon.--Steam on the Great River.--Loreto.--San The Amazon began to look more like a lake than a river, having a width The forest of the Amazon is less full of life than the river. cache = ./cache/19209.txt txt = ./txt/19209.txt === reduce.pl bib === id = 38774 author = Bulfinch, Thomas title = Oregon and Eldorado; or, Romance of the Rivers date = pages = extension = .txt mime = text/plain words = 95698 sentences = 4420 flesch = 75 summary = Indian chiefs, several large tracts of land near Nootka Sound, for which he anchored at one o'clock in a large river of fresh water, ten miles half miles distance; a village on the north side of the river, this time, another chief, with a large party of white men, were waiting Indian who had straggled a short distance down the river returned, with within a distance of a mile and a half, a small river from the right. Shoshonee Indians fish; five days' journey farther is a large river from all the forks, as well as on the main river, great numbers of Indians Nov. 4.--Next day, we landed on the left bank of the river, at a village Next day we passed the mouth of a large river, a hundred and fifty yards The water for a great distance off the mouth of the river appears very cache = ./cache/38774.txt txt = ./txt/38774.txt === reduce.pl bib === id = 27101 author = Rochelle, James Henry title = Life of Rear Admiral John Randolph Tucker date = pages = extension = .txt mime = text/plain words = 25097 sentences = 1368 flesch = 71 summary = SQUADRON ENTERS JAMES RIVER--CREWS OF THE _Patrick Henry_, command of Captain Tucker, on the James river, on the war steamer Henry_--GUARDING JAMES RIVER--SCALING THE GUNS--"NAVAL SQUADRON--TUCKER ORDERED TO COMMAND THE IRON-CLAD James river, but in a short time was ordered to assume command of the James river, desired to present to the _Patrick Henry_ a flag which _Patrick Henry_, 12, Commander J.R. Tucker; _Jamestown_, 2, Lieutenant Whilst the James river squadron was passing the batteries, the in fight all the Confederate vessels in James river, and no course was open to Tucker but to take his squadron up the river and make a stand In August, 1862, Tucker was ordered to command the iron-clad steamer Embarking on board the _Tambo_, Tucker took the steamer up the river nineteen miles from the mouth of the Amazon, following the river, and A chart of the Peruvian Amazon river, from the mouth of cache = ./cache/27101.txt txt = ./txt/27101.txt === reduce.pl bib === Building ./etc/reader.txt 21385 19209 38774 19209 38774 21385 number of items: 5 sum of words: 353,785 average size in words: 88,446 average readability score: 77 nouns: river; feet; miles; water; time; way; distance; day; men; forest; side; trees; canoe; place; country; head; part; mouth; tree; night; length; days; ground; man; mountains; sea; people; species; party; number; shore; natives; life; bank; fire; name; others; canoes; stream; fish; city; sight; morning; friends; spot; land; banks; village; mountain; father verbs: was; is; had; were; are; be; have; been; made; found; has; said; do; came; being; saw; having; see; did; called; seen; make; seemed; come; went; take; go; reached; find; left; took; covered; passed; observed; told; brought; set; am; gave; get; looking; got; kept; carried; appeared; heard; taken; put; looked; began adjectives: great; other; little; long; large; small; many; few; several; more; same; first; white; high; good; such; true; indian; short; young; whole; much; last; black; old; beautiful; deep; next; own; only; thick; best; ready; dark; open; able; vast; low; different; new; wild; common; numerous; fine; wide; usual; sure; red; narrow; main adverbs: not; up; so; very; then; now; out; down; as; more; however; only; off; soon; most; about; here; still; on; also; again; well; away; much; far; back; there; thus; even; once; nearly; just; almost; too; therefore; never; in; long; sometimes; yet; first; indeed; often; forward; all; always; together; scarcely; probably; perhaps pronouns: we; it; i; they; he; our; his; their; them; us; its; him; you; her; my; me; she; your; himself; themselves; ourselves; itself; myself; one; herself; theirs; ours; yourself; mine; thy; yours; wappatoo; thyself; montaria; embaüba; ay; 108.--they proper nouns: _; |; indians; amazon; arthur; john; quito; ellen; duppo; andes; napo; river; tucker; domingos; america; capt; footnote; south; lewis; indian; atlantic; hut; maria; peru; don; de; jose; new; brazil; states; raleigh; rio; united; chapter; pará; clarke; confederate; valley; tony; ecuador; la; columbia; henry; del; ucayali; james; spaniards; humboldt; harry; guayaquil keywords: amazon; river; indians; united; states; quito; great; foot; chapter; atlantic; york; world; water; virginia; valley; ucayali; tucker; true; tony; spanish; spaniards; south; september; santa; rosa; rio; raleigh; pichincha; peru; patrick; pará; pacific; oria; orellana; new; negro; navy; napo; missouri; mile; maria; marañon; maono; man; majeronas; lewis; july; jose; john; isoro one topic; one dimension: river file(s): ./cache/19209.txt titles(s): The Andes and the Amazon; Or, Across the Continent of South America three topics; one dimension: river; arthur; amazon file(s): ./cache/27101.txt, ./cache/21385.txt, ./cache/19209.txt titles(s): Life of Rear Admiral John Randolph Tucker | On the Banks of the Amazon | The Andes and the Amazon; Or, Across the Continent of South America five topics; three dimensions: river miles indians; arthur john said; amazon quito feet; beam barely expectation; beam barely expectation file(s): ./cache/27101.txt, ./cache/21385.txt, ./cache/19209.txt, , titles(s): Life of Rear Admiral John Randolph Tucker | On the Banks of the Amazon | The Andes and the Amazon; Or, Across the Continent of South America | The Forest Exiles: The Perils of a Peruvian Family in the Wilds of the Amazon | The Forest Exiles: The Perils of a Peruvian Family in the Wilds of the Amazon Type: gutenberg title: subject-amazonRiver-gutenberg date: 2021-05-31 time: 16:05 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Amazon River" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 38774 author: Bulfinch, Thomas title: Oregon and Eldorado; or, Romance of the Rivers date: words: 95698.0 sentences: 4420.0 pages: flesch: 75.0 cache: ./cache/38774.txt txt: ./txt/38774.txt summary: Indian chiefs, several large tracts of land near Nootka Sound, for which he anchored at one o''clock in a large river of fresh water, ten miles half miles distance; a village on the north side of the river, this time, another chief, with a large party of white men, were waiting Indian who had straggled a short distance down the river returned, with within a distance of a mile and a half, a small river from the right. Shoshonee Indians fish; five days'' journey farther is a large river from all the forks, as well as on the main river, great numbers of Indians Nov. 4.--Next day, we landed on the left bank of the river, at a village Next day we passed the mouth of a large river, a hundred and fifty yards The water for a great distance off the mouth of the river appears very id: 21385 author: Kingston, William Henry Giles title: On the Banks of the Amazon date: words: 132231.0 sentences: 7610.0 pages: flesch: 84.0 cache: ./cache/21385.txt txt: ./txt/21385.txt summary: my friends, Tony and Arthur Mallet, and as soon as I had time I sat down "Yes," said John, "I believe that for a very long time a very strong joined by my companions, and in a little time Ellen and Maria came said Domingos to John and me, while Don Jose was at a little distance. Jose and John helping up Ellen, Domingos assisting Maria, Arthur and I time, I called Ellen and Arthur to look at them. rocky point, I caught sight of the huts, and saw Arthur running towards We had gone on some way, when, passing round a clump of trees, we saw "I will do as you wish," said Arthur; "but I do not like running away turn the canoe round," said John, "and let the raft go first. John, placing Arthur at a little distance, came back to our turning the canoe''s head round, proceeded after our Indian friends. id: 19209 author: Orton, James title: The Andes and the Amazon; Or, Across the Continent of South America date: words: 100759.0 sentences: 6952.0 pages: flesch: 79.0 cache: ./cache/19209.txt txt: ./txt/19209.txt summary: and finishing it where the great river appears a fresh-water ocean. Down the Amazon.--Steam on the Great River.--Loreto.--San Antonio.--Tabatinga. Life within the Great River.--Fishes.--Alligators.--Turtles.--Porpoises Life around the Great River.--Origin of the Red Man.--General Characteristics bank of the River Guayas, sixty miles from the ocean, and but a few feet The coffee-tree is about eight feet high, and has dark green leaves, Captain Lee''s little steamers to Bodegas, seventy miles up the river. Quito, though not the highest city on the globe, is two thousand feet Quito.--Primeval Inhabitants of the Andes.--Quichua Indians. The moment the Andes arose, the great continental valley of the Amazon Sea-Cows and Turtles'' Eggs.--The Forest.--Peccaries.--Indian Tribes Sea-Cows and Turtles'' Eggs.--The Forest.--Peccaries.--Indian Tribes Down the Amazon.--Steam on the Great River.--Loreto.--San The Amazon began to look more like a lake than a river, having a width The forest of the Amazon is less full of life than the river. id: 24814 author: Reid, Mayne title: The Forest Exiles: The Perils of a Peruvian Family in the Wilds of the Amazon date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 27101 author: Rochelle, James Henry title: Life of Rear Admiral John Randolph Tucker date: words: 25097.0 sentences: 1368.0 pages: flesch: 71.0 cache: ./cache/27101.txt txt: ./txt/27101.txt summary: SQUADRON ENTERS JAMES RIVER--CREWS OF THE _Patrick Henry_, command of Captain Tucker, on the James river, on the war steamer Henry_--GUARDING JAMES RIVER--SCALING THE GUNS--"NAVAL SQUADRON--TUCKER ORDERED TO COMMAND THE IRON-CLAD James river, but in a short time was ordered to assume command of the James river, desired to present to the _Patrick Henry_ a flag which _Patrick Henry_, 12, Commander J.R. Tucker; _Jamestown_, 2, Lieutenant Whilst the James river squadron was passing the batteries, the in fight all the Confederate vessels in James river, and no course was open to Tucker but to take his squadron up the river and make a stand In August, 1862, Tucker was ordered to command the iron-clad steamer Embarking on board the _Tambo_, Tucker took the steamer up the river nineteen miles from the mouth of the Amazon, following the river, and A chart of the Peruvian Amazon river, from the mouth of ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel