mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-beagleExpedition-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/3620.txt inflating: ./tmp/input/input-file/944.txt inflating: ./tmp/input/input-file/3704.txt inflating: ./tmp/input/input-file/2690.txt inflating: ./tmp/input/input-file/3054.txt inflating: ./tmp/input/input-file/38961.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-beagleExpedition-gutenberg FILE: cache/3620.txt OUTPUT: txt/3620.txt FILE: cache/2690.txt OUTPUT: txt/2690.txt FILE: cache/944.txt OUTPUT: txt/944.txt FILE: cache/38961.txt OUTPUT: txt/38961.txt FILE: cache/3704.txt OUTPUT: txt/3704.txt FILE: cache/3054.txt OUTPUT: txt/3054.txt === file2bib.sh === id: 3054 author: Darwin, Charles title: Volcanic Islands date: pages: extension: .txt txt: ./txt/3054.txt cache: ./cache/3054.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'3054.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 2690 author: Darwin, Charles title: Coral Reefs date: pages: extension: .txt txt: ./txt/2690.txt cache: ./cache/2690.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'2690.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 3620 txt/../wrd/3620.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2690 txt/../ent/2690.ent 3054 txt/../ent/3054.ent === file2bib.sh === id: 3620 author: Darwin, Charles title: Geological Observations on South America date: pages: extension: .txt txt: ./txt/3620.txt cache: ./cache/3620.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'3620.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 3620 txt/../ent/3620.ent 3054 txt/../pos/3054.pos 2690 txt/../wrd/2690.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 3620 txt/../pos/3620.pos 3054 txt/../wrd/3054.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2690 txt/../pos/2690.pos 3704 txt/../pos/3704.pos 944 txt/../pos/944.pos 944 txt/../wrd/944.wrd 3704 txt/../wrd/3704.wrd 38961 txt/../pos/38961.pos 38961 txt/../wrd/38961.wrd 944 txt/../ent/944.ent 38961 txt/../ent/38961.ent 3704 txt/../ent/3704.ent === file2bib.sh === id: 944 author: Darwin, Charles title: The Voyage of the Beagle date: pages: extension: .txt txt: ./txt/944.txt cache: ./cache/944.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 10 resourceName b'944.txt' === file2bib.sh === id: 38961 author: King, Philip Parker title: Narrative of the surveying voyages of His Majesty's ships Adventure and Beagle, between the years 1826 and 1836. Volume I. Proceedings of the First Expedition, 1826-1830 date: pages: extension: .txt txt: ./txt/38961.txt cache: ./cache/38961.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 14 resourceName b'38961.txt' === file2bib.sh === id: 3704 author: Darwin, Charles title: Journal of Researches into the Natural History and Geology of the Countries Visited During the Voyage Round the World of H.M.S. Beagle Under the Command of Captain Fitz Roy, R.N. date: pages: extension: .txt txt: ./txt/3704.txt cache: ./cache/3704.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'3704.txt' Done mapping. Reducing subject-beagleExpedition-gutenberg === reduce.pl bib === === reduce.pl bib === === reduce.pl bib === id = 38961 author = King, Philip Parker title = Narrative of the surveying voyages of His Majesty's ships Adventure and Beagle, between the years 1826 and 1836. Volume I. Proceedings of the First Expedition, 1826-1830 date = pages = extension = .txt mime = text/plain words = 232129 sentences = 14851 flesch = 81 summary = places, successively; namely; Madeira: Teneriffe: the northern point of St. Antonio, and the anchorage at St. Jago; both in the Cape Verd Islands: the then to proceed to survey the Coasts, Islands, and Straits; from Cape St. Antonio, at the south side {xvii} of the River Plata, to Chilóe; on the bay, by a very narrow channel, near its south end; but it is small, and so anchored in a small bay, formed between the two projecting points of Cape Channel--Hope returns to Port Famine--San Antonio--Lomas Bay--Loss of Mount Hope proved to be an isolated mass of hills, lying like the rest N.W. and S.E., having low land to the southward, over which nothing was visible Islands, about seven miles from Guard Bay. The 27th was rainy, but the boats went to different points, and angles were Lieutenant Skyring had seen water from Focus Island, near Easter Bay, and cache = ./cache/38961.txt txt = ./txt/38961.txt === reduce.pl bib === id = 3704 author = Darwin, Charles title = Journal of Researches into the Natural History and Geology of the Countries Visited During the Voyage Round the World of H.M.S. Beagle Under the Command of Captain Fitz Roy, R.N. date = pages = extension = .txt mime = text/plain words = 215725 sentences = 11397 flesch = 75 summary = different islands--Tameness of the birds--Fear of man an passed through great bands of muddy water, exactly like that of a the land, I have seen narrow lines of water of a bright red colour, mile, and was like the rushing of a great body of water. water like a great shoal of some amphibious animal. of the country, or to the numbers of large animals inhabiting it. rhea inhabits the country of La Plata as far as a little south of little remaining water nearly as salt as that of the sea. great numbers of birds, wild animals, cattle, and horses perished In deep water, far from the land, the number of living creatures is distance be ever so great, to be deposited near the sea-coast. near Port Pleasant, they appeared from a long distance like black rock from low-water mark to a great depth, both on the outer coast cache = ./cache/3704.txt txt = ./txt/3704.txt === reduce.pl bib === === reduce.pl bib === id = 944 author = Darwin, Charles title = The Voyage of the Beagle date = pages = extension = .txt mime = text/plain words = 208237 sentences = 9228 flesch = 72 summary = action stand either near sea-coasts or as islands in the midst of the Near Keeling Atoll, in the Indian Ocean, I observed many little masses colour of the water, as seen at some distance, was like that of a river land, I have seen narrow lines of water of a bright red colour, from mud-like water; these strips were some miles long, but only a few yards above the water like a great shoal of some amphibious animal. soon as the bird is seen flying, its whole appearance changes; the long little boy, riding like a Mazeppa on the white horse, thus leaving far Very great numbers of birds, wild animals, In deep water, far from the land, the number of living creatures is appeared from a long distance like black spots, whilst south of great shock took place at the time of low water; and an old woman who cache = ./cache/944.txt txt = ./txt/944.txt Building ./etc/reader.txt 3704 944 38961 3704 944 38961 number of items: 6 sum of words: 656,091 average size in words: 218,697 average readability score: 76 nouns: water; land; sea; day; feet; time; coast; country; miles; part; species; man; side; island; trees; place; islands; night; wind; men; shore; boat; distance; parts; weather; animals; ground; morning; days; birds; mountains; line; number; appearance; head; point; height; ship; party; rock; inhabitants; snow; animal; horses; shells; view; rocks; manner; course; evening verbs: is; was; were; are; be; have; had; been; has; being; found; having; made; seen; saw; called; did; covered; passed; do; see; left; said; formed; reached; observed; appeared; taken; believe; find; came; thought; appears; think; went; given; took; take; heard; anchored; appear; seemed; described; brought; known; make; does; told; following; placed adjectives: other; great; many; little; small; large; same; few; several; such; much; long; high; good; more; whole; common; first; old; different; fine; low; wild; next; last; remarkable; short; white; greater; distant; strong; deep; dry; lower; fresh; numerous; similar; black; general; southern; south; curious; young; heavy; open; wide; narrow; less; latter; thick adverbs: not; very; so; up; as; only; most; more; here; then; well; even; much; out; now; however; about; far; nearly; also; quite; soon; together; down; generally; almost; thus; again; there; never; rather; first; away; probably; long; afterwards; often; off; therefore; perhaps; scarcely; always; sometimes; still; too; close; hence; frequently; certainly; yet pronouns: it; i; we; they; their; its; our; he; his; them; me; my; us; her; him; she; themselves; you; itself; one; himself; myself; your; ourselves; herself; yourself; ours; theirs; mine; state;--as; oneself; wigwam; inserted,--the; ii; hers; ''--r. proper nouns: |; _; cape; mr.; bay; port; indians; beagle; island; captain; strait; st.; america; del; south; san; de; rio; tierra; islands; chile; fuego; channel; cordillera; roy; fitz; plate; s.; patagonia; sound; england; harbour; fuegians; adelaide; new; mount; famine; f.; plata; west; m.; monte; buenos; ayres; cove; lieutenant; king; sarmiento; pacific; north keywords: tierra; st.; south; roy; rio; port; mr.; indians; fuego; fuegians; fitz; captain; cape; beagle; san; patagonia; pampas; pacific; north; new; negro; island; great; gauchos; europe; english; england; cordillera; chile; buenos; blanca; bahia; ayres; andes; america; africa; water; video; strait; stokes; spanish; sound; skyring; sarmiento; santa; s.w.; rosas; point; plate; plata one topic; one dimension: water file(s): titles(s): Geological Observations on South America three topics; one dimension: great; bay; ann file(s): ./cache/3704.txt, ./cache/38961.txt, titles(s): Journal of Researches into the Natural History and Geology of the Countries Visited During the Voyage Round the World of H.M.S. Beagle Under the Command of Captain Fitz Roy, R.N. | Narrative of the surveying voyages of His Majesty''s ships Adventure and Beagle, between the years 1826 and 1836. Volume I. Proceedings of the First Expedition, 1826-1830 | Geological Observations on South America five topics; three dimensions: great water little; bay cape port; spout color linn; spout color linn; spout color linn file(s): ./cache/3704.txt, ./cache/38961.txt, , , titles(s): Journal of Researches into the Natural History and Geology of the Countries Visited During the Voyage Round the World of H.M.S. Beagle Under the Command of Captain Fitz Roy, R.N. | Narrative of the surveying voyages of His Majesty''s ships Adventure and Beagle, between the years 1826 and 1836. Volume I. Proceedings of the First Expedition, 1826-1830 | Geological Observations on South America | Geological Observations on South America | Geological Observations on South America Type: gutenberg title: subject-beagleExpedition-gutenberg date: 2021-06-01 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Beagle Expedition (1831-1836)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 3620 author: Darwin, Charles title: Geological Observations on South America date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 944 author: Darwin, Charles title: The Voyage of the Beagle date: words: 208237.0 sentences: 9228.0 pages: flesch: 72.0 cache: ./cache/944.txt txt: ./txt/944.txt summary: action stand either near sea-coasts or as islands in the midst of the Near Keeling Atoll, in the Indian Ocean, I observed many little masses colour of the water, as seen at some distance, was like that of a river land, I have seen narrow lines of water of a bright red colour, from mud-like water; these strips were some miles long, but only a few yards above the water like a great shoal of some amphibious animal. soon as the bird is seen flying, its whole appearance changes; the long little boy, riding like a Mazeppa on the white horse, thus leaving far Very great numbers of birds, wild animals, In deep water, far from the land, the number of living creatures is appeared from a long distance like black spots, whilst south of great shock took place at the time of low water; and an old woman who id: 3704 author: Darwin, Charles title: Journal of Researches into the Natural History and Geology of the Countries Visited During the Voyage Round the World of H.M.S. Beagle Under the Command of Captain Fitz Roy, R.N. date: words: 215725.0 sentences: 11397.0 pages: flesch: 75.0 cache: ./cache/3704.txt txt: ./txt/3704.txt summary: different islands--Tameness of the birds--Fear of man an passed through great bands of muddy water, exactly like that of a the land, I have seen narrow lines of water of a bright red colour, mile, and was like the rushing of a great body of water. water like a great shoal of some amphibious animal. of the country, or to the numbers of large animals inhabiting it. rhea inhabits the country of La Plata as far as a little south of little remaining water nearly as salt as that of the sea. great numbers of birds, wild animals, cattle, and horses perished In deep water, far from the land, the number of living creatures is distance be ever so great, to be deposited near the sea-coast. near Port Pleasant, they appeared from a long distance like black rock from low-water mark to a great depth, both on the outer coast id: 2690 author: Darwin, Charles title: Coral Reefs date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 3054 author: Darwin, Charles title: Volcanic Islands date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 38961 author: King, Philip Parker title: Narrative of the surveying voyages of His Majesty''s ships Adventure and Beagle, between the years 1826 and 1836. Volume I. Proceedings of the First Expedition, 1826-1830 date: words: 232129.0 sentences: 14851.0 pages: flesch: 81.0 cache: ./cache/38961.txt txt: ./txt/38961.txt summary: places, successively; namely; Madeira: Teneriffe: the northern point of St. Antonio, and the anchorage at St. Jago; both in the Cape Verd Islands: the then to proceed to survey the Coasts, Islands, and Straits; from Cape St. Antonio, at the south side {xvii} of the River Plata, to Chilóe; on the bay, by a very narrow channel, near its south end; but it is small, and so anchored in a small bay, formed between the two projecting points of Cape Channel--Hope returns to Port Famine--San Antonio--Lomas Bay--Loss of Mount Hope proved to be an isolated mass of hills, lying like the rest N.W. and S.E., having low land to the southward, over which nothing was visible Islands, about seven miles from Guard Bay. The 27th was rainy, but the boats went to different points, and angles were Lieutenant Skyring had seen water from Focus Island, near Easter Bay, and ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel Error: near line 1: database is locked Send options without primary recipient specified. Usage: mailx -eiIUdEFntBDNHRVv~ -T FILE -u USER -h hops -r address -s SUBJECT -a FILE -q FILE -f FILE -A ACCOUNT -b USERS -c USERS -S OPTION users