mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-adventureStoriesAustralian-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24998.txt inflating: ./tmp/input/input-file/23821.txt inflating: ./tmp/input/input-file/3818.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-adventureStoriesAustralian-gutenberg FILE: cache/24998.txt OUTPUT: txt/24998.txt FILE: cache/3818.txt OUTPUT: txt/3818.txt FILE: cache/23821.txt OUTPUT: txt/23821.txt === file2bib.sh === id: 24998 author: Becke, Louis title: Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 date: pages: extension: .txt txt: ./txt/24998.txt cache: ./cache/24998.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24998.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24998 txt/../pos/24998.pos 24998 txt/../ent/24998.ent 24998 txt/../wrd/24998.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 23821 txt/../pos/23821.pos 23821 txt/../wrd/23821.wrd 23821 txt/../ent/23821.ent === file2bib.sh === id: 23821 author: Becke, Louis title: Yorke The Adventurer date: pages: extension: .txt txt: ./txt/23821.txt cache: ./cache/23821.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'23821.txt' 3818 txt/../pos/3818.pos 3818 txt/../wrd/3818.wrd 3818 txt/../ent/3818.ent === file2bib.sh === id: 3818 author: Becke, Louis title: By Reef and Palm date: pages: extension: .txt txt: ./txt/3818.txt cache: ./cache/3818.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'3818.txt' Done mapping. Reducing subject-adventureStoriesAustralian-gutenberg === reduce.pl bib === id = 23821 author = Becke, Louis title = Yorke The Adventurer date = pages = extension = .txt mime = text/plain words = 20514 sentences = 905 flesch = 82 summary = "Guess he's a lunatic," said Captain Guest, turning to me with a laugh. like a drink of water, Yorke became the soul of hospitality, and told "Captain Yorke," I said, "I can cut it out, I am sure. "Guess he thinks a lot about those poor men of his," said Guest to me "Captain Yorke," said Guest, with a laugh, "you should not have told us "Don't believe that, Captain Yorke," I said, "but at the same time I "I got away on the same morning, and made a fine run right across St. George's Channel, and along the New Britain coast till I made Cape "It's a mighty smart dodge, Captain Yorke," said Guest, as we rose and "Well then, Captain Yorke," I said, "as Guest here leaves me to do all was strained, I picked myself up, handed the rifles to Yorke, and said I cache = ./cache/23821.txt txt = ./txt/23821.txt === reduce.pl bib === === reduce.pl bib === id = 3818 author = Becke, Louis title = By Reef and Palm date = pages = extension = .txt mime = text/plain words = 38203 sentences = 2369 flesch = 90 summary = wife, is away at the other White Man's house no woman cometh inside the "Ay," said Robertson, the trading skipper, "and a good man with his "Aye," said the girl with the White Man's blood, "my right hand is for But the white man smiled, and said his boat was too head of the good and clever white man, as she rubbed his and the girl's "Let's have a look at her," said the skipper, a man of kind impulses, "Nay, mother," said the White Man, "not brother and sister, but only "Tell me," said the White Man. "'Then shalt thou live alone in thy shame,' said the old man; and he our white man, till he returned and said the woman was dead. "The white girl put her hands to her face and wept, and said: 'Bring me son to the white man that came here to look upon the Silent Faces; and cache = ./cache/3818.txt txt = ./txt/3818.txt Building ./etc/reader.txt 3818 23821 24998 3818 23821 24998 number of items: 3 sum of words: 58,717 average size in words: 29,358 average readability score: 86 nouns: man; hand; boat; wife; men; girl; people; captain; island; face; time; day; ship; night; water; woman; eyes; years; house; hands; head; beach; natives; sea; cutter; days; women; side; trader; board; lagoon; deck; one; way; crew; wind; morning; village; vessel; land; reef; place; months; life; turtle; schooner; thing; moment; blood; child verbs: was; had; is; said; were; be; have; do; came; are; see; been; ''s; come; went; made; go; did; get; saw; let; know; told; called; took; looked; tell; got; put; has; knew; am; take; asked; left; fell; turned; set; sat; think; stood; make; gave; give; lay; gone; brought; laughed; filled; thought adjectives: little; old; white; good; other; native; young; many; great; big; more; own; long; few; heavy; first; black; dead; poor; small; much; dark; right; blue; wild; such; new; last; same; open; next; soft; only; low; better; bad; strong; german; deep; brown; quick; full; fine; whole; sure; quiet; high; half; certain; short adverbs: then; not; up; so; out; away; now; here; n''t; again; down; back; there; very; only; just; off; as; well; too; over; even; never; ever; once; in; still; about; ashore; yet; all; far; soon; ago; on; enough; first; more; together; quite; perhaps; always; quickly; much; long; right; nearly; also; presently; most pronouns: i; he; his; her; it; we; you; she; my; me; him; they; us; them; our; their; your; myself; himself; thy; thee; its; herself; ourselves; yourself; themselves; mine; itself; ours; one; hers; theirs; ''s; ''em; yours; thyself; she----; hez; he''d proper nouns: _; yorke; guest; new; brantley; thou; captain; island; doris; enderby; taplin; taku; pacific; o''shea; islands; god; south; pallou; mr; langton; challis; motley; group; samoa; le; britain; sydney; white; nalia; jennabon; farani; drake; vahitahi; tom; probyn; nerida; fray; charley; ned; luita; bentos; varua; temeteri; hayes; becke; warren; tahiti; paranili; papalagi; allan keywords: yorke; taplin; taku; pallou; pacific; o''shea; new; nalia; man; langton; island; hand; guest; fray; enderby; drake; doris; challis; captain; britain; brantley; bentos one topic; one dimension: said file(s): ./cache/3818.txt titles(s): By Reef and Palm three topics; one dimension: said; yorke; lofty file(s): ./cache/3818.txt, ./cache/23821.txt, titles(s): By Reef and Palm | Yorke The Adventurer | Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 five topics; three dimensions: said man white; yorke said guest; lofty share cracking; lofty share cracking; lofty share cracking file(s): ./cache/3818.txt, ./cache/23821.txt, , , titles(s): By Reef and Palm | Yorke The Adventurer | Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 | Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 | Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 Type: gutenberg title: subject-adventureStoriesAustralian-gutenberg date: 2021-05-31 time: 15:05 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Adventure stories, Australian" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 24998 author: Becke, Louis title: Concerning "Bully" Hayes From "The Strange Adventure Of James Shervinton and Other Stories" - 1902 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 23821 author: Becke, Louis title: Yorke The Adventurer date: words: 20514.0 sentences: 905.0 pages: flesch: 82.0 cache: ./cache/23821.txt txt: ./txt/23821.txt summary: "Guess he''s a lunatic," said Captain Guest, turning to me with a laugh. like a drink of water, Yorke became the soul of hospitality, and told "Captain Yorke," I said, "I can cut it out, I am sure. "Guess he thinks a lot about those poor men of his," said Guest to me "Captain Yorke," said Guest, with a laugh, "you should not have told us "Don''t believe that, Captain Yorke," I said, "but at the same time I "I got away on the same morning, and made a fine run right across St. George''s Channel, and along the New Britain coast till I made Cape "It''s a mighty smart dodge, Captain Yorke," said Guest, as we rose and "Well then, Captain Yorke," I said, "as Guest here leaves me to do all was strained, I picked myself up, handed the rifles to Yorke, and said I id: 3818 author: Becke, Louis title: By Reef and Palm date: words: 38203.0 sentences: 2369.0 pages: flesch: 90.0 cache: ./cache/3818.txt txt: ./txt/3818.txt summary: wife, is away at the other White Man''s house no woman cometh inside the "Ay," said Robertson, the trading skipper, "and a good man with his "Aye," said the girl with the White Man''s blood, "my right hand is for But the white man smiled, and said his boat was too head of the good and clever white man, as she rubbed his and the girl''s "Let''s have a look at her," said the skipper, a man of kind impulses, "Nay, mother," said the White Man, "not brother and sister, but only "Tell me," said the White Man. "''Then shalt thou live alone in thy shame,'' said the old man; and he our white man, till he returned and said the woman was dead. "The white girl put her hands to her face and wept, and said: ''Bring me son to the white man that came here to look upon the Silent Faces; and ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel