mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-germanAmericans-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/454.txt inflating: ./tmp/input/input-file/39753.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-germanAmericans-gutenberg FILE: cache/454.txt OUTPUT: txt/454.txt FILE: cache/39753.txt OUTPUT: txt/39753.txt 454 txt/../ent/454.ent === file2bib.sh === id: 454 author: Leland, Charles Godfrey title: The Breitmann Ballads date: pages: extension: .txt txt: ./txt/454.txt cache: ./cache/454.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'454.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 454 txt/../wrd/454.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 454 txt/../pos/454.pos 39753 txt/../pos/39753.pos 39753 txt/../wrd/39753.wrd 39753 txt/../ent/39753.ent === file2bib.sh === id: 39753 author: Consolation Club title: The Misfit Christmas Puddings date: pages: extension: .txt txt: ./txt/39753.txt cache: ./cache/39753.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'39753.txt' Done mapping. Reducing subject-germanAmericans-gutenberg === reduce.pl bib === === reduce.pl bib === id = 39753 author = Consolation Club title = The Misfit Christmas Puddings date = pages = extension = .txt mime = text/plain words = 19655 sentences = 1410 flesch = 87 summary = { Granny M'Carty,--much care; little comfort. WIDOW M'CARTY'S ABODE MORNING OF THE DAY BEFORE CHRISTMAS After a moment's quiet, Mrs. M'Carty slipped the pipe out of Granny's "Musha, musha, Mrs. M'Carty!" said Grandad. "Whist now, whist, Granny!" cried Mrs. M'Carty, coming in from the "That's like yer foolishness, Bridget M'Carty," retorted Granny. "Now then, Mrs. M'Carty," said Grandad Rafferty, as usual finding some Granny M'Carty in the easiest chair and Grandad Rafferty in the next Every clerk declared that Mrs. M'Carty should have her Christmas cake "Sure, it ain't much like Christmas Eve I'm thinkin'," she said, his Christmas puddings, was to send at once to the Widow M'Carty's and WIDOW M'CARTY'S ABODE CHRISTMAS DAY "Never mind that, Granny," said Grandad. "Wan time is as good as another for a surprise," said Granny. "Merry Christmas, with a present for you, Granny," he said. "If Bridget M'Carty had said her cache = ./cache/39753.txt txt = ./txt/39753.txt Building ./etc/reader.txt 39753 454 39753 454 number of items: 2 sum of words: 19,655 average size in words: 19,655 average readability score: 87 nouns: puddings; pudding; time; table; day; man; store; children; door; night; morning; eyes; package; illustration; cake; bit; clerks; way; place; one; money; head; card; words; baker; things; moment; holiday; fire; father; family; daughter; customers; chair; saints; home; mother; candy; air; word; water; something; nothing; hand; cakes; ye''re; window; sleigh; paper; order verbs: was; be; had; ''s; were; is; said; have; do; been; went; came; see; get; are; dose; did; ''re; make; go; told; cried; come; took; put; made; let; know; began; take; looked; getting; being; set; returned; has; ''ve; mind; look; keep; heard; give; found; buy; ''m; sat; passed; haf; coming; tell adjectives: little; good; old; more; poor; many; fine; few; small; much; large; same; first; such; other; last; new; long; red; great; big; bad; sure; grand; enough; beautiful; whole; white; warm; round; next; happy; better; best; yer; third; sweet; rich; ready; possible; german; empty; busy; wonderful; und; real; hard; favorite; dose; dear adverbs: not; n''t; so; now; up; just; as; never; down; then; all; here; back; away; too; there; even; out; more; again; soon; once; ever; on; off; at; in; well; very; home; enough; already; that; perhaps; over; most; always; only; long; far; almost; yet; indeed; entirely; together; much; however; fairly; apiece; still pronouns: it; i; her; his; she; he; you; them; me; they; their; my; him; we; us; its; your; herself; himself; themselves; yerself; ye; our; one; yourself; myself; itself; ''s; yours; puttin; ''em proper nouns: m''carty; granny; christmas; katrina; grandad; bridget; mrs.; _; baumgärtner; ye; michael; herr; widow; baker; rafferty; dat; terence; m''cartys; yer; hans; katy; puddin; father; baumgÄrtner; norah; ellen; episode; biddy; mit; merry; eve; patsy; miss; mein; gott; ach; ye''re; vat; misther; kleinhardt; ja; himmel; denny; ''s; yez; nein; maggie; joost; go; establishment keywords: rafferty; mrs.; michael; m''carty; katrina; herr; granny; grandad; christmas; bridget; baumgärtner one topic; one dimension: carty file(s): titles(s): The Breitmann Ballads three topics; one dimension: carty; zealously; zealously file(s): ./cache/39753.txt, , titles(s): The Misfit Christmas Puddings | The Breitmann Ballads | The Breitmann Ballads five topics; three dimensions: carty christmas granny; zealously haste harder; zealously haste harder; zealously haste harder; zealously haste harder file(s): ./cache/39753.txt, , , , titles(s): The Misfit Christmas Puddings | The Breitmann Ballads | The Breitmann Ballads | The Breitmann Ballads | The Breitmann Ballads Type: gutenberg title: subject-germanAmericans-gutenberg date: 2021-06-06 time: 16:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"German Americans" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 39753 author: Consolation Club title: The Misfit Christmas Puddings date: words: 19655.0 sentences: 1410.0 pages: flesch: 87.0 cache: ./cache/39753.txt txt: ./txt/39753.txt summary: { Granny M''Carty,--much care; little comfort. WIDOW M''CARTY''S ABODE MORNING OF THE DAY BEFORE CHRISTMAS After a moment''s quiet, Mrs. M''Carty slipped the pipe out of Granny''s "Musha, musha, Mrs. M''Carty!" said Grandad. "Whist now, whist, Granny!" cried Mrs. M''Carty, coming in from the "That''s like yer foolishness, Bridget M''Carty," retorted Granny. "Now then, Mrs. M''Carty," said Grandad Rafferty, as usual finding some Granny M''Carty in the easiest chair and Grandad Rafferty in the next Every clerk declared that Mrs. M''Carty should have her Christmas cake "Sure, it ain''t much like Christmas Eve I''m thinkin''," she said, his Christmas puddings, was to send at once to the Widow M''Carty''s and WIDOW M''CARTY''S ABODE CHRISTMAS DAY "Never mind that, Granny," said Grandad. "Wan time is as good as another for a surprise," said Granny. "Merry Christmas, with a present for you, Granny," he said. "If Bridget M''Carty had said her id: 454 author: Leland, Charles Godfrey title: The Breitmann Ballads date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel