mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-baking-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24125.txt inflating: ./tmp/input/input-file/38193.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-baking-gutenberg FILE: cache/38193.txt OUTPUT: txt/38193.txt FILE: cache/24125.txt OUTPUT: txt/24125.txt === file2bib.sh === id: 24125 author: Hubbard, L. P. title: A Little Book for A Little Cook date: pages: extension: .txt txt: ./txt/24125.txt cache: ./cache/24125.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24125.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24125 txt/../wrd/24125.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24125 txt/../pos/24125.pos 24125 txt/../ent/24125.ent 38193 txt/../wrd/38193.wrd 38193 txt/../pos/38193.pos 38193 txt/../ent/38193.ent === file2bib.sh === id: 38193 author: Royal Baking Powder Company title: New Royal Cook Book date: pages: extension: .txt txt: ./txt/38193.txt cache: ./cache/38193.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'38193.txt' Done mapping. Reducing subject-baking-gutenberg === reduce.pl bib === id = 38193 author = Royal Baking Powder Company title = New Royal Cook Book date = pages = extension = .txt mime = text/plain words = 30541 sentences = 2284 flesch = 83 summary = Beat egg and add one cup milk; stir in corn meal, flour, sugar, salt and Sift together corn meal, flour, baking powder, salt and sugar; add milk, Soak bread crumbs in cold milk 10 minutes; add flour, baking powder and Sift together flour, baking powder, salt and sugar; add milk slowly; Sift together flour, baking powder, salt and sugar; add milk slowly; Cream butter, add beaten egg, flour in which baking powder and salt have Sift together flour, baking powder, sugar and salt; add beaten egg and Sift together flour, baking powder, sugar and salt; add beaten egg and Sift together flour, sugar, salt and baking powder; add milk, beaten egg Sift together the flour, baking powder, sugar and salt; add milk and Sift together the flour, baking powder, sugar and salt; add milk and Cream shortening; add sugar, beaten egg and milk; sift flour and baking cache = ./cache/38193.txt txt = ./txt/38193.txt === reduce.pl bib === Building ./etc/reader.txt 38193 24125 38193 24125 number of items: 2 sum of words: 30,541 average size in words: 30,541 average readability score: 83 nouns: cup; teaspoon; sugar; salt; water; flour; milk; minutes; cups; egg; tablespoons; teaspoons; tablespoon; eggs; butter; baking; powder; pan; oven; vanilla; pepper; cream; juice; extract; lemon; whites; corn; ingredients; fruit; bread; place; cake; half; boiling; shortening; top; pieces; syrup; parsley; hours; time; potatoes; sauce; flavoring; dough; yolks; page; onion; fish; chocolate verbs: add; shortening; put; bake; mix; beaten; is; be; cut; been; chopped; cover; serve; have; boil; beat; boiling; has; pour; remove; spread; make; roll; sifted; boiled; melted; stirring; are; used; sprinkle; drain; greased; cook; stir; grated; allow; cooked; stand; mixed; made; fold; drop; turn; sift; fill; sterilized; icing; granulated; desired; beating adjectives: hot; cold; moderate; greased; little; small; thick; dry; white; other; brown; soft; smooth; cool; thin; floured; fresh; stiff; few; shallow; melted; deep; oven; fine; slow; powdered; same; large; enough; double; more; warm; unsweetened; quart; french; tender; plain; light; hard; clean; long; green; sweet; possible; whole; usual; several; necessary; medium; damp adverbs: together; well; slowly; in; very; about; out; then; not; lightly; up; off; gradually; enough; slightly; on; finely; just; thoroughly; over; once; constantly; carefully; as; quickly; only; down; longer; immediately; always; again; hard; continually; too; most; alternately; soon; loosely; instead; above; often; jelly; at; apart; all; thin; thick; more; first; away pronouns: it; them; they; its; i; you; their; syrup--1; our; itself proper nouns: royal; baking; powder; cream; cake; sift; sauce; boil; cup; oven; brown; cakes; _; wash; jelly; icing; pie; corn; chocolate; fruit; nut; filling; bread; orange; mix; melt; egg; cook; sugar; apple; salad; pudding; pan; nutmeg; layer; strawberry; scald; tomato; rolls; roast; graham; cocoanut; canning; butter; beans; baked; yolk; soup; rice; raisin keywords: teaspoon; royal; powder; cup; cream; cake; baking one topic; one dimension: add file(s): titles(s): A Little Book for A Little Cook three topics; one dimension: add; section; section file(s): ./cache/38193.txt, , titles(s): New Royal Cook Book | A Little Book for A Little Cook | A Little Book for A Little Cook five topics; three dimensions: add cup sugar; section root reserve; section root reserve; section root reserve; section root reserve file(s): ./cache/38193.txt, , , , titles(s): New Royal Cook Book | A Little Book for A Little Cook | A Little Book for A Little Cook | A Little Book for A Little Cook | A Little Book for A Little Cook Type: gutenberg title: subject-baking-gutenberg date: 2021-06-01 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Baking" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 24125 author: Hubbard, L. P. title: A Little Book for A Little Cook date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 38193 author: Royal Baking Powder Company title: New Royal Cook Book date: words: 30541.0 sentences: 2284.0 pages: flesch: 83.0 cache: ./cache/38193.txt txt: ./txt/38193.txt summary: Beat egg and add one cup milk; stir in corn meal, flour, sugar, salt and Sift together corn meal, flour, baking powder, salt and sugar; add milk, Soak bread crumbs in cold milk 10 minutes; add flour, baking powder and Sift together flour, baking powder, salt and sugar; add milk slowly; Sift together flour, baking powder, salt and sugar; add milk slowly; Cream butter, add beaten egg, flour in which baking powder and salt have Sift together flour, baking powder, sugar and salt; add beaten egg and Sift together flour, baking powder, sugar and salt; add beaten egg and Sift together flour, sugar, salt and baking powder; add milk, beaten egg Sift together the flour, baking powder, sugar and salt; add milk and Sift together the flour, baking powder, sugar and salt; add milk and Cream shortening; add sugar, beaten egg and milk; sift flour and baking ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel