mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-bohemiaCzechRepublic-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24419.txt inflating: ./tmp/input/input-file/42539.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-bohemiaCzechRepublic-gutenberg FILE: cache/24419.txt OUTPUT: txt/24419.txt FILE: cache/42539.txt OUTPUT: txt/42539.txt === file2bib.sh === id: 24419 author: Gleig, G. R. (George Robert) title: Germany, Bohemia, and Hungary, Visited in 1837. Vol. II date: pages: extension: .txt txt: ./txt/24419.txt cache: ./cache/24419.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24419.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24419 txt/../ent/24419.ent 24419 txt/../wrd/24419.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24419 txt/../pos/24419.pos 42539 txt/../pos/42539.pos 42539 txt/../wrd/42539.wrd 42539 txt/../ent/42539.ent === file2bib.sh === id: 42539 author: White, Walter title: A July Holiday in Saxony, Bohemia, and Silesia date: pages: extension: .txt txt: ./txt/42539.txt cache: ./cache/42539.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 8 resourceName b'42539.txt' Done mapping. Reducing subject-bohemiaCzechRepublic-gutenberg === reduce.pl bib === id = 42539 author = White, Walter title = A July Holiday in Saxony, Bohemia, and Silesia date = pages = extension = .txt mime = text/plain words = 84406 sentences = 4399 flesch = 77 summary = rows of little windows which resemble a half-opened eye. seen on the way besides fields, low hills, and the tall-chimneyed, when a young man came up, looked at me inquisitively, and said, "E within half a day's walk; and somewhat farther are the singular rocks that when you come to a green vale, with its little hay-fields watered Gradually the tall forest gives place to scrubby-looking firs, stony "Perhaps you come out of Saxony?" said a man, stepping from a house o'clock when I came to Buchau--a village of low houses built round a a great open arch, running far to the rear--a beer-house--the space doors of a pleasant house on a hill-slope beyond the city. Half an hour's stay gives you time to look at Aussig, to admire its The "little half-hour" brought us to a great cross by the "A snug little place," said the Dresdener, as we walked from room to cache = ./cache/42539.txt txt = ./txt/42539.txt === reduce.pl bib === Building ./etc/reader.txt 42539 24419 42539 24419 number of items: 2 sum of words: 84,406 average size in words: 84,406 average readability score: 77 nouns: place; way; time; hill; side; road; house; day; trees; view; town; man; houses; beer; men; room; miles; water; church; village; hills; eye; city; glass; hour; sight; ground; women; walk; night; years; rocks; name; hand; music; morning; nothing; distance; country; feet; door; year; work; something; one; mountains; times; pleasure; places; castle verbs: is; was; are; had; be; were; have; see; came; has; been; made; come; said; went; saw; look; did; looking; seen; having; go; took; find; do; built; left; read; looked; brought; set; sat; found; being; told; kept; going; gave; make; held; get; tell; take; let; heard; asked; think; seemed; stands; comes adjectives: little; other; more; few; great; many; good; old; same; small; long; own; first; such; short; large; tall; narrow; green; broad; white; much; wooden; last; high; whole; numerous; young; open; dark; bohemian; best; remarkable; red; low; new; steep; distant; black; most; next; deep; pleasant; german; wild; full; bright; ancient; blue; half adverbs: not; up; here; so; then; now; out; down; once; there; away; very; more; well; as; however; far; off; still; again; only; about; yet; on; perhaps; always; back; in; too; never; even; all; most; enough; presently; soon; much; farther; ever; long; together; somewhat; first; ago; over; forth; nearly; around; n''t; scarcely pronouns: i; you; it; he; his; their; they; we; me; my; them; its; him; your; her; she; our; us; themselves; myself; himself; itself; one; yourself; mine; herself; theirs; ourselves; yours; trodden; thyself; thy; thee; riesengebirge_--the; ne; it--"they; bookshelf proper nouns: _; prague; bohemia; england; english; st.; hill; herrnhut; chapter; carlsbad; saxony; saxon; czechs; count; adersbach; house; elbe; jew; sunday; baron; old; kunz; englishman; von; schneekoppe; röschen; warmbrunn; silesia; great; god; german; berlin; triller; rübezahl; london; hradschin; dresden; brethren; altenburg; view; royal; prince; luther; germans; beer; würzburg; prussia; king; john; jews keywords: way; walk; triller; sunday; st.; schneekoppe; saxon; prague; place; old; look; little; kunz; jew; hradschin; house; hill; herrnhut; good; german; englishman; english; england; elbe; dresden; czechs; czechish; count; chapter; carlsbad; brethren; bohemia; berlin; beer; baron; adersbach one topic; one dimension: little file(s): titles(s): Germany, Bohemia, and Hungary, Visited in 1837. Vol. II three topics; one dimension: little; ædiles; ædiles file(s): ./cache/42539.txt, , titles(s): A July Holiday in Saxony, Bohemia, and Silesia | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II five topics; three dimensions: little place hill; ædiles gunshot gurgle; ædiles gunshot gurgle; ædiles gunshot gurgle; ædiles gunshot gurgle file(s): ./cache/42539.txt, , , , titles(s): A July Holiday in Saxony, Bohemia, and Silesia | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II | Germany, Bohemia, and Hungary, Visited in 1837. Vol. II Type: gutenberg title: subject-bohemiaCzechRepublic-gutenberg date: 2021-06-01 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Bohemia (Czech Republic)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 24419 author: Gleig, G. R. (George Robert) title: Germany, Bohemia, and Hungary, Visited in 1837. Vol. II date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 42539 author: White, Walter title: A July Holiday in Saxony, Bohemia, and Silesia date: words: 84406.0 sentences: 4399.0 pages: flesch: 77.0 cache: ./cache/42539.txt txt: ./txt/42539.txt summary: rows of little windows which resemble a half-opened eye. seen on the way besides fields, low hills, and the tall-chimneyed, when a young man came up, looked at me inquisitively, and said, "E within half a day''s walk; and somewhat farther are the singular rocks that when you come to a green vale, with its little hay-fields watered Gradually the tall forest gives place to scrubby-looking firs, stony "Perhaps you come out of Saxony?" said a man, stepping from a house o''clock when I came to Buchau--a village of low houses built round a a great open arch, running far to the rear--a beer-house--the space doors of a pleasant house on a hill-slope beyond the city. Half an hour''s stay gives you time to look at Aussig, to admire its The "little half-hour" brought us to a great cross by the "A snug little place," said the Dresdener, as we walked from room to ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel