mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-reformers-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24934.txt inflating: ./tmp/input/input-file/567.txt inflating: ./tmp/input/input-file/568.txt inflating: ./tmp/input/input-file/569.txt inflating: ./tmp/input/input-file/5866.txt inflating: ./tmp/input/input-file/6449.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-reformers-gutenberg FILE: cache/567.txt OUTPUT: txt/567.txt FILE: cache/569.txt OUTPUT: txt/569.txt FILE: cache/24934.txt OUTPUT: txt/24934.txt FILE: cache/568.txt OUTPUT: txt/568.txt FILE: cache/5866.txt OUTPUT: txt/5866.txt FILE: cache/6449.txt OUTPUT: txt/6449.txt === file2bib.sh === id: 567 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 01 date: pages: extension: .txt txt: ./txt/567.txt cache: ./cache/567.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'567.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 568 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 10 date: pages: extension: .txt txt: ./txt/568.txt cache: ./cache/568.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'568.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 24934 author: Jones, Rufus M. (Rufus Matthew) title: Spiritual Reformers in the 16th & 17th Centuries date: pages: extension: .txt txt: ./txt/24934.txt cache: ./cache/24934.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24934.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24934 txt/../ent/24934.ent === file2bib.sh === id: 569 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 12 date: pages: extension: .txt txt: ./txt/569.txt cache: ./cache/569.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'569.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 568 txt/../wrd/568.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 567 txt/../ent/567.ent 568 txt/../ent/568.ent 569 txt/../ent/569.ent 24934 txt/../wrd/24934.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 568 txt/../pos/568.pos 567 txt/../pos/567.pos 569 txt/../pos/569.pos 569 txt/../wrd/569.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24934 txt/../pos/24934.pos 567 txt/../wrd/567.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 5866 txt/../wrd/5866.wrd 5866 txt/../pos/5866.pos 5866 txt/../ent/5866.ent === file2bib.sh === id: 5866 author: McCutcheon, George Barr title: Yollop date: pages: extension: .txt txt: ./txt/5866.txt cache: ./cache/5866.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'5866.txt' 6449 txt/../wrd/6449.wrd 6449 txt/../pos/6449.pos 6449 txt/../ent/6449.ent === file2bib.sh === id: 6449 author: Hubbard, Elbert title: Little Journeys to the Homes of the Great - Volume 09 Little Journeys to the Homes of Great Reformers date: pages: extension: .txt txt: ./txt/6449.txt cache: ./cache/6449.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'6449.txt' Done mapping. Reducing subject-reformers-gutenberg === reduce.pl bib === === reduce.pl bib === === reduce.pl bib === === reduce.pl bib === id = 5866 author = McCutcheon, George Barr title = Yollop date = pages = extension = .txt mime = text/plain words = 23708 sentences = 2131 flesch = 91 summary = I think how I let a skinny, half-witted boob like you walk right "I'll tell what I'll do," said Cassius Smilk obligingly. "The thing that's troubling me now," said Mr. Yollop, as Smilk hung "You were saying a little while ago," said Mr. Yollop, shifting his "I'm tryin' to use common, every-day words, Mr. Shallop," said Mr. Smilk, with dignity, "and I wish you'd do the same." "Cassius," interrupted Mr. Yollop urbanely, "this is my sister, Mrs. Champney. "Put up your hands, Yollop!" ordered Mr. Smilk. "I say, Cassius," cried Mr. Yollop, "is this the woman you wanted to "See here, Smilk," said Mr. Yollop, "I cannot allow you to strike my "I was thinking of your roll of bills, Cassius," said Mr. Yollop. "I wish I had shot you, Smilk, when I had the chance," said Mr. Yollop sadly. The State: "Now, Mr. Yollop, I'm going to ask you to tell the jury, cache = ./cache/5866.txt txt = ./txt/5866.txt === reduce.pl bib === id = 6449 author = Hubbard, Elbert title = Little Journeys to the Homes of the Great - Volume 09 Little Journeys to the Homes of Great Reformers date = pages = extension = .txt mime = text/plain words = 83299 sentences = 4434 flesch = 75 summary = Wesley went one day to hold evening prayers at a village church near years have passed since men heard his voice, looked on his strong, Henry George was that rare, peculiar and strange thing--an honest man. "What Cheer House" was all right for a man getting good wages, but much faith in God. After his thirty-sixth year Henry George slipped by natural process and insist that men shall have the right to work out their lives in The Reverend Theodore Parker once said: "Every living man in America United States, offered Paine passage to America on board the man-ofwar "Maryland," in order that he might be safe from capture by the Paine thought Franklin quite the greatest man of his time, an opinion time is coming when a State Church will be unknown in England, and The man who said, "In a world where death is, there is no time cache = ./cache/6449.txt txt = ./txt/6449.txt === reduce.pl bib === Building ./etc/reader.txt 6449 5866 569 6449 5866 569 number of items: 6 sum of words: 107,007 average size in words: 53,503 average readability score: 83 nouns: man; time; men; people; years; life; way; work; religion; things; world; year; children; name; death; day; business; woman; fact; mother; thing; law; church; place; heart; money; hand; times; land; nothing; love; power; one; mind; country; book; truth; head; order; house; counsel; wife; police; friends; words; horse; anything; question; part; state verbs: was; is; had; be; were; have; are; do; been; did; said; ''s; say; has; made; being; get; know; go; got; make; see; come; went; take; came; called; took; think; let; give; found; does; am; knew; read; thought; gave; want; sent; done; wrote; put; having; told; tell; ''ve; ''m; hear; given adjectives: great; good; little; own; other; many; more; same; much; first; old; few; free; right; young; true; new; strong; only; honest; such; better; several; religious; poor; long; last; full; human; certain; public; next; private; necessary; most; best; bad; political; mental; guilty; common; possible; beautiful; sure; high; dead; whole; simple; second; peculiar adverbs: not; so; n''t; then; up; out; now; only; never; very; here; just; as; back; ever; even; down; well; always; too; over; also; there; again; once; more; away; on; off; yet; still; all; much; in; soon; however; most; really; quite; often; simply; about; thus; first; together; no; finally; enough; before; almost pronouns: he; his; it; you; i; they; him; their; her; we; she; them; your; my; me; himself; us; our; its; themselves; ''em; myself; herself; yourself; one; itself; yours; thee; ourselves; mine; thy; theirs; ''s; huh; hers; out,--; on''t; em; brightened,--they proper nouns: mr.; john; yollop; smilk; garibaldi; england; paine; god; wesley; mrs.; george; cobden; bradlaugh; henry; parker; cassius; church; charles; america; state; oliver; cromwell; bright; hutchinson; hundred; calvin; theodore; new; knox; boston; house; thomas; luther; france; mary; london; mazzini; lord; oxford; reverend; richard; italy; emerson; york; rousseau; seventeen; jean; franklin; anne; jacques keywords: state; mrs.; yollop; wesley; time; theodore; smilk; sing; parker; paine; oxford; oliver; new; mr.; mazzini; man; london; knox; john; hutchinson; house; henry; god; george; garibaldi; france; england; cromwell; crittenden; cobden; church; charles; champney; cassius; calvin; bright; bradlaugh; boston; america one topic; one dimension: man file(s): titles(s): Spiritual Reformers in the 16th & 17th Centuries three topics; one dimension: man; dilemmas; dilemmas file(s): ./cache/6449.txt, , titles(s): Little Journeys to the Homes of the Great - Volume 09 Little Journeys to the Homes of Great Reformers | Spiritual Reformers in the 16th & 17th Centuries | Spiritual Reformers in the 16th & 17th Centuries five topics; three dimensions: man men john; mr yollop smilk; orderly hole whirling; orderly hole whirling; orderly hole whirling file(s): ./cache/6449.txt, ./cache/5866.txt, , , titles(s): Little Journeys to the Homes of the Great - Volume 09 Little Journeys to the Homes of Great Reformers | Yollop | Spiritual Reformers in the 16th & 17th Centuries | Spiritual Reformers in the 16th & 17th Centuries | Spiritual Reformers in the 16th & 17th Centuries Type: gutenberg title: subject-reformers-gutenberg date: 2021-06-09 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Reformers" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 567 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 01 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 568 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 10 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 569 author: Brann, William Cowper title: The Complete Works of Brann, the Iconoclast — Volume 12 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 6449 author: Hubbard, Elbert title: Little Journeys to the Homes of the Great - Volume 09 Little Journeys to the Homes of Great Reformers date: words: 83299.0 sentences: 4434.0 pages: flesch: 75.0 cache: ./cache/6449.txt txt: ./txt/6449.txt summary: Wesley went one day to hold evening prayers at a village church near years have passed since men heard his voice, looked on his strong, Henry George was that rare, peculiar and strange thing--an honest man. "What Cheer House" was all right for a man getting good wages, but much faith in God. After his thirty-sixth year Henry George slipped by natural process and insist that men shall have the right to work out their lives in The Reverend Theodore Parker once said: "Every living man in America United States, offered Paine passage to America on board the man-ofwar "Maryland," in order that he might be safe from capture by the Paine thought Franklin quite the greatest man of his time, an opinion time is coming when a State Church will be unknown in England, and The man who said, "In a world where death is, there is no time id: 24934 author: Jones, Rufus M. (Rufus Matthew) title: Spiritual Reformers in the 16th & 17th Centuries date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 5866 author: McCutcheon, George Barr title: Yollop date: words: 23708.0 sentences: 2131.0 pages: flesch: 91.0 cache: ./cache/5866.txt txt: ./txt/5866.txt summary: I think how I let a skinny, half-witted boob like you walk right "I''ll tell what I''ll do," said Cassius Smilk obligingly. "The thing that''s troubling me now," said Mr. Yollop, as Smilk hung "You were saying a little while ago," said Mr. Yollop, shifting his "I''m tryin'' to use common, every-day words, Mr. Shallop," said Mr. Smilk, with dignity, "and I wish you''d do the same." "Cassius," interrupted Mr. Yollop urbanely, "this is my sister, Mrs. Champney. "Put up your hands, Yollop!" ordered Mr. Smilk. "I say, Cassius," cried Mr. Yollop, "is this the woman you wanted to "See here, Smilk," said Mr. Yollop, "I cannot allow you to strike my "I was thinking of your roll of bills, Cassius," said Mr. Yollop. "I wish I had shot you, Smilk, when I had the chance," said Mr. Yollop sadly. The State: "Now, Mr. Yollop, I''m going to ask you to tell the jury, ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel