mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-interracialMarriage-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/15402.txt inflating: ./tmp/input/input-file/1127.txt inflating: ./tmp/input/input-file/1793.txt inflating: ./tmp/input/input-file/2267.txt inflating: ./tmp/input/input-file/10549.txt inflating: ./tmp/input/input-file/9865.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-interracialMarriage-gutenberg FILE: cache/1127.txt OUTPUT: txt/1127.txt FILE: cache/1793.txt OUTPUT: txt/1793.txt FILE: cache/2267.txt OUTPUT: txt/2267.txt FILE: cache/15402.txt OUTPUT: txt/15402.txt FILE: cache/9865.txt OUTPUT: txt/9865.txt FILE: cache/10549.txt OUTPUT: txt/10549.txt === file2bib.sh === id: 2267 author: Shakespeare, William title: Othello date: pages: extension: .txt txt: ./txt/2267.txt cache: ./cache/2267.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'2267.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1793 txt/../pos/1793.pos 2267 txt/../pos/2267.pos 1793 txt/../wrd/1793.wrd 1127 txt/../pos/1127.pos 2267 txt/../ent/2267.ent 2267 txt/../wrd/2267.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1127 txt/../ent/1127.ent 1793 txt/../ent/1793.ent 1127 txt/../wrd/1127.wrd === file2bib.sh === id: 1127 author: Shakespeare, William title: The Tragedy of Othello, Moor of Venice date: pages: extension: .txt txt: ./txt/1127.txt cache: ./cache/1127.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1127.txt' === file2bib.sh === id: 1793 author: Shakespeare, William title: Othello date: pages: extension: .txt txt: ./txt/1793.txt cache: ./cache/1793.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1793.txt' 15402 txt/../pos/15402.pos 9865 txt/../pos/9865.pos 9865 txt/../wrd/9865.wrd 15402 txt/../wrd/15402.wrd 9865 txt/../ent/9865.ent 15402 txt/../ent/15402.ent 10549 txt/../pos/10549.pos 10549 txt/../wrd/10549.wrd 10549 txt/../ent/10549.ent === file2bib.sh === id: 15402 author: Dickinson, Anna E. (Anna Elizabeth) title: What Answer? date: pages: extension: .txt txt: ./txt/15402.txt cache: ./cache/15402.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'15402.txt' === file2bib.sh === id: 9865 author: Hergesheimer, Joseph title: Java Head date: pages: extension: .txt txt: ./txt/9865.txt cache: ./cache/9865.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'9865.txt' === file2bib.sh === id: 10549 author: Child, Lydia Maria title: A Romance of the Republic date: pages: extension: .txt txt: ./txt/10549.txt cache: ./cache/10549.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 16 resourceName b'10549.txt' Done mapping. Reducing subject-interracialMarriage-gutenberg === reduce.pl bib === id = 15402 author = Dickinson, Anna E. (Anna Elizabeth) title = What Answer? date = pages = extension = .txt mime = text/plain words = 67288 sentences = 4433 flesch = 87 summary = the way, it seemed more home-like and less shoppy, as Mrs. Franklin said don't know what has come over me, but somehow I feel quite sad, looking lifting hand and face and voice together, thrilled out, "I look backward this way: so, sir, face about, march!" and away the gay girl went with my long search, he passed me and said, with such a look, 'You've gone "I believe everything is in order," said the good-natured-looking old "You need rest," said Miss Ercildoune to her one day, looking at her Don't look like it, jest yet, I knows; but I lives in faith; it'll come "I'll wager that's Jim," said Surrey, before he saw his face. just what Jim said; an' de sojer he put his hand up to his face, an' I you any good; and, upon my word, the way you're looking I really think cache = ./cache/15402.txt txt = ./txt/15402.txt === reduce.pl bib === id = 1127 author = Shakespeare, William title = The Tragedy of Othello, Moor of Venice date = pages = extension = .txt mime = text/plain words = 40 sentences = 10 flesch = 88 summary = THIS EBOOK WAS ONE OF PROJECT GUTENBERG'S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#100) at https://www.gutenberg.org/ebooks/100 cache = ./cache/1127.txt txt = ./txt/1127.txt === reduce.pl bib === === reduce.pl bib === id = 10549 author = Child, Lydia Maria title = A Romance of the Republic date = pages = extension = .txt mime = text/plain words = 128367 sentences = 7849 flesch = 83 summary = "What are you going to do with yourself this evening, Alfred?" said Mr. Royal to his companion, as they issued from his counting-house in New "Let her do as she likes, Rosa dear," said her father. "You would make Taglioni jealous," said Mr. Fitzgerald, addressing the little dancer; and Mr. King silently "Dear Gerald, you didn't tell us Tulee was here," said Rosa. "But tell me one thing, my little friend," continued Mrs. Delano. "I want you to come again as soon as you can," said Mrs. Delano, "I felt troubled when I went away the other day," said Flora. "I should think something would happen very often then," rejoined Mrs. Delano with a smile, to which she responded with her ready little Flora said, "Rosa, dear, does it pain you very much to hear about Mr. Fitzgerald?" some general conversation, Flora said: "You know Mrs. Fitzgerald is "Poor Mrs. Fitzgerald!" said Flora. cache = ./cache/10549.txt txt = ./txt/10549.txt === reduce.pl bib === id = 9865 author = Hergesheimer, Joseph title = Java Head date = pages = extension = .txt mime = text/plain words = 68071 sentences = 4152 flesch = 78 summary = Jeremy Ammidon's mind turned to Gerrit, his son; this interest in Nettie more like Gerrit, Captain Ammidon, than Mrs. Saltonstone, his own sister. "Father," he said, "Rhoda and William, allow me--my wife, Taou Yuen." A man in charge said to Gerrit Ammidon: Taou Yuen did not come down to breakfast, and Gerrit stayed away from Rhoda, Taou Yuen beside her with Gerrit facing them, followed in the stupefied greetings; while Gerrit Ammidon moved on at Taou Yuen's side. "Well, Nettie," Gerrit said, moving forward promptly, "it's pleasant to more brains than Jeremy Ammidon, that stiff old man with a face the color "You know my father," he said, and Jeremy Ammidon, his heavy body in Gerrit Ammidon to smile at her with his eyes blue like a fair sea... "Perhaps Taou Yuen will come down," Rhoda Ammidon suggested, and Nettie's "I love you, Gerrit," Nettie said; "I'll never stop till I die." Her face cache = ./cache/9865.txt txt = ./txt/9865.txt === reduce.pl bib === id = 1793 author = Shakespeare, William title = Othello date = pages = extension = .txt mime = text/plain words = 40 sentences = 10 flesch = 88 summary = THIS EBOOK WAS ONE OF PROJECT GUTENBERG'S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#1531) at https://www.gutenberg.org/ebooks/1531 cache = ./cache/1793.txt txt = ./txt/1793.txt Building ./etc/reader.txt 10549 15402 9865 9865 10549 15402 number of items: 6 sum of words: 263,806 average size in words: 52,761 average readability score: 84 nouns: time; man; face; father; hand; eyes; day; mother; room; way; heart; voice; house; men; life; something; nothing; friend; lady; wife; head; anything; night; morning; love; home; woman; world; evening; things; door; one; words; hands; place; moment; people; mind; children; sea; days; years; name; thing; girl; son; gentleman; slave; daughter; feeling verbs: was; had; be; is; have; were; said; do; been; ''s; are; did; see; know; replied; go; has; made; think; come; came; am; say; went; thought; told; saw; tell; seemed; take; make; heard; looked; found; rejoined; looking; turned; going; took; answered; knew; let; put; get; called; brought; hear; being; felt; seen adjectives: little; good; young; other; great; such; old; own; more; long; last; poor; same; first; few; dear; white; black; many; much; new; beautiful; bright; happy; full; dark; possible; next; dead; handsome; small; pleasant; glad; sure; strange; better; short; free; rich; best; fine; right; ready; blue; whole; bad; open; afraid; least; present adverbs: not; n''t; so; up; then; very; out; now; never; here; away; as; more; too; again; there; back; down; always; only; once; just; still; ever; well; soon; much; in; off; all; even; on; almost; long; yet; perhaps; enough; most; far; rather; often; over; first; together; sometimes; however; no; quite; forward; suddenly pronouns: i; he; her; she; you; it; his; him; they; me; my; their; them; your; we; its; us; our; herself; himself; myself; yourself; ''em; itself; themselves; mine; one; thy; yours; thee; ourselves; gerrit; hers; ye; ours; theirs; em; ''s; yerself; jus; hisself; yer.--an; won''t,--she; thyself; tears; ourself; o; no,--you; know,--she; himself,--"a proper nouns: _; mr.; mrs.; rosa; fitzgerald; flora; king; gerrit; delano; ammidon; tulee; madame; nettie; gerald; new; yuen; jim; dunsack; taou; surrey; floracita; god; tom; mamita; salem; william; edward; signor; boston; blumenthal; rhoda; laurel; alfred; sidsall; royal; rosabella; miss; jeremy; ercildoune; street; vollar; sallie; orleans; francesca; exclaimed; chloe; brevard; percival; de; captain keywords: tom; new; mrs.; mr.; ebook; boston; yuen; willie; william; vollar; tulee; taou; surrey; street; signor; sidsall; saltonstone; sallie; salem; russell; royal; rosabella; rosa; roger; robert; rhoda; percival; orleans; nettie; nautilus; missy; miss; manchu; man; mamita; madame; look; little; like; laurel; king; jim; jeremy; good; god; gerrit; gerald; francesca; floracita; flora one topic; one dimension: said file(s): ./cache/15402.txt titles(s): What Answer? three topics; one dimension: said; said; gutenberg file(s): ./cache/9865.txt, ./cache/10549.txt, ./cache/1127.txt titles(s): Java Head | A Romance of the Republic | The Tragedy of Othello, Moor of Venice five topics; three dimensions: said like gerrit; said mr mrs; ebook gutenberg 1531; improved title viewed; improved title viewed file(s): ./cache/9865.txt, ./cache/10549.txt, ./cache/1127.txt, , titles(s): Java Head | A Romance of the Republic | The Tragedy of Othello, Moor of Venice | Othello | Othello Type: gutenberg title: subject-interracialMarriage-gutenberg date: 2021-06-06 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Interracial marriage" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 10549 author: Child, Lydia Maria title: A Romance of the Republic date: words: 128367.0 sentences: 7849.0 pages: flesch: 83.0 cache: ./cache/10549.txt txt: ./txt/10549.txt summary: "What are you going to do with yourself this evening, Alfred?" said Mr. Royal to his companion, as they issued from his counting-house in New "Let her do as she likes, Rosa dear," said her father. "You would make Taglioni jealous," said Mr. Fitzgerald, addressing the little dancer; and Mr. King silently "Dear Gerald, you didn''t tell us Tulee was here," said Rosa. "But tell me one thing, my little friend," continued Mrs. Delano. "I want you to come again as soon as you can," said Mrs. Delano, "I felt troubled when I went away the other day," said Flora. "I should think something would happen very often then," rejoined Mrs. Delano with a smile, to which she responded with her ready little Flora said, "Rosa, dear, does it pain you very much to hear about Mr. Fitzgerald?" some general conversation, Flora said: "You know Mrs. Fitzgerald is "Poor Mrs. Fitzgerald!" said Flora. id: 15402 author: Dickinson, Anna E. (Anna Elizabeth) title: What Answer? date: words: 67288.0 sentences: 4433.0 pages: flesch: 87.0 cache: ./cache/15402.txt txt: ./txt/15402.txt summary: the way, it seemed more home-like and less shoppy, as Mrs. Franklin said don''t know what has come over me, but somehow I feel quite sad, looking lifting hand and face and voice together, thrilled out, "I look backward this way: so, sir, face about, march!" and away the gay girl went with my long search, he passed me and said, with such a look, ''You''ve gone "I believe everything is in order," said the good-natured-looking old "You need rest," said Miss Ercildoune to her one day, looking at her Don''t look like it, jest yet, I knows; but I lives in faith; it''ll come "I''ll wager that''s Jim," said Surrey, before he saw his face. just what Jim said; an'' de sojer he put his hand up to his face, an'' I you any good; and, upon my word, the way you''re looking I really think id: 9865 author: Hergesheimer, Joseph title: Java Head date: words: 68071.0 sentences: 4152.0 pages: flesch: 78.0 cache: ./cache/9865.txt txt: ./txt/9865.txt summary: Jeremy Ammidon''s mind turned to Gerrit, his son; this interest in Nettie more like Gerrit, Captain Ammidon, than Mrs. Saltonstone, his own sister. "Father," he said, "Rhoda and William, allow me--my wife, Taou Yuen." A man in charge said to Gerrit Ammidon: Taou Yuen did not come down to breakfast, and Gerrit stayed away from Rhoda, Taou Yuen beside her with Gerrit facing them, followed in the stupefied greetings; while Gerrit Ammidon moved on at Taou Yuen''s side. "Well, Nettie," Gerrit said, moving forward promptly, "it''s pleasant to more brains than Jeremy Ammidon, that stiff old man with a face the color "You know my father," he said, and Jeremy Ammidon, his heavy body in Gerrit Ammidon to smile at her with his eyes blue like a fair sea... "Perhaps Taou Yuen will come down," Rhoda Ammidon suggested, and Nettie''s "I love you, Gerrit," Nettie said; "I''ll never stop till I die." Her face id: 1127 author: Shakespeare, William title: The Tragedy of Othello, Moor of Venice date: words: 40.0 sentences: 10.0 pages: flesch: 88.0 cache: ./cache/1127.txt txt: ./txt/1127.txt summary: THIS EBOOK WAS ONE OF PROJECT GUTENBERG''S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#100) at https://www.gutenberg.org/ebooks/100 id: 1793 author: Shakespeare, William title: Othello date: words: 40.0 sentences: 10.0 pages: flesch: 88.0 cache: ./cache/1793.txt txt: ./txt/1793.txt summary: THIS EBOOK WAS ONE OF PROJECT GUTENBERG''S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#1531) at https://www.gutenberg.org/ebooks/1531 id: 2267 author: Shakespeare, William title: Othello date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel