mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named bacon-from-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/2434.txt inflating: ./tmp/input/input-file/3290.txt inflating: ./tmp/input/input-file/575.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === updating bibliographic database Building study carrel named bacon-from-gutenberg FILE: cache/2434.txt OUTPUT: txt/2434.txt FILE: cache/3290.txt OUTPUT: txt/3290.txt FILE: cache/575.txt OUTPUT: txt/575.txt === file2bib.sh === id: 3290 author: Bacon, Francis title: Valerius Terminus: Of the Interpretation of Nature date: pages: extension: .txt txt: ./txt/3290.txt cache: ./cache/3290.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'3290.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 3290 txt/../ent/3290.ent 3290 txt/../pos/3290.pos 3290 txt/../wrd/3290.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2434 txt/../pos/2434.pos 2434 txt/../wrd/2434.wrd 2434 txt/../ent/2434.ent === file2bib.sh === id: 2434 author: Bacon, Francis title: New Atlantis date: pages: extension: .txt txt: ./txt/2434.txt cache: ./cache/2434.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'2434.txt' 575 txt/../pos/575.pos 575 txt/../wrd/575.wrd 575 txt/../ent/575.ent === file2bib.sh === id: 575 author: Bacon, Francis title: The Essays or Counsels, Civil and Moral date: pages: extension: .txt txt: ./txt/575.txt cache: ./cache/575.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'575.txt' Done mapping. Reducing bacon-from-gutenberg === reduce.pl bib === id = 2434 author = Bacon, Francis title = New Atlantis date = pages = extension = .txt mime = text/plain words = 15797 sentences = 595 flesch = 73 summary = a yellow cane, tipped at both ends with blue, who came aboard our ship, did in our ship-boat, sending the principal man amongst us save one, which answer the said person lifted up his right hand towards Heaven, men and goods out of our ship, was somewhat settled and quiet, I old world, and the new; and whether ever we shall see Europe, God only The morrow after our three days were past, there came to us a new man, He said, "I am by office governor of this House of Strangers, and by of those times,) had then fifteen hundred strong ships, of great of the true nature of all things, (whereby God might have the more On the feast day, the father or Tirsan cometh forth after divine Jew came to me again, and said; "Ye are happy men; for the Father of cache = ./cache/2434.txt txt = ./txt/2434.txt === reduce.pl bib === === reduce.pl bib === id = 575 author = Bacon, Francis title = The Essays or Counsels, Civil and Moral date = pages = extension = .txt mime = text/plain words = 53415 sentences = 2339 flesch = 74 summary = of a man's heart, so secret men come to the knowledge of many things rich man, and another except to it, Yea, but he hath a great charge Certainly great persons had need to borrow other men's Certainly to men of great judgment, bold persons are a sport Princes are like to heavenly bodies, which cause good or evil times; and servant, shall carry things against a great good of the master's. Seeming wise men may make shift to get opinion; but let no man choose it; namely, religion, matters of state, great persons, any man's present England, that had the greatest audits of any man in my time; a great since we have said, it were good not to use men of ambitious natures, of man's life, let men by all means endeavor, to obtain good customs. Yet such men, many times, are in great favor; virtue or greatness, these men are good trumpeters. cache = ./cache/575.txt txt = ./txt/575.txt Building ./etc/reader.txt 575 2434 3290 575 2434 3290 number of items: 3 sum of words: 69,212 average size in words: 34,606 average readability score: 73 nouns: man; men; things; nature; time; state; persons; times; part; people; business; others; thing; counsel; use; place; kind; side; matter; end; body; princes; land; world; way; virtue; number; life; envy; divers; doth; day; speech; one; mind; years; parts; hand; hath; children; means; king; honor; estate; rest; person; nothing; ground; self; religion verbs: is; be; are; have; was; do; were; had; make; let; come; take; said; been; made; see; give; set; being; think; say; know; speak; did; call; go; find; came; put; done; use; seen; keep; hath; thought; look; bring; seem; pass; left; tell; given; found; need; maketh; called; live; concerning; used; taken adjectives: great; other; good; many; such; own; little; more; much; like; true; first; better; best; wise; same; certain; natural; greater; small; new; fair; most; greatest; full; second; several; few; high; excellent; ancient; fit; secret; least; doth; third; strange; saith; principal; particular; long; last; ill; common; young; open; former; able; less; human adverbs: not; so; also; more; well; therefore; too; yet; then; only; rather; as; ever; likewise; most; never; certainly; up; first; much; now; commonly; sometimes; far; again; less; down; forth; out; somewhat; indeed; especially; in; very; off; almost; there; generally; still; long; otherwise; even; together; often; thereof; over; surely; on; is; back pronouns: it; they; he; we; their; his; them; you; i; him; us; our; themselves; himself; your; my; me; itself; her; she; ourselves; thy; one; thee; thyself; theirs; ours; yourself; whereof; its; yourselves; yours; ye; tunescere; myself proper nouns: god; hath; thou; england; caesar; house; solomon; ye; whereof; henry; europe; et; envy; tacitus; heaven; doth; bensalem; yea; tirsan; salomon; rome; romans; france; pompey; king; fortune; west; bacon; augustus; atlantis; spain; qui; queen; new; lord; jupiter; father; cicero; christ; seventh; seneca; nec; mahomet; jus; great; withal; vespasian; usury; turks; tiberius keywords: man; great; god; tirsan; time; thing; state; solomon; salomon; place; person; nature; mean; matter; little; like; land; house; henry; hath; good; envy; england; doth; counsel; come; caesar; business; bensalem one topic; one dimension: man file(s): ./cache/2434.txt titles(s): New Atlantis three topics; one dimension: man; great; seal file(s): ./cache/575.txt, ./cache/2434.txt, titles(s): The Essays or Counsels, Civil and Moral | New Atlantis | Valerius Terminus: Of the Interpretation of Nature five topics; three dimensions: man men great; great said land; seal sugar void; seal sugar void; seal sugar void file(s): ./cache/575.txt, ./cache/2434.txt, , , titles(s): The Essays or Counsels, Civil and Moral | New Atlantis | Valerius Terminus: Of the Interpretation of Nature | Valerius Terminus: Of the Interpretation of Nature | Valerius Terminus: Of the Interpretation of Nature Type: gutenberg title: bacon-from-gutenberg date: 2021-01-08 time: 20:59 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: author:"Bacon, Francis" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 2434 author: Bacon, Francis title: New Atlantis date: words: 15797.0 sentences: 595.0 pages: flesch: 73.0 cache: ./cache/2434.txt txt: ./txt/2434.txt summary: a yellow cane, tipped at both ends with blue, who came aboard our ship, did in our ship-boat, sending the principal man amongst us save one, which answer the said person lifted up his right hand towards Heaven, men and goods out of our ship, was somewhat settled and quiet, I old world, and the new; and whether ever we shall see Europe, God only The morrow after our three days were past, there came to us a new man, He said, "I am by office governor of this House of Strangers, and by of those times,) had then fifteen hundred strong ships, of great of the true nature of all things, (whereby God might have the more On the feast day, the father or Tirsan cometh forth after divine Jew came to me again, and said; "Ye are happy men; for the Father of id: 3290 author: Bacon, Francis title: Valerius Terminus: Of the Interpretation of Nature date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 575 author: Bacon, Francis title: The Essays or Counsels, Civil and Moral date: words: 53415.0 sentences: 2339.0 pages: flesch: 74.0 cache: ./cache/575.txt txt: ./txt/575.txt summary: of a man''s heart, so secret men come to the knowledge of many things rich man, and another except to it, Yea, but he hath a great charge Certainly great persons had need to borrow other men''s Certainly to men of great judgment, bold persons are a sport Princes are like to heavenly bodies, which cause good or evil times; and servant, shall carry things against a great good of the master''s. Seeming wise men may make shift to get opinion; but let no man choose it; namely, religion, matters of state, great persons, any man''s present England, that had the greatest audits of any man in my time; a great since we have said, it were good not to use men of ambitious natures, of man''s life, let men by all means endeavor, to obtain good customs. Yet such men, many times, are in great favor; virtue or greatness, these men are good trumpeters. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel