mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-chineseLiterature-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/4094.txt inflating: ./tmp/input/input-file/2941.txt inflating: ./tmp/input/input-file/10056.txt inflating: ./tmp/input/input-file/12086.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-chineseLiterature-gutenberg FILE: cache/2941.txt OUTPUT: txt/2941.txt FILE: cache/4094.txt OUTPUT: txt/4094.txt FILE: cache/12086.txt OUTPUT: txt/12086.txt FILE: cache/10056.txt OUTPUT: txt/10056.txt === file2bib.sh === id: 4094 author: Legge, James title: The Chinese Classics — Volume 1: Confucian Analects date: pages: extension: .txt txt: ./txt/4094.txt cache: ./cache/4094.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'4094.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 2941 author: nan title: The Chinese Classics — Prolegomena date: pages: extension: .txt txt: ./txt/2941.txt cache: ./cache/2941.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'2941.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 2941 txt/../ent/2941.ent 4094 txt/../pos/4094.pos 4094 txt/../ent/4094.ent 2941 txt/../pos/2941.pos 4094 txt/../wrd/4094.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2941 txt/../wrd/2941.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 12086 txt/../wrd/12086.wrd 12086 txt/../pos/12086.pos 12086 txt/../ent/12086.ent === file2bib.sh === id: 12086 author: nan title: Eastern Shame Girl date: pages: extension: .txt txt: ./txt/12086.txt cache: ./cache/12086.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'12086.txt' 10056 txt/../pos/10056.pos 10056 txt/../wrd/10056.wrd 10056 txt/../ent/10056.ent === file2bib.sh === id: 10056 author: Faxian title: Chinese Literature Comprising the Analects of Confucius, the Sayings of Mencius, the Shi-King, the Travels of Fâ-Hien, and the Sorrows of Han date: pages: extension: .txt txt: ./txt/10056.txt cache: ./cache/10056.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 8 resourceName b'10056.txt' Done mapping. Reducing subject-chineseLiterature-gutenberg === reduce.pl bib === === reduce.pl bib === === reduce.pl bib === id = 10056 author = Faxian title = Chinese Literature Comprising the Analects of Confucius, the Sayings of Mencius, the Shi-King, the Travels of Fâ-Hien, and the Sorrows of Han date = pages = extension = .txt mime = text/plain words = 88809 sentences = 6076 flesch = 85 summary = The Master once said of Kwan Chung, [9] "A small-minded man indeed!" Confucius, and said, "When great men have come here, I have never yet "High station," said the Master, "occupied by men who have no large and Tsz-lu then said, "I should like, sir, to hear what your heart is set disciples, cannot by any learning manage to be," said Kung-si Hwa. Once when the Master was seriously ill, Tsz-lu requested to be allowed A high State official, after questioning Tsz-kung, said, "Your Master is "You are spoiling a good man's son," said the Master. "In hearing causes, I am like other men," said the Master. Tsz-chang having raised some question about government, the Master said "A man of little mind, that!" said the Master, when Fan Ch'i had gone "Let good and able men discipline the people for seven years," said the When the music-master had left, Tsz-chang said to him, "Is that the way cache = ./cache/10056.txt txt = ./txt/10056.txt === reduce.pl bib === id = 12086 author = nan title = Eastern Shame Girl date = pages = extension = .txt mime = text/plain words = 33267 sentences = 2521 flesch = 90 summary = days went quickly, and the months too; and a year had passed. "We who keep open doors must eat our visitors three times a day, and who refuses riches, opens wide the door, and makes my old body bear So Shih-niang said; "I have stayed in your house for a long time, and Next day they thanked Yuch-lang again, and went to the house of "Since earliest time," said Sun, "the hearts of women have been as As the girl did not answer, this wise old visitor turned to the mother So the old woman went up into the sick man's room, and he said to her the evening, said to his mother: "An excellent day's work! At this moment the door of the house opened below, and a man came As soon as the mother had left the room, the woman took a slight cache = ./cache/12086.txt txt = ./txt/12086.txt Building ./etc/reader.txt 10056 12086 4094 10056 12086 4094 number of items: 4 sum of words: 122,076 average size in words: 61,038 average readability score: 87 nouns: man; men; people; place; day; king; time; way; days; heart; years; footnote; country; night; monks; father; one; life; mother; words; name; son; others; house; woman; things; wife; family; city; death; mind; door; body; girl; nothing; prince; head; daughter; food; tope; love; part; offerings; matter; tree; kingdom; hand; ground; work; parents verbs: is; was; be; have; are; had; said; were; do; has; been; went; go; come; came; let; made; make; did; take; asked; being; know; am; see; say; give; replied; having; took; put; called; does; answered; found; heard; speak; left; going; gave; find; brought; seen; done; told; saw; became; set; sent; given adjectives: great; other; good; such; old; more; little; young; own; first; same; many; large; high; superior; small; able; long; full; present; right; whole; white; few; last; poor; new; true; different; former; various; precious; common; second; proper; certain; much; chinese; beautiful; wild; rich; next; hard; bright; deep; worthy; vain; sad; possible; fine adverbs: not; so; then; now; out; up; also; only; again; there; here; away; still; never; down; back; yet; once; as; very; even; all; well; on; thus; far; indeed; more; soon; too; forth; together; off; long; already; just; first; however; most; immediately; therefore; over; about; no; in; alone; much; forward; always; rather pronouns: he; his; i; it; you; they; him; my; her; their; them; she; your; we; me; our; its; himself; us; themselves; one; yourself; herself; myself; thee; itself; thy; ourselves; mine; ye; ours; yours; theirs; td; ourself; husband~; history.--but; himself:--"even; gatherers~; council~ proper nouns: _; master; buddha; tsz; confucius; lu; li; heaven; king; chang; hien; yu; fâ; emperor; han; kung; chow; shih; book; majesty; niang; lord; yen; sun; liu; law; wan; wu; duke; footnote; governor; chia; lang; india; china; ki; mencius; ya; state; nei; ma; life; hwuy; ho; wei; rules; chung; bodhisattva; ts''in; south keywords: yen; wan; tsz; sun; state; shih; rules; master; man; majesty; lord; liu; life; law; king; india; hwuy; heaven; han; great; governor; footnote; emperor; duke; confucius; come; chow; chinese; china; chia; chapter; chang; buddha; book one topic; one dimension: said file(s): titles(s): The Chinese Classics — Volume 1: Confucian Analects three topics; one dimension: said; said; developed file(s): ./cache/10056.txt, ./cache/12086.txt, titles(s): Chinese Literature Comprising the Analects of Confucius, the Sayings of Mencius, the Shi-King, the Travels of Fâ-Hien, and the Sorrows of Han | Eastern Shame Girl | The Chinese Classics — Volume 1: Confucian Analects five topics; three dimensions: said master man; said little went; frighten educated bitterly; frighten educated bitterly; frighten educated bitterly file(s): ./cache/10056.txt, ./cache/12086.txt, , , titles(s): Chinese Literature Comprising the Analects of Confucius, the Sayings of Mencius, the Shi-King, the Travels of Fâ-Hien, and the Sorrows of Han | Eastern Shame Girl | The Chinese Classics — Volume 1: Confucian Analects | The Chinese Classics — Volume 1: Confucian Analects | The Chinese Classics — Volume 1: Confucian Analects Type: gutenberg title: subject-chineseLiterature-gutenberg date: 2021-06-03 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Chinese literature" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 10056 author: Faxian title: Chinese Literature Comprising the Analects of Confucius, the Sayings of Mencius, the Shi-King, the Travels of Fâ-Hien, and the Sorrows of Han date: words: 88809.0 sentences: 6076.0 pages: flesch: 85.0 cache: ./cache/10056.txt txt: ./txt/10056.txt summary: The Master once said of Kwan Chung, [9] "A small-minded man indeed!" Confucius, and said, "When great men have come here, I have never yet "High station," said the Master, "occupied by men who have no large and Tsz-lu then said, "I should like, sir, to hear what your heart is set disciples, cannot by any learning manage to be," said Kung-si Hwa. Once when the Master was seriously ill, Tsz-lu requested to be allowed A high State official, after questioning Tsz-kung, said, "Your Master is "You are spoiling a good man''s son," said the Master. "In hearing causes, I am like other men," said the Master. Tsz-chang having raised some question about government, the Master said "A man of little mind, that!" said the Master, when Fan Ch''i had gone "Let good and able men discipline the people for seven years," said the When the music-master had left, Tsz-chang said to him, "Is that the way id: 4094 author: Legge, James title: The Chinese Classics — Volume 1: Confucian Analects date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 2941 author: nan title: The Chinese Classics — Prolegomena date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 12086 author: nan title: Eastern Shame Girl date: words: 33267.0 sentences: 2521.0 pages: flesch: 90.0 cache: ./cache/12086.txt txt: ./txt/12086.txt summary: days went quickly, and the months too; and a year had passed. "We who keep open doors must eat our visitors three times a day, and who refuses riches, opens wide the door, and makes my old body bear So Shih-niang said; "I have stayed in your house for a long time, and Next day they thanked Yuch-lang again, and went to the house of "Since earliest time," said Sun, "the hearts of women have been as As the girl did not answer, this wise old visitor turned to the mother So the old woman went up into the sick man''s room, and he said to her the evening, said to his mother: "An excellent day''s work! At this moment the door of the house opened below, and a man came As soon as the mother had left the room, the woman took a slight ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel