mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-chinesePoetry-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/390.txt inflating: ./tmp/input/input-file/37938.txt inflating: ./tmp/input/input-file/40425.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-chinesePoetry-gutenberg FILE: cache/37938.txt OUTPUT: txt/37938.txt FILE: cache/390.txt OUTPUT: txt/390.txt FILE: cache/40425.txt OUTPUT: txt/40425.txt === file2bib.sh === id: 390 author: Cranmer-Byng, L. (Launcelot) title: A Lute of Jade : Selections from the Classical Poets of China date: pages: extension: .txt txt: ./txt/390.txt cache: ./cache/390.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'390.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 390 txt/../ent/390.ent 390 txt/../wrd/390.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 390 txt/../pos/390.pos 40425 txt/../pos/40425.pos 40425 txt/../wrd/40425.wrd 40425 txt/../ent/40425.ent === file2bib.sh === id: 40425 author: nan title: Chinese Mother Goose Rhymes date: pages: extension: .txt txt: ./txt/40425.txt cache: ./cache/40425.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'40425.txt' 37938 txt/../pos/37938.pos 37938 txt/../wrd/37938.wrd 37938 txt/../ent/37938.ent === file2bib.sh === id: 37938 author: nan title: Chinese Poems date: pages: extension: .txt txt: ./txt/37938.txt cache: ./cache/37938.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'37938.txt' Done mapping. Reducing subject-chinesePoetry-gutenberg === reduce.pl bib === id = 37938 author = nan title = Chinese Poems date = pages = extension = .txt mime = text/plain words = 19858 sentences = 1609 flesch = 90 summary = little excursion into the field of Chinese poetry, for the thoughts and 'The River by Night in Spring,' 'Reflections on the Brevity of Life,' work and passed away during nearly three thousand years, they know but Han Dynasty or earlier, and they are regarded as poetical compositions rules which have guided Chinese poets in writing poetry since the T'ang this day; and during the most flourishing years of the T'ang Dynasty the read the poems of the T'ang period and neglect those of ancient times; dynasties did not always follow the new poetical technique of the T'ang Form of 5-character Lüh poem beginning in the Ping tone: each line in terms of ping and tseh forms the rhythm of Chinese poetry. the poets of the T'ang Dynasty; but in ancient poetry, words both in his old age he was allowed to return, and he ended his days peacefully the work of ancient Chinese poets. cache = ./cache/37938.txt txt = ./txt/37938.txt === reduce.pl bib === === reduce.pl bib === id = 40425 author = nan title = Chinese Mother Goose Rhymes date = pages = extension = .txt mime = text/plain words = 6897 sentences = 796 flesch = 103 summary = "Sweeter than Sugar," "Sweet Pill," "Little Fat Boy," and "Baby is Fenn, of Peking, to her old nurse repeating these rhymes to her little And you shall come and eat with me, You dear little baby, A LITTLE GIRL'S WANTS What a fine little fellow is this fat boy of mine! Little baby, go to bed, Our little bean-cake we will fry. Like a little withered flower, The faithful old watch-dog looks after the house, When asked by his mother to buy her some cake, There were two little sisters went walking one day, A wee little flower-pot, very deep green, And a baby comes to our home at night; Come, buy my flowers, Old Mr. blind man, come here quick, The little dog's run away, I am my brother's dear little sister; The old man comes out This little cow eats grass, This little cow eats hay, This little cow runs away, cache = ./cache/40425.txt txt = ./txt/40425.txt Building ./etc/reader.txt 37938 40425 390 37938 40425 390 number of items: 3 sum of words: 26,755 average size in words: 13,377 average readability score: 96 nouns: ping; poetry; day; flowers; life; tseh; night; head; mother; baby; poems; poem; wife; moon; years; time; river; tree; girl; trees; man; wine; water; poets; home; flower; face; boy; sun; mountain; men; love; light; side; hair; beauty; work; name; house; earth; dog; tones; hours; cake; tone; mind; line; land; dew; days verbs: is; are; was; be; has; have; see; do; were; come; ''s; had; eat; go; been; take; found; said; give; came; buy; ping; make; made; ''ve; put; meet; hear; coming; want; pass; left; find; did; comes; run; get; fly; fell; bought; written; went; used; say; regarded; gone; am; took; think; sleep adjectives: little; chinese; old; many; great; other; such; ancient; poetical; big; few; more; white; red; new; fair; bright; sweet; first; own; long; last; high; true; good; early; literary; happy; full; fragrant; famous; dear; modern; deep; brief; weary; small; second; green; distant; wild; several; official; gentle; dead; clear; young; vast; unknown; silent adverbs: not; now; then; so; up; far; away; very; only; out; there; here; too; more; still; n''t; as; forth; never; long; on; just; once; down; ever; even; again; most; back; soon; around; yet; well; above; over; in; however; always; alone; off; much; indeed; earlier; also; all; thus; quickly; probably; oft; first pronouns: i; he; my; you; his; her; it; we; they; their; she; your; our; me; its; him; them; us; himself; herself; thee; themselves; one; ay; yourself; ourselves; ours; myself; itself; i''m proper nouns: _; dynasty; tseh; han; emperor; ts; chang; a.d.; ping; li; t''ang; p.; lan; fu; wu; king; song; si; shi; muh; tze; river; tu; chinese; chao; spring; ling; su; old; life; wei; wang; mountains; china; b.c.; t''sin; heaven; chiün; c.; wife; peh; chow; autumn; little; lady; kiu; court; yuen; spinning; sheng keywords: tze; tseh; song; shi; ping; old; little; lan; king; han; emperor; dynasty; come; chinese; boy; baby; a.d. one topic; one dimension: ping file(s): titles(s): A Lute of Jade : Selections from the Classical Poets of China three topics; one dimension: ping; little; speak file(s): ./cache/37938.txt, ./cache/40425.txt, titles(s): Chinese Poems | Chinese Mother Goose Rhymes | A Lute of Jade : Selections from the Classical Poets of China five topics; three dimensions: ping tseh dynasty; little ll old; limb hung sixth; limb hung sixth; limb hung sixth file(s): ./cache/37938.txt, ./cache/40425.txt, , , titles(s): Chinese Poems | Chinese Mother Goose Rhymes | A Lute of Jade : Selections from the Classical Poets of China | A Lute of Jade : Selections from the Classical Poets of China | A Lute of Jade : Selections from the Classical Poets of China Type: gutenberg title: subject-chinesePoetry-gutenberg date: 2021-06-03 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Chinese poetry" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 390 author: Cranmer-Byng, L. (Launcelot) title: A Lute of Jade : Selections from the Classical Poets of China date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 37938 author: nan title: Chinese Poems date: words: 19858.0 sentences: 1609.0 pages: flesch: 90.0 cache: ./cache/37938.txt txt: ./txt/37938.txt summary: little excursion into the field of Chinese poetry, for the thoughts and ''The River by Night in Spring,'' ''Reflections on the Brevity of Life,'' work and passed away during nearly three thousand years, they know but Han Dynasty or earlier, and they are regarded as poetical compositions rules which have guided Chinese poets in writing poetry since the T''ang this day; and during the most flourishing years of the T''ang Dynasty the read the poems of the T''ang period and neglect those of ancient times; dynasties did not always follow the new poetical technique of the T''ang Form of 5-character Lüh poem beginning in the Ping tone: each line in terms of ping and tseh forms the rhythm of Chinese poetry. the poets of the T''ang Dynasty; but in ancient poetry, words both in his old age he was allowed to return, and he ended his days peacefully the work of ancient Chinese poets. id: 40425 author: nan title: Chinese Mother Goose Rhymes date: words: 6897.0 sentences: 796.0 pages: flesch: 103.0 cache: ./cache/40425.txt txt: ./txt/40425.txt summary: "Sweeter than Sugar," "Sweet Pill," "Little Fat Boy," and "Baby is Fenn, of Peking, to her old nurse repeating these rhymes to her little And you shall come and eat with me, You dear little baby, A LITTLE GIRL''S WANTS What a fine little fellow is this fat boy of mine! Little baby, go to bed, Our little bean-cake we will fry. Like a little withered flower, The faithful old watch-dog looks after the house, When asked by his mother to buy her some cake, There were two little sisters went walking one day, A wee little flower-pot, very deep green, And a baby comes to our home at night; Come, buy my flowers, Old Mr. blind man, come here quick, The little dog''s run away, I am my brother''s dear little sister; The old man comes out This little cow eats grass, This little cow eats hay, This little cow runs away, ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel