mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-wildFlowers-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/3003.txt inflating: ./tmp/input/input-file/8866.txt inflating: ./tmp/input/input-file/13347.txt inflating: ./tmp/input/input-file/42696.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-wildFlowers-gutenberg FILE: cache/13347.txt OUTPUT: txt/13347.txt FILE: cache/3003.txt OUTPUT: txt/3003.txt FILE: cache/8866.txt OUTPUT: txt/8866.txt FILE: cache/42696.txt OUTPUT: txt/42696.txt === file2bib.sh === id: 3003 author: Blanchan, Neltje title: Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors date: pages: extension: .txt txt: ./txt/3003.txt cache: ./cache/3003.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'3003.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 8866 author: Blanchan, Neltje title: Wild Flowers Worth Knowing date: pages: extension: .txt txt: ./txt/8866.txt cache: ./cache/8866.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'8866.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 8866 txt/../ent/8866.ent 8866 txt/../pos/8866.pos 3003 txt/../pos/3003.pos 3003 txt/../wrd/3003.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 8866 txt/../wrd/8866.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 3003 txt/../ent/3003.ent 13347 txt/../pos/13347.pos 13347 txt/../wrd/13347.wrd 13347 txt/../ent/13347.ent === file2bib.sh === id: 13347 author: Cooke, Arthur O. (Arthur Owens) title: Wildflowers of the Farm date: pages: extension: .txt txt: ./txt/13347.txt cache: ./cache/13347.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'13347.txt' 42696 txt/../pos/42696.pos 42696 txt/../wrd/42696.wrd 42696 txt/../ent/42696.ent === file2bib.sh === id: 42696 author: Furneaux, William S. title: Field and Woodland Plants date: pages: extension: .txt txt: ./txt/42696.txt cache: ./cache/42696.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'42696.txt' Done mapping. Reducing subject-wildFlowers-gutenberg === reduce.pl bib === id = 13347 author = Cooke, Arthur O. (Arthur Owens) title = Wildflowers of the Farm date = pages = extension = .txt mime = text/plain words = 14340 sentences = 919 flesch = 91 summary = farmer's fields, we shall see many pretty flowers which he calls weeds. comparatively small plants in which the flower or blossom is easily leaves make earth or "soil." Wallflowers and other plants which grow on under side of the flower stem; the Red Valerian, like the Violet, is a The stems with the flowers and leaves hang down below the root; it On the barren stems the leaves grow so closely that they quite cover the The small greenish-yellow flowers of the Stinging Nettle grow in long The leaves of the White Clover grow, like the flower, at the top of the The leaves of the Crimson Clover grow on the flower difference is that the blossoms of the Primrose grow on _long_ stems flowers are a little like those of the Red Clover; each blossom has many There are leaves as well as flowers on the stem. On the flower stems grow very small narrow leaves; cache = ./cache/13347.txt txt = ./txt/13347.txt === reduce.pl bib === === reduce.pl bib === id = 42696 author = Furneaux, William S. title = Field and Woodland Plants date = pages = extension = .txt mime = text/plain words = 110399 sentences = 8098 flesch = 82 summary = CORNACEÃ�.--Herbs and shrubs with opposite leaves, small flowers, and DIPSACEÃ�.--Herbs with opposite leaves; and heads of small flowers, BETULACEÃ�.--Trees or shrubs with alternate leaves and small flowers. TYPHACEÃ�.--Erect marsh plants, with long, narrow leaves; and small leaves; and a flowering stem from six to twelve inches high. stipuled, lobed leaves; the axillary flowers; and the fruit composed of The plant is common in fields, and flowers during May and June. plant, with a spreading, four-angled stem, and narrow-ovate leaves that an erect, hairy plant, from one to two feet high, with yellow flowers, plant, with stem from six to eighteen inches long; and digitate leaves stem; downy, stalked leaves; and pale yellow, scentless flowers that trifoliate leaves; and small, white or yellow flowers in long racemes on branched stem from two to four feet high; and long-stalked leaves with plants, with much-divided leaves and compound umbels of white flowers, cache = ./cache/42696.txt txt = ./txt/42696.txt === reduce.pl bib === Building ./etc/reader.txt 42696 13347 8866 42696 13347 8866 number of items: 4 sum of words: 124,739 average size in words: 62,369 average readability score: 86 nouns: flowers; leaves; plant; stem; flower; species; illustration; ft; plants; petals; ins; feet; order; inches; erect; fruit; calyx; stamens; sepals; colour; stems; corolla; inch; base; lobes; heads; hairs; parts; bracts; height; stalks; leaf; ones; seeds; number; fruits; branches; summer; segments; ground; length; spring; places; roots; carpels; trees; stalk; foot; tube; time verbs: are; is; have; be; has; flowering; arranged; grow; spreading; grows; seen; stalked; divided; found; see; do; shaped; leaved; been; being; covered; form; growing; find; distinguished; branched; known; consists; appear; note; attached; forming; produce; cut; creeping; surrounded; stems; bloom; called; become; formed; described; does; bearing; give; cultivated; having; flowers; said; meet adjectives: small; common; long; narrow; other; high; white; same; little; large; many; yellow; short; upper; smooth; few; toothed; green; lower; more; several; terminal; similar; hairy; ovary; purple; pale; abundant; numerous; last; simple; opposite; dry; thick; smaller; dense; oblong; general; broad; most; downy; entire; like; first; blue; latter; globular; conspicuous; sessile; red adverbs: very; not; often; more; usually; so; only; also; sometimes; about; much; long; generally; less; as; almost; now; rather; slightly; deeply; thus; well; nearly; however; even; up; then; quite; here; easily; especially; always; first; too; out; closely; down; all; most; frequently; still; soon; above; commonly; together; off; somewhat; just; close; shortly pronouns: it; its; we; they; their; our; them; you; i; themselves; he; itself; us; his; me; your; him; my; himself; she; ourselves; her; one; myself; ours proper nouns: _; .; june; july; august; w.; �; y.; ¦; common; september; may; grass; p.; pu; marsh; england; wild; family; april; red; white; yellow; britain; nettle; c.; clover; stamens; meadow; plate; g.; great; south; orchis; leafy; thistle; field; flower; water; heads; willow; wood; bl; poppy; lesser; heath; rose; sweet; tree; crane''s keywords: illustration; flower; yellow; wild; september; red; plate; plant; marsh; leave; june; july; heads; hammond; grass; family; england; common; clover; britain; august; april one topic; one dimension: flowers file(s): titles(s): Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors three topics; one dimension: flowers; flowers; kept file(s): ./cache/42696.txt, ./cache/13347.txt, titles(s): Field and Woodland Plants | Wildflowers of the Farm | Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors five topics; three dimensions: flowers leaves plant; market drives connect; market drives connect; market drives connect; market drives connect file(s): ./cache/42696.txt, , , , titles(s): Field and Woodland Plants | Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors | Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors | Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors | Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors Type: gutenberg title: subject-wildFlowers-gutenberg date: 2021-06-10 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Wild flowers" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 3003 author: Blanchan, Neltje title: Wild Flowers An Aid to Knowledge of Our Wild Flowers and Their Insect Visitors date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 8866 author: Blanchan, Neltje title: Wild Flowers Worth Knowing date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 13347 author: Cooke, Arthur O. (Arthur Owens) title: Wildflowers of the Farm date: words: 14340.0 sentences: 919.0 pages: flesch: 91.0 cache: ./cache/13347.txt txt: ./txt/13347.txt summary: farmer''s fields, we shall see many pretty flowers which he calls weeds. comparatively small plants in which the flower or blossom is easily leaves make earth or "soil." Wallflowers and other plants which grow on under side of the flower stem; the Red Valerian, like the Violet, is a The stems with the flowers and leaves hang down below the root; it On the barren stems the leaves grow so closely that they quite cover the The small greenish-yellow flowers of the Stinging Nettle grow in long The leaves of the White Clover grow, like the flower, at the top of the The leaves of the Crimson Clover grow on the flower difference is that the blossoms of the Primrose grow on _long_ stems flowers are a little like those of the Red Clover; each blossom has many There are leaves as well as flowers on the stem. On the flower stems grow very small narrow leaves; id: 42696 author: Furneaux, William S. title: Field and Woodland Plants date: words: 110399.0 sentences: 8098.0 pages: flesch: 82.0 cache: ./cache/42696.txt txt: ./txt/42696.txt summary: CORNACEÃ�.--Herbs and shrubs with opposite leaves, small flowers, and DIPSACEÃ�.--Herbs with opposite leaves; and heads of small flowers, BETULACEÃ�.--Trees or shrubs with alternate leaves and small flowers. TYPHACEÃ�.--Erect marsh plants, with long, narrow leaves; and small leaves; and a flowering stem from six to twelve inches high. stipuled, lobed leaves; the axillary flowers; and the fruit composed of The plant is common in fields, and flowers during May and June. plant, with a spreading, four-angled stem, and narrow-ovate leaves that an erect, hairy plant, from one to two feet high, with yellow flowers, plant, with stem from six to eighteen inches long; and digitate leaves stem; downy, stalked leaves; and pale yellow, scentless flowers that trifoliate leaves; and small, white or yellow flowers in long racemes on branched stem from two to four feet high; and long-stalked leaves with plants, with much-divided leaves and compound umbels of white flowers, ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel