mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-vermont-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/14957.txt inflating: ./tmp/input/input-file/15562.txt inflating: ./tmp/input/input-file/26723.txt inflating: ./tmp/input/input-file/5347.txt inflating: ./tmp/input/input-file/11681.txt inflating: ./tmp/input/input-file/13091.txt inflating: ./tmp/input/input-file/35573.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-vermont-gutenberg FILE: cache/15562.txt OUTPUT: txt/15562.txt FILE: cache/5347.txt OUTPUT: txt/5347.txt FILE: cache/14957.txt OUTPUT: txt/14957.txt FILE: cache/13091.txt OUTPUT: txt/13091.txt FILE: cache/11681.txt OUTPUT: txt/11681.txt FILE: cache/26723.txt OUTPUT: txt/26723.txt FILE: cache/35573.txt OUTPUT: txt/35573.txt === file2bib.sh === id: 11681 author: Abbott, Jacob title: Marco Paul's Voyages and Travels; Vermont date: pages: extension: .txt txt: ./txt/11681.txt cache: ./cache/11681.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'11681.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 11681 txt/../wrd/11681.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 11681 txt/../ent/11681.ent 11681 txt/../pos/11681.pos 26723 txt/../pos/26723.pos 15562 txt/../wrd/15562.wrd 26723 txt/../wrd/26723.wrd 5347 txt/../pos/5347.pos 15562 txt/../pos/15562.pos 5347 txt/../wrd/5347.wrd 26723 txt/../ent/26723.ent 15562 txt/../ent/15562.ent 5347 txt/../ent/5347.ent 35573 txt/../pos/35573.pos === file2bib.sh === id: 15562 author: Jacobs, Caroline Emilia title: The S. W. F. Club date: pages: extension: .txt txt: ./txt/15562.txt cache: ./cache/15562.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'15562.txt' 35573 txt/../ent/35573.ent === file2bib.sh === id: 26723 author: Curtis, Alice Turner title: A Little Maid of Ticonderoga date: pages: extension: .txt txt: ./txt/26723.txt cache: ./cache/26723.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'26723.txt' 13091 txt/../pos/13091.pos 35573 txt/../wrd/35573.wrd 13091 txt/../wrd/13091.wrd === file2bib.sh === id: 5347 author: Fisher, Dorothy Canfield title: Understood Betsy date: pages: extension: .txt txt: ./txt/5347.txt cache: ./cache/5347.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'5347.txt' 13091 txt/../ent/13091.ent 14957 txt/../wrd/14957.wrd 14957 txt/../pos/14957.pos 14957 txt/../ent/14957.ent === file2bib.sh === id: 35573 author: Robinson, Rowland Evans title: Vermont: A Study of Independence date: pages: extension: .txt txt: ./txt/35573.txt cache: ./cache/35573.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'35573.txt' === file2bib.sh === id: 13091 author: Fisher, Dorothy Canfield title: Hillsboro People date: pages: extension: .txt txt: ./txt/13091.txt cache: ./cache/13091.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'13091.txt' === file2bib.sh === id: 14957 author: Fisher, Dorothy Canfield title: The Brimming Cup date: pages: extension: .txt txt: ./txt/14957.txt cache: ./cache/14957.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'14957.txt' Done mapping. Reducing subject-vermont-gutenberg === reduce.pl bib === id = 5347 author = Fisher, Dorothy Canfield title = Understood Betsy date = pages = extension = .txt mime = text/plain words = 48676 sentences = 3417 flesch = 93 summary = small and thin and middle-aged, Aunt Frances (for Elizabeth Ann called devote herself entirely to taking care of Elizabeth Ann. So one day, after this had happened several times, Aunt Frances really but not Elizabeth Ann, for Aunt Frances would need to give all her time imperative old voice called upon Cousin Molly and Elizabeth Ann to stop Elizabeth Ann looked up now at Aunt Abigail and said, "What is its name, Aunt Abigail said, "Well, well!" and moving over in bed took the little "Oh," said Cousin Ann, opening her black eyes a little. Cousin Ann. Aunt Abigail, who had just pulled herself up the stairs, panting, said, girl lay in bed looking at Aunt Abigail's old face, she should feel so "Why," said Aunt Abigail, as if remembering that Betsy had asked her a "Now, Henry," said Aunt Abigail, "do stop going on about old times long cache = ./cache/5347.txt txt = ./txt/5347.txt === reduce.pl bib === id = 14957 author = Fisher, Dorothy Canfield title = The Brimming Cup date = pages = extension = .txt mime = text/plain words = 135152 sentences = 10001 flesch = 90 summary = The girl's answering laugh, like the inward look of her eyes, showed Marise stood for a long time looking after the children. There was no doubt about how Vincent looked, as though he thought Mr. Welles, exulting over a blow with a mattock, an old imbecile in his Elly as usual said nothing, looking up into Mother's face. "Would you like to go quite close and look at it, children?" Marise To Marise he looked so sweet and good, and like a tired old child, that Old Mrs. Powers said at his elbow, "The first sets are forming, Mr. Marsh." She called across to Frank Warner, standing very straight with "Mother," said Elly, coming up close to Marise, as she stood unpacking years with a real, living woman like Marise, didn't know whether to "I know," said Paul, "I've done it lots of times." He went on, "Mother, cache = ./cache/14957.txt txt = ./txt/14957.txt === reduce.pl bib === id = 15562 author = Jacobs, Caroline Emilia title = The S. W. F. Club date = pages = extension = .txt mime = text/plain words = 39701 sentences = 3361 flesch = 91 summary = "What is it, Hilary?" Pauline asked, coming to sit at one end of the "You know perfectly well, Pauline Almy Shaw!" Patience proclaimed, "There's Josie," Hilary said, and her sister drew rein, as a girl came "Isn't she the dearest thing!" Pauline declared, as she and Hilary went "If you're not contented here, Hilary Shaw!" Pauline said, standing in had done Hilary good; the thought of the long simple days to come, were "Well, I like that!" Patience said, coming across the lawn. "What do you think, mother?" Pauline asked, as Mrs. Shaw finished "There won't be time, Patience," Pauline said. Just before Pauline and Patience went home that evening, Mrs. Boyd "I'll go tell Hilary!" Pauline said. "Never mind, Patience," Pauline said, "we haven't answered Tom yet. "Tell mother to come," Hilary said. Patience came flying down the garden path to where Pauline and Hilary cache = ./cache/15562.txt txt = ./txt/15562.txt === reduce.pl bib === === reduce.pl bib === id = 13091 author = Fisher, Dorothy Canfield title = Hillsboro People date = pages = extension = .txt mime = text/plain words = 98889 sentences = 6033 flesch = 86 summary = runs past the house starts a new story, every old man whom we leave great-grandfather, who came to live with us when I was a little boy." said: 'I tell ye, Joey, I've lived a long time, and I've larned a lot The old woman sat up straighter and looked the world in the face. "I tell you it looked like----" she said, and paused, The old woman turned very pale and for the first time looked again at the Ev'leen Ann looked at me, her face suddenly old and gray. They found him in a little old house of logs--the only one that looked The young man said nothing until after the old people had gone out to hesitation, she turned to her husband and said in a tone more like her old To the haggard old eyes the face of the world was like a The old man looked at it, cache = ./cache/13091.txt txt = ./txt/13091.txt === reduce.pl bib === id = 35573 author = Robinson, Rowland Evans title = Vermont: A Study of Independence date = pages = extension = .txt mime = text/plain words = 92058 sentences = 3656 flesch = 64 summary = regiment of New Hampshire men commanded by Colonel Goffe opened the road commanded by John Warner,[42] was on New Year's Day "received and committee of the General Assembly of New York resolved that the governor force, after meeting and capturing two small boats on their way to St. John's with the alarming news of the surrender, arrived at Crown Point Inhabitants of Vermont to the Government of New York, and their right to Vermont, at the same time proposing that New York should unite with that Vermont had a powerful interest in the New England States, and with Vermont does not wish to enter into a war with the State of New York, When Vermont had taken her place in the Union, her state government A handsome new state house of Vermont granite was built in 1835 on feeling of the New England States, in all of which, except Vermont, the cache = ./cache/35573.txt txt = ./txt/35573.txt === reduce.pl bib === id = 26723 author = Curtis, Alice Turner title = A Little Maid of Ticonderoga date = pages = extension = .txt mime = text/plain words = 40126 sentences = 2791 flesch = 91 summary = Faith Carew was ten years old when Esther Eldridge came to visit her. "I wish I could go to Ticonderoga and visit Aunt Prissy," said Faith. In a moment the little girl looked up toward the open door and Faith "She is an only child, like your own little maid," he said to Mrs. Carew, "and I am glad they are to be friends." little girls did not notice that, just as Esther began speaking, Mrs. Carew had opened the sitting-room door. "My father made this little table," said Faith, helping Esther to a Mrs. Carew had told the little girls of the plan for Faith to go to "I hope she will come before I go to Aunt Prissy's," said Faith. "Put your hand on his head, Faith," said Aunt Prissy, "and I'll tell Faith told her aunt what the shoemaker had said about his little girl, cache = ./cache/26723.txt txt = ./txt/26723.txt Building ./etc/reader.txt 14957 13091 35573 5347 35573 15562 number of items: 7 sum of words: 454,602 average size in words: 75,767 average readability score: 85 nouns: time; eyes; life; way; house; mother; people; day; man; face; children; men; head; something; room; hand; girl; door; faith; years; father; things; anything; place; nothing; moment; voice; thing; child; woman; night; world; home; part; school; patience; side; morning; one; heart; days; girls; bed; hands; course; mind; name; work; fire; town verbs: was; had; were; be; said; do; have; is; ''s; did; been; know; see; are; came; come; go; made; looked; went; get; thought; make; asked; think; going; take; tell; felt; say; ''ve; got; put; looking; look; told; has; took; turned; stood; knew; seemed; began; ''m; heard; being; ''re; saw; let; called adjectives: little; old; other; good; great; own; more; first; long; big; new; such; young; many; last; white; same; much; next; sure; right; few; small; ready; full; strong; only; best; blue; fine; dark; afraid; black; open; dear; human; real; quiet; better; high; most; hot; tired; poor; nice; cold; red; hard; whole; sick adverbs: not; n''t; so; up; now; out; down; back; then; very; there; just; never; as; only; here; all; again; away; too; always; on; ever; off; more; still; in; even; over; well; much; once; really; almost; quite; soon; right; yet; most; long; far; perhaps; enough; else; before; elly; at; home; together; first pronouns: she; her; it; he; i; you; his; they; him; their; them; we; me; your; my; its; herself; us; our; himself; themselves; myself; yourself; itself; ''em; one; hers; ''s; yours; mine; ourselves; ye; theirs; ours; em; ha; gran''ther; i''m; you''re; yerself; oneself; yourselves; you''ll; ye''r; wigwam; tom--; together--; thyself; thy; there--_here proper nouns: _; mr.; aunt; marise; ann; new; vermont; mrs.; betsy; faith; paul; pauline; hilary; neale; cousin; york; elizabeth; allen; welles; esther; uncle; louise; state; abigail; molly; congress; vincent; frances; general; eugenia; prissy; henry; hetty; colonel; miss; ticonderoga; mother; marsh; carew; crittenden; hampshire; shaw; father; mountain; warner; shirley; hillsboro; hannah; green; canada keywords: mrs.; mr.; aunt; uncle; new; cousin; old; molly; look; little; like; good; ann; abigail; york; welles; warner; vincent; vermont; united; tryphena; tom; tim; ticonderoga; state; st.; shirley; shep; shaw; purdon; prissy; powers; point; pauline; paul; patience; niram; neale; nathaniel; mountain; mother; moira; miss; mehetabel; mary; marsh; mark; marise; louise; lord one topic; one dimension: said file(s): ./cache/15562.txt titles(s): The S. W. F. Club three topics; one dimension: said; new; faith file(s): ./cache/14957.txt, ./cache/35573.txt, ./cache/26723.txt titles(s): The Brimming Cup | Vermont: A Study of Independence | A Little Maid of Ticonderoga five topics; three dimensions: old said like; new vermont men; said ann little; faith little said; army summons listless file(s): ./cache/14957.txt, ./cache/35573.txt, ./cache/5347.txt, ./cache/26723.txt, titles(s): The Brimming Cup | Vermont: A Study of Independence | Understood Betsy | A Little Maid of Ticonderoga | Marco Paul's Voyages and Travels; Vermont Type: gutenberg title: subject-vermont-gutenberg date: 2021-06-10 time: 16:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Vermont" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 11681 author: Abbott, Jacob title: Marco Paul's Voyages and Travels; Vermont date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 26723 author: Curtis, Alice Turner title: A Little Maid of Ticonderoga date: words: 40126.0 sentences: 2791.0 pages: flesch: 91.0 cache: ./cache/26723.txt txt: ./txt/26723.txt summary: Faith Carew was ten years old when Esther Eldridge came to visit her. "I wish I could go to Ticonderoga and visit Aunt Prissy," said Faith. In a moment the little girl looked up toward the open door and Faith "She is an only child, like your own little maid," he said to Mrs. Carew, "and I am glad they are to be friends." little girls did not notice that, just as Esther began speaking, Mrs. Carew had opened the sitting-room door. "My father made this little table," said Faith, helping Esther to a Mrs. Carew had told the little girls of the plan for Faith to go to "I hope she will come before I go to Aunt Prissy''s," said Faith. "Put your hand on his head, Faith," said Aunt Prissy, "and I''ll tell Faith told her aunt what the shoemaker had said about his little girl, id: 14957 author: Fisher, Dorothy Canfield title: The Brimming Cup date: words: 135152.0 sentences: 10001.0 pages: flesch: 90.0 cache: ./cache/14957.txt txt: ./txt/14957.txt summary: The girl''s answering laugh, like the inward look of her eyes, showed Marise stood for a long time looking after the children. There was no doubt about how Vincent looked, as though he thought Mr. Welles, exulting over a blow with a mattock, an old imbecile in his Elly as usual said nothing, looking up into Mother''s face. "Would you like to go quite close and look at it, children?" Marise To Marise he looked so sweet and good, and like a tired old child, that Old Mrs. Powers said at his elbow, "The first sets are forming, Mr. Marsh." She called across to Frank Warner, standing very straight with "Mother," said Elly, coming up close to Marise, as she stood unpacking years with a real, living woman like Marise, didn''t know whether to "I know," said Paul, "I''ve done it lots of times." He went on, "Mother, id: 5347 author: Fisher, Dorothy Canfield title: Understood Betsy date: words: 48676.0 sentences: 3417.0 pages: flesch: 93.0 cache: ./cache/5347.txt txt: ./txt/5347.txt summary: small and thin and middle-aged, Aunt Frances (for Elizabeth Ann called devote herself entirely to taking care of Elizabeth Ann. So one day, after this had happened several times, Aunt Frances really but not Elizabeth Ann, for Aunt Frances would need to give all her time imperative old voice called upon Cousin Molly and Elizabeth Ann to stop Elizabeth Ann looked up now at Aunt Abigail and said, "What is its name, Aunt Abigail said, "Well, well!" and moving over in bed took the little "Oh," said Cousin Ann, opening her black eyes a little. Cousin Ann. Aunt Abigail, who had just pulled herself up the stairs, panting, said, girl lay in bed looking at Aunt Abigail''s old face, she should feel so "Why," said Aunt Abigail, as if remembering that Betsy had asked her a "Now, Henry," said Aunt Abigail, "do stop going on about old times long id: 13091 author: Fisher, Dorothy Canfield title: Hillsboro People date: words: 98889.0 sentences: 6033.0 pages: flesch: 86.0 cache: ./cache/13091.txt txt: ./txt/13091.txt summary: runs past the house starts a new story, every old man whom we leave great-grandfather, who came to live with us when I was a little boy." said: ''I tell ye, Joey, I''ve lived a long time, and I''ve larned a lot The old woman sat up straighter and looked the world in the face. "I tell you it looked like----" she said, and paused, The old woman turned very pale and for the first time looked again at the Ev''leen Ann looked at me, her face suddenly old and gray. They found him in a little old house of logs--the only one that looked The young man said nothing until after the old people had gone out to hesitation, she turned to her husband and said in a tone more like her old To the haggard old eyes the face of the world was like a The old man looked at it, id: 15562 author: Jacobs, Caroline Emilia title: The S. W. F. Club date: words: 39701.0 sentences: 3361.0 pages: flesch: 91.0 cache: ./cache/15562.txt txt: ./txt/15562.txt summary: "What is it, Hilary?" Pauline asked, coming to sit at one end of the "You know perfectly well, Pauline Almy Shaw!" Patience proclaimed, "There''s Josie," Hilary said, and her sister drew rein, as a girl came "Isn''t she the dearest thing!" Pauline declared, as she and Hilary went "If you''re not contented here, Hilary Shaw!" Pauline said, standing in had done Hilary good; the thought of the long simple days to come, were "Well, I like that!" Patience said, coming across the lawn. "What do you think, mother?" Pauline asked, as Mrs. Shaw finished "There won''t be time, Patience," Pauline said. Just before Pauline and Patience went home that evening, Mrs. Boyd "I''ll go tell Hilary!" Pauline said. "Never mind, Patience," Pauline said, "we haven''t answered Tom yet. "Tell mother to come," Hilary said. Patience came flying down the garden path to where Pauline and Hilary id: 35573 author: Robinson, Rowland Evans title: Vermont: A Study of Independence date: words: 92058.0 sentences: 3656.0 pages: flesch: 64.0 cache: ./cache/35573.txt txt: ./txt/35573.txt summary: regiment of New Hampshire men commanded by Colonel Goffe opened the road commanded by John Warner,[42] was on New Year''s Day "received and committee of the General Assembly of New York resolved that the governor force, after meeting and capturing two small boats on their way to St. John''s with the alarming news of the surrender, arrived at Crown Point Inhabitants of Vermont to the Government of New York, and their right to Vermont, at the same time proposing that New York should unite with that Vermont had a powerful interest in the New England States, and with Vermont does not wish to enter into a war with the State of New York, When Vermont had taken her place in the Union, her state government A handsome new state house of Vermont granite was built in 1835 on feeling of the New England States, in all of which, except Vermont, the ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel