mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-nieces-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/25446.txt inflating: ./tmp/input/input-file/3166.txt inflating: ./tmp/input/input-file/8877.txt inflating: ./tmp/input/input-file/36880.txt inflating: ./tmp/input/input-file/38197.txt inflating: ./tmp/input/input-file/43773.txt inflating: ./tmp/input/input-file/41831.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-nieces-gutenberg FILE: cache/25446.txt OUTPUT: txt/25446.txt FILE: cache/8877.txt OUTPUT: txt/8877.txt FILE: cache/36880.txt OUTPUT: txt/36880.txt FILE: cache/41831.txt OUTPUT: txt/41831.txt FILE: cache/43773.txt OUTPUT: txt/43773.txt FILE: cache/38197.txt OUTPUT: txt/38197.txt FILE: cache/3166.txt OUTPUT: txt/3166.txt === file2bib.sh === id: 25446 author: Richards, Laura Elizabeth Howe title: Fernley House date: pages: extension: .txt txt: ./txt/25446.txt cache: ./cache/25446.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'25446.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 8877 author: Richards, Laura Elizabeth Howe title: Geoffrey Strong date: pages: extension: .txt txt: ./txt/8877.txt cache: ./cache/8877.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'8877.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 8877 txt/../ent/8877.ent 25446 txt/../ent/25446.ent 8877 txt/../pos/8877.pos 25446 txt/../wrd/25446.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 25446 txt/../pos/25446.pos 8877 txt/../wrd/8877.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 41831 txt/../pos/41831.pos 41831 txt/../wrd/41831.wrd 41831 txt/../ent/41831.ent === file2bib.sh === id: 41831 author: Jewett, Sarah Orne title: Betty Leicester's Christmas date: pages: extension: .txt txt: ./txt/41831.txt cache: ./cache/41831.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'41831.txt' 36880 txt/../pos/36880.pos 36880 txt/../wrd/36880.wrd 36880 txt/../ent/36880.ent === file2bib.sh === id: 36880 author: Hampden, Mary title: Niece Catherine date: pages: extension: .txt txt: ./txt/36880.txt cache: ./cache/36880.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'36880.txt' 43773 txt/../wrd/43773.wrd 43773 txt/../pos/43773.pos 38197 txt/../pos/38197.pos 38197 txt/../wrd/38197.wrd 43773 txt/../ent/43773.ent 38197 txt/../ent/38197.ent === file2bib.sh === id: 43773 author: Bassett, Sara Ware title: Shifting Sands date: pages: extension: .txt txt: ./txt/43773.txt cache: ./cache/43773.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'43773.txt' 3166 txt/../pos/3166.pos 3166 txt/../wrd/3166.wrd 3166 txt/../ent/3166.ent === file2bib.sh === id: 38197 author: Robertson, Margaret M. (Margaret Murray) title: The Twa Miss Dawsons date: pages: extension: .txt txt: ./txt/38197.txt cache: ./cache/38197.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'38197.txt' === file2bib.sh === id: 3166 author: Trollope, Anthony title: Doctor Thorne date: pages: extension: .txt txt: ./txt/3166.txt cache: ./cache/3166.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 11 resourceName b'3166.txt' Done mapping. Reducing subject-nieces-gutenberg === reduce.pl bib === === reduce.pl bib === id = 41831 author = Jewett, Sarah Orne title = Betty Leicester's Christmas date = pages = extension = .txt mime = text/plain words = 11920 sentences = 643 flesch = 87 summary = But Lady Mary would be busy enough with her great house-party of said Lady Mary wistfully, as they began to go up the great steps and good-night, darling," said this dear lady, whom Betty had always longed The minute Betty Leicester looked at Edith Banfield next day she saw a great friend of his; then she looked for Lady Mary, who was at the dear friend Betty, who knows what American girls like best, is kindly A maid appeared to take Edith to her room, and Lady Mary patted Betty's "So does papa," said Betty; "oh, so very much!--next to Lady Mary and "Why, of course," said Betty, with great pleasure. "Why, Warford, my dear!" said Lady Mary, with great delight, as he met Edith looked on with pleasure, and presently Lady Mary came toward them. for the ladies to go to the drawing-room, and Betty, feeling a little cache = ./cache/41831.txt txt = ./txt/41831.txt === reduce.pl bib === id = 3166 author = Trollope, Anthony title = Doctor Thorne date = pages = extension = .txt mime = text/plain words = 221834 sentences = 13678 flesch = 86 summary = "I know he used," said Lady de Courcy, looking very wise, and rather "His father, you know, died when he was very young," said Frank. "Come in, Mary," said Beatrice, "you know my cousin Alexandrina." "You know I never interfere," said the Lady Arabella; "I never liked "Much better, I would think," said the Lady Arabella; "but you know, "It is a great deal of money, certainly," said Lady Arabella. "Yes," said Mary, "I know he is rich; and a rich man I suppose can "Now, doctor, don't let him talk that way, don't," said Lady about the money, you know, doctor," said she; "of course Sir Roger "Shall I go now," said the doctor, "and send Lady Scatcherd to you?" "As I said before, Frank is, to my thinking, an excellent young man. "I am engaged to Frank Gresham," and having so said, Mary looked her cache = ./cache/3166.txt txt = ./txt/3166.txt === reduce.pl bib === id = 36880 author = Hampden, Mary title = Niece Catherine date = pages = extension = .txt mime = text/plain words = 35390 sentences = 2380 flesch = 85 summary = 'Kiss the tiny fellow "good-night" for me, dear,' said Mrs. Arderne, the manner of his brother (Catherine's Uncle Jack), and this surprising Mrs. Arderne made Catherine give a full account of her visit to Uncle but oh, Uncle Jack, dear, until you offered me a home I had not realized Agatha's dark eyes gazed wonderingly at Catherine's sweet, smiling face. that he was glad Catherine possessed so true-hearted a friend, and Mrs. Arderne came to the conclusion that Brian was a man of delightful 'I want to come "home" to stay, dear uncle. 'God will answer our prayers, Uncle Jack, dear. During the following days Uncle Jack and Mrs. Arderne, Agatha, and the all but Agatha and Catherine, who could not help loving Ted best, though Catherine could not have much doubt--if Uncle Ross would but ask for 'My dear, Catherine has promised not to desert us,' said Uncle Ross with cache = ./cache/36880.txt txt = ./txt/36880.txt === reduce.pl bib === === reduce.pl bib === id = 38197 author = Robertson, Margaret M. (Margaret Murray) title = The Twa Miss Dawsons date = pages = extension = .txt mime = text/plain words = 108939 sentences = 6991 flesch = 92 summary = "Here are the bairns," said Miss Jean softly as the two sisters came like a bird, and to ken her from our May, and Marion Petrie," said Jean, spared on an occasion like yesterday, I would think," said Miss Jean. "It has made an old man of your father," added Miss Jean in a little. "Jean," said her sister after a long silence, "do you think he would do his," said Jean, with a sound that was like a sob, her father thought. come to visit her there," Marion said, including both George and Jean in He grew more like his old self, his father said to Miss Jean, giving the Dawson was coming with you," said Marion with a little change of face "And Jean thinks there are few like George," said Marion smiling, as time on board," said Mr Dawson, as he took his way to Miss Jean's house cache = ./cache/38197.txt txt = ./txt/38197.txt === reduce.pl bib === id = 43773 author = Bassett, Sara Ware title = Shifting Sands date = pages = extension = .txt mime = text/plain words = 60911 sentences = 6334 flesch = 93 summary = After days of fog Stanley Heath, a stranger whose power-boat runs "I shall not tell you one thing," Marcia replied. Why, within the week Sylvia's been here, I happen to know Marcia's Fortunately both Marcia and Sylvia were at the moment too far out of Sylvia stole a look at Marcia who had stiffened and now stood with eyes The moment the door banged behind them, Sylvia turned toward Marcia. Sylvia, meanwhile, had heard Stanley Heath call Marcia and hailed her Yes, Marcia and Stanley Heath were talking. The small, grey-haired man looked from Stanley Heath to Marcia, and for dear Marcia." Impulsively Sylvia bent her lips to the hands so tightly "Sylvia, come back here!" Marcia cried. Heath went to Sylvia and took her hand. Marcia and the--the--she and Mr. Heath love one "Sit down, Sylvia, and let us talk of Marcia," ventured Heath after a cache = ./cache/43773.txt txt = ./txt/43773.txt Building ./etc/reader.txt Error: near line 1: database is locked Send options without primary recipient specified. Usage: mailx -eiIUdEFntBDNHRVv~ -T FILE -u USER -h hops -r address -s SUBJECT -a FILE -q FILE -f FILE -A ACCOUNT -b USERS -c USERS -S OPTION users 3166 38197 43773 3166 38197 8877 number of items: 7 sum of words: 438,994 average size in words: 87,798 average readability score: 88 nouns: man; doctor; time; father; way; day; house; nothing; mother; heart; hand; squire; life; face; one; room; things; eyes; son; money; something; love; sister; word; world; thing; friend; moment; days; girl; brother; mind; words; matter; place; course; men; years; woman; people; home; night; hands; morning; door; aunt; uncle; head; anything; wife verbs: was; had; be; have; is; said; do; been; were; did; are; say; come; ''s; know; think; go; has; see; made; came; am; make; tell; went; thought; take; let; give; told; done; put; knew; ''m; going; found; get; looked; heard; left; got; being; took; look; saw; coming; wish; like; mean; does adjectives: own; little; good; other; young; more; such; great; much; old; last; first; sure; many; poor; long; dear; best; same; better; happy; few; new; least; true; right; possible; able; glad; strong; anxious; necessary; different; ready; angry; usual; high; next; full; fine; small; silent; certain; bad; only; present; afraid; whole; sorry; nice adverbs: not; so; n''t; now; then; very; up; never; as; well; out; only; again; too; even; here; more; away; there; just; much; quite; down; still; all; yet; perhaps; also; indeed; always; back; ever; once; on; home; over; enough; however; in; rather; almost; hardly; soon; far; off; long; certainly; together; most; therefore pronouns: he; i; her; it; you; she; his; him; me; my; they; them; your; we; himself; their; herself; us; its; our; myself; yourself; one; themselves; itself; ''em; yours; mine; ye; hers; ourselves; ay; ''s; thee; thy; theirs; em; hisself; ha''e; i''m; ours; o; thyself; thinkin; herself,--; ee; you''se; you''re; wish--; were--`she proper nouns: mr; mary; frank; jean; miss; lady; _; thorne; sir; gresham; dr; greshamsbury; arabella; marcia; dawson; george; scatcherd; mrs; catherine; louis; marion; roger; beatrice; heath; god; courcy; sylvia; calderwood; uncle; may; moffat; ye; oriel; dunstable; elisha; london; mr.; betty; fillgrave; gazebee; augusta; jack; eleazer; john; portie; hill; willie; mrs.; boxall; barchester keywords: miss; mary; lady; zenas; wilton; willie; wal; uncle; thorne; ted; sylvia; stanley; sir; scatcherd; saughleas; ross; roger; portie; petrie; patience; parliament; oriel; new; mrs.; mrs; mr.; moffat; marion; marcia; manners; louis; london; john; jean; jason; jack; howe; hortie; horatio; homestead; hill; henry; heath; harry; greshamsbury; gresham; god; george; gazebee; frank one topic; one dimension: said file(s): titles(s): Fernley House three topics; one dimension: said; jean; marcia file(s): ./cache/3166.txt, ./cache/38197.txt, ./cache/43773.txt titles(s): Doctor Thorne | The Twa Miss Dawsons | Shifting Sands five topics; three dimensions: said frank mary; jean said miss; marcia catherine uncle; betty lady said; reserved painted bonnets file(s): ./cache/3166.txt, ./cache/38197.txt, ./cache/43773.txt, ./cache/41831.txt, titles(s): Doctor Thorne | The Twa Miss Dawsons | Shifting Sands | Betty Leicester''s Christmas | Fernley House Type: gutenberg title: subject-nieces-gutenberg date: 2021-06-07 time: 12:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Nieces" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 43773 author: Bassett, Sara Ware title: Shifting Sands date: words: 60911.0 sentences: 6334.0 pages: flesch: 93.0 cache: ./cache/43773.txt txt: ./txt/43773.txt summary: After days of fog Stanley Heath, a stranger whose power-boat runs "I shall not tell you one thing," Marcia replied. Why, within the week Sylvia''s been here, I happen to know Marcia''s Fortunately both Marcia and Sylvia were at the moment too far out of Sylvia stole a look at Marcia who had stiffened and now stood with eyes The moment the door banged behind them, Sylvia turned toward Marcia. Sylvia, meanwhile, had heard Stanley Heath call Marcia and hailed her Yes, Marcia and Stanley Heath were talking. The small, grey-haired man looked from Stanley Heath to Marcia, and for dear Marcia." Impulsively Sylvia bent her lips to the hands so tightly "Sylvia, come back here!" Marcia cried. Heath went to Sylvia and took her hand. Marcia and the--the--she and Mr. Heath love one "Sit down, Sylvia, and let us talk of Marcia," ventured Heath after a id: 36880 author: Hampden, Mary title: Niece Catherine date: words: 35390.0 sentences: 2380.0 pages: flesch: 85.0 cache: ./cache/36880.txt txt: ./txt/36880.txt summary: ''Kiss the tiny fellow "good-night" for me, dear,'' said Mrs. Arderne, the manner of his brother (Catherine''s Uncle Jack), and this surprising Mrs. Arderne made Catherine give a full account of her visit to Uncle but oh, Uncle Jack, dear, until you offered me a home I had not realized Agatha''s dark eyes gazed wonderingly at Catherine''s sweet, smiling face. that he was glad Catherine possessed so true-hearted a friend, and Mrs. Arderne came to the conclusion that Brian was a man of delightful ''I want to come "home" to stay, dear uncle. ''God will answer our prayers, Uncle Jack, dear. During the following days Uncle Jack and Mrs. Arderne, Agatha, and the all but Agatha and Catherine, who could not help loving Ted best, though Catherine could not have much doubt--if Uncle Ross would but ask for ''My dear, Catherine has promised not to desert us,'' said Uncle Ross with id: 41831 author: Jewett, Sarah Orne title: Betty Leicester''s Christmas date: words: 11920.0 sentences: 643.0 pages: flesch: 87.0 cache: ./cache/41831.txt txt: ./txt/41831.txt summary: But Lady Mary would be busy enough with her great house-party of said Lady Mary wistfully, as they began to go up the great steps and good-night, darling," said this dear lady, whom Betty had always longed The minute Betty Leicester looked at Edith Banfield next day she saw a great friend of his; then she looked for Lady Mary, who was at the dear friend Betty, who knows what American girls like best, is kindly A maid appeared to take Edith to her room, and Lady Mary patted Betty''s "So does papa," said Betty; "oh, so very much!--next to Lady Mary and "Why, of course," said Betty, with great pleasure. "Why, Warford, my dear!" said Lady Mary, with great delight, as he met Edith looked on with pleasure, and presently Lady Mary came toward them. for the ladies to go to the drawing-room, and Betty, feeling a little id: 25446 author: Richards, Laura Elizabeth Howe title: Fernley House date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 8877 author: Richards, Laura Elizabeth Howe title: Geoffrey Strong date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 38197 author: Robertson, Margaret M. (Margaret Murray) title: The Twa Miss Dawsons date: words: 108939.0 sentences: 6991.0 pages: flesch: 92.0 cache: ./cache/38197.txt txt: ./txt/38197.txt summary: "Here are the bairns," said Miss Jean softly as the two sisters came like a bird, and to ken her from our May, and Marion Petrie," said Jean, spared on an occasion like yesterday, I would think," said Miss Jean. "It has made an old man of your father," added Miss Jean in a little. "Jean," said her sister after a long silence, "do you think he would do his," said Jean, with a sound that was like a sob, her father thought. come to visit her there," Marion said, including both George and Jean in He grew more like his old self, his father said to Miss Jean, giving the Dawson was coming with you," said Marion with a little change of face "And Jean thinks there are few like George," said Marion smiling, as time on board," said Mr Dawson, as he took his way to Miss Jean''s house id: 3166 author: Trollope, Anthony title: Doctor Thorne date: words: 221834.0 sentences: 13678.0 pages: flesch: 86.0 cache: ./cache/3166.txt txt: ./txt/3166.txt summary: "I know he used," said Lady de Courcy, looking very wise, and rather "His father, you know, died when he was very young," said Frank. "Come in, Mary," said Beatrice, "you know my cousin Alexandrina." "You know I never interfere," said the Lady Arabella; "I never liked "Much better, I would think," said the Lady Arabella; "but you know, "It is a great deal of money, certainly," said Lady Arabella. "Yes," said Mary, "I know he is rich; and a rich man I suppose can "Now, doctor, don''t let him talk that way, don''t," said Lady about the money, you know, doctor," said she; "of course Sir Roger "Shall I go now," said the doctor, "and send Lady Scatcherd to you?" "As I said before, Frank is, to my thinking, an excellent young man. "I am engaged to Frank Gresham," and having so said, Mary looked her ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel