mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-birthdays-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/21901.txt inflating: ./tmp/input/input-file/23955.txt inflating: ./tmp/input/input-file/419.txt inflating: ./tmp/input/input-file/39812.txt inflating: ./tmp/input/input-file/33517.txt inflating: ./tmp/input/input-file/43569.txt inflating: ./tmp/input/input-file/43131.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-birthdays-gutenberg FILE: cache/23955.txt OUTPUT: txt/23955.txt FILE: cache/43131.txt OUTPUT: txt/43131.txt FILE: cache/43569.txt OUTPUT: txt/43569.txt FILE: cache/419.txt OUTPUT: txt/419.txt FILE: cache/33517.txt OUTPUT: txt/33517.txt FILE: cache/21901.txt OUTPUT: txt/21901.txt FILE: cache/39812.txt OUTPUT: txt/39812.txt === file2bib.sh === id: 23955 author: Ritchie, Lily Munsell title: Chicken Little Jane date: pages: extension: .txt txt: ./txt/23955.txt cache: ./cache/23955.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'23955.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 23955 txt/../wrd/23955.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 23955 txt/../ent/23955.ent 23955 txt/../pos/23955.pos 21901 txt/../wrd/21901.wrd 21901 txt/../pos/21901.pos 33517 txt/../wrd/33517.wrd 33517 txt/../pos/33517.pos 21901 txt/../ent/21901.ent 43569 txt/../wrd/43569.wrd === file2bib.sh === id: 21901 author: Optic, Oliver title: The Birthday Party: A Story for Little Folks date: pages: extension: .txt txt: ./txt/21901.txt cache: ./cache/21901.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'21901.txt' 43569 txt/../pos/43569.pos 33517 txt/../ent/33517.ent === file2bib.sh === id: 33517 author: Leslie, Madeline title: Little Frankie on a Journey date: pages: extension: .txt txt: ./txt/33517.txt cache: ./cache/33517.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'33517.txt' === file2bib.sh === id: 43569 author: Mitchell, Lebbeus title: Bobby in Search of a Birthday date: pages: extension: .txt txt: ./txt/43569.txt cache: ./cache/43569.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'43569.txt' 43569 txt/../ent/43569.ent 43131 txt/../wrd/43131.wrd 43131 txt/../pos/43131.pos 419 txt/../wrd/419.wrd 419 txt/../pos/419.pos 39812 txt/../wrd/39812.wrd 39812 txt/../pos/39812.pos 43131 txt/../ent/43131.ent 419 txt/../ent/419.ent 39812 txt/../ent/39812.ent === file2bib.sh === id: 419 author: Baum, L. Frank (Lyman Frank) title: The Magic of Oz date: pages: extension: .txt txt: ./txt/419.txt cache: ./cache/419.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'419.txt' === file2bib.sh === id: 43131 author: Molesworth, Mrs. title: Mary: A Nursery Story for Very Little Children date: pages: extension: .txt txt: ./txt/43131.txt cache: ./cache/43131.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'43131.txt' === file2bib.sh === id: 39812 author: Molesworth, Mrs. title: The Oriel Window date: pages: extension: .txt txt: ./txt/39812.txt cache: ./cache/39812.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'39812.txt' Done mapping. Reducing subject-birthdays-gutenberg === reduce.pl bib === id = 21901 author = Optic, Oliver title = The Birthday Party: A Story for Little Folks date = pages = extension = .txt mime = text/plain words = 5433 sentences = 400 flesch = 95 summary = About a week before the time, Mrs. Lee told Flora she might "I want to ask all the children in Riverdale," said Flora, "Just as you think best, dear mother," replied Flora. "Tommy isn't a bad boy," said Mrs. Lee, with a smile. "But Tommy is a great traveller, you know," added Mrs. Lee, The next day, when the children had gone to school, Mrs. Lee Flora could not help thinking how much good the forty Mrs. Lee laughed at the troubled looks of Flora, and I could live in a little house, like Mrs. White?" laughed not think Master Woggs was a very great man. The children wanted to march a little "Children," said the old man, as he took off his hat and "I think it is too bad to laugh at an old man like him," "Play us some tunes," said the children. cache = ./cache/21901.txt txt = ./txt/21901.txt === reduce.pl bib === id = 419 author = Baum, L. Frank (Lyman Frank) title = The Magic of Oz date = pages = extension = .txt mime = text/plain words = 40461 sentences = 2468 flesch = 90 summary = "Now, see here," said Dorothy; "we want the Magic Flower to give to Come on, then, Cap'n," said the Glass Cat, starting to "Wizard," said Dorothy, "I want you to help me fix up a present for "In that hollow place," said Dorothy, "I want to hide a lot of monkeys place by looking at the Map of the Land of Oz. Gugu Forest is the home of most of the wild beasts that inhabit Oz. These are seldom disturbed in their leafy haunts because there is no "Beasts wouldn't know what to do with the things people use," said the "I've been to the Magic Isle," said the Glass Cat, "and I've watched "If the Glass Cat is right," said the Wizard in a solemn voice, "I forgot to tell you," said the Glass Cat, "that Trot and Cap'n Bill "The Magic Isle is in this forest," said the Glass Cat, "but the river cache = ./cache/419.txt txt = ./txt/419.txt === reduce.pl bib === === reduce.pl bib === id = 43569 author = Mitchell, Lebbeus title = Bobby in Search of a Birthday date = pages = extension = .txt mime = text/plain words = 10398 sentences = 905 flesch = 98 summary = When the man had opened the gate, he stopped and looked at Bobby and "No'm," said Bobby, trying to answer the man's questions in order. The Lady Who Likes Little Boys went quickly into another room and took The lady kissed Bobby good-bye while the man looked pleadingly at her. The Man Who Lets You Play with the Puppy took Bobby from the Lady and when he looked up and saw the Lady Who Likes Little Boys coming swiftly "I don't know, Bobby," said the man when he had stopped laughing. Bobby turned at once to the Lady Who Likes Little Boys. The man looked at Bobby and then said in a low voice to his wife: The Lady Who Likes Little Boys took Bobby into the house to get him "Why _he's_ the Man Who Lets You Play with the Puppy, too!" said Bobby, cache = ./cache/43569.txt txt = ./txt/43569.txt === reduce.pl bib === id = 33517 author = Leslie, Madeline title = Little Frankie on a Journey date = pages = extension = .txt mime = text/plain words = 7388 sentences = 572 flesch = 96 summary = "Frankie," said mamma one evening, just as he was going to bed, mamma, Willie, Nelly, and Margie; to keep the house from being burned In the morning, Frankie said the Lord's prayer, and this pretty little "Come to breakfast now," said mamma; "and then you shall play with your Perhaps you will wonder whether papa and mamma gave Frankie a present. "I like that elephant," said Frankie; "but I shouldn't think the baby's Frankie, when he kissed his mamma good night, said, "I wish I could have "Well, mamma," said the little fellow, "they sound like mulberry trees." "I mean to ask father to buy me a watch," said Nelly, "just as soon as I Mrs. Gray bent down and kissed her little niece, and then said, "I am "O, yes, aunty," said the little girl; "may I, Frankie?" "Well, Master Frankie," said Nelly's papa on the morning when they were cache = ./cache/33517.txt txt = ./txt/33517.txt === reduce.pl bib === id = 43131 author = Molesworth, Mrs. title = Mary: A Nursery Story for Very Little Children date = pages = extension = .txt mime = text/plain words = 37598 sentences = 2752 flesch = 97 summary = "I'm calling nurse," Mary went on, "I don't want you, Little Sarah. "Nurse wouldn't never be busy like that," said Mary. "Dear little Mary," said Artie, kissing her. "Yes, dear," said the stranger, "I'm come to be baby's nurse. "No," said Mary, "I think it's a good plan," and she gave a little sigh "Mary," he said, "mamma is awake and you may come in and get a birthday "Baby's opening her eyes so wide, Miss Mary," she said. "Because their teeth coming often hurts babies a good deal," said nurse. "I'm f'ightened of those little barky dogs," said Mary; "I don't want to "You needn't look down upon Mary," said Leigh, "if you can't get any "Oh," said Mary, with a little laugh, "I never thought of that! words we say to her," said Mary, with a little sigh; "I can't think why "Oh, baby, you sweet--you dear little innicent sweet!" said Mary; cache = ./cache/43131.txt txt = ./txt/43131.txt === reduce.pl bib === id = 39812 author = Molesworth, Mrs. title = The Oriel Window date = pages = extension = .txt mime = text/plain words = 47477 sentences = 4066 flesch = 93 summary = "Ferdy, my boy"--"Dear little man," as his father and mother came in. [Illustration: OFF FERDY WENT AGAIN, A LITTLE BIT FASTER THIS TIME.] "Ferdy," said Chrissie suddenly, "I think there's going to be a begin talking together, you know," said mamma, "Ferdy would get dear Ferdy," Miss Lilly was saying, "see what comes of holidays! "Now, Miss Lilly, you're joking--you know you are," said Ferdy, looking "Oh, I know," said Ferdy; "it was about Jesse Piggot. "In the house of life," said Miss Lilly after thinking a little. "I don't know, I'm sure, Master Ferdy," said Flowers, who did not feel "It looks like him, Master Ferdy," he said, "but I don't know that he'll "Come in, Jesse," she said, "I do want Master Ferdy to see--you know "Good evening, Jesse," said Ferdy, holding out his hand. "Jesse's not to go back to Draymoor, mamma," said Ferdy, looking up cache = ./cache/39812.txt txt = ./txt/39812.txt Building ./etc/reader.txt 39812 43131 419 39812 419 43569 number of items: 7 sum of words: 148,755 average size in words: 24,792 average readability score: 94 nouns: time; way; boy; children; man; day; things; baby; people; papa; mamma; birthday; nurse; eyes; girl; face; something; room; father; head; one; mother; thing; boys; beasts; anything; place; voice; story; bed; hand; nothing; morning; door; monkeys; forest; lady; window; house; work; moment; sister; birthdays; side; home; book; flowers; course; name; friends verbs: was; said; had; be; is; do; have; ''s; were; are; did; think; see; know; been; go; get; come; came; tell; asked; thought; ''m; make; looked; made; going; has; went; got; say; ''ve; want; ''re; replied; like; take; began; told; saw; let; seemed; put; look; give; knew; took; find; called; looking adjectives: little; good; other; old; great; big; poor; own; sure; nice; long; dear; more; many; better; right; young; best; afraid; new; happy; white; pretty; such; small; beautiful; much; pleased; able; same; few; last; first; red; glad; tired; ready; full; bright; lovely; strange; next; blue; sweet; funny; wonderful; sorry; bad; real; fine adverbs: not; n''t; so; very; then; up; now; out; just; again; quite; as; too; all; never; there; only; much; away; back; still; on; rather; down; here; even; more; well; ever; off; always; really; once; in; soon; perhaps; over; most; almost; long; yet; at; first; indeed; together; pretty; sometimes; far; enough; right pronouns: i; it; he; you; she; her; his; they; him; we; them; me; my; their; your; us; himself; our; its; herself; myself; themselves; yourself; ''em; one; ''s; mine; itself; yours; ourselves; em; ours; hers; eva; hisself; i''m; i''ll; thee; oneself; heart,--the; ee; be-- proper nouns: _; mary; ferdy; leigh; bobby; miss; wizard; oz; jesse; lilly; mrs.; dorothy; mr.; ozma; chrissie; kiki; cat; trot; artie; bill; glass; magic; master; mamma; nome; ross; ruggedo; frankie; molesworth; emma; gugu; king; aru; land; lion; flower; gray; christine; janie; fuzzy; illustrated; lady; edition; flora; nurse; tiger; dr.; emerald; city; christmas keywords: little; miss; master; wizard; willie; trot; tommy; ross; ozma; mrs.; mr.; molesworth; mary; lilly; leigh; lee; lady; kiki; jesse; janie; illustrations; illustrated; gray; glass; frankie; flora; ferdy; emma; edition; dorothy; christine; chrissie; cat; bobby; bill; artie one topic; one dimension: said file(s): titles(s): Chicken Little Jane three topics; one dimension: said; ferdy; bobby file(s): ./cache/419.txt, ./cache/39812.txt, ./cache/43569.txt titles(s): The Magic of Oz | The Oriel Window | Bobby in Search of a Birthday five topics; three dimensions: ferdy said little; said wizard oz; said mary leigh; bobby man little; shake bushes playing file(s): ./cache/39812.txt, ./cache/419.txt, ./cache/43131.txt, ./cache/43569.txt, titles(s): The Oriel Window | The Magic of Oz | Mary: A Nursery Story for Very Little Children | Bobby in Search of a Birthday | Chicken Little Jane Type: gutenberg title: subject-birthdays-gutenberg date: 2021-06-01 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Birthdays" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 419 author: Baum, L. Frank (Lyman Frank) title: The Magic of Oz date: words: 40461.0 sentences: 2468.0 pages: flesch: 90.0 cache: ./cache/419.txt txt: ./txt/419.txt summary: "Now, see here," said Dorothy; "we want the Magic Flower to give to Come on, then, Cap''n," said the Glass Cat, starting to "Wizard," said Dorothy, "I want you to help me fix up a present for "In that hollow place," said Dorothy, "I want to hide a lot of monkeys place by looking at the Map of the Land of Oz. Gugu Forest is the home of most of the wild beasts that inhabit Oz. These are seldom disturbed in their leafy haunts because there is no "Beasts wouldn''t know what to do with the things people use," said the "I''ve been to the Magic Isle," said the Glass Cat, "and I''ve watched "If the Glass Cat is right," said the Wizard in a solemn voice, "I forgot to tell you," said the Glass Cat, "that Trot and Cap''n Bill "The Magic Isle is in this forest," said the Glass Cat, "but the river id: 33517 author: Leslie, Madeline title: Little Frankie on a Journey date: words: 7388.0 sentences: 572.0 pages: flesch: 96.0 cache: ./cache/33517.txt txt: ./txt/33517.txt summary: "Frankie," said mamma one evening, just as he was going to bed, mamma, Willie, Nelly, and Margie; to keep the house from being burned In the morning, Frankie said the Lord''s prayer, and this pretty little "Come to breakfast now," said mamma; "and then you shall play with your Perhaps you will wonder whether papa and mamma gave Frankie a present. "I like that elephant," said Frankie; "but I shouldn''t think the baby''s Frankie, when he kissed his mamma good night, said, "I wish I could have "Well, mamma," said the little fellow, "they sound like mulberry trees." "I mean to ask father to buy me a watch," said Nelly, "just as soon as I Mrs. Gray bent down and kissed her little niece, and then said, "I am "O, yes, aunty," said the little girl; "may I, Frankie?" "Well, Master Frankie," said Nelly''s papa on the morning when they were id: 43569 author: Mitchell, Lebbeus title: Bobby in Search of a Birthday date: words: 10398.0 sentences: 905.0 pages: flesch: 98.0 cache: ./cache/43569.txt txt: ./txt/43569.txt summary: When the man had opened the gate, he stopped and looked at Bobby and "No''m," said Bobby, trying to answer the man''s questions in order. The Lady Who Likes Little Boys went quickly into another room and took The lady kissed Bobby good-bye while the man looked pleadingly at her. The Man Who Lets You Play with the Puppy took Bobby from the Lady and when he looked up and saw the Lady Who Likes Little Boys coming swiftly "I don''t know, Bobby," said the man when he had stopped laughing. Bobby turned at once to the Lady Who Likes Little Boys. The man looked at Bobby and then said in a low voice to his wife: The Lady Who Likes Little Boys took Bobby into the house to get him "Why _he''s_ the Man Who Lets You Play with the Puppy, too!" said Bobby, id: 39812 author: Molesworth, Mrs. title: The Oriel Window date: words: 47477.0 sentences: 4066.0 pages: flesch: 93.0 cache: ./cache/39812.txt txt: ./txt/39812.txt summary: "Ferdy, my boy"--"Dear little man," as his father and mother came in. [Illustration: OFF FERDY WENT AGAIN, A LITTLE BIT FASTER THIS TIME.] "Ferdy," said Chrissie suddenly, "I think there''s going to be a begin talking together, you know," said mamma, "Ferdy would get dear Ferdy," Miss Lilly was saying, "see what comes of holidays! "Now, Miss Lilly, you''re joking--you know you are," said Ferdy, looking "Oh, I know," said Ferdy; "it was about Jesse Piggot. "In the house of life," said Miss Lilly after thinking a little. "I don''t know, I''m sure, Master Ferdy," said Flowers, who did not feel "It looks like him, Master Ferdy," he said, "but I don''t know that he''ll "Come in, Jesse," she said, "I do want Master Ferdy to see--you know "Good evening, Jesse," said Ferdy, holding out his hand. "Jesse''s not to go back to Draymoor, mamma," said Ferdy, looking up id: 43131 author: Molesworth, Mrs. title: Mary: A Nursery Story for Very Little Children date: words: 37598.0 sentences: 2752.0 pages: flesch: 97.0 cache: ./cache/43131.txt txt: ./txt/43131.txt summary: "I''m calling nurse," Mary went on, "I don''t want you, Little Sarah. "Nurse wouldn''t never be busy like that," said Mary. "Dear little Mary," said Artie, kissing her. "Yes, dear," said the stranger, "I''m come to be baby''s nurse. "No," said Mary, "I think it''s a good plan," and she gave a little sigh "Mary," he said, "mamma is awake and you may come in and get a birthday "Baby''s opening her eyes so wide, Miss Mary," she said. "Because their teeth coming often hurts babies a good deal," said nurse. "I''m f''ightened of those little barky dogs," said Mary; "I don''t want to "You needn''t look down upon Mary," said Leigh, "if you can''t get any "Oh," said Mary, with a little laugh, "I never thought of that! words we say to her," said Mary, with a little sigh; "I can''t think why "Oh, baby, you sweet--you dear little innicent sweet!" said Mary; id: 21901 author: Optic, Oliver title: The Birthday Party: A Story for Little Folks date: words: 5433.0 sentences: 400.0 pages: flesch: 95.0 cache: ./cache/21901.txt txt: ./txt/21901.txt summary: About a week before the time, Mrs. Lee told Flora she might "I want to ask all the children in Riverdale," said Flora, "Just as you think best, dear mother," replied Flora. "Tommy isn''t a bad boy," said Mrs. Lee, with a smile. "But Tommy is a great traveller, you know," added Mrs. Lee, The next day, when the children had gone to school, Mrs. Lee Flora could not help thinking how much good the forty Mrs. Lee laughed at the troubled looks of Flora, and I could live in a little house, like Mrs. White?" laughed not think Master Woggs was a very great man. The children wanted to march a little "Children," said the old man, as he took off his hat and "I think it is too bad to laugh at an old man like him," "Play us some tunes," said the children. id: 23955 author: Ritchie, Lily Munsell title: Chicken Little Jane date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel