mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-southPacificOcean-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/21756.txt inflating: ./tmp/input/input-file/24995.txt inflating: ./tmp/input/input-file/13731.txt inflating: ./tmp/input/input-file/32084.txt inflating: ./tmp/input/input-file/37903.txt inflating: ./tmp/input/input-file/40572.txt inflating: ./tmp/input/input-file/43688.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-southPacificOcean-gutenberg FILE: cache/40572.txt OUTPUT: txt/40572.txt FILE: cache/21756.txt OUTPUT: txt/21756.txt FILE: cache/37903.txt OUTPUT: txt/37903.txt FILE: cache/24995.txt OUTPUT: txt/24995.txt FILE: cache/32084.txt OUTPUT: txt/32084.txt FILE: cache/43688.txt OUTPUT: txt/43688.txt FILE: cache/13731.txt OUTPUT: txt/13731.txt 24995 txt/../pos/24995.pos 24995 txt/../wrd/24995.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point === file2bib.sh === id: 24995 author: Becke, Louis title: The Americans In The South Seas 1901 date: pages: extension: .txt txt: ./txt/24995.txt cache: ./cache/24995.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24995.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24995 txt/../ent/24995.ent 43688 txt/../pos/43688.pos 43688 txt/../wrd/43688.wrd 43688 txt/../ent/43688.ent === file2bib.sh === id: 43688 author: Allen, Grant title: Wednesday the Tenth, A Tale of the South Pacific date: pages: extension: .txt txt: ./txt/43688.txt cache: ./cache/43688.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'43688.txt' 40572 txt/../pos/40572.pos 21756 txt/../wrd/21756.wrd 32084 txt/../wrd/32084.wrd 32084 txt/../pos/32084.pos 40572 txt/../wrd/40572.wrd 21756 txt/../pos/21756.pos 21756 txt/../ent/21756.ent 40572 txt/../ent/40572.ent 32084 txt/../ent/32084.ent 37903 txt/../pos/37903.pos 37903 txt/../wrd/37903.wrd 13731 txt/../wrd/13731.wrd 13731 txt/../pos/13731.pos === file2bib.sh === id: 40572 author: Mason, Arthur title: The Flying Bo'sun: A Mystery of the Sea date: pages: extension: .txt txt: ./txt/40572.txt cache: ./cache/40572.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'40572.txt' === file2bib.sh === id: 21756 author: Ballantyne, R. M. (Robert Michael) title: Philosopher Jack date: pages: extension: .txt txt: ./txt/21756.txt cache: ./cache/21756.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'21756.txt' === file2bib.sh === id: 32084 author: Roosevelt, Wyn title: Frontier Boys in the South Seas date: pages: extension: .txt txt: ./txt/32084.txt cache: ./cache/32084.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'32084.txt' 37903 txt/../ent/37903.ent 13731 txt/../ent/13731.ent === file2bib.sh === id: 37903 author: Strang, Herbert, Mrs. title: The Girl Crusoes: A Story of the South Seas date: pages: extension: .txt txt: ./txt/37903.txt cache: ./cache/37903.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'37903.txt' === file2bib.sh === id: 13731 author: Gale, Zona title: Romance Island date: pages: extension: .txt txt: ./txt/13731.txt cache: ./cache/13731.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'13731.txt' Done mapping. Reducing subject-southPacificOcean-gutenberg === reduce.pl bib === id = 21756 author = Ballantyne, R. M. (Robert Michael) title = Philosopher Jack date = pages = extension = .txt mime = text/plain words = 49325 sentences = 2894 flesch = 85 summary = "No, you won't, Watty," said Ben, laying his hand on his friend's "Oh, Baldwin," said Polly with a little laugh, "surely you can't believe "We're all right, Polly, thank God!" said the captain, earnestly, when "You'll soon get ashore," said Polly, laying her hand on Ben Trench's "Yes," said Edwin Jack, coming forward at the moment, "a coral island, "You don't mean to tell me, Jack," said Baldwin Burr, "that this island "He's all right if O'Rook is with him," said the captain to Polly, in "And yet he is a good, kind man, father," said Polly. "Polly is right," said Philosopher Jack; "I'd know Watty's action among "Now, Jack," said Wilkins, "I'm not going to set up for a little "Poor fellow," said Jack, seeing Watty wince a little, "does it hurt open to Polly," said Jack quite warmly, "or Mr Wilkins's, for the cache = ./cache/21756.txt txt = ./txt/21756.txt === reduce.pl bib === === reduce.pl bib === id = 13731 author = Gale, Zona title = Romance Island date = pages = extension = .txt mime = text/plain words = 90230 sentences = 5392 flesch = 84 summary = St. George had sometimes told himself that the man looked like an knew his ways; but Chillingworth's methods always told, and St. George turned away with all the old glow of his first assignment. "No, Mrs. Hastings," said St. George, "she did not say one word. "Prince Tabnit," said St. George, "I beg you not to jest with us. As Olivia gave St. George her hand he came perilously near telling "Lights!" said St. George, and gave the glass to Amory, his hand St. George's eyes softened as he looked at the little man. But Jarvo found footing in an instant, and St. George and Amory pressed closely behind him, Rollo and little Akko "Rollo," said St. George, "go and look out the window and see if "Yes," said St. George, "I know a little lad of about five, I should St. George saw Prince Tabnit kneel before Olivia and place a ring cache = ./cache/13731.txt txt = ./txt/13731.txt === reduce.pl bib === id = 37903 author = Strang, Herbert, Mrs. title = The Girl Crusoes: A Story of the South Seas date = pages = extension = .txt mime = text/plain words = 76406 sentences = 5403 flesch = 89 summary = dark, handsome sister Elizabeth, whilst Mary, the second girl, drawing "Tommy darling, do try to be a bit sensible," said Elizabeth, with a "Yes," said Tommy; "he helped me down the side last time I saw you off." "Look out for a landing-place," said Elizabeth, as she rowed slowly Tommy was soon asleep, but the elder girls lay awake for a long time, "Mary dear," said Elizabeth, "we must look at the worst side and face "A good idea!" said Tommy, springing up and running to Elizabeth's "Come, girls, this really won't do," said Elizabeth briskly. Elizabeth jumped up, carrying the odd-looking paddle, which Tommy said "You first, Tommy," said Elizabeth. "She's a dear, brave girl," said Mary, "and I shall like the oranges Elizabeth was afraid that Mary's strength might give way, or that Tommy "Now you," said Tommy, pointing to the girl herself. "Don't be ridiculous, Tommy," said Elizabeth, feeling it was no time cache = ./cache/37903.txt txt = ./txt/37903.txt === reduce.pl bib === id = 43688 author = Allen, Grant title = Wednesday the Tenth, A Tale of the South Pacific date = pages = extension = .txt mime = text/plain words = 21287 sentences = 1221 flesch = 85 summary = fellows swarming over them like ants; and poor Tom Blake got a bullet beach-comber (or degraded white man who lives like a native) for three half an hour the younger boy was sitting up in Jim's arms with his eyes is an awful long stretch for two boys to come in an open boat. exclaimed in his very best Kanaka-English, "Boy come round again. "It used to be called 'The Long Reef,'" Martin said, looking up; "but "But we got away from Tanaki eight days ago," the boy declared strongly The business-like way they went to work, Jack and Martin told us, was "At least," he cried, "Chief, you'll let us say good-by to our boys with axe, like Taranaka kill first missionary that come a Tanaki. Tanaki let go missionary, and boy, and white woman. native, who, Jack whispered to me, was the Chief of Tanaki, came up from cache = ./cache/43688.txt txt = ./txt/43688.txt === reduce.pl bib === id = 32084 author = Roosevelt, Wyn title = Frontier Boys in the South Seas date = pages = extension = .txt mime = text/plain words = 46351 sentences = 3580 flesch = 88 summary = Jim Darlington and John Berwick, the latter the once time engineer of "Much obliged to you, captain," said Jim, when they had gone up on deck "The professor with the long name!" cried Jim and Berwick "That's the professor," whispered Jo to Jim as the man came into the "Glad to know you, Mr. Berwick," said the professor. "That's only a joke of the professor's captain," replied Jim. "Why, it looked like that!" exclaimed the professor, taking the box Tom busy down in the engine room with Berwick, and Jim and the professor "Where do you think is a good place to make it?" asked Tom, looking The professor, before replying, looked at Jim inquiringly. "Where are you going to land, Jim," asked Berwick, who had taken the "Do you know of a Captain Beauchamp?" Jim asked. "Now," said the professor, "tell us about Jim." cache = ./cache/32084.txt txt = ./txt/32084.txt === reduce.pl bib === id = 40572 author = Mason, Arthur title = The Flying Bo'sun: A Mystery of the Sea date = pages = extension = .txt mime = text/plain words = 45326 sentences = 2958 flesch = 89 summary = "Never mind about anything," said the Captain, "get the damned old spare With a look of disdain at Old Charlie, he said, "To Hell with breakfast! "Sick, is he?" said the Captain, and pointed to me, saying: "Go forward About nine o'clock the cook came running aft, crying, "Mr. Mate, Swanson is very sick, and the crew think that he is going to die." "I saw Swanson on deck this morning," said the Captain. "To Hell with the cat," said the Captain, "this is no time to stand on "Riley," said I, "come on deck and throw a few buckets of salt water on "Riley," said I, opening the door to the Captain's room, "I want you and There are instances where the Captain and mates of the old time sailing Before going on deck again, I looked in on the Hindoo in the Captain's cache = ./cache/40572.txt txt = ./txt/40572.txt Building ./etc/reader.txt 13731 37903 21756 13731 37903 40572 number of items: 7 sum of words: 328,925 average size in words: 54,820 average readability score: 86 nouns: time; man; way; day; captain; boat; island; ship; sea; eyes; night; hand; men; girls; moment; water; face; one; professor; room; head; place; prince; something; deck; side; nothing; sir; light; morning; hands; father; things; life; people; feet; world; days; thing; story; course; voice; anything; heart; crew; boys; name; air; work; hour verbs: was; had; is; said; be; have; were; do; are; been; ''s; did; know; see; come; go; get; made; think; has; came; went; make; say; looked; asked; going; found; take; cried; let; tell; seemed; saw; replied; got; thought; put; being; am; knew; ''m; ''ve; seen; find; turned; look; stood; heard; told adjectives: little; old; other; good; more; great; few; own; last; long; many; first; much; same; white; poor; new; small; sure; strange; young; right; such; next; open; ready; better; dear; black; high; large; possible; several; true; full; best; able; strong; short; clear; certain; bad; dead; second; only; safe; low; big; dark; afraid adverbs: not; n''t; up; so; now; then; out; very; down; here; there; away; only; back; as; again; more; off; just; never; all; too; once; well; still; on; even; much; almost; far; soon; quite; in; long; ever; over; always; suddenly; perhaps; forward; yet; enough; however; first; about; indeed; most; no; together; at pronouns: i; he; it; you; his; they; her; we; she; him; their; them; me; my; your; us; our; its; himself; herself; one; themselves; itself; myself; ''s; yourself; ourselves; yours; ''em; mine; meself; ye; theirs; em; shur''n; ours; hers; yourselves; oneself; you''ll; yerself; we''d; thee; north--; boys!--mere; ah proper nouns: st.; george; _; tommy; elizabeth; jim; mary; captain; jack; olivia; tom; mr.; amory; mrs.; yaque; jo; hastings; berwick; king; polly; miss; riley; mr; watty; jarvo; fangati; wilkins; prince; juarez; god; ben; holland; tabnit; rollo; o''rook; frothingham; sea; hut; chapter; bess; samson; uncle; charlie; new; philosopher; chillingworth; broome; mrs; south; senor keywords: captain; mr.; miss; little; king; jim; jack; god; chapter; ben; york; yaque; wilkins; wednesday; watty; uncle; trench; tommy; tom; time; tanaki; tabnit; swanson; suva; story; storm; st.; ship; senor; sea; samson; rollo; riley; prince; polly; philosopher; pete; otho; olsen; olivia; old; o''rook; new; nassaline; mrs.; mrs; mary; martin; marjorie; malakh one topic; one dimension: said file(s): ./cache/21756.txt titles(s): Philosopher Jack three topics; one dimension: said; st; tommy file(s): ./cache/21756.txt, ./cache/13731.txt, ./cache/37903.txt titles(s): Philosopher Jack | Romance Island | The Girl Crusoes: A Story of the South Seas five topics; three dimensions: captain said jim; st george said; tommy said elizabeth; jack polly watty; dozed attitude sounding file(s): ./cache/40572.txt, ./cache/13731.txt, ./cache/37903.txt, ./cache/21756.txt, titles(s): The Flying Bo''sun: A Mystery of the Sea | Romance Island | The Girl Crusoes: A Story of the South Seas | Philosopher Jack | The Americans In The South Seas 1901 Type: gutenberg title: subject-southPacificOcean-gutenberg date: 2021-06-10 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"South Pacific Ocean" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 43688 author: Allen, Grant title: Wednesday the Tenth, A Tale of the South Pacific date: words: 21287.0 sentences: 1221.0 pages: flesch: 85.0 cache: ./cache/43688.txt txt: ./txt/43688.txt summary: fellows swarming over them like ants; and poor Tom Blake got a bullet beach-comber (or degraded white man who lives like a native) for three half an hour the younger boy was sitting up in Jim''s arms with his eyes is an awful long stretch for two boys to come in an open boat. exclaimed in his very best Kanaka-English, "Boy come round again. "It used to be called ''The Long Reef,''" Martin said, looking up; "but "But we got away from Tanaki eight days ago," the boy declared strongly The business-like way they went to work, Jack and Martin told us, was "At least," he cried, "Chief, you''ll let us say good-by to our boys with axe, like Taranaka kill first missionary that come a Tanaki. Tanaki let go missionary, and boy, and white woman. native, who, Jack whispered to me, was the Chief of Tanaki, came up from id: 21756 author: Ballantyne, R. M. (Robert Michael) title: Philosopher Jack date: words: 49325.0 sentences: 2894.0 pages: flesch: 85.0 cache: ./cache/21756.txt txt: ./txt/21756.txt summary: "No, you won''t, Watty," said Ben, laying his hand on his friend''s "Oh, Baldwin," said Polly with a little laugh, "surely you can''t believe "We''re all right, Polly, thank God!" said the captain, earnestly, when "You''ll soon get ashore," said Polly, laying her hand on Ben Trench''s "Yes," said Edwin Jack, coming forward at the moment, "a coral island, "You don''t mean to tell me, Jack," said Baldwin Burr, "that this island "He''s all right if O''Rook is with him," said the captain to Polly, in "And yet he is a good, kind man, father," said Polly. "Polly is right," said Philosopher Jack; "I''d know Watty''s action among "Now, Jack," said Wilkins, "I''m not going to set up for a little "Poor fellow," said Jack, seeing Watty wince a little, "does it hurt open to Polly," said Jack quite warmly, "or Mr Wilkins''s, for the id: 24995 author: Becke, Louis title: The Americans In The South Seas 1901 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 13731 author: Gale, Zona title: Romance Island date: words: 90230.0 sentences: 5392.0 pages: flesch: 84.0 cache: ./cache/13731.txt txt: ./txt/13731.txt summary: St. George had sometimes told himself that the man looked like an knew his ways; but Chillingworth''s methods always told, and St. George turned away with all the old glow of his first assignment. "No, Mrs. Hastings," said St. George, "she did not say one word. "Prince Tabnit," said St. George, "I beg you not to jest with us. As Olivia gave St. George her hand he came perilously near telling "Lights!" said St. George, and gave the glass to Amory, his hand St. George''s eyes softened as he looked at the little man. But Jarvo found footing in an instant, and St. George and Amory pressed closely behind him, Rollo and little Akko "Rollo," said St. George, "go and look out the window and see if "Yes," said St. George, "I know a little lad of about five, I should St. George saw Prince Tabnit kneel before Olivia and place a ring id: 40572 author: Mason, Arthur title: The Flying Bo''sun: A Mystery of the Sea date: words: 45326.0 sentences: 2958.0 pages: flesch: 89.0 cache: ./cache/40572.txt txt: ./txt/40572.txt summary: "Never mind about anything," said the Captain, "get the damned old spare With a look of disdain at Old Charlie, he said, "To Hell with breakfast! "Sick, is he?" said the Captain, and pointed to me, saying: "Go forward About nine o''clock the cook came running aft, crying, "Mr. Mate, Swanson is very sick, and the crew think that he is going to die." "I saw Swanson on deck this morning," said the Captain. "To Hell with the cat," said the Captain, "this is no time to stand on "Riley," said I, "come on deck and throw a few buckets of salt water on "Riley," said I, opening the door to the Captain''s room, "I want you and There are instances where the Captain and mates of the old time sailing Before going on deck again, I looked in on the Hindoo in the Captain''s id: 32084 author: Roosevelt, Wyn title: Frontier Boys in the South Seas date: words: 46351.0 sentences: 3580.0 pages: flesch: 88.0 cache: ./cache/32084.txt txt: ./txt/32084.txt summary: Jim Darlington and John Berwick, the latter the once time engineer of "Much obliged to you, captain," said Jim, when they had gone up on deck "The professor with the long name!" cried Jim and Berwick "That''s the professor," whispered Jo to Jim as the man came into the "Glad to know you, Mr. Berwick," said the professor. "That''s only a joke of the professor''s captain," replied Jim. "Why, it looked like that!" exclaimed the professor, taking the box Tom busy down in the engine room with Berwick, and Jim and the professor "Where do you think is a good place to make it?" asked Tom, looking The professor, before replying, looked at Jim inquiringly. "Where are you going to land, Jim," asked Berwick, who had taken the "Do you know of a Captain Beauchamp?" Jim asked. "Now," said the professor, "tell us about Jim." id: 37903 author: Strang, Herbert, Mrs. title: The Girl Crusoes: A Story of the South Seas date: words: 76406.0 sentences: 5403.0 pages: flesch: 89.0 cache: ./cache/37903.txt txt: ./txt/37903.txt summary: dark, handsome sister Elizabeth, whilst Mary, the second girl, drawing "Tommy darling, do try to be a bit sensible," said Elizabeth, with a "Yes," said Tommy; "he helped me down the side last time I saw you off." "Look out for a landing-place," said Elizabeth, as she rowed slowly Tommy was soon asleep, but the elder girls lay awake for a long time, "Mary dear," said Elizabeth, "we must look at the worst side and face "A good idea!" said Tommy, springing up and running to Elizabeth''s "Come, girls, this really won''t do," said Elizabeth briskly. Elizabeth jumped up, carrying the odd-looking paddle, which Tommy said "You first, Tommy," said Elizabeth. "She''s a dear, brave girl," said Mary, "and I shall like the oranges Elizabeth was afraid that Mary''s strength might give way, or that Tommy "Now you," said Tommy, pointing to the girl herself. "Don''t be ridiculous, Tommy," said Elizabeth, feeling it was no time ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel