mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-dutch-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/16704.txt inflating: ./tmp/input/input-file/17450.txt inflating: ./tmp/input/input-file/720.txt inflating: ./tmp/input/input-file/34977.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-dutch-gutenberg FILE: cache/17450.txt OUTPUT: txt/17450.txt FILE: cache/720.txt OUTPUT: txt/720.txt FILE: cache/34977.txt OUTPUT: txt/34977.txt FILE: cache/16704.txt OUTPUT: txt/16704.txt === file2bib.sh === id: 17450 author: Heeres, J. E. (Jan Ernst) title: The Part Borne by the Dutch in the Discovery of Australia 1606-1765 date: pages: extension: .txt txt: ./txt/17450.txt cache: ./cache/17450.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'17450.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 17450 txt/../wrd/17450.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 17450 txt/../pos/17450.pos 17450 txt/../ent/17450.ent 34977 txt/../pos/34977.pos 34977 txt/../wrd/34977.wrd 16704 txt/../pos/16704.pos 720 txt/../wrd/720.wrd 34977 txt/../ent/34977.ent 720 txt/../pos/720.pos 16704 txt/../wrd/16704.wrd 16704 txt/../ent/16704.ent 720 txt/../ent/720.ent === file2bib.sh === id: 34977 author: Goodwin, Maud Wilder title: Dutch and English on the Hudson: A Chronicle of Colonial New York date: pages: extension: .txt txt: ./txt/34977.txt cache: ./cache/34977.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'34977.txt' === file2bib.sh === id: 720 author: Conrad, Joseph title: Almayer's Folly: A Story of an Eastern River date: pages: extension: .txt txt: ./txt/720.txt cache: ./cache/720.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'720.txt' === file2bib.sh === id: 16704 author: Forbes, George title: Adventures in Southern Seas: A Tale of the Sixteenth Century date: pages: extension: .txt txt: ./txt/16704.txt cache: ./cache/16704.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'16704.txt' Done mapping. Reducing subject-dutch-gutenberg === reduce.pl bib === === reduce.pl bib === id = 16704 author = Forbes, George title = Adventures in Southern Seas: A Tale of the Sixteenth Century date = pages = extension = .txt mime = text/plain words = 68437 sentences = 3070 flesch = 77 summary = "Let Peter come," said Hartog when the boat was alongside. When we had come to the shore Hartog, taking the boat's crew with him, "Of a truth, Peter," said Hartog, smiling at my sorry appearance, "I At length matters came to a climax, when Van Luck ordered me to set "How now," said Hartog, "am I captain of this ship or not? By the time we came in sight of the islands Janstins had recovered his When we had been some days upon the island Hartog expressed to the king with no land until we sighted a group of islands which Hartog believed presently a great water-snake began to swim slowly round our ship in Soon after leaving the islands of the South Seas we encountered heavy the ships and the frigate remained for a time at the islands, where the Isabel wished to return to the island for more gold, but Hartog would cache = ./cache/16704.txt txt = ./txt/16704.txt === reduce.pl bib === id = 720 author = Conrad, Joseph title = Almayer's Folly: A Story of an Eastern River date = pages = extension = .txt mime = text/plain words = 63747 sentences = 3907 flesch = 82 summary = "Listen, Tuan Almayer," said Dain. lights burning strong and white, with a suggestion of paraffin and lampglasses, stood the house and the godowns of Abdulla bin Selim, the great Almayer rising slowly, his long pipe in hand, his face set into a look of "Be careful, Nina," said Almayer, after a short silence and rising from Mrs. Almayer turned her face towards the girl, and her sunken eyes shone shaking Almayer's hand with grave courtesy, his face wearing a look of Dain Maroola came the next day and had a long conversation with Almayer. "And will you be long away, Dain?" asked Nina, in a low voice. Dain was not long in crossing the river after leaving Almayer. "Lay him there," said Babalatchi to Almayer's men, pointing to a pile of "Listen, girl," he said: "there will be many white men in Almayer's Almayer's house to see the white woman's face, to look close at those cache = ./cache/720.txt txt = ./txt/720.txt === reduce.pl bib === id = 34977 author = Goodwin, Maud Wilder title = Dutch and English on the Hudson: A Chronicle of Colonial New York date = pages = extension = .txt mime = text/plain words = 52706 sentences = 2237 flesch = 68 summary = of New Netherland, a Governor who had come to govern. of Dutch rule in America appeared at New Amsterdam, Petrus or Pieter the Hudson--Fort Orange, Rondout, and New Amsterdam--and that the rest Orange became respectively New York, Fort James, and Albany in honor of Leisler invited the people of the towns and counties of New York to of the fort at New York until orders shall be received from their Kidd, a sea-captain of New York who chanced to be in London at the time people (innuendo, the governor and council of New York) cause them and Men of New Amsterdam in the Time of Governor Peter Stuyvesant_ Colve, Captain Anthony, Dutch Governor of New York, 143 Cosby, William, Governor of New York, 190, 194-96 New York, government changed, 137-38; surrenders to Dutch (1674), 143; first English Governor of New York, 137-138, 139, 144; warns against cache = ./cache/34977.txt txt = ./txt/34977.txt Building ./etc/reader.txt 34977 16704 720 34977 720 17450 number of items: 4 sum of words: 184,890 average size in words: 61,630 average readability score: 75 nouns: man; men; time; ship; house; life; eyes; sea; river; water; island; hand; people; head; place; day; face; years; way; boat; nothing; hands; night; land; side; feet; fire; words; death; voyage; voice; heart; woman; gold; days; women; light; father; canoe; country; vessel; part; girl; savages; order; end; daughter; islands; shore; others verbs: was; had; be; were; is; have; been; said; are; made; came; did; see; found; being; do; come; seemed; go; make; stood; set; looked; saw; went; took; knew; brought; has; heard; appeared; am; take; know; having; seen; felt; began; became; looking; called; asked; spoke; given; let; sent; answered; put; left; give adjectives: great; white; other; many; own; little; old; first; long; more; such; new; same; last; dutch; much; good; small; young; black; red; large; dead; open; short; ready; high; few; full; next; dark; low; able; heavy; true; only; deep; big; strange; strong; several; second; silent; wise; whole; spanish; early; certain; rich; fresh adverbs: not; so; now; up; then; out; only; away; down; very; more; again; here; as; also; well; there; never; off; far; even; together; still; however; once; back; soon; on; too; yet; much; long; most; in; ever; thus; suddenly; over; perhaps; almost; slowly; always; no; first; therefore; later; close; often; just; all pronouns: he; his; i; it; we; her; they; she; him; you; my; their; me; our; them; us; its; himself; your; myself; themselves; herself; itself; ourselves; thee; yourself; thy; yours; one; hers; theirs; mine; ya; whence; ours; ye; thyself proper nouns: _; almayer; new; hartog; nina; dain; van; babalatchi; york; amsterdam; governor; island; dutch; lakamba; mrs.; peter; netherland; de; hudson; company; luck; england; king; captain; rajah; fort; william; melannie; holland; stuyvesant; indians; english; director; tuan; sambir; river; west; leisler; ali; abdulla; lingard; anna; ackbau; isabel; albany; south; kidd; india; queen; bulangi keywords: van; king; island; amsterdam; york; william; west; tuan; thedori; stuyvesant; spanish; seahorse; sambir; river; reshid; rajah; peter; orange; nina; new; netherland; mrs.; montbar; melannie; man; malay; luck; look; lingard; leisler; lakamba; kidd; isabel; indians; hudson; hartog; governor; golden; general; fort; ford; english; england; dutch; donna; director; dain; company; chapter; bulangi one topic; one dimension: new file(s): ./cache/16704.txt titles(s): Adventures in Southern Seas: A Tale of the Sixteenth Century three topics; one dimension: new; almayer; sells file(s): ./cache/16704.txt, ./cache/720.txt, titles(s): Adventures in Southern Seas: A Tale of the Sixteenth Century | Almayer''s Folly: A Story of an Eastern River | The Part Borne by the Dutch in the Discovery of Australia 1606-1765 five topics; three dimensions: almayer man said; new dutch york; brink cruising risked; brink cruising risked; brink cruising risked file(s): ./cache/720.txt, ./cache/34977.txt, , , titles(s): Almayer''s Folly: A Story of an Eastern River | Dutch and English on the Hudson: A Chronicle of Colonial New York | The Part Borne by the Dutch in the Discovery of Australia 1606-1765 | The Part Borne by the Dutch in the Discovery of Australia 1606-1765 | The Part Borne by the Dutch in the Discovery of Australia 1606-1765 Type: gutenberg title: subject-dutch-gutenberg date: 2021-06-05 time: 14:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Dutch" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 720 author: Conrad, Joseph title: Almayer''s Folly: A Story of an Eastern River date: words: 63747.0 sentences: 3907.0 pages: flesch: 82.0 cache: ./cache/720.txt txt: ./txt/720.txt summary: "Listen, Tuan Almayer," said Dain. lights burning strong and white, with a suggestion of paraffin and lampglasses, stood the house and the godowns of Abdulla bin Selim, the great Almayer rising slowly, his long pipe in hand, his face set into a look of "Be careful, Nina," said Almayer, after a short silence and rising from Mrs. Almayer turned her face towards the girl, and her sunken eyes shone shaking Almayer''s hand with grave courtesy, his face wearing a look of Dain Maroola came the next day and had a long conversation with Almayer. "And will you be long away, Dain?" asked Nina, in a low voice. Dain was not long in crossing the river after leaving Almayer. "Lay him there," said Babalatchi to Almayer''s men, pointing to a pile of "Listen, girl," he said: "there will be many white men in Almayer''s Almayer''s house to see the white woman''s face, to look close at those id: 16704 author: Forbes, George title: Adventures in Southern Seas: A Tale of the Sixteenth Century date: words: 68437.0 sentences: 3070.0 pages: flesch: 77.0 cache: ./cache/16704.txt txt: ./txt/16704.txt summary: "Let Peter come," said Hartog when the boat was alongside. When we had come to the shore Hartog, taking the boat''s crew with him, "Of a truth, Peter," said Hartog, smiling at my sorry appearance, "I At length matters came to a climax, when Van Luck ordered me to set "How now," said Hartog, "am I captain of this ship or not? By the time we came in sight of the islands Janstins had recovered his When we had been some days upon the island Hartog expressed to the king with no land until we sighted a group of islands which Hartog believed presently a great water-snake began to swim slowly round our ship in Soon after leaving the islands of the South Seas we encountered heavy the ships and the frigate remained for a time at the islands, where the Isabel wished to return to the island for more gold, but Hartog would id: 34977 author: Goodwin, Maud Wilder title: Dutch and English on the Hudson: A Chronicle of Colonial New York date: words: 52706.0 sentences: 2237.0 pages: flesch: 68.0 cache: ./cache/34977.txt txt: ./txt/34977.txt summary: of New Netherland, a Governor who had come to govern. of Dutch rule in America appeared at New Amsterdam, Petrus or Pieter the Hudson--Fort Orange, Rondout, and New Amsterdam--and that the rest Orange became respectively New York, Fort James, and Albany in honor of Leisler invited the people of the towns and counties of New York to of the fort at New York until orders shall be received from their Kidd, a sea-captain of New York who chanced to be in London at the time people (innuendo, the governor and council of New York) cause them and Men of New Amsterdam in the Time of Governor Peter Stuyvesant_ Colve, Captain Anthony, Dutch Governor of New York, 143 Cosby, William, Governor of New York, 190, 194-96 New York, government changed, 137-38; surrenders to Dutch (1674), 143; first English Governor of New York, 137-138, 139, 144; warns against id: 17450 author: Heeres, J. E. (Jan Ernst) title: The Part Borne by the Dutch in the Discovery of Australia 1606-1765 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel