mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-saintAugustineFla-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24335.txt inflating: ./tmp/input/input-file/37507.txt inflating: ./tmp/input/input-file/37909.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-saintAugustineFla-gutenberg FILE: cache/37507.txt OUTPUT: txt/37507.txt FILE: cache/37909.txt OUTPUT: txt/37909.txt FILE: cache/24335.txt OUTPUT: txt/24335.txt === file2bib.sh === id: 24335 author: Colcock, Annie T. title: Margaret Tudor: A Romance of Old St. Augustine date: pages: extension: .txt txt: ./txt/24335.txt cache: ./cache/24335.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24335.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24335 txt/../wrd/24335.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24335 txt/../pos/24335.pos 24335 txt/../ent/24335.ent 37507 txt/../pos/37507.pos 37909 txt/../wrd/37909.wrd 37507 txt/../wrd/37507.wrd 37909 txt/../pos/37909.pos 37507 txt/../ent/37507.ent 37909 txt/../ent/37909.ent === file2bib.sh === id: 37507 author: Fairbanks, George R. (George Rainsford) title: The Spaniards in Florida Comprising the Notable Settlement of the Huguenots in 1564, and the History and Antiquities of St. Augustine, Founded A.D. 1565 date: pages: extension: .txt txt: ./txt/37507.txt cache: ./cache/37507.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'37507.txt' === file2bib.sh === id: 37909 author: Hope, Laura Lee title: The Bobbsey Twins on the Deep Blue Sea date: pages: extension: .txt txt: ./txt/37909.txt cache: ./cache/37909.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'37909.txt' Done mapping. Reducing subject-saintAugustineFla-gutenberg === reduce.pl bib === id = 37909 author = Hope, Laura Lee title = The Bobbsey Twins on the Deep Blue Sea date = pages = extension = .txt mime = text/plain words = 44959 sentences = 3679 flesch = 97 summary = Flossie and Freddie, and Bert and Nan Bobbsey, who lived with their "Don't interrupt, dears, if you want to hear Daddy's news," said Mrs. Bobbsey, and her husband, after looking at the letter, as if to make "I wonder what Cousin Jasper really wants of you," said Mrs. Bobbsey to Nan and Bert were looking at the big buildings of New York, when Mrs. Bobbsey turned, putting away the handkerchief she had been waving, and "Come on, Flossie," said Freddie, when Bert and Nan had walked away down "What sort of pipe?" asked Mrs. Bobbsey, thinking her little boy might "That's an awful little boat to go on the big ocean in," said Flossie. "Well, you and Nan may stay up on deck a little longer," said Mrs. Bobbsey. father, while Mrs. Bobbsey went below with Flossie and Freddie. "Yes, that's the _Swallow_, as Captain Crane calls his boat," Mr. Bobbsey said. cache = ./cache/37909.txt txt = ./txt/37909.txt === reduce.pl bib === id = 37507 author = Fairbanks, George R. (George Rainsford) title = The Spaniards in Florida Comprising the Notable Settlement of the Huguenots in 1564, and the History and Antiquities of St. Augustine, Founded A.D. 1565 date = pages = extension = .txt mime = text/plain words = 44905 sentences = 1683 flesch = 66 summary = easterly side of the river, as the Spaniards marched by land from St. Augustine in a northwesterly direction to Fort Caroline. Spanish fort within fifty years; yet so rapid has been the work of time "'The Adelantado occupied himself in fortifying his settlement at St. Augustine, as well as he could, to defend it from the French fleet if "On the next day following the return of the Adelantado at St. Augustine, the same Indians who came before returned, and said that 'a fire the French crossed to the other fort, their Indian allies in great Nine years had elapsed from the death of Menendez, and the colony at St. Augustine had slowly progressed into the settlement of a small town; but this scheme, he proceeded along the coast of Florida, and came off St. Augustine, where he landed and marched directly upon the town, which he cache = ./cache/37507.txt txt = ./txt/37507.txt === reduce.pl bib === Building ./etc/reader.txt 37909 37507 24335 37909 37507 24335 number of items: 3 sum of words: 89,864 average size in words: 44,932 average readability score: 81 nouns: boat; fort; water; men; island; time; sea; boy; place; fish; twins; doll; one; day; father; mother; children; years; town; ship; river; others; country; fire; engine; city; captain; way; side; motor; deck; things; people; something; part; shore; land; ocean; vessel; night; girl; garrison; raft; vessels; room; storm; governor; days; name; work verbs: was; had; is; were; said; have; be; do; are; been; did; asked; go; ''s; get; come; answered; see; has; went; came; going; cried; made; take; called; being; know; found; got; saw; having; think; took; ''m; put; want; find; guess; make; say; like; taken; look; tell; happened; thought; stay; told; heard adjectives: little; other; big; great; good; many; more; spanish; small; same; old; large; first; much; right; ready; own; long; few; french; deep; strange; blue; such; whole; indian; better; sure; present; glad; poor; nice; english; several; considerable; ancient; high; next; most; last; general; able; wet; warm; new; second; real; public; hard; fat adverbs: n''t; not; so; then; up; now; out; there; very; here; as; down; all; just; off; back; on; away; soon; well; maybe; too; only; still; much; also; more; again; in; even; about; over; first; perhaps; once; right; most; far; enough; really; always; almost; never; around; yet; thus; ever; long; rather; often pronouns: it; i; he; they; we; his; you; their; them; him; her; its; she; me; my; us; our; your; himself; themselves; myself; itself; one; ''em; yourself; ''s; thy; herself; ourselves; yours; theirs; thee; ourself; ours; em proper nouns: bobbsey; freddie; flossie; bert; mr.; st.; _; mrs.; augustine; jasper; cousin; nan; captain; florida; crane; de; adelantado; menendez; jack; indians; island; swallow; spaniards; chapter; spain; french; fort; snap; ribault; dent; states; .; united; new; general; exclaimed; mother; god; helen; caroline; y; france; english; york; san; jean; south; carolina; st; laudonnière keywords: united; states; st.; spanish; spaniards; spain; ribault; mrs.; mr.; menendez; indians; god; general; french; freddie; fort; flossie; florida; english; chapter; caroline; bobbsey; bert; augustine; adelantado one topic; one dimension: said file(s): ./cache/37909.txt titles(s): The Bobbsey Twins on the Deep Blue Sea three topics; one dimension: st; bobbsey; stormy file(s): ./cache/37507.txt, ./cache/37909.txt, titles(s): The Spaniards in Florida Comprising the Notable Settlement of the Huguenots in 1564, and the History and Antiquities of St. Augustine, Founded A.D. 1565 | The Bobbsey Twins on the Deep Blue Sea | Margaret Tudor: A Romance of Old St. Augustine five topics; three dimensions: st fort augustine; bobbsey said freddie; stormy finish animals; stormy finish animals; stormy finish animals file(s): ./cache/37507.txt, ./cache/37909.txt, , , titles(s): The Spaniards in Florida Comprising the Notable Settlement of the Huguenots in 1564, and the History and Antiquities of St. Augustine, Founded A.D. 1565 | The Bobbsey Twins on the Deep Blue Sea | Margaret Tudor: A Romance of Old St. Augustine | Margaret Tudor: A Romance of Old St. Augustine | Margaret Tudor: A Romance of Old St. Augustine Type: gutenberg title: subject-saintAugustineFla-gutenberg date: 2021-06-09 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Saint Augustine (Fla.)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 24335 author: Colcock, Annie T. title: Margaret Tudor: A Romance of Old St. Augustine date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 37507 author: Fairbanks, George R. (George Rainsford) title: The Spaniards in Florida Comprising the Notable Settlement of the Huguenots in 1564, and the History and Antiquities of St. Augustine, Founded A.D. 1565 date: words: 44905.0 sentences: 1683.0 pages: flesch: 66.0 cache: ./cache/37507.txt txt: ./txt/37507.txt summary: easterly side of the river, as the Spaniards marched by land from St. Augustine in a northwesterly direction to Fort Caroline. Spanish fort within fifty years; yet so rapid has been the work of time "''The Adelantado occupied himself in fortifying his settlement at St. Augustine, as well as he could, to defend it from the French fleet if "On the next day following the return of the Adelantado at St. Augustine, the same Indians who came before returned, and said that ''a fire the French crossed to the other fort, their Indian allies in great Nine years had elapsed from the death of Menendez, and the colony at St. Augustine had slowly progressed into the settlement of a small town; but this scheme, he proceeded along the coast of Florida, and came off St. Augustine, where he landed and marched directly upon the town, which he id: 37909 author: Hope, Laura Lee title: The Bobbsey Twins on the Deep Blue Sea date: words: 44959.0 sentences: 3679.0 pages: flesch: 97.0 cache: ./cache/37909.txt txt: ./txt/37909.txt summary: Flossie and Freddie, and Bert and Nan Bobbsey, who lived with their "Don''t interrupt, dears, if you want to hear Daddy''s news," said Mrs. Bobbsey, and her husband, after looking at the letter, as if to make "I wonder what Cousin Jasper really wants of you," said Mrs. Bobbsey to Nan and Bert were looking at the big buildings of New York, when Mrs. Bobbsey turned, putting away the handkerchief she had been waving, and "Come on, Flossie," said Freddie, when Bert and Nan had walked away down "What sort of pipe?" asked Mrs. Bobbsey, thinking her little boy might "That''s an awful little boat to go on the big ocean in," said Flossie. "Well, you and Nan may stay up on deck a little longer," said Mrs. Bobbsey. father, while Mrs. Bobbsey went below with Flossie and Freddie. "Yes, that''s the _Swallow_, as Captain Crane calls his boat," Mr. Bobbsey said. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel