mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-prisonersOfWar-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/30849.txt inflating: ./tmp/input/input-file/25049.txt inflating: ./tmp/input/input-file/40046.txt inflating: ./tmp/input/input-file/59536.txt inflating: ./tmp/input/input-file/60335.txt inflating: ./tmp/input/input-file/61474.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-prisonersOfWar-gutenberg FILE: cache/40046.txt OUTPUT: txt/40046.txt FILE: cache/60335.txt OUTPUT: txt/60335.txt FILE: cache/25049.txt OUTPUT: txt/25049.txt FILE: cache/61474.txt OUTPUT: txt/61474.txt FILE: cache/30849.txt OUTPUT: txt/30849.txt FILE: cache/59536.txt OUTPUT: txt/59536.txt === file2bib.sh === id: 25049 author: Viljoen, Ben J. (Ben Johannis) title: My Reminiscences of the Anglo-Boer War date: pages: extension: .txt txt: ./txt/25049.txt cache: ./cache/25049.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'25049.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 25049 txt/../ent/25049.ent 25049 txt/../pos/25049.pos 25049 txt/../wrd/25049.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 61474 txt/../wrd/61474.wrd 61474 txt/../pos/61474.pos 61474 txt/../ent/61474.ent === file2bib.sh === id: 61474 author: Hubbard, L. Ron (La Fayette Ron) title: Strain date: pages: extension: .txt txt: ./txt/61474.txt cache: ./cache/61474.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'61474.txt' 60335 txt/../wrd/60335.wrd 60335 txt/../pos/60335.pos 60335 txt/../ent/60335.ent 40046 txt/../pos/40046.pos === file2bib.sh === id: 60335 author: Scott, John Lee title: Narrative of a Recent Imprisonment in China after the Wreck of the Kite date: pages: extension: .txt txt: ./txt/60335.txt cache: ./cache/60335.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 189 resourceName b'60335.txt' 40046 txt/../wrd/40046.wrd 40046 txt/../ent/40046.ent === file2bib.sh === id: 40046 author: Tyler, William N. (William Nelson) title: The Dispatch Carrier and Memoirs of Andersonville Prison date: pages: extension: .txt txt: ./txt/40046.txt cache: ./cache/40046.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 194 resourceName b'40046.txt' 59536 txt/../wrd/59536.wrd 59536 txt/../pos/59536.pos 59536 txt/../ent/59536.ent 30849 txt/../wrd/30849.wrd 30849 txt/../pos/30849.pos 30849 txt/../ent/30849.ent === file2bib.sh === id: 59536 author: Havard, Aline title: Captain Lucy and Lieutenant Bob date: pages: extension: .txt txt: ./txt/59536.txt cache: ./cache/59536.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 120 resourceName b'59536.txt' === file2bib.sh === id: 30849 author: Stevenson, Robert Louis title: The Works of Robert Louis Stevenson - Swanston Edition, Vol. 20 date: pages: extension: .txt txt: ./txt/30849.txt cache: ./cache/30849.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'30849.txt' Done mapping. Reducing subject-prisonersOfWar-gutenberg === reduce.pl bib === id = 30849 author = Stevenson, Robert Louis title = The Works of Robert Louis Stevenson - Swanston Edition, Vol. 20 date = pages = extension = .txt mime = text/plain words = 136597 sentences = 9143 flesch = 87 summary = "Devil a bit; passed away like a lamb," said he. "High time," said Ronald, whom (to say the truth) I had a little Ives," said the old lady, "it's high time for you to be "My good man," said I, "I can allow myself to be placed in no such "Here, sir," said he, "is to the Great Man. I think you take me? "A good answer," said he, "and an excellent principle.--Sir, do you "Really, sir," he said, smiling a little, "you have a way of carrying "God be good to me, sir," said I, "have I something more to admire in "My good sir, remember yourself!" said I. "Yes, sir, it does; you are right," said he: "it _does_ look like "At a word, my dear fellow," said Robbie; and "Major!" he cried, "come "I think it time you were saying good-night, Mr. Ducie!" she said. cache = ./cache/30849.txt txt = ./txt/30849.txt === reduce.pl bib === === reduce.pl bib === id = 61474 author = Hubbard, L. Ron (La Fayette Ron) title = Strain date = pages = extension = .txt mime = text/plain words = 4826 sentences = 385 flesch = 86 summary = "Captain Forrester de Wolf," said the man behind the desk. Flight Officer Morrison licked overly dry lips. "You go to hell!" said Flight Officer Morrison, hysteria lurking behind back some feet from himself and watching the clever young staff captain "Gentlemen," said the intelligence officer, looking at his cigarette Flight Officer Morrison glanced at his captain. at the flight officer and tried to keep his attention upon Morrison's Not until Morrison had been gone an hour or more did Captain de Wolf carefully took himself in hand and felt the light die in his eyes. For the space of several loud and shattering drops De Wolf stood Captain de Wolf lay where they had dropped him. Captain de Wolf tried to drop his eyes. A few hours later the intelligence officer was making out his report. plane, Captain Forrester de Wolf and Flight Officer Morrison. Captain de Wolf and Flight Officer Morrison are cache = ./cache/61474.txt txt = ./txt/61474.txt === reduce.pl bib === id = 59536 author = Havard, Aline title = Captain Lucy and Lieutenant Bob date = pages = extension = .txt mime = text/plain words = 75234 sentences = 4574 flesch = 86 summary = "Marian," said Mrs. Gordon, looking at her little cousin's delicate "Lucy," said Mrs. Gordon, looking at her daughter's completed pile, "Marian's almost well now, William," said Lucy, to smooth things over, "Can you believe Bob will come home an officer in two weeks, Lucy? "I won't ask to be transferred to-day, anyhow," said Bob, looking down All the way across the parade, Bob had made Lucy and Marian laugh at it," said Bob, smiling at Lucy's big, reproachful eyes and the little, "All right; come on, Bob," said Lucy. Bob had only to say good-bye to Lucy, Marian and William, which he sat out on the cool piazza, where William ate his supper, while Mrs. Gordon told the little news she had of Bob's fellow officers and "Yes--when," said Lucy without much enthusiasm, thinking of Bob. When Marian and Lucy had left the room, Major Gordon came back from cache = ./cache/59536.txt txt = ./txt/59536.txt === reduce.pl bib === id = 40046 author = Tyler, William N. (William Nelson) title = The Dispatch Carrier and Memoirs of Andersonville Prison date = pages = extension = .txt mime = text/plain words = 34157 sentences = 2256 flesch = 93 summary = The first of February, 1862, we got marching orders for St. Louis, Mo. Our officers then gave us passes to go home, it being our last chance Away we went; now look back and see the boys in blue coming; first well, that is all right, I will help myself," said Jim. Away he went. Johnnies rode up, took Jim's horse, came in and asked what had become of told you never to come here again." Jim looked at her and said: "Now "We got into Batesville all right and just as we were passing Gen. Curtis' headquarters my captain looked up and saw us coming. I went back, got my horse and put him in an old shanty back of the house our horses and one man went back in a small boat and got it and cut the rebel sergeant came in every day and said, "All you men that will come cache = ./cache/40046.txt txt = ./txt/40046.txt === reduce.pl bib === id = 60335 author = Scott, John Lee title = Narrative of a Recent Imprisonment in China after the Wreck of the Kite date = pages = extension = .txt mime = text/plain words = 23134 sentences = 926 flesch = 75 summary = rights--Jolly-boat returns--Chinese--Leave the wreck. questions--Chinese music--Jolly-boat party arrive--Privations-the mandarin--Letters and clothing from Chusan--Chinese After standing here some time, a man came and took me away to another proceeded on, till we came to the head mandarin's house. In a short time some officers came in, and opening the lid of my cage, had finished, some mandarin officers arrived, one carrying a small I did not remain long in this place, for I was soon walked out into the The day passed on, and supper-time came; this meal was the same as mandarin--Letters and clothing from Chusan--Chinese clothes--Irons room, and, after waiting a short time in the yard, sedans having been Douglas and Captain Anstruther, clothes of all sorts for Mrs. Noble, and a quantity for the child which was drowned; but nothing told them that the mandarins said we were going to Chusan in six days, taken; and each sedan being placed in a separate boat, we were soon cache = ./cache/60335.txt txt = ./txt/60335.txt Building ./etc/reader.txt 30849 59536 40046 59536 40046 30849 number of items: 6 sum of words: 273,948 average size in words: 54,789 average readability score: 85 nouns: man; time; day; hand; way; night; face; eyes; sir; room; men; moment; house; door; morning; head; nothing; place; hands; side; one; something; name; road; prisoners; feet; thing; anything; word; voice; part; days; soldier; things; words; water; heart; life; end; war; mother; gentleman; country; table; fire; soldiers; air; lady; officer; hour verbs: was; had; were; said; be; have; is; do; been; are; did; came; see; go; ''s; come; made; know; get; went; think; am; say; got; take; make; took; tell; looked; found; let; has; told; put; saw; going; being; turned; gave; asked; thought; seemed; give; left; began; taken; heard; brought; cried; look adjectives: little; good; old; other; more; own; first; last; great; much; same; young; long; next; few; many; sure; least; small; short; new; cold; such; large; dear; whole; white; ready; open; better; poor; best; several; right; hard; second; german; french; possible; sudden; big; fine; glad; dark; full; only; certain; able; high; red adverbs: not; so; up; n''t; out; now; very; down; here; then; back; as; again; only; just; off; never; there; too; more; all; in; away; still; well; even; on; soon; over; far; once; much; almost; enough; yet; about; perhaps; no; most; rather; already; always; long; quite; right; together; ever; indeed; first; before pronouns: i; he; it; you; my; his; we; me; her; she; him; they; our; us; your; them; their; myself; himself; its; yourself; herself; themselves; ourselves; mine; ''s; one; itself; yours; ours; ''em; hers; ye; you''ns; theirs; thy; yourselves; you,--you; oneself; on''t; mean,--you; je; is,--i; interestin; hisself; em proper nouns: _; lucy; bob; mr.; marian; gordon; mrs.; i.; rowley; major; julia; captain; william; anne; flora; miss; romaine; elizabeth; de; ronald; leslie; jim; benton; colonel; st.; sergeant; english; byfield; karl; edinburgh; god; france; alain; general; sir; m.; bertrand; father; chevenix; sim; chinese; chapter; robbie; douglas; castle; viscount; mother; gilchrist; street; chusan keywords: mrs.; captain; mr.; man; major; yves; yanks; wolf; william; viscount; union; street; st.; sim; sheepshanks; sergeant; saint; rowley; ronald; romaine; robbie; rebel; noble; morrison; miss; marian; lucy; lieut; leslie; lascars; karl; julia; johnnies; jim; ives; gordon; good; goguelat; god; gilchrist; german; french; france; flora; fenn; english; england; elizabeth; edinburgh; ducie one topic; one dimension: said file(s): ./cache/40046.txt titles(s): The Dispatch Carrier and Memoirs of Andersonville Prison three topics; one dimension: said; lucy; wrists file(s): ./cache/30849.txt, ./cache/59536.txt, titles(s): The Works of Robert Louis Stevenson - Swanston Edition, Vol. 20 | Captain Lucy and Lieutenant Bob | My Reminiscences of the Anglo-Boer War five topics; three dimensions: said mr man; lucy bob said; time chinese came; reports conclude twisted; reports conclude twisted file(s): ./cache/30849.txt, ./cache/59536.txt, ./cache/60335.txt, , titles(s): The Works of Robert Louis Stevenson - Swanston Edition, Vol. 20 | Captain Lucy and Lieutenant Bob | Narrative of a Recent Imprisonment in China after the Wreck of the Kite | My Reminiscences of the Anglo-Boer War | My Reminiscences of the Anglo-Boer War Type: gutenberg title: subject-prisonersOfWar-gutenberg date: 2021-06-09 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Prisoners of war" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 59536 author: Havard, Aline title: Captain Lucy and Lieutenant Bob date: words: 75234.0 sentences: 4574.0 pages: flesch: 86.0 cache: ./cache/59536.txt txt: ./txt/59536.txt summary: "Marian," said Mrs. Gordon, looking at her little cousin''s delicate "Lucy," said Mrs. Gordon, looking at her daughter''s completed pile, "Marian''s almost well now, William," said Lucy, to smooth things over, "Can you believe Bob will come home an officer in two weeks, Lucy? "I won''t ask to be transferred to-day, anyhow," said Bob, looking down All the way across the parade, Bob had made Lucy and Marian laugh at it," said Bob, smiling at Lucy''s big, reproachful eyes and the little, "All right; come on, Bob," said Lucy. Bob had only to say good-bye to Lucy, Marian and William, which he sat out on the cool piazza, where William ate his supper, while Mrs. Gordon told the little news she had of Bob''s fellow officers and "Yes--when," said Lucy without much enthusiasm, thinking of Bob. When Marian and Lucy had left the room, Major Gordon came back from id: 61474 author: Hubbard, L. Ron (La Fayette Ron) title: Strain date: words: 4826.0 sentences: 385.0 pages: flesch: 86.0 cache: ./cache/61474.txt txt: ./txt/61474.txt summary: "Captain Forrester de Wolf," said the man behind the desk. Flight Officer Morrison licked overly dry lips. "You go to hell!" said Flight Officer Morrison, hysteria lurking behind back some feet from himself and watching the clever young staff captain "Gentlemen," said the intelligence officer, looking at his cigarette Flight Officer Morrison glanced at his captain. at the flight officer and tried to keep his attention upon Morrison''s Not until Morrison had been gone an hour or more did Captain de Wolf carefully took himself in hand and felt the light die in his eyes. For the space of several loud and shattering drops De Wolf stood Captain de Wolf lay where they had dropped him. Captain de Wolf tried to drop his eyes. A few hours later the intelligence officer was making out his report. plane, Captain Forrester de Wolf and Flight Officer Morrison. Captain de Wolf and Flight Officer Morrison are id: 60335 author: Scott, John Lee title: Narrative of a Recent Imprisonment in China after the Wreck of the Kite date: words: 23134.0 sentences: 926.0 pages: flesch: 75.0 cache: ./cache/60335.txt txt: ./txt/60335.txt summary: rights--Jolly-boat returns--Chinese--Leave the wreck. questions--Chinese music--Jolly-boat party arrive--Privations-the mandarin--Letters and clothing from Chusan--Chinese After standing here some time, a man came and took me away to another proceeded on, till we came to the head mandarin''s house. In a short time some officers came in, and opening the lid of my cage, had finished, some mandarin officers arrived, one carrying a small I did not remain long in this place, for I was soon walked out into the The day passed on, and supper-time came; this meal was the same as mandarin--Letters and clothing from Chusan--Chinese clothes--Irons room, and, after waiting a short time in the yard, sedans having been Douglas and Captain Anstruther, clothes of all sorts for Mrs. Noble, and a quantity for the child which was drowned; but nothing told them that the mandarins said we were going to Chusan in six days, taken; and each sedan being placed in a separate boat, we were soon id: 30849 author: Stevenson, Robert Louis title: The Works of Robert Louis Stevenson - Swanston Edition, Vol. 20 date: words: 136597.0 sentences: 9143.0 pages: flesch: 87.0 cache: ./cache/30849.txt txt: ./txt/30849.txt summary: "Devil a bit; passed away like a lamb," said he. "High time," said Ronald, whom (to say the truth) I had a little Ives," said the old lady, "it''s high time for you to be "My good man," said I, "I can allow myself to be placed in no such "Here, sir," said he, "is to the Great Man. I think you take me? "A good answer," said he, "and an excellent principle.--Sir, do you "Really, sir," he said, smiling a little, "you have a way of carrying "God be good to me, sir," said I, "have I something more to admire in "My good sir, remember yourself!" said I. "Yes, sir, it does; you are right," said he: "it _does_ look like "At a word, my dear fellow," said Robbie; and "Major!" he cried, "come "I think it time you were saying good-night, Mr. Ducie!" she said. id: 40046 author: Tyler, William N. (William Nelson) title: The Dispatch Carrier and Memoirs of Andersonville Prison date: words: 34157.0 sentences: 2256.0 pages: flesch: 93.0 cache: ./cache/40046.txt txt: ./txt/40046.txt summary: The first of February, 1862, we got marching orders for St. Louis, Mo. Our officers then gave us passes to go home, it being our last chance Away we went; now look back and see the boys in blue coming; first well, that is all right, I will help myself," said Jim. Away he went. Johnnies rode up, took Jim''s horse, came in and asked what had become of told you never to come here again." Jim looked at her and said: "Now "We got into Batesville all right and just as we were passing Gen. Curtis'' headquarters my captain looked up and saw us coming. I went back, got my horse and put him in an old shanty back of the house our horses and one man went back in a small boat and got it and cut the rebel sergeant came in every day and said, "All you men that will come id: 25049 author: Viljoen, Ben J. (Ben Johannis) title: My Reminiscences of the Anglo-Boer War date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel