mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-indigenousPeoples-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/14299.txt inflating: ./tmp/input/input-file/25803.txt inflating: ./tmp/input/input-file/1452.txt inflating: ./tmp/input/input-file/37712.txt inflating: ./tmp/input/input-file/37588.txt inflating: ./tmp/input/input-file/39061.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-indigenousPeoples-gutenberg FILE: cache/1452.txt OUTPUT: txt/1452.txt FILE: cache/39061.txt OUTPUT: txt/39061.txt FILE: cache/37712.txt OUTPUT: txt/37712.txt FILE: cache/25803.txt OUTPUT: txt/25803.txt FILE: cache/14299.txt OUTPUT: txt/14299.txt FILE: cache/37588.txt OUTPUT: txt/37588.txt === file2bib.sh === id: 1452 author: Plaatje, Sol. T. (Solomon Tshekisho) title: Native Life in South Africa Before and Since the European War and the Boer Rebellion date: pages: extension: .txt txt: ./txt/1452.txt cache: ./cache/1452.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1452.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1452 txt/../ent/1452.ent 1452 txt/../wrd/1452.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1452 txt/../pos/1452.pos 14299 txt/../pos/14299.pos 37712 txt/../pos/37712.pos 25803 txt/../pos/25803.pos 14299 txt/../wrd/14299.wrd 25803 txt/../wrd/25803.wrd 37712 txt/../wrd/37712.wrd 14299 txt/../ent/14299.ent 37712 txt/../ent/37712.ent 25803 txt/../ent/25803.ent 37588 txt/../pos/37588.pos 37588 txt/../wrd/37588.wrd === file2bib.sh === id: 14299 author: Butler, Josephine Elizabeth Grey title: Native Races and the War date: pages: extension: .txt txt: ./txt/14299.txt cache: ./cache/14299.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'14299.txt' 39061 txt/../pos/39061.pos 39061 txt/../wrd/39061.wrd === file2bib.sh === id: 37712 author: Doyle, Arthur Conan title: The Crime of the Congo date: pages: extension: .txt txt: ./txt/37712.txt cache: ./cache/37712.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'37712.txt' 37588 txt/../ent/37588.ent === file2bib.sh === id: 25803 author: Wallace, Edgar title: The Keepers of the King's Peace date: pages: extension: .txt txt: ./txt/25803.txt cache: ./cache/25803.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'25803.txt' 39061 txt/../ent/39061.ent === file2bib.sh === id: 37588 author: Stables, Gordon title: The Island of Gold: A Sailor's Yarn date: pages: extension: .txt txt: ./txt/37588.txt cache: ./cache/37588.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'37588.txt' === file2bib.sh === id: 39061 author: Strang, Herbert title: Samba: A Story of the Rubber Slaves of the Congo date: pages: extension: .txt txt: ./txt/39061.txt cache: ./cache/39061.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'39061.txt' Done mapping. Reducing subject-indigenousPeoples-gutenberg === reduce.pl bib === id = 25803 author = Wallace, Edgar title = The Keepers of the King's Peace date = pages = extension = .txt mime = text/plain words = 54831 sentences = 3799 flesch = 86 summary = "Anyway, she's coming, Bones," said Hamilton; "and she's looking forward "That's my dinky little religion, dear old Miss Hamilton," said Bones. "I'm under your jolly old orders, sir," Bones said with the air of an "Why 'good-bye,' dear old Hamilton's sister?" asked Bones. "O Bosambo," said Bones, in the river dialect, "this is sad news, for I "Your pity, dear old officer, is offensive," said Bones stiffly, "an' I "Dear old Miss Hamilton," said Bones, "you saw me to-day as I really am. "O people," said Sanders, "you all know that under my King men may live "Viciously put, dear old officer, but, nevertheless, true," said Bones "Through the door, dear old officer," said the sarcastic Bones. "Painful as it is to undeceive you, dear old sir," said Bones, "We'll get away as quickly as we can, Bones," Sanders said. "I didn't tell him, dear old sir and superior captain," said Bones. cache = ./cache/25803.txt txt = ./txt/25803.txt === reduce.pl bib === id = 14299 author = Butler, Josephine Elizabeth Grey title = Native Races and the War date = pages = extension = .txt mime = text/plain words = 48329 sentences = 2226 flesch = 69 summary = condition of the native races, both in the Transvaal, and at the hands Boers, Moshesh, their Chief, appealed to the British Government for expecting to win over the Transvaal Boers, when the British Government, principles of British government, a General Election takes place in great objection many of the Boers had, and still have, to English law, long time resident in South Africa, has sent to a friend in London a To most people in South Africa who knew the Boers it was quite plain good Government in the Transvaal--justice to the natives, the 'You come from South Africa, do you,' said the great man; 'a place where native people to the Transvaal Government, and on the other hand to do THE GREAT PRINCIPLES OF BRITISH GOVERNMENT AND LAW. these principles of British Government and Law, so far as they have been A friend who has lived in South Africa, and who has had natives working cache = ./cache/14299.txt txt = ./txt/14299.txt === reduce.pl bib === === reduce.pl bib === id = 37712 author = Doyle, Arthur Conan title = The Crime of the Congo date = pages = extension = .txt mime = text/plain words = 52204 sentences = 2686 flesch = 74 summary = wrought in the Congo lands by King Leopold of Belgium and his followers to own work, Stanley laboured hard among the native chiefs, and returned to the fall of the Arab power the Congo Free State was only called upon to Already the Congo State was largely the outcome of Belgian work and of King Leopold let it be known that he had left the Congo Free State in his State within this district, (1) natives can only gather rubber on received by the general public from the Congo Free State concerned the Having shown in these two examples the way in which the Congo Free State sent in every direction, forcing natives to make rubber and to bring Congo Free State--rubber and murder, slavery in its worst form. rubber--said he had often told the sentinels not to kill the people. "The State soldiers brought in seven hands, and reported having shot cache = ./cache/37712.txt txt = ./txt/37712.txt === reduce.pl bib === id = 37588 author = Stables, Gordon title = The Island of Gold: A Sailor's Yarn date = pages = extension = .txt mime = text/plain words = 80753 sentences = 5414 flesch = 91 summary = Away went Ransey Tansey now, and opened a rough old door in a rock which "Now, look 'ee here," said Ransey, "if ye're good and brings my letters all, 'cause Babs would die like dead mother if I went away." Ransey's head is bent and Babs's hands are clasped till grace is said. Every man Jack shall be on board the _Sea Flower_ to-day, time James and I got on board the _Sea Flower_ four bells in the Halcott and Tandy were good sailors, and but little likely to trust "It is strangely like my island," said Halcott; "but that hill, far to "Far away then, Tandy and Nelda," said Halcott, resuming his narrative, "Babs is going to be very good to-day," said Tandy to his little "Then," said Halcott, "I was right, and those savages you see, Tandy, "Just there, Tandy," said Halcott, as the two stood together a day or cache = ./cache/37588.txt txt = ./txt/37588.txt === reduce.pl bib === id = 39061 author = Strang, Herbert title = Samba: A Story of the Rubber Slaves of the Congo date = pages = extension = .txt mime = text/plain words = 121470 sentences = 7992 flesch = 87 summary = said Jack, standing up in the canoe and taking a long look ahead. "Sure an' he'll be a treasure, sorr," said Barney, as he handed Mr. Martindale his cup of tea and plate of broiled fish. "Samba him uncle, berrah bad man, come to fight," said Nando "An attack in force this time, uncle," said Jack. party set off, the boy going ahead with Pat, Mr. Martindale and Jack "Your cigar has gone out, dear old man," said Jack, laying his hand on "Nando said not a man jack of 'em knows it but himself. "Well, Barney," said Jack, when Mr. Martindale's canoe had disappeared, to day, men, women, and children began to drop in at Jack's camp, many With Barney at his right hand Jack led his men "Dear old uncle!" said Jack as he handed the letter to Barney. "It was Pat that showed me where Samba was," said Jack to Barney. cache = ./cache/39061.txt txt = ./txt/39061.txt Building ./etc/reader.txt 39061 25803 37588 25803 39061 37712 number of items: 6 sum of words: 357,587 average size in words: 71,517 average readability score: 81 nouns: men; man; time; bones; people; day; way; natives; country; river; forest; hand; rubber; boy; night; water; head; eyes; camp; chief; village; hands; days; side; years; nothing; face; work; one; moment; life; children; land; place; end; morning; sea; part; war; fire; canoe; stream; enemy; party; uncle; fact; things; fort; ground; sir verbs: was; had; is; be; have; were; said; been; are; do; has; did; made; came; see; come; go; ''s; say; make; know; went; being; found; take; get; saw; left; tell; seen; told; done; think; took; heard; got; brought; put; give; called; am; going; looked; asked; let; knew; seemed; ''ve; ''m; find adjectives: little; other; old; white; great; good; many; more; own; few; same; long; such; last; first; native; dear; poor; whole; new; much; black; small; large; next; certain; true; big; strange; british; young; dead; terrible; right; full; sure; best; wild; bad; open; dark; present; only; strong; red; high; several; beautiful; ready; clear adverbs: not; so; up; now; n''t; then; out; very; only; away; down; here; as; more; back; never; too; even; just; well; far; off; again; there; all; on; once; soon; still; most; also; ever; almost; much; in; however; indeed; enough; long; no; yet; already; always; first; at; over; often; perhaps; quite; about pronouns: he; his; it; i; they; you; him; their; we; them; my; me; her; our; she; your; its; us; himself; themselves; itself; one; myself; ''em; yourself; herself; ourselves; yours; mine; uv; thy; em; meself; theirs; ''s; ay; ye; you''re; ya; thee; ours; yer; wa; oo; oneself; i''m; hisself; hers; yourselves; you''ll proper nouns: _; jack; mr.; samba; elbel; state; barney; hamilton; congo; ransey; james; martindale; halcott; tandy; government; sorr; lord; nando; bob; transvaal; sanders; king; imbono; bones; boers; africa; sir; god; england; pat; south; miss; hut; lokolobolo; bosambo; babs; lepoko; english; great; ye; cape; tansey; massa; leopold; nelda; ilombekabasi; sea; captain; free; de keywords: mr.; man; state; miss; king; jack; government; god; congo; british; boma; zaire; wiggle; white; weathereye; transvaal; tibbetti; tandy; sure; south; sir; sea; scragley; sandi; sanders; samba; rubber; ransey; ral; queen; president; patricia; pat; ochori; nelda; native; nando; mboyo; martindale; malone; makoko; mackenzie; lord; lokolobolo; lepoko; leopold; kruger; jim; james; isisi one topic; one dimension: said file(s): ./cache/14299.txt titles(s): Native Races and the War three topics; one dimension: said; jack; state file(s): ./cache/37588.txt, ./cache/39061.txt, ./cache/37712.txt titles(s): The Island of Gold: A Sailor''s Yarn | Samba: A Story of the Rubber Slaves of the Congo | The Crime of the Congo five topics; three dimensions: jack men samba; said ransey little; bones said hamilton; state congo rubber; transvaal government boers file(s): ./cache/39061.txt, ./cache/37588.txt, ./cache/25803.txt, ./cache/37712.txt, ./cache/14299.txt titles(s): Samba: A Story of the Rubber Slaves of the Congo | The Island of Gold: A Sailor''s Yarn | The Keepers of the King''s Peace | The Crime of the Congo | Native Races and the War Type: gutenberg title: subject-indigenousPeoples-gutenberg date: 2021-06-06 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Indigenous peoples" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 14299 author: Butler, Josephine Elizabeth Grey title: Native Races and the War date: words: 48329.0 sentences: 2226.0 pages: flesch: 69.0 cache: ./cache/14299.txt txt: ./txt/14299.txt summary: condition of the native races, both in the Transvaal, and at the hands Boers, Moshesh, their Chief, appealed to the British Government for expecting to win over the Transvaal Boers, when the British Government, principles of British government, a General Election takes place in great objection many of the Boers had, and still have, to English law, long time resident in South Africa, has sent to a friend in London a To most people in South Africa who knew the Boers it was quite plain good Government in the Transvaal--justice to the natives, the ''You come from South Africa, do you,'' said the great man; ''a place where native people to the Transvaal Government, and on the other hand to do THE GREAT PRINCIPLES OF BRITISH GOVERNMENT AND LAW. these principles of British Government and Law, so far as they have been A friend who has lived in South Africa, and who has had natives working id: 37712 author: Doyle, Arthur Conan title: The Crime of the Congo date: words: 52204.0 sentences: 2686.0 pages: flesch: 74.0 cache: ./cache/37712.txt txt: ./txt/37712.txt summary: wrought in the Congo lands by King Leopold of Belgium and his followers to own work, Stanley laboured hard among the native chiefs, and returned to the fall of the Arab power the Congo Free State was only called upon to Already the Congo State was largely the outcome of Belgian work and of King Leopold let it be known that he had left the Congo Free State in his State within this district, (1) natives can only gather rubber on received by the general public from the Congo Free State concerned the Having shown in these two examples the way in which the Congo Free State sent in every direction, forcing natives to make rubber and to bring Congo Free State--rubber and murder, slavery in its worst form. rubber--said he had often told the sentinels not to kill the people. "The State soldiers brought in seven hands, and reported having shot id: 1452 author: Plaatje, Sol. T. (Solomon Tshekisho) title: Native Life in South Africa Before and Since the European War and the Boer Rebellion date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 37588 author: Stables, Gordon title: The Island of Gold: A Sailor''s Yarn date: words: 80753.0 sentences: 5414.0 pages: flesch: 91.0 cache: ./cache/37588.txt txt: ./txt/37588.txt summary: Away went Ransey Tansey now, and opened a rough old door in a rock which "Now, look ''ee here," said Ransey, "if ye''re good and brings my letters all, ''cause Babs would die like dead mother if I went away." Ransey''s head is bent and Babs''s hands are clasped till grace is said. Every man Jack shall be on board the _Sea Flower_ to-day, time James and I got on board the _Sea Flower_ four bells in the Halcott and Tandy were good sailors, and but little likely to trust "It is strangely like my island," said Halcott; "but that hill, far to "Far away then, Tandy and Nelda," said Halcott, resuming his narrative, "Babs is going to be very good to-day," said Tandy to his little "Then," said Halcott, "I was right, and those savages you see, Tandy, "Just there, Tandy," said Halcott, as the two stood together a day or id: 39061 author: Strang, Herbert title: Samba: A Story of the Rubber Slaves of the Congo date: words: 121470.0 sentences: 7992.0 pages: flesch: 87.0 cache: ./cache/39061.txt txt: ./txt/39061.txt summary: said Jack, standing up in the canoe and taking a long look ahead. "Sure an'' he''ll be a treasure, sorr," said Barney, as he handed Mr. Martindale his cup of tea and plate of broiled fish. "Samba him uncle, berrah bad man, come to fight," said Nando "An attack in force this time, uncle," said Jack. party set off, the boy going ahead with Pat, Mr. Martindale and Jack "Your cigar has gone out, dear old man," said Jack, laying his hand on "Nando said not a man jack of ''em knows it but himself. "Well, Barney," said Jack, when Mr. Martindale''s canoe had disappeared, to day, men, women, and children began to drop in at Jack''s camp, many With Barney at his right hand Jack led his men "Dear old uncle!" said Jack as he handed the letter to Barney. "It was Pat that showed me where Samba was," said Jack to Barney. id: 25803 author: Wallace, Edgar title: The Keepers of the King''s Peace date: words: 54831.0 sentences: 3799.0 pages: flesch: 86.0 cache: ./cache/25803.txt txt: ./txt/25803.txt summary: "Anyway, she''s coming, Bones," said Hamilton; "and she''s looking forward "That''s my dinky little religion, dear old Miss Hamilton," said Bones. "I''m under your jolly old orders, sir," Bones said with the air of an "Why ''good-bye,'' dear old Hamilton''s sister?" asked Bones. "O Bosambo," said Bones, in the river dialect, "this is sad news, for I "Your pity, dear old officer, is offensive," said Bones stiffly, "an'' I "Dear old Miss Hamilton," said Bones, "you saw me to-day as I really am. "O people," said Sanders, "you all know that under my King men may live "Viciously put, dear old officer, but, nevertheless, true," said Bones "Through the door, dear old officer," said the sarcastic Bones. "Painful as it is to undeceive you, dear old sir," said Bones, "We''ll get away as quickly as we can, Bones," Sanders said. "I didn''t tell him, dear old sir and superior captain," said Bones. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel