mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-charities-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/29505.txt inflating: ./tmp/input/input-file/1025.txt inflating: ./tmp/input/input-file/42363.txt inflating: ./tmp/input/input-file/43625.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-charities-gutenberg FILE: cache/1025.txt OUTPUT: txt/1025.txt FILE: cache/29505.txt OUTPUT: txt/29505.txt FILE: cache/43625.txt OUTPUT: txt/43625.txt FILE: cache/42363.txt OUTPUT: txt/42363.txt === file2bib.sh === id: 1025 author: Rumford, Benjamin, Graf von title: Essays; Political, Economical, and Philosophical — Volume 1 date: pages: extension: .txt txt: ./txt/1025.txt cache: ./cache/1025.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'1025.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1025 txt/../ent/1025.ent 1025 txt/../wrd/1025.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1025 txt/../pos/1025.pos 29505 txt/../pos/29505.pos 29505 txt/../ent/29505.ent 29505 txt/../wrd/29505.wrd === file2bib.sh === id: 29505 author: Faudel, Henry title: Suggestions to the Jews for improvement in reference to their charities, education, and general government date: pages: extension: .txt txt: ./txt/29505.txt cache: ./cache/29505.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'29505.txt' 43625 txt/../wrd/43625.wrd 43625 txt/../pos/43625.pos 43625 txt/../ent/43625.ent 42363 txt/../wrd/42363.wrd 42363 txt/../pos/42363.pos === file2bib.sh === id: 43625 author: Various title: The Survey, Volume XXX, Number 1, April 5, 1913 date: pages: extension: .txt txt: ./txt/43625.txt cache: ./cache/43625.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'43625.txt' 42363 txt/../ent/42363.ent === file2bib.sh === id: 42363 author: Bercovici, Konrad title: Crimes of Charity date: pages: extension: .txt txt: ./txt/42363.txt cache: ./cache/42363.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'42363.txt' Done mapping. Reducing subject-charities-gutenberg === reduce.pl bib === id = 42363 author = Bercovici, Konrad title = Crimes of Charity date = pages = extension = .txt mime = text/plain words = 59299 sentences = 5011 flesch = 89 summary = children--a fine woman, a good mother, a real lady, if you want to know. "Why did you leave Mrs. S., that poor woman, without coal?" I asked. A woman came, looked around, questioned me and went away. The next day I went to the office and gave a report of my work. of sufferers there." Again the young man thinks of the good work, but The records of the institution were looked up, and every man and woman A woman's pension has been discontinued _because her children looked too woman with two children, one eight and one six years old. the investigator, Mrs. G., herself a mother of children, explained to A woman, Bertha S., about thirty years old, still good looking, despite old woman might take his last days into his own hands and come out with rooms--my children are on the streets." The investigator, Mrs. B., uses cache = ./cache/42363.txt txt = ./txt/42363.txt === reduce.pl bib === === reduce.pl bib === id = 43625 author = Various title = The Survey, Volume XXX, Number 1, April 5, 1913 date = pages = extension = .txt mime = text/plain words = 40357 sentences = 2001 flesch = 67 summary = comprehensive review of emergent relief work following great disasters. Act II shows William working in different places, and for short times, hearten him in his great work for years to come." It is all in the way cause, but the physicians on the case agreed in stating that lead formed The draft of a new law, prepared after months of careful investigation work unceasingly in state and nation for trade disease compensation. the new state insurance law in Ohio has rendered justice in such cases classes of diseases, a trained social worker was set at work in January, social follow-up work, whereby the patients are held at the clinic until condition was good, as things go for men in the coal fields, and the Yet the game has cost the state, the operators and the miners millions fact in most instances the reason the men do not work more days in a cache = ./cache/43625.txt txt = ./txt/43625.txt === reduce.pl bib === id = 29505 author = Faudel, Henry title = Suggestions to the Jews for improvement in reference to their charities, education, and general government date = pages = extension = .txt mime = text/plain words = 8993 sentences = 286 flesch = 52 summary = London alone, a number of distinct Jewish Congregations, _independent_ general co-operation, and for one common fund, every kindly feeling The anxiety of the poor Jews for instruction,--of the trading classes carried out, will tend to elevate the Jews from their present degraded contribute to the general _honour_ or _disgrace_, it is our duty to subsistence, an evil which not only affects the present generation, Let us contrast in our minds, for one moment, the present state of aloud, "There is a feeling of hope stirring among the Jews--they seek power, the Jews cannot stand still and be at the same time respected. aged would be provided for--the ignorant instructed--and, as a general The great sums distributed in known or public charities are more than Let, then, the present _funds_ of all the charities be united, with received--with a power such as this pressing upon the general cache = ./cache/29505.txt txt = ./txt/29505.txt Building ./etc/reader.txt 42363 43625 29505 42363 43625 29505 number of items: 4 sum of words: 108,649 average size in words: 36,216 average readability score: 69 nouns: children; woman; man; work; men; day; charity; house; time; mother; room; years; money; one; people; office; dollars; investigator; door; women; state; boy; home; week; case; life; way; miners; charities; coal; child; law; eyes; bread; place; days; country; face; fact; year; months; business; institution; family; cents; system; others; operators; night; hand verbs: is; was; are; be; had; have; were; has; do; been; did; get; know; go; told; said; ''s; made; see; asked; went; come; give; want; does; called; take; given; put; came; am; make; looked; say; work; think; found; let; wanted; tell; sent; being; knew; got; took; taken; keep; answered; thought; going adjectives: other; poor; old; few; more; good; little; many; great; such; new; social; own; last; same; whole; first; much; young; next; sick; public; necessary; big; better; mental; present; certain; several; jewish; hungry; general; right; real; large; rich; cold; small; industrial; most; best; bad; possible; open; human; less; important; enough; high; able adverbs: not; out; so; up; n''t; then; only; very; now; here; again; away; as; well; there; never; even; more; too; down; in; all; still; once; just; soon; also; most; back; on; much; off; always; yet; about; ever; immediately; home; far; long; thus; almost; over; later; however; together; ago; of; instead; enough pronouns: i; he; it; they; she; his; her; you; their; me; them; my; him; we; our; your; its; us; himself; themselves; myself; herself; one; yourself; itself; thy; mine; yours; theirs; ourselves; ''s; well_--they; thee; subscribers"--they; hers; d''you proper nouns: _; mr.; mrs.; manager; cram; west; new; jews; york; virginia; s.; united; creek; b.; street; sam; william; r.; m.; d.; house; cabin; w.; survey; ohio; states; lawson; god; association; jew; red; paint; colton; pittsburgh; neighborhood; cross; governor; congress; wilson; society; russia; labor; charity; america; san; president; john; h.; g.; francisco keywords: work; mr.; charity; york; woman; william; west; virginia; united; street; state; sam; red; poor; ohio; object; new; mrs.; manager; man; lawson; jews; jewish; illustration; house; home; day; cross; creek; cram; council; child; cabin one topic; one dimension: children file(s): titles(s): Essays; Political, Economical, and Philosophical — Volume 1 three topics; one dimension: children; work; shamed file(s): ./cache/42363.txt, ./cache/43625.txt, titles(s): Crimes of Charity | The Survey, Volume XXX, Number 1, April 5, 1913 | Essays; Political, Economical, and Philosophical — Volume 1 five topics; three dimensions: children woman man; work men state; functions loans achieving; functions loans achieving; functions loans achieving file(s): ./cache/42363.txt, ./cache/43625.txt, , , titles(s): Crimes of Charity | The Survey, Volume XXX, Number 1, April 5, 1913 | Essays; Political, Economical, and Philosophical — Volume 1 | Essays; Political, Economical, and Philosophical — Volume 1 | Essays; Political, Economical, and Philosophical — Volume 1 Type: gutenberg title: subject-charities-gutenberg date: 2021-06-01 time: 19:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Charities" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 42363 author: Bercovici, Konrad title: Crimes of Charity date: words: 59299.0 sentences: 5011.0 pages: flesch: 89.0 cache: ./cache/42363.txt txt: ./txt/42363.txt summary: children--a fine woman, a good mother, a real lady, if you want to know. "Why did you leave Mrs. S., that poor woman, without coal?" I asked. A woman came, looked around, questioned me and went away. The next day I went to the office and gave a report of my work. of sufferers there." Again the young man thinks of the good work, but The records of the institution were looked up, and every man and woman A woman''s pension has been discontinued _because her children looked too woman with two children, one eight and one six years old. the investigator, Mrs. G., herself a mother of children, explained to A woman, Bertha S., about thirty years old, still good looking, despite old woman might take his last days into his own hands and come out with rooms--my children are on the streets." The investigator, Mrs. B., uses id: 29505 author: Faudel, Henry title: Suggestions to the Jews for improvement in reference to their charities, education, and general government date: words: 8993.0 sentences: 286.0 pages: flesch: 52.0 cache: ./cache/29505.txt txt: ./txt/29505.txt summary: London alone, a number of distinct Jewish Congregations, _independent_ general co-operation, and for one common fund, every kindly feeling The anxiety of the poor Jews for instruction,--of the trading classes carried out, will tend to elevate the Jews from their present degraded contribute to the general _honour_ or _disgrace_, it is our duty to subsistence, an evil which not only affects the present generation, Let us contrast in our minds, for one moment, the present state of aloud, "There is a feeling of hope stirring among the Jews--they seek power, the Jews cannot stand still and be at the same time respected. aged would be provided for--the ignorant instructed--and, as a general The great sums distributed in known or public charities are more than Let, then, the present _funds_ of all the charities be united, with received--with a power such as this pressing upon the general id: 1025 author: Rumford, Benjamin, Graf von title: Essays; Political, Economical, and Philosophical — Volume 1 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 43625 author: Various title: The Survey, Volume XXX, Number 1, April 5, 1913 date: words: 40357.0 sentences: 2001.0 pages: flesch: 67.0 cache: ./cache/43625.txt txt: ./txt/43625.txt summary: comprehensive review of emergent relief work following great disasters. Act II shows William working in different places, and for short times, hearten him in his great work for years to come." It is all in the way cause, but the physicians on the case agreed in stating that lead formed The draft of a new law, prepared after months of careful investigation work unceasingly in state and nation for trade disease compensation. the new state insurance law in Ohio has rendered justice in such cases classes of diseases, a trained social worker was set at work in January, social follow-up work, whereby the patients are held at the clinic until condition was good, as things go for men in the coal fields, and the Yet the game has cost the state, the operators and the miners millions fact in most instances the reason the men do not work more days in a ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel