mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named classification-P-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/15649.txt inflating: ./tmp/input/input-file/18818.txt inflating: ./tmp/input/input-file/30867.txt inflating: ./tmp/input/input-file/12629.txt inflating: ./tmp/input/input-file/13182.txt inflating: ./tmp/input/input-file/25040.txt inflating: ./tmp/input/input-file/24974.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named classification-P-gutenberg FILE: cache/30867.txt OUTPUT: txt/30867.txt FILE: cache/24974.txt OUTPUT: txt/24974.txt FILE: cache/18818.txt OUTPUT: txt/18818.txt FILE: cache/25040.txt OUTPUT: txt/25040.txt FILE: cache/15649.txt OUTPUT: txt/15649.txt FILE: cache/12629.txt OUTPUT: txt/12629.txt FILE: cache/13182.txt OUTPUT: txt/13182.txt === file2bib.sh === id: 24974 author: Ontario. Department of Education title: Ontario Teachers' Manuals: Literature date: pages: extension: .txt txt: ./txt/24974.txt cache: ./cache/24974.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24974.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 25040 author: Belcourt, N. A. (Napoléon-Antoine) title: Bilingualism: Address delivered before the Quebec Canadian Club At Quebec, Tuesday, March 28th, 1916 date: pages: extension: .txt txt: ./txt/25040.txt cache: ./cache/25040.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'25040.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 25040 txt/../wrd/25040.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24974 txt/../ent/24974.ent 25040 txt/../ent/25040.ent 25040 txt/../pos/25040.pos 24974 txt/../wrd/24974.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24974 txt/../pos/24974.pos 30867 txt/../wrd/30867.wrd 30867 txt/../pos/30867.pos 18818 txt/../pos/18818.pos 18818 txt/../wrd/18818.wrd 15649 txt/../pos/15649.pos 18818 txt/../ent/18818.ent 15649 txt/../ent/15649.ent 30867 txt/../ent/30867.ent === file2bib.sh === id: 30867 author: Calin, Harold title: What Need of Man? date: pages: extension: .txt txt: ./txt/30867.txt cache: ./cache/30867.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'30867.txt' 15649 txt/../wrd/15649.wrd === file2bib.sh === id: 18818 author: Powell, John Wesley title: On the Evolution of Language First Annual Report of the Bureau of Ethnology to the Secretary of the Smithsonian Institution, 1879-80, Government Printing Office, Washington, 1881, pages 1-16 date: pages: extension: .txt txt: ./txt/18818.txt cache: ./cache/18818.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'18818.txt' === file2bib.sh === id: 15649 author: Besnier, Pierre title: A Philosophicall Essay for the Reunion of the Languages Or, The Art of Knowing All by the Mastery of One date: pages: extension: .txt txt: ./txt/15649.txt cache: ./cache/15649.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'15649.txt' 12629 txt/../pos/12629.pos 12629 txt/../wrd/12629.wrd 12629 txt/../ent/12629.ent 13182 txt/../pos/13182.pos 13182 txt/../ent/13182.ent 13182 txt/../wrd/13182.wrd === file2bib.sh === id: 12629 author: Sapir, Edward title: Language: An Introduction to the Study of Speech date: pages: extension: .txt txt: ./txt/12629.txt cache: ./cache/12629.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'12629.txt' === file2bib.sh === id: 13182 author: nan title: Prefaces and Prologues to Famous Books with Introductions, Notes and Illustrations date: pages: extension: .txt txt: ./txt/13182.txt cache: ./cache/13182.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'13182.txt' Done mapping. Reducing classification-P-gutenberg === reduce.pl bib === id = 30867 author = Calin, Harold title = What Need of Man? date = pages = extension = .txt mime = text/plain words = 5156 sentences = 525 flesch = 88 summary = traveling at escape velocity, being oriented and controlled completely Lynds was assigned the first flight at escape velocity. "Let's don't count chickens," Bannister said tautly. fourteen minutes the capsule detached into orbit just under escape "Now do you understand about the manual controls?" Bannister said. parabolic to the capsule, almost like the start of an orbit, but at a Harry, how long was I out?" We heard Lynds' voice come alive Bannister's controls are supposed to bring me back." "Let me tell you something, Harry," he said. "Bannister, do you know what it feels like to "Look at the instruments and remember, Bannister. Lynds was about seventy miles up, his velocity down to a point or two I looked at Bannister. Bannister looked at me for a second. We both looked at the controls now. It would not do to have Bannister looked upon as a bad gambit, cache = ./cache/30867.txt txt = ./txt/30867.txt === reduce.pl bib === id = 18818 author = Powell, John Wesley title = On the Evolution of Language First Annual Report of the Bureau of Ethnology to the Secretary of the Smithsonian Institution, 1879-80, Government Printing Office, Washington, 1881, pages 1-16 date = pages = extension = .txt mime = text/plain words = 6696 sentences = 349 flesch = 62 summary = entering into combination to form the new word is somewhat changed--the words are used to form cases in nouns, and a variety of illustrations is, to indicate mode, tense, number, person, gender, etc., of verbs, When words are combined by compounding, the formative elements cannot but in those languages where article pronouns are not found the verbs languages to form new words with which to express new ideas. In English the relation of words is expressed both by placement idea expressed by the word inflected; thus a noun is qualified by case the verb is used for the noun, and in so doing the Indian names the Thus the verb of an Indian language contains within itself incorporated In some languages the article pronoun constitutes a distinct word, but pronoun, and for mode and tense in the verb, to that extent the parts of voice of the verb, the English language has undifferentiated parts of cache = ./cache/18818.txt txt = ./txt/18818.txt === reduce.pl bib === id = 13182 author = nan title = Prefaces and Prologues to Famous Books with Introductions, Notes and Illustrations date = pages = extension = .txt mime = text/plain words = 173376 sentences = 6771 flesch = 64 summary = such time as he had accomplished this said work, it liked him to send read in this said book and work, that they take the good and honest And for to pass the time this book shall be pleasant to read in; of that breath-giving life which God hath cast upon time and dust, as And though it hath pleased God to reserve the art of reading men's that could never yet discover the way and reason of nature's working, even the world itself and the nature of things and of the mind. that the mind may exercise over the nature of things the authority came into my mind that our old English poet, Chaucer, in many things the works of the two authors we may read their manners and natural the man who, book in hand, steps in front of the work of art itself. cache = ./cache/13182.txt txt = ./txt/13182.txt === reduce.pl bib === === reduce.pl bib === id = 12629 author = Sapir, Edward title = Language: An Introduction to the Study of Speech date = pages = extension = .txt mime = text/plain words = 78758 sentences = 4561 flesch = 63 summary = nature of a symbol, a word, an element of language. One word more as to the relation between language and thought. The true, significant elements of language are generally sequences of the language truly a pure concept-word (type A) instead of being of a Some languages, like Latin, express practically all relations by means radical nucleus of the word as is an English element like _-er_ from the language to express every concrete idea by an independent word or Language in its fundamental forms is the symbolic expression of human fusing languages that express the syntactic relations in pure form, that symbolic languages that do not express relational concepts in the word agglutinative languages that express these same concepts in the word--in languages in which the syntactic relations are expressed in mixed form, thought, to change every sound, word, and concrete concept of a language cache = ./cache/12629.txt txt = ./txt/12629.txt === reduce.pl bib === === reduce.pl bib === id = 15649 author = Besnier, Pierre title = A Philosophicall Essay for the Reunion of the Languages Or, The Art of Knowing All by the Mastery of One date = pages = extension = .txt mime = text/plain words = 10532 sentences = 310 flesch = 54 summary = easie way to become universally acquainted with the Languages, and to quit First, that _there is a certain accord between the Severall Languages:_ and mastery of the Languages, making it appear to the world by a sensible After having made choice of a Language in order to the design, I am in the expressing the sounds of all the distinguishing characters of each Language For this reason altho I consider every Language in its greatest perfection, 'Tis by their Principles I reduce to naturall reason all imaginable ways by Language of each Nation as they are commonly in its manners, or from the communicated to their Language, and that all their words should breath My sense is much the same of other Languages, but because reason it selfe The only way (as I imagine) to Learn the Languages, and that in what number Languages so distanc't in appearance one from another; If at any time it cache = ./cache/15649.txt txt = ./txt/15649.txt Building ./etc/reader.txt 13182 12629 15649 12629 13182 18818 number of items: 7 sum of words: 274,518 average size in words: 54,903 average readability score: 66 nouns: language; words; man; word; languages; time; men; nature; speech; form; things; art; world; work; life; part; elements; mind; nothing; element; way; book; forms; others; concepts; history; number; sense; reason; use; order; place; day; sentence; poetry; one; knowledge; expression; parts; works; type; subject; sounds; point; power; matter; fact; people; poet; kind verbs: is; be; are; have; was; has; been; had; were; do; say; being; make; made; said; see; does; did; found; find; used; let; know; take; given; give; expressed; am; having; according; come; think; set; done; go; written; known; read; put; thought; speak; taken; makes; call; become; called; seem; seen; seems; left adjectives: other; such; same; many; own; more; great; first; certain; true; general; little; new; human; phonetic; linguistic; much; good; present; old; radical; different; common; particular; english; most; natural; few; modern; whole; distinct; long; necessary; greater; second; least; last; formal; relational; noble; single; possible; greatest; simple; less; grammatical; very; real; ancient; best adverbs: not; so; more; only; as; most; now; then; well; far; very; even; also; thus; out; always; up; therefore; never; too; yet; much; however; here; still; sometimes; often; rather; perhaps; ever; just; long; merely; no; all; indeed; again; once; less; first; together; down; almost; easily; already; there; at; off; on; e.g. pronouns: it; i; his; he; we; they; their; its; them; our; him; my; us; you; me; itself; themselves; himself; her; your; one; myself; she; ourselves; herself; thy; theirs; mine; yourself; thee; yours; ours; oneself; ne; severall; yourselves; undermin''d; thyself; tackin; stress[87]--an; sought,"--"they; nature.--having; judg''d; iv; inself; fear,[4; basque,[128; awawkwardnessthey; ''s; ''em proper nouns: _; english; footnote; god; |; shakespeare; french; hath; latin; chaucer; poet; lord; german; christ; king; greek; england; languages; church; france; john; homer; virgil; sir; language; bannister; t; metre; ii; saxon; nootka; pope; nature; henry; e; b; anglo; poetry; d; chinese; de; iv; aristotle; s; milton; charles; poems; holy; germanic; fot keywords: word; language; english; latin; french; footnote; art; work; virgil; time; thing; speech; sound; sir; shakespeare; saxon; reader; principle; preface; pope; poetry; poet; poems; ovid; nootka; nature; nation; mind; milton; man; majesty; lynds; lord; like; life; know; king; john; indian; homer; holy; history; henry; hath; harry; greek; great; good; god; germanic one topic; one dimension: language file(s): ./cache/15649.txt titles(s): A Philosophicall Essay for the Reunion of the Languages Or, The Art of Knowing All by the Mastery of One three topics; one dimension: man; language; channels file(s): ./cache/13182.txt, ./cache/12629.txt, titles(s): Prefaces and Prologues to Famous Books with Introductions, Notes and Illustrations | Language: An Introduction to the Study of Speech | Bilingualism: Address delivered before the Quebec Canadian Club At Quebec, Tuesday, March 28th, 1916 five topics; three dimensions: man time men; language languages words; bannister controls lynds; maybe genders tenses; maybe genders tenses file(s): ./cache/13182.txt, ./cache/12629.txt, ./cache/30867.txt, , titles(s): Prefaces and Prologues to Famous Books with Introductions, Notes and Illustrations | Language: An Introduction to the Study of Speech | What Need of Man? | Bilingualism: Address delivered before the Quebec Canadian Club At Quebec, Tuesday, March 28th, 1916 | Bilingualism: Address delivered before the Quebec Canadian Club At Quebec, Tuesday, March 28th, 1916 Type: gutenberg title: classification-P-gutenberg date: 2021-05-29 time: 12:05 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: classification:"P" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 25040 author: Belcourt, N. A. (Napoléon-Antoine) title: Bilingualism: Address delivered before the Quebec Canadian Club At Quebec, Tuesday, March 28th, 1916 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 15649 author: Besnier, Pierre title: A Philosophicall Essay for the Reunion of the Languages Or, The Art of Knowing All by the Mastery of One date: words: 10532.0 sentences: 310.0 pages: flesch: 54.0 cache: ./cache/15649.txt txt: ./txt/15649.txt summary: easie way to become universally acquainted with the Languages, and to quit First, that _there is a certain accord between the Severall Languages:_ and mastery of the Languages, making it appear to the world by a sensible After having made choice of a Language in order to the design, I am in the expressing the sounds of all the distinguishing characters of each Language For this reason altho I consider every Language in its greatest perfection, ''Tis by their Principles I reduce to naturall reason all imaginable ways by Language of each Nation as they are commonly in its manners, or from the communicated to their Language, and that all their words should breath My sense is much the same of other Languages, but because reason it selfe The only way (as I imagine) to Learn the Languages, and that in what number Languages so distanc''t in appearance one from another; If at any time it id: 30867 author: Calin, Harold title: What Need of Man? date: words: 5156.0 sentences: 525.0 pages: flesch: 88.0 cache: ./cache/30867.txt txt: ./txt/30867.txt summary: traveling at escape velocity, being oriented and controlled completely Lynds was assigned the first flight at escape velocity. "Let''s don''t count chickens," Bannister said tautly. fourteen minutes the capsule detached into orbit just under escape "Now do you understand about the manual controls?" Bannister said. parabolic to the capsule, almost like the start of an orbit, but at a Harry, how long was I out?" We heard Lynds'' voice come alive Bannister''s controls are supposed to bring me back." "Let me tell you something, Harry," he said. "Bannister, do you know what it feels like to "Look at the instruments and remember, Bannister. Lynds was about seventy miles up, his velocity down to a point or two I looked at Bannister. Bannister looked at me for a second. We both looked at the controls now. It would not do to have Bannister looked upon as a bad gambit, id: 24974 author: Ontario. Department of Education title: Ontario Teachers' Manuals: Literature date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 18818 author: Powell, John Wesley title: On the Evolution of Language First Annual Report of the Bureau of Ethnology to the Secretary of the Smithsonian Institution, 1879-80, Government Printing Office, Washington, 1881, pages 1-16 date: words: 6696.0 sentences: 349.0 pages: flesch: 62.0 cache: ./cache/18818.txt txt: ./txt/18818.txt summary: entering into combination to form the new word is somewhat changed--the words are used to form cases in nouns, and a variety of illustrations is, to indicate mode, tense, number, person, gender, etc., of verbs, When words are combined by compounding, the formative elements cannot but in those languages where article pronouns are not found the verbs languages to form new words with which to express new ideas. In English the relation of words is expressed both by placement idea expressed by the word inflected; thus a noun is qualified by case the verb is used for the noun, and in so doing the Indian names the Thus the verb of an Indian language contains within itself incorporated In some languages the article pronoun constitutes a distinct word, but pronoun, and for mode and tense in the verb, to that extent the parts of voice of the verb, the English language has undifferentiated parts of id: 12629 author: Sapir, Edward title: Language: An Introduction to the Study of Speech date: words: 78758.0 sentences: 4561.0 pages: flesch: 63.0 cache: ./cache/12629.txt txt: ./txt/12629.txt summary: nature of a symbol, a word, an element of language. One word more as to the relation between language and thought. The true, significant elements of language are generally sequences of the language truly a pure concept-word (type A) instead of being of a Some languages, like Latin, express practically all relations by means radical nucleus of the word as is an English element like _-er_ from the language to express every concrete idea by an independent word or Language in its fundamental forms is the symbolic expression of human fusing languages that express the syntactic relations in pure form, that symbolic languages that do not express relational concepts in the word agglutinative languages that express these same concepts in the word--in languages in which the syntactic relations are expressed in mixed form, thought, to change every sound, word, and concrete concept of a language id: 13182 author: nan title: Prefaces and Prologues to Famous Books with Introductions, Notes and Illustrations date: words: 173376.0 sentences: 6771.0 pages: flesch: 64.0 cache: ./cache/13182.txt txt: ./txt/13182.txt summary: such time as he had accomplished this said work, it liked him to send read in this said book and work, that they take the good and honest And for to pass the time this book shall be pleasant to read in; of that breath-giving life which God hath cast upon time and dust, as And though it hath pleased God to reserve the art of reading men''s that could never yet discover the way and reason of nature''s working, even the world itself and the nature of things and of the mind. that the mind may exercise over the nature of things the authority came into my mind that our old English poet, Chaucer, in many things the works of the two authors we may read their manners and natural the man who, book in hand, steps in front of the work of art itself. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel