mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-weather-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/17269.txt inflating: ./tmp/input/input-file/26968.txt inflating: ./tmp/input/input-file/24163.txt inflating: ./tmp/input/input-file/33429.txt inflating: ./tmp/input/input-file/36344.txt inflating: ./tmp/input/input-file/46338.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-weather-gutenberg FILE: cache/26968.txt OUTPUT: txt/26968.txt FILE: cache/17269.txt OUTPUT: txt/17269.txt FILE: cache/24163.txt OUTPUT: txt/24163.txt FILE: cache/33429.txt OUTPUT: txt/33429.txt FILE: cache/46338.txt OUTPUT: txt/46338.txt FILE: cache/36344.txt OUTPUT: txt/36344.txt === file2bib.sh === id: 24163 author: Claridge, John title: The Shepherd of Banbury's Rules to Judge of the Changes of the Weather, Grounded on Forty Years' Experience date: pages: extension: .txt txt: ./txt/24163.txt cache: ./cache/24163.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24163.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24163 txt/../pos/24163.pos 24163 txt/../ent/24163.ent 24163 txt/../wrd/24163.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 26968 txt/../wrd/26968.wrd 26968 txt/../pos/26968.pos 26968 txt/../ent/26968.ent === file2bib.sh === id: 26968 author: Marlowe, Stephen title: Summer Snow Storm date: pages: extension: .txt txt: ./txt/26968.txt cache: ./cache/26968.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'26968.txt' 36344 txt/../pos/36344.pos 36344 txt/../wrd/36344.wrd 17269 txt/../wrd/17269.wrd 17269 txt/../pos/17269.pos === file2bib.sh === id: 36344 author: Talman, Charles Fitzhugh title: The Mentor: The Weather Serial Number 110; 1 July, 1916 date: pages: extension: .txt txt: ./txt/36344.txt cache: ./cache/36344.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'36344.txt' 36344 txt/../ent/36344.ent 46338 txt/../pos/46338.pos === file2bib.sh === id: 17269 author: Dack, Charles title: Weather and Folk Lore of Peterborough and District date: pages: extension: .txt txt: ./txt/17269.txt cache: ./cache/17269.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'17269.txt' 17269 txt/../ent/17269.ent 46338 txt/../wrd/46338.wrd 46338 txt/../ent/46338.ent === file2bib.sh === id: 46338 author: nan title: A Medley of Weather Lore date: pages: extension: .txt txt: ./txt/46338.txt cache: ./cache/46338.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'46338.txt' 33429 txt/../pos/33429.pos 33429 txt/../wrd/33429.wrd 33429 txt/../ent/33429.ent === file2bib.sh === id: 33429 author: Butler, T. B. (Thomas Belden) title: The Philosophy of the Weather. And a Guide to Its Changes date: pages: extension: .txt txt: ./txt/33429.txt cache: ./cache/33429.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'33429.txt' Done mapping. Reducing subject-weather-gutenberg === reduce.pl bib === id = 17269 author = Dack, Charles title = Weather and Folk Lore of Peterborough and District date = pages = extension = .txt mime = text/plain words = 12380 sentences = 879 flesch = 90 summary = It is lucky for a dark man to enter the house first on New Year's morning, and I know a man who used to see the Old Year out and the New Children used to go round the villages and city on this day and sing: The Garlands are carried round on 1st May and on Old May Day. The Huntingdonshire Garlands are usually of a pryamidical form of The 11th November is generally called Martlemas Day and old people still round during the night time and on Boxing Days they call for their on this day and about sixty or seventy years ago many old people kept of Peterborough, St. John's Church Bells were not rung on Wyldbore's day If a woman has a fine day for washing the first time after Michaelmas Two crows bring good luck, and if they fly away over the person's head cache = ./cache/17269.txt txt = ./txt/17269.txt === reduce.pl bib === id = 33429 author = Butler, T. B. (Thomas Belden) title = The Philosophy of the Weather. And a Guide to Its Changes date = pages = extension = .txt mime = text/plain words = 117432 sentences = 6516 flesch = 73 summary = portions of the atmosphere, having risen in the trade-wind region and run extra-tropical belt of regular rains surrounding the earth, north of the the sun as perfectly as the clouds of a north-east storm, it differs from generally, in all considerable storms, observe that the wind blows from of rains and calms follows the trades and sun, in their transit north and sun: the trades with the central belts of rains travel north and south In like manner the sea-breezes and other fair-weather surface winds, rise north-west, and makes the mean of the surface winds of their storms place, as the storms and counter-trades pass north and east in the the north-west wind and its peculiar fair-weather scud. snow storms originate the surface easterly winds in winter. attraction of an easterly wind, by the storm in the counter-trade. During set fair weather, when the attracting belt of rains is far north, cache = ./cache/33429.txt txt = ./txt/33429.txt === reduce.pl bib === === reduce.pl bib === id = 36344 author = Talman, Charles Fitzhugh title = The Mentor: The Weather Serial Number 110; 1 July, 1916 date = pages = extension = .txt mime = text/plain words = 9999 sentences = 689 flesch = 67 summary = Of The United States Weather Bureau Chief of the United States Weather Bureau when the department was first hence the study of weather--meteorology--is one of the most important [Illustration: STATIONS OF THE UNITED STATES WEATHER BUREAU the phenomena of the atmosphere,--rain and snow, cloud and fog, wind and The layer of the atmosphere lying between sea-level and the upper cloud upward in the air shows under average conditions a fall of temperature [Illustration: THE NEW IDEA IN WEATHER OBSERVATORIES At about 200 stations of the Weather Bureau, distributed over the United days after we had made announcement of a "Weather" number of The Mentor. TALMAN, of the United States Weather Bureau, Washington. [Illustration: CENTRAL OFFICE OF THE UNITED STATES WEATHER BUREAU, [Illustration: A SIMPLE WEATHER STATION] The United States Signal Service (now the Weather Bureau) For a number of years the United States Weather Bureau maintained a cache = ./cache/36344.txt txt = ./txt/36344.txt === reduce.pl bib === id = 26968 author = Marlowe, Stephen title = Summer Snow Storm date = pages = extension = .txt mime = text/plain words = 4707 sentences = 554 flesch = 92 summary = Chief Botts dangled the forecast sheet before Johnny Sloman's bloodshot "Yes, sir," said Johnny Sloman. place at all, Johnny Sloman," she had said. Johnny sat with his head in his hands until Harry Bettis, the GS-5 "That's all right, girls," Harry Bettis said. didn't, but Harry Bettis knew that look on a girl's face. "Hell's bells," Harry Bettis said before Johnny could say it was all a in July," Harry Bettis said in a shocked voice. "I'd better call Washington and tell them," Chief Botts said, but Harry "Johnny!" Harry Bettis said. "Jo-Anne," Johnny said. "Of everything Johnny makes as the world's first _real_ Weather Man. Not manager," said Harry Bettis, and walked out of the office, steering a Harry Bettis said, "Well, thank you for your time, Mr. Secretary. "Johnny," Harry said. "If Johnny thinks he ought to help--" Jo-Anne said. "I don't think you should have done that," Johnny said after he had cache = ./cache/26968.txt txt = ./txt/26968.txt === reduce.pl bib === id = 46338 author = nan title = A Medley of Weather Lore date = pages = extension = .txt mime = text/plain words = 16038 sentences = 2361 flesch = 99 summary = A fair day in winter is the mother of a storm. OLD CUSTOM OF BLESSING APPLE TREES ON TWELFTH DAY. "Twelfth-Day--came in a tiffany suit, white and gold, like a queen on a When a moorland shepherd meets his sheep on a winter's night coming White moon doth neither rain nor snow. The green bud springs, the young bird sings, Do come to sing in thy green trees, Old May Day is the usual time for turning out cattle into the pastures, And the violet, and then the rose, and all sweet things are coming. Then comes in the sweet o' the year! Then comes in the sweet o' the year! "Haste thee away, oh, winter day!" If Michaelmas Day be fair, the sun will shine much in the winter; The melancholy days are come, the saddest of the year, If New Year's Eve night wind blows south cache = ./cache/46338.txt txt = ./txt/46338.txt Building ./etc/reader.txt 33429 46338 17269 33429 17269 36344 number of items: 6 sum of words: 160,556 average size in words: 32,111 average readability score: 84 nouns: wind; storm; rain; °; weather; trade; day; storms; earth; air; surface; winds; north; belt; clouds; summer; sun; atmosphere; condensation; -; action; winter; time; year; cloud; currents; trades; temperature; snow; rains; portion; character; part; line; west; east; showers; course; miles; influence; place; south; season; heat; days; theory; water; side; month; barometer verbs: is; are; be; have; was; has; been; do; were; had; seen; see; said; found; does; come; made; following; passing; blow; ''s; show; pass; know; make; did; falls; passed; say; let; go; called; being; observed; take; known; find; coming; supposed; occur; taken; used; appear; given; set; carried; fall; blowing; blows; get adjectives: other; same; great; magnetic; such; different; northern; cold; more; dry; first; counter; many; southern; fair; tropical; western; clear; true; eastern; south; much; little; general; considerable; old; warm; latter; greater; atmospheric; regular; good; rainy; few; electric; violent; hot; new; upper; large; high; several; less; small; last; whole; long; volcanic; peculiar; greatest adverbs: not; so; very; more; up; then; as; now; most; thus; sometimes; often; also; again; off; far; still; too; there; away; out; only; south; here; always; about; even; well; never; in; perhaps; however; north; down; over; soon; much; therefore; all; frequently; probably; doubtless; on; first; ever; n''t; nearly; usually; generally; indeed pronouns: it; they; its; i; we; their; them; he; his; our; you; us; her; my; your; him; she; me; itself; thy; themselves; himself; one; thee; ours; yourself; mine; herself; ye; ourselves; you''re; wi; saying--"whatever; myself; ''s proper nouns: _; |; n.; w.; s.; e.; west; new; may; mr.; south; day; atlantic; johnny; p.m.; america; mexico; april; july; march; january; august; june; professor; fort; states; st.; north; redfield; a.m.; weather; pacific; mean; february; europe; american; c.; st; bettis; united; ocean; east; gulf; december; indian; harry; september; old; africa; dr. keywords: weather; states; new; day; year; wind; west; united; tusser; sunday; summer; storm; st.; spring; south; redfield; rain; professor; peterborough; pacific; p.m.; ocean; mr.; mexico; mentor; march; june; johnny; john; illustration; harry; good; fort; europe; come; clock; clare; christmas; bureau; bettis; author; august; atlantic; april; american; america; a.m. one topic; one dimension: wind file(s): ./cache/33429.txt titles(s): The Philosophy of the Weather. And a Guide to Its Changes three topics; one dimension: wind; day; weather file(s): ./cache/33429.txt, ./cache/46338.txt, ./cache/17269.txt titles(s): The Philosophy of the Weather. And a Guide to Its Changes | A Medley of Weather Lore | Weather and Folk Lore of Peterborough and District five topics; three dimensions: wind north south; day year st; weather johnny said; drinking thinking sell; drinking thinking sell file(s): ./cache/33429.txt, ./cache/46338.txt, ./cache/26968.txt, , titles(s): The Philosophy of the Weather. And a Guide to Its Changes | A Medley of Weather Lore | Summer Snow Storm | The Shepherd of Banbury's Rules to Judge of the Changes of the Weather, Grounded on Forty Years' Experience | The Shepherd of Banbury's Rules to Judge of the Changes of the Weather, Grounded on Forty Years' Experience Type: gutenberg title: subject-weather-gutenberg date: 2021-06-10 time: 17:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Weather" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 33429 author: Butler, T. B. (Thomas Belden) title: The Philosophy of the Weather. And a Guide to Its Changes date: words: 117432.0 sentences: 6516.0 pages: flesch: 73.0 cache: ./cache/33429.txt txt: ./txt/33429.txt summary: portions of the atmosphere, having risen in the trade-wind region and run extra-tropical belt of regular rains surrounding the earth, north of the the sun as perfectly as the clouds of a north-east storm, it differs from generally, in all considerable storms, observe that the wind blows from of rains and calms follows the trades and sun, in their transit north and sun: the trades with the central belts of rains travel north and south In like manner the sea-breezes and other fair-weather surface winds, rise north-west, and makes the mean of the surface winds of their storms place, as the storms and counter-trades pass north and east in the the north-west wind and its peculiar fair-weather scud. snow storms originate the surface easterly winds in winter. attraction of an easterly wind, by the storm in the counter-trade. During set fair weather, when the attracting belt of rains is far north, id: 24163 author: Claridge, John title: The Shepherd of Banbury's Rules to Judge of the Changes of the Weather, Grounded on Forty Years' Experience date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 17269 author: Dack, Charles title: Weather and Folk Lore of Peterborough and District date: words: 12380.0 sentences: 879.0 pages: flesch: 90.0 cache: ./cache/17269.txt txt: ./txt/17269.txt summary: It is lucky for a dark man to enter the house first on New Year''s morning, and I know a man who used to see the Old Year out and the New Children used to go round the villages and city on this day and sing: The Garlands are carried round on 1st May and on Old May Day. The Huntingdonshire Garlands are usually of a pryamidical form of The 11th November is generally called Martlemas Day and old people still round during the night time and on Boxing Days they call for their on this day and about sixty or seventy years ago many old people kept of Peterborough, St. John''s Church Bells were not rung on Wyldbore''s day If a woman has a fine day for washing the first time after Michaelmas Two crows bring good luck, and if they fly away over the person''s head id: 26968 author: Marlowe, Stephen title: Summer Snow Storm date: words: 4707.0 sentences: 554.0 pages: flesch: 92.0 cache: ./cache/26968.txt txt: ./txt/26968.txt summary: Chief Botts dangled the forecast sheet before Johnny Sloman''s bloodshot "Yes, sir," said Johnny Sloman. place at all, Johnny Sloman," she had said. Johnny sat with his head in his hands until Harry Bettis, the GS-5 "That''s all right, girls," Harry Bettis said. didn''t, but Harry Bettis knew that look on a girl''s face. "Hell''s bells," Harry Bettis said before Johnny could say it was all a in July," Harry Bettis said in a shocked voice. "I''d better call Washington and tell them," Chief Botts said, but Harry "Johnny!" Harry Bettis said. "Jo-Anne," Johnny said. "Of everything Johnny makes as the world''s first _real_ Weather Man. Not manager," said Harry Bettis, and walked out of the office, steering a Harry Bettis said, "Well, thank you for your time, Mr. Secretary. "Johnny," Harry said. "If Johnny thinks he ought to help--" Jo-Anne said. "I don''t think you should have done that," Johnny said after he had id: 36344 author: Talman, Charles Fitzhugh title: The Mentor: The Weather Serial Number 110; 1 July, 1916 date: words: 9999.0 sentences: 689.0 pages: flesch: 67.0 cache: ./cache/36344.txt txt: ./txt/36344.txt summary: Of The United States Weather Bureau Chief of the United States Weather Bureau when the department was first hence the study of weather--meteorology--is one of the most important [Illustration: STATIONS OF THE UNITED STATES WEATHER BUREAU the phenomena of the atmosphere,--rain and snow, cloud and fog, wind and The layer of the atmosphere lying between sea-level and the upper cloud upward in the air shows under average conditions a fall of temperature [Illustration: THE NEW IDEA IN WEATHER OBSERVATORIES At about 200 stations of the Weather Bureau, distributed over the United days after we had made announcement of a "Weather" number of The Mentor. TALMAN, of the United States Weather Bureau, Washington. [Illustration: CENTRAL OFFICE OF THE UNITED STATES WEATHER BUREAU, [Illustration: A SIMPLE WEATHER STATION] The United States Signal Service (now the Weather Bureau) For a number of years the United States Weather Bureau maintained a id: 46338 author: nan title: A Medley of Weather Lore date: words: 16038.0 sentences: 2361.0 pages: flesch: 99.0 cache: ./cache/46338.txt txt: ./txt/46338.txt summary: A fair day in winter is the mother of a storm. OLD CUSTOM OF BLESSING APPLE TREES ON TWELFTH DAY. "Twelfth-Day--came in a tiffany suit, white and gold, like a queen on a When a moorland shepherd meets his sheep on a winter''s night coming White moon doth neither rain nor snow. The green bud springs, the young bird sings, Do come to sing in thy green trees, Old May Day is the usual time for turning out cattle into the pastures, And the violet, and then the rose, and all sweet things are coming. Then comes in the sweet o'' the year! Then comes in the sweet o'' the year! "Haste thee away, oh, winter day!" If Michaelmas Day be fair, the sun will shine much in the winter; The melancholy days are come, the saddest of the year, If New Year''s Eve night wind blows south ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel