key: cord-0591137-du9y960u authors: Armstrong, Eve; Chester, title: My cat Chester's dynamical systems analysyyyyy7777777777777777y7is of the laser pointer and the red dot on the wall: correlation, causation, or SARS-Cov-2 hallucination? date: 2021-03-31 journal: nan DOI: nan sha: 440427fc43eec3daa5e9a83a666c3d2b840b787c doc_id: 591137 cord_uid: du9y960u My cat Chester investigates the elusive relationship between the appearance in my hand of a silver laser pointer and that of a red dot on the wall, or on the floor, or on any other object that resides within the vicinity of the laser pointer. Chester first assesses preliminary establishments for causality, including mutual information, temporal precedence, and control for third variables. These assessments are all inconclusive for various reasons. In particular, mutual information fails to illuminate the problem due to a dearth of information regarding what the laser pointer might have been doing at times following Chester's first awareness of the dot. Next Chester performs a formal reconstruction of phase space via time-delay embedding, to unfold the gggggggggggfffgfgtredvteometry ,mmmm.........,.,,......,.mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm of the underlying dynamical system giving rise to the red dot's trajectory. The resulting attractor does not resemble a laser pointer. The reconstruction could, however, be flawed, for example, due to the short temporal duration of the dot's observed trajectory. Finally, the red dot could be a hallucination: a symptom brought on by COVID-19 - because, well, these days pretty much anything might be a symptom brought on by COVID-19. On this note, Chester's kitten brother Mad Dog Lapynski offers an independent check on the red dot's existence. Moreover, the results of this study are inconclusive and ca[pokilki[[[[[ll for follow-up. Chester (Fig. 1, top panel) , an orange tabby, is a cuddling, clawing, purring, biting, trilling, hissing, head-bumping bipolar ball of fire. In one moment he lovingly purrs underneath a head scratch, and in the next attempts to amputate my hand as punishment for having head-scratched just a wee bit too long. He weighs eight pounds, six hundred 1 of which is ego. In truth, Chester's endearing [2] and ferocious [3] personal attributes are too intertwined to decouple in writing. Among his diverse quirks, it is Chester's canniness that is the fodder for this paper. Specifically: Chester possesses a distinctly uncanny talent for predicting events within his observable Universe. He is poised statuesque on the kitchen counter by the time I enter to scoop out 2.5 ounces of Purrlicious Fishes. He is peering wide-eyed out the livingroom window before our neighbor emerges to take her leashed parrot for a daily fly. And he always head-bumps me one to five minutes prior to my morning alarm. No computational pattern recognition algorithm holds a candle to Chester's fuzzy orange head. And Chester flexes this predictive muscle not only on the simple case of one variable's cyclic behavior. He also probes multivariate scenarios. Specifically, those involving correlations. The term 'correlation' brands any kind of statistical relationship between two or more variables. For example, upon beholding a silver laser pointer in my hand (Fig. 1, bottom left) , Chester will scan the space nearby until he locates a red dot (Fig. 1 , bottom right). While Chester suffers no scarcity of things to chase, he is particularly taken with this red dot. What renders the dot more intriguing than other chaseable objects is thatto date -he has never been able to catch it. Indeed, this dot is no ordinary dot. To put it mildly, the dot displays unusual physical properties. It is not, for example, a speck on a sweater that can be flicked or pinched or brushed away. On the contrary, this dot seems to lack any material substance whatsoever. It flits from surface to surface without once appearing in the air between the surfaces. It vanishes and reappears in the blink of an eye, seemingly at the speed of light. The laws of physics as we know them forbid this: no matter particle can travel at light speed [4] . Moreover, this dot truly appears to be not of this world. Small wonder, then, is Chester's obsession. What is this incorporeal dot? Is it an ethereal spirit from a netherland? [5, 6, 7, 8] The tooth fairy [9] ? Batman [10]? And whence came it? Regarding this last question, Chester may have a clue: the laser pointer correlation. Now, while a correlation between two variables is rather straightforward to identify, digging at the nature of the underlying relationship is a slippery problem. This slipperiness is not appreciated by all. Some are fond of assuming that a correlation necessarily implies a specific causal relationship, especially if it concerns telomeres [11, 12] , a full moon [13, 14] , or sex drive [15, 16, 17, 18, 19, 20] . On the contrary, causation is a viciously elusive thing to pin down. But Chester, undaunted as always, was determined to give it a try. Chester first performed three basic tests for causality between the time series of spatial locations of the red dot and of the laser pointer, respectively. These calculations were: the mutual information between time series, temporal precedence, and control for possible third variables. The calculations all failed, due to insufficient observations of any object other than the dot. Once appreciating that the red dot time series was really all he had to go on, Chester thought: well, what information did the red dot time series alone contain about the underlying dynamical system that produced it? To investigate this question, Chester turned to time-delay embedding. Time-delay embedding is a method of translating from a scalar set of measurements to a multivariate phase space that contains a geometric representation of the (unobserved) dynamics that gave rise to the measurements [21, 22, 23] . The geometric structure is called an attractor: a set of points in the space to which all nearby trajectories will tend to converge. Since the theorem's publication in the 1980's, the procedure has seen a vast range of applications. These include: characterizing chaos in dynamical systems [24] , synthesizing musical tones [25] , analyzing dolphin echo-location [26, 27] and human speech [28, 29, 30] , using EKG recordings to identfffgdshjrify heart abnormalities [31] , and using finger-tapping to predict Parkinson's Disease [32] . To date, time delay embedding has not been employed to reconstruct the dynamical system giving rise to the trajectory of an incorporeal red dot capable of traveling at the speed of light. Regarding this case of the red dot, Chester posed the question: does the resulting attractor in reconstructed phase space look like a laser pointer? After performing the reconstruction, the answer appears to be no. There exist various possible explanations, however, including the possibility that the red dot was in fact a hallucination brought on by COVID-19, the novel coronavirus disease caused by the virus SARS-Cov-2 [33] . Moreover, the results of this study are inconclusive. Fortunately, Chester is not discouraged. He has not missed a beajikllllllllll;'t. Since concluding this study, he has attacked the renegade shadow of a housefly, chastized a billowing shower curtain, and now -glowering from under the bed -appears to be holding the entire household accountable for thunder. While the room in which the data collection occurred exists in three spatial dimensions, the analysis techniques employed in this paper require the use of scalar data sets. Thus, Chester performed the analysis three times independently, for time series in the x, y, and z directions, respectively. For brevity, in this paper we show only the x case, as it is representative of those for y and z. where coordinate x is defined as the direction from South (x ≡ 0.0) to North (x ≡ 1.0) walls. He stared unblinking at the pointer for two seconds -until 9:04:19, at which time his eyes darted away to scan the space nearby. After two additional seconds (9:04:21), Chester located a red dot on the North wall. Thereafter he sampled the red dot time series densely, using a step size of 0.1 s, the integration time of his eye (Fig. 2 ). The total baseline of the red dot time series was 130 s, at which time I grew bored. During that time, Chester missed a total of only twelve temporal locations -a loss attributable not to any dearth of diligence on Chester's part, but rather to the noted incorporeal and light-speed properties of the dot (e.g. missing only twelve points total. Panels 3 through 6 of Figure 4 show selected time series of objects that the dot visited, including the North wall (third panel; not to be confused with the East wall pictured in Figure 4 , left panel), Gretel the miniature schnauzer (fourth panel), Kleenex (fifth panel), and Windex (sixth panel). Note the sparsity of these time series. In addition, note that none of these objects moves in the x dimension, with the one exception of Gretel, who -upon feeling a claw piercing her rear end -high-tailed it out of the room as quickly as possible. Finally, Panel 7 of Figure 4 shows Chester's time series sampling of the Elmer's Glue, an object upon which the red dot did not appear. This time series is representative of all other objects upon which the red dot did not appear. Before embarking on anything fancy, Chester first considered three basic requirements for establishing causality between two events: covariation, temporal precedence, and control for third variables. Now, covariance can be undefined if either variable does not have a well-defined mean. Noting that the red dot trajectory appeared chaotic at times, and that the laser pointer trajectory contained a mere twenty data points (sampled at 0.1 s over two seconds), Chester prudently took neither to have a well-defined mean. Thus, rather than covariance he opted to measure the mutual information [34] between the time series, as mutual information is always defined, and it has an established history as a test for causality [35] . The prescription for calculating mutual information goes as follows. We call the time series of the red dot's trajectory D = {dot m } sampled over m temporal locations, and the time series of the laser pointer's trajectory to be P = {pointer n } sampled over n temporal locations. Then we ask: How much information, in bits with logs to base 2, do we learn about Event {dot m } if we observed Event {pointer n }, and vice versa? Formally: where P DP (d m , p n ) is the joint probability distribution of events dot m and pointer n , and the marginal distributions P D (dot m ) ≡ ∑ pointer n P DP (dot m , pointer n ) and P P (pointer n ) ≡ ∑ dot m P DP (dot m , pointer n ). Then, the average over the elements is the average mutual information: The AMI measures the degree to which the two time series predict each other. To machine precision, Chester's calculation of the average mutual information between the time series is zero. This result is probably due to inadequate sampling. While Chester made scrupulous observations of the flight of the red dot once he had spotted it (m = 130 s ×10 samples/s −12 = 1288), he noted only the first two seconds of the time series of the laser pointer's location (n = 20) and did not record the dot's time series during those initial two seconds. Temporal precedence also could not be established, as Chester had not bothered to check for the red dot at times prior to the appearance of the laser pointer. Finally, Chester's monitoring for the role of a third variable was intermittent at best and nonexistent at worst (Panels 3 through 7 of Figure 4 ). Grudgingly accepting that the red dot time series was the only quality data he had to go on, Chester next turned to the more complicated -and admittedly in-parts-heuristic -method of time-delay embedding, to reconstruct the global phase space of the underlying dynamical system giving rise to the red dot's trajectory, and to thereby ascertain whether this dynamical system in any way resembled a laser pointer. Within the prescription of time-delay embedding, we assume that any observed scalar signal -in this case, the x(t) trajectory of our red dot -arises from the mechanics of an underlying dynamical system, and that we can construct a geometric representation of that Top: Four 3D visualizations of the reconstructed geometry of the dynamical system giving rise to the red dot's trajectory in the x dimension. Each of the four corresponds to a three-dimensional slice of the four-dimensional phase space, as d = 4 was found to be the minimum dimension required for unfolding. Here, the dimensions are labeled: D1, D2, D3, and D4. These structures are representative of those y(t) and z(t) data sets (not shown). Bottom: Left to right: laser pointer in the x-z plane (representative of appearance in y-z plane), x-y plane at z = 0, and x-y plane at z = L, where L is the length of the laser pointer. No 3D slice of the geometry in reconstructed phase space resembles a laser pointer. system by means of the observations themselves. The method has been used as a test for causality (e.g. Refs [36, 37, 38] . Formally, the embedding theorem, attributed to Takens and Mané [21, 40, 23] , goes as follows. We assume that there exists an unknown dynamical system dx/dt = H(x(t)) and that we are observing some scalar projection dot( ) of some vector function of the dynamical variables g(x(t)). Then the geometry of the unknown dynamics generating the measurements can be "unfolded" from those measurements dot(g(x(t)) in a space constructed of new vectors y(t) with components consisting of dot( ) applied to powers of g(x(t))): where d is the global dimension of the "reconstructed" phase space. This new set of vector y(t) describes an object in the space called an attractor. An attractor is a point, or a set of points, in a phase space to which all nearby tattttyyytttttttttttttttttttytyttyttttttttttjifdlrajectories will tend to converge. The vectors y(t) can be designed such that the new space preserves critical features of the original unknown dynamical system dx/dt = H(x(t)); specifically, its deterministic -or temporal -behavior. The embedding theorem applies to any smooth function of dot( ) and g(x) [41] . To g(x) we assign the operation that takes a vector x to that vector one time delay later. So the T th k power of g is: where τ sample is the sampling rate. Then, assuming that all delays are integer multiples of a common delay τ ≡ T k τ sample , the vectors y(t) become: (1) It remains to choose the time delay τ and global embedding dimension d that is sufficient to unfold the dynamics giving rise to the red dot trajectory (for these choices, see Appendix), and then to plot the emergent vectors 2 . The data used for phase space reconstruction must be scalar quantities. Thus Chester performed the analysis three independent times, for the x, y, and z directions, respectively. All three, if emerging from the same underlying mechanism, should yield the same dynamics. For the analysis in x, y, and z Chester found that the global embedding dimension required to unfold the dynamics underlying the observations was 4. The stability of this value across the data sets was encouraging. To visualize the emergent geomety in this space, Chester plotted every combination of three dimensions out of that four, for the x, y, and z data sets independently. The results for the x set are representative of those for the other two, and are displayed in Figure 5 . None of the emergent attractors 3 (top panel) resemble a laser pointer (bottom). They aren't even silver 4 . Now, Chester's embedding procedure may have been flawed, for multiple reasons. In addition to the heuristic choices for τ and d, the number of sampled points during the 130-second time series was smallish. While some have had success with short data sets [43] , embedding tends to require time series of several tens of thousands of points [39] . Despite the ambiguous significance of the attractors pictured in Figure 5 they are in fact quite intriguing and merit discussion (see Discussion). While Chester recalls the dot/pointer correlation from past occasions, he allowed that this particular instance might be pegged on COVID-19 -because, well, at the moment most anything [44] might be pegged on COVID-19. That is, could the red dot be a hallucination? Fortunately, as Chester pondered this possibility, his younger brother Mad Dog Lapynski ( Figure 6 ) wandered onto the scene. Mad Dog Lapynski also noted the red dot (Figure 7) , inadvertently establishing an independent verification of its existence 5 . Mad Dog Lapynski opted not to perform his own analysis of the data. He only stayed long enough to comment snidely that Chester's study neglected to consider topological causality [45] , and to smugly decline our offer of co-authorship. Figure 7 : Mad Dog Lapynski also sees the red dot, an independent check that renders the COVID-19 hypothesis unlikely. 3 Actually, we are not sure that these are attractors. To establish this would require additional evidence such as Poincaré mapping [42] . 4 Do not bother trying to create a silver line plot via Matplotlib; it just looks grey. 5 Unless the brothers are displaying identical symptoms. While the strategies employed in this paper have yielded inconclusive results, they by no means represent an exhaustive examination of tests for causality. Other lines of attack exist in the literature, for example, topological causality [45] , as noted by Mad Dog Lapynski. Nevertheless, this study is noteworthy as the first dynamical systems approach to probing the confounding nature of incorporeal light-speed red dots. In addition, while the significance of the attractors in Chester's reconstructed phase space is unclear, the results do carry intriguing implications that might not be readily obvious to the reader. Allow us to elucidate. FTake, for example, the structure that emerges in the D 1 -D 3 -D 4 slice of the four-dimensional phase space ( Figure 5 , middle left E.A. thanks her attorney overseeing the action filed by her co-author concerning the appropriate assignment of first authorship of this manuscript. (Her case is that she did all of the write-up; C. argues that he did all of the work and some of the write-up.) E.A. also thanks BAND-AID ® regarding the multiple injuries incurred by her forearms throughout the litigation thus far. C., as usual, thanks no one. To choose τ there exists no single formal prescription. The delay should be sufficiently long to render the coordinates essentially independent, so that they form an orthonormal basis that spans the phase space. Too short a delay will not permit sufficient new information to have been generated in the interim, while too long a delay will erase evidence of causality, assuming that there was any to begin with. To strike a balance between these extremes, Chester plotted the average mutual information between coordinates AMI(x(t) | x(t + τ)) as a function of τ, and chose the value of τ that yielded the first minimum of this distribution [46, 47] . This strategy has been used successfully for time-delay embedding of the chaotic Hénon map [24] , chaotic Lorenz-63 system [24] , and an audio tape taken inside an aviary of ornery cowbirds [48] . (Note: here we are considering the mutual information between successive points in the red-dot time series, and not between the dot time series and laser pointer time series, as was the case in Preliminary tests.) Next, the choice for d performs the unfolding. There exists no single preferred methodology for this calculation either. Chester followed the prescription of minimizing the percentage of "false nearest neighbors" [49] in a time series. On a trajectory, points may appear sequential for one of two reasons: 1) the dynamics truly renders them sequential, or 2) errors in the sequence were acquired via the projection from the x(t) space to the scalar h(g(x(t))) space -and so these sequential points are "false neighbors". If a sufficient number of components d is used to construct the vectors y(t) that define our new phase space, then the tangles can be unfolded -i.e. the imposter neighbors eliminated. The Barbary Lion Gold Star Pet" Award. 463 Fort Washington Avenue Worst Pet Ever" Award. 295 West 112th Street A first course in general relativity Yellow crocodiles and bush spirits: Timpaus islanders' conceptualization of ethereal phenomena Non-detection of the Tooth Fairy at Optical Wavelengths Children Who Sleep Less May Age Faster at a Cellular Level Full Moon Leads to More Babies? British Broadcasting Corporation. Crackdown on Lunar-fuelled Crime Bananas Increase Your Sexual Drive Swim Your Way to Better Sex Here's How Strong Your Sex Drive Is, According to your Zodiac Sign The Color Purple May Spice Up Your Sex Life Five Yoga Poses for Better Sex Detecting strange attractors in turbulence, author=Takens, Floris, booktitle=Dynamical systems and turbulence Dynamical systems and turbulence Ergodic theory of chaos and strange attractors. The theory of chaotic attractors Computing the Lyapunov spectrum of a dynamical system from an observed time series Synthesizing natural sounds using dynamic models of sound attractors Characterization of dolphin acoustic echo-location data using a dynamical classification method Characterization of various fluids in cylinders from dolphin sonar data in the interval domain Nonlinear speech analysis using models for chaotic systems Time-domain isolated phoneme classification using reconstructed phase spaces A dynamical systems approach to speech processing Electrocardiogram classification using delay differential equations Finger tapping movements of Parkinson's disease patients automatically rated using nonlinear delay differential equations SARS-COV-2 virus Transmission of information: A statistical theory of communications On causality and mutual information Testing for causality in reconstructed state spaces by an optimized mixed prediction method Distinguishing time-delayed causal interactions using convergent cross mapping Comparison of six methods for the detection of causality in a bivariate time series Analysis of observed chaotic data Topological analysis of chaotic time series data from the Belousov-Zhabotinskii reaction Characterization of strange attractors Detecting causality from nonlinear dynamics with shortterm time series Ten Unusual Symptoms of Covid-19 Topological causality in dynamical systems Independent coordinates for strange attractors from mutual information Information and entropy in strange attractors Colonel Mustard in the Aviary with the Candlestick: a limit cycle attractor transitions to a stable focus via supercritical Andronov-Hopf bifurcation Determining embedding dimension for phasespace reconstruction using a geometrical construction Predicting the future: completing models of observed complex systems Chester's choices for the values of time delay τ and global embedding dimension d for phase space reconstruction were rather heuristic, as they have been in all the literature cited in this paper.