key: cord-0839621-fpr5gdcp
authors: Rivas, Elena
title: Evolutionary conservation of RNA sequence and structure
date: 2021-03-22
journal: Wiley Interdiscip Rev RNA
DOI: 10.1002/wrna.1649
sha: 8b264975522e6b93ee9f4e4b3612b404516c1627
doc_id: 839621
cord_uid: fpr5gdcp

An RNA structure prediction from a single‐sequence RNA folding program is not evidence for an RNA whose structure is important for function. Random sequences have plausible and complex predicted structures not easily distinguishable from those of structural RNAs. How to tell when an RNA has a conserved structure is a question that requires looking at the evolutionary signature left by the conserved RNA. This question is important not just for long noncoding RNAs which usually lack an identified function, but also for RNA binding protein motifs which can be single stranded RNAs or structures. Here we review recent advances using sequence and structural analysis to determine when RNA structure is conserved or not. Although covariation measures assess structural RNA conservation, one must distinguish covariation due to RNA structure from covariation due to independent phylogenetic substitutions. We review a statistical test to measure false positives expected under the null hypothesis of phylogenetic covariation alone (specificity). We also review a complementary test that measures power, that is, expected covariation derived from sequence variation alone (sensitivity). Power in the absence of covariation signals the absence of a conserved RNA structure. We analyze artifacts that falsely identify conserved RNA structure such as the misuse of programs that do not assess significance, the use of inappropriate statistics confounded by signals other than covariation, or misalignments that induce spurious covariation. Among artifacts that obscure the signal of a conserved RNA structure, we discuss the inclusion of pseudogenes in alignments which increase power but destroy covariation. This article is categorized under: RNA Structure and Dynamics > RNA Structure, Dynamics and Chemistry. RNA Evolution and Genomics > Computational Analyses of RNA. RNA Evolution and Genomics > RNA and Ribonucleoprotein Evolution.

Many functional RNAs adopt conserved structures. Conserved structural RNAs are involved in many cellular functions from translation (ribosomal RNA, transfer RNA), to RNA cleavage (RNaseP, ribozymes), protein localization (SRP), or gene regulation at both transcriptional and translational levels (riboswitches, microRNAs). RNA-Seq probing experiments have revealed numerous expressed and uncharacterized RNAs for which it seems imperative to interrogate whether they perform any relevant function by means of an RNA structure. Here we address the question of how to identify new evolutionarily conserved RNA structures. We will show that a plausible computational prediction by a standard single-sequence folding method is not evidence of a conserved RNA structure, nor is a computational prediction complemented with chemical probing data. In addition to computational predictions and chemical probing, another standard technique for analyzing an uncharacterized RNA is to compare similar sequences in related organisms. A conserved RNA sequence does not necessarily imply a conserved RNA structure. We will show that it requires a particular pattern of variation to support a conserved RNA structure. We will also show that there are variation patterns that support the absence of a conserved structure as well.

When presented with a structural RNA, one important statistical question is to predict its structure. Information about the structure can bring important clues to decipher the RNA function. Computational methods to predict a secondary structure from the sequence of a structural RNA have a long history (Nussinov et al., 1978; Zuker & Sankoff, 1984) . Methods such as Mfold (Zuker, 1989) , ViennaRNA (Gruber et al., 2015) , RNAstructure (Reuter & Mathews, 2010) , NUPACK (Dirks & Pierce, 2003) , Sfold (Ding et al., 2004) , or GTfold (Swenson et al., 2012) use thermodynamic parameters to predict the most stable folds. Other methods use probabilistic context-free grammars (Dowell & Eddy, 2004; Rivas et al., 2012) , or conditional random fields such as CONTRAfold (Do et al., 2006) or RNAsoft (Andronescu et al., 2003) , to produce the most probable set of compatible base pairs given a single RNA sequence. These methods whether they measure structures by free-energy stability, probability, or an arbitrary score they have the same design principles and use similar algorithms (Rivas, 2013) . They search for an optimal final configuration of the whole RNA, and do not take into account the kinetics of the folding process, although there are specific methods that systematically study RNA folding kinetics both computationally (Flamm et al., 2000; Mironov & Lebedev, 1993; Wolfinger et al., 2004) and experimentally (Incarnato et al., 2017) . They model base pairs and stacked interactions of base pairs as well as details of the different loops of unpaired nucleotides that appear in an RNA secondary structure. They use dynamic programming algorithms that can calculate the optimal structure or the maximum expected accuracy structure which tends to be more accurate than the former regardless of the model parameterization (Hamada et al., 2009; Lu et al., 2009) . For an RNA sequence of length L, the algorithms have a complexity of O L 3 ð Þ when pseudoknots are not included, and much higher (O L 6 À Á ) when pseudoknots are allowed by the model (Rivas & Eddy, 1999) . The success of these programs in recapitulating the structure of known structural RNAs from a single sequence alone is on average between 65% and 70%, both for the fraction of true base pairs correctly predicted (sensitivity) and the fraction of predicted base pairs that are correct (positive predictive value) (Andronescu et al., 2007; Rivas et al., 2012) . This overall average accuracy is comparable for all methods, but there is high variability from sequence to sequence for a given method, and from method to method for a given sequence. These are modest but nevertheless informative results when it is known (or safe to presume) that the sequence is a structural RNA, but whose actual structure is unknown. As an example, Figure 1a shows the known structure of the SAM-I riboswitch, a bacterial RNA, which includes 31 Watson-Crick (WC) canonical base pairs, and 3 more A:G noncanonical base pairs forming a kink turn RNA motif. In Figure 1b -d, we show different structures predicted by different methods using the Thermoanaerobacter tengcongesis SAM-I riboswitch sequence. ViennaRNA and RNAstructure (not shown in Figure 1 ) predict a structure with 26 base pairs, all of them correct. The methods NUPACK and CONTRAfold give worse predictions for this sequence. On a different sequence, the situation may be reversed and ViennaRNA could be worse than NUPACK or CONTRAfold. Single sequence RNA prediction methods are generally insufficient to accurately predict base pairs of a structural RNA, specially for large RNAs such as the small and large subunits of rRNA (Doshi et al., 2004) .

That is not to say that the secondary structure methods are bad at determining the right structure, rather the problem is inherently not constrained enough by base pairing. That is, there are many different ways to create different plausible structures from the same sequence, with similar number of base pairs and free energy, and it is hard to know which one is correct. To illustrate that point, a straightforward calculation shows that in the T. tengcongesis SAM-I riboswitch sequence, there are 32 helices with at least 3 consecutive base pairs, of which only 5 of them appear in the actual structure. These possible 32 helices cannot occur all at the same time, but using subsets of those 32 helices, one can construct many different consistent structures different from the real one and with comparable stabilities. Some of those structures are the ones identified by the different computational methods in Figure 1b -d. This underdetermination problem increases exponentially with the length of the RNA. For instance, for the human telomerase RNA with 451 nts, the number of possible helixes with at least 3 base pairs is 1716. This "exceedingly large number of potential helices" (Gutell, 2014 ) is a reason why it is unlikely to predict an RNA structure correctly only from maximizing G:C, A:U, and G:U base pairs. In addition, it has been shown that small perturbation in the thermodynamic parameters, perturbations within the parameters' determination error, can result in important changes in the predicted structure (Layton & Bundschuh, 2005) .

If you are by now unsatisfied with this scenario, things get even more interesting, because in most cases, we are presented with RNA transcripts for which we do not even know if they are structured or not. F I G U R E 1 RNA structure prediction from a single sequence with and without chemical modification data. (a) Sequence and structure of a SAM-I riboswitch from Thermoanaerobacter tengcongesis determined by X-ray crystallography (Montange & Batey, 2006) . Watson-Crick base pairs are depicted with a black line. The SAM-I structure includes a pseudoknot and a kink-turn motif with three non-Watson-Crick A-G pairs. (b-d) Secondary structure predictions for the SAM-I riboswitch by the software ViennaRNA (program: RNAfold) (Gruber et al., 2015) , NUPACK (program: mfe) (Dirks & Pierce, 2003) , and CONTRAfold (Do et al., 2006) . Base pairs correctly predicted are depicted in red. These prediction methods cannot find pseudoknots or non-Watson-Crick base pairs. (e) Structure prediction using both the sequence and per residue chemical reactivities obtained using the SHAPE-Seq 2.0 method, an deposited in the URL (https://rmdb.stanford.edu/detail/ SAMRSW_1M7_0001) (Loughrey et al., 2014) , predicted using ViennaRNA (RNAfold --shape <reactivities> < sequence>). (f) Distributions of the free energies and number of base pairs observed in the best structures (calculated using ViennaRNA) for 200 randomized versions of the T. tengcongesis SAM-I sequence. (g-i) Predicted structures for one shuffled SAM-I sequence selected for having similar number of base pairs as the ViennaRNA prediction for the real SAM-I sequence. (j) Structure predicted by ViennaRNA using the same randomized SAM-I sequence and a set of randomized SHAPE reactivities has a biologically relevant structure or not. Instead, we need to turn to evolutionary conservation to approach that question.

Any functional structural RNA is expected to have some level of structural conservation. The RNA would have to interact with other molecular elements, mostly proteins with conserved structures, and changes that could break the RNA structure would not be easily tolerated if the rest of the machinery is conserved.

Structural conservation is not necessarily synonymous with conservation of the RNA sequence, but some level of sequence conservation is also expected. Homologous structural RNAs can be very divergent, but still have a rate of substitutions at base pairs slower than (and distinguishable from) unconstrained substitutions at the two positions. This effect is better observed when the comparison is restricted to a clade. The slower rate of substitutions at base pairs results from most mutations being rejected, except for double compensatory substitutions that produce 3D functionally equivalent molecules.

For a conserved RNA sequence, the pattern of substitutions observed in an alignment is informative of whether there is a conserved RNA structure or not. Figure 2 shows three different patterns resulting in three different outcomes. In Figure 2a using a helix from the vertebrate telomerase RNA as an example, we observe a pattern of changes in which substitutions tend to preserve A:U, G:C, or G:U base pairs. This pattern indicates a pressure to maintain the helix through evolution. In contrast, the pattern observed in Figure 2b using a putative helix for the RNA HOTAIR (helix 3) indicates that while there is a similar number of mutations as in the telomerase RNA helix, most of those changes appear to be uncorrelated and do not seem to preserve the base pairs annotated in the human HOTAIR sequence as inferred by structural prediction informed by chemical probing data (Somarowthu et al., 2015) . Figure 2c shows a different pattern observed in another HOTAIR proposed helix (helix 11). In this case, the lack of variability in the sequence makes it impossible to determine whether the helix is conserved or just one of the many possible helices one can find in any RNA sequence.

Conservation patterns like the one presented in Figure 2a have been long recognized in structural RNAs, and they have been successfully exploited to predict the structure of ribosomal RNA and other RNAs to great accuracy (Gutell et al., 1985; Holley et al., 1965; Michel et al., 1982 Michel et al., , 2000 Noller et al., 1981; Pace et al., 1989; Williams & Bartel, 1996) . Since the early covariation analyses, computational methods based on mutual information (MI) and other covariation methods have been developed (Akmaev et al., 2000; Gutell et al., 1992) .

Different covariation measures can be used to quantify the sequence variation observed in Figure 2a . MI values (Shannon, 1948) such as those reported in Figure 2 help distinguish the variation due to the RNA structure from random changes or no change at all. MI has been used extensively to measure RNA covariation (Akmaev et al., 2000; Dutheil, 2012; Gutell et al., 1994; Yeang & Haussler, 2007) . There are many other similar covariation statistics that have been tested for the purpose of identifying conserved RNA structures (Lindgreen et al., 2006) . In Rivas et al. (2017) , we reported that the G-test covariation measure (Woolf, 1957) has the best sensitivity and positive predictive value among several different covariation measures tested. The G-test value for two positions i, j is defined as

Obs ab ij log

where a, b are (non-gap) residues; Obs ab ij is the observed count of a : b pairs in positions i, j (only counting when both a, b are residues), and Obs a i is the observed count of residue a in position i. G-test and MI have similar expressions; the Gtest uses observed counts where MI uses residue frequencies. These two differ when the positions have gaps. Two pairs of positions with the same residue frequencies will have the same MI, but the pair with fewer gaps will have higher Gtest value.

It was noticed early on that what constitutes significant covariation evidence depends on the sequence context in which the pairs are embedded . To that effect, background corrections have been proposed by subtracting the average covariation of all possible pairs in the alignment from each individual value (Dunn et al., 2007) . The average product correction (APC) is the most commonly used background correction. For any covariation measure cov(i, j), for an alignment of length L and 1 ≤ i, j ≤ L, the APC correction is defined as F I G U R E 2 Three different patterns of sequence conservation with different implications for inferring RNA structure. (a) For the vertebrate telomerase RNA, a helix from the Rfam seed alignment (RF00024). The pattern of substitutions (calculated relative to consensus CCCC…GGGG) supports the helix being conserved throughout evolution. (b) From HOTAIR domain 1, putative helix 3 from the structural alignment provided by Somarowthu et al. (2015) . The substitutions are mostly incompatible with the annotated helix. (c) Putative helix 11 from the same HOTAIR structural alignment in (b). The small number of changes makes it inconclusive whether the helix exists or not. In green, residues that preserve the structural annotation by making a compensatory base pair substitution relative to the consensus base pair; in blue, a half change (such as G:C to G:U) that also preserves the base pair; in red, changes that break the proposed base pair; and in gray, residues that are not analyzed. We display the mutual information (MI) of each of the original base pairs, and after the residues in each column are permuted to destroy all covariation

Most measure of covariation after subtracting a background correction improves their performance for detecting covariation in RNA alignments (Lindgreen et al., 2006) . In Rivas et al. (2017) , we confirmed those results, and adopted the APC-corrected G-test statistic as the default measure of covariation in our analysis program R-scape (RNA Structural Covariation Above Phylogenetic Expectation).

The next issue is how to use covariation to decide whether an RNA has a conserved structure or not. After all, all pairs of positions in an RNA alignment present some amount of covariation, unless a position is 100% conserved. The question then becomes, when is the covariation score sufficiently large to distinguish a conserved RNA base pair from statistical background and other sources of pairwise covariation signal in RNA sequence alignments?

Even positions that do not seem to support an RNA base pair have some positive nonzero MI, as illustrated in Figure 2b . Even random sequence alignments show some level of covariation due to statistical noise. What constitutes significant covariation evidence of an RNA structure has to be measured against covariation produced by other sources in the context of the same alignment. Phylogeny is an obvious source of background covariation in any conserved sequence alignment. Covariation methods have tried to correct for this background covariation effect (Dutheil, 2012) . Figure 3 shows an example of two toy alignments that show similar variation but where only one of the cases is associated with a conserved RNA base pair. In Figure 3a , two independent substitutions produce by chance what appear to be a compensatory double mutation. In Figure 3b , eight mutation coordinated as four compensatory pairs preserving a base pair produce descendent sequences with exactly the same pairwise residue frequencies as in Figure 3a .

In Rivas et al. (2017) , we designed a statistical test to distinguish between these two different covariation scenarios, implemented in a program named R-scape. In the R-scape test, the covariations in an alignment are compared to the distribution of covariation scores observed in simulated alignments of similar degree of divergence and phylogenetic correlation, but where structural correlation has been removed. The simulated alignments reproduce the same number of substitutions in the same branches as the real alignment. But in the simulated alignments, the substitutions for a given branch do not occur at the same positions as in the real alignment, but at different random positions selected from the pool of positions with the same residue. For instance, for the evolutionary history in Figure 3b , the two depicted columns arise from an evolutionary history of four correlated pairs of mutations occurring in four different branches, at just two positions. In the simulated alignments, those mutations will be replaced as eight independent mutations in the same four branches, but occurring at random positions in the alignment that allow those particular mutations.

Using many simulated alignments, we obtain the distribution of covariation scores for an evolutionary history similar to that of the input alignment, but after removing any positional co-evolution in the real alignment. The empirical distribution for this null hypothesis of covariation due solely to phylogeny is used to estimate the number of expected F I G U R E 3 Spurious pairwise covariations can arise from uncorrelated substitutions on a phylogenetic tree. Two aligned positions (gray background) with identical mutual information, (a) one resulting from two independent substitutions (C to U and G to A) that happen to occur at the same branch in the phylogenetic tree, (b) the other resulting from four pairs of compensatory substitutions preserving a canonical RNA base pair (two C:G base pairs becoming U:A, and two U:A becoming C:G). Each of the four pairs of compensatory substitutions occurs at a different branch in the phylogenetic tree false positives due to phylogeny, called the E-value, per pair of positions. The E-value estimates the expected number of pairs related by phylogeny alone what would have a score at least as large as the pair in question. The smaller the Evalue, the fewer expected pairs related just by phylogeny that would have a comparable covariation score. Figure 4 shows how R-scape works using two examples of structural RNAs, the SAM-I riboswitch with an average length of 110 nts, and the longer vertebrate telomerase RNA (vTR in Figure 4 legend) with 445 nts on average. Figure 4 (a) Expected # not proposed pairs with score > t significantly covary (27) significantly covary (2) significantly covary (30) F I G U R E 4 RNA significant covariation above phylogenetic expectation, R-scape. Statistical test for the structures of the SAM-I riboswitch and the vertebrate telomerase RNA (vTR) using the Rfam seed alignments (with 433 and 37 sequences respectively). The SAM-I riboswitch consensus structure is derived from the X-ray 3D crystal structure (Montange & Batey, 2006) . The vTR consensus structure is derived from Zhang et al. (2010) . Using R-scape option -s, two independent statistical tests are performed: one for the set of base pairs in the given structures and another for the rest of the pairs (blue and red respectively in panels c and d). (a,b) Depicted in green are the base pairs in the structures that significantly covary with an E-value <0.05 using R-scape statistical test for the proposed structures. The top six base pairs with lowest E-values are marked with an arrow. For the SAM-I riboswitch structure, 31 of the 38 base pairs covary above the phylogenetic signal. For the vertebrate telomerase RNA, 27 of the 107 base pairs significantly covary. For the SAM-I riboswitch, there are two significant triple interaction not part of the proposed structure labeled "sc" (side-covariation) and "xc" (cross covariation) respectively. (c,d) Cumulative distribution of covariation scores for the proposed base pairs (in blue) and all the rest of the pairs (in red). Covariation scores larger than 88 for the base pairs (larger than 179 for the rest of pairs) in the SAM-I riboswitch are significantly covarying with Evalues <0.05. For the vTR, significant scores are those larger than 23 for the set of base pairs, and larger than 40 for the rest of pairs uses the Rfam seed alignments for these two structural RNAs. Figure 4a ,b shows the consensus structures given in the Rfam alignments where base pairs with significant covariation support (E-values smaller than 0.05) have been marked green. Figure 4a ,b shows that in both molecules most helices have covariation support for at least one of the base pairs. Figure 4c ,d shows in blue the distribution of covariation scores for the base pairs in the annotated structure. Shaded in blue are the base pairs with E-value smaller than 0.05, that is those for which their score corresponds to an expected number of false positives smaller than 0.05 under the null distribution (plotted in black). For the SAM-I riboswitch, this analysis identifies 30 out of the 38 annotated base pairs as significantly covarying, and 27 out of 107 for the vertebrate telomerase RNA.

The R-scape analysis also calculates the significance of the covariation support for all other possible pairs besides those in the given consensus structure. Figure 4c ,d shows in red the distribution of covariation scores for nonbase pairs. In shaded red are those nonbase pairs with a score that would result in an expected number of false positives less than 0.05. For the SAM-I riboswitch, two tertiary interactions are found significant (named "sc" for side-covariation and "xc" for cross-covariation in Figure 4a ). They appear to be indirect correlations between residues involved in the highly correlated base pairs of helix P4.

Riboswitches are examples of RNAs with alternative structures with covariation evidence. Figure 4a shows the structure of the SAM-I riboswitch aptamer, but riboswitches have another functional domain called the expression platform. The aptamer and expression platforms overlap by a region that can form two alternative helices. Figure 5a shows the Rscape analysis of alignments including both the aptamer and the expression platforms for the SAM-I riboswitch from Zhu and Meyer (2015) and the purine riboswitch obtained from Ritz et al. (2013) . These extended alignments show evidence of covariation in both the terminator and anti-terminator alternative helices.

Another example of an RNA with conserved alternative structures is the U2 spliceosomal RNA. The Stem-IIa and Stem-IIc are two competing structures that promote different splicing steps (Perriman & Ares, 2007) . In addition, the branching interacting stem loop (BSL) rearranges with Stem-I (Perriman & Ares, 2010) . Figure 5b shows that there is covariation evidence for the two alternative Stem-IIa and Stem-IIb. Stem-I also has covariation support, but the sequences forming the BSL are very conserved and lack covariation.

R-scape has shown that proposed structures for some long noncoding RNAs (lncRNAs) such as the eutherian HOTAIR (Somarowthu et al., 2015) , Xist RNA (Fang et al., 2015; Maenner et al., 2010) , and ncSRA (Novikova et al., 2012) , although they have been said to be evolutionarily conserved, in fact do not present any statistically significant evidence of structural covariation (Rivas et al., 2017) . The published structures proposed for HOTAIR, Xist, and ncSRA were constructed using experimental chemical probing in combination with different prediction algorithms on single sequences (Fang et al., 2015; Maenner et al., 2010; Novikova et al., 2012; Somarowthu et al., 2015) , yet alignments of vertebrate homologs with the proposed consensus structure do not show any significant covariation above phylogenetic expectation. This covariation analysis however does not distinguish whether the lack of covariation in these lncRNAs occurs despite sufficient variability as in Figure 2b or whether it is merely due to lack of variability as in Figure 2c . The former case gives evidence against the presence of a conserved RNA structure, while the latter cannot rule out the presence of a conserved structure that could be eventually inferred and supported from a more diverse alignment.

To distinguish between the two possible scenarios for why covariation support would be absent, Rivas et al. (2020) quantified the covariation potential defined as the number of base pairs expected to covary given the variability observed in the alignment. While the R-scape E-values are a measure of false positives expected under the null hypothesis (specificity), power is a measure of the expected true positives (sensitivity). Power is estimated by empirically calculating the probability that bona fide RNA base pairs would be reported as significantly covarying as a function of the variability. For conserved RNA structures, we expect a concordance between covariation and power. Alignments of real structural RNAs often show both covariation and power. Real structural RNAs can produce alignments with low power, for instance when the aligned sequences belong to a specific clade of species. Low power means that there is not conclusive evidence as to whether there is an evolutionarily conserved RNA structure or not. On the other hand, power in the absence of covariation would suggest an evolutionary signal not compatible with RNA structure.

As examples of structural RNAs, Figure 6a shows the covariation versus power for the 3444 RNA families in the Rfam database. There is a strong correspondence between the observed number of covarying base pairs and expected

Covariation in alternative RNA structures. (a) R-scape covariation analysis of the SAM-I riboswitch and the purine riboswitch from alignments that include both the aptamer and the expression platform sequences, using a consensus structure that includes both the terminator and anti-terminator alternative and overlapping helices. For the two riboswitches, both the terminator and antiterminator helices have covariation support. The SAM-I riboswitch structural alignment including the terminator sequence was produced by Zhu and Meyer (2015) . The purine riboswitch extended structural alignment was obtained from Ritz et al. (2013) . (b) Two sets of alternative structures in U2 spliceosomal RNA: The branching interacting stem loop (BSL)/Stem-I (Perriman & Ares, 2010) , and the Stem-IIa/Stem-IIc alternative structures (Perriman & Ares, 2007) . There is covariation evidence for three of the alternative helices Stem-I, Stem-IIa, and Stem-IIb. The sequences forming the BSL are very conserved and lack covariation. The R-scape analysis is performed in the Rfam U2 seed alignment (RF00004) number of base pair to covary given the variability present in the Rfam seed alignments. In contrast, Figure 6b shows that for the lncRNAs HOTAIR, ncSRA, and repA RNA (a fragment of Xist RNA exon 1 that includes the repA repeat) for which conserved RNA structures have been proposed, there is a discordance between the number of expected covariations and the almost complete absence of covarying base pairs (only one found for RepA). This pattern of variation in the absence of covariation is evidence against the presence of a conserved RNA structure in these conserved lncRNAs .

Another conservation pattern that covariation power helps elucidate is that described in Figure 2c . In that case, low covariation is in concordance with low power, and it is not possible to decide on the presence or not of a conserved RNA structure. This happens when the alignment lacks sufficient variation for covariation analysis.

An example of inconclusive results due to low power is shown in Figure 6c for 106 RNA structures reported in the SARS-CoV-2 genome. These RNA structures cover approximately 30% of the SARS-CoV-2 genome (Rangan et al., 2020) . The structures were obtained by a combination of chemical probing and computational prediction. We built Infernal models (Nawrocki & Eddy, 2013) of each of the 106 RNAs, and searched a collection of 124 Nidovirales from RefSeq, the viral order of SARS-CoV-2. We used R-scape to analyze the covariation and covariation power of the alignments. For comparison, we also analyzed the 14 SARS-CoV-2 RNA families in Rfam. Nine of the Rfam coronavirus RNA families have at least five covarying base pairs and similar power. On the other hand, for the majority of the 106 RNA structures in Rangan et al. (2020) , it remains inconclusive whether there is a conserved RNA structure (2 RNAs have 3 evolutionarily conserved base pairs, and 10 others have 2). We use the term evolutionarily conserved base pair to describe base pairs significantly covarying according to R-scape analysis of a particular alignment using an E-value cutoff of 0.05.

An analysis presented in Tavares et al. (2019) (reproduced here in Figure 7 and Table 1 ) observes that alignments of diminishing power result in less covariation. For seven structural RNAs (5S rRNA, 5.8S rRNA, RNaseP, tRNA, U2 snRNA, U5 snRNA, and MALAT1), the Tavares analysis compared the Rfam seed alignments (black in Figure 7 ) to other restricted alignments obtained by increasing the percentage identity of the sequences (blue), and to alignments obtained by selecting sequences from mammal species only (orange). The observation is that as the power of the alignment decreases, so does the covariation signal. Alignments with less power become increasingly less informative toward (Somarowthu et al., 2015) , noncoding steroid receptor RNA activator (ncSRA) (Novikova et al., 2012) and RepA (Liu et al., 2017 assessing the presence or not of a conserved RNA structure. Tavares et al. framed that result as a failure of covariation analysis. The correct interpretation is that those restricted alignments have little variability, and as a result, they do not have sufficient power to decide on whether the structures are conserved or not. Lack of covariation under conditions of no variation does not necessarily imply lack of a conserved structure but the inability to decide on the subject.

The analysis presented in Tavares et al. (2019) also shows another important point. How erroneously including pseudogenes in an alignment can disrupt a covariation analysis.

F I G U R E 7 Covariation versus covariation power as a function of sequence diversity. (a) An illustration of the expected covariation and power in alignments of: structural RNAs (green), not structural RNAs (red), RNAs too conserved in sequence to be able to decide whether they have a conserved structure or not (blue). Operationally, the red stripe described the region with at least six base pairs expected to covary, and no covariations observed. We use the term "observed covariation" to describe pairs that are called significant by R-scape with an E-value smaller than 0.05. (b-e) For several structural RNAs, the covariation and power for three different alignments are shown: the Rfam seed alignment (black), Tavares et al. (2019) high-id alignment (blue) derived from the seed alignments by selecting sequences with high percentage identity, and Tavares only-mammals alignment (orange) produced from the Rfam full sequences using Infernal. (f) For MALAT1, black corresponds to a 132 vertebrates alignment, and orange corresponds to a 13 mammals alignment derived from the previous one, both introduced in Tavares et al. (2019) . (g,h) For 5S rRNA and RNaseP RNA, we analyze also another mammals-only alignment that includes the same species as Tavares but where the selected sequence is the best E-value Infernal hit per species (maroon). Details of the alignments, their covariation, and power are given in Table 1 . (i) Detail of helix 3 of the 5S rRNA Tavares mammals-only alignment. The human sequence in this alignment is located in chromosome 8 (26, 136, 136, 998) , and it appears to be a pseudogene. (j) Detail of helix 3 of the 5S rRNA best-hit Infernal mammals alignment. The human sequence is 1 of 16 identical genes, and belongs to the longest tandem array of 5S rRNA genes located in chromosome 1 (Sørensen et al., 1991) (e.g., chr1:228,632,631-228,632,749, named RNA5S11) . The E-value of the Infernal search for each species is reported next to the alignment. Human coordinates are from assembly GRCh38/hg38. The alignments are provided in the Supplemental Materials Note: For different RNAs, we compare the covariation signal in alignments of different power and analyze the relationship between the two. In blue, alignments for which the observed and expected number of covariations are consistent with each other representing either an alignment with enough power to supports a conserved RNA structure or an alignment with little power that cannot provide information about whether a conserved RNA structure exists or not. In red, alignments with power but little or no covariation suggesting the absence of an RNA structure. The alignments' names are color coded as in Figure 7a . Tavares et al. (2019) used some mammal-restricted alignments to show examples of alignments with variability but not covariation, and concluded that covariation cannot be used to identify structural RNAs (Figure 7g,h) . However, their alignments include pseudogenes.

For example, Figure 7i shows the 5S RNA Tavares alignment (helix 3). Tavares' human 5S RNA sequence located in chromosome 8 is a 5S rRNA pseudogene (Sørensen et al., 1991) . 5S rRNA is notorious for its large number of pseudogenes, estimated to be over 500 in the human genome (International Human Genome Sequencing Consortium, 2001). Pseudogenes are not subjected to preserving a conserved structure, and their conservation pattern resembles more that of Figure 2b than that of Figure 2a .

A simple fix for avoiding most pseudogenes is to take the best hit per genome (Figures 7j) . The best-hit 5S rRNA mammal alignment with the same species as the Tavares alignment has low power and behaves normally (Figures 7g) . This is a cautionary tale; on building alignment for covariation analysis, one should be careful excluding any possible pseudogenes. Pseudogenes can obscure RNA covariation evidence by adding variation inconsistent with an RNA structure.

The alignments for lncRNAs HOTAIR, ncSRA, and repA, on the other hand, do not contain pseudogenes. Thus the discordance found in their alignments with low covariation but high power cannot be attributed (as it is the case for the Tavares mammals-only alignments) to the presence of pseudogenes in a structural RNA alignment. 

The original analysis of the HOTAIR lncRNA alignments reported a structure which the authors say is "evolutionarily conserved" (Somarowthu et al., 2015) . For example, three proposed base pairs in HOTAIR helix 10 ( Figure 8) were reported by Somarowthu et al. (2015) as covarying.

The Somarowthu et al. (2015) analysis used a data visualization program called R2R that does not perform statistical analysis. The R2R authors explicitly warn against interpreting the R2R drawing for the purpose of covariation analysis (Weinberg & Breaker, 2011) . R2R only requires a single compensatory pair substitution to annotate a pair as Putative Cyrano RNA cloverleaf structure (((((((((((((((,, <<<<<<____>>>>>><<<<<-----<<<<<<<_______>>>>>>>----->>>>>,<<<<<<____>>>>>>)))))))-))))----)))) human . The hypothetical miR-7 binding site is overlined in purple. The notation describing the alignment positions is given in Figure 4 (blue box) "covarying," so long as no more than 10% of the sequences are inconsistent with canonical base pairing of the two positions. Somarowthu et al. (2015) customized R2R's tolerance to allow up to 15% inconsistent base pairs. This is why R2R marked as covarying the three pairs of helix 10 indicated in Figure 8 , although the three base pairs include each just one compensatory change, and just as many changes inconsistent with a base pair. For instance for the 352:370 base pair in helix 10, the 352 position is a highly conserved G, and the 370 position is a mostly conserved C. There is only one pairwise compensatory substitution (an A:U in Cavia porcellus), an inconsistent substitution (A:C in Mustela), and many inconsistent substitutions at other pairs in the proposed helix. In addition, the mouse/human pairwise comparison in this HOTAIR region shows six substitutions inconsistent with the proposed structure and no compensatory base pair substitutions. Overall, the analysis of the proposed HOTAIR structure is a combination of helices such as proposed helix 10 ( Figure 8 ) and helix 11 (Figure 2c ) with a pattern of little variation, mixed with helices such as proposed helix 3 (Figure 2b) showing a pattern of large variation but not covariation.

This HOTAIR analysis shows the danger of not using the appropriate tool to assess covariation. In the words of the R2R authors, as it reads in any R2R output: "R2R is not intended to evaluate evidence for covariation or RNA structure where this is in question. It is not appropriate to use R2R's covariation markings to declare that there is evidence of structural conservation within an alignment. R2R is a drawing program." A statistical analysis of the same HOTAIR alignments shows that none of the proposed base pairs in Somarowthu et al. (2015) significantly covary (Rivas et al., 2017) , while the alignments have sufficient power to find covariation due to RNA structure if those were present .

The choice of covariation statistics mattersDifferent statistics have been developed for analyzing pairwise covariation in RNA alignments. For the purpose of predicting a consensus RNA structure for an RNA known to have one, it is advantageous to consider not only covariation but also consistency with base pairing. A completely conserved G column and a completely conserved C column show no covariation, but are consistent with a conserved G:C base pair. A structure prediction program might want to choose a statistics that rewards consistency, though perhaps not as much as covariation. One such statistic developed for RNA structure prediction is RAF (RNAalifold measure) used by the program RNAalifold (Hofacker et al., 2002) , and the related statistic RAFS (RNAalifold with stacking) (Lindgreen et al., 2006) .

However, for the purpose of distinguishing RNAs that have versus do not have an evolutionarily conserved structure, it is important to use a "pure" covariation measure such as MI or the G-test used by R-scape. A statistic like RAF (or RAFS) can erroneously assign significant "covariation" support to completely conserved base pairs.

An example of the inappropriate use of the RAFS statistic to provide support for an evolutionarily conserved RNA structure is Tavares et al. (2019) . Figure 2c depicts the Tavares alignment of HOTAIR putative helix 11 showing a five base helix. Tavares' analysis reports the three middle base pairs as "significantly covarying" because RAFS sees them as consistently conserved. There is no covariation and no compensatory base pair substitutions at these three pairs, by definition, because the AGC on the right side of the proposed three pairs is invariant. Figure 8 shows the HOTAIR alignment for putative helix 10. Tavares calls the 352:370 as significantly covarying (not the other two called by their previous Somarowthu et al. (2015) analysis though). A control for whether Tavares' analysis is detecting covariation is to shuffle the alignment by permuting the residues in each individual column. This destroys all covariation while preserving position-specific sequence conservation. On a permuted HOTAIR alignment, Tavares' analysis still calls helix 10 positions 352:370 "significantly covarying" (E = 0.016). Using Tavares' --RAFSp --window 500 --slide 100 analysis on the complete HOTAIR D1 alignment, similar numbers of "significantly covarying pairs" are detected in permuted alignments (range 28-39, in 10 different shuffles) as in the original alignment (30, at threshold E < 0.05). More details about this analysis are given in Rivas and Eddy (2018). 6.2 | A good CMfinder score does not mean an evolutionarily conserved structure RNA homology methods such as Infernal (Nawrocki & Eddy, 2013) or CMfinder (Yao et al., 2006) use both sequence and structure conservation, together with consistency with an RNA structure, in order to predict conserved RNA structures. As a result, sequence conservation and/or consistency with an RNA structure can drive a good homology score even in complete absence of covariation. Thus, a good homology score either from Infernal or CMfinder is not guarantee of an evolutionarily conserved RNA structure. Figure 9 shows an example of this situation for the case of a proposed structure for Cyrano RNA (Jones et al., 2020) .

Cyrano RNA is a long intergenic noncoding RNA (lincRNA) first identified in zebrafish with homology in vertebrates (Ulitsky et al., 2011) . Cyrano RNA includes a putative binding site for microRNA miR-7. This interaction has SRP RNA -Muscle alignment been studied for the possible influence of Cyrano on animal behavior (Bitetti et al., 2018; Kleaveland et al., 2018) . However, proposed functions of Cyrano RNA have been called into question by recent publications that find that Cyrano is dispensable in zebrafish development (Goudarzi et al., 2019) , and dispensable as well for pluripotency of human stem cells (Hunkler et al., 2020) . In a recent manuscript, Jones et al. (2020) proposed an RNA structure for Cyrano which is said to be evolutionarily conserved from fish to mammals. Figure 9 shows the cloverleaf structure for human Cyrano proposed by Jones et al. (2020) . The structure was identified using CMfinder. The base pairs framed in two black boxes are said to be evolutionarily conserved because they have a good CMfinder score (Jones et al., 2020) .

In order to assess whether the proposed Cyrano cloverleaf structure is evolutionarily conserved, we created the vertebrate alignment shown in Figure 9 . The alignment was created using an Infernal model for the human Cyrano cloverleaf sequence and structure. This Cyrano Infernal model was used to search the UCSD 100 vertebrate genome database. An alignment of the best hits was created using the Infernal program cmalign. The alignment with 27 sequences includes mammals, marsupials, and fish species.

The R-scape analysis of this Cyrano alignment shows one covarying base pair, and consistently it expects 3 ± 2 base pairs to covary. This means the alignment has little variability from which it is not possible to assert the presence of a conserved RNA structure. While the analysis of the overall structure clearly concludes that the alignment lacks variability, the analysis of individual base pairs indicates that at least two of them 45:63 and 48:60 have enough power to start questioning whether the variability observed is consistent with an RNA base pairing at all.

The Cyrano sequence is conserved from fish to human, but it is impossible to decide whether the proposed structure is conserved as well. The fact that the Cyrano sequence is conserved is not enough. This Cyrano region is completely duplicated in human (Cyrano: chr15 41300362 41300860+; Duplication: chr1 240759949 240759453−) as well as in mouse (Cyrano: chr2 119601930 119602533+; Duplication: chr3 129505993 129505339−). The fact that the sequence seems to be mostly consistent with the proposed cloverleaf structure is also not enough, as sequences, even random ones, usually conform with consistent structures. The covariation and power analysis is the way to assess whether the RNA structure is conserved or not. The alignment in Figure 9 is at best inconclusive on that regard.

Observing structural covariation strongly relies on having an alignment where homologous base pairs are aligned respecting the structural constraints of the molecule. Conserved RNA structures can have important differences from species to species: sometimes helices have different number of base pairs; even entire helices may be missing in particular groups of species. The alignment of structural RNAs is further complicated by the fact that the pattern of mutations is more often dictated by base pairing correlations than by simple position conservation. Because helices can have variable number of base pairs and compensatory substitutions, alignments built without taking into account the conserved structure can easily misalign residues in helical regions.

Perhaps counterintuitively, misalignments can create spurious covariations. Figure 10a shows an example of spurious covariations found in an alignment for the lncRNA COOLAIR (Hawkes et al., 2016) . As illustrated in Figure 10b , a misaligned helix in which base paired residues slide relative to the consensus for a fraction of the sequences will result in spurious covariations.

Alignments with base pair misalignments can be identified by performing structural realignments. A technique to identify spurious covariations consists of realigning the sequences using an Infernal model build with the proposed structure. An Infernal realignment of the COOLAIR sequences in Figure 10a shows that the same COOLAIR structure F I G U R E 1 0 Spurious covariations due to misalignments. (a, top) COOLAIR alignment presented in Hawkes et al. (2016) . The green asterisks indicate the position of the five spurious covariations. (a, bottom) Realignment of the same sequences using the program Infernal. The realignment supports the same structure without substitution or gaps in the base paired positions. Derived from Figure 2d of Rivas et al. (2020) . (b) Cartoon illustrating the sequence sliding effect that results in spurious covariations. (c) CaCoFold structure prediction for a collection of 312 signal recognition particle (SRP) RNAs from different species including metazoan, protozoa, plants, and bacteria (large and small). The SRP sequences are aligned using the program MUSCLE. (d) Reanalysis of the same sequences, by creating an Infernal model for just one of the sequences (Zea mays SRP) using the CaCoFold predicted structure. An alignment is produced using the Infernal program cmsearch with default E-value cutoff. The Infernal alignment includes 75 out of the 312 SRP sequences that report a significant hit is supported by an alignment that has no variation or covariation. This shows that there is a consistent structure between conserved sequences, but too conserved to infer the presence or not of a conserved RNA structure.

Infernal (Nawrocki & Eddy, 2013) performs structural alignments using both the sequences and a consensus structure. Given a multiple sequence alignment and a consensus secondary structure for all the sequences, Infernal builds a profile context-free grammar (Durbin et al., 1998) that can be used to find structural homologs (Infernal program cmsearch), and to make an alignment of the homologs (program cmalign). An Infernal model simultaneously scores conservation, covariation, and consistency with the proposed RNA structure. Using Infernal, the database Rfam has collected reliable alignments of over 3000 structural RNA families (Kalvari et al., 2018) .

As a particular case, Infernal can build a model based only in one RNA sequence annotated with a structure. We built an Infernal model for the Arabidopsis thaliana sequence and the structure proposed in Figure 10a . The realignment of all sequences using this one sequence/one structure Infernal model produces the COOLAIR alignment in Figure 10b which supports the same structure but the helix is completely conserved.

As a different example, Figure 10c shows for a collection of 312 metazoan, protozoa, plants, and bacteria signal recognition particle (SRP) RNAs, the covariation found in a nonstructural alignment of all sequences created using the method MUSCLE (Edgar, 2004) . Most of the covariations are spurious, and they do not relate to the structure of SRP. On the other hand, an alignment of the sequences using the method Infernal by building a one sequence/one structure covariance model results in a very different pattern of covariation that recapitulates the SRP structure (Figure 10d ).

Direct coupling analysis (DCA) is a method of describing residue-to-residue correlations by inferring the direct pairwise statistical interactions in a biological sequence, as opposed to indirect interactions, where two residues that do not directly interact are correlated because both interact to a third residue resulting in a network effect (Weigt et al., 2009) .

DCA methods are based on the statistical mechanical Potts model (Potts, 1952) . Potts models are a theoretical advance relative to other correlation measures taken directly from the alignment, such as the above mentioned G-test and MI which cannot distinguish direct from indirect interactions.

Indirect interactions in RNA can appear due to base triples and other tertiary interactions (Batey et al., 1999) . RNA bases have three distinct edges: the WC, Hoogsteen, and Sugar edges. RNA base pairing occurs by direct interaction between any two edges which can form at least two hydrogen bonds, and can have cis or trans orientation resulting in 12 different types of direct base pairs (Leontis & Westhof, 2001) . The most common pairs are cis WC base pairs, all other 11 types are usually referred to as the non-Watson-Crick (non-WC) base pairs. Triple base pairs form when a base directly interacts with two other bases using two different edges (a found example is an A forming a cis WC pair with a U and a Hoogsteen-type pair with another U). Base triples can induce indirect correlations between the other two bases. Because non-WC direct interactions tend to show low covariation signal, indirect interactions due to base triples which involve at least one non-WC pair are not expected to have strong covariation signal.

A Potts model describes the probability of a sequence s 1 …s L as,

The parameters {J ij } i < j are referred to as the direct couplings. The partition function Z L provides the appropriate normalization over all possible sequences of length L. (1) is the maximum entropy probabilistic model (Jaynes, 1982) that reproduces observed arbitrary single and pairwise residue frequencies. Thus, for a Potts model to be consistent with an alignment, it has to satisfy that the marginal probabilities for one and two positions are equal to the corresponding empirical frequencies f i (a) and f ij (a, b) observed in the alignment, that is,

where 1 ≤ s i ≤ K, for an alphabet of size K. DCA methods calculate the correlation between two positions i, j using the direct information (DI) statistic (Weigt et al., 2009) ,

where the "dir" probabilities 

F I G U R E 1 1 Comparison of different measures of covariation on 19 structural RNAs. We report the number of total base pairs detected as a function of the positive predictive value (PPV, fraction of predictions that are base pairs). G-test scores are calculated using R-scape (option --naive). EC (evolutionary coupling) scores are those provided in Weinreb et al. (2016) on the same alignments. BL-DCA scores are calculated with the code provided in Cuturello et al. (2020) . Dashed lines correspond to 50% PPV (horizontal) and 50% sensitivity (vertical). Results for each structural RNA are given in Figure S1 and Table S1 . The seed alignments come from Rfam v14.2. The full alignments are those provided in Weinreb et al. (2016) . The annotation of both Watson-Crick (WC) as well as non-Watson-Crick (non-WC) base pairs are derived from the PDB files using the program RNAview (Yang et al., 2003) We report the total number of detected base pairs (sensitivity) at 50% positive predicted value (PPV, the fraction of the detected base pairs that are true base pairs). G-test APC corrected scores are calculated using the program R-scape (option: --naive). BL-DCA scores derived from DCA couplings trained using Boltzmann learning are calculated using the code provided with (Cuturello et al., 2020) . Evolutionary couplings (ECs) scores calculated from Potts models trained using pseudo-maximum likelihood optimization come directly from (Weinreb et al., 2016) . Running times for ECs were not given. Chen et al., Mol Cell 2017, Fig S1A 5ś ynthesis initiation 

Ch Ch Ch Ch Ch Ch Ch Ch Ch C Ch Ch C Ch Ch Ch C Ch Ch Ch h C C en en en en en en en en en en en en en en en n en e en n n n n n en en en n n n n n n n n n n n n n en n n n n n n a a a a a a a a a a a a a a a a a a F I G U R E 1 2 Covariation not related to RNA structure. In orange, significant covariations not attributed to RNA structure. In green, significant covariations attributed to RNA structure. (a) The tRNA alignment shows three significantly covarying pairs in the AC loop not related to the RNA structure. For each pair, we provide information about the observed correlations. A:B mean that probability of finding B at the 3 0 end of the pair, given there is an A at the 5 0 end, that is P(Bj A), is higher than 0.85; A:Bh means that it is between 0.5 and 0.85; and A:notB means that the probability of B given A is lower than 0.05. In pink, we also show a singly hydrogen-bonded base pair with covariation support found at the junction of the AC loop and stem (Auffinger & Westhof, 1999) . Some covarying pairs between the D and T loops also due to RNA structure are omitted for clarity. (b) In 6S RNA, one covarying pair between two residues contiguous in the backbone involving the first position of the RNA product (pRNA) produced by the molecule (Chen et al., 2017) . (c) Multiple short-range covariations in the mRNA-like domain of the tmRNA (Ramrath et al., 2012) . Many of the residues also show significant covariations due to the RNA structure. The covariation analysis was performed in the corresponding Rfam seed alignments using R-scape and CaCoFold. Figure is derived from Figure 5 and Figure S6 of Rivas et al. (2020) depend on the Potts model coupling parameters J ij (a, b), and on some modified parametersĥ i a ð Þ,ĥ j b ð Þ defined by the conditions P j P b P ij dir a, b ð Þ= f i a ð Þ , and P i P a P ij dir a, b ð Þ= f j b ð Þ . The DI scores are usually corrected using the APC (Dunn et al., 2007) .

DCA methods have proven successful in predicting amino acid contacts from protein alignments, which in turn can be used to predict a protein 3D structure (Ekeberg et al., 2013; Jones et al., 2012; Kamisetty et al., 2013; Marks et al., 2011; Morcos et al., 2011) . DCA models have been applied as well to calculate RNA covariations in structural RNA alignments (De Leonardis et al., 2015; Weinreb et al., 2016) .

Using DCA statistics requires inferring the coupling parameters from the given alignment. That is not a trivial process, and several different DCA methods exist depending on different optimization methods to train the coupling parameters. For RNA, several methods have been developed using pseudo-maximum likelihood optimization such as DCA scores (De Leonardis et al., 2015) , and evolutionary couplings (ECs) (Weinreb et al., 2016) ; and others using Boltzmann learning such as BL-DCA (Cuturello et al., 2020) .

Here, we study the effectiveness of these methods in predicting RNA base pairs, and we compare the ECs and BL-DCA scores to those of a simpler G-test statistic which does not require parameter training and in principle does not distinguish between direct and indirect interactions.

For 19 structural RNAs with experimentally determined 3D structures, we report the number of base pairs detected as a function of the positive predicted value (PPV or fraction of the detected base pairs that are true base pairs) for each of the three methods ( Figure 11 and Figure S1 ). The list includes two ribozymes (RNaseP RNA and GlmS), tRNAs and selenocysteine tRNA, transfer-messenger RNA (tmRNA), 5.8S rRNA, two SRP RNAs (metazoan and bacterial), group II intron, and 10 riboswitches. For each RNA, we use two different Rfam alignments (seed and full) annotated with the same RNA structure. The annotated base pairs are inferred from crystal structures and include both WC and non-WC (Table S1) .

Overall, our experiments show that for structural RNAs, there is little performance difference using DCA methods versus a simpler G-test statistic. For most RNAs, we observe a sensitivity threshold at which there is a sharp transition from high PPVs to low PPVs ( Figure S1 ). This sensitivity threshold seems to be mostly dependent on the alignment, and all three methods tend to perform closely to each other (with some variability across RNAs) by the time it is reached. In Table S1 , we report the sensitivity threshold, operationally measured at 50% PPV. Figure 11 summarizes these results. We observe that the sensitivity (measured at 50% PPV) of the G-test versus DCA methods is almost identical: 61% of base pairs detected using G-test versus 59% with ECs ( Figure 11 and Table 2 ). This similarity is likely to be the consequence that, unlike proteins, most RNA interactions are direct. The detection of WC base pairs ranges from 70% with G-test to 66% with ECs. DCA couplings seem to provide a small increase in the determination of non-WC bases (from 10% sensitivity at 50% PPV with G-test to 17% with ECs). This result could be because some non-WC interactions create network effects as they are not necessarily disjoint interactions. On the other hand, the time requirements for training a Potts model are vastly larger than those of calculating the G-test statistic ( Table 2 and Table S1 ).

A conserved RNA structure results in covariation, but a conserved RNA structure is not the only source of covariation in an RNA alignment. The method R-scape (Rivas et al., 2017) introduced an empirical model to test the hypothesis of covariation due just to the phylogenetic relationships between the sequences without involving any correlations between specific positions. Using a null model of phylogenetic covariation has enabled identification of significant covariations in alignments of many structural RNAs .

However, a significant covariation above phylogenetic expectation does not mean that it has to be due to a conserved RNA structure. We have observed various sources of nonphylogenetic and non-RNA structure covariations while analyzing many RNA alignments (Rivas, 2020) . Three examples observed in Rfam seed alignments are given in Figure 12 . One source of covariation not due to base pairing are interactions with other molecules. Examples are: (1) in Figure 12a : a covariation between the tRNA middle anticodon position (residue 35) and the discriminator located at the 5 0 end of the molecule (residue 73). Both the discriminator and the anticodon bind to the tRNA synthetase, and they are both involved in determining the aminoacylation identity of the tRNA (Giegé et al., 1998) . There are two other CaCoFold Glutamine riboswitch In vivo SHAPE reactivity F I G U R E 1 3 RNA structure prediction using evolutionary information. Comparison of structural predictions by the methods: RNAalifold (Bernhart et al., 2008) , R-scape covariation analysis on the RNAalifold predicted structure (Rivas et al., 2017) , Rfam (Kalvari et al., 2018) , and CaCoFold (Rivas, 2020) . For: (a) the glutamine riboswitch which includes a crystal structure, (b) the coronavirus 3 0 UTR pseudoknot, which includes results from in vivo SHAPE data (Manfredonia et al., 2020) , and (c) the RtR RNA, an RNA element from the tyrT operon of Escherichia coli. The structures produced with RNAalifold incorporate the Rfam structure as a constraint (option --SS_cons). The structures produced with CaCoFold perform the covariation analysis using the R-scape two-set mode that tests the Rfam proposed structure (option -s --fold). In blue, motifs identified by covariation alone. Figure is derived from Figures S4, S5 , and S7 of Rivas et al. (2020) significant covariations in the AC loop involving the 3 0 end position of the anticodon (residue 36) and other AC loop residues. Those covarying pairs are 36:37 and 36:38. The correlations observed in these two pairs appear to be related to translational efficiency (Yarus, 1982) . Another AC loop covariation observed between positions 32:38 and adjacent to the AC stem is a single hydrogen-bond base pairs (Auffinger & Westhof, 1999) .

(2) In Figure 12b : a covariation in 6S RNA involving two contiguous residues at which the synthesis of the RNA product initiates. The 6S RNA structure mimics an open promoter and serves as a transcription template. Figure 12c shows another source of covariation not due to RNA structure. The tmRNA is responsible for removing defective mRNAs without a stop codon stacked at the ribosome by providing a short mRNA template ending on a stop codon. For the mRNA-like domain (MLD) of tmRNA, we observe both covariations associated to RNA structure (part of the MLD sequence is involved in an RNA helix), as well as multiple other covariations between contiguous residues due to the coding structure of the MLD region.

The development of power calculations, in addition to significance testing, makes it possible to identify pairs of bases which have plenty of variation, yet not significant covariation. Such pairs of positions are unlikely to form consensus RNA base pairs. We call this "negative" evolutionary information (evidence against a conserved base pair). RNA structure prediction can be made more reliable by using both positive and negative evolutionary information in the form of base pairs that covary and base pairs that vary but do not covary. Given an RNA alignment, the method CaCoFold infers a consensus RNA structure that incorporates all covarying base pairs and avoids all negative base pairs (Rivas, 2020) . CaCoFold uses a battery of probabilistic folding grammars that incorporate in layers all observed covarying pairs. A visualization of the resulting structure and the significant covariation that supports it helps identify which parts of the predicted structure are reliable based on their covariation signal, and which are only a prediction consistent with RNA base pairing.

Covariation analysis helps identify structural elements that otherwise would remain undetected, such as a single base pair pseudoknot in the glutamine riboswitch (Figure 13a ). The pseudoknot is not reported by Rfam or methods like RNAalifold, but because the base pair significantly covaries, R-scape confirms the interaction, and CaCoFold integrates the base pair as part of the structure. A G:A interaction reported in the E-loop is very conserved, and no covariation is detected.

Covariation helps predict new structural elements. For instance, for the coronavirus 3 0 UTR pseudoknot, the covariation analysis of the proposed Rfam structure identifies a new hairpin loop with an AA bulge, a standard RNA motif (Lilley, 1995) . The extra proposed helix converts the already identified pseudoknot between a hairpin loop and a single stranded region to a kissing loop pseudoknot between two hairpin loops ( Figure 13b ). In vivo SHAPE data for SARS-CoV-2 provides support only for one of the three helices in this 3 0 UTR motif, even though all three helices have covariation support (Manfredonia et al., 2020) .

Covariation also provides a critical assessment of which parts of the structure are well determined versus which are not. Figure 13c shows predictions for the structure for the vTR RNA (repeat structure of the Escherichia coli tyrT operon). Covariation helps identify one additional helix with covariation support which frames a tandem GA, another recurrent RNA motif (Gautheret et al., 1994) . It also helps extend another helix due to additional covariation support. We also observe that parts of the structure of the vTR RNA (Figure 4b ) are still unconfirmed by the current evolutionary information as there is one proposed helix without any covariation support.

A conserved structural RNA implies a slower rate of substitutions at base paired positions, thus conserved structural RNAs from a clade will result in alignments with sequence conservation. However, a conserved RNA sequence does not imply the existence of a conserved RNA structure. Fortunately, there is a distinctive pattern of sequence change associated to a conserved RNA structure different from that of other conservation signals. The identification of novel RNA structures from uncharacterized conserved RNAs is enabled by covariation analysis, and a method to assess which covariations can significantly be excluded from having a phylogenetic source.

Single-sequence methods of RNA structure analysis (computational and/or experimental) do not reliably identify conserved RNA structure. Covariation and variation information found in alignments of conserved RNAs help distinguish conserved RNA structures from conserved RNAs not supporting a structure. On the other hand, conserved RNA structure cannot be inferred from conserved RNAs without variability.

Covariation analysis requires a covariation measure and a test to distinguish covariation due to RNA structure versus covariation due to other sources. Acceptable covariation statistics are those that measure covariation alone, such as MI, G-test, or DCA couplings. Covariation measures that also score conservation and consistency with an RNA structure are not acceptable to decide on the presence of a conserved RNA structure as both conservation and consistency occur frequently in RNA sequences, almost with independence of the presence or not of an RNA structure.

R-scape provides a statistical test to identify base pairs with covariation above phylogenetic expectation. Statistically significant pairwise covariation could still sometimes be due to other sources than a conserved RNA structure. The method CaCoFold which proposed an RNA structure with arbitrary topology using all covariation information present in the alignment is able to display the RNA structure supported by covariation, other covarying interactions not attributed to RNA base pairing, and the regions of the structure with poor determination due to the absence of covariation support.

The accuracy of alignments is fundamental in recovering the evolutionary signals left by a conserved RNA structure. Most alignment algorithms assume a position independent pattern of substitutions which often disrupts the pattern of structural RNAs and may even induce spurious covariation. Starting from a one-sequence/structure Infernal model to produce the alignment of all conserved sequences is usually better (even if the one-sequence structure is only partially correct) than using alignments by other standard methods. Emphasis on improving RNA structural alignment methods so that they can be informed not just by the nested base pairs but by all arbitrary RNA base pairing will greatly help the identification of novel conserved structural RNAs.

There are other RNA homology methods comparable to CMfinder that attempt to extract from a genome regions with a conserved RNA structure such as QRNA , RNAz (Gruber et al., 2010) , or EvoFold (Pedersen et al., 2006) . RNA genefinding efforts have been effective in small bacterial genomes (del Val et al., 2007; , but in eukaryotic genomes they produce too many predictions with too low specificity (Parker et al., 2011; Pedersen et al., 2006; Torarinsson et al., 2006 Torarinsson et al., , 2008 Washietl et al., 2005 Washietl et al., , 2007 Washietl et al., , 2011 . These methods use both sequence and structure conservation. On the other hand, R-scape measures only covariation and has a tunable false discovery rate, which opens a new line of attack on structural RNA genefinding (Rivas et al., 2017) .

The author thanks Sean Eddy and William Gao for comments on the manuscript.

The author has declared no conflicts of interest for this article.

A tarball with the data used in this manuscript is located at http://rivaslab.org/publications/Rivas21/Rivas21-review_ supplement.tar.gz.

Elena Rivas https://orcid.org/0000-0002-2084-269X RELATED WIREs ARTICLE Unraveling the structure and biological functions of RNA triple helices

Phylogenetically enhanced statistical tools for RNA structure prediction

RNAsoft: A suite of RNA secondary structure prediction and design software tools

Efficient parameter estimation for RNA secondary structure prediction

Singly and bifurcated hydrogen-bonded base-pairs in tRNA anticodon hairpins and ribozymes

Tertiary motifs in RNA structure and folding

RNAalifold: Improved consensus structure prediction for RNA alignments

MicroRNA degradation by a conserved target RNA regulates animal behavior

6S RNA mimics B-form DNA to regulate Escherichia coli RNA polymerase

Assessing the accuracy of direct-coupling analysis for RNA contact prediction

Direct-coupling analysis of nucleotide coevolution facilitates RNA secondary and tertiary structure prediction

Accurate SHAPE-directed RNA structure determination

Identification of differentially expressed small non-coding RNAs in the legume endosymbiont Sinorhizobium meliloti by comparative genomics

Sfold web server for statistical folding and rational design of nucleic acids

A partition function algorithm for nucleic acid secondary structure including pseudoknots

CONTRAfold: RNA secondary structure prediction without physics-based models

Evaluation of the suitability of free-energy minimization using nearestneighbor energy parameters for RNA secondary structure prediction

Evaluation of several lightweight stochastic context-free grammars for RNA secondary structure prediction

Mutual information without the influence of phylogeny or entropy dramatically improves residue contact predictions

Biological sequence analysis: Probabilistic models of proteins and nucleic acids

Detecting coevolving positions in a molecule: Why and how to account for phylogeny

Computational analysis of conserved RNA secondary structure in transcriptomes and genomes

Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models

Probing Xist RNA structure in cells using targeted structure-seq

RNA folding kinetics at elementary step resolution

A major family of motifs involving G.A mismatches in ribosomal RNA

Universal rules and idiosyncratic features in tRNA identity

Individual long non-coding RNAs have no overt functions in zebrafish embryogenesis, viability and fertility. eLife

The ViennaRNA web services

RNAz 2.0: Improved noncoding RNA detection

Ten lessons with Carl Woese about RNA and comparative analysis

Lessons from an evolving rRNA: 16S and 23S rRNA structures from a comparative perspective

Identifying constraints on the higher-order structure of RNA: Continued development and application of comparative sequence analysis methods

Comparative anatomy of 16S-like ribosomal RNA

Prediction of RNA secondary structure using generalized centroid estimators

COOLAIR antisense RNAs form evolutionarily conserved elaborate secondary structures

Secondary structure prediction for aligned RNA sequences

Structure of a ribonucleic acid

The long non-coding RNA Cyrano is dispensable for pluripotency of murine and human pluripotent stem cells

In vivo probing of nascent RNA structures reveals principles of cotranscriptional folding

Initial sequencing and analysis of the human genome

On the rationale of maximum-entropy methods

An evolutionarily-conserved RNA structure in the functional core of the lincRNA Cyrano

PSICOV: Precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments

Rfam 13.0: Shifting to a genome-centric resource for non-coding RNA families

Assessing the utility of coevolution-based residue-residue contact predictions in a sequence-and structure-rich era

A network of noncoding regulatory RNAs acts in the mammalian brain

A statistical analysis of RNA folding algorithms through thermodynamic parameter perturbation

Geometric nomenclature and classification of RNA base pairs

Kinking of DNA and RNA by base bulges

Measuring covariation in RNA alignments: Physical realism improves information measures

Visualizing the secondary and tertiary architectural domains of lncRNA RepA

SHAPE-Seq 2.0: Systematic optimization and extension of high-throughput chemical probing of RNA secondary structure with next generation sequencing

Improved RNA secondary structure prediction by maximizing expected pair accuracy

2-D structure of the A region of Xist RNA and its implication for PRC2 association

Genome-wide mapping of SARS-CoV-2 RNA structures identifies therapeutically-relevant elements

Protein 3D structure computed from evolutionary sequence variation

Modeling RNA tertiary structure from patterns of sequence variation

Comparison of fungal mitochondrial introns reveals extensive homologies in RNA secondary structure

A kinetic model of RNA folding. Boiosystems

Structure of the S-adenosylmethionine riboswitch regulatory mRNA element

Directcoupling analysis of residue coevolution captures native contacts across many protein families

RNA base-pairing complexity in living cells visualized by correlated chemical probing

Infernal 1.1: 100-fold faster RNA homology searches

Secondary structure model for 23S ribosomal RNA

Structural architecture of the human long non-coding RNA, steroid receptor RNA activator

Algorithms for loop matchings

Phylogenetic comparative analysis and the secondary structure of ribonuclease P RNA -A review

New families of human regulatory RNA structures identified by comparative analysis of vertebrate genomes

Identification and classification of conserved RNA secondary structures in the human genome

Rearrangement of competing U2 RNA helices within the spliceosome promotes multiple steps in splicing

Invariant U2 snRNA nucleotides form a stem loop to recognize the intron early in splicing

Some generalized order-disorder transformations

The complex of tmRNA-SmpB and EF-G on translocating ribosomes

RNA genome conservation and secondary structure in SARS-CoV-2 and SARS-related viruses: A first look

RNAstructure: Software for RNA secondary structure prediction and analysis

Evolutionary evidence for alternative structure in RNA sequence co-variation

The four ingredients of single-sequence RNA secondary structure prediction: A unifying perspective

RNA structure prediction using positive and negative evolutionary information

A statistical test for conserved RNA structure shows lack of evidence for structure in lncRNAs

Estimating the power of sequence covariation for detecting conserved RNA structure

A dynamic programming algorithm for RNA structure prediction including pseudoknots

Secondary structure alone is generally not statistically significant for the detection of noncoding RNAs

Noncoding RNA gene detection using comparative sequence analysis

Response to Tavares et al., "covariation analysis with improved parameters reveals conservation in lncRNA structures

Computational identification of noncoding RNAs in E. coli by comparative genomics

A range of complex probabilistic models for RNA secondary structure prediction that include the nearest neighbor model and more

A note on the concept of entropy

HOTAIR forms an intricate and modular secondary structure

Fine mapping of human 5S rRNA genes to chromosome 1q42.11-q42.13

Evaluating the accuracy of SHAPE-directed RNA secondary structure predictions

GTfold: Enabling parallel RNA secondary structure prediction on multi-core desktops

Phylogenetic analysis with improved parameters reveals conservation in lncRNA structures

Thousands of corresponding human and mouse genomic regions unalignable in primary sequence contain common RNA structure

Comparative genomics beyond sequence-based alignments: RNA structures in the ENCODE regions

Conserved function of lincRNAs in vertebrate embryonic development despite rapid sequence evolution

Mapping of conserved RNA secondary structures predicts thousands of functional noncoding RNAs in the human genome

RNA folding with soft constraints: Reconciliation of probing data and thermodynamic secondary structure prediction

Structured RNAs in the ENCODE selected regions of the human genome

New families of human regulatory RNA structures identified by comparative analysis of vertebrate genomes

Architecture and secondary structure of an entire HIV-1 RNA genome

Identification of direct residue contacts in protein-protein interaction by message passing

R2R -Software to speed the depiction of aesthetic consensus RNA secondary structures

3D RNA and functional interactions from evolutionary couplings

Phylogenetic analysis of tmRNA secondary structure

Exact folding dynamics of RNA secondary structures

The log likelihood ratio test (the G-test)

Tools for the automatic identification and classification of RNA base pairs

CMfinder -A covariance model based RNA motif finding algorithm

Translational efficiency of transfer RNA's: Uses of an extended anticodon

Integrating chemical footprinting data into RNA secondary structure prediction

Structurally conserved five nucleotide bulge determines the overall topology of the core domain of human telomerase RNA

Four RNA families with functional transient structures

On finding all suboptimal foldings of an RNA molecule

RNA secondary structures and their prediction

Additional supporting information may be found online in the Supporting Information section at the end of this article.How to cite this article: Rivas E. Evolutionary conservation of RNA sequence and structure. WIREs RNA. 2021; e1649. https://doi.org/10.1002/wrna.1649