|
|
|
|
Genome Res. 14:507-516, 2004 ©2004 by Cold Spring Harbor Laboratory Press; ISSN 1088-9051/04 $5.00 Reconstructing the Genomic Architecture of Ancestral Mammals: Lessons From Human, Mouse, and Rat Genomes1 Centre de Recherches Mathématiques, Université de Montréal, Canada H3C 3J7 2 Department of Computer Science and Engineering, University of CaliforniaSan Diego, La Jolla, California 92093, USA 3 Department of Mathematics, University of CaliforniaSan Diego, La Jolla, California 92093, USA
Recent analysis of genome rearrangements in human and mouse genomes revealed evidence for more rearrangements than thought previously and shed light on previously unknown features of mammalian evolution, like breakpoint reuse and numerous microrearrangements. However, two-way analysis cannot reveal the genomic architecture of ancestral mammals or assign rearrangement events to different lineages. Thus, the "original synteny" problem introduced by Nadeau and Sankoff previously, remains unsolved, as at least three mammalian genomes are required to derive the ancestral mammalian karyotype. We show that availability of the rat genome allows one to reconstruct a putative genomic architecture of the ancestral murid rodent genome. This reconstruction suggests that this ancestral genome retained many previously postulated chromosome associations in the placental ancestor and reveals others that were beyond the resolution of cytogenetic, radiation hybrid mapping, and chromosome painting techniques. Three-way analysis of rearrangements leads to a reliable reconstruction of the genomic architecture of specific regions in the murid ancestor, including the X chromosome, and for the first time allows one to assign major rearrangement events to one of human, mouse, and rat lineages. Our analysis implies that the rate of rearrangements is much higher in murid rodents than in the human lineage and confirms the existence of rearrangement hot-spots in all three lineages.
Molecular evolution studies are usually based on the analysis of individual genes rather than entire genomes. An alternative approach is to infer the evolutionary history of entire genomes, rather than individual genes, on the basis of the analysis of gene orders. Human, mouse, and rat genomic sequences, for the first time, provide the opportunity to accurately estimate the extent of rearrangement events and to derive the putative genomic architecture of ancestral mammalian genomes.
Every genome rearrangement study involves solving a combinatorial puzzle to find a series of genome rearrangements to transform one genome into another. For multichromosomal genomes, the most common rearrangements are reversals (also known as inversions), translocations, fusions, and fissions, and the number of such rearrangements in a most parsimonious scenario is known as the genomic distance between multichromosomal genomes. Finding the genomic distance is a difficult combinatorial problem. The shortcoming of early genome rearrangement studies is that they considered breakpoints independently without revealing combinatorial dependencies between related breakpoints. Kececioglu and Sankoff (1995
Multiple microrearrangements within synteny blocks call for development of new synteny block generation algorithms that adequately address the complex rearrangement history of mammalian genomes. Recently, Waterston et al. (2002
Synteny Blocks We demonstrate that human and rat share 417 synteny blocks of size at least 300 kb, on the basis of the current assemblies. (Human and mouse share 394, whereas mouse and rat share 162.) Rearrangements in the mouse lineage further break some of the humanrat synteny blocks into smaller blocks, thus creating an even more granular representation of comparative genomic architecture of three species (Fig. 1). However, many of these newly formed synteny blocks are too short to pass the 300-kb block-length threshold, so the number of three-way humanmouserat synteny blocks of length 300 kb or longer is reduced to 391 (see Tables 1 and 2 for details).5
Although the Hannenhalli-Pevzner theory provided efficient tools to study rearrangements between two genomes, integration of data from multiple genomes (genome phylogeny) represent a more difficult task. Initial work on this topic was based on breakpoint distances between pairs of genomes (Blanchette et al. 1997 Using the 391 three-way blocks, MGR reveals evidence of at least 293 pairwise macrorearrangements between human and mouse, 299 between human and rat, and 100 between mouse and rat (these are different from the figures for macrorearrangements in Table 1, which were based on GRIMM-Synteny's two-way synteny blocks that were constructed without regard to the third genome), and constructs a three-way rearrangement scenario between human, mouse, and rat. The constraints of fitting all three genomes into the same scenario increase the pairwise distances slightly to 298, 303, and 107, respectively, within the three-way scenario. Within the 391 three-way blocks, there is evidence of at least 1070 microrearrangements between human and mouse, 1533 between human and rat, and 1260 between mouse and rat (although many of them may be artifacts of incorrect assemblies). MGR further identifies the putative murid rodent ancestor (more precisely, it computes a possible median ancestor of human, mouse, and rat; this median is a close approximation to the last common ancestor of mouse and rat; see the tree in Fig. 3, below) and estimates the number of rearrangement events on the evolutionary path from the ancestor to human, mouse, and rat. This reconstruction suggests that the ancestral murid rodent genome retained many previously postulated chromosome associations of the placental ancestor. This analysis gives an estimated rate of 3.2 chromosomal rearrangements per million years on the mouse branch from the murid rodent ancestor; 3.5 chromosomal rearrangements per million years on the rat branch; and 1.6 chromosomal rearrangements per million years on the human branch (these rates are estimated by taking the ratio between the number of rearrangements in the putative scenario recovered and the estimated time of divergence). Our results imply that rodents may have unusually rapid chromosome alterations. The sequencing data for chimpanzee and dog may soon shed further light on the comparative rates of rearrangements in different branches of the mammalian evolutionary tree. Our three-way analysis of rearrangements within particular regions, such as the X chromosome or a large preserved region of human chromosome 17, mouse chromosome 11, and rat chromosome 10 (h17/m11/r10) leads to a reliable reconstruction of the genomic architecture of the murid ancestor of these regions, and for the first time, allows one to assign the major rearrangement events to one of human, mouse, and rat lineages.
Summary of Methods We compared the following assemblies: Human (April 2003, NCBI build 33); Mouse (Feb. 2003, NCBI build 30); and Rat (June 2003, Baylor HGSC v. 3.1). They were first repeat masked by the UCSC Genome Bioinformatics group (Kent et al. 2002
PatternHunter generated
Because the existing repeatmasking tools are far from perfect, PatternHunter's output, similar to other genome-scale alignment tools, is contaminated by repeats. We remove this contamination and combine the remaining similarities into two- and three-way anchors by the algorithm described below. We ran these anchors through GRIMM-Synteny (Pevzner and Tesler 2003a
Some of these steps are illustrated for h17/m11/r10 in Figure 2. A related illustration for X chromosome evolution will appear in the Rat Genome Sequencing Project Consortium 2004
From Local Alignments to Anchors Constructing Two-Way Anchors The assemblies were repeat masked and PatternHunter produced local alignments between two repeat-masked sequences. However, as repeat masking is not perfect, many repeats still survived masking, resulting in multiple hits on the same genomic coordinates. The genome rearrangement algorithms are not designed to work with repeated regions, and all repeats have to be discarded before the rearrangement analysis starts. We separated the unique hits from the repeats by the following algorithm, which we explain using human and mouse.
The PatternHunter alignments are base-by-base alignments between an interval of a human chromosome and an interval of a mouse chromosome. Each alignment is between an interval chromosome; start...end for human and chromosome, start...end for mouse, and has a sign The unique hits and repeats are separated as follows.6
GRIMM-Anchors-2d
We formed 642,542 humanmouse anchors, 598,632 humanrat anchors, and 1,279,600 mouserat anchors by this procedure, ranging in size from 30 bp up to about 14,000 bp. (Although PatternHunter reported some larger alignments, they were classified as repeat families by this procedure and discarded.) Next, these were input to GRIMM-Synteny to construct two-way synteny blocks for breakpoint reuse analysis (see below), and separately, they were combined into 291,000 three-way humanmouserat anchors, as described below. We emphasize that the produced anchors do not necessarily represent similarities within human and mouse genes, but may also represent similarities between noncoding regions. This is a departure from the previous gene order comparison approach of genome rearrangement studies. It allows us to bypass the difficult issues of gene annotation and ortholog identification, which are not necessary for genome rearrangement studies. The processing of PatternHunter local alignments described above may remove some unique regions if such regions are combined with repeats in the PatternHunter output. However, the number of such discarded unique regions is typically small compared with all unique regions, and removing such regions does not have a serious effect on the constructed synteny blocks. This shortcoming of available repeat-masking tools can be addressed by a more involved analysis of the graph components with multiple edges, and we will consider them in future research, unless the accuracy of repeat masking improves.
From Two-Way Anchors to Three-Way Anchors The three sets of two-way anchors were combined into 291,000 three-way anchors as follows.
We first identify certain triples of two-way anchors between humanmouse, humanrat, and mouserat as follows: (H1,M1, This procedure generalizes to producing k-way anchors from two-way anchors in a straightforward way, but the details are tedious and will not be stated here.
From Anchors to Synteny Blocks Synteny blocks do not cover the entire genome, as typically, there is a gap (called a breakpoint region) between every two consecutive synteny blocks. Although in some cases, there is either no gap or a very small one, they can also be quite large; our 300-kb humanmouserat blocks have 112 human breakpoint regions <100 kb and 256 >100 kb (not counting chromosome ends). The largest breakpoint region is 26 Mb long. The exact positions of breakpoints within these regions are unknown.
In this section, we assume that a set of nonoverlapping three-way anchors is given, and the goal is to construct the synteny blocks on the basis of these anchors. False ortholog assignments, missing orthologs in one of the species, and microrearrangements make it nontrivial to find synteny blocks conserved across all three species. In Pevzner and Tesler (2003a The distance between two points (h1,m1,r1) and (h2,m2,r2) in the same chromosome triple is defined as the Manhattan distance |h2-h1|+|m2-m1|+|r2-r1|. The distance between two points in different chromosome triples is defined as infinity. The distance between two anchors on the same chromosome triple is the distance between their nearest endpoints. Two anchors are regarded as close when their distance is less than the gap threshold G, which is a user-specified parameter. The number of synteny blocks found by GRIMM-Synteny depends on parameters, G and C. For example, with the 291,000 three-way anchors, at C = 300 kb and G = 450 kb, we found 391 synteny blocks, whereas at C = 100 kb and G = 150 kb, we found 662 synteny blocks. However, smaller syntenic blocks assignments are less reliable, as they may be caused by false orthologs and sequencing errors. We emphasize that the shorter the synteny block, the larger the chance that it reflects spurious similarities (as produced by genomic-scale similarity search tools as PatternHunter) or duplications/gene loss events that remain beyond our genome rearrangement analysis. As a result, short synteny blocks have to be discarded. Three-way blocks are verified by similarities in all three genomes, and are therefore more reliable than two-way blocks. The chosen values of G and C result in a classification of the anchor arrangements. We define microrearrangements as rearrangements of anchors within a synteny block, and macrorearrangements as rearrangements of the order and orientations of the synteny blocks.
From Synteny Blocks to Rearrangement Analysis In the context of an analysis of rearrangements, genomes are viewed as signed permutations, in which each integer corresponds to a unique gene/marker or, as in the current study, a unique synteny block and the sign corresponding to its orientation. The goal is to recover a most parsimonious scenario that can explain the observed data. The MGR (Multiple Genome Rearrangements) algorithm (Bourque and Pevzner 2002
In the current application, with only three genomes, the problem is to find the ancestral synteny block order that minimizes the total number of rearrangements required to convert each of the three genomes into the median ancestor. The algorithm finds this ancestor by iteratively performing rearrangements in one of the three genomes in a manner such that they are slowly merged together. The choice of the rearrangements to be carried out and their order is of utmost importance. See Bourque and Pevzner (2002 MGR identifies the putative murid rodent ancestor and estimates the number of rearrangement events on the evolutionary path from this ancestor to human, mouse, and rat (Fig. 3). A step-by-step breakdown of the rearrangement events along the edges of this tree for h17/m11/r10 is shown in Figure 2C.
Running MGR on the 391 three-way synteny blocks of at least 300 kb common to human, mouse, and rat produced the median ancestor (A, shown in Fig. 3).8 At this level of granularity, A is the mouserat ancestor and is close to the last common murid ancestor. The recovered scenario requires a total of 353 rearrangements (247 from A to human, 50 from A to mouse, and 56 from A to rat). The path from human to the mouserat ancestor consists of two subpaths (one from human to humanmouserat ancestor and another from the humanmouserat ancestor to the mouserat ancestor). A recent study (Stanyon et al. 2003
We define a chromosome association as synteny blocks from two different human chromosomes that are adjacent on a single chromosome in another genome [i.e., fragments of human chromosomes 3 and 21 fused together (denoted 3/21) on mouse chromosome 16] or in an ancestor. The reconstruction suggests that the ancestral murid rodent genome retained many previously postulated chromosome associations of the placental ancestor like 3/21, 4/8, 12/22, 16/19 (Murphy et al. 2003
The MouseRat ancestor is located
Our previous analysis (Pevzner and Tesler 2003a
Our analysis of h17/m11/r10 reveals 19 three-way blocks of length 300 kb and longer. A possible step-by-step breakdown of these rearrangement events are shown in this work (Fig. 2C). The scenario recovered is guaranteed to be optimal, as the pairwise distances in the tree equal the pairwise distances disregarding the constraints of the tree. Moreover, in all most parsimonious scenarios, the median ancestral chromosome fragment containing this region coincides with this region in present-day mouse.10 This three-way analysis of rearrangements within h17/m11/r10 leads to a reliable reconstruction of the genomic architecture of the murid ancestor of this region and, for the first time, allows one to assign rearrangement events to particular lineages (see Fig. 2C). Determining how the events on the A to human branch were split between human and rodent lineages requires use of additional outgroups (relative to the HMR node). Low-resolution data from the dog genome (Kirkness et al. 2003
Microrearrangement analysis can indirectly reveal the problematic regions in assembly. For example, a perfectly conserved synteny block in human and mouse that is disrupted by many microrearrangements in rat may be an indication of an assembly error in rat. The analysis of humanmouserat microrearrangements implies that the rate of microrearrangements in the rat lineage is significantly higher than in mouse lineage (in our three-way blocks, 8.8 microrearrangements per million years between human and rat vs. 6.1 microrearrangements per million years between human and mouse), thus pointing either to (1) problematic assembly of some synteny blocks in rat, or (2) a very high microrearrangement rate in rat.
Breakpoint Reuse in Human, Mouse, and Rat Evolution
Of course, histograms of synteny block lengths in our pairwise comparisons (Fig. 4) deviate from the exponential distribution, but in the humanmouse and humanrat comparisons, these deviations are small enough to accept the random breakage model as the first approximation of the evolutionary process. However, even a visual inspection of the histogram of the mouserat synteny lengths reveals significant deviations from the exponential distributions and raises a question about applicability of the random breakage model. In all cases (humanmouse, humanrat, and mouserat), the histograms significantly deviate from exponential distributions if the number of inferred hidden synteny blocks (arising from breakpoint region reuse) is added to the analysis (Pevzner and Tesler 2003b
Because every rearrangement creates at most two new breakpoints, the genomic distance is at most half the number of the breakpoints in the genome. However, the estimate of genomic distance in terms of breakpoints is inaccurate, as it assumes that the breakpoints are not reused in evolution.11 The previous studies of human and mouse genomic sequences revealed extensive reuse of breakpoints from the same short regions. The humanmouserat rearrangement analysis confirms this conclusion and reveals extensive breakpoint reuse in evolution of each of the three lineages, summarized in Table 1.12
We thank Bin Ma for providing us with the PatternHunter runs and Bill Murphy for many helpful suggestions. We also thank the referees for many additional suggestions. The publication costs of this article were defrayed in part by payment of page charges. This article must therefore be hereby marked "advertisement" in accordance with 18 USC section 1734 solely to indicate this fact.
Article and publication are at http://www.genome.org/cgi/doi/10.1101/gr.1975204.
4 Corresponding author. [Supplemental material is available online at www.genome.org.]
5 Table 1 illustrates some potential pitfalls of the artificial separation of large-scale and small-scale rearrangements. Increasing the minimum synteny block length filters out smaller blocks and reduces the number of large-scale rearrangements of those that remain. We concurrently increased the gap threshold (described later) by a proportionate amount to the minimum synteny block length, which allowed more anchors into these larger synteny blocks and resulted in more microrearrangements. Apart from these issues, there is ambiguity in how to treat the chromosome ends; because the teleomeres have not been sequenced (too many repeats), we do not know whether rearrangements involving them are bounded at the exact end of the chromosome, or somewhere within the end regions. The lack of sequence data precludes us from computing the blocks (if any) at the ends and the rearrangements involving them. Some chromosome ends do not participate in rearrangements, so there is ambiguity in whether to call them breakpoint regions.
6 In Pevzner and Tesler (2003a
7 Although the Hannenhalli-Pevzner algorithm finds a most parsimonious rearrangement scenario for two genomes, the real scenario is not necessarily a most parsimonious one, and the order of rearrangement events within a most parsimonious scenario usually remains uncertain. Availability of more than two genomes remedies some of these limitations and provides a means to infer the gene order in the mammalian ancestor (Bourque and Pevzner 2002
8 In many cases, MGR does not provide an exact solution. It attempts to determine a most parsimonious tree based on macrorearrangements of the synteny block orders in the genomes. The synteny block order of the computed ancestral nodes is only approximate, because there are other possible orders that give identical tree scores, although exploration of neighboring alternative solutions suggests that most of the adjacencies (including all of the chromosome associations) are valid. Localizing the analysis to particular regions of the genome, or including data from appropriate additional species acting as outgroups, can help resolve these issues.
9 The rate of rearrangements on the path from the placental ancestor to human may be significantly smaller than 1.6, as most of the rearrangements on the human branch in Figure 3 may have been acquired on the path from the placental to the murid rodent ancestor.
10 The scenario being optimal, and the ancestor being unique are not typical. With arbitrary data, MGR approximates an optimal scenario, but does not guarantee it will achieve it. In general, distances between two genomes in the computed tree equal or exceed their pairwise distance if the tree constraints are ignored; in this case they are equal, proving the scenario is optimal. Also in general, the recovered ancestor may not be unique.
11 We emphasize that by reusing breakpoints, we do not mean multiple use of exactly the same genomic position as an endpoint of rearrangements, but rather the fact that the breakpoint regions host endpoints for multiple rearrangement events.
12 The breakpoint reuse analysis depends crucially on the accurate generation of synteny blocks and separation between macro- and microrearrangements (Sankoff and Nadeau 2003
Benson, G. 1999. Tandem repeats finder: A program to analyze DNA sequences. Nucleic Acids Res. 27: 573-580. Blanchette, M., Bourque, G., and Sankoff, D. 1997. Breakpoint phylogenies. In Genome informatics workshop (eds. S. Miyano and T. Takagi), pp. 25-34. University Academy Press, Tokyo, Japan. Bourque, G. and Pevzner, P.A. 2002. Genome-scale evolution: Reconstructing gene orders in the ancestral species. Genome Res. 12: 9748-9753. Caprara, A. 2003. The reversal median problem. INFORMS J. Comput. 15: 93-113.
Couronne, O., Poliakov, A., Bray, N., Ishkhanov, T., Ryaboy, D., Rubin, E., Pachter, L., and Dubchak, I. 2003. Strategies and tools for whole-genome alignments. Genome Res. 13: 73-80. Hannenhalli, S. and Pevzner, P.A. 1995a. Transforming men into mice (polynomial algorithm for genomic distance problem). In Proceedings of the 36th Annual IEEE Symposium on Foundations of Computer Science, pp. 581-592. Milwaukee, WI. . 1995b. Transforming cabbage into turnip (polynomial algorithm for sorting signed permutations by reversals). In Proceedings of the 27th Annual ACM Symposium on the Theory of Computing, pp. 178-189. (full version appeared in J. of ACM 46: 1-27, 1999). Kececioglu, J. and Sankoff, D. 1995. Exact and approximation algorithms for the inversion distance between two permutations. Algorithmica 13: 180-210.[CrossRef]
Kent, W.J. 2002. BLATthe BLAST-like alignment tool. Genome Res. 12: 656-664.
Kent, W.J., Sugnet, C.W., Furey, T.S., Roskin, K.M., Pringle, T.H., Zahler, A.M., and Haussler, D. 2002. The Human Genome Browser at UCSC. Genome Res. 12: 996-1006.
Kent, W.J., Baertsch, R., Hinrichs, A., Miller, W., and Haussler, D. 2003. Evolution's cauldron: Duplication, deletion, and rearrangement in the mouse and human genomes. Proc. Natl. Acad. Sci. 100: 11484-11489.
Kirkness, E.F., Bafna, V., Halpern, A.L., Levy, S., Remington, K., Rusch, D.B., Delcher, A.L., Pop, M., Wang, W., Fraser, C.M., et al. 2003. The dog genome: Survey sequencing and comparative analysis. Science 301: 1898-1903.
Lahn, B.T. and Page, D.C. 1999. Four evolutionary strata on the human X chromosome. Science 286: 964-967.
Ma, B., Tromp, J., and Li, M. 2002. PatternHunter: Faster and more sensitive homology search. Bioinformatics 18: 440-445. Moret, B.M.E., Wyman, S., Bader, D.A., Warnow, T., and Yan, M. 2001. A new implementation and detailed study of breakpoint analysis. In 6th Pacific Symposium on Biocomputing (PSB 2001), Hawaii, pp. 583-594. Moret, B.M.E., Siepel, A.C., Tang, J., and Liu, T. 2002. Inversion medians outperform breakpoint medians in phylogeny reconstruction from gene-order data. In Proceedings of the 2nd International Workshop on Algorithms in Bioinformatics (WABI'02). (Lecture Notes in Computer Science 2452), pp. 521-563, Rome, Italy. Murphy, W.J., Bourque, G., Tesler, G., Pevzner, P.A., and O'Brien, S.J. 2003. Reconstructing the genomic architecture of mammalian ancestors using multispecies comparative maps. Human Genomics 1: 30-40.
Nadeau, J.H. and Taylor, B.A. 1984. Lengths of chromosomal segments conserved since divergence of man and mouse. Proc. Natl. Acad. Sci. 81: 814-818. Ohno, S. 1973. Ancient linkage groups and frozen accidents. Nature 244: 259-262. Ozery-Flato, M. and Shamir, R. 2003. Two notes on genome rearrangement. J. Bioinform. Computat. Biol. 1: 71-94.
Pevzner, P.A. and Tesler, G. 2003a. Genome rearrangements in mammalian evolution: Lessons from human and mouse genomic sequences. Genome Res. 13: 13-26.
. 2003b. Human and mouse genomic sequences reveal extensive breakpoint reuse in mammalian evolution. Proc. Natl. Acad. Sci. 100: 7672-7677. Rat Genome Sequencing Project Consortium. 2004. Genome sequence of the Brown Norway Rat yields insights into mammalian evolution. Nature (in press). Sankoff, D. and Blanchette, M. 1997. The median problem for breakpoints in comparative genomics. In Computing and combinatorics. Proc. of COCOON '97, Lecture Notes in Computer Science, pp. 251-263. Springer Verlag, New York.
Sankoff, D. and Nadeau, J.H. 2003. Chromosome rearrangements in evolution: From gene order to genome sequence and back. Proc. Natl. Acad. Sci. 100: 11188-11189.
Schwartz, S., Zhang, Z., Frazer, K.A., Smit, A., Riemer, C., Bouck, J., Gibbs, R., Hardison, R., and Miller, W. 2000. PipMakerA web server for aligning two genomic DNA sequences. Genome Res. 10: 577-586. Siepel, A.C. and Moret, B.M.E. 2001. Finding an optimal inversion median: Experimental results. In Proceedings of the First International Workshop on Algorithms in Bioinformatics (WABI'01), Vol. 2149 of Lecture Notes in Computer Science, pp. 189-203. Springer Verlag, New York.
Springer, M.S., Murphy, W.J., Eizirik, E., andO'Brien, S.J. 2003. Placental mammal diversification and the Cretaceous-Tertiary boundary. Proc. Natl. Acad. Sci. 100: 1056-1061. Stanyon, R., Stone, G., Garcia, M., and Froenicke, L. 2003. Reciprocal chromosome painting shows that squirrels, unlike murid rodents, have a highly conserved genome organization. Genomics 82: 245-249.[CrossRef][Medline] Tesler, G. 2002a. Efficient algorithms for multichromosomal genome rearrangements. J. Comp. Sys. Sci. 65: 587-609.[CrossRef]
. 2002b. GRIMM: Genome rearrangements web server. Bioinformatics 18: 492-493. Waterston, R.H., Lindblad-Toh, K., Birney, E., Rogers, J., Abril, J.F., Agarwal, P., Agarwala, R., Ainscough, R., Alexandersson, M., An, P., et al. 2002. Initial sequencing and comparative analysis of the mouse genome. Nature 420: 520-562.[CrossRef][Medline]
http://www-cse.ucsd.edu/groups/bioinformatics/GRIMM/index.html; genome rearrangements Web server.
Received September 13, 2003;
accepted in revised format November 17, 2003.
This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||