|
|
|
|
Genome Res. 14:1861-1869, 2004 ©2004 by Cold Spring Harbor Laboratory Press; ISSN 1088-9051/04 $5.00 Letter Inverted Repeat Structure of the Human Genome: The X-Chromosome Contains a Preponderance of Large, Highly Homologous Inverted Repeats That Contain Testes Genes1 Department of Human Genetics, Mount Sinai School of Medicine, New York, New York 10029, USA 2 Department of Computer Science, Department of Biology, Boston University, Boston, Massachusetts 02215, USA 3 Laboratory for Biocomputing and Informatics, Boston University, Boston, Massachusetts 02215, USA
We have performed the first genome-wide analysis of the Inverted Repeat (IR) structure in the human genome, using a novel and efficient software package called Inverted Repeats Finder (IRF). After masking of known repetitive elements, IRF detected 22,624 human IRs characterized by arm size from 25 bp to >100 kb with at least 75% identity, and spacer length up to 100 kb. This analysis required 6 h on a desktop PC. In all, 166 IRs had arm lengths >8 kb. From this set, IRs were excluded if they were in unfinished/unassembled regions of the genome, or clustered with other closely related IRs, yielding a set of 96 large IRs. Of these, 24 (25%) occurred on the X-chromosome, although it represents only 5% of the genome. Of the X-chromosome IRs, 83.3% were 99% identical, compared with 28.8% of autosomal IRs. Eleven IRs from Chromosome X, one from Chromosome 11, and seven already described from Chromosome Y contain genes predominantly expressed in testis. PCR analysis of eight of these IRs correctly amplified the corresponding region in the human genome, and six were also confirmed in gorilla or chimpanzee genomes. Similarity dot-plots revealed that 22 IRs contained further secondary homologous structures partially categorized into three distinct patterns. The prevalence of large highly homologous IRs containing testes genes on the X- and Y-chromosomes suggests a possible role in male germ-line gene expression and/or maintaining sequence integrity by gene conversion.
The recent completion of the human DNA sequence (Lander et al. 2001
Inverted Repeats (IRs) make up one class of human duplications, which consist of two arms of similar DNAwith one inverted and complemented relative to the otheraround a central, usually nonhomologous spacer. Large IRs have been observed in physical maps of the X-chromosome, and have been associated with chromosomal rearrangements and gene deletions (Lafreniere et al. 1993
IRs are widespread in both prokaryotic and eukaryotic genomes, and have been associated with a myriad of possible functions, reviewed in Pearson et al. (1996 To facilitate the study of genomic IRs, a novel and efficient computer program called Inverted Repeats Finder (IRF) was developed, and the first genome-wide analysis of IRs in the human genome was performed. The largest and most homologous IRs found in the human genome, described in detail in this report, showed a disproportionately high representation on the X-chromosome. The program IRF, as well as updated descriptions of the IR structure of future assemblies of the human genome, will be made publicly available at the Inverted Repeat Data Base (IRDB) (http://tandem.bu.edu).
Inverted Repeats Finder (IRF) Reveals a Preponderance of Large, Highly Homologous IRs on the X-Chromosome IRF was run against each human chromosome from the latest available version of the human genome sequence (hg16). Repeat-Masker (Jurka 2000 75% identical between arms (Fig. 1A,B). These IRs had arm lengths from 25 bp up to 500 kb, albeit skewed toward lengths under 100 bp (Fig. 1A). The spacer lengths were skewed toward lengths <500 bp (mean of 9358 bp, median of 327 bp; data not shown).
Figure 1B suggests that in general there is no correlation between arm length and percent similarity. However, there did appear to be a distinct outlying subset of large IRs (arm lengths 8 kb) and high arm-to-arm identity ( 95%; Fig. 1C). Therefore, in this report we concentrated on the set of 166 large IRs detected by IRF (>8 kb; Fig. 1B,C). The effectiveness of IRF is demonstrated by the detection of nine of the 10 large IRs recently described on the Y-chromosome (Fig. 1C, green triangles). The two largest and most similar IRs detected by IRF corresponded precisely to the 496-kb IR (P5) and 190-kb IR (P4) on the Y-chromosome (Table 1; Skaletsky et al. 2003
The percentage of the total set of 22,624 IRs (% total IRs) detected by IRF on each chromosome was approximately proportional to the chromosome size (% total genome), suggesting no chromosome-specific difference in the density of IRs in general (Fig. 1D). However, for IRs 8 kb, the percentage was significantly increased on both the X- and Y-chromosomes, shown for IRs with 95% arm identity in Figure 1C. Of the 166 IRs detected by IRF that are 8 kb, 75% arm identity, 37 (22.3%) were detected on the X-chromosome and 18 (10.8%) on the Y-chromosome, although these chromosomes represent only 5% and 1.6% of the genome, respectively (Fig. 1D). To produce the most robust list of large IRs possible, the 166 largest IRs detected by IRF were evaluated by visualizing them on the UCSC Genome Browser using the custom track file provided by IRF (see Methods). Note that when viewing these custom tracks, a striking mirror symmetrical pattern for the arms of each IR is seen in the RepeatMasker Tracks of the UCSC Genome Browser. We took a conservative approach and removed all IRs that were possible false positives due to assembly errors, such as IRs that span gaps (12) or abut gaps (9) (Supplemental data S1). However, several of the IRs excluded as potential false positives may be confirmed as true IRs upon further refinement of the sequence assembly. Conversely, it is possible that the arms of highly homologous IRs may have been inadvertently combined into a single sequence, resulting in false negatives undetected by IRF. It will be important to compare the results of IRF from different builds of the human genome available at IRDB (http://tandem.bu.edu) to re-evaluate IRs that were excluded as potential false positives in the current set.
Overall, 70 of the 166 large IRs initially detected by IRF in hg16 build 34 were excluded based on several criteria (see Methods; Supplemental data S1), yielding a final set of 96 IRs (Supplemental data S2). This exclusion process did not significantly alter the distribution of IRs across the chromosomes and specifically did not affect the significance of the high proportion of IRs found on the X-chromosome (24 IRs, 25%) and Y-chromosome (13 IRs, 13.6%; Fig. 1D). The high proportion of X-chromosome IRs did not appear to be caused by any bias in the quality of the DNA sequence, as the X-chromosome has a relatively high proportion of gaps (Kent et al. 2002
Human IRs with longer spacer length (up to 500 kb) were also examined. IRF detected a total of 31,163 IRs with spacer length 500 kb, 75% arm identity representing an additional 8539 IRs (27.4%). Of these IRs, 486 had a 8-kb arm length. Not surprisingly, a much higher proportion of these (151/486, 31.1%) span gaps in the sequence than do IRs with spacers 100 kb (12/166, 7.2%). A lower percentage of large IRs with spacer lengths 500 kb were found on the X-chromosome (56/486, 11.6%) as compared with IRs with spacer size 100 kb (37/166, 22.3%; see Fig. 1D). For all IRs with a spacer 500 kb, the average spacer size for X-chromosome IRs (mean 100 kb, median 61 kb) was significantly smaller than for autosomes (mean 210 kb, median 187 kb). However, IRs with spacers 500 kb and arm identity 99% were overrepresented on the X-chromosome (29/103, 28.2%). The high percentage of IRs with spacers 500 kb that span gaps suggests that these may represent a less reliable data set than IRs with spacers 100 kb. IRs with spacer sizes 500 kb will be included in the IRF analyses of the current and future assemblies of the human genome available in IRDB (http://tandem.bu.edu).
Large IRs on the X-Chromosome Predominantly Contain Testes Genes
Analysis of IRs in the Mouse Genome
Analysis of IR Structure in Human Chromosome Xp11.22
Other features of the similarity dot-plot of Xp11.22 (Fig. 2A) include some relatively dense regions indicative of repetitive low-complexity DNA around IRX-50.79 and IRX-51.73. In the case of IRX-50.79, this region simply represents a high density of full-length LINE elements in tandem and inverted orientation within the spacer region. In the case of IRX-51.73, this region represents a cluster of SSX genes and pseudogenes (Fig. 2C), arranged in at least three inverted pairs that are 85% identical, consistent with previous genomic mapping (Gure et al. 2002
Classification of Large IRs Into Three Distinct Patterns of Genomic Organization
The second pattern of genomic organization consists of the spacer region of the IR containing regions of similarity to the arm regions (Fig. 3B), seen in seven large IRs (Table 1). The internal IRs characteristic of patterns 1 and 2 (Fig. 3, A and B, respectively) such as IRX-69.804 (Fig. 3A) were originally detected by IRF but excluded from the final set of 96 IRs because they contributed to secondary structure (Table 1; Supplemental data S1). The third pattern of genomic organization was seen for six IRs that formed three intertwined pairs, where an arm of each IR is in the spacer of the other IR, shown for IRs IR7-143.36 and IR7-143.41 in Figure 3C. Four other IRs (Table 1) contained secondary structure patterns caused by the presence of a multigene cluster, which, however, could not be classified into one of the three other common patterns.
Conservation of IR Arm Boundaries in Great Apes
A high degree of similarity between the arms of these IRs (Table 1) suggests that they are either relatively recent duplications, or are undergoing arm-to-arm homogenization. Therefore, we attempted PCR amplification using our human arm-specific STSs on gorilla and chimpanzee genomic DNA to assess whether these IRs were present in a common ancestor. In six of the eight examples positive in human, both arm/spacer boundaries were amplified in gorilla, and four of these were also amplified in chimp (Fig. 4). These PCR products were the same size as predicted from the human genome, and sequence analysis showed that they corresponded to the appropriate regions in human (Supplemental data S3). Great apes and humans diverged from a common ancestor 5 million years ago, and in general show 1%-2% sequence divergence between species (Rozen et al. 2003
We have performed the first genome-wide analysis of the IR structure of the current version (build 34) of the human genome DNA sequence, using a novel efficient software package called IRF, which is available for ongoing future analyses at IRDB (http://tandem.bu.edu). We found that the human X-chromosome contained a disproportionately high number of large, highly homologous IRs that contained testes genes. This is highly analogous to the IRs found on the human Y-chromosome, which are evidently undergoing conversion to preserve gene integrity and the function of male fertility genes in the absence of meiotic pairing and crossing over (Rozen et al. 2003
The highly homologous IRs on the X-chromosome predominantly contain genes expressed in testes, suggesting a possible role in male germ-line gene expression. The accumulation of sex-linked genes on the X-chromosome appears to be dependent on their timing of expression in meiosis. The mammalian X- and Y-chromosomes undergo male germ-line sex chromosome inactivation (MSCI), which prevents expression of X- and Y-linked genes during meiotic pachytene. The X-chromosome appears to accumulate spermatogenesis genes that are expressed prior to MSCI (Wang et al. 2001
Most genes expressed during later stages of spermatogenesis have been found on autosomes (Eddy and O'Brien 1998
The largest autosomal IR observed (IR11-89.34), which was present in great apes by our PCR assay (Fig. 4), also contains the testes gene RNF18 (Table 1). IR1-147.04, also present in great apes (Fig. 4), contains the only human histone gene cluster organized in an IR, which, however, does not contain histone H2B, for which a testes-specific homolog has been identified (Zalensky et al. 2002 The highly homologous IRs described here suggest the formation of large DNA cruciform structures, the arms of which would be indistinguishable from normal double-stranded DNA. Such large cruciforms could both replicate and be transcribed essentially normally. They would be exquisite structures for regulating the topological state of chromosomal regions, especially during chromatin remodeling and/or nucleosome replacement. Removal of nucleosomes from DNA creates negative superhelical twist, which could be relaxed by extrusion into a cruciform. Some IRs with complex secondary structures (Fig. 3; Table 1) could form distinct cruciform structures, such as the double cruciform shown in Figure 3D. In IRs in which the spacer is homologous to the arm (Fig. 3B; Table 1), multiple cruciforms are possible, each pairing different sets of homologous genes and permitting conversion between them. And when one IR is surrounded by another IR (Fig. 3C; Table 1), two mutually exclusive cruciforms are possible.
The large and highly homologous IRs described here could potentially lead to aberrant sister-chromatid exchange and chromosome rearrangements. Notably, several human isodicentric Xq chromosome breakpoints have been mapped to Xp11.22 (Wolff et al. 1996 To summarize, we have examined the IR structure of the human genome, and revealed a remarkable preponderance of large, highly homologous IRs on the human X-chromosome, in regions containing testes genes. These IRs may play an important evolutionary or regulatory role in controlling sex-specific gene expression critical during germ-cell development or meiosis.
IRF (http://tandem.bu.edu/cgi-bin/irdb/irdb.exe) is a prototype tool for identifying approximate inverted repeats in nucleotide sequences that is similar in concept to the Tandem Repeats Finder (Benson 1999
Candidate IRs are confirmed (aligned and extended) or rejected by computing Smith-Waterman style similarity alignment. An efficient "narrowband" technique is used (Benson 1999 IRF was run against human genome sequences of each chromosome (hg16, obtained from NCBI), using parameters 2,3,5,40::match, mismatch, indel, minimum score. Chromosomes were run simultaneously on a computing cluster consisting of four nodes, each with a single 2.4 GHz Pentium 4 processor, 2 GB RAM, and 80 GB hard disk storage. Analysis took 1.5 h, the equivalent of 6 h on a single computer. The data were then inserted into a Microsoft SQL Server database.
At these settings of IRF, the shortest IR detected has 20 nt in each arm with a identity of 100% between the arms. For all runs, repetitive elements masked by RepeatMasker (Jurka 2000
The complete set of IRs detected by IRF or any subsequently filtered subset can be displayed on the assembled human genome sequence using the UCSC Genome Browser (Kent et al. 2002
To estimate the number of X-chromosome genes expressed predominantly from testes, we queried the human transcriptome represented in the GNF atlas 2 data base (Su et al. 2004
Two specific IRs with spacer >100 kb are listed in Table 1. The 283-kb IRY-23.2 has a 169-kb spacer (P3; Skaletsky et al. 2003 PCR was performed using standard protocols. Gorilla and chimpanzee genomic DNA were obtained from Coriell Cell Repositories. DNA sequencing was performed using standard protocols.
We thank Laura Carrel (Penn State, Hershey, PA) for comments on the manuscript and Alfredo Rodriquez (Boston University) for helpful advice. This work was supported in part by grants from the NSF DBI-0413462 (to G.B.) and the NIH R21 HG002919 (to P.E.W.).
4 Corresponding author. E-MAIL peter.warburton{at}mssm.edu; FAX (212) 849-2508. [Supplemental material is available online at www.genome.org.] Article and publication are at http://www.genome.org/cgi/doi/10.1101/gr.2542904.
Aradhya, S., Bardaro, T., Galgoczy, P., Yamagata, T., Esposito, T., Patlan, H., Ciccodicola, A., Munnich, A., Kenwrick, S., Platzer, M., et al. 2001. Multiple pathogenic and benign genomic rearrangements occur at a 35 kb duplication involving the NEMO and LAGE2 genes. Hum. Mol. Genet. 10: 2557-2567.
Bailey, J.A., Gu, Z., Clark, R.A., Reinert, K., Samonte, R.V., Schwartz, S., Adams, M.D., Myers, E.W., Li, P.W., and Eichler, E.E. 2002. Recent segmental duplications in the human genome. Science 297: 1003-1007. Benham, C.J., Savitt, A.G., and Bauer, W.R. 2002. Extrusion of an imperfect palindrome to a cruciform in superhelical DNA: Complete determination of energetics using a statistical mechanical model. J. Mol. Biol. 316: 563-581.[CrossRef][Medline]
Benson, G. 1999. Tandem Repeats Finder: A program to analyze DNA sequences. Nucleic Acids Res. 27: 573-580.
Chen, Y.T., Scanlan, M.J., Sahin, U., Tureci, O., Gure, A.O., Tsang, S., Williamson, B., Stockert, E., Pfreundschuh, M., and Old, L.J. 1997. A testicular antigen aberrantly expressed in human cancers detected by autologous antibody screening. Proc. Natl. Acad. Sci. 94: 1914-1918.
Chomez, P., De Backer, O., Bertrand, M., De Plaen, E., Boon, T., and Lucas, S. 2001. An overview of the MAGE gene family with the identification of all human members of the family. Cancer Res. 61: 5544-5551. Eddy, E.M. and O'Brien, D.A. 1998. Gene expression during mammalian meiosis. Curr. Top. Dev. Biol. 37: 141-200.[Medline]
Emerson, J.J., Kaessmann, H., Betran, E., and Long, M. 2004. Extensive gene traffic on the mammalian X chromosome. Science 303: 537-540. Gure, A.O., Wei, I.J., Old, L.J., and Chen, Y.T. 2002. The SSX gene family: Characterization of 9 complete genes. Int. J. Cancer 101: 448-453.[CrossRef][Medline] Jurka, J. 2000. Repbase update: A database and an electronic journal of repetitive elements. Trends Genet. 16: 418-420.[CrossRef][Medline]
Kent, W.J., Sugnet, C.W., Furey, T.S., Roskin, K.M., Pringle, T.H., Zahler, A.M., and Haussler, D. 2002. The Human Genome Browser at UCSC. Genome Res. 12: 996-1006. Khil, P.P., Smirnova, N.A., Romanienko, P.J., and Camerini-Otero, R.D. 2004. The mouse X chromosome is enriched for sex-biased genes not subject to selection by meiotic sex chromosome inactivation. Nat. Genet. 36: 642-646.[CrossRef][Medline] Kuroda-Kawaguchi, T., Skaletsky, H., Brown, L.G., Minx, P.J., Cordum, H.S., Waterston, R.H., Wilson, R.K., Silber, S., Oates, R., Rozen, S., et al. 2001. The AZFc region of the Y chromosome features massive palindromes and uniform recurrent deletions in infertile men. Nat. Genet. 29: 279-286.[CrossRef][Medline]
Lafreniere, R.G., Brown, C.J., Rider, S., Chelly, J., Taillon-Miller, P., Chinault, A.C., Monaco, A.P., and Willard, H.F. 1993. 2.6 Mb YAC contig of the human X inactivation center region in Xq13: Physical linkage of the RPS4X, PHKA1, XIST and DXS128E genes. Hum. Mol. Genet. 2: 1105-1115. Lander, E.S., Linton, L.M., Birren, B., Nusbaum, C., Zody, M.C., Baldwin, J., Devon, K., Dewar, K., Doyle, M., FitzHugh, W., et al. 2001. Initial sequencing and analysis of the human genome. Nature 409: 860-921.[CrossRef][Medline]
Lercher, M.J., Urrutia, A.O., and Hurst, L.D. 2003. Evidence that the human X chromosome is enriched for male-specific but not female-specific genes. Mol. Biol. Evol. 20: 1113-1116. Marzluff, W.F., Gongidi, P., Woods, K.R., Jin, J., and Maltais, L.J. 2002. The human and mouse replication-dependent histone genes. Genomics 80: 487-498.[CrossRef][Medline] McDonell, N., Ramser, J., Francis, F., Vinet, M.C., Rider, S., Sudbrak, R., Riesselman, L., Yaspo, M.L., Reinhardt, R., Monaco, A.P., et al. 2000. Characterization of a highly complex region in Xq13 and mapping of three isodicentric breakpoints associated with preleukemia. Genomics 64: 221-229.[CrossRef][Medline] Ottolenghi, C., Fellous, M., Barbieri, M., and McElreavey, K. 2002. Novel paralogy relations among human chromosomes support a link between the phylogeny of doublesex-related genes and the evolution of sex determination. Genomics 79: 333-343.[CrossRef][Medline] Pearson, C.E., Zorbas, H., Price, G.B., and Zannis-Hadjopoulos, M. 1996. Inverted repeats, stem-loops, and cruciforms: Significance for initiation of DNA replication. J. Cell Biochem. 63: 1-22.[Medline] Rozen, S., Skaletsky, H., Marszalek, J.D., Minx, P.J., Cordum, H.S., Waterston, R.H., Wilson, R.K., and Page, D.C. 2003. Abundant gene conversion between arms of palindromes in human and ape Y chromosomes. Nature 423: 873-876.[CrossRef][Medline] Samonte, R.V. and Eichler, E.E. 2002. Segmental duplications and the evolution of the primate genome. Nat. Rev. Genet. 3: 65-72.[Medline] Scanlan, M.J., Simpson, A.J.G., and Old, L.J. 2004. The cancer/testis genes: Review, standardization, and commentary. Cancer Imm. 4: 1-15. Shlyakhtenko, L.S., Hsieh, P., Grigoriev, M., Potaman, V.N., Sinden, R.R., and Lyubchenko, Y.L. 2000. A cruciform structural transition provides a molecular switch for chromosome structure and dynamics. J. Mol. Biol. 296: 1169-1173.[CrossRef][Medline] Skaletsky, H., Kuroda-Kawaguchi, T., Minx, P.J., Cordum, H.S., Hillier, L., Brown, L.G., Repping, S., Pyntikova, T., Ali, J., Bieri, T., et al. 2003. The male-specific region of the human Y chromosome is a mosaic of discrete sequence classes. Nature 423: 825-837.[CrossRef][Medline] Small, K., Iber, J., and Warren, S.T. 1997. Emerin deletion reveals a common X-chromosome inversion mediated by inverted repeats. Nat. Genet. 16: 96-99.[CrossRef][Medline]
Su, A.I., Wiltshire, T., Batalov, S., Lapp, H., Ching, K.A., Block, D., Zhang, J., Soden, R., Hayakawa, M., Kreiman, G., et al. 2004. A gene atlas of the mouse and human protein-encoding transcriptomes. Proc. Natl. Acad. Sci. 101: 6062-6067.
Thompson, J.D., Higgins, D.G., and Gibson, T.J. 1994. CLUSTAL W: Improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice. Nucleic Acids Res. 22: 4673-4680. Wang, P.J. 2004. X chromosomes, retrogenes and their role in male reproduction. Trends Endocrin. Metab. 15: 79-83.[CrossRef][Medline] Wang, P.J., McCarrey, J.R., Yang, F., and Page, D.C. 2001. An abundance of X-linked genes expressed in spermatogonia. Nat. Genet. 27: 422-426.[CrossRef][Medline] Waterston, R.H., Lindblad-Toh, K., Birney, E., Rogers, J., Abril, J.F., Agarwal, P., Agarwala, R., Ainscough, R., Alexandersson, M., An, P., et al. 2002. Initial sequencing and comparative analysis of the mouse genome. Nature 420: 520-562.[CrossRef][Medline] Wayne, C.M., MacLean, J.A., Cornwall, G., and Wilkinson, M.F. 2002. Two novel human X-linked homeobox genes, hPEPP1 and hPEPP2, selectively expressed in the testis. Gene 301: 1-11.[CrossRef][Medline] Wolff, D.J., Miller, A.P., Van Dyke, D.L., Schwartz, S., and Willard, H.F. 1996. Molecular definition of breakpoints associated with human Xq isochromosomes: Implications for mechanisms of formation. Am. J. Hum. Genet. 58: 154-160.[Medline] Wu, C.I. and Xu, E.Y. 2003. Sexual antagonism and X inactivationThe SAXI hypothesis. Trends Genet. 19: 243-247.[CrossRef][Medline] Yoshikawa, T., Seki, N., Azuma, T., Masuho, Y., Muramatsu, M., Miyajima, N., and Saito, T. 2000. Isolation of a cDNA for a novel human RING finger protein gene, RNF18, by the virtual transcribed sequence (VTS) approach(1). Biochim. Biophys. Acta 1493: 349-355.[Medline]
Zalensky, A.O., Siino, J.S., Gineitis, A.A., Zalenskaya, I.A., Tomilin, N.V., Yau, P., and Bradbury, E.M. 2002. Human testis/sperm-specific histone H2B (hTSH2B). Molecular cloning and characterization. J. Biol. Chem. 277: 43474-43480. Zendman, A.J., Ruiter, D.J., and Van Muijen, G.N. 2003a. Cancer/testis-associated genes: Identification, expression profile, and putative function. J. Cell Physiol. 194: 272-288.[CrossRef][Medline] Zendman, A.J., Zschocke, J., van Kraats, A.A., de Wit, N.J., Kurpisz, M., Weidle, U.H., Ruiter, D.J., Weiss, E.H., and van Muijen, G.N. 2003b. The human SPANX multigene family: Genomic organization, alignment and expression in male germ cells and tumor cell lines. Gene 309: 125-133.[CrossRef][Medline]
http://ftp.genome.washington.edu/RM/RepeatMasker.html; RepeatMasker. http://tandem.bu.edu/cgi-bin/irdb/irdb.exe; Inverted Repeat Finder. http://tandem.bu.edu; Inverted Repeat Data Base (IRDB).
Received March 4, 2004; accepted in revised format July 27, 2004. This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||