Brain, Vol. 125, No. 2, 384-390,
February 1, 2002
© 2002 Oxford University Press
Twinsingleton differences in brain structure using structural equation modelling
1 Department of Psychiatry, University Medical Centre Utrecht and 2 Department of Biological Psychology, Free University Amsterdam, The Netherlands
Correspondence to: Dr H. E. Hulshoff Pol, Department of Psychiatry, A01.126, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands E-mail: h.e.hulshoff{at}azu.nl
| Summary |
|---|
|
|
|---|
Twin studies are important to investigate genetic influences on variation in human brain morphology in health and disease. However, the twin method has been criticized for its alleged non-generalizability due to differences in the intrauterine and family environment of twins, compared with singletons. To test whether twinsingleton differences complicate interpretation of genetic contributions on variation in brain volume, brains from 112 pairs of twins and 34 of their siblings with a mean (standard deviation) age of 30.7 (9.6) years were scanned using MRI. The influence of birth order, zygosity and twinsibling differences on brain volume measures was analysed using maximum-likelihood model fitting. Variances were homogeneous across birth order, zygosity and twinsingleton status. Irrespective of zygosity, intracranial volume was smaller in second-born twins compared with first-born twins and compared with siblings. Grey matter volume was smaller in second-born twins compared with first-born twins. White matter was smaller in twins compared with siblings. Differences in grey and white matter between these groups were no longer significant after correction for intracranial volume. Total brain, and lateral and third ventricle volumes were comparable in twins and singletons. In conclusion, second-born twins have a smaller intracranial volume than their first-born co-twins and siblings. This suggests aberrant early brain development in second-born twins, which is consistent with the suboptimal pre- and perinatal environment related to birth order in twins. Since other brain volume measures were comparable between the groups, twin studies can provide reliable estimates of heritabilities in brain volume measures and these can be generalized to the singleton population.
Keywords: twins; structural equation modelling; MRI; brain; birth order
Abbreviations: DOS= dizygotic opposite-sex twins; DZ = dizygotic; DZF = dizygotic female twins; DZM = dizygotic male twins; MZ = monozygotic; MZF = monozygotic female twins; MZM = monozygotic male twins; SF = female sibling; SM = male sibling
| Introduction |
|---|
|
|
|---|
Twins studies are considered important to investigate genetic influences on variation in human brain morphology. Several studies have investigated quantitatively the contribution of genetic and environmental influences to individual differences in human brain structure (Bartley et al., 1997
The twin method has sometimes been criticized for its alleged non-generalizability due to differences in intrauterine and family environment of twins, compared with singletons. As foetuses, twins share the womb and prenatal nutrition, and compete for the best position during labour. The intrauterine environment may therefore be considered as suboptimal compared with that of singletons, with the greatest disadvantage for the second born of a (monozygotic) twin pair (Price et al., 1950
). In addition, it has been argued that family environments in which twins are reared can be suboptimal compared with those of singletons. Some studies have shown that physical likeness, limitation of resources and competition may lead to negative influences on the cognitive development of at least one twin member (Hay et al., 1983
). However, in a large sample of 3-year-old twins, it was found that they had similar, or even lower, levels of behavioural and emotional problems than singletons (Van den Oord et al., 1996
).
Evidence for differences between twins and singletons has been suggested in a few studies for cognitive measures (Hay et al., 1983
; Nathan et al., 1984
), raising concerns regarding generalizations towards the singleton population (Vandenberg, 1984
). However, these studies generally compared twins with genetically unrelated singletons, which complicates the generalizability of the findings. Recently, using an extended twin design (Posthuma and Boomsma, 2000
; Posthuma et al., 2000
a), a study was completed in which monozygotic and dizygotic twins were compared with their own siblings on intellectual ability, providing perfectly matched genetic and familial environments (Posthuma et al., 2000
b). No evidence was found for differences in intellectual ability between twins and their siblings. This suggests that twin studies can provide reliable estimates of heritabilities, which can be generalized to the singleton population, at least with respect to intellectual abilities. Similarly, comparison of twins and their non-twin relatives showed no differences in psychiatric symptoms (Kendler et al., 1995
). However, it is not known whether twin studies provide reliable estimates of heritabilities of brain structure. Studies examining the relative contributions of genetic and non-genetic factors to structural brain volume in health and disease rely on the assumption that brains of twins are comparable with those of singletons. To test whether twinsingleton differences complicate interpretation of genetic contributions to variation in brain structure, brain volume measures from pairs of twins and their siblings were compared.
| Methods |
|---|
|
|
|---|
Subjects
A total number of 258 family members from 112 families participated in the study after written consent was obtained (Baaré et al., 2001
Brain imaging
MRIs were obtained on a 1.5 tesla Philips Gyroscan scanner at the University Medical Centre Utrecht. For volumetric analysis, a three-dimensional T1-weighted, coronal FFE (spoiled gradient echo scan) of the whole head [TE (echo time) = 4.6 ms, TR (repetition time) = 30 ms, flip angle = 30°, 170180 contiguous slices; 1 x 1 x 1.2 mm3 voxels], and a coronal DTSE (dual contrast turbo spin echo) of the whole brain (TE1 = 14 ms, TE2 = 80 ms, TR = 6350 ms, 120 contiguous slices; 1 x 1 x 1.6 mm3 voxels) were acquired.
Images were coded to ensure blindness for subject identification, zygosity and family membership. Image volumes were transformed into Talairach space (no scaling) and corrected for magnetic field inhomogeneities (Maes et al., 1997
; Sled et al., 1998
). Volumetric measurements were obtained using automated segmentation procedures and included intracranial, whole brain, grey and white matter of the cerebrum (excluding cerebellum and brainstem), and lateral and third ventricle volumes. Automatic segmentation software included histogram analysis algorithms, anatomical knowledge-based decision rules and series of mathematical morphological operators to connect all voxels of interest (Schnack et al., 2001
a, b). Intracranial volume was segmented on DTSE scans. Whole brain volume was segmented on the three-dimensional FFE scans using a binary image of the intracranial volume as a mask. A plane through the fourth ventricle and the aqueduct limited the cerebellum. In lateral ventricle segmentation, automatic decision rules bridged connections not detectable and prevented leaking into cisterns. The third ventricle was limited by coronal slices that clearly showed the anterior and posterior commissures; the upper boundary was a plane through the plexus choroideus ventriculi tertii in the midsagittal slice perpendicular to this slice. Segmented intracranial, whole brain and lateral and third ventricle volumes were checked visually and edited if necessary. The segmentation procedures yielded highly reliable volume measurements, with inter-rater intraclass correlations all above 0.96.
Statistical analysis
Structural equation modelling with Mx software (Neale, 1997
) was used to estimate the contribution of birth order of the twins to mean scores of and variance in brain volumes, to test the assumption that the mean volumes (and variance) in MZ twins and DZ twins do not differ, and to test whether the mean volumes (and variance) of twins and siblings are significantly different. Models were fitted to the raw data using maximum-likelihood to estimate parameters. Hierarchic
2 tests were used to compare the fit of different models. Twice the difference between the log-likelihood of two models is distributed asymptotically as
2. The degrees of freedom for these tests are equal to the difference in parameters being estimated. Utilizing the principle of parsimony, the most restrictive model is accepted as the best fitting one in case the difference between a nested and a more comprehensive model is not significant (Neale and Cardon, 1992
).
Four univariate nested models were fitted using this procedure (Posthuma et al., 2000
a). In the first model (the control model), the variances for brain volumes of all twin members and all siblings were constrained to be equal. In addition, all covariances of twinsibpairs, the covariance of two sibs within one family and the covariance of the DZ twins were set to be equal. The second model (to test birth order effects) is the same as the first model, with two extra equality constraints; one on the means of both members of the MZ twin pairs and another on the means of both members of the DZ twin pairs. The third model (to test zygosity effects) is the same as the second model, but further constrains the means of the MZ twin pairs and the DZ twin pairs to be equal. The fourth model (to test twinsibling differences) is the same as the third model, but with an extra equality constraint on the means of all twins (MZ and DZ) and siblings.
Univariate models were fitted on all variables, with the effects of age and sex corrected for by means of a linear regression on the observed values of each of the dependent variables.
Post hoc analyses were done with intracranial volume as a covariant, when effects for total brain, grey and white matter or ventricular volumes were found to evaluate the specificity of the finding. Moreover, in case of a significant finding for birth order, the influence of birth weight was tested, by adding birth weight as covariate to the analyses.
Results
Means and standard deviations of brain volume measures are shown in Table 1. The volume estimates in the control model are shown in Table 2. The tests for equality of variances showed no evidence of differences in variance according to birth order, zygosity or twinsingleton status. In addition, no differences were found in DZ covariance and sibpair covariances.
|
|
The results for the univariate analyses of birth order, zygosity and twinsibling differences on the means of the brain volume measures using the Mx software are shown in Table 3.
|
For intracranial volume, the more restrictive models revealed a significant difference in means due to birth order (
2 = 11.99,
d.f. = 2, P < 0.05). The second-born twins had smaller intracranial volumes than the first-born twins. Because birth order mattered, separate comparisons for first-born and second-born twins with siblings were made. The mean intracranial volume of the first-born twins did not differ from that of the siblings. However, the mean intracranial volume of the second-born twins was smaller than that of the siblings (
2 = 9.32,
d.f. = 1, P < 0.05). For grey matter volume, the more restrictive models revealed a significant difference in mean due to birth order (
2 = 7.23,
d.f. = 2, P < 0.05). The comparisons for first-born and second-born twins with siblings revealed no significant differences in mean grey matter volume, although grey matter volume of the second-born twins was smaller compared with that of the siblings. For white matter volume, the more restrictive models revealed a significant difference (
2 = 4.26,
d.f. = 1, P < 0.05). Mean white matter volume in twins, irrespective of birth order and zygosity, was smaller than in siblings. Post hoc analyses revealed that the effects of grey and white matter in (second-born) twins compared with siblings were no longer significant after correction for intracranial volume.
For the total brain, and the lateral and third ventricular volumes, the more restrictive models caused no significant differences in
2. This means that the more restrictive models may all be accepted. Thus, the estimated means of first- and second-born twins, the estimated means of MZ twins and DZ twins, and those of twins compared with siblings were not significantly different with respect to total brain, and lateral and third ventricular volumes.
There was a significant correlation between birth weight and intracranial volume (r = 0.23, P < 0.01). Birth weight was lower in second-born twins (mean ± standard deviation birth weight 2455.3 ± 569.9 g) compared with first-born twins (2575.6 ± 567.8 g) (
2 = 6.404,
d.f. = 2, P < 0.05). Twins had a lower birth weight than siblings (3369.1 ± 591.2 g) (
2 = 59.124, (d.f. = 1, P < 0.0001). When birth weight was added as covariant in the model, it did not influence the results, i.e. intracranial volume remained significantly smaller in the second-born compared with the first-born twins (
2 = 11.481,
d.f. = 2, P < 0.05).
| Discussion |
|---|
|
|
|---|
This study compared brain morphology between MZ and DZ twins with their non-twin siblings. No differences in (co)variances were found according to birth order, zygosity or twinsingleton status. However, a mean difference was found for intracranial volume, such that the second-born twins had a significantly smaller intracranial volume compared with the first-born twins and compared with their siblings, whereas the intracranial volume of first-born twins did not differ from that of the siblings. Moreover, grey matter volume was smaller in the second-born twins compared with the siblings, and white matter was smaller in the twins, irrespective of birth order and zygosity, compared with the siblings. After correction for intracranial volume, the effects for grey and white matter were no longer significant. Mean values of total brain, and lateral and third ventricular volumes were not influenced by birth order or zygosity, and no evidence was found for twinsibling differences.
The finding that, irrespective of zygosity, second-born twins had a smaller intracranial volume than first-born twins and their siblings suggests that brain growth is influenced by non-genetic factors during early brain development. Brain growth is thought to be the main factor influencing growth of the neurocranium in the first years of life (ORahilly and Müller, 1992
; Sgouros et al., 1999
). No effect of birth order on head circumference was reported earlier, but that finding was based on the inclusion of 10 pairs of MZ twins only (Tramo et al., 1998
). Because no effects of zygosity were found, it is likely that environmental and not genetic factors resulted in the development of a relatively smaller head in second-born twins. Nutritional deficiency during the first trimester of gestation (Hulshoff Pol et al., 2000
), and birth complications (McNeil et al., 2000
; for a review, see Frangou and Murray, 1996
), in schizophrenia as well as very preterm birth (Allin et al., 2001
) have all been related to decreased brain volume. Twin gestations have a significantly higher rate of complications compared with singleton gestations, particularly with regard to preterm labour, pregnancy-induced hypertension and foetal death (Kovacs et al., 1989
; Doyle, 1996
), and the second-born twin seems to be particularly at risk. The overall mortality risk of second-born twins has been reported to be 8% greater than that of first-born twins. Mortality risks as a result of respiratory distress syndrome, intrauterine hypoxia and birth asphyxia, and congenital anomalies were 1927% higher among second-born twins than among first-born twins (Fowler et al., 1991
). Moreover, second-born twins were found to have a lower birth weight compared with first-born twins in a sample of 193 twins where 55% of the second born twin were male (Daniel et al., 2000
) and in a sample of 2930 Dutch twins (Baal and Boomsma, 1998
). Although, in our study, no direct comparison between obstetric complications and brain volume measures was made, it is likely that pre- and perinatal factors specific for second-born twins influenced intracranial volume in these subjects. Correcting for birth weight in the analysis did not change the finding that second-born twins had a smaller intracranial volume than the first-born twins. Because the effects were only found in the second-born twins and not in the first-born twins, suboptimal family environments that have been associated with twin rearing (Hay and OBrien, 1983
) are less likely to have influenced intracranial volume.
Twinsibling differences were found for mean white matter volumes, with those of twins being smaller than their siblings, and grey matter volume, which was smaller in the second-born twins compared with siblings. However, after correction for intracranial volume, these effects on the means were no longer significant. This suggests that the difference in (second-born) twins compared with siblings is due predominantly to differences in intracranial volume and occurs early in brain development. Moreover, it implies that overall volumes of grey and white matter do not develop differently in twins and singletons.
No differences in mean values of total brain, and lateral and third ventricular volumes were found secondary to twinsibling differences. Although total brain volume was somewhat smaller in twins compared with siblings, this finding did not reach significance. The comparability of both the variances and the means of brain volumes across twins and their siblings suggests that suboptimal pre-, peri- and possibly postnatal circumstances in twins and siblings do not differentially influence total brain, and lateral and third ventricle volumes in twins and singletons. Moreover, it suggests that twin studies can provide reliable estimates of heritability of these brain volumes and that these estimates can be generalized to the singleton population.
Whether the smaller intracranial volume in second-born twins has consequences for their subsequent cognitive and behavioural development remains to be determined. However, it is unlikely that the smaller intracranial volume in second-born twins implies such consequences. In a study that included a majority of the twins from this study, no differences in intelligence measured by the Wechsler Adult Intelligence Scale and birth order in twins were found (Posthuma et al., 2000
b). Earlier findings suggested that twins recover from deficits in intellectual performance by 68 years of age (Wilson, 1979
). Indeed, by the age of 11 years, no evidence for a relationship between the order of delivery of twins on their intelligence quotient as measured by a verbal reasoning task was found (Record et al., 1970
). Finally, levels of behavioural and emotional problems were found to be similar, or even lower, in 3-year-old twins compared with singletons (Van den Oord et al., 1996
).
Our findings suggest that twin studies can provide reliable estimates of heritabilities of brain volumes that can be generalized to the singleton population. Whether twinsibling differences occur in particular brain areas such as in limbic, diencephalic and basal ganglia structures remains to be established in future studies.
| References |
|---|
|
|
|---|
Allin M, Matsumoto H, Santhouse AM, Nosarti C, AlAsady MH, Stewart AL, et al. Cognitive and motor function and the size of the cerebellum in adolescents born very pre-term. Brain 2001; 124: 606.
Baal CG van, Boomsma DI. Etiology of individual differences in birth weight of twins as a function of maternal smoking during pregnancy. Twin Res 1998; 1: 12330[Medline]
Baaré WF, Hulshoff Pol HE, Boomsma DI, Posthuma D, de Geus EJ, Schnack HG, et al. Quantitative genetic modeling of variation in human brain morphology. Cereb Cortex 2001a; 11: 81624.
Baaré WF, van Oel CJ, Hulshoff Pol HE, Schnack HG, Durston S, Sitskoorn MM, et al. Volumes of brain structures in twins discordant for schizophrenia. Arch Gen Psychiatry 2001b; 58: 3340.
Bartley AJ, Jones DW, Weinberger DR. Genetic variability of human brain size and cortical gyral patterns. Brain 1997; 120: 25769.
Boomsma DI. Twin registers in Europe: an overview. Twin Res 1998; 1: 3451.[Medline]
Carmelli D, DeCarli C, Swan GE, Jack LM, Reed T, Wolf PA, et al. Evidence for genetic variance in white matter hyperintensity volume in normal elderly male twins. Stroke 1998; 29: 117781.
Daniel Y, Ochshorn Y, Fait G, Geva E, Bar-Am A, Lessing JB. Analysis of 104 twin pregnancies conceived with assisted reproductive technologies and 193 spontaneously conceived twin pregnancies. Fertil Steril 2000; 74: 6839.[ISI][Medline]
Doyle P. The outcome of multiple pregnancy. [Review]. Hum Reprod 1996; 11 Suppl 4: 11017.
Fowler MG, Kleinman JC, Kiely JL, Kessel SS. Double jeopardy: twin infant mortality in the United States 1983 and 1984. Am J Obstet Gynecol 1991; 165: 1522.[ISI][Medline]
Frangou S, Murray RM. Imaging as a tool in exploring the neurodevelopment and genetics of schizophrenia. [Review]. Br Med Bull 1996; 52: 58796.
Hay DA, OBrien PJ. The La Trobe Twin Study: a genetic approach to the structure and development of cognition in twin children. Child Dev 1983; 54: 31730.[ISI][Medline]
Hulshoff Pol HE, Hoek HW, Susser E, Brown AS, Dingemans A, Schnack HG, et al. Prenatal exposure to famine and brain morphology in schizophrenia. Am J Psychiatry 2000; 157: 11702.
Kendler KS, Martin NG, Heath AC, Eaves LJ. Self-report psychiatric symptoms in twins and their nontwin relatives: are twins different? Am J Med Genet 1995; 60: 58891.[ISI][Medline]
Kovacs BW, Kirschbaum TH, Paul RH. Twin gestations. I. Antenatal care and complications. Obstet Gynecol 1989; 74: 31317.
LeGoualher G, Argenti AM, Duyme M, Baaré WFC, Hulshoff Pol HE, Boomsma DI, et al. Statistical sulcal shape comparisons: application to the detection of genetic encoding of the central sulcus shape. Neuroimage 2000; 11: 56474.[ISI][Medline]
Lohmann G, von Cramon DY, Steinmetz H. Sulcal variability of twins. Cereb Cortex 1999; 9: 75463.
Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P. Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging 1997; 16: 18798.[ISI][Medline]
McNeil TF, Cantor-Graae E, Weinberger DR. Relationship of obstetric complications and differences in size of brain structures in monozygotic twin pairs discordant for schizophrenia. Am J Psychiatry 2000; 157: 20312.
Nathan M, Guttman R. Similarities in test scores and profiles of kibbutz twins and singletons. Acta Genet Med Gemellol (Roma) 1984; 33: 21318.[Medline]
Neale MC. Mx: statistical modeling. 3rd edn. Box 980126 MC, Richmond (VA) 23298: Department of Psychiatry; 1997.
Neale MC, Cardon LR. Methodology for genetic studies of twins and families. Dordrecht: Kluwer Academic; 1992.
Nurnberger JI Jr, Blehar MC, Kaufman CA, York-Cooler C, Simpson SG, Haravy-Friedman J, et al. Diagnostic interview for genetic studies. Rationale, unique features, and training. NIMH Genetics Initiative. Arch Gen Psychiatry 1994; 51: 84959.[Abstract]
ORahilly R, Müller F. Human embryology & teratology. New York: Wiley-Liss; 1992.
Pennington BF, Filipek PA, Lefly D, Chhabildas N, Kennedy DN, Simon JH, et al. A twin MRI study of size variations in human brain. J Cogn Neurosci 2000; 12: 22332.
Pfefferbaum A, Sullivan EV, Swan GE, Carmelli D. Brain structure in men remains highly heritable in the seventh and eighth decades of life. Neurobiol Aging 2000; 21: 6374.[ISI][Medline]
Posthuma D, Boomsma DI. A note on the statistical power in extended twin designs. Behav Genet 2000; 30: 14758.[ISI][Medline]
Posthuma D, de Geus EJ, Neale MC, Hulshoff Pol HE, Baaré WF, Kahn RS, et al Multivariate genetic analysis of brain structure in an extended twin design. Behav Genet 2000a; 30: 3119.[ISI][Medline]
Posthuma D, De Geus EJ, Bleichrodt N, Boomsma DI. Twinsingleton differences in intelligence? Twin Res 2000b; 3: 837.[Medline]
Price B. Primary biases in twin studies. Am J Hum Genet 1950; 2: 293352.[ISI][Medline]
Record RG, McKeown T, Edwards JH. An investigation of the difference in measured intelligence between twins and single births. Ann Hum Genet 1970; 34: 1120.[ISI][Medline]
Reveley AM, Reveley MA, Clifford CA, Murray RM. Cerebral ventricular size in twins discordant for schizophrenia. Lancet 1982; 1: 5401.[ISI][Medline]
Schnack HG, Hulshoff Pol HE, Baaré WF, Staal WG, Viergever MA, Kahn RS. Automated separation of gray and white matter from MR images of the human brain. Neuroimage 2001a; 13: 2307.[ISI][Medline]
Schnack HG, Hulshoff Pol HE, Baare WF, Viergever MA, Kahn RS. Automatic segmentation of the ventricular system from MR images of the human brain. Neuroimage, 2001b; 14: 95104.[ISI][Medline]
Sgouros S, Hockley AD, Goldin JH, Wake MJ, Natarajan K. Intracranial volume change in craniosynostosis. J Neurosurg 1999; 91: 61725.[ISI][Medline]
Sled JG, Zijdenbos AP, Evans AC. A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans Med Imaging 1998; 17: 8797.[ISI][Medline]
Suddath RL, Christison GW, Torrey EF, Casanova MF, Weinberger DR. Anatomical abnormalities in the brains of monozygotic twins discordant for schizophrenia. New Engl J Med 1990; 322: 78994.[Abstract]
Tramo MJ, Loftus WC, Stukel TA, Green RL, Weaver JB, Gazzaniga MS. Brain size, head size, and intelligence quotient in monozygotic twins. Neurology 1998; 50: 124652.
Vandenberg SG. Does a special twin situation contribute to similarity for abilities in MZ and DZ twins? Acta Genet Med Gemellol (Roma) 1984; 33: 21922.[Medline]
van den Oord EJ, Verhulst FC, Boomsma DI. A genetic study of maternal and paternal ratings of problem behaviors in 3-year-old twins. J Abnorm Psychol 1996; 105: 34957.[ISI][Medline]
Wilson RS. Twin growth: initial deficit, recovery, and trends in concordance from birth to nine years. Ann Hum Biol 1979; 6: 20520.[ISI][Medline]
Received March 28, 2001. Revised September 14, 2001. Accepted September 20, 2001.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
M.-T. Tsou, M.-W. Tsou, M.-P. Wu, and J.-T. Liu Academic achievement of twins and singletons in early adulthood: Taiwanese cohort study BMJ, July 21, 2008; 337(jul21_1): a438 - a438. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. E. Hulshoff Pol, H. G. Schnack, D. Posthuma, R. C. W. Mandl, W. F. Baare, C. van Oel, N. E. van Haren, D. L. Collins, A. C. Evans, K. Amunts, et al. Genetic Contributions to Human Brain Morphology and Intelligence J. Neurosci., October 4, 2006; 26(40): 10235 - 10242. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. G. M. van Erp, P. A. Saleh, M. Huttunen, J. Lonnqvist, J. Kaprio, O. Salonen, L. Valanne, V.-P. Poutanen, C.-G. Standertskjold-Nordenstam, and T. D. Cannon Hippocampal Volumes in Schizophrenic Twins Arch Gen Psychiatry, April 1, 2004; 61(4): 346 - 353. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||


