Background

Two study designs are commonly employed in genetic association studies: a case-control and a family-based approach. The case-control design compares frequencies of alleles carried among cases with a disease and among controls that are free of disease. The family-based design compares the frequency of alleles transmitted to an affected offspring by their parents with alleles carried by the parents but not passed to the offspring; this type of statistical analysis is often called a transmission disequilibrium test (TDT). Complex diseases are likely to be under the influence of several genetic risk factors; therefore, the contribution of a single gene to risk of disease is expected to be modest. Meta-analysis allows for the pooling of independent studies that examine similar hypotheses; for example, that a particular allele at a SNP is associated with disease status, and thus may improve power to detect moderate effect sizes. Although a few methods have been developed to combine family-based data with data from unrelated controls and/or unrelated cases obtained by the same study [110], most of these methods are not specifically designed to pool results from multiple independent studies and thus do not have a built-in test for heterogeneity of effect, which may be used to determine whether pooling of independent samples is reasonable. Exceptions to this statement include the method implemented in Genie[7, 8], which conducts a genotype-based test that allows for the pooling of multiple study types across independent samples (meta-analysis), relying on empirical p-values which can be computationally intensive and SCOUT[5], which allows for the pooling of family-based data with data from unrelated cases and/or controls and performs a formal test of whether differing data types can be sensibly pooled. The likelihood-based method implemented in SCOUT[5] assumes that pooled samples are from the same source population with the same mating-type frequencies, and thus is inappropriate to use in a meta-analysis setting where independent samples have been drawn from differing populations; however, the use of additional programs such as the R package meta [10] subsequent to using SCOUT may be performed to pool estimates. A recent paper outlined a method for the combination of odds ratios (ORs) from independent case-control and TDT-based studies using a fixed-effect approach [6], using an allele-based model. Although several programs exist to conduct meta-analyses of case-control genetic data, no software exists that implements the Kazeem & Farrall (2005)[6] method to conduct case-control and TDT meta-analyses of independent samples. I have implemented this model [6], plus extended the method to the random-effects model of DerSimonian and Laird [11] in the freely-available R [12] package catmap.

Implementation

Fixed-effect estimates are as described by Kazeem and Farrall [6]. First, ln(OR) estimates and their respective standard errors are derived from separate analyses for each independent study using traditional epidemiological methods for unmatched and matched case-control designs for 2 × 2 contingency tables (see [6] for review). Study-specific weights are derived using the inverse of the variance from each study (w i = 1/σi2), which gives increased weight to larger studies (because their variances are generally smaller). The pooled estimate of the logarithm of the odds ratios using fixed effects methods (ORFE) is given by[6]:

ln ( O R F E ) = i = 1 K w i ln ( O R i ) i = 1 K w i MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGagiiBaWMaeiOBa4MaeiikaGIaem4ta8KaemOuai1aaSbaaSqaaiabdAeagjabdweafbqabaGccqGGPaqkcqGH9aqpjuaGdaWcaaqaamaaqadabaGaem4DaC3aaSbaaeaacqWGPbqAaeqaaiGbcYgaSjabc6gaUjabcIcaOiabd+eapjabdkfasnaaBaaabaGaemyAaKgabeaacqGGPaqkaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGlbWsaiabggHiLdaabaWaaabmaeaacqWG3bWDdaWgaaqaaiabdMgaPbqabaaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4saSeacqGHris5aaaaaaa@51D1@

with associated variance estimate of[6]:

σ ln ( O R F E ) 2 = 1 i = 1 K w i MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGae83Wdm3aa0baaSqaaiGbcYgaSjabc6gaUjabcIcaOiabd+eapjabdkfasnaaBaaameaacqWGgbGrcqWGfbqraeqaaSGaeiykaKcabaGaeGOmaidaaOGaeyypa0tcfa4aaSaaaeaacqaIXaqmaeaadaaeWaqaaiabdEha3naaBaaabaGaemyAaKgabeaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGlbWsaiabggHiLdaaaaaa@4421@

where K is the number of studies to be pooled, and the w i are the study-specific weights as described above. In the presence of heterogeneity of genetic effects random-effects estimates of the pooled OR and variance may be more appropriate. Random-effects models do not assume that a common genetic effect exists across all samples. Following DerSimonian and Laird [11, 13], the random-effects model implemented in catmap includes an estimate of the between study variance, τ2, as:

τ 2 = Q ( K 1 ) i = 1 K w i ( i = 1 K w i 2 i = 1 K w i ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaacciGae8hXdq3aaWbaaSqabeaacqaIYaGmaaGccqGH9aqpjuaGdaWcaaqaaiabdgfarjabgkHiTiabcIcaOiabdUealjabgkHiTiabigdaXiabcMcaPaqaamaaqadabaWaaubeaeqabaGaemyAaKgabeqaaiabdEha3baacqGHsisldaqadaqaamaalaaabaWaaabmaeaacqWG3bWDdaqhaaqaaiabdMgaPbqaaiabikdaYaaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGlbWsaiabggHiLdaabaWaaabmaeaadaqfqaqabeaacqWGPbqAaeqabaGaem4DaChaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUealbGaeyyeIuoaaaaacaGLOaGaayzkaaaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4saSeacqGHris5aaaaaaa@56FA@

Where Q is the heterogeneity χ2 statistic (see [6] for review), K is the number of studies and the wi are the study weights calculated using fixed-effects estimates as described above. If τ2 ≤ 0, τ2 is set to 0 and random-effects estimates are identical to fixed-effects estimates. If τ2 > 0 the random-effects weight for study i is r i = 1/(wi-1 + τ2) and the random-effects pooled estimate of the logarithm of the odds ratio (ORRE) can be written as:

ln ( O R R E ) = i = 1 K r i ln ( O R i ) i = 1 K r i MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGagiiBaWMaeiOBa4MaeiikaGIaem4ta8KaemOuai1aaSbaaSqaaiabdkfasjabdweafbqabaGccqGGPaqkcqGH9aqpjuaGdaWcaaqaamaaqadabaGaemOCai3aaSbaaeaacqWGPbqAaeqaaiGbcYgaSjabc6gaUjabcIcaOiabd+eapjabdkfasnaaBaaabaGaemyAaKgabeaacqGGPaqkaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGlbWsaiabggHiLdaabaWaaabmaeaacqWGYbGCdaWgaaqaaiabdMgaPbqabaaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4saSeacqGHris5aaaaaaa@51D5@

and the standard error of the random-effects pooled ln(ORRE) is simply 1/(Σr i )1/2.

Results and Discussion

An example input file for catmap is shown in Table 1.

Table 1

Input files are tab-delimited text files using the header shown in the example. The name of the first author and year of study, the type of study (1 = family-based, 2 = case-control) the number of alleles transmitted to affected offspring, the number of alleles not transmitted to affected offspring (both referring to family-based studies), the number of risk alleles in cases, the number of risk alleles observed in controls, the number of non-risk alleles observed in cases and the number of non-risk alleles observed in controls (latter 4 columns referring to case-control studies) must be specified. In the case of a family-based study, the t and nt columns should contain counts and the additional 4 columns may contain 0 or NA; for case-control studies, the columns t and nt should contain 0 or NA and the remaining 4 columns should contain the allele count data for cases and controls. catmap allows for the meta-analysis of all case-control or all family-based studies and for the combination of both family-based and case-control studies. In situations where both family-based and case-control data exist for the same set of cases only one type of study design (either family-based or case-control) should be used as input to catmap. catmap calculates fixed- and random-effects estimates, a χ2 test for heterogeneity and associated p-values and must be used to create a catmap object for use in downstream functions. To create a forest plot using either the pooled fixed- or random-effects OR and 95% CI the function catmap.forest is used. catmap.sense calculates leave-one-out sensitivity analyses using either fixed- or random-effects estimates and creates a Portable Document Format (PDF) plot of the estimate of the pooled OR and 95% CIs with the removed study listed on the y-axis (Figure 1). Because the first report of a genetic association between a polymorphism and disease status often is larger than those reported by follow-up studies [14, 15], the function catmap.cumulative may be used to calculate cumulative ORs and associated CIs and to create a PDF plot of the pooled estimates, adding one study at a time, using either fixed- or random-effects analyses. A graphic in PDF format to assess publication bias can be created using catmap.funnel.

Figure 1
figure 1

Sensitivity analysis plot created using test data set and function catmap.sense.

Conclusion

Pooling studies of genetic polymorphisms data via meta-analysis may improve the ability of researchers to detect modest association signals. Since case-control studies are not robust to spurious effects caused by confounding via population stratification, before combining results from case-control studies researchers should assess evidence for substructure in individual studies and also examine the similarity of effect sizes and allele frequencies across study type and population, along with the formal test of heterogeneity of genetic effect implemented in catmap. catmap implements a random-effects estimate of the pooled odds ratio, which assumes a Normal distribution of genetic effects across studies instead of a single genetic effect, which may be preferred when combining studies across sub-groups or when the heterogeneity χ2 indicates significant between-study differences in effect sizes, although when evidence for heterogeneity exists the pooling of data may not be indicated. Since two types of study design (case-control and family-based) are common in statistical genetics, methods and freely-available software that can combine estimates from both designs should prove useful to applied researchers.

Availability and Requirements

Project name: catmap

Project home page: Contributed package at http://www.r-project.org.

Operating systems: MS Windows, Linux, Mac

Programming language: R

Other requirements: R 2.4 or higher

License: GPL

Any restrictions to use by non-academics: none