Abstract
Background
Feature extraction (FE) is difficult, particularly if there are more features than samples, as small sample numbers often result in biased outcomes or overfitting. Furthermore, multiple sample classes often complicate FE because evaluating performance, which is usual in supervised FE, is generally harder than the two-class problem. Developing sample classification independent unsupervised methods would solve many of these problems.
Results
Two principal component analysis (PCA)-based FE, specifically, variational Bayes PCA (VBPCA) was extended to perform unsupervised FE, and together with conventional PCA (CPCA)-based unsupervised FE, were tested as sample classification independent unsupervised FE methods. VBPCA- and CPCA-based unsupervised FE both performed well when applied to simulated data, and a posttraumatic stress disorder (PTSD)-mediated heart disease data set that had multiple categorical class observations in mRNA/microRNA expression of stressed mouse heart. A critical set of PTSD miRNAs/mRNAs were identified that show aberrant expression between treatment and control samples, and significant, negative correlation with one another. Moreover, greater stability and biological feasibility than conventional supervised FE was also demonstrated. Based on the results obtained, in silico drug discovery was performed as translational validation of the methods.
Conclusions
Our two proposed unsupervised FE methods (CPCA- and VBPCA-based) worked well on simulated data, and outperformed two conventional supervised FE methods on a real data set. Thus, these two methods have suggested equivalence for FE on categorical multiclass data sets, with potential translational utility for in silico drug discovery.
Similar content being viewed by others
Background
Feature extraction (FE) is an important task in bioinformatic analyses, as there are often more features than samples. The number of bases spanning linear space is at most equivalent to the number of independent vectors. Accordingly, more features than samples inevitably leads to redundancy. Although dimensional reduction is often used to eliminate redundancy, it is far from true redundancy elimination as reconstructed bases are usually the linear combination of all features, which is not always necessary for spanning entire linear space.
Instead of dimensional reduction, FE can be used to eliminate redundancy, and is often performed to maximize performance of targeted tasks (supervised FE), e.g., discrimination between samples or regression analysis, although fewer samples than features often creates difficulties due to overfitting and/or bias. Multiple class samples commonly provide additional problems when supervised FE is used, complicating performance evaluations compared with two-class samples. Although pairwise evaluations (e.g., one versus one or one versus others) are possible, they are time-consuming. FE using a set of pairwise evaluations is often even more difficult, because it is hard to maximize performance simultaneously for all pairwise evaluations with commonly selected features for all pairs. In addition, supervised FE is often heavily sample-dependent, and alternative sample sets often provide alternative optimal FE. Moreover, with categorical classes the problems are greater, since frequently used FE with regression analyses, e.g., lasso [1], cannot be directly applied to categorical multiclass data sets.
In order to avoid these difficulties, unsupervised FE is useful as it is assumed to be more robust and stable, although this has not been extensively studied because of implementation difficulties, e.g., supervision is not based upon performance, therefore FE has nothing suitable for optimization. Variational Bayesian approaches eliminate redundancy in an unsupervised manner, and have recently been proposed as promising unsupervised FE methods. In this paper, we used variational Bayes (VB) principal component analysis (PCA) [2,3] to perform unsupervised FE. In addition, a simpler and more conventional PCA (CPCA)-based unsupervised FE method (CPCAFE) that worked well with a simulated data set was proposed as an alternative to VBPCA. As VBPCA is more computationally challenging, CPCAFE is an even more promising alternative unsupervised FE candidate than the VB approach.
To demonstrate applicability to translational research, we used CPCA-based, and partially, VBPCA-based unsupervised FE (VBPCAFE) to examine heart disease associated with posttraumatic stress disorder (PTSD). PTSD [4] is caused by exposure to high-magnitude, life-threatening stressors, i.e., traumatic events. PTSD patients typically develop acute stress responses that include symptoms of arousal, anxiety, sadness, grief, agitation, irritability, and sleep disturbances. Heart disease is associated with PTSD, with a meta-analysis showing association between coronary heart disease (CHD) and PTSD [5]. Moreover, hospitalization due to cardiovascular disease is associated with PTSD caused by the September 11, 2001, World Trade Center disaster [6]. PTSD was also associated with CHD using a prospective twin study design [7]. However, the underlying genetic background of the association is not well known.
By applying CPCAFE and VBPCAFE to publically available mRNA and microRNA (miRNA) expression data [8] from stressed mouse hearts, we identified aberrantly expressed miRNAs and mRNAs. Biological feasibility of the identified miRNAs and mRNAs was determined (by negative correlation between miRNAs and mRNAs, and Kyoto Encyclopedia of Genes and Genomes (KEGG) [9] pathway enrichment of miRNA target genes), showing suitability of our selections.
Two supervised FE methods, specifically, regression analysis using categorical pseudo variables and backward elimination using Hilbert-Schmidt norm of the cross-covariance operator (BAHSIC), identified unstable and biologically less feasible sets of mRNAs and miRNAs that were not always negatively correlated, and suggested superiority of unsupervised FE methods.
Among the aberrantly expressed genes identified by CPCAFE, fatty acid binding protein 3 (FABP3) was considered a potential drug target candidate by structural investigations, and inhibitory drugs were sought using the in silico drug discovery tool, chooseLD, a profile-based drug discovery program.
Results and discussion
FE methods applied to a simulated categorical multiclass data set
We performed FE using a simulated categorical multiclass data set, to determine the limitations of FE and usefulness of our proposed methods.
The data set consisted of 100 simulated ensembles of 20 samples with 100 features, of which only 10 features were distinct between four classes, and with each class consisting of 5 samples (see Methods). As sample values of each feature were obtained from an identical mixture of four Gaussian distributions, FE is difficult but discrimination between four classes varies between three cases (shown in Figure 1; a typical feature boxplot with distinct expression among classes). We named these three cases as easy (s=2), medium (s=1), and hard (s=0.5). Furthermore, we did not use order between the four classes, so the data could be treated as a categorical data set.
In order to demonstrate the limitations of FE, we first tested one vs one t test based FE (see Methods). No significantly different features were detected between the four classes in any of the three cases (Figure 2; confusion tables are available in Additional file 1), demonstrating that FE on a categorical multiclass data set is difficult.
Matthews correlation coefficients and F measure for various FE methods applied to the simulated data set.t test, one vs one t test based FE; CRP, categorical regression based FE (using adjusted P-values); CRR, categorical regression based FE (using ranked P-values); BAHSIC, backward elimination using Hilbert-Schmidt norm of the cross-covariance operator; VBPCAFE, variational Bayes principal component analysis based unsupervised FE; CPCAFE, conventional principal component analysis based unsupervised FE.
Next, we applied a more sophisticated method, specifically, categorical regression based FE (using significance based on adjusted P-values, see Methods). The number of correctly extracted features improved, with Matthews correlation coefficients of 0.95, 0.35, and 0.05, and F measures of 0.98, 0.15, and 0.005 for easy, medium, and hard cases, respectively (Figure 2; confusion tables are available in Additional file 1). However, for the hard case, both values are almost zero.
In order to improve performance, we selected the top 10 ranked features with the smallest P-values, independent of significance (using P-value ranks, see Methods). This resulted in Matthews correlation coefficients of 0.97, 0.61, and 0.22, and F measures of 0.97, 0.65, and 0.30 for easy, medium, and hard cases, respectively (Figure 2; confusion tables are available in Additional file 1). Thus, FE accuracy is reasonable, but selecting features using non-significant P-values is not ideal, highlighting the problem of using FE on a categorical multiclass data set.
In order to overcome this, we next tested BAHSIC [10] (see Methods), a recently proposed non-parametric FE method that has been used on high-dimensional microarray data sets. The obtained Matthews correlation coefficients were 0.84, 0.49, and 0.18, and F measures were 0.86, 0.54, and 0.27 for easy, medium, and hard cases, respectively (Figure 2; confusion tables are available in Additional file 1). Although performance is relatively improved (without using highly ranked but non-significant features), BAHSIC does not use P-values, and again the results are not completely satisfactory, especially for the easy case: a Matthews coefficient of 0.84 is less than the 0.95 achieved by categorical regression based FE.
Therefore, we next considered VBPCAFE. In order to perform FE with VBPCA, original VBPCA was extended to incorporate feature dependence (see Methods). Prior distribution in this extension has feature-dependent parameters, and therefore automatic elimination of irrelevant features was expected. The \(C_{B}^{i1}\) histogram reflects the prior distribution parameter of the first principal component (PC) (Figure 3), with smaller values assumed to be irrelevant features. Originally, C B was introduced to eliminate irrelevant PCs, and therefore has only q (PC) and not i (feature) dependence. However, we needed to eliminate irrelevant features as well; therefore, in our study C B must also have i dependence. Although we did not use sample labelling information, as expected, irrelevant features had smaller \(C_{B}^{i1}\). Averaged A j1 (contribution of the jth sample to the first PC) over 100 ensembles (Figure 4), demonstrates that A j1 represents the distinction between the four classes. Thus, features not coincident with A j1 (and with smaller \(C_{B}^{i1}\)) were eliminated, producing Matthews correlation coefficients of 0.91, 0.39, and 0.04, and F measures of 0.92, 0.46, and 0.14 for easy, medium, and hard cases, respectively (Figure 2; confusion tables are available in Additional file 1).
Relationship between \({C_{b}^{i}}\) and features with distinct expression among four classes. Left column: histogram obtained from logarithmic \({C_{b}^{i}}\) for 100 independent ensembles. Red color indicates features with distinct expression between four classes. Right column: proportion of features with distinct expression between four classes in each bin. Top: s=2, easy; middle: s=1, medium; bottom: s=0.5, hard cases.
Although performance has been successfully improved for the easy case, VBPCAFE is computationally challenging and is a potential drawback to its use. Iteration involves updates proportional to the number of features, which can often be as many as several tens of thousands. Thus, a more computationally effective method is of value, and a relatively straightforward idea is to replace \(C_{B}^{iq}\) with B iq , the qth PC score of ith feature, because a larger B iq is expected to result in relevant (thus larger) \(C_{B}^{iq}\) (for example, see eq. (1) in Methods). Indeed, replacing \(C_{B}^{i1}\) with B 1i , we obtained Matthews correlation coefficients of 0.88, 0.34, and 0.02, and F measures of 0.89, 0.41, and 0.12 for easy, medium and hard cases, respectively (Figure 2, confusion tables are available in Additional file 1). These values are comparable with those using \(C_{B}^{i1}\). Considering that CPCAFE requires minimal computational resources, CPCAFE is a promising candidate for applying to real data that often consists of more than several thousand features.
In summary, there are at least four methods that achieve comparable FE performance on a categorical multiclass data set: categorical regression based FE (using ranked P-values), BAHSIC, VBPCAFE, and CPCAFE. Each has its own advantages and disadvantages: although categorical regression based FE achieved the best overall performance, it used features with non-significant adjusted P-values. BAHSIC does not have this problem, but as it does not use P-values, its performance using the easy case was poorest of the tested methods. VBPCAFE and CPCAFE were more effective using the easy case, but their performance was poor for the hard case. VBPCAFE is computationally challenging, while CPCAFE is not.
However, these conclusions may be viewed as slightly subjective. The methods recommended for the hard case (i.e., categorical regression based FE and BAHSIC) have strict label dependency. Harder class discrimination often means label uncertainty (or incorrectness). Of course, there are many objective labels (e.g., gender or age), but those related to experimental conditions often include subjective criterion or insufficient controls for experimental conditions. Hard class discrimination often originates from these subjective labels, and consequently, robustness to mislabeling is desired, especially for hard cases.
In order to test robustness of the four methods towards partial mislabeling, we determined performance after mislabeling (Table 1). Figure 5 shows performance degradation caused by little, medium, and heavy partial mislabeling. Little, medium, and heavy were defined by the distance between true and wrong labels. The number of samples with wrong labels included only a proportion of the data, and never more than 20%. Although only 20% of samples were mislabeled, performance degradation with BAHSIC and categorical regression based FE was considerable for medium and heavy mislabeling. Conversely, VBPCAFE and CPNAFE performance were not affected by mislabeling as these two methods do not require labeling information. This indicates that the two methods recommended for hard cases are not particularly robust, even against partial mislabeling, and therefore not always recommended.
Matthews correlation coefficients and F measure for various FE methods applied to the simulated data set with partial mislabeling, indicated in Table 1. Correlation coefficients between mislabeled and true labeling were (a) 0.92, (b) 0.68, and (c) 0.60, as shown in Table 1. Other notations are the same as in Figure 2.
In conclusion, CPCAFE or VBPCAFE are the best methods for FE from categorical multiclass data sets, as they maintain robustness and show relatively stable and good performance for most cases.
Translational use of CPCAFE
In order to determine the effectiveness of CPCAFE in a real application, we examined PTSD associated heart disease. Our data set consisted of multiclass categorical samples, including several experimental conditions with no pre-defined rank orders (see Methods), and is suitable for estimating CPCAFE performance. Two-dimensional embedding of miRNA profiles are shown (Figure 6). Two probes (corresponding to mmu-miR-302c and -370) with extremely large values were deemed to be erroneous signals and excluded prior to embedding. Since each miRNA was attributed to multiple probes, removing these two probes did not mean exclusion of these miRNAs from the analysis. In addition, probes with relatively large PC2 projections were excluded and the 100 top-ranked outliers along PC1 selected. This strategy ensured selection of PC1 enhanced probes, as outliers along both PC1 and PC2 were not expected to be PC1 specific (PCs other than PC1 or PC2 were excluded, with our rationale discussed in Additional file 2). CPCAFE assumes that if a set of probes are outliers along a PC, they behave in a group oriented manner. If not, they are not outliers and are instead located on the origin, where the majority of probes without biological feasibility are presumed to be located. This criterion requires no user input and probe biological relevance (e.g., distinct expression between treatment and control samples) is unknown. Using these assumptions, we further investigated a selected 100 probes, representing 27 unique miRNAs, specifically, mmu-miR-451, -22, -133b, -709, -126-3p, -30c, -29a, -143, -24, -23b, -133a, -378, -30b, -29b, -125b-5p, -675-5p, -16, -26a, -30e, -1983, -691, -23a, -690, -207, and -669l, and mmu-let-7b and -7g. We investigated differential expression of these miRNAs between treatment and control samples using various statistical tests (e.g., t-test, Wilcoxon rank sum test, and Kolmogorov-Smirnov test), but obtained no significant results. However, owing to the small number of samples (four samples for treatment and control conditions), the significance criterion (i.e., P<0.05) was not satisfied by any miRNA examined, including the 27 selected miRNAs. Therefore, we compared the selected and other miRNAs as two separate groups. Boxplots of logarithmic P-values obtained by t tests between miRNAs in treatment and control samples are shown (Figure 7).
Two-dimensional embedding of miRNA expression determined by PCA. Each dot represents a probe. Red dots indicate the 100 top-ranked probes with larger PC1 scores, selected as outliers based on the criterion of CPCAFE. A few probes with relatively large PC2 scores were excluded to allow selection of PC1 enhanced probes. See Additional file 2 for more detail.
Boxplots of logarithmic P-values obtained from t tests comparing control and treatment samples.P-values < 0.5 indicate greater miRNA upregulation in treatment samples than controls (justification for using logarithmic P-values is available in Additional file 2). From left to right, the experimental conditions were 2, 5, and 10 days of stress and 1 day of rest; 5 days of stress and 10 days of rest; and 10 days of stress and 42 days of rest. Right-hand boxes (“selected”) are the 27 miRNAs identified by PCA-based unsupervised FE, and left-hand boxes (“others”) the remaining miRNAs. P-values shown above each plot were calculated using t tests to compare logarithmic P-values between selected and other miRNAs. P >s (P <s) is the rejection probability that rejects the null hypothesis (both sets have equal means) in favor of the alternative hypothesis (“others” have a larger or smaller mean than “selected”). Based on these criteria, selected miRNAs are upregulated in treatment samples with 2 days of stress and 1 day of rest, and downregulated in treatment samples for the other conditions.
The 27 selected miRNAs have larger or smaller P-values than the other miRNAs, indicating that CPCAFE successfully selected differentially expressed miRNAs between treatment and control samples (justification for using logarithmic P-values is provided in Additional file 2).
Although the selected miRNAs were expressed distinctly from the other miRNAs, this does not demonstrate biological relevance. As our aim was to investigate the underlying transcriptomic background of PTSD-mediated heart disease, preliminary validation of our approach can be provided by prior involvement of the selected miRNAs with heart disease. To address this, we performed literature searches (Table 2). Of the 27 selected miRNAs, 23 (excluding miR-1983, -691, -690, and -207) were previously reported to be related to heart disease, suggesting our miRNA selection is biologically useful.
To further confirm biological suitability of the identified miRNAs, we examined KEGG pathway enrichment using miRNA target genes (see Methods). Associations between enriched KEGG pathways and heart disease are summarized (Table 3). Next, we examined the 21 top-ranked pathways (the complete list is available in Additional file 3), with 17 found to be related to heart disease. Overall, these findings validate both our selection of miRNAs, and utility of CPCAFE.
Moreover, our results suggest that the aberrantly expressed miRNAs are likely involved in PTSD-mediated heart disease. Hence, further investigation of the miRNA target genes may clarify the underlying molecular biology and transcriptomic background of PTSD-mediated heart disease.
In this regards, we applied PCA to mRNA expression. Two-dimensional embedding of mRNA expression is shown (Figure 8). To determine correlation between miRNA and mRNA expression, we compared their expression profiles and determined the contribution of each sample to PC1 (Figure 9(a)), showing negative correlation between PC1s. Additionally, to determine if the observed correlation is coincident with experimental conditions, scatterplots of averaged values within each condition were examined (Figure 9(b)). This strengthened the correlations but did not change significance, indicating that the observed negative correlation between mRNA and miRNA expression is reliable. Next, we selected mRNAs using CPCAFE. To select PC1 enhanced probes, the 100 top-ranked outliers along PC1 were selected, excluding probes with relatively large projections to PC2. In total, 59 unique mRNAs were identified (RefSeq mRNA IDs are provided in Additional file 4). To confirm negative correlation between miRNAs and miRNA target mRNAs, correlation coefficients were determined (see Additional file 4). There were no targets common to the selected 59 mRNAs and TarBase, employed by DNA intelligent Analysis (DIANA)-mirpath [11] and used in KEGG pathway analysis (see Methods), possibly because of TarBase’s experiment-oriented, thus context-dependent, nature (i.e., TarBase does not include PTSD). Thus, instead we used seed matching to identify miRNA target genes, with so called 7mer-m8 [12] detecting exact matches to positions 2-8 of mature miRNAs (seed + position 8). Among the 59 mRNAs, 24 were targeted by at least one of the 27 selected miRNAs. In addition, 47 pairs of miRNAs and miRNA target genes were identified. In total, there were 45/47 negative correlation coefficients between miRNAs and miRNA target genes. We also examined correlation coefficient significance (see Methods), with 26/47 pairs (more than half) associated with significant correlations (two positive correlations were judged insignificant), and confirming negative correlation between miRNAs and miRNA target genes.
Comparison of sample contributions to PC1 between mRNA and miRNA.(a) Scatterplot comparing mRNA and miRNA expression profiles for sample contribution to PC1 (i.e., components of the first loading vector). Pearson’s correlation coefficient =−0.37 (P=0.01). (b) Averaged contributions within each condition. Pearson’s correlation coefficient =−0.69 (P=0.01). XY-Zd with X = C (control); X = T (treatment); Y, stress days; and Z, rest days in experimental conditions. See Additional file 2 for more detail.
In order to determine if the selected 59 mRNAs were differentially expressed between control and treated samples, we examined the logarithmic ratio. Using t tests, the averaged logarithmic ratio of the 59 samples was significantly negative or positive compared with that averaged over other mRNAs, excluding only one condition (see Table 4). Thus, our results show that the 59 selected mRNAs are mostly distinctly expressed between control and treated samples.
Although the selected mRNAs include many targeted and negatively regulated by miRNAs, and are differentially expressed between control and treated samples, published associations between the selected mRNAs and heart disease would provide direct biological relevance. Association between the identified genes and heart disease are summarized (Table 5). In total, 9 genes were both targeted by at least one of the 27 miRNAs and related to heart disease. In addition, 17 genes were related to heart disease but not targeted by any of the 27 miRNAs (see Additional file 5). Among the genes not associated with heart disease, 15 genes were targeted by at least one of the 27 miRNAs, and only 18 genes were not targeted by any. Because approximately half (26 in total) of the selected 59 genes are related to heart disease, our gene selection is feasible from a biological point of view.
Finally, we compared the selected 59 genes with KEGG pathways. KEGG pathway analysis had been performed for the miRNAs, but as they are not the only mRNA regulatory mechanism, mRNA expression may be, at least partially, distinct from miRNA expression. We found many genes were concentrated to specific KEGG pathways (see Additional file 6). For example, Uqcrh, Uqcrq, Cox6a2, Cox7a1, Cox5a, Cox4i1, Cox8b, Cox6c, Myl2, Myl3, Myh6, Myh8, Tpm1, Tnni3, and Tnnt2 belong to the KEGG pathway “Cardiac muscle contraction” (mmu04260), and most are also components of cytochrome c oxidase, involved in mitochondrial proton transfer. Thus, it is biologically reasonable that heart disease is associated with aberrant expression of these genes. Mybpc3, Tnni3, and Tnnt2 belong to the KEGG pathway “Hypertrophic cardiomyopathy” (mmu05410), also coincident with a role in heart disease. Atp5g1, Atp5b, Atp5g3, Atp5h, Atp5a1, Atp5e, Atp5j2, Ndufa13, and Ndufs6 belong to “Oxidative phosphorylation” (mmu00190 + 11951). This KEGG pathway is an essential part of mitochondrial energy metabolism, and malfunction is likely to be directly related to muscle functionality. Mdh2 and Aco2 belong to the “Citrate cycle” (mmu00020), and are involved in energy production, while Fabp3 belongs to the “peroxisome proliferator-activated receptor (PPAR) signaling pathway” (mmu03320), involved in muscle function. Thus, based on these KEGG pathway functions, the genes identified by CPCAFE are related to heart disease.
In order to further confirm the validity of our methodology, i.e., integrated analysis of mRNA and miRNA expression, we have also performed KEGG pathway analysis by the Database for Annotation, Visualization and Integrated Discovery (DAVID) [13] restricted to 24 genes targeted by at least one of 27 miRNAs (see Methods). DAVID identified five KEGG pathways associated with significant P-values adijutsted by Benjamini and Hochberg (BH) critetion (Table 6). Two out of five were related to cradiadic diseases (“Cardiac muscle contraction” and “Oxidative phosphorylation”[14]) and three were related to neurodegenerative diseases (“Parkinson’s disease”, “Alzheimer’s disease” and “Huntington’s disease”). Thus, these are very coincident with those causing PTSD mediated heart diseases. Figure 10 summarizes the analyses performed in the above.
Our findings suggest that PTSD-mediated heart disease may be caused by malfunction in “Cardiac muscle contraction” and/or “Oxidative phosphorylation” of energy metabolism. These malfunctions are related to aberrant gene expression likely mediated by aberrant miRNA expression. From a therapeutic point of view, PTSD-mediated heart disease may be treated based upon this knowledge. To perform in silico drug discovery for these genes, the 26 genes associated with heart disease were investigated. First, tertiary structures were predicted (see Methods), and found to be similar to predicted or experimentally determined tertiary structures available in the Protein Data Bank (PDB), indicating our tertiary structures are reliable (see Additional file 7).
Among the proteins with tertiary structures predicted or available in PDB, FABP3 has a “pocket” to which inhibitors can bind, and was therefore selected as a candidate drug target for in silico drug discovery. FABP3 is an acid binding protein and its function can be blocked by inhibition of acid binding. Moreover, FABP3 is upregulated in patients with ventricular-septal defects in comparison to normal controls [15]. FABP3 is also a member of FABPs that play critical roles in the PPAR signaling pathway identified above. Thus, it is likely that FABP3 is a key protein in PTSD-mediated heart disease.
The 10 top-ranked drug candidate compounds obtained by in silico drug discovery (see Methods) are listed (Table 7). The complete list of compounds ranked by FPAScores is available in Additional file 8. The compounds include promising drug candidates, for example, two heat shock protein 90 (HSP90) inhibitors are upregulated in dilated cardiomyopathy [16], and two PPAR inhibitors are regarded as pharmacological therapeutic targets [17]. Furthermore, overexpression of two Cyclin-dependent kinase 2 (CDK2) inhibitors results in smaller mononuclear cardiomyocytes [18]. All of these candidates should be investigated further.
Stability and comparison with other methods
We have shown biological feasibility of CPCAFE when applied to PTSD. However, it is also important to compare its performance against other methods, as CPCAFE superiority is doubtful if any other method can achieve comparable performance. Hence, we used a modified data set to ensure performance is due to the method and not the data set. If slight modifications of the sample data set drastically decrease performance, CPCAFE superiority is doubtful. In addition, VBPCAFE performance on the PTSD data set is unknown. If VBPCAFE derives completely different outcomes from CPCAFE, proposing CPCAFE as an alternative to VBPCAFE (with a firmer theoretical base, albeit a more time-consuming method) would be less convincing.
First, we examined equivalence between CPCAFE and VBPCAFE. VBPCAFE is too time-consuming to be directly applied to the whole PTSD data set, therefore we created a data set small enough to be used directly that consisted of 200 features, with 100 features selected by CPCAFE and 100 distinct features. If VBPCAFE and CPCAFE are equivalent, the 100 features selected by CPCAFE should have larger \(C^{i1}_{B}\)s than those attributed to the other 100 features (see Methods). Feature frequencies selected from the 100 top-ranked probes with larger \(C^{i1}_{B}\) values after investigation of 100 independent ensembles are shown (Figure 11). Scatterplots between \(C_{B}^{i1}\) and B i1 are also shown (Figure 12). As expected (from eq. (1) in Methods), \(C_{B}^{i1}\) is quadratically dependent upon B i1, definitely demonstrating equivalence between CPCAFE and VBPCAFE when applied to a real data set. Of course, there is still the possibility that VBPCAFE applied to the whole PTSD data set would select a completely different set of features from the 100 features selected by CPCAFE. However, we believe it is unlikely as there are almost no features not selected by CPCAFE, within the 100 top-ranked in any of the 100 ensembles. Thus, CPCAFE and VBPCAFE show equivalence when applied to not only simulated data, but also a real data set.
Next, we examined CPCAFE stability, i.e., sample independence, by performing a 4-fold cross-validation study (see Methods). We specifically used a 4-fold cross-validation as there are only four biological replicates in each experimental condition, therefore using any other cross-validation would not be straightforward. The results from 100 independent ensembles are shown (see Additional file 9). For mRNAs, 78 probes were always selected by CPCAFE and only 10 probes not always selected, demonstrating high sample independence. Among the 78 probes always selected, 53 had associated RefSeq IDs that were part of the 59 RefSeq IDs selected by applying CPCAFE to the whole data set. For miRNAs, 27 probes were always selected and no probe not always selected (see Additional file 9). Among the 27 selected mature miRNAs, 25 were part of the 27 mature miRNAs selected by CPCAFE previously. Thus, CPCAFE selected almost all features 100% of the time, demonstrating stability and suggesting that performance is not likely due to the selected data set. As CPCAFE and VBPCAFE show potential equivalence, it is likely that VBPCAFE also shares this stability.
Third, we determined if other conventional supervised, and thus possibly sample dependent, FE methods can achieve a comparable performance to CPCAFE. As there are as many as 12 experimental setups without any pre-defined rankings or orderings, it is not straightforward to use a popular multiclass oriented FE with regression analyses, e.g., lasso [1]. Not only is there no way to attribute labels with actual values to each experimental setup, but it is also not known if it is possible, in principal, to align these 12 experimental conditions in one dimensional order. Thus, the number of usable supervised FE methods that can be tested on the present PTSD data set is limited. Nevertheless, we identified and examined two methods. The first was regression analysis, which attributes a 0 or 1 to each experimental setup with a linear combination assumed to represent mRNA/miRNA expression (categorical regression-based FE, see Methods). Each feature is then ranked by significance (small P-values are attributed to regression), and the 100 top-ranked features selected. Using this method, we identified 100 mRNA/miRNA probes and investigated biological feasibility and stability of selected ones. For mRNAs, among the 100 selected probes, only 23 had associated RefSeq IDs (see Additional file 4), a smaller number than CPCAFE, suggesting that CPCAFE more readily identifies biologically important genes (with the underlying assumption that biologically important genes are more likely to have RefSeq IDs). Disease association of the selected genes was also poorer than those selected by CPCAFE (Table 8). Only 4/23 genes (Ttn, Ubr2, Gata5, and Hs2st1) were associated with heart failure-related diseases, in contrast with the 26 heart disease associated genes (out of 59 genes) selected by CPCAFE. Even extending the target species to human, only one additional gene (Cxc11) was identified. Altogether, these results show that CPCAFE has greater power for identifying biologically feasible genes. For miRNAs, among the 100 selected probes, 77 were identified with unique mature miRNA names (see Additional file 4), a much larger number than CPCAFE. Again, this demonstrates the biological feasibility of CPCAFE, as each miRNA is attributed to multiple probes and should therefore have been selected simultaneously. Thus with miRNAs, a smaller number of identified unique mature miRNA names reflects more plausible FE. The identified miRNAs were uploaded to DIANA-mirpath for KEGG pathway analysis (see Additional file 3), and 74 KEGG pathways identified (66 with CPCAFE), although the number of miRNAs related to each pathway is much smaller: using CPCAFE, on average seven miRNAs contributed to each pathway, while with categorical regression-based FE, only four miRNAs contributed, despite almost three times larger (77 vs 27) miRNAs uploaded (P = 1.67×10−17, difference between mean values computed by t test). This suggests that categorical regression-based FE is less able to identify biologically important miRNAs than CPCAFE. We also determined if miRNA target mRNAs were negatively correlated with miRNA expression, and identified 180 mRNA-miRNA pairs but with only 35 pairs negatively correlated (see Additional file 4). This again contrasts with CPCAFE, with almost all mRNA-miRNA pairs negatively correlated. Correlation coefficient significance was examined, and only 20 significantly correlated pairs were identified. Since all significant correlation coefficients were negative, categorical correlation-based FE can extract correct features, but is less able to confidently screen more features than CPCAFE; more than half of the pairs identified by CPCAFE were associated with significant negative correlations. This is consistent with the limited number of miRNAs selected by categorical regression-based FE contributing to KEGG pathway analysis. Stability was also compared with CPCAFE (see Additional file 9). For mRNAs, only 24 probes were always selected among 100 cross-validation ensembles, with 122 probes selected only once. For miRNAs, only eight probes were always selected (see Additional file 9). The next highest frequencies selected were 93 and 95, corresponding to only two probes each. Conversely, 33 and 29 probes were selected only once and twice, respectively. Thus, with regards to stability, CPCAFE outperforms FE with categorical regression analysis.
It is possible that CPCAFE outperforms FE with categorical regression analysis because it is too simple (naive) an alternative. Therefore to compare CPCAFE performance with a more sophisticated method, we used BAHSIC (see Methods).
For mRNAs, among the 100 selected probes, only 37 had RefSeq IDs, again less than CPCAFE (see Additional file 4). Of these 37 mRNAs, only 16 were associated with heart failure-related disease (Table 8), even when the target species was extended to human. Thus, 43% of extracted RefSeq associated mRNAs are related to heart disease in the Gendoo server. This is similar to the 45% reported for genes selected by CPCAFE. Considering that the total number of selected RefSeq associated mRNAs is larger, this suggests that CPCAFE outperforms BAHSIC as well as categorical regression based FE. Interestingly, 15/37 mRNAs (not always including the 16 disease associated genes) were also selected by CPCAFE, despite use of distinct algorithms by BAHSIC and CPCAFE. Nine genes selected by CPCAFE (in addition to the six genes listed in Table 8 or Additional file 5), but with missing disease association were Synrg, Milr1, Exosc2, Medag, 2610028H24Rik, pbld1, Hbb-bt, 1700047I17Rik2, and Hba-a2. Thus, mRNAs extracted by CPCAFE and BAHSIC overlap significantly. Furthermore, if we also consider PC2 outliers (see Additional file 2) that were excluded in the previous analyses, an additional 15 genes (Rhox8, Kctd14, Ttc38, G l r x2, Ndor1, Dcc, E l k1, G c m1, Hccs, Nppa, A c t c1, Pigr, Slc10a1, C x c l11, and Med16) have been identified by CPCAFE (Bolditalic six genes are also associated with heart failure-related disease, see Additional file 2). Consequently, there is a substantial increase in overlap significance between mRNAs extracted by CPCAFE and BAHSIC. Figure 13 shows the relationship between CPCAFE, BAHSIC, and heart failure-related disease association. The many genes identified by both methods and associated with disease show that our method (i.e., treating expression data as a categorical multiclass data set and not a collection of pairwise comparisons) can identify biologically relevant genes.
Venn diagram of mRNAs extracted by CPCAFE and BAHSIC, and heart failure-related disease association. Numbers in parentheses correspond to those with outliers along PC2 (see Additional file 2).
For miRNAs, among the 100 probes, 47 unique mature miRNAs were selected (see Additional file 4), a much larger number than CPCAFE (27). The 47 miRNAs were uploaded to DIANA-mirpath (see Additional file 4), and 65 KEGG pathways identified as significant. Although this number is similar to that obtained by CPCAFE (66), considering that the number of uploaded miRNAs was almost twice (47 vs 27), CPCAFE is still superior to BAHSIC. In fact, the averaged number of miRNAs with target mRNAs enriched in each pathway, was approximately seven, similar to that obtained by CPCAFE despite two-times more uploaded miRNAs. We also compared biological significance of the KEGG pathways obtained by BAHSIC and CPCAFE. In contrast to 17 reported pathways related to heart-failure related disease (from the top most significant 21 KEGG pathways) using CPCAFE (Table 3), only 11 identified by BASHSIC (of which, seven were also identified by CPCAFE; Table 3) were related to heart-failure related disease by literature searching (Table 9). Thus, from a biological point of view, CPCAFE outperforms BAHSIC. We also determined if targeted mRNAs negatively correlate with miRNA expression, and identified 164 mRNA-miRNA pairs, although only 73 were negatively correlated (see Additional file 4). Conversely, with CPCAFE, almost all pairs are negatively correlated. Correlation coefficient significance was examined, with only 33 significantly correlated pairs identified. Since all significant correlation coefficients were negative, this shows that BAHSIC cannot correctly extract features, and is less able to confidently screen more features than CPCAFE. Again this coincides with the limited number of miRNAs selected by BAHSIC that contribute to KEGG pathway analysis.
BAHSIC stability was compared (see Additional file 9). For mRNAs, only one probe was selected only 14 times among the 100 independent ensembles, and was also the most frequently selected. The second most frequent four probes were selected only 13 times, and 2133 probes were selected only once. For miRNAs, 68 probes were always selected among 100 cross-validation ensembles (see Additional file 9). The second most frequent probes were selected 99 times, but this only included three probes. The third, fourth, and fifth frequent probes were selected 98, 97, and 96 times, but included only 2, 3 and 1 probes, respectively. Thus, with stability, CPCAFE definitely outperforms BAHSIC.
In conclusion, CPCAFE outperformed two conventional supervised FE methods on both stability and biological feasibility, and performed equally well to VBPCAFE, which has more theoretical confidence. Thus, CPCAFE and VBPCAFE are the most suitable FE methods for categorical multiclass problems.
We have included diagrams summarizing the discussed points (Figure 14). Figure 14(a) shows the number of unique miRNAs. The same 100 probes were extracted using all methods, and miRNAs assigned to multiple probes. As all probes to which the same miRNAs are assigned should be extracted at the same time, smaller numbers of unique miRNAs assigned to 100 probes shows better extraction. In this context, CPCAFE outperformed the other two methods (Venn diagram is also available in Figure 15). Figure 14(b) shows the number of mRNAs with RefSeq IDs. As mRNAs with RefSeq IDs are more likely to have known biological significance, a larger number of RefSeq IDs accompanying mRNAs shows selection of more biologically relevant mRNAs. In this context, CPCAFE outperformed the other two methods. Figure 14(c) shows the number of RefSeq miRNA genes related to heart failure-related disease. Larger numbers suggest that FE has correctly extracted mRNAs related to the target disease, therefore CPCAFE outperformed the other two methods. Figure 14(d) shows the number of KEGG pathways identified by uploading the miRNAs shown in Figure 14(a) to DIANA-mirpath. Although categorical regression based FE outperformed the other two methods, it may have incorrectly extracted the most unique miRNAs in Figure 14(a), therefore increased number of KEGG pathways does not always reflect method superiority. Indeed, counting the average number of miRNAs contributing to each pathway (Figure 14(e)), indicates that CPCAFE and BAHSIC are comparable while categorical regression based FE performs worse. This suggests that categorical regression based FE cannot identify as many KEGG pathways as CPCAFE or BAHSIC if the same number of unique miRNAs are extracted (albeit experimentally). Thus, it is reasonable to assume that CPCAFE and BAHSIC outperformed categorical regression based FE in this context. Figure 14(f) shows the possible number of mRNA/miRNAs pairs, i.e., product of the unique miRNAs (Figure 14(a)) and RefSeq accompanying mRNAs (Figure 14(b)). Although these numbers are comparable among the three FE methods, the number of miRNA and targeted mRNA pairs is distinct (Figure 14(g)). Considering the ratio (Figure 14(h)) (obtained by dividing the numbers in Fig. 14(g) by those in Figure 14(f)), CPCAFE appears worst (i.e., smallest), but this is reversed if significance is considered. Figure 14(i) shows the number of miRNA and targeted mRNA pairs with significant correlations. Converting these numbers to a ratio (Figure 14(j)) by dividing the number of pairs of miRNAs and targeted mRNAs (Figure 14(g)), CPCAFE outperformed the other two methods. The same result is obtained when considering negative correlations (Figures 14(k) and (l)), which are desirable as miRNAs suppress target mRNA expression. Overall, these results (from Figure 14(g)-(l)) suggest that CPCAFE extracted significantly more miRNA and targeted mRNA pairs than the other two methods, which had apparently extracted more. In conclusion, based on our summarized discussions, we conclude that CPCAFE outperforms two other FE methods.
Conclusions
We have extended VBPCA for FE. Although VBPCAFE is an effective method when applied to simulated data, feature-dependent extension inevitably makes it computationally challenging. Thus, we replaced VBPCA with the simpler CPCA, and achieved reasonable FE performance on simulated data. In order to demonstrate CPCAFE effectiveness on real data, we performed an integrated analysis of mRNA and miRNA expression from stressed mouse heart, investigating the underlying molecular biology and transcriptomic background of PTSD-mediated heart disease. CPCAFE successfully identified aberrantly expressed miRNAs and their negatively regulated target mRNAs. Biological significance of the identified miRNAs and mRNAs was confirmed. Equivalence between CPCAFE and VBPCAFE was demonstrated by applying both methods to the PTSD data set. Two conventional supervised FE methods were also tested, with CPCAFE outperforming them both. In silico drug discovery was performed for a selected gene, FABP3, with the top-ranked compounds identified including protein inhibitors reportedly upregulated in heart disease.
Methods
Simulations based on synthetic data of categorical multiclass samples
To simulate multiclass samples with N features and M samples, expression values were modeled using Gaussian distributions with μ k mean (k class). Standard deviations were fixed at 0.5. μ k was
with K indicating class number. Considering x ij to be an expression of the ith feature of the jth sample, it obeys:
where \({\mathcal N} (\mu,\sigma)\) is the normal distribution with a mean of μ and standard deviation of σ. The reason for including positive and negative μ k signs was to simulate coexistence of up/downregulated genes among multiple classes. The s parameter represents difficulty of distinguishing among multiple classes. Larger (smaller) s indicates easier (harder) samples with fixed K. ε is a random number satisfying the probability, P:
In the present study, N=100,N ′=10,K=4, and M=20 were used, and performances averaged over 100 independent ensembles.
One vs one t test based FE of a simulated categorical multiclass data set
P values, \(P^{k,k'}_{i}\), attributed to each i were computed using t tests to compare between \(\left \{ x_{\textit {ij}}; (k-1)\frac {M}{K} < j \leq k\frac {M}{K}\right \}\) and \(\left \{ x_{\textit {ij}}; (k'-1)\frac {M}{K} < j \leq k'\frac {M}{K}\right \}\), for all K(K−1)/2 pairs of k and k ′. \(P^{k,k'}_{i}\) was adjusted by BH criterion [19], with each k,k ′ pair and the ith gene adjusted. \(P^{k,k'}_{i}\)s <0.05 for all (k,k ′) pairs were identified as distinct features between multiple classes.
Categorical regression-based FE
Categorical regression-based FE was defined as follows, x ij reflects “expression” of the jth feature of the ith samples, therefore x ij can be represented as:
with δ jk = 1 only when the jth sample belongs to the kth category, otherwise it is 0. Category summation was taken and C ik s are fitting parameters. Because independent variables are categorical, the above regression equation belongs to a category of equations often named as categorical regression. For each ith feature, P-values were computed using the lm function implemented in R[20] (this can be easily performed if factors corresponding to experimental setups are used as independent variables in lm).
FE was used for simulated categorical multiclass regression in two ways. The first selected features with BH criterion [19] adjusted P-values <0.05. The second selected the top 10 features with smallest P-values. Finally, for the PTSD data set, the 100 top-ranked features with smallest P-values were selected as extracted features.
BAHSIC
BAHSIC uses the Hilbert-Schmidt norm of the cross-covariance operator (HSIC), defined as follows:
where 〈·〉 j and \(\langle \cdot \rangle _{jj^{\prime }}\) are averaged over all j and j,j ′ pairs, respectively, and \(\delta _{kk^{\prime }}\) is cronecker’s delta. The reason why linear kernel was employed was because it was shown to achieve best performances when applied to microarray gene expression [10]. In BAHSIC, features with smaller HSIC are iteratively discarded until the desired number of features remain. The number of features discarded at each step was 1 for the simulated categorical multiclass data set and 10% of remaining features for the PTSD data set.
R code for this algorithm is available in Additional file 2.
Extended VBPCA
Before extending VBPCA, conventional VBPCA is briefly explained.
X={x ij } was modeled [2,3] as:
where B and A are N×Q and M×Q matrices, respectively, and E is a N×M matrix obeying a Gaussian distribution with zero mean and standard deviation, σ E . The purpose of VBPCA is to obtain an optimal approximation using Q≪N,M.
Thus, following conventional notation and after substituting X=V, the conditional probability is:
where ||·||Fro is the Frobenius norm matrix. In order to obtain optimal Q values, a prior distribution was assumed:
where C A and C B are Q×Q diagonal positive matrices qth (q=1,…,Q) is a diagonal element of C A and C B that expresses the importance of the obtained qth principal component. Free energy was minimized as:
where Σ A and Σ B are variance matrices of \(\hat {A}\) and \(\hat {B}\), estimated from A and B by the variational method. Locally optimal \(\hat {A}, \hat {B}, \Sigma _{A}, \Sigma _{B}, C_{B}\), and σ E were obtained by performing the following iterative updates in this order:
where \(\boldmath {\hat {\text {\textit {B}}}}_{q}\) is the qth columnar vector of matrix \(\hat {B}\), and \({C_{B}^{q}}\) is the qth diagonal element of C B . ith row V vector. In addition to the above iteration, which should be repeated from top to bottom, i.e., Σ A in the left hand side of the first equation substituted to Σ A in the right hand side of the second equation, C A should be I in order to simulate conventional PCA [21]. It is also known that C B can be used to estimate the optimal number of PCs [2].
Next, we extended VBPCA so that it can extract features. In order to do this, C B was assumed to have i,(i=1,…,N) dependence, and should be denoted as \({C_{b}^{i}}\). Thus, P(B) should also have i dependence as:
Furthermore, it is required that Σ B has i dependence, and should also be denoted as \({\Sigma _{B}^{i}}\). For example, in the above equations, N C B and N Σ B are replaced with \(\sum _{i} {C_{B}^{i}}\) and \(\sum _{i} {\Sigma _{B}^{i}}\), respectively.
Then \( \frac {N}{2} \log \frac {|C_{B}|}{|\Sigma _{B}|}\) in F is replaced with \( \frac {1}{2} \sum _{i} \log \frac {|{C_{B}^{i}}|}{|{\Sigma ^{i}_{B}}|}\). \(\text {tr} \left \{ C_{B}^{-1} \left (\hat {B}^{T}\hat {B} \right) \right \}\) in F is replaced with \(\sum _{i}\hat {\boldmath {\text {\textit {B}}}_{i}}^{T} \left ({C_{B}^{i}} \right)^{-1} \hat {\boldmath {\text {\textit {B}}}_{i}}\), where \(\hat {\boldmath {\text {\textit {B}}}}_{i}\) is the ith row vector of \(\hat {B}\). \(C_{B}^{-1} N. \Sigma _{B}\) and N Σ B in F are replaced with \(\sum _{i} \left ({C_{B}^{i}} \right)^{-1} {\Sigma _{B}^{i}} \) and \(\sum _{i} {\Sigma _{B}^{i}}\), respectively. As a result:
is obtained. Reflecting these extensions, the above iteration rules are modified as:
where V i is the ith row V vector, and \(\boldmath {\hat {\text {\textit {A}}}}_{q}\) is the qth columnar vector of matrix \(\hat {A}\). Because of extension, divergence was suppressed by introducing C A normalization instead of using constant values. Therefore, \({C_{b}^{i}}\) expresses ith feature importance, and C A (instead of the former C B ) represents importance of the qth PC, and must be non-constant. The order of iterations in eq. (1) is arbitrary since each iteration is independent of one another.
In the present study, the above iterations began by substituting pre-computed PCs (using the prcomp function in R[20]) in A and B, to compensate for slow convergence. After a suitable number of iterations, parameters with the smallest F values were used for further analysis. Convergence was judged if extracted features change after more than 100 iterations.
R code for this algorithm is available in Additional file 2.
Statistical analysis of CPCAFE and VBPCAFE applied to simulated data
For VBPCAFE, the top-ranked features with larger \(C_{B}^{i1}\) values were extracted after convergence, judged by changes in extracted features after more than 100 iterations. For CPCAFE [22-29], expression data ({x ij }) was embedded into low dimensional space using PCA. After selecting the PC for FE, outliers along the PC were extracted i. e., the top 10 features with larger absolute projections to the selected PC.
Evaluation of FE performance
In order to evaluate FE performance in a simulated categorical multiclass data set, two measures were used for discrimination of binary classes with unequal member numbers. In this computation, true positive (TP) represents the number of features with distinct expression between classes (i≤N ′), which are identified by the specified feature. Conversely, true negative (TN) is the number of features with no distinct expression between classes (i>N ′), and are not identified by the specified feature. False positive (FP) is the number of features with no distinct expression between classes (i>N ′), but are identified by the specified feature. False negative (FN) is the number of features with distinct expression between classes (i≤N ′), but are not identified by the specified feature. Accordingly, the Matthews correlation coefficient is defined as:
while the F measure is:
where T P+F P corresponds to the number of features identified by specific FE, and T P+F N represents the number of features with distinct expression between classes (i≤N ′), thus representing the harmonic mean of sensitivity \(\left (\frac {TP}{TP+FN}\right)\) and precision \(\left (\frac {TP}{TP+FP}\right)\).
Translational application to PTSD associated heart disease
The overall work flow is illustrated in Figure 16.
Overall study work flow. The methods used for data processing and evaluation are indicated in red and blue, respectively. Dotted lines in sample descriptions (i.e., 1 or 2 day(s) stress vs 1 day rest) indicate missing control samples (see Methods for more detail).
mRNA and miRNA expression
mRNA and miRNA expression data were obtained from the Gene Expression Omnibus (GEO) using the GEO ID: GSE52875 [8]. Expression was observed in stressed mouse hearts. The length of time subservient mice were exposed to aggressor mice varied, with variable rest times after exposure. Exposure and rest times were 1, 2, 3, or 10 days of exposure and 1 day of rest, 5 days of exposure and 1 or 10 days of rest, and 10 days of exposure and 42 days of rest (in total, seven distinct treatment conditions). Controls were housed separately from the aggressor mice in personal cages, and prepared for all treatment conditions except for 1 or 3 days of exposure and 1 day of rest. Thus, there were only five control conditions. For each condition there were four biological replicates and therefore 48 samples in total were available.
mRNA expression was included in the subseries GSE52866 and GSE52871. GSE52866_RAW.tar and GSE52871_RAW.tar (provided as Supplementary Data in GEO) were downloaded, and the gProcessedSignal in each of 48 GSM files used for analysis. miRNA expression was included in the subseries GSE52869 and GSE52872. From GSE52872, eight raw Exiqon files (provided as Supplementary Data in GEO) were downloaded, and gProcessedSignal and rProcessedSignal used as miRNA profiles for further analysis. From GSE52869, 16 files (provided as Supplementary Data in GEO) were downloaded, and “Spot Mean Intensity Cyanine3” and “Spot Mean Intensity Cyanine5H” used as miRNA profiles for further analysis. The conditions attributed to each sample were provided by the file names. mRNA and miRNA expression were not normalized, apart from for CPCAFE, where mRNA expression was normalized to have zero mean and a standard deviation of 1.
KEGG pathway analysis of miRNAs using DIANA-mirpath
For CPCAFE, the 27 identified miRNAs were uploaded to the DIANA-mirpath server [11]. Although DIANA-mirpath requires mature miRNA names used in miRBase (rel. 18), the mature miRNA names in GEO ID: GSE52875 were used in the previous release, therefore the uploaded mature miRNAs are not exactly the same as the 27 identified miRNAs. Target gene prediction was performed using Tarbase [30], a database using experimentally validated targets that are more biologically plausible. Combined target genes sets were used for KEGG pathway enrichment analysis. False discovery rate corrected P-values were used to screen KEGG pathways. Direct weblinks to DIANA-mirpath results are provided in Additional file 10. The same analyses were performed for categorical regression-based FE and BAHSIC, excluding the number of uploaded miRNAs.
Disease association analysis of genes using the Gendoo server
The Gendoo server [31], a literature-based disease association database, was used to identify associations between selected mRNAs and disease. As mRNAs were identified using RefSeq mRNA IDs, these were interpreted to gene symbols. Obtained gene symbols were uploaded to the Gendoo server with mouse being the specified target species. Human was also tested for categorical regression-based FE and BAHSIC, to compensate for the small number of hits.
KEGG pathway analysis of mRNAs by DAVID
Employed 24 genes were mRNAs that have non zero values in the column named as “target” of the “CPCA based” sheet in Additional file 4. Refseq IDs for these 24 genes were identified and were uploaded to DAVID [13] server using default setting. Then KEGG pathways identified were extracted.
Tertiary protein structure prediction
Tertiary protein structures were predicted using two prediction servers, Protein Homology/analogY Recognition Engine V2.0 (phyre2) [32] and full automatic modeling systems (FAMS) [33]. Among the 26 genes investigated, 14 genes were included in the PDB [34]. Tertiary protein structures of the remaining genes were predicted by either phyre2 or FAMS. The complete list of template proteins and amino acid sequences of investigated genes in fasta format is available in Additional file 11.
In silico drug discovery for FABP3
ChooseLD [35] was used for FABP3 drug discovery. Using the PDB structure of chain A in 1HMR as the template protein, and four ligands (9-OCTADECENOIC ACID in 1HMR, OLEIC ACID in 1HMS, STEARIC ACID in 1HMT, and PALMITIC ACID in 2HMB) as template ligands (acids not provided in 1HMR were mapped to 1HMR prior to chooseLD execution), with four additional FABP3 inhibitors from ChEMBL [36] as template ligands (see Additional file 2 for more detail), drug candidate compounds were selected from DrugBank [37]. ChooseLD was applied to 1450 compounds with a Tanimoto index >0.20 from at least one of the eight template ligands. The 1450 compounds were selected from 6510 compounds with tertiary structures computed by Babel software [38], from among the 6583 compounds listed in DrugBank [37]. The 1450 compounds were ranked based on Finger Print Alignment Scores (FPAScores) averaged over three independent runs.
Generation of a test PTSD data set
In order to test equivalence between CPCAFE and VBPCAFE on PTSD data, a test data set was generated. In addition to the 100 probes selected by CPCAFE, an additional 100 probes were chosen from those remaining, generating a test data set with 200 features. VBPCAFE was applied to the generated data set, and \(C_{B}^{i1}\)s values calculated. The top-ranked 200 features with largest \(C_{B}^{i1}\)s values were selected as extracted features. FE was performed over 100 independent ensembles, and the frequency (number of times each feature was selected) counted. Frequency number = 100, indicates that the feature was always selected.
FE cross-validation
In order to test FE stability on the PTSD data set, a 4-fold cross-validation was performed, with each experiment repeated four times. For each experimental setup, three out of four replicates were randomly selected, generating a data set with 36 samples. Since the total possible number of independent samplings was 412≃2×107, it is impossible to test all samplings. Therefore, 100 samplings were tested, which was large enough to demonstrate superior stability of CPCAFE compared with the two conventional supervised methods of categorical regression-based FE and BAHSIC.
Significance of correlation coefficients
Correlation coefficient significance was investigated by transforming the correlation coefficient (r) to the statistical test variable (t):
obeying the t distribution of M−2 degrees of freedom. As there were 48 samples in our study, M= 48. Computed P-values were adjusted by BH criterion [19]. Correlation coefficients with adjusted P-values <0.05 were regarded as significant.
Abbreviations
- BAHSIC:
-
Backward elimination using Hilbert-Schmidt norm of the cross covariance operator
- BH:
-
Benjamini and Hochberg
- CDK2:
-
Cyclin-dependent kinase 2
- CPCA:
-
Conventional PCA
- CHD:
-
Coronary heart disease
- CPCAFE:
-
Conventional PCA-based unsupervised FE
- DAVID:
-
Database for annotation, visualization and integrated discovery
- DIANA:
-
DNA intelligent Analysis
- FABP3:
-
Fatty acid binding protein 3
- FAMS:
-
Full automatic modeling systems
- FE:
-
Feature extraction
- FP:
-
False positive
- FPAScores:
-
Finger print alignment scores
- FN:
-
False negative
- GEO:
-
Gene expression omnibus
- HSP90:
-
Heat shock protein 90
- KEGG:
-
Kyoto encyclopedia of genes and genomes
- miRNA:
-
microRNA
- PC:
-
Principal component
- PCA:
-
principal component analysis
- PDB:
-
Protein data bank
- phyre2:
-
Protein homology/analogy recognition engine V2.0
- PPAR:
-
Peroxisome proliferator-activated receptor
- PTSD:
-
Posttraumatic stress disorder
- TP:
-
True positive
- TN:
-
True nagative
- VB:
-
Variational Bayes
- VBPCAFE:
-
VBPCA-based unsupervised FE
References
Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc. Ser B (Methodological). 1996; 58(1):267–88.
Bishop CM. Variational principal components. In: Proceedings of International Conference on Artificial Neural Networks. Heidelberg: Springer: 1999. p. 514–09.
Lim YJ, Teh TW. Variational bayesian approach to movie rating prediction. In: Proceedings of KDD Cup and Workshop: 2007. http://www.cs.uic.edu/~liub/KDD-cup-2007/proceedings/variational-Lim.pdf.
Yehuda R. Post-traumatic stress disorder. N Engl J Med. 2002; 346(2):108–14.
Edmondson D, Kronish IM, Shaffer JA, Falzon L, Burg MM. Posttraumatic stress disorder and risk for coronary heart disease: a meta-analytic review. Am Heart J. 2013; 166(5):806–14.
Jordan HT, Stellman SD, Morabia A, Miller-Archie SA, Alper H, Laskaris Z, et al.Cardiovascular disease hospitalizations in relation to exposure to the September 11, 2001 World Trade Center disaster and posttraumatic stress disorder. J Am Heart Assoc. 2013; 2(5):000431.
Vaccarino V, Goldberg J, Rooks C, Shah AJ, Veledar E, Faber TL, et al.Post-traumatic stress disorder and incidence of coronary heart disease: a twin study. J Am Coll Cardiol. 2013; 62(11):970–8.
Cho JH, Lee I, Hammamieh R, Wang K, Baxter D, Scherler K, et al.Molecular evidence of stress-induced acute heart injury in a mouse model simulating posttraumatic stress disorder. Proc Natl Acad Sci USA. 2014; 111(8):3188–93.
Kanehisa M, Goto S, Sato Y, Kawashima M, Furumichi M, Tanabe M. Data, information, knowledge and principle: back to metabolism in KEGG. Nucleic Acids Res. 2014; 42(Database issue):199–205.
Song L, Smola A, Gretton A, Bedo J, Borgwardt K. Feature selection via dependence maximization. J Machine Learning Res. 2012; 13(1):1393–434.
Vlachos IS, Kostoulas N, Vergoulis T, Georgakilas G, Reczko M, Maragkakis M, et al.DIANA miRPath v.2.0: investigating the combinatorial effect of microRNAs in pathways. Nucleic Acids Res. 2012; 40(Web Server issue):498–504.
Lee HC, Chen CY, Au LC. Systemic comparison of repression activity for miRNA and siRNA associated with different types of target sequences. Biochem Biophys Res Commun. 2011; 411(2):393–6.
Huang DAW, Sherman BT, Lempicki RA. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc. 2009; 4(1):44–57.
Rosca MG, Vazquez EJ, Kerner J, Parland W, Chandler MP, Stanley W, et al.Cardiac mitochondria in heart failure: decrease in respirasomes and oxidative phosphorylation. Cardiovasc Res. 2008; 80(1):30–9.
Zhang H, Zhou L, Yang R, Sheng Y, Sun W, Kong X, et al.Identification of differentially expressed genes in human heart with ventricular septal defect using suppression subtractive hybridization. Biochem Biophys Res Commun. 2006; 342(1):135–44.
Kapustian LL, Vigontina OA, Rozhko OT, Ryabenko DV, Michowski W, Lesniak W, et al.Hsp90 and its co-chaperone, Sgt1, as autoantigens in dilated cardiomyopathy. Heart Vessels. 2013; 28(1):114–9.
Finck BN. The PPAR regulatory system in cardiac physiology and disease. Cardiovasc Res. 2007; 73(2):269–77.
Liao HS, Kang PM, Nagashima H, Yamasaki N, Usheva A, Ding B, et al.Cardiac-specific overexpression of cyclin-dependent kinase 2 increases smaller mononuclear cardiomyocytes. Circ Res. 2001; 88(4):443–50.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc. 1995; B57(1):289–300.
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2014. R Foundation for Statistical Computing. http://www.R-project.org/.
Tipping ME, Bishop CM. Probabilistic principal component analysis. J R Stat Soc: Ser B (Stat Methodology). 1999; 61(3):611–22.
Kinoshita R, Iwadate M, Umeyama H, Taguchi YH. Genes associated with genotype-specific DNA methylation in squamous cell carcinoma as candidate drug targets. BMC Syst Biol. 2014; 8 Suppl 1:4.
Taguchi YH, Murakami Y. Principal component analysis based feature extraction approach to identify circulating microRNA biomarkers. PLoS ONE. 2013; 8(6):66714.
Ishida S, Umeyama H, Iwadate M, Taguchi YH. Bioinformatic Screening of Autoimmune Disease Genes and Protein Structure Prediction with FAMS for Drug Discovery. Protein Pept Lett. 2014; 21(8):828–39.
Murakami Y, Toyoda H, Tanahashi T, Tanaka J, Kumada T, Yoshioka Y, et al.Comprehensive miRNA expression analysis in peripheral blood can diagnose liver disease. PLoS ONE. 2012; 7(10):48366.
Taguchi Y-H, Okamoto A. Principal component analysis for bacterial proteomic analysis In: Shibuya T, Kashima H, Sese J, Ahmad S, editors. Pattern Recognition in Bioinformatics, Lecture Notes in Computer Science. Heidelberg: Springer: 2012. p. 141–52.
Umeyama H, Iwadate M, Taguchi Y-H. TINAGL1 and B3GALNT1 are potential therapy target genes to suppress metastasis in non-small cell lung cancer. BMC Genomics. 2014; 15(Suppl 9):S2.
Taguchi Y-H. Integrative analysis of gene expression and promoter methylation during reprogramming of a non-small-cell lung cancer cell line using principal component analysis-based unsupervised feature extraction In: Huang D-S, Han K, Gromiha M, editors. Intelligent Computing in Bioinformatics. Lecture Notes in Computer Science. Heidelberg: Springer: 2014. p. 445–55.
Taguchi Y-H, Murakami Y. Universal disease biomarker: Can a fixed set of blood micrornas diagnose multiple diseases?. BMC Reserch Notes. 2014; 7:581.
Vergoulis T, Vlachos IS, Alexiou P, Georgakilas G, Maragkakis M, Reczko M, et al.TarBase 6.0: capturing the exponential growth of miRNA targets with experimental support. Nucleic Acids Res. 2012; 40(Database issue):222–9.
Nakazato T, Bono H, Matsuda H, Takagi T. Gendoo: functional profiling of gene and disease features using MeSH vocabulary. Nucleic Acids Res. 2009; 37(Web Server issue):166–9.
Kelley LA, Sternberg MJ. Protein structure prediction on the Web: a case study using the Phyre server. Nat Protoc. 2009; 4(3):363–71.
Umeyama H, Iwadate M. FAMS and FAMSBASE for protein structure. Curr Protoc Bioinf. 2004; Chapter 5:Unit5.2.
Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, et al.The Protein Data Bank. Nucleic Acids Res. 2000; 28(1):235–42.
Takaya D, Takeda-Shitaka M, Terashi G, Kanou K, Iwadate M, Umeyama H. Bioinformatics based Ligand-Docking and in-silico screening. Chem Pharm Bull. 2008; 56(5):742–4.
Gaulton A, Bellis LJ, Bento AP, Chambers J, Davies M, Hersey A, et al.ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic Acids Res. 2012; 40(Database issue):1100–7.
Law V, Knox C, Djoumbou Y, Jewison T, Guo AC, Liu Y, et al.DrugBank 4.0: shedding new light on drug metabolism. Nucleic Acids Res. 2014; 42(Database issue):1091–7.
O’Boyle NM, Banck M, James CA, Morley C, Vandermeersch T, Hutchison GR. Open Babel: An open chemical toolbox. J Cheminform. 2011; 3:33.
Wang X, Zhu H, Zhang X, Liu Y, Chen J, Medvedovic M, et al.Loss of the miR-144/451 cluster impairs ischaemic preconditioning-mediated cardioprotection by targeting Rac-1. Cardiovasc Res. 2012; 94(2):379–90.
Goren Y, Kushnir M, Zafrir B, Tabak S, Lewis BS, Amir O. Serum levels of microRNAs in patients with heart failure. Eur J Heart Fail. 2012; 14(2):147–54.
Matkovich SJ, Wang W, Tu Y, Eschenbacher WH, Dorn LE, Condorelli G, et al.MicroRNA-133a protects against myocardial fibrosis and modulates electrical repolarization without affecting hypertrophy in pressure-overloaded adult hearts. Circ Res. 2010; 106(1):166–75.
Vacchi-Suzzi C, Bauer Y, Berridge BR, Bongiovanni S, Gerrish K, Hamadeh HK, et al.Perturbation of microRNAs in rat heart during chronic doxorubicin treatment. PLoS ONE. 2012; 7(7):40395.
Qiang L, Hong L, Ningfu W, Huaihong C, Jing W. Expression of miR-126 and miR-508-5p in endothelial progenitor cells is associated with the prognosis of chronic heart failure patients. Int J Cardiol. 2013; 168(3):2082–8.
Duisters RF, Tijsen AJ, Schroen B, Leenders JJ, Lentink V, van der Made I, et al. miR-133 and miR-30 regulate connective tissue growth factor: implications for a role of microRNAs in myocardial matrix remodeling. Circ Res. 2009; 104(2):170–8.
van Rooij E, Sutherland LB, Thatcher JE, DiMaio JM, Naseem RH, Marshall WS, et al.Dysregulation of microRNAs after myocardial infarction reveals a role of miR-29 in cardiac fibrosis. Proc Natl Acad Sci USA. 2008; 105(35):13027–32.
Rangrez AY, Massy ZA, Metzinger-Le Meuth V, Metzinger L. miR-143 and miR-145: molecular keys to switch the phenotype of vascular smooth muscle cells. Circ Cardiovasc Genet. 2011; 4(2):197–205.
Wang J, Huang W, Xu R, Nie Y, Cao X, Meng J, et al. MicroRNA-24 regulates cardiac fibrosis after myocardial infarction. J Cell Mol Med. 2012; 16(9):2150–60.
van Rooij E, Sutherland LB, Liu N, Williams AH, McAnally J, Gerard RD, et al. A signature pattern of stress-responsive microRNAs that can evoke cardiac hypertrophy and heart failure. Proc Natl Acad Sci USA. 2006; 103(48):18255–60.
Ganesan J, Ramanujam D, Sassi Y, Ahles A, Jentzsch C, Werfel S, et al.MiR-378 controls cardiac hypertrophy by combined repression of mitogen-activated protein kinase pathway factors. Circulation. 2013; 127(21):2097–106.
Wong SS, Ritner C, Ramachandran S, Aurigui J, Pitt C, Chandra P, et al. miR-125b promotes early germ layer specification through Lin28/let-7d and preferential differentiation of mesoderm in human embryonic stem cells. PLoS ONE. 2012; 7(4):36121.
Tijsen AJ, Creemers EE, Moerland PD, de Windt LJ, van der Wal AC, Kok WE, et al. MiR423-5p as a circulating biomarker for heart failure. Circ Res. 2010; 106(6):1035–9.
Bao MH, Feng X, Zhang YW, Lou XY, Cheng Y, Zhou HH. Let-7 in cardiovascular diseases, heart development and cardiovascular differentiation from stem cells. Int J Mol Sci. 2013; 14(11):23086–102.
Spinetti G, Fortunato O, Caporali A, Shantikumar S, Marchetti M, Meloni M, et al. MicroRNA-15a and microRNA-16 impair human circulating proangiogenic cell functions and are increased in the proangiogenic cells and serum of patients with critical limb ischemia. Circ Res. 2013; 112(2):335–46.
Zhang ZH, Li J, Liu BR, Luo CF, Dong Q, Zhao LN, et al. MicroRNA-26 was decreased in rat cardiac hypertrophy model and may be a promising therapeutic target. J Cardiovasc Pharmacol. 2013; 62(3):312–9.
Crippa S, Cassano M, Messina G, Galli D, Galvez BG, Curk T, et al. miR669a and miR669q prevent skeletal muscle differentiation in postnatal cardiac progenitors. J Cell Biol. 2011; 193(7):1197–212.
Miwa K, Lee JK, Takagishi Y, Opthof T, Fu X, Hirabayashi M, et al. Axon guidance of sympathetic neurons to cardiomyocytes by glial cell line-derived neurotrophic factor (GDNF). PLoS ONE. 2013; 8(7):65202.
Chan AO, Jim MH, Lam KF, Morris JS, Siu DC, Tong T, et al. Prevalence of colorectal neoplasm among patients with newly diagnosed coronary artery disease. JAMA. 2007; 298(12):1412–9.
Kerkela R, Grazette L, Yacobi R, Iliescu C, Patten R, Beahm C, et al. Cardiotoxicity of the cancer therapeutic agent imatinib mesylate. Nat Med. 2006; 12(8):908–16.
Patwary MS, Haque KMHSS, Shoaib N, Salehin KS, Hosan ATMI. Cardiac Involvement of Hepatitis B and C Virus Infection. Univ Heart J. 2012; 8(2):113–8.
van Haelst PL, Schot B, Hoendermis ES, van den Berg MP. Acute myeloid leukaemia as a cause of acute ischaemic heart disease. Neth Heart J. 2006; 14(2):62–5.
DiMichele LA, Doherty JT, Rojas M, Beggs HE, Reichardt LF, Mack CP, et al.Myocyte-restricted focal adhesion kinase deletion attenuates pressure overload-induced hypertrophy. Circ Res. 2006; 99(6):636–45.
Muslin AJ. MAPK signalling in cardiovascular health and disease: molecular mechanisms and therapeutic targets. Clin Sci. 2008; 115(7):203–18.
Ward KK, Shah NR, Saenz CC, McHale MT, Alvarez EA, Plaxe SC. Cardiovascular disease is the leading cause of death among endometrial cancer patients. Gynecol Oncol. 2012; 126(2):176–9.
Bonney KM, Engman DM. Chagas heart disease pathogenesis: one mechanism or many?Curr Mol Med. 2008; 8(6):510–8.
Xu Y, Li X, Liu X, Zhou M. Neuregulin-1/ErbB signaling and chronic heart failure. Adv Pharmacol. 2010; 59:31–51.
Thomas JA, Gerber L, Banez LL, Moreira DM, Rittmaster RS, Andriole GL, et al.Prostate cancer risk in men with baseline history of coronary artery disease: results from the REDUCE Study. Cancer Epidemiol Biomarkers Prev. 2012; 21(4):576–81.
Leak D, Meghji M. Toxoplasmic infection in cardiac disease. Am J Cardiol. 1979; 43(4):841–9.
Bujak M, Frangogiannis NG. The role of TGF-beta signaling in myocardial infarction and cardiac remodeling. Cardiovasc Res. 2007; 74(2):184–95.
Steingart RM, Bakris GL, Chen HX, Chen MH, Force T, Ivy SP, et al. Management of cardiac toxicity in patients receiving vascular endothelial growth factor signaling pathway inhibitors. Am Heart J. 2012; 163(2):156–63.
Perez-Lloret S, Rey MV, Crispo J, Krewski D, Lapeyre-Mestre M, Montastruc JL, et al. Risk of heart failure following treatment with dopamine agonists in Parkinson’s disease patients. Expert Opin Drug Saf. 2014; 13(3):351–60.
Depression and Heart Disease. http://www.nimh.nih.gov/health/publications/depression-and-heart-disease/index.shtml.
Trifilo MJ, Yajima T, Gu Y, Dalton N, Peterson KL, Race RE, et al. Prion-induced amyloid heart disease with high blood infectivity in transgenic mice. Science. 2006; 313(5783):94–7.
Razani B, Zhang H, Schulze PC, Schilling JD, Verbsky J, Lodhi IJ, et al. Fatty acid synthase modulates homeostatic responses to myocardial stress. J Biol Chem. 2011; 286(35):30949–61.
Severs NJ, Coppen SR, Dupont E, Yeh HI, Ko YS, Matsushita T. Gap junction alterations in human cardiac disease. Cardiovasc Res. 2004; 62(2):368–77.
Acknowledgements
We thank Dr. Katsuichiro Komatsu for assistance with in silico drug screening using chooseLD. This work was supported by the Japan Society for the Promotion of Science KAKENHI (Nos. 23300357 and 26120528), and a Chuo University Joint Research Grant.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
HU performed drug discovery using chooseLD. MI performed protein tertiary structure predictions using FAMS. YHT designed and supervised the research, performed calculations and analyses, and prepared the manuscript. All authors read and approved the final manuscript.
Additional files
Additional file 1
Confusion tables for simulated data. Performance of FE methods applied to a simulated data set and expressed using confusion tables.
Additional file 2
Supplementary text. Supplementary discussion not included in the main text.
Additional file 3
Complete DIANA-mirpath results. Complete list of the KEGG pathway analysis reported by DIANA-mirpath for CPCAFE, categorical regression-based FE, and BAHSIC (xlsx). A partial list for CPCAFE is included in the main text as Table 3.
Additional file 4
Correlation coefficients between selected miRNAs and target mRNAs. Correlation coefficients between selected miRNAs and target mRNAs, with RefSeq IDs and gene symbols provided. None are filled between miRNAs and off target genes. The column “target” indicates the number of miRNAs targeting each gene (xlsx). CPCAFE, 27 miRNAs vs 59 mRNAs; categorical regression-based FE, 77 miRNAs vs 23 mRNAs; and BAHSIC, 47 miRNAs vs 37 mRNAs.
Additional file 5
List of associated diseases with genes and miRNAs. List of associated diseases with genes and miRNAs targeting each gene identified by CPCAFE. Lists genes not included in Table 5.
Additional file 6
KEGG pathway mapping diagram of identified genes. KEGG pathway mapping diagram of genes identified by CPCAFE (red characters). Genes listed as targets of drug candidate compounds in Table 7 are also indicated (blue characters).
Additional file 8
Full list of drug candidate compounds ranked by FPAScores.
Additional file 9
Stability analysis. Stability analysis of CPCAFE, categorical regression-based FE, and BAHSIC. Frequency represents the number of times each probe was selected among 100 independent ensembles. Number of probes represents the number of probes selected by the corresponding frequency. Numbers in bold represent the number of mRNAs/miRNAs selected 100%. Note that no mRNA was selected 100% by BAHSIC.
Additional file 10
DIANA-mirpath link. Weblink retrieving the DIANA-mirpath results of this study.
Additional file 11
Amino acid sequences uploaded to FAMS/phyre2. Amino acid sequences in fasta format that were uploaded to FAMS/phyre2 to determine tertiary protein structures.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Taguchi, Yh., Iwadate, M. & Umeyama, H. Principal component analysis-based unsupervised feature extraction applied to in silico drug discovery for posttraumatic stress disorder-mediated heart disease. BMC Bioinformatics 16, 139 (2015). https://doi.org/10.1186/s12859-015-0574-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12859-015-0574-4