Abstract
Background
Identifying drug–target interactions (DTIs) plays a key role in drug development. Traditional wet experiments to identify DTIs are expensive and time consuming. Effective computational methods to predict DTIs are useful to narrow the searching scope of potential drugs and speed up the process of drug discovery. There are a variety of non-negativity matrix factorization based methods to predict DTIs, but the convergence of the algorithms used in the matrix factorization are often overlooked and the results can be further improved.
Results
In order to predict DTIs more accurately and quickly, we propose an alternating direction algorithm to solve graph regularized non-negative matrix factorization with prior knowledge consistency constraint (ADA-GRMFC). Based on known DTIs, drug chemical structures and target sequences, ADA-GRMFC at first constructs a DTI matrix, a drug similarity matrix and a target similarity matrix. Then DTI prediction is modeled as the non-negative factorization of the DTI matrix with graph dual regularization terms and a prior knowledge consistency constraint. The graph dual regularization terms are used to integrate the information from the drug similarity matrix and the target similarity matrix, and the prior knowledge consistency constraint is used to ensure the matrix decomposition result should be consistent with the prior knowledge of known DTIs. Finally, an alternating direction algorithm is used to solve the matrix factorization. Furthermore, we prove that the algorithm can converge to a stationary point. Extensive experimental results of 10-fold cross-validation show that ADA-GRMFC has better performance than other state-of-the-art methods. In the case study, ADA-GRMFC is also used to predict the targets interacting with the drug olanzapine, and all of the 10 highest-scoring targets have been accurately predicted. In predicting drug interactions with target estrogen receptors alpha, 17 of the 20 highest-scoring drugs have been validated.
Similar content being viewed by others
Background
According to the DrugBank database, there are over 500,000 drugs for different diseases. However, there are still many diseases for which we have no effective drugs, and there is a long way for drug discovery and drug repurposing. The process of drug discovery and drug repurposing takes some important steps such as finding valid target proteins and discovering proper chemical compounds to interact with the targets (i.e. identifying drug–target interactions or binding affinity between drugs and proteins) [1]. Determining drug–target interactions (DTIs) via wet experiments is both time-consuming and expensive [2, 3]. To increase the probabilities of discovering new drugs or new applications of approved drugs, accurate computational methods to predict DTI are in urgent need to choose a small number of compounds for the wet experiments.
Based on the crystal structure of the target binding site, Cheng et al. [4] constructed maximal affinity model using docking simulations and calculated the maximal affinity values associated with the drug. Campillos et al. [5] used side-effect similarity of drugs to infer the probability of two drug sharing a target. The above two methods could not predict DTIs for targets without known crystal structure or drugs without known side-effects.
To effectively predict DTIs in large scale, a lot of computation models have been introduced. For example, Yamanishi et al. [6] computed drug chemical structure similarities, amino acid sequence similarities of target proteins, and proposed a bipartite graph learning method to predict DTIs by eigenvalue decomposition based on and known drug–target interactions. Based on the same drug structure similarities, sequence similarities of proteins and known drug–target interactions, Bleakley and Yamanishi [7] proposed bipartite local models (BLM) to predict target proteins for a given drug, and the drugs targeting a given protein. Laarhoven et al. [8] proposed Gaussian interaction profile (GIP) kernel method to calculate the similarities between targets (and drugs), and regularized least squares (RLS) was used to predict unknown DTIs. The Kronecker RLS model [9] was proposed based on RLS. However, these methods can not predict DTIs for the drugs or targets if they have no known interactions. In order to compensate the lack of interaction information, based on GIP, Laarhoven and Marchiori [10] proposed a weighted nearest neighbor method to predict DTIs. Mei et al. [11] derived training data from neighbors of new drug (target) candidates, and proposed BLM-NII method by integrating neighbor-based interaction-profile inferring into BLM for DTI predictions.
Instead of utilizing the attributes of drug chemical structure and sequence of target proteins separately, more and more methods integrated multiple features and then built classifiers to make prediction. Wang and Zeng [12] transformed the DTI prediction problem into a two-layer graphical model, used restricted Boltzmann machine to predict diverse types of DTIs, such as direct and indirect interactions. Based on multiple information, random walk with restarts (RWR) was used for DTIs feature extraction on positive-unlabeled learning method [13] and DTINet method [14]. In order to predict large scale DTIs, convolutional neural network (CNN) was applied to to extract drug and target features information [15,16,17,18]. FCS [19] and KGE_NFM [20] were proposed to obtain the low-rank representations for information of multi-omics in DTI prediction. Other information fusion methods including negative sample screening framework [21], SITAR framework [22] and multiple kernels learning [23, 24] were successively proposed. However, the computation complexity of large scale similarity matrices is high.
The known DTIs are usually represented by a drug–target interaction matrix, and matrix factorization method has been widely used in DTI prediction. Matrix factorization is a embedding model that is used to decompose interaction matrix into two feature matrices of low ranks which represents the interactions between drugs and targets as the product of feature matrices. For example, Gönen [25] proposed a kernelized Bayesian matrix factorization with twin kernels method to predict DTIs. The twin kernel matrices were constructed by chemical similarity function of drug compounds and genomic similarity function of target proteins. Combined logistic matrix decomposition with neighborhood regularization [26] and a variational Bayesian multiple kernel logistic matrix factorization method [27] were proposed to infer interactions. MSCMF [28], GRMF [29], \(L_{2,1}\)-GRMF [30], GRGMF [31], HCNMF [32], CHNMF [33] and SRCMF [34] were proposed by means of graph regularization. However, their performances are still not satisfying due to the lost information of these decompose strategies.
To implement matrix factorization, the above methods used either the alternating least squares algorithm [35] or the multiplicative update algorithm [36]. However, there are other efficient algorithms to implement matrix factorization. Hoyer [37] introduced a sparseness measure, and proposed a projected gradient descent algorithm for non-negative matrix factorization with sparseness constraints. Lin [38] proposed an improved projected gradient method for NMF with bound constrains. It has not been proved that the alternating least squares algorithm and the multiplicative update algorithm converge to a stationary point when convergence does occur [39]. Due to the use of a simple geometric rule for the step size, gradient descent methods are very sensitive to the initialization [40] and often produce a poor factorization. To overcome the limitations of the above methods, the alternating direction method (ADM) has attracted attention. To obtain a higher-quality matrix factorization with less computing time, Zhang [39] extended the alternating direction method (ADM) to solve NMF. Based on the above algorithm, Xu et al. [41] devised an improved alternating direction algorithm (ADA) to solve the non-negative matrix factorization-and-completion problem.
The high-dimensional data are in fact sampled from a nonlinear low-dimensional manifold embedded in the high-dimensional space, and according to [42], the model learning performance can be greatly improved if the intrinsic geometrical structure of the manifold have been taken into account. Shang et al. [43] showed that a graph dual regularization helps NMF improve clustering performance since the graph dual regularization considers the underlying geometric structures of both the data manifold and the feature manifold. In this paper, in order to predict DTIs more accurately and quickly, we propose an Alternating Direction Algorithm to solve Graph Regularized non-negative Matrix Factorization with prior knowledge consistency constraint (ADA-GRMFC). The prior knowledge consistency constraint aims to ensure that the decomposition result is consistent with the prior knowledge of known DTIs. The alternating direction algorithm ensures that ADA-GRMFC can converge to KKT point.
Extensive experimental results show that ADA-GRMFC has better performance than other state-of-the-art methods. In case studies involving the drug olanzapine and the target estrogen receptor alpha, all the 10 highest-scoring targets predicted to interact with olanzapine, and 17 of the 20 highest-scoring drugs predicted to interact with estrogen receptor alpha have been validated by wet experiments. The case studies show that, for drugs that do not have any known target proteins and for proteins that are so far not approved as drug targets, ADA-GRMFC also has good prediction performance.
Materials
The experimental data include known drug–target interactions, drug chemical structures and target protein sequences. They were from public databases BRENDA [44], KEGG BRITE [45], SuperTarget [46] and DrugBank [47] and were downloaded from the website: http://web.kuicr.kyoto-u.ac.jp/supp/yoshi/drugtarget/.
The target proteins have the following four types: nuclear receptors (NR), G protein-coupled receptors (GPCR), ion channels (IC) and enzymes (E). Accordingly, the benchmark known drug–target interactions are divided into four datasets NR, GPCR, IC and E. The sizes of the four datasets are different. In the NR dataset, there are 90 known interactions between 54 drugs and 26 nuclear receptors; in the GPCR dataset, there are 635 known interactions between 223 drugs and 95 G protein-coupled receptors; in the IC dataset, there are 1476 known interactions between 210 drugs and 204 ion channels; and in the E dataset, there are 2926 known interactions between 445 drugs and 664 enzymes. The known interactions between n drugs and m proteins are recorded by an \(n \times m\) DTI matrix Z. If the ith drug is approved to target the jth protein, \(Z_{i,j}=1\); otherwise \(Z_{i,j}=0\). The information of the four datasets are shown in Table 1.
The structural similarities between drugs were calculated using SIMCOMP [48] according to the size of the common substructures between two drugs.
An \(n\times n\) matrix \(S^d\) is used to record the similarity information between n drugs. The sequence similarity of the target proteins used the normalized version of the Smith-Waterman score [49]. Let \(p_1\) and \(p_2\) represent two proteins and SW(., .) be the original Smith-Waterman alignment score. The Smith-Waterman score of the normalized version of \(p_1\) and \(p_2\) is \(s({p_1},{p_2}) = \frac{{SW({p_1},{p_2})}}{{\sqrt{SW({p_1},{p_1})} \sqrt{SW({p_2},{p_2})} }}\). An \(m\times m\) matrix \(S^t\) is used to store the similarity information between m target proteins.
Methods
After construction of the DTI matrix Z, the drug similarity matrix \(S^d\) and a target similarity matrix \(S^t\), DTI prediction is transformed into non-negative factorization of the DTI matrix with graph dual regularization terms and a prior knowledge consistency constraint. The graph dual regularization terms are used to integrate the information from the drug similarity matrix and the target similarity matrix, in order to take the intrinsic geometrical structures of the related manifolds into account. Finally, an alternating direction algorithm is used to solve the matrix factorization. Furthermore, we prove the convergence of the algorithm.
Non-negative matrix factorization
In order to obtain low-dimensional feature representations of drugs and targets in the drug–target interaction space, factorization of the DTI matrix is widely adopted. The general form of the matrix factorization is as follows:
where X and Y are the latent feature matrices of drugs and targets respectively, \(X \in {R^{n \times k}}, Y \in {R^{m \times k}}\), and k is the rank of feature vectors of drugs and targets (\(k \ll \min (m,n)\)).
To improve interpretability, the non-negativity constraint of X and Y is usually added. The optimization model of non-negative matrix factorization (NMF) is as follows:
Graph regularized non-negative matrix factorization
NMF aims to well approximate the DTI matrix by finding two low rank matrices, but fail to consider the geometric information in the original data. To integrate the geometric information, Cai et al. [50] proposed graph regularized non-negative matrix factorization (GNMF) which introduces a graph regularization item. The cost function of GNMF is as follows:
where \({\text {Tr}}\) is the trace of a matrix, \(\lambda\) is regularization parameter, W is the weight matrix representing a neighbor graph of the data points, and D is a diagonal matrix such that \({D_{ii}} = \sum \nolimits _l {{W_{il}}}\). The matrix \(D-W\) is called graph Laplacian and denoted by \(\mathcal {L}\) in the following. Furthermore, considering the geometric structure of data manifold and feature manifold, Shang et al. [43] proposed graph dual regularization non-negative matrix factorization (GDNMF), whose cost function is:
From the similarity matrices \(S^d\) and \(S^t\), we could obtain the geometric information of drugs and targets. First we construct two p-nearest neighbor graphs \(N^d\) and \(N^t\) of drugs and targets, respectively.
For two drugs \(d_i\) and \(d_j\), the weight of the edge between vertices i and j in the p-nearest neighbor graph \(N^d\) is defined as follows.
where \(\mathcal {N}_p(i)\) and \(\mathcal {N}_p(j)\) are the sets of p most similar drugs of drugs \(d_i\) and \(d_j\) according to \(S^d\), respectively. \(N^d\) is used to make the drug similarity matrix \(S^d\) sparse as follows.
\({\hat{S}}^d\) is used as the weight matrix representing the drug neighbor graph. The graph Laplacian of \({\hat{S}}^d\) is \({\mathcal {L}_d} = {D^d} - {{\hat{S}}^d}\), where \(D^d\) is a diagonal degree matrix with \(D_{ii}^d = \sum \limits _r {{\hat{S}}_{ir}^d}\).
The same processing is performed on the target similarity matrix \(S^t\) and we calculated out \({\hat{S}}^t\) the weight matrix representing the target neighbor graph as follows.
The graph Laplacian of \({\hat{S}}^t\) is \({\mathcal {L}_t} = {D^t} - {{\hat{S}}^t}\), where \(D^t\) is diagonal degree matrix, \(D_{jj}^t = \sum \limits _q {{\hat{S}}_{jq}^t}\).
Since the normalized graph Laplacian usually performs better in many actual applications, we adopted the following normalized graph Laplacian forms of \(\mathcal {L}_d\) and \(\mathcal {L}_t\).
The graph dual regularization non-negative matrix factorization (GDNMF) for DTI prediction problem is formulated as follows.
where \(\lambda _d\) and \(\lambda _t\) are regularization parameters.
Graph dual regularized non-negative matrix factorization with prior knowledge constraint for DTI prediction
To ensure the matrix decomposition result is consistent with the prior knowledge of known DTIs, we introduce a Prior knowledge Constraint in GDNMF and formulate the DTI prediction problem as the following optimization problem (abbreviated as GRMFC).
where \(\Omega\) indexes the known drug–target interactions, i.e. the elements whose values are 1 in Z. \({\mathrm{\mathscr {P}}_\Omega }(S)\) returns a copy of S that zeros out the elements whose indices are not in \(\Omega\), which is defined as follows.
Since the elements whose values are 1 in Z represent the known validated drug–target interactions, and we introduce the prior knowledge consistency constraint \({\mathrm{\mathscr {P}}_\Omega }(Z - XY^T) = 0\) to ensure that the matrix fraction \(XY^T\) remains the known DTIs and does not lose the prior knowledge.
GRMFC is a non-convex optimization problem, and it is difficult to obtain its accurate solution. Inspired by the iteration algorithm in [41], we used an adapted alternating direction algorithm to obtain a local optimal solution. The alternating direction algorithm (ADA) is an iteration algorithm that alternatively updates X and Y. In order to use ADA to solve GRMFC efficiently, we introduce auxiliary matrices M, U and V, and transform (11) into the following equivalent form.
where \(U \in {R^{n \times k}}\), \(V \in {R^{k \times m}}\). The auxiliary matrix M is regarded as the predicted drug–target interaction matrix.
The augmented Lagrangian of (12) is:
where \(\Lambda\) and \(\Pi\) are Lagrangian multipliers, \(\Lambda \in {R^{n \times k}}\), \(\Pi \in {R^{k \times m}}\), and \(\alpha , \beta > 0\) are penalty parameters.
The alternating direction algorithm successively updates the values of matrices X, Y, M, U and V one at a time, such that \(\mathscr {L}\) reaches the minimum with respect to the updated matrix while the other matrices take their most recent values. The updating rules are as follows.
In closed form, the updating rules are as follows.
where \((\mathscr {P}_{+}(S))_{ij}=max\{S_{ij}, 0\}\), and \(\gamma\) is a step length parameter which is set as 1.618 in the following experiments according to [41].
The iteration process will terminated when the changes of M smaller than a given smaller threshold. The pseudocode of the algorithm (ADA-GRMFC) is shown in Algorithm 1. The proof of convergence of ADA-GRMFC is shown in Additional file 1: Appendix.
![figure a](http://media.springernature.com/lw685/springer-static/image/art%3A10.1186%2Fs12859-022-05119-6/MediaObjects/12859_2022_5119_Figa_HTML.png)
Experiments
The performance of ADA-GRMFC has been tested in the following three aspects. First, ADA-GRMFC was compared with other state-of-the-art algorithms using the four datasets: NR, GPCR, IC and E. Second, we analyzed the effect of graph dual regularization terms on the prediction accuracy of ADA-GRMFC using ablation experiments. Third, we tested ADA-GRMFC using case studies.
To compare performances of DTI prediction algorithms, 5 repetitions of 10-fold cross-validation were performed. The final test results were the averages of the 5 repetitions of 10-fold cross-validation. The cross-validation experiments are conducted under the following two scenarios [9].
-
1.
\(CV_d\): The drugs are divided in ten subsets (folds), each fold is selected in turn as the test dataset and the other remained 9 folds are used as the training dataset. If the ith drug is in the test dataset, the elements in the ith row of Z are all set 0, which means the known interactions with tested drugs are removed from the input DTI matrix. It aims to evaluate the targeted protein prediction performance for the drugs without any known interactive targets.
-
2.
\(CV_t\): The targets are divided in ten subsets (folds), each fold is selected in turn as the test dataset and the other remained 9 folds are used as the training dataset. If the jth target in the test dataset, the elements in the jth column of Z are all set 0, which means the known interactions with tested targets are removed from the input DTI matrix. It aims to evaluate the targeting drug prediction performance for the targets without any known interactive drugs.
The area under receiver operating characteristic curve (AUC) and area under the precision-recall curve (AUPR) are used as performance evaluation metrics in the following experiments.
Comparison with state-of-the-art methods
To demonstrate the effectiveness of ADA-GRMFC in predicting DTIs, we compared ADA-GRMFC with the following seven methods, namely BLM-NII [11], WKNKN [10], RLS-WNN [8], GRMF [29], WGRMF, CMF [28], SRCMF [34], where WGRMF is a weighted form of GRMF.
Parameter settings
For BLM-NII, the combination weight \(\alpha =0.5\). For WKNKN, the parameters \(K=5\), \(\eta =0.7\). According to the original literature of GRMF, WGRMF, CMF and SRCMF, some parameters are automated chosen using grid search [51] based on the AUPR value. Based on a previous research [29], rank k of the matrices X and Y was selected from \(\left\{ {50, 100} \right\}\). For GRMF, WGRMF, CMF and SRCMF, the regularization parameter \(\lambda _l\) was selected from \(\{2^{-2}, 2^{-1}, 2^{0}, 2^{1}\}\). For GRMF, WGRMF and ADA-GRMFC, \(\lambda _d\) and \(\lambda _t\) were selected from \(\{0, 10^{-4}, 10^{-3}, 10^{-2}, 10^{-1}\}\). For CMF and SRCMF, \(\lambda _d\) and \(\lambda _t\) were selected from {\(2^{-3}, 2^{-2}, 2^{-1}, 2^{0}, 2^{1}, 2^{2}, 2^{3}, 2^{4}, 2^{5}\)}.
In terms of ADA-GRMFC, the optimal parameters combination of \(\alpha\), \(\beta\) and \(\gamma\) are different under different experiment scenario, which makes the parameter settings more complicated. When tuning the parameter \(\alpha\), we set other parameters as their optimal values. The same settings were applied to \(\beta\) and \(\gamma\). Figures 1, 2 and 3 in the appendix file showed the impact of the parameter \(\alpha\), \(\beta\) and \(\gamma\) on AUC and AUPR, respectively. When the parameters change, the performances of ADA-GRMFC varied more significantly on NR datasets and GPCR datasets than on IC datasets and E datasets. The results show that the best performance was achieved when \(\alpha = 0.5\), \(\beta =0.01\) and \(\gamma =1.618\). Thus, in the following experiments, for ADA-GRMFC, \(\alpha =0.5\), \(\beta =0.01\), \(\gamma = 1.618\). The parameters \(\epsilon =10^{-6}\).
Prediction results
Under the \(CV_d\) scenario, ADA-GRMFC performs better than other methods in terms of AUC and AUPR on NR, IC, and E datasets. The AUC values of ADA-GRMFC are 0.860748, 0.798762, and 0.834382 on NR, IC, and E datasets, respectively. The AUPR values of ADA-GRMFC are 0.574956, 0.374033, and 0.39878 on NR, IC, and E datasets, respectively. On the GPCR dataset, WGRMF achieve the highest AUC and AUPR values, which are 0.868548 and 0.410652, respectively. The AUC and AUPR values of ADA-GRMFC are higher than those of other algorithms except WGRMF. The AUC and AUPR values of the different algorithms on the four datasets are shown in Tables 2 and 3, respectively. The AUC and AUPR histograms with error bars of different algorithms are shown in Figure 1a, b, respectively. The receiver operating characteristic (ROC) curves and the precision-recall (PR) curves of different methods on the four datasets are shown in Figs. 2 and 3, respectively.
Under the \(CV_t\) scenario, the AUC and AUPR values of ADA-GRMFC are higher than the other methods on the four datasets. The AUC values of ADA-GRMFC are 0.799721, 0.896419, 0.948086, and 0.939765 on NR, GPCR, IC, and E datasets, respectively. The AUPR values of ADA-GRMFC on NR, GPCR, IC, and E datasets are 0.454528, 0.598742, 0.812833, and 0.806995, respectively. The AUC values and AUPR values of different algorithms on the four datasets are shown in Tables 4 and 5, respectively. The AUC and AUPR histograms with error bars of different algorithms are shown in Fig. 4a, b, respectively. ROC and PR curves of different algorithms are shown in Figs. 5 and 6 on the four datasets, respectively.
Ablation experiments
Our model includes two graph dual regularization terms: a regularization term for drugs and regularization term for targets. To evaluate the impact of the graph dual regularization terms on the performance of ADA-GRMFC, we conduct ablation experiments on the benchmark datasets.
In Tables 6, 7, 8 and 9, parameter \(\lambda _d\) and \(\lambda _t\) of ADA-GRMFC are chosen using grid search. ADA-GRMFC with \(\lambda _d=0\) means that the graph regularization term for drugs is not used. ADA-GRMFC with \(\lambda _t=0\) means that the graph regularization terms for targets is not used. When we use regularization terms for drugs and targets, ADA-GRMFC has the highest prediction performance in \(CV_d\) and \(CV_t\). In \(CV_d\), when \(\lambda _d=0\), the values of AUC and AUPR of ADA-GRMFC are significantly decreased. The AUC values have decreased by 23%, 19%, 44%, 36% on NR, GPCR, IC and E datasets, respectively. The AUPR values have decreased by 92%, 87%, 91%, 97% on NR, GPCR, IC and E datasets, respectively. Similarly, in \(CV_t\), if the graph regularization terms for targets is not used, the performances of ADA-GRMFC is significantly decreased too. When \(\lambda _t=0\), the AUC values have decreased by 34%, 33%, 43%, 45% on NR, GPCR, IC and E datasets, respectively. The AUPR values have decreased by 77%, 91%, 95%, 98% on NR, GPCR, IC and E datasets, respectively. These results show that regularization terms for drugs and targets contribute the improvement of DTI prediction performance of ADA-GRMFC significantly.
Case studies
To further evaluate the ability of ADA-GRMFC to find new targets for a drug and new drugs for a target in practice, two case studies concerning the drug olanzapine and the target estrogen receptor alpha were conducted.
In the first case study, we predicted targets that interact with the drug olanzapine on the G protein-coupled receptors (GPCR) dataset using ADA-GRMFC. Olanzapine is an antipsychotic drug which could target many receptors, and it was recently found that olanzapine could be an attractive antiemetic drug [52]. The known interactions of olanzapine with targets were deleted from the the training dataset, and the candidate targets of olanzapine predicted by ADA-GRMFC were prioritized according to the prediction scores. At last, the top 10 highest-scoring predicted targets were picked out to be validated using the databases KEGG [53] and DrugBank [54]. The results showed that all 10 targets were correctly predicted. The detailed results of the predictions are shown in Table 10.
In the second case study, we predicted candidate drugs for the target estrogen receptor alpha (ER\(\alpha\)) on the NR dataset and aimed to assess the ability of ADA-GRMFC to predict candidate drugs for targets with no known targeting drugs. ER\(\alpha\) is mainly expressed in reproductive tissues (uterus, ovaries), breast, kidney, bone, white adipose tissue and liver, and is over-expressed in more than half of breast cancers [55]. The known interactions of ER\(\alpha\) with drugs were removed from the training dataset, and the candidate drugs of ER\(\alpha\) predicted by ADA-GRMFC were prioritized according to the prediction scores. The top 20 highest-scoring predicted drugs were selected to be validated against the databases KEGG and DrugBank. Among the predicted 20 drugs, 17 drugs had evidences to target ER\(\alpha\). The detailed results of the case study are shown in Table 11.
Conclusion
The knowledge of interactions between drugs and targets could help to find the novel usage of drugs. In the paper, we propose a matrix factorization based method, ADA-GRMFC, to predict interactions between drugs and targets. ADA-GRMFC uses graph dual regularization terms to capture structural information from the drug similarity matrix and the target similarity matrix. At the same time, the prior knowledge consistency constraint is used to ensure the matrix decomposition result is consistent with the known DTIs. Finally, an alternating direction algorithm is used to solve the matrix factorization with constraints. Extensive experiments show that ADA-GRMFC outperforms the state-of-the-art methods in predicting DTIs.
The reasons for the superior performance of ADA-GRMFC are as follows. First, unlike traditional matrix factorization algorithms, the prior knowledge consistency constraint ensures that the matrix decomposition result is consistent with the prior knowledge of known DTIs. Second, the graph dual Laplace regular terms not only overcome overfitting of model, but also obtain underlying structural information about the data. Finally, we use alternating direction algorithm with fast convergence to solve the constrained problem.
However, ADA-GRMFC also has limitations. The lack of known drug–target associations may affect the performance of ADA-GRMFC, and including more information related with drugs and targets would help to improve the prediction ability. The values of the parameters of ADA-GRMFC are set by grid search which is time consuming, and appropriate methods to choose optimal parameters need further research.
Availability of data and materials
ADA-GRMFC is implemented in Matlab and freely available to the public on https://github.com/zhang340jj/ADAGRMFC/tree/master.
References
D’Souza S, Prema KV, Balaji S. Machine learning models for drug–target interactions: current knowledge and future directions. Drug Discov Today. 2020;25(4):748–56. https://doi.org/10.1016/j.drudis.2020.03.003.
Maryam B, Elyas S, Kai W, Sartor MA, Zaneta NC, Kayvan N. Machine learning approaches and databases for prediction of drug-target interaction: a survey paper. Brief Bioinform. 2020;22:247–69. https://doi.org/10.1093/bib/bbz157.
Gorgulla C, Boeszoermenyi A, Wang Z-F, Fischer PD, Coote PW, Padmanabha Das KM, Malets YS, Radchenko DS, Moroz YS, Scott DA, Fackeldey K, Hoffmann M, Iavniuk I, Wagner G, Arthanari H. An open-source drug discovery platform enables ultra-large virtual screens. Nature. 2020;580(7805):663–8. https://doi.org/10.1038/s41586-020-2117-z.
Cheng AC, Coleman RG, Smyth KT, Cao Q, Soulard P, Caffrey DR, Salzberg AC, Huang ES. Structure-based maximal affinity model predicts small-molecule druggability. Nat Biotechnol. 2007;25(1):71–5.
Campillos M, Kuhn M, Gavin A-C, Jensen LJ, Bork P. Drug target identification using side-effect similarity. Science. 2008;321(5886):263–6.
Yoshihiro Y, Michihiro A, Alex G, Wataru H, Minoru K. Prediction of drug-target interaction networks from the integration of chemical and genomic spaces. Bioinformatics. 2008;24(13):232–40. https://doi.org/10.1093/bioinformatics/btn162.
Bleakley K, Yamanishi Y. Supervised prediction of drug–target interactions using bipartite local models. Bioinformatics. 2009;25(18):2397–403. https://doi.org/10.1093/bioinformatics/btp433.
Twan VL, Nabuurs SB, Elena M. Gaussian interaction profile kernels for predicting drug–target interaction. Bioinformatics. 2011;21:3036.
Pahikkala T, Airola A, Pietila S, Shakyawar S, Szwajda A, Tang J, Aittokallio T. Toward more realistic drug–target interaction predictions. Brief Bioinform. 2015;16(2):325–37. https://doi.org/10.1093/bib/bbu010.
Twan VL, Elena M, Peter C. Predicting drug–target interactions for new drug compounds using a weighted nearest neighbor profile. PLoS ONE. 2013;8(6):66952.
Mei JP, Kwoh CK, Yang P, Li XL, Zheng J. Drug–target interaction prediction by learning from local information and neighbors. Bioinformatics. 2013;29(2):238–45. https://doi.org/10.1093/bioinformatics/bts670.
Wang YH, Zeng JY. Predicting drug–target interactions using restricted Boltzmann machines. Bioinformatics. 2013;29(13):126–34. https://doi.org/10.1093/bioinformatics/btt234.
Lan W, Wang J, Li M, Liu J, Li Y, Wu F-X, Pan Y. Predicting drug–target interaction using positive-unlabeled learning. Neurocomputing. 2016;206:50–7. https://doi.org/10.1016/j.neucom.2016.03.080.
Luo Y, Zhao X, Zhou J, Yang J, Zhang Y, Kuang W, Peng J, Chen L, Zeng J. A network integration approach for drug–target interaction prediction and computational drug repositioning from heterogeneous information. Nat Commun. 2017;8(1):1–13.
Rifaioglu AS, Atalay V, Martin M, Cetin-Atalay R. Tunca: Deepscreen: high performance drug–target interaction prediction with convolutional neural networks using 2-d structural compound representations. Chem Sci. 2020;11:2531–57.
Nguyen T, Le H, Quinn TP, Nguyen T, Le TD, Venkatesh S. Graphdta: predicting drug–target binding affinity with graph neural networks. Bioinformatics. 2020;37(8):1140–7. https://doi.org/10.1093/bioinformatics/btaa921.
Liu Z, Chen Q, Lan W, Pan H, Hao X, Pan S. Gadti: graph autoencoder approach for DTI prediction from heterogeneous network. Front Genet. 2021;12: 650821. https://doi.org/10.3389/fgene.2021.650821.
Yazdani-Jahromi M, Yousefi N, Tayebi A, Kolanthai E, Neal CJ, Seal S, Garibay OO. Attentionsitedti: an interpretable graph-based model for drug–target interaction prediction using NLP sentence-level relation classification. Brief Bioinform. 2022. https://doi.org/10.1093/bib/bbac272.
Huang K, Xiao C, Glass LM, Sun J. Moltrans: molecular interaction transformer for drug–target interaction prediction. Bioinformatics. 2020;37(6):830–6. https://doi.org/10.1093/bioinformatics/btaa880.
Ye Q, Hsieh C-Y, Yang Z, Kang Y, Chen J, Cao D, He S, Hou T. A unified drug–target interaction prediction framework based on knowledge graph and recommendation system. Nat Commun. 2021;12(1):6775. https://doi.org/10.1038/s41467-021-27137-3.
Liu H, Sun J, Guan J, Zheng J, Zhou S. Improving compound–protein interaction prediction by building up highly credible negative samples. Bioinformatics. 2015;31(12):221–9. https://doi.org/10.1093/bioinformatics/btv256.
Perlman L, Gottlieb A, Atias N, Ruppin E, Sharan R. Combining drug and gene similarity measures for drug–target elucidation. J Comput Biol. 2011;18(2):133–45. https://doi.org/10.1089/cmb.2010.0213.
Ding Y, Tang J, Guo F. Identification of drug–target interactions via fuzzy bipartite local model. Neural Comput Appl. 2020;32(14):10303–19. https://doi.org/10.1007/s00521-019-04569-z.
Ding Y, Tang J, Guo F. Identification of drug–target interactions via dual Laplacian regularized least squares with multiple kernel fusion. Knowl Based Syst. 2020;204: 106254. https://doi.org/10.1016/j.knosys.2020.106254.
Gönen M. Predicting drug–target interactions from chemical and genomic kernels using Bayesian matrix factorization. Bioinformatics. 2012;28(18):2304–10. https://doi.org/10.1093/bioinformatics/bts360.
Liu Y, Wu M, Miao C, Zhao P, Li X-L. Neighborhood regularized logistic matrix factorization for drug–target interaction prediction. PLoS Comput Biol. 2016;12(2):1004760. https://doi.org/10.1371/journal.pcbi.1004760.
Bolgár B, Antal P. VB-MK-LMF: fusion of drugs, targets and interactions using variational Bayesian multiple kernel logistic matrix factorization. BMC Bioinform. 2017;18(1):440. https://doi.org/10.1186/s12859-017-1845-z.
Zheng X, Ding H, Mamitsuka H, Zhu S. Collaborative matrix factorization with multiple similarities for predicting drug–target interactions. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining. 2013. p. 1025–1033.
Ezzat A, Zhao P, Wu M, Li X, Kwoh CK. Drug–target interaction prediction with graph regularized matrix factorization. IEEE/ACM Trans Comput Biol Bioinform(TCBB). 2016;14(3):646–656.
Cui Z, Gao YL, Liu JX, Dai LY, Yuan SS. L2,1-GRMF: an improved graph regularized matrix factorization method to predict drug–target interactions. BMC Bioinform. 2019;20(Suppl 8):1–13.
Zhang Z-C, Zhang X-F, Wu M, Ou-Yang L, Zhao X-M, Li X-L. A graph regularized generalized matrix factorization model for predicting links in biomedical bipartite networks. Bioinformatics. 2020;36(11):3474–81. https://doi.org/10.1093/bioinformatics/btaa157.
Jiao CN, Gao YL, Yu N, Liu JX, Qi LY. Hyper-graph regularized constrained NMF for selecting differentially expressed genes and tumor classification. IEEE J Biomed Health Inform. 2020;24(10):3002–11. https://doi.org/10.1109/jbhi.2020.2975199.
Yu N, Wu MJ, Liu JX, Zheng CH, Xu Y. Correntropy-based hypergraph regularized NMF for clustering and feature selection on multi-cancer integrated data. IEEE Trans Cybern. 2021;51(8):3952–63. https://doi.org/10.1109/tcyb.2020.3000799.
Gao L-G, Yang M-Y, Wang J-X. Collaborative matrix factorization with soft regularization for drug–target interaction prediction. J Comput Sci Technol. 2021;36(2):310–22. https://doi.org/10.1007/s11390-021-0844-8.
Takane Y, Young FW, de Leeuw J. Nonmetric individual differences multidimensional scaling: an alternating least squares method with optimal scaling features. Psychometrika. 1977;42(1):7–67. https://doi.org/10.1007/BF02293745.
Seung D, Lee L. Algorithms for non-negative matrix factorization. Adv Neural Inf Process Syst. 2001;13:556–62.
Hoyer PO. Nonnegative matrix factorization with sparseness constraints. J Mach Learn Res. 2004;5(9):1457–69.
Lin C-J. Projected gradient methods for nonnegative matrix factorization. Neural Comput. 2007;19(10):2756–79.
Zhang Y. An alternating direction algorithm for nonnegative matrix factorization. Technical report. 2010.
Berry MW, Browne M, Langville AN, Pauca VP, Plemmons RJ. Algorithms and applications for approximate nonnegative matrix factorization. Comput Stat Data Anal. 2007;52(1):155–73.
Xu YY, Yin WT, Wen ZW, Zhang Y. An alternating direction algorithm for matrix completion with nonnegative factors. Front Math China. 2012;7(2):365–84. https://doi.org/10.1007/s11464-012-0194-5.
Wang Y, Zhang Y. Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng. 2013;25(6):1336–53. https://doi.org/10.1109/TKDE.2012.51.
Shang FH, Jiao LC, Wang F. Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recogn. 2012;45(6):2237–50. https://doi.org/10.1016/j.patcog.2011.12.015.
Schomburg I, Chang A, Ebeling C, Gremse M, Heldt C, Huhn G, Schomburg D. Brenda, the enzyme database: updates and major new developments. Nucleic Acids Res. 2004;32(suppl1):431–3.
Kanehisa M, Goto S, Hattori M, Aoki-Kinoshita KF, Itoh M, Kawashima S, Katayama T, Araki M, Hirakawa M. From genomics to chemical genomics: new developments in KEGG. Nucleic Acids Res. 2006;34(Database issue):354–7.
Günther S, Kuhn M, Dunkel M, Campillos M, Senger C, Petsalaki E, Ahmed J, Urdiales EG, Gewiess A, Jensen LJ, Schneider R, Skoblo R, Russell RB, Bourne PE, Bork P, Preissner R. Supertarget and matador: resources for exploring drug–target relationships. Nucleic Acids Res. 2007;36(suppl1):919–22. https://doi.org/10.1093/nar/gkm862.
Wishart DS, Knox C, Guo AC, Cheng D, Shrivastava S, Tzur D, Gautam B, Hassanali M. Drugbank: a knowledgebase for drugs, drug actions and drug targets. Nucleic Acids Res. 2007;36(suppl1):901–6. https://doi.org/10.1093/nar/gkm958.
Hattori M, Okuno Y, Goto S, Kanehisa M. Development of a chemical structure comparison method for integrated analysis of chemical and genomic information in the metabolic pathways. J Am Chem Soc. 2003;125(39):11853–65. https://doi.org/10.1021/ja036030u.
Smith T, Waterman M. Identification of common molecular subsequences. J Mol Biol. 1981;147:195–7. https://doi.org/10.1016/0022-2836(81)90087-5.
Cai D, He X, Han J, Huang TS. Graph regularized non-negative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell. 2011;33(8):1548–60.
Bergstra J, Bengio Y. Random search for hyper-parameter optimization. J Mach Learn Res. 2012;13(2):281–305.
Brafford MV, Glode A. Olanzapine: an antiemetic option for chemotherapy-induced nausea and vomiting. J Adv Pract Oncol. 2014;5(1):24.
Kanehisa M, Furumichi M, Tanabe M, Sato Y, Morishima K. KEGG: new perspectives on genomes, pathways, diseases and drugs. Nucleic Acids Res. 2017;45(D1):353–61. https://doi.org/10.1093/nar/gkw1092.
Law V, Knox C, Djoumbou Y, Jewison T, Guo AC, Liu Y, Maciejewski A, Arndt D, Wilson M, Neveu V, Tang A, Gabriel G, Ly C, Adamjee S, Dame ZT, Han B, Zhou Y, Wishart DS. Drugbank 4.0: shedding new light on drug metabolism. Nucleic Acids Res. 2014;42(Database issue):1091–7. https://doi.org/10.1093/nar/gkt1068.
Ali S, Coombes RC. Estrogen receptor alpha in human breast cancer: occurrence and significance. J Mammary Gland Biol Neoplasia. 2000;5(3):271–81.
Acknowledgements
Not applicable.
Funding
This work was supported by the National Natural Science Foundation of China under Grant 62172028 and Grant 61772197.
Author information
Authors and Affiliations
Contributions
J.Z. and M.X. designed the model, algorithm and experiments, and wrote the paper. J.Z. implemented the algorithm and conducted the experiments. All authors have reviewed the paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Convergence of ADA-GRMFC.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Zhang, J., Xie, M. Graph regularized non-negative matrix factorization with prior knowledge consistency constraint for drug–target interactions prediction. BMC Bioinformatics 23, 564 (2022). https://doi.org/10.1186/s12859-022-05119-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12859-022-05119-6