Background

Identification of ligand-protein binding sites is a key step to annotate the protein functions and find applications in drug design. Since physical experimental methods are expensive and time consuming, computational methods are indispensable for guiding the physical experimental analysis.

So far, several computational methods have been proposed for identifying protein functional sites [117]. These methods can be categorized into three groups: 1) approaches that focus on molecular docking with known protein structures [15]; 2) methods that predict putative interacting sites based on protein sequences [617]; 3) methods that identify interacting sites based on the hybrid features of protein structure and sequences [15]. Due to the structures of most proteins are not available, the structure-based methods cannot be generally used. Here, we focus on the sequence-based methods of ligand-binding sites prediction. The inputs of previous sequence-based methods also can be categorized into three groups: (i) direct output of PSSM [610]; (ii) combination of PSSM with other sequence features, including amino acid distance and physicochemical prosperity [11] ; (iii) combination of PSSM with other predicted structural information, such as predicted secondary structure [12, 16, 17], predicted solvent accessibility [12, 16, 17], predicted disorder probabilities [16, 17], predicted dihedral angles [16] and predicted B-factors. Of course, analyzing the various features of the binding partner is important for understanding the ligand-binding behavior. However, incorporating many other features, especially some predicted feature as input for binding sites prediction has some potential shortcomings: 1) multi-features easily result in high-dimensional feature space. In machine learning, if the training samples are limited, high-dimensional feature space easily leads to over fitting to noise data and then cause a degradation in performance; 2) incorporating predicted results from other predictors greatly increases the complexity of the algorithm. Many studies even provided no Web services because of the complexity in their design; 3) the performance of the predictors which employed other predicted results are also largely affected by other classifiers. Thus, more simple and high efficient method for identifying interacting residues is indispensable.

Evolutionary information included in PSSM has been considered to be the most effective feature for functional site predication. Nearly all the sequence-based methods adopted PSSM as an input feature for prediction. Raghava’s group has used the standard PSSMs for various functional sites predication [710]. John A. C. et al. [13] also found that conservation features was highly predictive in identifying ligand-binding sites and catalytic sites compared to identify other functional site. Ke Chen et al. [18] proved that the exclusion of PSSM profile leads to a larger decrease in prediction performance than the exclusion of other input features, which suggests that the evolutionary information plays a key role in determination of the nucleotide-binding residues.

Here, we developed a novel sequence-based predictor for ATP-binding sites prediction. In our approach, only the high local evolutionary conservation scores in the PSSMs are considered as input. We employed no other predicted results as input features. Our method is based on the assumptions that: 1) the most effective features for predicting functional sites are embedded in the sequence itself; 2) the local evolutionary conservation is distinct enough to enable an accurate prediction of ATP-binding sites directly from amino acid sequence, without requiring any additional predicted structural information. In order to assess the predictive quality, we compared our method with 9 other existing methods which adopted various predicted structural features. The Support Vector Machine (SVM) was adopted to build the classifiers.

Methods

Benchmark datasets

We took ATP as an example of ligands. For facilitating comparison, we collected 2 data sets from the existing papers [10, 16, 17].

Dataset 1: It is extracted from the reference [10], which was also used in the reference [17]. This data set includes 168 ATP-binding protein chains, that contain 3,104 ATP-interacting residues (AIRs) and 59,226 non-ATP interacting residues (non-AIRs), named as ATP168. It is available at http://www.imtech.res.in/raghava/atpint/.

Dataset 2: It is extracted from the reference [16], which was also used in the reference [17]. This data set includes 227 ATP-binding protein chains that contain 3,393 AIRs and 80,409 non-AIRs, named as ATP227. It is available at http://biomine.ece.ualberta.ca/ATPsite/.

Continuous binding residues analysis

In order to conform whether ATP-binding sites are clustered closely together in sequence, the 168 ATP-binding protein chains in Dataset 1 were analyzed as example. As shown in Figure 1, 68% of binding-sites appear alone, 22% of them appear in two consecutive residues, and the others appear continuously with lengths distribution between 3 to 5 residues. This result suggests that, the ATP-binding sites have certain independence, and meanwhile are affected by their flanking regions to some extent.

Figure 1
figure 1

Statistics of continuous ATP-binding residues.

Composition and physicochemical properties analysis

We next analyzed the composition and physicochemical properties of the ATP-binding proteins. Sequences were divided into 3 regions: the ATP-interacting residues (AIRs), regions flanking the AIRs, and general non-ATP interacting regions (non-AIRs). Regions flanking on either side of the interacting sites with 15-residue long were analyzed.

Difference between the flanking regions and general non-AIRs regions (percentage of flanking - percentage of non_AIRs) with respect to 20 amino acids composition is shown in Figure 2. The Pearson product-moment correlation coefficients between the flanking length and the composition difference for each amino acid were also calculated (Table 1 for the left flanking side and Table 2 for the right flanking side). For both the flanking regions, the correlation coefficients related to Leu, Gly, Glu, Gln, Ser, and Thr have absolute value > 0.69 at the p-value <0.001. It illustrates that, composition of these amino acids in the flanking regions and in the general non-binding regions is significantly different.

Figure 2
figure 2

Differences with respect to amino acids composition between AIRs and non-AIRs. The values at position 0 on the horizontal axis mean the values for AIRs, L means the left flanking side and R means the right flanking side.

Table 1 Correlation coefficients between the left flanking length and composition difference (left ATP_flanking – non_ATP) for each amino acid
Table 2 Correlation coefficients between the right flanking length and composition difference (right ATP_flanking – non_ATP) for each amino acid

Difference between the flanking regions and general non-AIRs regions with respect to 10 physicochemical properties is shown in Figure 3. The corresponding Pearson correlation coefficients between the flanking length and each physicochemical property difference are shown in Table 3 (for the left flanking side) and Table 4 (for the right flanking side). For the left flanking side, correlation coefficients related to small, tiny, negative and charged have absolute value > 0.60 at the p-value < 0.001; for the right flanking side, correlation coefficients related to small, tiny and aliphatic have absolute value > 0.73 at the p-value < 0.001. This phenomenon illustrates that, these physicochemical properties of flanking regions are very different from those of general non-AIRs regions.

Figure 3
figure 3

Differences in physicochemical properties between AIRs and non-AIRs. The values at position 0 on the horizontal axis mean the values for the AIRs, L means the left flanking side and R means the right flanking side.

Table 3 Correlation coefficients between the left flanking length and each physicochemical property difference (left ATP_flanking - non-ATP)
Table 4 Correlation coefficients between the right flanking length and each physicochemical property difference (right ATP_flanking - non-ATP)

The above analyses of the composition and physicochemical properties for the three regions illustrated that flanking regions are highly relevant to the ATP-binding sites. Therefore, we assumed that the ATP-binding sites in protein sequences are highly contextual. Because ATP-binding sites are found to be more conserved than surrounding residues [710, 13, 18], we considered incorporating contextual information of residues with local evolutionary conservation to improve the prediction of ATP-binding sites.

Prediction model

Our approach focuses on using high local evolutionary conservation scores in the PSSMs for prediction. The prediction model is shown in Figure 4.

Figure 4
figure 4

Prediction model. The length of sliding window is represented by 2 h+1, n is the length of sequence, and v i represents the corresponding amino acids i in the feature vector.

Evolutionary information (PSSM)

Evolutionary information was obtained from PSSMs generated by PSI-BLAST [19] with searching against NCBI non-redundant (nr) database [20] by three times iteration with an e-value of 0.001. Evolutionary information for each amino acid was encapsulated in a vector of 20 dimensions. The size of PSSM of a protein with N residues is 20 × N, where N is the length of a protein. 20 dimensions were considered as a standard amino acid size.

Masking and filtering the PSSM

The modified PSSM is used to describe the local evolutionary information of each residue in a protein. It is converted from a standard PSSM according to formula (1) and (2).

Firstly, a masking sliding window with appropriate size is used to calculate the mean conservation score for each residue in a standard PSSM, and then, scores in PSSM are converted to local conservation scores according to formula (1). After that, the local conservation scores below the average scores are changed to 0 according to formula (2). This can strengthen the high conservative information while filtering out the low ones.

Masking _ C i = C i 1 2 n + 1 i n i + n C j
(1)
Filtering _ C i = Masking _ C i , Masking _ C i > 0 0 , Masking _ C i 0
(2)

Masking _C i is the mean conservation score of residue i, C i is the standard conservation score in PSSM, 2n+1 is the masking window size. Figure 5 illustrates an example of a masked and filtered PSSM.

Figure 5
figure 5

Procedure of preparing feature sets for the predictor.

Smoothing the modified PSSM

Every value in a standard PSSM is calculated based on the assumption that the position of each value in the matrix is independent from the others. However, ligand-binding residues tend to appear continuously. The flanking regions also largely affect the binding behavior. In order to incorporate the dependency on surrounding neighbors of a central residue, we adopt the same smoothing method as Cheng-Wei C’s group [21], firstly, in order to deal with the N-terminal and C-terminal of a protein sequence, m (m is an odd number) ZERO vectors are appended to the head and the tail of a standard PSSM profile, where 2 m+1 is the size of a smoothing sliding-window. Then the smoothing sliding-window is used to incorporate the evolutionary information from upstream and downstream residues. Each row vector of an amino acid residue Ci is smoothed according to formula (3).

Smoothing _ C i = i m i + m Filtering _ C j
(3)

Finally, each value in the smoothed PSSM matrix is scaled to the range of [-1, 1] according to a certain ratio. Procedure of preparing feature sets for the predictor is shown in Figure 5.

Support vector machines (SVM) and 5-fold cross-validation

Identification of ATP-binding sites can be addressed as a two-classification problem, i.e., determining whether a given residue is binding residue or not. In this study, like the other researches, we adopted SVM to build the binary classifier. The prediction models were trained by the libSVM software package which was written by in Chih-Jen [22, 23]. Here, the Radial Basis Function (RBF kernel) was adopted to construct the SVM classifiers. The grid search method [22, 23] was used to search for the best parameters c and g for training. The negative samples were selected randomly with an equal number of positive samples. 5-fold cross-validation was used to evaluate the performance of the developed models, that is, the patterns were randomly divided into five sets. Four sets were used for training and the remaining one set was used for testing. The process was repeated until each set was used once for testing.

Evaluation criteria

We adopted the evaluation criteria used in CASP10 [24]. The area under the corresponding ROC curve (AUC), MCC, and the accuracy (ACC) were adopted to evaluate the performance of the classifiers. The ROC plots with the AUC values were created by using the R statistical package [25]. The sensitivity, specificity, true positive rate (TPR), false negative rate (FPR) and ACC are defined as follows:

Specifity = TN TN + FP
(4)
TPR = Sensitivity = TP TP + FN
(5)
FPR = 1 Specificity = FP TN + FP
(6)
ACC = 1 2 Sensitivity + Specificity
(7)

Where TP, TN, FP and FN represents true positive, true negative, false positive and false negative respectively.

Results and discussion

Window sizes

For developing the CLCLpred model, 3 window sizes are necessary; the masking-window size which is used to calculate average local conservation scores, the outside sliding-window size which would finally decide the dimensions of feature vectors, and the inside smoothing-window size which is used to strengthen the local conservation features. Here, for a fair comparison, we chose the same size 17 with the researches [10, 16, 17] as the outside-sliding window size. The masking-window size has the similar meaning with the outside sliding-window size. Both of them indicate the length of flanking regions that would be considered to affect a central residue. So, 17 was also adopted as our masking window size. With an outside sliding-window and a masking-window size of 17, the CLCLpred model was further tested according to different smoothing window sizes. The relative best ROC plots would be chosen to represent the performance of the related models.

Effectiveness of the feature extracting methods

  • Effectiveness at the individual protein level

    To confirm the effectiveness of our feature extracting method in distinguishing AIRs from non-AIRs and to determine how this might benefit the predication, we selected the protein [PDB: 2B6F] as an example. It has a continuous ATP-binding region of “G-G-C-H-R” located at residues 81~ 85 in the A chain.

    Because the binding region “G-G-C-H-R” contains two residues of ‘G’, we extracted the ‘G’ column of position-specific scores from the standard PSSM (there are a total of 20 columns, corresponding to the 20 standard amino acids). Then, the distribution of the scores in the standard PSSM, masked PSSM, and smoothed PSSM were counted (Figure 6). In the standard PSSM, the distribution of scores between the AIRs and non-AIRs showed no distinct difference. The AIR region contains both highly conserved residues (‘G’) and highly variable residues (other amino acids). In the masked PSSM, scores below the average have been filtered out, thereby discarding the noise data (low conservative scores), that are undesirable for prediction. In the smoothed PSSM, scores of residues that are surrounded by conserved residues have been enhanced after smoothing, and scores of residues that are surrounded by poorly conserved residues have been weakened. Since AIRs are found to be more conserved than surrounding residues and flanked by less conserved residues [710, 13, 18], they are easy to appear as highly conserved peaks compared to the non-AIR regions. We have shown the results for just the ‘G’ column, similar results were obtained for ‘C’, ‘H’ and ‘R’ columns of the PSSM (data not shown).

    Figure 6
    figure 6

    Distribution of conservation scores for protein 2B6F (PDB ID) related to the three steps. (A) distribution of scores in the standard PSSM, (B) distribution of scores in the masked and filtered PSSM, and (C) distribution of scores in the smoothed PSSM. The red dotted rectangles mark the position of ATP-binding residues (only residues 51~121 in the A chain are displayed).

  • Effectiveness at the whole dataset level.

    We next analyzed the distributions of local conservation scores for all residues in the data set ATP168 in three stages: in the standard PSSM, after masked and filtered, and after smoothed. We assumed that the summation of scores in each row in the corresponding PSSM represented the local conservation of the related residues C i . Then the local conservation score in each stage is able to be calculated according to formula (8~10).

Distribution of summation score related to The AIRs and non-AIRs was compared (Figure 7). In the standard PSSM, more non-AIRs showed stronger conservation than the AIRs. However, that, after filtered, the percentage of the AIRs with high local conservation scores increased significantly (Figure 7(B)). This can illustrate that, most of filtered out scores were belonging to the non-AIRs. Finally, after smoothed, more AIRs showed stronger local conservation than the non-AIRs (Figure 7(C)). Unsurprisingly, most of the AIRs and their flanking residues have stronger local conservation than the general non-AIRs. Because in order to maintain certain function, the functional sites of proteins must maintain a high degree of conservation. Figure 7 shows that, our feature extracting method can effectively extract the local conservation information of residues to distinguish the AIRs from non-AIRs.

Figure 7
figure 7

Distribution of the summation scores of AIRs and non-AIRs related to the three steps. (A) distribution of the summation scores in the standard PSSM (B) distribution of the summation scores in the masked and filtered PSSM, and (C) distribution of the summation scores in the smoothed PSSM.

Performance of the CLCLpred and comparison with other PSSM-based methods

ROC plots of the CLCLpred method apply to the ATP168 and ATP227 with different masking window sizes are shown in Figure 8. The respective best plots are shown in Figure 9.

Figure 8
figure 8

ROC plots of CLCLpred with different smoothing window sizes applied on ATP168 (A) and ATP227 (B) (W indicates the flanking window length).

Figure 9
figure 9

The best ROC plot of the CLCLpred method tested on ATP168 (A) and ATP227 (B).

Performance comparison with other PSSM-based methods

In order to verify the importance of revising PSSM to match the detailed conservation pattern of ATP-binding sites, we have compared the CLCLpred method with three other PSSM-based methods on the ATP168 dataset: 1) the ‘PSSM’ method, which uses the direct output of PSSMs for prediction; 2) the ‘Smooth_PSSM’ method, which uses smoothed PSSMs without masking and filtering; and 3) the ‘Mask_PSSM’ method, which uses masked and filtered PSSMs without smoothing. Performances of the four methods are shown in Table 5, and the ROC plots of them are shown in Figure 10. The results demonstrate that, although all the four methods are based on PSSM of sequence, the CLCLpred method achieves the best performance.

Table 5 Performance comparison with other three PSSM-based methods on ATP168
Figure 10
figure 10

ROC plots of the four PSSM-based methods verified on ATP168.

Sum _ Masking _ C i = j = 1 20 Masking _ C j
(8)
Sum _ Filtering _ C i = j = 1 20 Filtering _ C j
(9)
Sum _ Smoothing _ C i = j = 1 20 Smoothing _ C j
(10)

We speculate that the reasons for the above results include: 1) the direct outputs of PSSMs contain redundant features, because the ‘Mask_PSSM’ method which filters out the low local conservation scores achieves nearly the same performance with the ‘PSSM’ method; 2) ATP-binding sites in protein sequences are highly contextual, and incorporating the conservation information from sequentially neighboring residues results in improved performance. As can be seen from Figure 10, the methods with the smoothing step (‘Smooth_PSSM’ and CLCLpred) significantly outperform the methods without the smoothing step (‘Mask_PSSM’ and ‘PSSM’); and 3) although the ATP-binding sites are affected by neighboring residues, they maintain a certain degree of independence (Figure 1 also shows that 68% of binding-sites appear alone). This kind of functional site with their flanking regions usually contains both highly conserved residues and highly variable residues and is highly locally conserved on the whole. Without the masking and filtering steps, the predictive power of highly conserved residues will be weakened by noise data (low conservation scores from the neighboring residues) after smoothing. On the contrary, if the noise data are discarded by masking and filtering, the predictive power of intensively highly conserved residues will be strengthened after smoothing. Therefore, the CLCLpred method outperformed the ‘Smooth_PSSM’ method. The above results also confirmed the previous analysis [13] that, better exploiting the signal from sequentially neighboring residues would largely facilitate ligand-binding sites prediction.

Performance comparison with other existing predictors

Since we have extracted the data set ATP168 and ATP227 from the research papers [10, 16, 17], here, we also listed them out for the comparison. All the methods were trained and tested on the same data sets. Results are shown in Table 6. Detailed comparison of ACC and AUC among all the methods on ATP168 and ATP227 are shown in Figures 11 and 12 respectively. As shown in Table 6, Figures 11 and 12, the CLCLpred predictor achieved the best ACC and AUC.

Table 6 Performance of CLCLpred and the existing predictors tested on the ATP168 and ATP227
Figure 11
figure 11

Detailed comparison of ACC and AUC for all the predictors on ATP168.

Figure 12
figure 12

Detailed comparisons of ACC and AUC for all the predictors on ATP227.

Feature dimensions comparison

Previous researches [10, 16, 17] combined many predicted features with PSSM as their input for the ATP-binding prediction. These predicted features not only increased the complexity of the algorithm, but also increased the dimensions of feature vectors. We summarized them in Table 7 for a comparison. Table 7 demonstrates that, the vector dimension of CLCLpred is lower than those of the methods which incorporated other predicted features, such as predicted secondary structure (ss), predicted solvent accessibility (sa), predicted disorder probabilities (dis) and predicted dihedral angle. In machine leaning, if the number of training samples is limited, increasing the feature dimensions will be harmful for the classification.

Table 7 Summarization of feature types and number of vector dimensions

Conclusions

In this study, we proposed a simple method which adopted a modified PSSM encoding scheme for ATP-binding predication. In this approach, only the high local evolutionary conservation scores in PSSMs are considered as input, without employing any predicted features from other classifiers. By means of masking, filtering and smoothing, the modified PSSM combines predictive features which can distinguish the AIRs from non-AIRs effectively. When comparing with 10 other existing methods that used direct output of PSSMs or incorporated various predicted structural features as their input on the same datasets, our method achieved the best performance besides its minimum feature dimensions, i.e., achieving an ACC of 4.9%~16.1% and an AUC of 0.036~0.169 higher than other methods when tested on ATP168; achieving an ACC of 2.6%~17.0% and an AUC of 0.018~0.15 higher than other methods when tested on ATP227. These results demonstrate that, the local evolutionary conservation is distinct enough to enable an accurate prediction of ATP-binding sites directly from amino acid sequence, and incorporating other predicted features for prediction is not always helpful. A free Web server has been developed (http://webapp.yama.info.waseda.ac.jp/fang/LigandPred.php), which allows users to identify ATP-binding residues in a given sequence using the model trained on our data sets. Our CLCLpred model can be also used for identifying other ligand-binding sites of proteins.