# Prediction of settled water turbidity and optimal coagulant dosage in drinking water treatment plant using a hybrid model of *k*-means clustering and adaptive neuro-fuzzy inference system

- 1.1k Downloads

## Abstract

Coagulation is an important process in drinking water treatment to attain acceptable treated water quality. However, the determination of coagulant dosage is still a challenging task for operators, because coagulation is nonlinear and complicated process. Feedback control to achieve the desired treated water quality is difficult due to lengthy process time. In this research, a hybrid of *k*-means clustering and adaptive neuro-fuzzy inference system (*k*-means-ANFIS) is proposed for the settled water turbidity prediction and the optimal coagulant dosage determination using full-scale historical data. To build a well-adaptive model to different process states from influent water, raw water quality data are classified into four clusters according to its properties by a *k*-means clustering technique. The sub-models are developed individually on the basis of each clustered data set. Results reveal that the sub-models constructed by a hybrid *k*-means-ANFIS perform better than not only a single ANFIS model, but also seasonal models by artificial neural network (ANN). The finally completed model consisting of sub-models shows more accurate and consistent prediction ability than a single model of ANFIS and a single model of ANN based on all five evaluation indices. Therefore, the hybrid model of *k*-means-ANFIS can be employed as a robust tool for managing both treated water quality and production costs simultaneously.

## Keywords

*k*-means clustering Adaptive neuro-fuzzy inference system Artificial neural network Coagulant dosage Water quality Modeling

## Introduction

Drinking water industry has been confronted with two aspects of strict water quality standards and reduction of production cost. Coagulation is an important process, and directly related to production cost and quality in drinking water treatment plant (WTP). The coagulation is a nonlinear and complicated process, because many physical and chemical variables influence the process. Conventionally, the determination of coagulant dosage in drinking WTP is carried out by experienced operators. However, although the operators determine coagulant dosage according to current quality of the raw water and the settled water, the dosage is still not necessarily optimal, because the operators cannot handle the errors which will occur after several hours (Zhang and Stanley 1999). Therefore, it is necessary to develop decision support models that are able to predict the treated water quality and the required coagulant dosage.

The models can be considered as process and inverse process of coagulation. In general, a process model is used to predict the treated water quality by process inputs, such as raw water quality and coagulant dosage. This model can be used to determine coagulant dosage by trial and error and can be used to understand factors which affect the process for process analysis and for new operators’ training (Baxter et al. 2001b). In addition, the process model can be used to assess in real time the adequacy of coagulant dosage based on the operator’s experience. Thus, the model can contribute to ensure the stability of operation. On the contrary, an inverse process model is used to predict coagulant dosage using the treated water quality and the raw water quality. Therefore, the inverse process model can be used to predict directly the optimal coagulant dosage based on the raw water quality and the desired treated water quality.

In recent years, a variety of artificial intelligence (AI) techniques, such as neural networks and fuzzy inference systems, have been used in modeling of complex nonlinear water treatment processes. The use of artificial neural networks (ANN) has obtained popularity in modeling of coagulation process in WTP (Gagnon et al. 1997; Robenson et al. 2009; Kennedy et al. 2015). ANNs have a great potential for representing nonlinear complex processes without structural knowledge of the processes. In the previous researches, ANNs were applied to develop process and inverse process models for coagulation to assist operators to determine coagulant dosage and to optimize the process. Baxter et al. (1999) developed a full-scale ANN process model to predict clarifier effluent color at the Rossdale WTP in Edmonton, Alberta, Canada. Zhang and Stanley (1999) developed both process and inverse process ANN models to predict the settled water turbidity and the optimal alum dosage at the same WTP. Yu et al. (2000) developed an ANN inverse process model to predict the coagulant dosage at a WTP in Taipei City, Taiwan. Maier et al. (2004) developed both process and inverse process models using multilayer perceptrons (MLP) to predict several treated water quality parameters and alum dosage at a WTP in southern Australia. Robenson et al. (2009) developed an inverse process ANN model to predict the optimal coagulant dosage with consideration of treated water quality at Segama WTP in Malaysia. Griffiths and Andrews (2011a) developed both process and inverse process seasonal ANN models to predict settled water turbidity and optimal alum dosage at Elgin Area WTP, Canada. Kennedy et al. (2015) evaluated four different hybrid ANN process models for predicting turbidity and dissolve organic matter removal during coagulation process using daily full-scale data at Akron WTP, Ohio, USA.

Another powerful technique for modeling nonlinear systems is neuro-fuzzy which has an ability to handle uncertain and noisy data from fuzzy inference system and learning ability from neural networks. Adaptive neuro-fuzzy inference system (ANFIS) is one type of neuro-fuzzy systems (Jang 1993). ANFIS does not have the limitation of ANN in being trapped in local minima. It can estimate values that are outside the range of the training data. In general, the results of ANFIS model are superior than ANN that they are more accurate and have less uncertainty (Talebizadeh and Moridnejad 2011). In the literature, ANFIS has shown effective results in modeling for predicting coagulant dosage (Gagnon et al. 1997; Wu and Lo 2008; Heddam et al. 2012). However, all these researches are based on operators’ past behavior corresponding to influent quality without considering the process output, such as the settled water turbidity. In other words, none of previous researches has applied ANFIS models on the dynamics of coagulation process.

As a result of development of supervisory control and data acquisition (SCADA), the amount of data collected at WTP has increased enormously in recent years. In this situation, clustering technique is a good method for analyzing huge amount of information by classifying data into groups. Moreover, it is very useful for categorizing multi-dimensional data in clusters, allowing users to acquire effective information in decision making for complex water treatment processes. Maier et al. (2004) used Kohonen self-organizing map (SOM) to divide data into three subsets for developing ANN models. Park et al. (2008) used *k*-means clustering to classify data sets in making decision model for coagulant dosage. Juntunen et al. (2013) applied SOM and *k*-means clustering for modeling water quality in drinking WTP to assess the essential characteristics of the process. They concluded that the whole model should be able to adapt to different conditions by making separated sub-models for different states of the process, because a single uniform model always had problem in modeling complex relationships in the whole WTP process. Some studies also demonstrated that models composed of sub-models could be effective by modeling each state of the process, such as seasonal models (Gagnon et al. 1997; Griffiths and Andrews 2011a, b).

The main objective of this research is to develop enhanced models that are able to predict better the settled water turbidity and to determine optimal hourly coagulant dosage on full-scale condition in drinking WTP. To develop well-adjusted prediction models to different process states, *k*-means clustering method is integrated with ANFIS technique. Models by ANFIS and ANN are also developed for performance comparison. The proposed hybrid of *k*-means-ANFIS approach is the first attempt in modeling dynamic coagulation process.

## Materials and methods

### Treatment process and data set

*k*water) which is a government-owned company. Raw water is supplied through 15.5 km buried pipeline from intake pump station at Nakdong River. It has treatment capacity of 120,000 m

^{3}per day and serves population and industrial complex in Changwon city. Bansong WTP adopts the conventional treatment process which consists of pre-chlorination, coagulation, flocculation, sedimentation, filtration, and post-chlorination. In addition, pre-ozonation facilities started operation in May, 2014. Coagulant of polyaluminium hydrogen chloride silicate (PAHCS) has been injected to the coagulation chambers since 2014. A simple flow diagram of the treatment process is given in Fig. 1.

At Bansong WTP, pH, turbidity, temperature, conductivity of raw water, and settled water turbidity are measured by online analyzer. These parameters describing raw water characteristics have direct influences on coagulation process. pH determines the solubility of the coagulant and effects floc characteristics. Turbidity controls the coagulation for low TOC raw water to destabilize suspended colloids or to create a good settling floc. Temperature has effect on efficiency of primary particle removal and rate of floc formation. Conductivity is a measure of electric current in the water by the ionized substance; therefore, it also influences on the dissolved solids. Two flow rates affect settling and detention time which are influent the flow rate and the effluent flow rate after sedimentation process. On the other hand, coagulant dosage is determined manually by operators’ judgment based on look-up table, variation of raw water quality, and the settled water turbidity trend. These water quality and operation data are recorded by SCADA system in real time, and transferred to the main database system. In this research, hourly data sets of the parameters during the whole period of 2014 are collected from the database server. They are used as input and output data required for models development. Total of 8760 records are gathered including water quality, flow rate, and coagulant dosage. According to the general guideline, at least one full cycle of data set should be applied to represent the data set (Baxter et al. 2002).

### Data preprocessing

*t*

_{r}is hydraulic retention time (hour) between the current point of coagulant dosage and target point;

*k*is hours required until

*V*

_{ i }/

*Q*

_{ i+1}is less than one; \(V_{i} = V_{i - 1} /Q_{i}\);

*Q*

_{ i }is flow rate per hour at the

*i*th hour; \(i\) is 1-h unit time index (\(i = 1, 2, \ldots , k\)); and

*V*

_{o}is volume of flocculation chamber and sedimentation basin.

Statistical summary of water quality and operational parameters for models’ development

Classification | Variables | Mean | Standard deviation | Coefficient of variation | Min | Max |
---|---|---|---|---|---|---|

Raw water | Turbidity (NTU) | 11.46 | 16.56 | 144.48 | 0.49 | 440.85 |

Temperature (°C) | 16.44 | 8.08 | 49.18 | 2.52 | 29.90 | |

pH | 7.67 | 0.35 | 4.59 | 6.76 | 8.85 | |

Conductivity (μs/cm | 299.70 | 89.57 | 29.89 | 110.20 | 537.17 | |

Effluent settled water | Turbidity (NTU) | 0.23 | 0.15 | 65.66 | 0.0002 | 1.31 |

Operational parameters | PAHCS dosage (mg/L) | 29.65 | 6.76 | 22.80 | 14.36 | 69.60 |

Inflow rate (m | 2898 | 686 | 23.68 | 1029 | 4188 | |

Outflow rate (m | 3037 | 693 | 22.80 | 914 | 4445 |

### *k*-means clustering

*k*-means clustering. Hierarchical clustering provides higher quality on likelihood classification for small data sets, whereas

*k*-means is less sensitive to outliers and more efficient for processing large sample sizes (>500) (Mooi and Sarstedt 2011; Abbas 2008). Due to these advantages,

*k*-means clustering has been used for analyzing data in many fields, including water treatment plant (Aguado et al. 2008; Zhu et al. 2015).

*k*-means clustering uses a centroid-based approach to minimize intra-cluster variation (MacQueen 1967). It classifies total objects into

*k*number of clusters with their similarity based on distance matrix. The centroid, which is the center of a cluster, is defined as a point to which the sum of distances from all objects in that cluster is minimized using similarity measure, such as Euclidean distance. Unlike hierarchical clustering,

*k*-means clustering operates on real observed data; therefore, it is often more suitable than hierarchical clustering for large amounts of data.

*k*-means clustering algorithm proceeds as follows (MacQueen 1967):

*J*is the objective function;

*x*

_{ j }is data vector given a set of observations (\(j = 1, 2, \ldots ,n )\);

*k*is the number of clusters;

*S*

_{ i }is cluster; and

*c*

_{ i }is cluster center.

- 1.
Define

*k*clusters with certain rules, and assign*k*random data vectors as the initial centroid of clusters. - 2.
Assign each object to the nearest cluster by calculating the distance between each object and the corresponding centroid vector.

- 3.
Update a new centroid vector for each cluster.

- 4.
If the result meets termination criterion (value of minimal objective function or maximum iteration number), the algorithm stops, otherwise, go to step 2.

### Adaptive neuro fuzzy inference system (ANFIS)

*x*,

*y*) and one output (

*f*). Each input is represented by two membership functions, and the output is represented by a first-order polynomial. A typical rule of ANFIS can be expressed as

*A*

_{1},

*A*

_{2}and

*B*

_{1},

*B*

_{2}are membership functions of input variables

*x*and

*y*, respectively;

*p*

_{1},

*q*

_{1},

*r*

_{1}and

*p*

_{2},

*q*

_{2},

*r*

_{2}are parameters of the output function. The role of each layer in ANFIS is as follows (Michael 2005):

*i*node for input

*x*can be computed as

*σ*

_{ i }are

*c*

_{ i }are parameters that control shape of the Gaussian function of node

*i*with maximum equal to 1 and minimum equal to 0. Parameters in this layer are referred as antecedent parameters.

*i*th node of this layer is computed as

*x*and \(y\). Thus, the output of each node in this layer is determined as the product of the normalized firing strength and the first-order polynomial function:

*p*

_{ i },

*q*

_{ i, }and

*r*

_{ i }are consequent parameters of rule

*i*.

*f*:

The parameters for optimization in ANFIS are the antecedent parameters {\(\sigma_{i} , c_{i}\)} which represent the shape and location of the input membership functions, and the consequent parameters {*p* _{ i }, *q* _{ i }, *r* _{ i }} which describe the overall output of the system. In ANFIS, the parameters associated the membership functions of input and output are trained using a hybrid learning algorithm that combines the least-square estimator and the gradient descent method (Jang 1993). Identification of parameters associated with the consequent part of fuzzy rules in the complicated system is important. There are two most commonly used models for identification of fuzzy inference system in ANFIS. They are grid partition and clustering methods. The grid partition method has a critical drawback that all combinations of membership functions for each input make excessive number of rules; therefore, it causes a huge amount of calculation and inferior performance to clustering method in predicting coagulant dosage (Heddam et al. 2012). Thus, these parameters are usually extracted from the observed data using clustering method. Among various clustering methods, subtractive clustering method is the best for the condition, where the number of clusters for a given data set is not known (Talebizadeh and Moridnejad 2011).

### Artificial neural network (ANN)

Artificial neural network is a massive parallel information processing system composed of a number of simple processing elements known as neurons or nodes (Haykin 1998). MLP is the most popularly used feed-forward hierarchical ANN which is used to map any random input with the corresponding output. Therefore, MLP has been used for a variety of studies for modeling and prediction on water research (Mondal et al. 2012; Al-Abadi 2014). MLP is comprised of different layers of neurons: one input layer, one or more hidden layers, and one output layer (Fig. 3).

*y*(

*x*) of MLP, which has three layers composed of an input layer with

*n*neurons receiving input

*x*

_{ i }signals, a hidden layer with

*H*neurons, and a layer with one output neuron, is given by

*h*

_{ j }is net input;

*W*

_{ j }denotes the weight between the hidden layer and the output layer;

*w*

_{ ji }is the weight between the input layer and hidden layer;

*b*is bias value; and

*f*is the activation function. Most prominent used activation functions for neural networks are linear and sigmoid transfer functions. The initial assigned interconnection weights are progressively adjusted during the training process. In this process, the predicted outputs by MLP are compared with target outputs, and errors are back propagated to minimize the errors. Levenberg–Marquardt (LM) algorithm is highly recommended back-propagation algorithm for optimizing the interconnection weights, because it is the fastest and gives better performance for a simple structure networks (Hagan and Menhaj 1994).

### Hybrid of *k*-means clustering and ANFIS

*k*-means-ANFIS is shown in Fig. 4. It consists of six key components: input and output database, data division unit,

*k*-means cluster unit, fuzzy system generator, fuzzy inference system, and adaptive neural network representing the fuzzy system. After data division processing, each training, validation, and test data sets are assigned to clusters formed by

*k*-means algorithm. Each cluster is trained independently with training and validation sets by ANFIS to obtain the optimal fuzzy inference system. Then, the fuzzy inference systems are kept and merged into a single entire system. For the test phase, inputs are provided to the corresponding fuzzy inference system depending on their belongings, which are determined by Euclidean distances between cluster centers and inputs, and then outputs are obtained. The combination of two algorithms is implemented in MATLAB.

### Indices of model performance

*k*-means-ANFIS and to compare with the other models, several statistical indices are used: root mean square error (RMSE), mean absolute percentage error (MAPE), correlation coefficient (

*R*), and coefficient of determination (

*R*

^{2}). The lower RMSE and MAPE, the higher

*R*and

*R*

^{2}values mean better performance. In addition,

*R*

_{m}

^{2}which was proposed by Roy and Roy (2008) is included to evaluate the robustness and the reliability of the models. This index evaluates the similarity between

*R*

^{2}and \(R_{\text{o}}^{ 2}\). It has value higher than 0.5 when the model has good performance, where \(R_{\text{o}}^{ 2}\) indicates the coefficient of determination between the observed values and the predicted values expected from a perfect fit line. These evaluation indices are defined as follows:

*P*

_{ i }is the predicted value and

*O*

_{ i }is the observed value; and \(\overline{P}\) and \(\overline{O}\) are the average values of the predicted and observed values, respectively.

## Result and discussion

### Variations of water quality and coagulant dosage

### The results of *k*-means clustering on raw water quality

*k*-means clustering. In general, data normalization is useful to generate good clusters and to improve the accuracy of clustering. The raw water quality data are converted into specific ranges by

*Z*-score method, so that different ranges of four parameters can be treated equally for fair comparison.

*Z*-score conversion is effective for

*k*-means algorithm (Mohamad and Usman 2013). The original data (

*x*) are normalized using the average value (\(\overline{x}\)) and standard deviation (

*s*) as shown in Eq. (15). As the result, all parameters have zero mean and unit variance:

*k*-means clustering, the number of clusters has to be decided in advance. In this research, the optimal number of clusters is determined using Davies–Bouldin criterion (Davies and Bouldin 1979) and Silhouette criterion (Rousseeuw 1987). In Davies–Bouldin method, the number of clusters is optimal when Davies–Bouldin index has minimal value, which indicates that distances among clusters are far. Whereas, Silhoutte plot shows graphically how well all objects lie within their corresponding clusters and provides the silhouette value which is a measure of how similar each point is to points in its own cluster. Davies–Bouldin index and Silhouette plot for the observed data are shown in Fig. 6. From Silhouette plot, most points in four clusters have positive Silhouette values higher than 0.6 (average Silhouette value 0.61), which indicate that the clusters are separated well from the neighboring clusters.

*k*-means algorithm, as shown in Fig. 7. From the viewpoint of models development, the number of data in cluster 1 is not sufficient for good training in neural networks compared with the other clusters; therefore, the data are integrated with cluster 2.

Cluster center of raw water quality by *k*-means clustering

Cluster | Turbidity | Temperature | pH | Conductivity | Observed counts |
---|---|---|---|---|---|

1 | 307.32 | 23.27 | 6.85 | 119.61 | 13 |

2 | 43.30 | 24.25 | 7.10 | 171.70 | 553 |

3 | 6.82 | 7.41 | 7.92 | 382.15 | 3230 |

4 | 10.10 | 21.43 | 7.57 | 260.74 | 4959 |

### ANFIS and ANN models

*R*) are calculated, as shown in Table 3. High turbidity impact is shown with high value of

*R*. Conductivity has the most influence on turbidity of the settled water, while it has the least influence on coagulant dosage. Both in and out flow rates are low influential parameters. Consequently, four raw water quality parameters and coagulant dosage are selected as input of the process model, and four raw water quality parameters and settled water turbidity are chosen as input of the inverse process model. The value of

*R*which is higher than 0.1 is set as the threshold for selecting input parameters in the models (Chen and Liu 2014).

Correlation coefficients between model outputs and input parameters

Parameter type | Potential input | Process model output: | Inverse model output: |
---|---|---|---|

Parameter | Turbidity of settled water | Coagulant dosage | |

Raw water quality | Turbidity | 0.516 | 0.534 |

Temperature | 0.275 | 0.153 | |

pH | −0.289 | −0.246 | |

Conductivity | −0.522 | −0.135 | |

Flow rate | Inflow | 0.089 | 0.055 |

Outflow | 0.100 | 0.081 | |

Settled water quality | Turbidity | 0.481 | |

Process control | Coagulant dosage | 0.481 |

Statistical parameters for training, validation, and test sets

Parameter | Data sets | Turbidity | Temperature | pH | Conductivity | Coagulant dosage | Settled water turbidity |
---|---|---|---|---|---|---|---|

Mean | Training | 11.45 | 16.35 | 7.67 | 300.67 | 29.64 | 0.23 |

Validation | 11.23 | 16.50 | 7.67 | 300.85 | 29.65 | 0.23 | |

Test | 11.73 | 16.64 | 7.67 | 295.61 | 29.66 | 0.23 | |

Standard deviation | Training | 16.32 | 8.05 | 0.35 | 90.40 | 6.75 | 0.15 |

Validation | 15.47 | 8.09 | 0.35 | 89.09 | 6.75 | 0.15 | |

Test | 18.25 | 8.18 | 0.36 | 87.46 | 6.79 | 0.16 |

Training parameter values for ANFIS and ANN models’ development

ANFIS | ANN | ||
---|---|---|---|

Basic structure | Subtractive clustering | Basic structure | MLP |

No. of layers except | 5 | No. of hidden layer | 1 |

Input and output layer | No. of hidden neuron | 88 | |

Shape of MFs | Gaussian | Hidden layer TFs | Tangent sigmoid |

No. of MFs | No. of cluster | Output layer TFs | Linear |

Training algorithm | Hybrid algorithm | Training algorithm | LM |

Training strop criterion | Cross-validation stop | Training strop criterion | Epoch number reach |

Avoid over-fitting | Min of validation error | Avoid over-fitting | Min of validation error |

Max of training epochs | 500 | Max of training epochs | 500 |

### Simulation results of *k*-means-ANFIS models

*k*-means-ANFIS are presented in Table 6. According to the optimal cluster radii, each inference system applies 13, 55, and 113 linguistic rules, respectively. Figure 8 shows 13 rules of cluster 1 & 2 model from fuzzy logic toolbox interface in MATLAB. With this interface tool, the settled water turbidity can be estimated from the five given input values. According to the evaluation results, all sub-models have correlation coefficients higher than 0.8, which represent strong correlation between the observed and predicted values. Cluster 1 & 2 model shows the lowest performance, and it is caused by the biggest variations of turbidity in raw and settled water (0.16–1.30 NTU) with the smallest number of data. The model of cluster 3 has the best performance considered from RMSE and MAPE, while the model of cluster 4 has the best performance considered from

*R*and

*R*

^{2}. Particularly, the

*R*

^{2}value of cluster 4 model is over 0.8, which indicates that the model is very good (Shu and Quarda 2008).

Performance of *k*-means-ANFIS process models

Cluster | Radii | Training | Test | ||||||
---|---|---|---|---|---|---|---|---|---|

RMSE (NTU) | MAPE (%) | | | RMSE (NTU) | MAPE (%) | | | ||

1 & 2 | 0.21 | 0.0649 | 8.77 | 0.9419 | 0.8873 | 0.1124 | 14.05 | 0.8598 | 0.738 |

3 | 0.1 | 0.0238 | 13.50 | 0.9328 | 0.8701 | 0.0304 | 13.36 | 0.8882 | 0.7811 |

4 | 0.09 | 0.0388 | 14.19 | 0.9653 | 0.9319 | 0.0599 | 22.76 | 0.9196 | 0.8456 |

*k*-means-ANFIS are shown in Table 7. According to the optimal cluster radii, the inference systems apply 8, 55, and 113 linguistic rules in the models, respectively. All models show accurate prediction ability with

*R*and

*R*

^{2}values higher than 0.8. The clusters 1 & 2 model also shows the lowest performance among the three models. This is caused by the same reason as the process model: wide coagulant dosage range (27.39–69.59 mg/L), with the smallest number of data. The model of cluster 3 has the best performance in all evaluation indices. Figure 9 illustrates 3D response surface graphs of cluster 3 model. It can be seen that coagulant dosage has complicated nonlinear relationship with raw water quality and the settled water turbidity.

Performance of K-means-ANFIS inverse process models

Cluster | Radii | Training | Test | ||||||
---|---|---|---|---|---|---|---|---|---|

RMSE (mg/L) | MAPE (%) | | | RMSE (mg/L) | MAPE (%) | | | ||

1 & 2 | 0.26 | 2.3563 | 3.79 | 0.9662 | 0.9336 | 4.0991 | 5.71 | 0.8989 | 0.8019 |

3 | 0.1 | 0.8131 | 1.8457 | 0.9896 | 0.9795 | 1.2364 | 2.87 | 0.9763 | 0.9528 |

4 | 0.09 | 1.0083 | 2.436 | 0.9803 | 0.961 | 1.7121 | 3.99 | 0.9416 | 0.8853 |

*k*-means-ANIFS method, prediction performances of the six models are compared with a single ANFIS model using the same data. As shown in Table 8, the results confirm better performance of

*k*-means-ANFIS by yielding lower RMSE and MAPE as well as higher

*R*and

*R*

^{2}than a single ANFIS except the process model of cluster 3. Although the single ANFIS model predicts very slightly better for cluster 3, it is not significant and MAPE evaluation contradicts it. Especially, both models of cluster 1 & 2 show significantly improved performances. As illustrated in Fig. 10, it can be noticed that the MFs of

*k*-means-ANFIS spread more widely in the entire range than MFs of single ANFIS.

Performance comparison of K-means-ANFIS and ANFIS

Model | Cluster | | ANFIS (79 fuzzy rules) | |||||||
---|---|---|---|---|---|---|---|---|---|---|

RMSE (NTU) | MAPE (%) | | | RMSE (NTU) | MAPE (%) | | | |||

Process | 1 & 2 | 0.1124 | 14.05 | 0.8598 | 0.738 | 0.1373 | 17.23 | 0.7813 | 0.6088 | |

3 | 0.0304 | 13.36 | 0.8882 | 0.7811 | 0.0299 | 14.95 | 0.8892 | 0.7882 | ||

4 | 0.0599 | 22.76 | 0.9196 | 0.8456 | 0.0628 | 25.10 | 0.9117 | 0.8303 | ||

Inverse | 1 & 2 | 4.0991 | 5.71 | 0.8989 | 0.8019 | 4.9974 | 7.00 | 0.8464 | 0.7124 | |

Process | 3 | 1.2364 | 2.87 | 0.9763 | 0.9528 | 1.3648 | 3.01 | 0.9712 | 0.9425 | |

4 | 1.7121 | 3.99 | 0.9416 | 0.8853 | 1.8055 | 4.43 | 0.9350 | 0.8725 |

*k*-means-ANFIS models, combining together three sub-models of process and inverse process, respectively, with ANFIS and ANN models.

Comparative analysis of *k*-means-ANFIS, ANFIS, and ANN models

Model | Index | | ANFIS | ANN |
---|---|---|---|---|

Process | RMSE (NTU) | 0.0572 | 0.0625 | 0.0633 |

MAPE (%) | 18.75 | 20.87 | 23.80 | |

| 0.9326 | 0.9189 | 0.9168 | |

| 0.8697 | 0.8444 | 0.8406 | |

\(R_{\text{m}}^{ 2}\) | 0.5558 | 0.5113 | 0.5049 | |

Inverse | RMSE (mg/L) | 1.848 | 2.075 | 2.2272 |

Process | MAPE (%) | 3.70 | 4.13 | 5.0029 |

| 0.9624 | 0.9525 | 0.9451 | |

| 0.9259 | 0.9066 | 0.8924 | |

\(R_{\text{m}}^{ 2}\) | 0.6739 | 0.6296 | 0.5997 |

*R*> 0.8,

*R*

^{2}> 0.8, \(R_{\text{m}}^{ 2}\) > 0.5. However, as shown in Table 9,

*k*-means-ANFIS model provides better prediction results than ANFIS and ANN models for all evaluation criteria. Therefore,

*k*-means-ANFIS method can be effectively applied to the process and the inverse process models of coagulation. The results of three models in the test phase are graphically compared by the plots of both observed and predicted values (Figs. 11, 12, 13).

*R*

^{2}value of 0.95 for inverse process model; however, the model was built based on only good cases of effluent turbidity and not covering all seasonal variations. The good performances of the models by Maier et al. resulted from small number of bench scale data. However, the model derived from bench scale data is generally unable to account for the simultaneous change in key process parameters, and often fail when applied to real WTP (Baxter et al. 1999). Robenson et al. made an accurate model using 11 inputs, but it could not catch up with the proposed model’s performance even though they used time series of coagulant dosage as input parameters. Kennedy et al. built an acceptable model with the

*R*value of 0.91; however, it was caused by daily sampling and relatively stable raw water quality, such as turbidity from 1.9 to 37.7 NTU. Therefore, it has a limitation of real-time predictions under abrupt large changes of raw water quality. The seasonal models by Griffiths and Andrews were built under similar simulation conditions to this work, but the overall performances of the seasonal models are lower than

*k*-means-ANFIS models despite using more inputs. The results in this section demonstrate that

*k*-means-ANFIS models are superior to those in the literatures under the condition when real-time predicting is required for WTP which has big fluctuation of raw water quality throughout a year.

Summary of process and inverse process ANN models on coagulation in the literatures

Literature | Number of inputs | Data samples | | Model |
---|---|---|---|---|

The proposed method | 5 | FS, 1[ | 0.87 (0.93) | Process |

5 | 0.93 (0.96) | Inverse process | ||

Zhang and Stanley (1999) | 10 | FS, 1745 | 0.24 | Process |

10 | 0.95 | Inverse process | ||

Maier et al. (2004) | 7 | BS, 202 | 0.90 | Process |

9 | 0.94 | Inverse process | ||

Robenson et al. (2009) | 11 | FS | 0.95 | Inverse process |

Griffiths and Andrews (2011a) | 12 | FS, 1[ | 0.79 | Process (fall) |

10 | 0.71 | Process (spring) | ||

10 | 0.63 | Process (winter) | ||

12 | 0.89 | Inverse process (fall) | ||

10 | 0.82 | Inverse process (spring) | ||

10 | 0.78 | Inverse process (winter) | ||

Kennedy et al. (2015) | 9 | FS, 24[ | (0.91) | Process |

## Conclusions

In this research, hybrid of *k*-means-ANFIS method was proposed and applied to predict the settled water turbidity and the optimal coagulant dosage with full-scale data from Bansong WTP (South Korea). The general ANFIS and ANN models were implemented for comparison as well. *k*-means clustering successfully characterized the wide-range influent conditions into four distinct groups. Then, four sub-models representing different process states of raw water quality were developed and merged into three sub-models. The evaluation results demonstrated high performance of the hybrid approach of *k*-means clustering and ANFIS. On the whole, the sub-models of *k*-means-ANFIS performed better than a single ANFIS model, especially it could achieve the most improved prediction results for cluster 1 & 2 models occupying rainy season. The prediction improvement of rainy season in *R* ^{2} index was 21.2% for the process model and 12.6% for the inverse process model. It indicates that *k*-means-ANFIS models can be used as a robust tool during rainy season which is the most challenging period of operation. In comparison with the general ANFIS and ANN, *k*-means-ANFIS also provided the best results in all evaluation indices: RMSE, MAPE, *R*, *R* ^{2}, \(R_{\text{m}}^{ 2}\). Therefore, the proposed hybrid approach can be used effectively for modeling the process and the inverse process of coagulation. It can provide operators with effective decision supports on both water quality control and operational costs.

## Notes

### Acknowledgements

The authors would like to thank the staffs who are working at Basnong water treatment plant in Changwon city, South Korea for supporting the data in this research.

## References

- Abbas OA (2008) Comparisons between data clustering algorithms. Int Arab J Inf Technol 5(3):320–325Google Scholar
- Aguado D, Montoya T, Borras L et al (2008) Using SOM and PCA for analyzing and interpreting data from a P-removal SBR. Eng Appl Artif Intell 21:919–930CrossRefGoogle Scholar
- Al-Abadi AM (2014) Modeling of stage-discharge relationship for Gharraf River, southern Iraq using backpropagation artificial neural networks, M5 decision trees, and Takagi–Sugeno inference system technique: a comparative study. Appl Water Sci. doi: 10.1007/s13201-014-0258-7 Google Scholar
- Baxter CW, Stanley SJ, Zhang Q (1999) Development of a full-scale artificial neural network model for the removal of natural organic matter by enhanced coagulation. Water Supply Res Technol Aqua 48(4):129–136CrossRefGoogle Scholar
- Baxter CW, Tupas RRT, Zhang Q et al (2001a) Artificial intelligence systems for water treatment plant optimization. American Water Works Association Research Foundation and American Water Works Association, DenverGoogle Scholar
- Baxter CW, Zhang Q, Stanley SJ et al (2001b) Drinking water quality and treatment: the use of artificial neural networks. Can J Civ Eng 28(1):26–35CrossRefGoogle Scholar
- Baxter CW, Stanley SJ, Zhang Q et al (2002) Development artificial neural network models of water treatment processes: a guide for utilities. J Environ Sci 1(3):201–211Google Scholar
- Chen WB, Liu WC (2014) Artificial neural network modeling of dissolved oxygen in reservoir. Environ Monit Assess 186:1203–1217CrossRefGoogle Scholar
- Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278Google Scholar
- Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell PAMI 1(2):224–227Google Scholar
- Gagnon C, Grandjean BPA, Thibault J (1997) Modelling of coagulant dosage in a water treatment plant. Artif Intell Eng 11(4):401–404CrossRefGoogle Scholar
- Griffiths KA, Andrews RC (2011a) The application of artificial neural networks for the optimization of coagulant dosage. Water Sci Technol Water Supply 11(5):605–611CrossRefGoogle Scholar
- Griffiths KA, Andrews RC (2011b) Application of artificial neural networks for filtration optimization. J Environ Eng 137(11):1040–1047CrossRefGoogle Scholar
- Hagan MT, Menhaj MB (1994) Training feedforward networks with the marquardt algorithm. IEEE Trans Neural Netw 5(6):989–993CrossRefGoogle Scholar
- Haykin S (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, New York, pp 26–32Google Scholar
- Heddam S, Bermad A, Dechemi N (2012) ANFIS-based modeling for coagulant dosage in drinking water treatment plant: a case study. Environ Monit Assess 184(4):1953–1971CrossRefGoogle Scholar
- Jang JSR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3):665–685CrossRefGoogle Scholar
- Juntunen P, Liukkonen M, Lehtola M et al (2013) Cluster analysis by self-organizing maps: an application to the modelling of water quality in a treatment process. Appl Soft Comput 13:3191–3196CrossRefGoogle Scholar
- Kennedy MJ, Gandomia AH, Miller CM (2015) Coagulation modeling using artificial neural networks to predict both turbidity and DOM-PARAFAC component removal. J Environ Chem Eng 3(4):2829–2838CrossRefGoogle Scholar
- MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of fifth Berkeley symposium on mathematical statistics and probability, vol I. Statistics, Berkeley and Los Angeles, University of California Press, pp 281–297Google Scholar
- Maier HR, Morgan N, Chow CWK (2004) Use of artificial neural networks for predicting optimal alum doses and treated water quality parameters. Environ Model Softw 19(5):485–494CrossRefGoogle Scholar
- Michael N (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison-Wesley, New York, p 276Google Scholar
- Mohamad IB, Usman D (2013) Standardization and its effects on
*k-*means clustering algorithm. Res J Appl Sci Eng Technol 6(17):3299–3303Google Scholar - Mondal SK, Jana S, Majumder M et al (2012) A comparative study for prediction of direct runoff for a river basin using geomorphological approach and artificial neural networks. Appl Water Sci. doi: 10.1007/s13201-011-0020-3 Google Scholar
- Mooi E, Sarstedt M (2011) A concise guide to market research: the process, data, and methods using IBM SPSS statistics. Springer, Berlin, pp 237–284CrossRefGoogle Scholar
- Park S, Bae H, Kim C (2008) Decision model for coagulant dosage using genetic programming and multivariate statistical analysis for coagulation/flocculation at water treatment process. Korean J Chem Eng 25(6):1372–1376CrossRefGoogle Scholar
- Robenson A, Abd.Shukor SR, Aziz N (2009) Development of process inverse neural network model to determine the required alum dosage at Segama water treatment plant Sabah, Malaysia. In: 10th international symposium on process systems engineering: part A, pp 525–530Google Scholar
- Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math 20(1):53–65CrossRefGoogle Scholar
- Roy PP, Roy K (2008) On some aspects of variable selection for partial least squares regression models. QSAR Comb Sci 27(3):302–313CrossRefGoogle Scholar
- Sahoo AK, Zuo MJ, Tiwari MK (2012) A data clustering algorithm for stratified data partitioning in artificial neural network. Expert Syst Appl 39(8):7004–7014CrossRefGoogle Scholar
- Shu C, Ouarda TBMJ (2008) Regional flood frequency analysis at ungauged sites using the adaptive neuro-fuzzy inference system. J Hydrol 349:31–43CrossRefGoogle Scholar
- Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15(1):116–132CrossRefGoogle Scholar
- Talebizadeh M, Moridnejad A (2011) Uncertainty analysis for the forecast of lake level fluctuations using ensembles of ANN and ANFIS models. Expert Syst Appl 38(4):4126–4135CrossRefGoogle Scholar
- Weigend AS, Rumelhart DE, Huberman BA (1990) Predicting the future: a connectionist approach. Int J Neural Syst 1(3):193–209CrossRefGoogle Scholar
- Wu GD, Lo SL (2008) Predicting real-time coagulant dosage in water treatment by artificial neural networks and adaptive network-based fuzzy inference system. Eng Appl Artif Intell 21(8):1189–1195CrossRefGoogle Scholar
- Yu RF, Kang SF, Liaw SL et al (2000) Application of artificial neural network to control the coagulant dosing in water treatment plant. Water Sci Technol 42(3–4):403–408Google Scholar
- Zhang Q, Stanley SJ (1999) Real-time water treatment process control with artificial neural networks. J Environ Eng 125(2):153–160CrossRefGoogle Scholar
- Zhu J, Segovia J, Anderson P (2015) Defining influent scenarios: application of cluster analysis to a water reclamation plant. J Environ Eng 141(7):04015005CrossRefGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.