Next Article in Journal
Retrieval and Evaluation of Chlorophyll-A Spatiotemporal Variability Using GF-1 Imagery: Case Study of Qinzhou Bay, China
Next Article in Special Issue
An Integrated Method for Landscape Assessment: Application to Santiago de Cuba Bay, Cuba
Previous Article in Journal
Spanish Adaptation and Validation of the Child Adjustment and Parent Efficacy Scale
Previous Article in Special Issue
Socio-Economic and Environmental Impacts of Biomass Valorisation: A Strategic Drive for Sustainable Bioeconomy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Suspended Sediment Modeling Using a Heuristic Regression Method Hybridized with Kmeans Clustering

1
State Key Laboratory of Hydrology-Water Resources and Hydraulic Engineering, Hohai University, Nanjing 210098, China
2
Department of Mathematics, IKG Punjab Technical University, Jalandhar, Kapurthala 144603, India
3
Agronomy Department, Hydraulics Division, Faculty of Science, University of Skikda, Skikda 21000, Algeria
4
Faculty of Engineering, School of Civil Engineering, Universiti Teknologi Malaysia (UTM), Johor Bahru 81310, Malaysia
5
School of Technology, Ilia State University, Tbilisi 0162, Georgia
*
Author to whom correspondence should be addressed.
Sustainability 2021, 13(9), 4648; https://0-doi-org.brum.beds.ac.uk/10.3390/su13094648
Submission received: 22 March 2021 / Revised: 15 April 2021 / Accepted: 19 April 2021 / Published: 22 April 2021

Abstract

:
The accurate estimation of suspended sediments (SSs) carries significance in determining the volume of dam storage, river carrying capacity, pollution susceptibility, soil erosion potential, aquatic ecological impacts, and the design and operation of hydraulic structures. The presented study proposes a new method for accurately estimating daily SSs using antecedent discharge and sediment information. The novel method is developed by hybridizing the multivariate adaptive regression spline (MARS) and the Kmeans clustering algorithm (MARS–KM). The proposed method’s efficacy is established by comparing its performance with the adaptive neuro-fuzzy system (ANFIS), MARS, and M5 tree (M5Tree) models in predicting SSs at two stations situated on the Yangtze River of China, according to the three assessment measurements, RMSE, MAE, and NSE. Two modeling scenarios are employed; data are divided into 50–50% for model training and testing in the first scenario, and the training and test data sets are swapped in the second scenario. In Guangyuan Station, the MARS–KM showed a performance improvement compared to ANFIS, MARS, and M5Tree methods in term of RMSE by 39%, 30%, and 18% in the first scenario and by 24%, 22%, and 8% in the second scenario, respectively, while the improvement in RMSE of ANFIS, MARS, and M5Tree was 34%, 26%, and 27% in the first scenario and 7%, 16%, and 6% in the second scenario, respectively, at Beibei Station. Additionally, the MARS–KM models provided much more satisfactory estimates using only discharge values as inputs.

1. Introduction

The rapidly growing global population has made freshwater resources scarce and compelled hydrologists to explore methods for better river management and water resource conservation [1]. Accurate modeling of suspended sediment load (SSL) plays a vital role in river restoration, pollution, and soil erosion reduction, thus solving challenges related to water quality, channel design, and the operation of hydraulic structures [2,3]. However, precise forecasting of SSL is challenging due to the concurrent effects of many meteorological and hydrological factors on sediment processes, such as wind speed, evaporation, precipitation, river discharge, water temperature, and ice packs. The variations of these parameters in space and time make the sediment dynamics highly complicated and nonlinear [4,5]. Many SSL estimation models have been developed in the literature, ranging from physically based to data-driven models. Physically based models require a large volume of different kinds of data and information for reliable estimation of SSL. However, such a large amount of data is difficult to obtain in data-scarce catchments, especially for developing countries [6]. For such cases, data-driven models have demonstrated success in modeling different hydrological phenomena, especially streamflow and sediment load, by capturing the non-stationarity and nonlinear behavior of SSL with fewer data [3,7,8]. Several data-driven modeling approaches, including artificial neural networks (ANN), adaptive neuro-fuzzy inference systems (ANFIS), support vector machines (SVM), the M5 model tree (M5Tree), and multivariate adaptive regression splines (MARS), have shown their efficiency in precise modeling of different hydrological variables [9,10,11,12]. Some of those algorithms, such as ANN, have also demonstrated their success in modeling SSL [13].
Different ANN models have been utilized to estimate SSL during the last two decades [13,14,15]. The studies showed some inherent drawbacks of ANN, including limited regularization and plunging to local minima. The rapid learning and adaptation capacity of ANFIS has made it capable of overcoming the weaknesses of ANN significantly. Therefore, it has been widely employed in recent years for SSL prediction [16,17,18,19,20,21,22,23,24,25,26,27,28,29]. Kisi and Yaseen [16] applied three different ANFIS models, including ANFIS subtractive clustering (ANFIS-SC), ANFIS grid partition (ANFIS-GP), and ANFIS fuzzy c-means (ANFIS-FCM), to predict the suspended sediment concentration of Eel River. Results indicated the satisfactory performance of ANFIS based models in estimating sediment concentration. Bakhtyar et al. [17] and Kabiri-Samani et al. [18] evaluated the prediction accuracy of ANFIS compared to different empirical formulas such as Walton–Bruno (WB), Van Rijn (VR), and CERC in forecasting longshore sediment transport rate (LSTR). They found less error in estimating LSTR using ANFIS models than that obtained using empirical formulas. Mianaei and Keshavarzi [19] examined the ANFIS prediction capability in assessing suspended sediment discharge at the Escanaba River mouth station. They found the ANFIS model’s prediction very close to observation. For daily streamflow and sediment discharge estimation at Polavaram and Pathagudem gauging stations of the Godavari catchment, Kumar et al. [20] applied ANFIS and ANN models. As results, they found that the ANFIS model with three membership functions provided the best results for daily streamflow and sediment discharge. Kisi and Kermani [21] utilized the ANFIS-FCM, ANN, and sediment rating curve methods to determine the daily sediment amount at two hydraulic stations operated by the United States Geological Survey. They reported the ANFIS model’s capability to improve prediction accuracy by 10% to 16% compared to the ANN model. Vafakhah [22] applied the ANFIS model to sediment load prediction of the Kojor forest watershed near the Caspian Sea using rainfall and streamflow as inputs. He compared the selected method with cokriging (CK), ordinary kriging (OK), and ANN models and reported a better performance of ANFIS compared to CK and OK models. For daily and monthly SSL modeling of the Little Black River and the Great Menderes basin, Rajaee et al. [23] and Firat and Gungor [24] compared the performance of the ANFIS model with ANN and multiple linear regression (MLR). Results demonstrated the dominancy of the ANFIS model over the ANN and MLR models. In dam operation management, the precise calculation of the sediment input to the dam reservoir is very critical. Therefore, Samet et al. [25] used the ANFIS model with ANN and genetic algorithm (GA) models for SSL estimation from temperature, runoff, and CM (three-section method of sediment sampling) data in the Maku dam reservoir of Iran as a case study. Results indicated that the ANFIS model has a “gauss” membership function, which provides more accurate results than the ANN and GA models, with only a 0.968% percentage error. In addition to success in SSL prediction, the ANFIS models also performed well in estimating riverbed load. For forecasting the bed load of three Malaysian rivers (Kurau, Langat, and Muda of Peninsular Malaysia), Chang et al. [26] utilized the ANFIS model. The literature also showed that coupling the wavelet technique with the ANFIS model produces more accurate results than standalone ANFIS models. Mirbagheri et al. [27], Rajaee. [28], and Rajaee et al. [29] applied the ANFIS hybrid model coupled with the wavelet method. They found that the hybrid ANFIS model provided more accurate results than the standalone ANFIS models in estimating SSL at a USA gauging station.
This study selected the MARS model due to its shorter training process and better ability to model complex nonlinear processes without strong model assumptions than ANN models [30]. Another selected method was the M5Tree model due to its large data handling capability and smaller computational cost than the ANN and SVM models [29]. In recent years, MARS and M5Tree have been applied successfully in modeling runoff and sediment load [31,32,33,34,35,36,37,38,39]. Malik et al. [37] compared the performance of the MARS model with the SVM-based model (least square SVM) and two ANN models (radial basis and self-organizing map neural network) for estimating daily SSL at different gauging stations in Godavari catchment, India. Results indicated that the radial basis neural network and MARS models provided more satisfactory results than other data-driven models. Senthil Kumar et al. [38] evaluated the accuracy of the M5Tree model in predicting SSL and compared its performance with ANN coupled with backpropagation and Levenberg–Marquardt algorithms, fuzzy logic, and REPTree models. They obtained the most precise sediment concentration simulations using M5Tree.
Although the MARS and M5Tree models demonstrated promising results in previous studies for sediment modeling, both models could not efficiently capture the uncertainties in sediment time series data due to their complex behavior. The literature found that hybrid MARS and M5Tree models can provide more precise results than standalone data-driven models. A hybrid of the wavelet method and the M5Tree model (WM5Tree) was introduced by Goyal et al. [39] to estimate the sediment yield, and they found that the wavelet M5Tree provided more accurate results than ANN models. Nourani et al. [35] endorsed the findings of Goyal et al. [39]. They predicted the daily sediment load of the Lighvanchai and Upper Rio Grande rivers by comparing the WM5Tree with ANN and standalone M5Tree models and found that the hybrid M5Tree model outperformed the other models. Rahgoshay et al. [36] applied M5Tree, MARS, and hybrid of SVM with GA and particle swarm optimization (PSO) models to predict the sediment load of two earth dams. They found that SVM hybrid models (SVM with GA and SVM with PSO) provided more precise results than the MARS and M5Tree models.
The abovementioned literature revealed hybrid models still need improvement for precise modeling of suspended sediment. In this study, a new model is developed through hybridization of MARS with the Kmeans method (MARS–KM) to overcome standalone MARS models’ weakness in precisely capturing uncertainties in sediment dynamics. The MARS model and many other machine learning models’ main disadvantage is that they are very time-consuming, especially for large amounts of data with high variance, as in sediment load. For this purpose, the K means clustering method is utilized in this study. Therefore, the main contributions of this study are to (1) develop a novel model that introducing the K-means clustering into the MARS model for more accurate and faster estimation; (2) compare the prediction accuracy of the proposed MARS–KMeans model with the commonly used machine learning models, e.g., MARS, M5Tree, and ANFIS in sediment load estimation; and (3) select methods based on 50–50% data division.
K-means has been successfully used in recent literature to improve machine learning models’ prediction accuracy due to its robust nature in estimation [40,41,42,43,44]. The application of hybrid the MARS–KMeans method is rarely found in the literature for prediction [45]. There is no published study in the literature that uses the MARS–KM method for modeling any variables in hydrology to the best of our knowledge. This gave impetus to this study.

2. Materials and Methods

2.1. Case Study and Data Analysis

The Jialing catchment was chosen in this study as a case study due to its vital role in the hydropower operation management of the world’s biggest dam, i.e., the Three Gorges Reservoir. The selected catchment is the second largest tributary of the Yangtze River with a drainage area of 160,000 km2 and one of the reservoir’s main discharges and sediment sources. Thus, a precise estimation of sediment load input from the basin to the reservoir is very important for efficient reservoir operation. Two key gauging stations in the Jialing catchment, located at Guangyuan and Beibei, were chosen to predict SSL. These hydraulic gauging stations’ geographical locations aid in understanding the overall sediment phenomena and contribution of the catchment to the main Yangtze River. The selected catchment also has two main tributaries, the Qu River on the main channel’s left side and the Fu River on the right side (see Figure 1). To estimate the daily sediment load of both gauging stations, the daily data of runoff and suspended sediment from 1 January 2007, to 31 December 2015, were gathered from the Hydrological Yearbooks of the People’s Republic of China. The time variation graphs of both stations’ sediment loads are illustrated in Figure S1 (see Supplementary Materials). The related authorities checked the reliability and homogeneity of the data before releasing the data. Chinese national standard criteria were followed in obtaining streamflow and sediment measurements. The first vertical profiles (usually 10–30 profiles depending on the river width) are determined for measurement. Then, water depth and velocity of flow (utilizing a velocity meter) at each profile are measured. Flow velocity is recorded for different depths. Water samples for sediment concentrations (SCs) are collected from each depth, and these samples are dried and weighed in the lab. Finally, daily sediment loads are computed by multiplying the SCs by the streamflow [46,47].
Table S1 reports the brief statistics of the used streamflow (Q) and sediment (S) data. In both stations, the Q and S have high skewness, indicating that the time series has many extreme values. An augmented Dickey–Fuller test was applied to the sediment data using the adftest MATLAB command to see if they are stationary or not. For the Guangyuan and Beibei stations, the test statistics were −27.53 and −21.67, while the critical value was −1.94. Test statistics indicate that the sediment data are stationary in both stations.

2.2. Adaptive Neuro-Fuzzy Inference System (ANFIS)

Time series models are traditionally used to predict future phenomena in different fields of study. The major drawback of these models is their dependence on the autocorrelation factor. Machine learning models have been introduced and applied to overcome this foremost weakness of time series prediction models. ANFIS is one of the machine learning models that has been extensively used around the globe. It is a fusion of two different techniques, namely, artificial neural networks and fuzzy logic. Zadeh [48] developed fuzzy logic based on semantic uncertainty, which has been extensively used for modeling different environmental phenomena, including air pollution estimation and water pollution prediction. This fuzzy inference system (FIS) is pillared on three theories, i.e., the rule-based system, model’s database, and inference system. The first part determines the if–then rules, the second part defines the membership function, and the third phase uses the rules to produce the results. The main problem of FIS is its incapability to optimize membership function and adjust parameters automatically. To overcome this problem, an artificial neural network (ANN) is coupled with FIS to develop ANFIS. The ANFIS model uses the training features of ANN to adjust the membership function of fuzzy logic. It is a multilayer feed-forward network based on ANN learning capabilities and fuzzy thinking. ANFIS has many membership functions, such as Gaussian, trapezoidal, sigmoid, generally bell-shaped, triangular, etc. In real-life problems, the selection of appropriate membership functions is vital. In the current study, the ANFIS model was developed using different input combinations and applied to sediment prediction at the study sites, Guangyuan and Beibei. The basic architecture of ANFIS is given in Figure 2.
In Figure 2, X1 and X2 are inputs to the system, and f is the output. The rules for the ANFIS system are described in Equations (1) and (2) below:
Rule 1: IF X1 is P1 and X2 is Q1, then f1 = s1 X1 + t1 X2 + v1
Rule 2: IF X1 is P2 and X2 is Q2, then f2 = s2 X1 + t2 X2 + v2
where si, ti, and vi are linear output parameters that are required to optimize during model training. The working of all layers of ANFIS is discussed below [49,50].
Layer 1 (fuzzification layer): here, every node is considered an adaptive node, and each node passes the external signal to the next layer
O 1 , i = μ P i ( X 1 )   f o r   i = 1 ,   2 , . .
O 1 , i = μ Q i 2 ( X 2 )   f o r   i = 1 ,   2 , . .
In this step, the Gaussian membership function is used.
μ P i ( X 1 , σ , c ) = e ( X 1 c ) 2 2 σ 2
in which σ and c are membership function parameters. Therefore, the output of the first layer is as follows:
O 1 , i = μ P i ( X 1 ) = e ( X 1 c i ) 2 2 σ i 2
Layer 2 (product layer): this layer produces the membership degree of inputs. All nodes of this layer are fixed nodes and labeled as ∏. The firing strength is calculated in this layer as
O 2 , i = μ P i ( X 1 ) μ Q i ( X 2 )   f o r   i = 1 ,   2
Layer 3 (normalized layer): here, the firing strength ratio at i-th rule to the sum of firing strengths of all rules is calculated,
O 3 , i = w ¯ i = w i w 1 + w 2 i = 1 ,   2 ,
Layer 4 (defuzzification layer): in this layer, each node is an adjustable node with the node function given below.
O 4 , i = w ¯ i f i = w ¯ i ( s i   X 1 + t i   X 2 + v i )
Here, wi is the output of the normalized firing strength, and {si, ti, vi} are the parameters set of the node i.
Layer 5 (output layer): the final output of the model is calculated in this layer. It is the sum of incoming signals, as below.
O 5 , i = i w ¯ i f i = w 1 f 1 + w 2 f 2 w 1 + w 2
The ANFIS model is highly capable of learning and classifying input–output data.

2.3. M5 Tree Model

The M5 tree model was developed by Quinlan [51] and later rebuilt and enhanced by Wang and Witten [52]. This model is developed based on a decision tree concept, which links input and output variables. The model works in two steps. In the first step, input variables are divided into different groups based on linear regression. This minimizes the error of approximation between exact and forecast values. The standard deviation reduction plays an important role in fixing the division rule of the M5 tree model. Therefore, the decision tree depending upon input information is developed based on standard deviation reduction in the first step. In the second step, the tree is cropped from every leaf. Each further attempt involves finer classification levels, as these are further divided into branch and leaf nodes. The classification and regression tree (CART) algorithm is the basis of the M5 tree model. This model is trained based on the concept of standard deviation reduction (SDR), as discussed using the formula given below.
S D R = s d ( T ) | T i | | T | s d ( T i )
Here, SDR means standard deviation reduction; sd is expressed as a standard deviation; T represents a set of examples that reach the node; Ti is the ith outcome of the possible set. The data’s standard deviation (SD) is less than the parent nodes. The M5 tree model is developed in the current study to forecast SSL for seven different input combinations.

2.4. Multivariate Adaptive Regression Splines (MARS)

MARS, developed by Friedman [53], has undergone many reforms to enhance its performance. MARS’s significant advantage is that it does not need any particular assumptions for mapping the input–output relationship, which is a major limitation of the M5 tree model. Therefore, the MARS model covers the limitation of the M5 tree model, where the endpoints of the segments are treated as nodes. MARS is the non-parametric regression model and is useful to forecast continuous numeric outcomes. The model’s beauty is its flexible steps to manage relationships, which are almost additive or contain relations with other input variables to the model. MARS can explain the complex and nonlinear association between predictor and response variables. The MARS model can also work with the use of both the backward and forward stepwise procedure. Andres et al. [54] explain its use to remove preventable variables to improve the forecasting accuracy and make this model perform better during the backward stepwise procedure. The stepwise forward process helps to select the appropriate input variables for the MARS model.
Two basic functions with a range of inputs define the other variable. The variable Y, mapped from the variable X with c as the threshold, can be given below.
Y = m a x ( 0 , X c )
Y = m a x ( 0 , c X )
Here, two neighboring splines are used to have continuity in the basis function at the knot. The MARS model is widely used in many different fields, as it has properties to predict future approximation phenomena with good accuracy. In the present research, the MARS model is developed to forecast the sediment for seven different input combinations. The working procedure of MARS is shown in Figure 3.

2.5. K-Means (KM) Algorithm and MARS Hybrid Model

Lloyd [55] first introduced the KM technique in 1957 as a standard algorithm. Later, MacQueen [56] anticipated the term KM, a clustering technique based on the partition-based cluster analysis. This algorithm has been used in many different areas of research. The distance matrix used in the KM model is the Euclidean distance [57]. The first phase takes K initial seeds of clustering, and then the mean Euclidean distance is compared with each initial seed. This helps to assign the closest cluster seed. The process is iterated until the error is below the threshold. The choice of initial seed and the numbers of clusters are crucial, as they decide the KM method’s accuracy [58]. The KM algorithm classifies the objects based upon characteristics into K number of groups.
If Ji is the Euclidean distance, xk is the data vector, c is the number of clusters, and ci is the cluster center, an objective function, J is defined as
J = i = 1 c J i = i = 1 c ( k , x k G i x k c i 2 )
In this study, the MARS model is coupled with the KM algorithm for better prediction results with the least error. The working procedure of MARS- KM is shown in Figure 4.

3. Application and Results

3.1. Modeling Approaches and Accuracy Assessments

Four approaches, adaptive neuro-fuzzy inference system (ANFIS), multivariate adaptive regression splines (MARS), M5 model tree (M5Tree), and MARS with k-means clustering algorithm (MARS–KM), were used for modeling suspended sediment using various input combinations of sediment load (St: kg/s) and streamflow (Q: m3/s). The proposed models were developed using MATLAB software and compared using data at two stations, Guangyuan and Beibei. For each modeling approach, the sediment (kg/s) was modeled either separately using only the Q (m3/s) measured at previous lags or combined with St (kg/s) estimated at previous lags. Here, the sediment (St: kg/s) is the response variable. The explanatory variables considered were varied from one to more inputs, formed by a combination of several Q and St lag values. In total, seven input combinations were compared, denoted as combinations (i), (ii) … etc. In the first four input combinations, only streamflow inputs were considered: (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; and (iv) Qt, Qt-1, Qt-2, and Qt-3. After selecting the best Q-based input combination, after the fourth combination, sediment inputs were added to the best Q-based combination. For example, for the ANFIS method, the input combinations considered are (v) Qt and St-1; (vi) Qt, St-1, and St-2, and (vi) Qt, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Performance assessment using different input combinations allows importance evaluation of variables and determining the lag values as inputs. Additionally, two different training scenarios were compared: splitting the dataset into two equal subsets having 50% of total data in each subset and a permutation between the two. Here, the two scenarios are denoted as the first training-test (scenario 1) and second training-test (scenario 2). In the first scenario, data from 4 January 2007, to 3 July 2011, were used for models’ training, while the remaining data from 4 July 2011, to 31 December 2015, were used for model testing at both stations. In the second scenario, the training and test data sets were swapped (data from 4 July 2011, to 31 December 2015, were used for the models’ training and data from 4 January 2007, to 3 July 2011, were used for the models’ testing). These two scenarios allowed comparing the overall models’ accuracy for the total range of the dataset. Model accuracy was computed by comparing the measured and the modeled data at each station separately using Nash–Sutcliffe efficiency (NSE), root mean squared error (RMSE: kg/s), and mean absolute error (MAE: kg/s).

3.2. Comparison of Accuracy among Models: Guangyuan Station

Table 1 shows the results obtained using ANFIS models for seven input combinations and two scenarios. In Table 1, Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study) and vice versa. For only the Q as input, i.e., from input combination (i) Qt to input combination (iv) Qt, Qt-1, Qt-2, and Qt-3, the models showed a moderate to low accuracy, with mean NSE, RMSE, and MAE of 0.514, 1856.25 kg/s, and 346.75 kg/s, respectively.
The strong contribution of Qt is apparent, since there is no improvement in the models’ performance after input combination (i). Instead, the mean NSE value dropped sharply from 0.608 to 0.382 (37.17%) after including time lags of Q as input in combinations (ii) to (iv). The mean RMSE also increased from 1663 to 2104 kg/s (20.96%) and the mean MAE from 326 to 382 kg/s or by 14.65%. This indicates that only Qt should be considered as a predictor for modeling St. The comparison of model performance for two scenarios, namely, the first training-test and the second training-test, showed little difference in the models’ performance. The three statistical indices were relatively close to each other for the two scenarios. Table 1 shows a strong impact of sediment (St) on the ANFIS model accuracy. Beyond the input combination (iv), i.e., input combinations (v), (vi), and (vii), the ANFIS model showed a gradual performance improvement. The (St-1) combined with Qt (input combination (v)) provided the highest accuracy compared to the ANFIS model with only Qt as input (input combination (i)). The mean NSE increased by 8.85% for combination (v) compared to input combination (i). However, it should be noted that the importance of St depends greatly on the number of lags included. Including more lags as predictors, i.e., the inclusion of two lags, St-1 and St-2 (input combination (vi)) or three lags, St-1, St-2, and St-3 (input combination (vi)), leads to a reduction in mean NSE by 6.44 and 29.68%, and an increase in mean RMSE by 24.11%, respectively. Overall, the best accuracy using the ANFIS model was achieved for input combination (v) with a mean NSE of 0.667.
The results obtained using the M5Tree model are reported in Table 2. The improvement achieved using the M5Tree model compared to the ANFS model was marginal. The M5Tree with the second input combination (Qt and Qt-1) yielded the best accuracy among the Q input-based models, with an average NSE value of 0.581. The prediction accuracy for the second input combination was higher than 1.20%, 11.87%, and 4.17% compared to that obtained using the input combinations of (i), (iii), and (iv), respectively. The difference in RMSE between the second and the fourth combination was the largest, an increase from 1716 to 1870 kg/s (8.23%.). To assess the impact of St on the model’s performance, one to three St lags were combined with Qt and Qt-1 in input combinations (v) to (vii) (Table 2). The RMSE showed a slight decrease by ~1.87% and ~8.31% for input combination (iv) and (v) (models without St and with St), respectively.
Nearly the same accuracy was achieved for all models using input combinations (vi) and (vii). The NSE was markedly higher and ranged from 0.663 to 0.672, with an average of 0.668 for those two input combinations. The accuracy increased most distinctly, with a decrease in RMSE and MAE by ~10.25 and ~18.80%, on average, between input combination (ii) and (vi). However, the inclusion of St-3 did not increase the NSE or decrease the RMSE and MAE. Consequently, M5Tree using the sixth and seventh combinations can be considered as the best models.
The statistical performance of the MARS model for both training scenarios is shown in Table 3. The results showed moderate MARS model accuracy for the first four input combinations (i, ii, iii, and iv), with a mean NSE value ranging from 0.567 to 0.595. It indicates a marginal gradual increase, yet more significant than that observed using ANFIS and M5Tree models. However, the improvement in the models’ accuracy by increasing the number of inputs from one (Qt) to four (Qt, Qt-1, Qt-2, and Qt-3) was almost marginal, less than ~4.70% in NSE and ~3.37% and ~8.00%, in RMSE and MAE, respectively. Table 3 shows that the accuracy of the MARS models was higher for the second training-test dataset than the first training-test dataset for all input combinations. It means no substantial improvement with the increased number of inputs beyond two. Therefore, the combination (ii), having only Qt and Qt-1, was deemed for model development. The performances of MARS models improved significantly after the fourth input combination (Table 3). The mean NSE increased from 0.595 to 0.759 or by ~21.60%, the mean RMSE decreased from 1691 to 1312 kg/s or by ~22.41%, and the mean MAE dropped from 350 to 241 kg/s or by ~31.14%. The MARS model for the input combination (v) showed an overall higher accuracy than the sixth and seventh input combinations, having a slightly larger NSE value of 0.759. The MARS models’ performance for the sixth and seventh combination was similar, with equal mean RMSE and MAE values of 1357 and 256 kg/s and a negligible mean NSE value of only 0.002. Overall, the MARS model for input combination (v) was the best model.
The statistical performance of the MARS–KM model for different input combinations and training scenarios is given in Table 4. Good accuracy using MARS–KM was observed for all the input combinations in terms of all three statistical metrics. The performance was higher compared to the ANFIS, M5Tree, and MARS models. The mean RMSE was higher (1342 kg/s) for the first four input combinations ((i) to (iv)) than for the last four input combinations ((v) to (vii)) (1158 kg/s). The differences observed for the four first input combinations were as follows: (1) good prediction accuracy using the MARS–KM model for the fourth input combination (Qt, Qt-1, Qt-2, and Qt-3) with a mean NSE value of 0.813, a mean RMSE value of 1158 kg/s, and a mean MAE value of 210 kg/s; (2) a slight to significant difference of mean RMSE, equal to 3.105% and 13.711% between the fourth and first combinations, and second and third combinations, respectively; and (3) the MAE of MARS–KM models’ accuracy dropped significantly for the fourth input combination. The inclusion of different lags of St as input showed a marked improvement in the models’ accuracy. For the three last input combinations (v, vi, and vii), the mean RMSE and MAE values rapidly decreased (dropped from 1158 to 1144 kg/s), while the NSE slightly increased from 0.813 to 0.818. Overall, MARS–KM also showed better performance for the fifth input combination.
The comparison of four machine learning methods with the corresponding best input combination is shown in Table S2. The four models exhibited different accuracy varying with mean NSE ranging from 0.608 to 0.818, mean RMSE between 1143 and 1663 kg/s, and mean MAE between 177 and 332 kg/s. The MARS–KM enhanced the St prediction significantly, while the ANFIS showed the least accuracy compared to the other models. The results highlight that, although the models were developed using the same input variables, their capabilities in capturing the major variability and uncertainty in the dataset were variable. The most apparent difference between the models was between MARS–KM and the ANFIS. The MARS–KM improved accuracy compared to ANRIS by 21%, 31.27%, and 44.53% in terms of NSE, RMSE, and MAE, respectively. The M5Tree and MARS models lie between the two extremes. The differences between the two showed that the MARS algorithm generally enhanced the M5Tree accuracy by an average of 14.80% and 6.95% reduction of RMSE and MAE, respectively. Table S2 indicates that, on average, the results obtained using different models differ significantly in terms of different metrics. For example, the variation of RMSE was lower than 12% between MARS and MARS–KM and 31% between ANFIS and MARS–KM. Overall, the models can be ranked in decreasing performance order as MARS–KM, MARS, M5Tree, and ANFIS.

3.3. Comparison of Accuracy among Models: Beibei Station

The results obtained using the ANFIS model for all input combinations and training scenarios at the Beibei Station are presented in Table 5. The results showed ANFIS models for the first four input combinations, (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; and (iv) Qt, Qt-1, Qt-2, and Qt-3, yielded relatively similar mean RMSE and MAE, ranging from 3553 to 3628 kg/s and 610 to 710 kg/s, respectively, whereas the fourth input combination showed the highest mean RMSE and lowest NSE.
Therefore, only Qt was combined with different lags of S to form the input combinations of (v), (vi), and (vii). The results showed a strong to moderate improvement in accuracy, with mean NSE value ranging from 0.602 to 0.693, mean RMSE ranging from 3130 to 3582 kg/s, and a mean MAE between 595 and 663 kg/s. The highest mean NSE value of 0.693 was found for the input combination (v). Relatively low mean NSE of 0.602 and large mean RMSE and MAE were found for the input combination (vii), highlighting the negligible contribution of St-2 and St-3 (Table 5). The increasing number of input variables showed a minimal contribution to ANFIS model performance improvement at this station.
Results obtained for the M5Tree model are reported in Table 6. Suspended sediment simulated from the first four input combinations showed a weak and insignificant difference between the models, with a slight superiority of the first input combination (only the Qt). Table 6 shows the variation of the RMSE, MAE, and NSE values averaged for different input combinations.
The results showed an apparent decrease in the model’s performances from the input combination (i) to the input combination (iv). The mean RMSE and MAE values increased from 3892 to 4309 kg/s (9.67%) and from 566 to 612 kg/s (7.51%), respectively, and the mean NSE value gradually declined to its lowest value of 0.423. This negligible difference in the models’ accuracy might be due to the marginal effect of the higher lag streamflow data, which have already been highlighted in the previous discussion. Therefore, the inclusion of only Qt was sufficient for predicting suspended sediment. The effect of an increasing number of input variables on M5Tree performances can also be observed in Table 6. There was a positive effect of St on model accuracy. Interestingly, the suspended sediment was more sensitive to its antecedent values than the Q. The lowest RMSE and MAE values of 3087 and 473 kg/s, respectively, and the mean NSE of 0.705 were obtained using the input combination (vii) (Qt, St-1, St-2, and St-3). The significant increase in the NSE value from 0.522 to 0.705 (18.3%) indicates that the inclusion of St-1, St-2, and St-3 has significantly contributed to M5Tree performances. Nevertheless, the sensitivity of the M5Tree model to the inclusion of the St was not the same for both training-test scenarios. The improvement was more significant for the second training-test data set.
The performances of the MARS model for different input combinations are shown in Table 7. An overall maximum mean NSE value of 0.545 was obtained using only the Qt as the input (input combination (i)), suggesting a weak level of agreement between measured and predicted suspended sediment. Mean RMSE and MAE values of 3822 and 631 kg/s were achieved using only the Qt, and the level of accuracy remained very low regardless of the number of Q lags included from one to four. Table 7 revealed Qt as the most dominant input variable. Therefore, only the first combination was coupled with different lag values of sediment. The St simulations for the input combinations (v), (vi), and (vii) showed better performance (Table 7). The NSE ranged from 0.706 to 0.728, with a mean of 0.720. The performances of the input combination (vi) (Qt, St-1, and St-2) and input combination (vii) (Qt, St-1, St-2, and St-3) were quite similar, where the input combination (v) performed less well with a lower mean NSE (0.706) and higher RMSE (3070 kg/s) and MAE (534 kg/s) values. The above results indicate that the input combination (vii) should be used to obtain the best accuracy.
Table 8 summarizes the statistics of MARS–KM models. MARS–KM at Beibei Station showed exceptional performance compared to other models. The results indicated the model’s higher ability to predict the suspended sediment independently and successfully, even without the inclusion of St lags as input. The NSE values for the seven input combinations were in the range of 0.810 to 8.17 with a mean of ~0.754. The best accuracy was achieved using only the Qt and Qt-1 as inputs (input combination (ii)), with a mean NSE of 0.817. The RMSE and MAE for the best model (input combination (ii)) were much smaller, ~2428 and ~2428 kg/s, respectively. The results described above indicate the MARS–KM model’s effectiveness in predicting suspended sediment.
The relative performance of the four models with the best input combinations is presented in Table S3. The results demonstrated that the performances of the models were relatively far from excellent. None of the models, i.e., ANFIS, M5Tree, MARS, and MARS–KM, achieved an NSE higher than 0.90. Overall, the performances of MARS–KM were remarkably superior. The MARS–KM improved the mean NSE of ANFIS, M5Tree, and MARS by 12.4%, 11.2%, and 8.9%, respectively. Additionally, it reduced the RMSE of ANFIS, M5Tree, and MARS by 22.42%, 21.34%, and 19.91%, respectively, and the MAE by 32.60%, 15.22%, and 22.73%, respectively.
The suspended sediment estimation ability of machine learning models was further assessed through visual comparison with the in-situ data (Figure 5a–d). MARS–KM and MARS reproduced suspended sediment variation much better and thus enhanced M5Tree and ANFIS models’ prediction accuracy. The scatterplots (Figures S2–S5, see Supplementary Materials) revealed that (i) the underestimated data points were much higher than the overestimated data points, and (ii) all the models failed to simulate large suspended sediment values. It is apparent from Figure 6 that the MARS–KM shows superiority in simulating cumulative sediment amounts compared to other alternatives.
In a recently published paper, Juez et al. [59] studied the sediment hysteresis, a direct link among sediment size, distal sediment supply, and proximal sediment data obtained through a laboratory experiment. The authors demonstrated that sediment in the channel downstream depends mainly on the time-varying sediment load with different hysteresis types. The study also highlighted that sediment availability is governed by the evolution of two important morphological parts of the riverbed, degradation and aggradation. The shapes of hysteresis loops have often been intrinsically correlated to these two morphological processes. Finally, one of the important findings of the above-reported investigation is that the sediment concentration–discharge hysterical behavior is increasingly likely to amount between the distal sediment supply and the proximal sediment availability.
Suspended sediment concentration (SSC) and discharge (Q) are two variables with a temporal shift; consequently, it is important to focus on these approaches’ weaknesses and limitations in modeling these kinds of variables. Based on the direct linking of SSC to Q, the empirical models can estimate SSC reasonably. However, data-driven models resulted in slightly better performances in predicting the amount of SSC. Interpretation of the empirical models is more straightforward, as physical, morphological, and hydrological processes are explicitly expressed with simplified equations. However, it is appropriate for data-driven black-box models to examine whether it is possible to simulate SSC with input values outside the data range used during their calibration. Indeed, both the empirical and data-driven models showed encouraging results in terms of model accuracy; physical interpretation of the data-driven models is a challenge, thus requiring further analysis in quantifying the correlation between the input and output variables in a more meaningful way. When extending the models to another watershed, the empirical models may be more practical because of local calibration. Additionally, most input variables (i.e., the Q) undergo a rapid momentary fluctuation, which is very hard to capture with data-driven models. This deficiency makes the data-driven models unable to generate a durable and continuous response. Clearly, although the advantages exist, the limitations are always existing, which should be addressed in future studies.

4. Conclusions

In this investigation, a new method was developed by hybridizing MARS and the K-means clustering algorithm to improve the accuracy of suspended sediment prediction. The models were developed using daily discharge and sediment data at two stations in China. The MARS–KM models’ performance was compared with ANFIS, MARS, and M5Tree models using three statistical metrics, RMSE, MAE, and NSE, and graphical comparison. The following conclusions were reached from the outcomes of the presented work:
The proposed MARS–KM considerably improved the accuracy of the ANFIS, MARS, and M5Tree methods. The increments in the RMSE of the three mentioned methods were by 39%, 30%, and 18%, and 24%, 22%, and 8% for the first and second scenarios at the Guangyuan Station, and by 34%, 26%, and 27%, and 7%, 16%, and 6% for the first and second scenarios at the Beibei Station, respectively.
  • The suspended sediment in the studied region is generally sensitive to its lagged values rather than the lag discharge values. However, the MARS–KM models could estimate suspended sediment satisfactory using only discharge (Q) as inputs. It is very important in practical applications, because the measurement of suspended sediment is often very difficult.
  • Comparison of models’ ability in simulating cumulative suspended sediment loads also showed the superiority of MARS–KM compared to ANFIS, MARS, and M5Tree methods.
In this study, seasonality in the sediment load and discharge time series was not considered. It can be addressed in future studies. The methods may produce better estimates when season information is included in the models.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/su13094648/s1, Figure S1: Time variation graph of sediment load for (a) Guangyuan and (b) Beibei Station, Figure S2: Time variation graphs of the observed and estimated sediments by ANFIS, M5Tree, MARS and MARS-KM models in the test period at Guangyuan Station for the 1st training-test scenario, Figure S3: Time variation graphs of the observed and estimated sediments by ANFIS, M5Tree, MARS and MARS-KM models in the test period at Guangyuan Station for the 2nd training-test scenario, Figure S4: Time variation graphs of the observed and estimated sediments by ANFIS, M5Tree, MARS and MARS-KM models in the test period of Beibei Station—1st training-test scenario, Figure S5: Time variation graphs of the observed and estimated sediments by ANFIS, M5Tree, MARS and MARS-KM models in the test period at Beibei Station for the 2nd training-test scenario; Table S1: The statistical parameters of the data used in the study, Table S2: Performance of the best ANFIS, M5Tree, MARS and MARS-KM models in sediment prediction at Guangyuan Station, Table S3: Performance of the best ANFIS, M5Tree, MARS and MARS-KM models in sediment prediction at Beibei Station.

Author Contributions

Conceptualization: R.M.A., O.K., and K.S.P.; formal analysis: S.H., S.S., O.K., and R.M.A.; validation: R.M.A., S.H., K.S.P., S.S., and O.K.; supervision: S.S. and O.K.; writing original draft: R.M.A., S.H., K.S.P., S.S., O.K., and R.M.A.; visualization: R.M.A., S.H., and K.S.P.; investigation: R.M.A., S.H., and K.S.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Key R&D Program of China. (2016YFC0402706).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study will be available on interested request from the corresponding author.

Conflicts of Interest

There is no conflict of interest in this study.

References

  1. Ampomah, R.; Hosseiny, H.; Zhang, L.; Smith, V.; Sample-Lord, K. A Regression-Based Prediction Model of Suspended Sediment Yield in the Cuyahoga River in Ohio Using Historical Satellite Images and Precipitation Data. Water 2020, 12, 881. [Google Scholar] [CrossRef] [Green Version]
  2. Zarris, D.; Vlastara, M.; Panagoulia, D. Sediment Delivery Assessment for a Transboundary Mediterranean Catchment: The Example of Nestos River Catchment. Water Resour. Manag. 2011, 25, 3785–3803. [Google Scholar] [CrossRef]
  3. Afan, H.A.; El-Shafie, A.; Mohtar, W.H.M.W.; Yaseen, Z.M. Past, present and prospect of an Artificial Intelligence (AI) based model for sediment transport prediction. J. Hydrol. 2016, 541, 902–913. [Google Scholar] [CrossRef]
  4. Khan, M.Y.A.; Tian, F.; Hasan, F.; Chakrapani, G.J. Artificial neural network simulation for prediction of suspended sediment concentration in the River Ramganga, Ganges Basin, India. Int. J. Sediment Res. 2019, 34, 95–107. [Google Scholar] [CrossRef]
  5. Bisoyi, N.; Gupta, H.; Padhy, N.P.; Chakrapani, G.J. Prediction of daily sediment discharge using a back propagation neural network training algorithm: A case study of the Narmada River, India. Int. J. Sediment Res. 2019, 34, 125–135. [Google Scholar] [CrossRef]
  6. Adnan, R.M.; Liang, Z.; Trajkovic, S.; Zounemat-Kermani, M.; Li, B.; Kisi, O. Daily streamflow prediction using optimally pruned extreme learning machine. J. Hydrol. 2019, 577, 123981. [Google Scholar] [CrossRef]
  7. Kumar, D.; Pandey, A.; Sharma, N.; Flügel, W.-A. Modeling Suspended Sediment Using Artificial Neural Networks and TRMM-3B42 Version 7 Rainfall Dataset. J. Hydrol. Eng. 2015, 20, C4014007. [Google Scholar] [CrossRef]
  8. Adnan, R.M.; Yuan, X.; Kisi, O.; Adnan, M.; Mehmood, A. Stream Flow Forecasting of Poorly Gauged Mountainous Watershed by Least Square Support Vector Machine, Fuzzy Genetic Algorithm and M5 Model Tree Using Climatic Data from Nearby Station. Water Resour. Manag. 2018, 32, 4469–4486. [Google Scholar] [CrossRef]
  9. Alizamir, M.; Kisi, O.; Muhammad Adnan, R.; Kuriqi, A. Modelling reference evapotranspiration by combining neuro-fuzzy and evolutionary strategies. Acta Geophys. 2020, 68, 1113–1126. [Google Scholar] [CrossRef]
  10. Kisi, O.; Shiri, J.; Karimi, S.; Adnan, R.M. Three different adaptive neuro fuzzy computing techniques for forecasting long-period daily streamflows. In Big Data in Engineering Applications; Springer: Singapore, 2018; pp. 303–321. [Google Scholar]
  11. Yuan, X.; Chen, C.; Lei, X.; Yuan, Y.; Adnan, R.M. Monthly runoff forecasting based on LSTM–ALO model. Stoch. Environ. Res. Risk Assess. 2018, 32, 2199–2212. [Google Scholar] [CrossRef]
  12. Muhammad Adnan, R.; Chen, Z.; Yuan, X.; Kisi, O.; El-Shafie, A.; Kuriqi, A.; Ikram, M. Reference Evapotranspiration Modeling Using New Heuristic Methods. Entropy 2020, 22, 547. [Google Scholar] [CrossRef]
  13. Nourani, V.; Andalib, G. Daily and monthly suspended sediment load predictions using wavelet based artificial intelligence approaches. J. Mt. Sci. 2015, 12, 85–100. [Google Scholar] [CrossRef]
  14. Mustafa, M.R.; Rezaur, R.B.; Saiedi, S.; Isa, M.H. River suspended sediment prediction using various multilayer perceptron neural network training algorithms—A case study in Malaysia. Water Resour. Manag. 2012, 26, 1879–1897. [Google Scholar] [CrossRef]
  15. Nourani, V.; Kalantari, O.; Baghanam, A.H. Two Semidistributed ANN-Based Models for Estimation of Suspended Sediment Load. J. Hydrol. Eng. 2012, 17, 1368–1380. [Google Scholar] [CrossRef]
  16. Kisi, O.; Yaseen, Z.M. The potential of hybrid evolutionary fuzzy intelligence model for suspended sediment concentration prediction. Catena 2019, 174, 11–23. [Google Scholar] [CrossRef]
  17. Bakhtyar, R.; Ghaheri, A.; Yeganeh-Bakhtiary, A.; Baldock, T. Longshore sediment transport estimation using a fuzzy inference system. Appl. Ocean Res. 2008, 30, 273–286. [Google Scholar] [CrossRef]
  18. Kabiri-Samani, A.; Aghaee-Tarazjani, J.; Borghei, S.; Jeng, D. Application of neural networks and fuzzy logic models to long-shore sediment transport. Appl. Soft Comput. 2011, 11, 2880–2887. [Google Scholar] [CrossRef]
  19. Mianaei, S.J.; Keshavarzi, A.R. Prediction of riverine suspended sediment discharge using fuzzy logic algorithms, and some implications for estuarine settings. Geo-Mar. Lett. 2010, 30, 35–45. [Google Scholar] [CrossRef]
  20. Kumar, A.; Kumar, P.; Singh, V.K. Evaluating Different Machine Learning Models for Runoff and Suspended Sediment Simulation. Water Resour. Manag. 2019, 33, 1217–1231. [Google Scholar] [CrossRef]
  21. Kisi, O.; Zounemat-Kermani, M. Suspended Sediment Modeling Using Neuro-Fuzzy Embedded Fuzzy c-Means Clustering Technique. Water Resour. Manag. 2016, 30, 3979–3994. [Google Scholar] [CrossRef]
  22. Vafakhah, M. Comparison of cokriging and adaptive neuro-fuzzy inference system models for suspended sediment load forecasting. Arab. J. Geosci. 2013, 6, 3003–3018. [Google Scholar] [CrossRef]
  23. Rajaee, T.; Mirbagheri, S.A.; Zounemat-Kermani, M.; Nourani, V. Daily suspended sediment concentration simulation using ANN and neuro-fuzzy models. Sci. Total. Environ. 2009, 407, 4916–4927. [Google Scholar] [CrossRef]
  24. Firat, M.; Güngör, M. Monthly total sediment forecasting using adaptive neuro fuzzy inference system. Stoch. Environ. Res. Risk Assess. 2009, 24, 259–270. [Google Scholar] [CrossRef]
  25. Samet, K.; Hoseini, K.; Karami, H.; Mohammadi, M. Comparison between Soft Computing Methods for Prediction of Sediment Load in Rivers: Maku Dam Case Study. Iran. J. Sci. Technol. Trans. Civ. Eng. 2018, 43, 93–103. [Google Scholar] [CrossRef]
  26. Chang, C.K.; Azamathulla, H.M.; Zakaria, N.A.; Ab Ghani, A. Appraisal of soft computing techniques in prediction of total bed material load in tropical rivers. J. Earth Syst. Sci. 2012, 121, 125–133. [Google Scholar] [CrossRef] [Green Version]
  27. Mirbagheri, S.A.; Nourani, V.; Rajaee, T.; Alikhani, A. Neuro-fuzzy models employing wavelet analysis for suspended sediment concentration prediction in rivers. Hydrol. Sci. J. 2010, 55, 1175–1189. [Google Scholar] [CrossRef] [Green Version]
  28. Rajaee, T. Wavelet and Neuro-fuzzy Conjunction Approach for Suspended Sediment Prediction. CLEAN Soil Air Water 2010, 38, 275–286. [Google Scholar] [CrossRef]
  29. Rajaee, T.; Mirbagheri, S.A.; Nourani, V.; Alikhani, A. Prediction of daily suspended sediment load using wavelet and neurofuzzy combined model. Int. J. Environ. Sci. Technol. 2010, 7, 93–110. [Google Scholar] [CrossRef] [Green Version]
  30. Chou, S.-M.; Lee, T.-S.; Shao, Y.E.; Chen, I.-F. Mining the breast cancer pattern using artificial neural networks and multivariate adaptive regression splines. Expert Syst. Appl. 2004, 27, 133–142. [Google Scholar] [CrossRef]
  31. Adnan, R.M.; Liang, Z.; Parmar, K.S.; Soni, K.; Kisi, O. Modeling monthly streamflow in mountainous basin by MARS, GMDH-NN and DENFIS using hydroclimatic data. Neural Comput. Appl. 2021, 33, 2853–2871. [Google Scholar] [CrossRef]
  32. Al-Sudani, Z.A.; Salih, S.Q.; Sharafati, A.; Yaseen, Z.M. Development of multivariate adaptive regression spline integrated with differential evolution model for streamflow simulation. J. Hydrol. 2019, 573, 1–12. [Google Scholar] [CrossRef]
  33. Mehdizadeh, S.; Fathian, F.; Safari, M.J.S.; Adamowski, J.F. Comparative assessment of time series and artificial intelligence models to estimate monthly streamflow: A local and external data analysis approach. J. Hydrol. 2019, 579, 124225. [Google Scholar] [CrossRef]
  34. Adnan, R.M.; Petroselli, A.; Heddam, S.; Santos, C.A.G.; Kisi, O. Short term rainfall-runoff modelling using several machine learning methods and a conceptual event-based model. Stoch. Environ. Res. Risk Assess. 2021, 35, 597–616. [Google Scholar] [CrossRef]
  35. Nourani, V.; Molajou, A.; Tajbakhsh, A.D.; Najafi, H. A Wavelet Based Data Mining Technique for Suspended Sediment Load Modeling. Water Resour. Manag. 2019, 33, 1769–1784. [Google Scholar] [CrossRef]
  36. Rahgoshay, M.; Feiznia, S.; Arian, M.; Hashemi, S.A.A. Simulation of daily suspended sediment load using an improved model of support vector machine and genetic algorithms and particle swarm. Arab. J. Geosci. 2019, 12. [Google Scholar] [CrossRef]
  37. Malik, A.; Kumar, A.; Kisi, O.; Shiri, J. Evaluating the performance of four different heuristic approaches with Gamma test for daily suspended sediment concentration modeling. Environ. Sci. Pollut. Res. 2019, 26, 22670–22687. [Google Scholar] [CrossRef]
  38. Kumar, A.R.S.; Ojha, C.S.P.; Goyal, M.K.; Singh, R.D.; Swamee, P.K. Modeling of Suspended Sediment Concentration at Kasol in India Using ANN, Fuzzy Logic, and Decision Tree Algorithms. J. Hydrol. Eng. 2012, 17, 394–404. [Google Scholar] [CrossRef]
  39. Goyal, M.K. Modeling of Sediment Yield Prediction Using M5 Model Tree Algorithm and Wavelet Regression. Water Resour. Manag. 2014, 28, 1991–2003. [Google Scholar] [CrossRef]
  40. Kim, C.M.; Parnichkun, M. Prediction of settled water turbidity and optimal coagulant dosage in drinking water treatment plant using a hybrid model of k-means clustering and adaptive neuro-fuzzy inference system. Appl. Water Sci. 2017, 7, 3885–3902. [Google Scholar] [CrossRef] [Green Version]
  41. Wu, L.; Peng, Y.; Fan, J.; Wang, Y.; Huang, G. A novel kernel extreme learning machine model coupled with K-means clustering and firefly algorithm for estimating monthly reference evapotranspiration in parallel computation. Agric. Water Manag. 2021, 245, 106624. [Google Scholar] [CrossRef]
  42. Georgogiannis, A. Robust k-means: A theoretical revisit. Adv. Neural Inf. Process. Syst. 2016, 29, 2891–2899. [Google Scholar]
  43. Kondo, Y.; Salibian-Barrera, M.; Zamar, R. RSKC: An R package for a robust and sparse k-means clustering algorithm. J. Stat. Softw. 2016, 72, 5. [Google Scholar] [CrossRef] [Green Version]
  44. Brodinová, Š.; Filzmoser, P.; Ortner, T.; Breiteneder, C.; Rohm, M. Robust and sparse k-means clustering for high-dimensional data. Adv. Data Anal. Classif. 2019, 13, 905–932. [Google Scholar] [CrossRef] [Green Version]
  45. Affes, Z.; Kaffel, R.H. Forecast Bankruptcy Using a Blend of Clustering and MARS Model—Case of US Banks. SSRN Electron. J. 2016, 281, 27–64. [Google Scholar] [CrossRef] [Green Version]
  46. Dai, S.; Yang, S.; Cai, A. Impacts of dams on the sediment flux of the Pearl River, southern China. Catena 2008, 76, 36–43. [Google Scholar] [CrossRef]
  47. Zhang, W.; Wei, X.; Jinhai, Z.; Yuliang, Z.; Zhang, Y. Estimating suspended sediment loads in the Pearl River Delta region using sediment rating curves. Cont. Shelf Res. 2012, 38, 35–46. [Google Scholar] [CrossRef]
  48. Zadeh, L.A. Fuzzy sets. Inf. Control. 1965, 8, 338–353. [Google Scholar] [CrossRef] [Green Version]
  49. Parmar, K.S.; Bhardwaj, R. River Water Prediction Modeling Using Neural Networks, Fuzzy and Wavelet Coupled Model. Water Resour. Manag. 2015, 29, 17–33. [Google Scholar] [CrossRef]
  50. Kisi, O.; Parmar, K.S. Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution. J. Hydrol. 2016, 534, 104–112. [Google Scholar] [CrossRef]
  51. Quinlan, J.R. Learning with continuous classes. In Proceedings of the 5th Australian Joint Conference on Artificial Intelligence, Hobart, Tasmania, 16–18 November 1992; Volume 92, pp. 343–348. [Google Scholar]
  52. Wang, Y.; Witten, I.H. Induction of model trees for predicting continuous lasses. In Proceedings of the Poster Papers of the European Conference on Machine Learning, 9th European Conference on Machine Learning, Prague, Czech Republic, 23–25 April 1997. [Google Scholar]
  53. Friedman, J.H. Multivariate Adaptive Regression Splines. Ann. Stat. 1991, 19, 1–67. [Google Scholar] [CrossRef]
  54. De Andrés, J.; Lorca, P.; de Cos Juez, F.J.; Sánchez-Lasheras, F. Bankruptcy forecasting: A hybrid approach using Fuzzy c-means clustering and Multivariate Adaptive Regression Splines (MARS). Expert Syst. Appl. 2011, 38, 1866–1875. [Google Scholar] [CrossRef]
  55. Lloyd, S. Least squares quantization in PCM. IEEE Trans. Inf. Theory 1982, 28, 129–137. [Google Scholar] [CrossRef]
  56. MacQueen, J. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA, 21 June 1967; Volume 1, pp. 281–297. [Google Scholar]
  57. Hartigan, J.A.; Wong, M.A. Journal of the Royal Statistical Society. Ser. C 1979, 28, 100–108. [Google Scholar]
  58. Adnan, R.M.; Khosravinia, P.; Karimi, B.; Kisi, O. Prediction of hydraulics performance in drain envelopes using Kmeans based multivariate adaptive regression spline. Appl. Soft Comput. 2021, 100, 107008. [Google Scholar] [CrossRef]
  59. Juez, C.; Hassan, M.A.; Franca, M.J. The Origin of Fine Sediment Determines the Observations of Suspended Sediment Fluxes Under Unsteady Flow Conditions. Water Resour. Res. 2018, 54, 5654–5669. [Google Scholar] [CrossRef]
Figure 1. The geographical location of the study area.
Figure 1. The geographical location of the study area.
Sustainability 13 04648 g001aSustainability 13 04648 g001b
Figure 2. Basic architecture of ANFIS.
Figure 2. Basic architecture of ANFIS.
Sustainability 13 04648 g002
Figure 3. The working procedure of MARS.
Figure 3. The working procedure of MARS.
Sustainability 13 04648 g003
Figure 4. The working procedure of MARS–KMeans.
Figure 4. The working procedure of MARS–KMeans.
Sustainability 13 04648 g004
Figure 5. Scatterplots of the observed and estimated sediments by ANFIS, M5Tree, MARS, and MARS–KM models in the test period at (a) Guangyuan Station for the first training-test scenario, (b) Guangyuan Station for the second training-test scenario, (c) Beibei Station for the first training-test scenario, and (d) Beibei Station for the second training-test scenario.
Figure 5. Scatterplots of the observed and estimated sediments by ANFIS, M5Tree, MARS, and MARS–KM models in the test period at (a) Guangyuan Station for the first training-test scenario, (b) Guangyuan Station for the second training-test scenario, (c) Beibei Station for the first training-test scenario, and (d) Beibei Station for the second training-test scenario.
Sustainability 13 04648 g005
Figure 6. Cumulative sediment amounts produced by the ANFIS, M5Tree, MARS, and MARS–KM models in the test period: (a) Guangyuan Station for the first training-test scenario, (b) Guangyuan Station for the second training-test scenario, (c) Beibei Station for the first training-test scenario, and (d) Beibei Station for the first training-test scenario.
Figure 6. Cumulative sediment amounts produced by the ANFIS, M5Tree, MARS, and MARS–KM models in the test period: (a) Guangyuan Station for the first training-test scenario, (b) Guangyuan Station for the second training-test scenario, (c) Beibei Station for the first training-test scenario, and (d) Beibei Station for the first training-test scenario.
Sustainability 13 04648 g006aSustainability 13 04648 g006b
Table 1. Performance of ANFIS model for different input combinations and training-test scenarios at Guangyuan Station.
Table 1. Performance of ANFIS model for different input combinations and training-test scenarios at Guangyuan Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test1649165817251834147015031608
Second training-test1677192920032374316234844496
Mean1663179418642104231624943052
MAEFirst training-test340302338377296296319
Second training-test323350355387608565209
Mean332326347382452431264
NSEFirst training-test0.5630.5590.5220.460.6530.6370.585
Second training-test0.6520.5430.5040.3030.680.6110.353
Mean0.6080.5510.5130.3820.6670.6240.469
In the table, input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt and St-1; (vi) Qt, St-1, and St-2; and (vi) Qt, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (i) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination.
Table 2. Performance of M5Tree model for different input combinations and training-test scenarios at Guangyuan Station.
Table 2. Performance of M5Tree model for different input combinations and training-test scenarios at Guangyuan Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test1756173119631953162214281428
Second training-test1700170117021786204716511651
Mean1728171618331870183515401540
MAEFirst training-test329328380361284249249
Second training-test311310314334304269269
Mean320319347348294259259
NSEFirst training-test0.5050.5190.3810.3940.5770.6720.672
Second training-test0.6420.6420.6420.6050.4820.6630.663
Mean0.5740.5810.5120.5000.5300.6680.668
In the table, input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, and St-1; (vi) Qt, Qt-1, St-1, and St-2; (vi) Qt, Qt-1, St-1, St-2, and St-3 where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (ii) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination.
Table 3. Performance of MARS model for different input combinations and training-test scenarios at Guangyuan Station.
Table 3. Performance of MARS model for different input combinations and training-test scenarios at Guangyuan Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test1717167616761667122513111311
Second training-test1783170517151715139914021402
Mean1750169116961691131213571357
MAEFirst training-test318327347351265286286
Second training-test325312349349217226226
Mean322320348350241256256
NSEFirst training-test0.5260.5490.5490.5540.7590.720.724
Second training-test0.6070.640.6360.6360.7580.7570.757
Mean0.5670.5950.5930.5950.7590.7390.741
In the table, for the first training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, Qt-2, Qt-3, and St-1; (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, and St-2; and (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (vi) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination. Similarly, for the second training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, and St-1; (vi) Qt, Qt-1, St-1, and St-2; and (vi) Qt, Qt-1, St-1, St-2, and St-3.
Table 4. Performance of MARS–KM model for different input combinations and training-test scenarios at Guangyuan Station.
Table 4. Performance of MARS–KM model for different input combinations and training-test scenarios at Guangyuan Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test1103140011081029100310031002
Second training-test1285128412841286128212841285
Mean1194134211961158114311441144
MAEFirst training-test216280223232187187185
Second training-test188185185187167168170
Mean202233204210177178178
NSEFirst training-test0.8050.6850.8030.830.8380.8380.839
Second training-test0.7960.7960.7960.7950.7970.7960.796
Mean0.8010.7410.8000.8130.8180.8170.818
In the table, for the first training-test data set, the input combinations are: (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, Qt-2, Qt-3, and St-1; (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, and St-2; and (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (vi) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination. Similarly, for the second training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt and St-1; (vi) Qt, St-1, and St-2; and (vi) Qt, St-1, St-2, and St-3.
Table 5. Performance of ANFIS model for different input combinations and training-test scenarios at Beibei Station.
Table 5. Performance of ANFIS model for different input combinations and training-test scenarios at Beibei Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test4003398240644087359134413909
Second training-test3163312331593168266832953254
Mean3583355336123628313033683582
MAEFirst training-test743644663673715746796
Second training-test677576643632474511529
Mean710610653653595629663
NSEFirst training-test0.520.5250.5050.4990.6140.6450.546
Second training-test0.680.6880.6810.6790.7720.6530.661
Mean0.6000.6070.5930.5890.6930.6490.602
In the table, input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt and St-1; (vi) Qt, St-1, and St-2; and (vi) Qt, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (i) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination. Similarly, for the second training-test data set, the input combinations are (i) Qt, (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, and St-1; (vi) Qt, Qt-1, St-1, and St-2; and (vi) Qt, Qt-1, St-1, St-2, and St-3.
Table 6. Performance of M5Tree model for different input combinations and training-test scenarios at Beibei Station.
Table 6. Performance of M5Tree model for different input combinations and training-test scenarios at Beibei Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test4567477145964728442632213221
Second training-test3217321839513890330130192953
Mean3892399542744309386431203087
MAEFirst training-test733782726794680495495
Second training-test566569638612494464451
Mean650676682703587480473
NSEFirst training-test0.3750.3180.3670.330.4130.6890.689
Second training-test0.6690.6680.50.5160.6510.7080.721
Mean0.5220.4930.4340.4230.5320.6990.705
In the table, input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt and St-1; (vi) Qt, St-1, and St-2; and (vi) Qt, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (i) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination.
Table 7. Performance of MARS model for different input combinations and training-test scenarios at Beibei Station.
Table 7. Performance of MARS model for different input combinations and training-test scenarios at Beibei Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test4250445144314355345333213265
Second training-test3394334433753296268626162650
Mean3822389839033826307029692958
MAEFirst training-test702763766826561581575
Second training-test560602589643507483462
Mean631683678735534532519
NSEFirst training-test0.4590.4060.4120.4320.6430.670.681
Second training-test0.6310.6420.6350.6520.7690.7810.775
Mean0.5450.5240.5240.5420.7060.7260.728
In the table, for the first training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt and St-1; (vi) Qt, St-1, and St-2; and (vi) Qt, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (i) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination. Similarly, for the second training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, Qt-2, Qt-3, and St-1; (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, and St-2; and (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, St-2, and St-3.
Table 8. Performance of MARS–KM model for different input combinations and training-test scenarios at Beibei Station.
Table 8. Performance of MARS–KM model for different input combinations and training-test scenarios at Beibei Station.
StatisticsData SetInput Combination
(i)(ii)(iii)(iv)(v)(vi)(vii)
RMSEFirst training-test2664237726642664225824192403
Second training-test2950247829142918292125342525
Mean2807242827892791259024772464
MAEFirst training-test508434518524382337334
Second training-test429367421417485458471
Mean469401470471434398403
NSEFirst training-test0.7870.8310.7870.7870.8470.8250.827
Second training-test0.7210.8030.7280.7280.7270.7940.796
Mean0.7540.8170.7580.7580.7870.8100.812
In the table, for the first training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, and St-1; (vi) Qt, Qt-1, St-1, and St-2; and (vi) Qt, Qt-1, St-1, St-2, and St-3, where Qt-1 and St-1 indicate the streamflow and sediment load at time t-1 (one previous day in this study). Among the Q inputs, input combination (vi) was considered, and therefore, after the fourth combination, sediment inputs were added to this combination. Similarly, for the second training-test data set, the input combinations are (i) Qt; (ii) Qt and Qt-1; (iii) Qt, Qt-1, and Qt-2; (iv) Qt, Qt-1, Qt-2, and Qt-3; (v) Qt, Qt-1, Qt-2, Qt-3, and St-1; (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, and St-2; and (vi) Qt, Qt-1, Qt-2, Qt-3, St-1, St-2, and St-3.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Adnan, R.M.; Parmar, K.S.; Heddam, S.; Shahid, S.; Kisi, O. Suspended Sediment Modeling Using a Heuristic Regression Method Hybridized with Kmeans Clustering. Sustainability 2021, 13, 4648. https://0-doi-org.brum.beds.ac.uk/10.3390/su13094648

AMA Style

Adnan RM, Parmar KS, Heddam S, Shahid S, Kisi O. Suspended Sediment Modeling Using a Heuristic Regression Method Hybridized with Kmeans Clustering. Sustainability. 2021; 13(9):4648. https://0-doi-org.brum.beds.ac.uk/10.3390/su13094648

Chicago/Turabian Style

Adnan, Rana Muhammad, Kulwinder Singh Parmar, Salim Heddam, Shamsuddin Shahid, and Ozgur Kisi. 2021. "Suspended Sediment Modeling Using a Heuristic Regression Method Hybridized with Kmeans Clustering" Sustainability 13, no. 9: 4648. https://0-doi-org.brum.beds.ac.uk/10.3390/su13094648

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop