Modeling non-point pollution across multiple scales has become an important environmental issue. As a more representative and practical approach in quantifying and qualifying surface water, a modular neural network (MNN) was implemented in this study. Two different site-scales (1.5 × 10
and 1.62 × 10
) with the same plants, soils, and paddy field management practices, were selected. Hydrologic data (rainfall, irrigation and surface discharge) and water quality data (time-series nutrient loadings) were continuously monitored and then used for the verification of MNN performance. Correlation coefficients (R) for the results predicted from the networks versus measured values were within the range of 0.41 to 0.95. The small block could be extrapolated to the large field for the rainfall-surface drainage process. Nutrient prediction produced less favorable results due to the complex phenomena of nutrients in the drainage water. However, the feasibility of using MNN to generate improved prediction accuracy was demonstrated if more hydrologic and environmental data are provided. The study findings confirmed the estimation accuracy of the upscaling from a small-segment block to large-scale paddy field, thereby contributing to the establishment of water quality management for sustainable agriculture.
Forecasting the behavior of a complex system in the environment is scale-dependent, which affects the model’s extent, accuracy, and precision. In addition, many researchers have reported that the major source of heterogeneity leading to spatial differences in runoff is topography, soils, and space-time scales of rainfall inputs [
]. Depending upon this knowledge, if the primary cause of the increasing nonlinear response is attributed to significant changes in simulation accuracy, the ability of two catchments with similar topographical and hydrologic phenomena to generate simulating results within a reasonable margin of error using the same simulation model has not been determined [
A paddy field is grouped in a number of management blocks of paddies. Each paddy block is connected to each reach and each paddy block drains into a drainage canal. Due to these unique topographic characteristics, rice paddies, drainage and irrigation canals are related surface water bodies, like rivers, and create a unique ecosystem which should be studied as a whole system. This indicates that the spatial upscaling in water quantification and quality would be appropriate
Because upscaling is very data intensive, the scarcity of relevant data at the watershed scale and the heterogeneity and incomplete understanding of the biogeochemical processes operating at this scale make physically based models of limited use
. Three approaches, the standard mathematical averaging methods, stochastic methods, and some regularization techniques, have mostly been applied for upscaling
. Many researchers have recently tried using the stochastic method, particularly artificial neural networks (ANNs) that are recognized as extremely nonlinearity analysis
ANNs have been used to successfully capture trends with less knowledge of the behavior of the system in terms of interactions between biological, geological, chemical, hydro-morphological, and physical processes affecting the modeled system
. This study adopted the modular neural network (MNN) because its interpretable and relevant neural presentation of the nonlinear behaviors in nature has been reported in many studies
. Recently, Zhang and Govindaraju
used an MNN to improve the forecasting of extreme rainfall events.
The basic architecture of MNN is similar to that of backpropagation (BP). The network consists of three basic layers: input, hidden and output. The MNN scheme differs in its involvement of a number of "local experts" with each combining two forecasts. A gating network is used to determine the assignment of different regions of the two-dimensional data space to different local experts. The proposed network system consists of a layer of input modules and an additional decision module. Each input variable is connected to a single, randomly chosen input module. The outputs of all input modules are connected to the decision network. Further information about MNN architecture is presented by Azam
In this study, the evaluation was upscaled from the block level to the field level by using the MNN model for the quality and quantity estimation. The specific study objectives are 1) to apply the MNN algorithm to time-dependent hydrologic and water quality data obtained from two paddy fields, 2) to prove our hypothesis that two catchments of similar topography but different size produce similar simulating results, and 3) to evaluate the feasibility of MNN as a predictive simulation tool to aid in the development of total maximum daily loads (TMDLs).
2. Materials and Methods
- 2.1. Site Description and Data Collection
Two intensive paddy fields, of area approximately 1.5 × 10
(small: ‘S’) and 1.62 × 10
(large: ‘L’), in Icheon city located in Gyeonggi province, Korea (37° 18’ 20.34’’ N, 127° 30’ 40.46’’ E), were selected for this study. The fields were isolated by enclosing banks, which prevented interactions with neighboring areas. During the study period, the two fields were irrigated with water from Bok-ha stream, and runoff water from the paddy fields was drained into Jook-Dang Stream. The study area is described in detail by Kim et al.
From April to October in 2002, 2003, and 2004, the data necessary for predicting the water quantity and quality, such as rainfall amounts, irrigation, discharge water, and nutrient (total nitrogen [TN], total phosphorus [TP]) concentrations, were monitored. The topography of both areas, according to the US Department of Agriculture soil taxonomy, was of alluvial plain with somewhat poor soil drainage. This indicated that most of the excessive water irrigated to the paddy fields was discharged through the drainage canal and into Jook-Dang Stream. In addition, because multiple rice fields were irrigated with the same water sources, mixed loads of irrigation-discharge water occurred. In addition, the two paddy fields had the same geographical location, soil, land use, climatic and physical characteristics and even management practices.
- 2.2. Implementation of MNN
As in any prediction/forecasting model, the selection of appropriate model inputs is extremely important, particularly in ANN-based multivariate forecasting, since it provides important information about the linearity and non-linearity in the data
. However, there is currently no systematic way to determine the optimum input variables.
Time-dependent surface discharge is affected by many factors such as rainfall, temperature, land cover, soil type and geomorphology. Among these factors, rainfall is treated as the independent variable with the greatest influence on runoff. In this study, the inputs (i.e., at times
[day]) of rainfall, surface discharge, and nutrient contents in the two fields are listed in
For data pre-processing, all data used in the calculations were normalized to prevent larger numbers from overriding smaller ones, and to prevent premature saturation of hidden nodes, which impede the learning process. Networks trained with experimental data that adequately represent the overall characteristics of the critical physical processes will achieve higher generation ability. To accomplish this goal, the total numbers of data points, 510, 292, and 288 for discharge, TN and TP, were divided into three subsets: a training set (72% of the data), a validation set (8% of the total), and a testing set (20% of the total), respectively.
In this study, the
-fold cross-validation method was used to improve the generation of the network and prevent over-fitting
. All data were randomly divided into
= 12 subsets of equal size but different network architecture and the selected parameters were identified and trained. Each time one of the subsets from the training set was removed during the training, but the omitted subset was used for validation. This procedure was repeated until no further decrease in error occurred among the 12 subsets. After training and validation, the network architecture having the smallest error over the 12 subsets was selected and then evaluated using the test set.
After the selection of the input and output processing elements (PEs) for the training and test, the number of hidden PEs is specified. The network performance of an MNN algorithm can be considered a quadratic function of the number of hidden PEs; thus, a decrease in the number of PEs, just as an increase, could result in increased performance
. Besides the number of hidden PEs, other factors govern the simulation performance, including transfer functions (linear, TanH, sigmoid, digital neural network architecture [DNNA], sine), update rules (Delta-rule, Normalize cumulative delta, Extended delta-bar-delta, Quickpro, Maxpro, and Delta-bar-delta), the effect iteration number, learning coefficient ratio, and momentum. Detailed information about these factors in MNN computation can be found in Happel and Murre
and Schmidt and Bandar
In comparison to BP, MNN offers the unique feature of a local expert. This acts as a specialized learning function so that each partition of input elements is classified in a competitive manner. Therefore, the output of MNN becomes a weighted sum of the outputs of the nested expert neural networks, weighted by the corresponding gating networks output at each level of the hierarchy
Input parameters depending upon their application
Input parameters depending upon their application
Model parameters are estimated for each of the independent variables to evaluate the statistical significance of that variable for explaining the spatial variation in the in-stream nutrient loads. The MNN was created with NeuralWorks Professional II/ PLUS software (version 5.22; Neuralware, Carnegie, PA, USA), and this package allows users to develop their own models by providing different networks and control parameters.
3. Results and Discussion
Climatologically, heavy rainfall over Korea mainly occurs from a quasi-stationary polar front for a period of 30?40 days from late June through the end of July, and rainfall in this period accounts for more than 40% of the annual rainfall
. A similar seasonal pattern of rainfall was presented in this study
Rainfall between May and September was increased in 2003 and 2004 by 0.95% and 11.51% compared to 2002, leading to decreases in required irrigation of 28.68% and 13.15%, respectively. In addition, surface discharges corresponding to the same rainfall event from the S and L fields are shown in
, revealing that the hydrologic phenomena are scale-dependent.
Dynamics of monthly rainfall, irrigation, and surface discharge (2002-2004).
Comparison of rainfall and surface discharge over time in a large paddy field (L; 162 ha) and a small paddy plot (S; 15 ha).
The recorded TN concentrations of the irrigation water into the watershed of paddy rice farming were generally a little higher than those of the surface discharge. The effluent TN concentrations of the watershed were lower than the influent TN concentrations, tending towards filtration, such as the uptake by plants and denitrification in soils, during the cultivation period. While the TN concentration of the irrigation and discharge water was not significantly different (
= 0.305), the TP showed a significant variation (
Daily data collected from the S and L paddy fields were used for training, validation and testing of the MNN.
summarizes the best architecture of the MNN. Depending upon its application using rainfall, surface discharge, and TN and TP concentrations, the responses of each governing factor clearly differed. To better elucidate the MNN behavior, sensitivity analysis of each governing factor in the MNN was conducted. Three applications regarding water quantity and quality showed different results. The observing network responses to a change of governing factors in the MNN algorithm showed that the type of transfer function significantly influenced the model results, followed by the rating network, learning coefficient ratio, update rule, momentum and the number of hidden layers in the rainfall-surface discharge prediction. In the case of TN prediction, the learning function was an influential factor, followed by the learning coefficient ratio, transfer function, number of hidden layers, rating network, and momentum. The transfer function was ranked the most influential, followed by the learning coefficient ratio, rating network, number of hidden layers, update rule and momentum in TP prediction.
The best model parameters and results for MNN’s performance and optimization.MNN: modular neural network, TN: total nitrogen, TP: total phosphorus, Ext DBD: Extended delta-bar-delta..
The best model parameters and results for MNN’s performance and optimization. MNN: modular neural network, TN: total nitrogen, TP: total phosphorus, Ext DBD: Extended delta-bar-delta..
also lists the linear correlating coefficients (R) for the resulting predictions from the networks versus the measured values, which ranged between 0.41 and 0.95. Individual results were R = 0.95 for surface discharge prediction by corresponding rainfall, and R = 0.52 and 0.41 for the TN and TP predictions by the corresponding surface discharge, respectively. Contrary to the excellent simulation result from the rainfall-surface discharge, the prediction results of TN and TP concentrations gave relatively poor results.
TMDL Acts have been implemented in the Republic of Korea amidst calls for new tools to quantify the nutrient fate and transport from various sources. The accurate estimation of nutrient loading from diffuse sources, particularly paddies, is essential, but there is currently little or no baseline data in Korea
. The surface water relationship between rice paddies and water canals creates a unique ecosystem that necessitates its study as a whole system.
This peculiar topographical characteristic of paddies enables the spatial upscaling in water quality and quantity. This study assessed the potential for upscaling prediction of waters from block to field scale of paddies. The scale compatibility of the two study areas, S and L, was examined for the possibility of significant upscaling effects in simulating the surface discharge and water quality. The computational parameters were optimized to generate the best achievable simulation results for surface discharge and water quality. In the results, the high agreement between the measured and computed surface discharge indicated that surface discharge has a predictable correlation with rainfall. On the other hand, the model prediction of nutrient concentration was not as accurate as expected. It was difficult to correlate the surface discharge with the nutrient concentrations in the drainage water due to the uncontrollable variation of nutrients already present in the irrigation water.
The study findings indicated that MNN implementation can serve as a powerful assessment tool to quantify surface discharge corresponding to rainfall. In addition, MNN could be a useful tool for defining the cause-and-effect of nutrient losses into neighboring surface water, thereby fostering a better understanding of the hydro-geologic system and improving future modeling endeavors. With the regionalization of effective and representative model input parameters, this study has provided further proof that the same model concept can be applied to both small-scale plots and large-scale fields, which supports a better understanding of the scale effects, and will contribute to many current studies regarding nutrient TMDLs, especially for paddy fields.
Modelling the effects of spatial variability in rainfall on catchment response 2 Experiments with distributed and lumped models
Quantifying model output uncertainty due to spatial variability of rainfall
J Am Water Res Assoc
Upscaling field scale hydrology and water quality modelling to catchment scale
Water Resour Manage
Higher Tier Risk Assessment for pesticides applied in rice paddies: Filling the gap at European level
Outlooks Pest Manage
Forest ecosystem processes at the watershed scale: Hydrological and ecological controls of nitrogen export
Comparison of upscaling methods to estimate hydraulic conductivity
Groundwater remediation optimization using artificial neural networks
Berkeley Initiative in Soft Computing Special Interest Group Earth Sciences Workshop
Artificial neural networks: Fundamentals computing design and application
J Microbiol Methods
The application of artificial neural networks to flow and phosphorus dynamics in small streams on the Boreal Plain with emphasis on the role of wetlands
Design and evolution of modular neural network architectures
Modularity-a concept for new neural network architectures
IASTED International Conference Computer Systems and Applications (CSA'98)
Mar 3-Apr 2
Prediction of watershed runoff using Bayesian concepts and modular neural networks
Water Resour Res
Biologically inspired modular neural networks [dissertation]
Virginia Polytechnic Institute and State University
Estimation of irrigation return flow from paddy fields considering the soil moisture
Agric Water Manage
Forecasting futures trading volume using neural networks
J Futures Markets
Time series forecasting with neural networks: a comparative study using the air line data
J Roy Stat Soc Ser C (Appl Stat)
Neural networks for pattern recognition
Development and evaluation of neural network based soil nitrate prediction models from satellite images and non imagery information
American Society of Agricultural and Biological Engineers (ASAE) AnnualMeeting
St Joseph MI
The linear relationship between monthly precipitation amounts of Korea and time variation of the geopotential height in East Asia and the Pacific during the summer season
J Korean Meteorol Soc
Heavy rainfall over Korea during 1980-1990
Korean J Atmos Sci