Air Pollutants Tracing Model using Perceptron Neural Network and Non-negative Least Square
Air Pollutants Tracing Model using Perceptron Neural Network and Non-negative Least Square
Journal of Korea Multimedia Society. 2013. Dec, 16(12): 1465-1474
Copyright © 2013, Korea Multimedia Society
  • Received : October 24, 2013
  • Accepted : November 15, 2013
  • Published : December 30, 2013
Export by style
Cited by
About the Authors
Suk-Hyun, Yu
Dept. of Information & Communications Engineering, Anyang Univ.
Hee-Yong, Kwon
Dept. of Computer Science Engineering, Anyang Univ.

In this paper, air pollutant tracing models using perceptron neural network(PNN) and non-negative least square(NNLS) are proposed. When the measured values of the air pollution and the contribution concentration of each source by chemical transport modeling are given, they estimate and trace the amount of the air pollutants emission from each source. Two kinds of emissions data are used in the experiments : CH4 and N2O of Geumgo-dong landfill greenhouse gas, and PM10 of 17 areas in Northeast Asia and eight regions of the Korean Peninsula. Emission values were calculated using pseudo inverse method, PNN and NNLS. Pseudo inverse method could be used for the model, but it may have negative emission values. In order to deal with the problem, we used the PNN and NNLS methods. As a result, the estimation using the NNLS is closer to the measured values than that using PNN. The proposed tracing models have better utilization and generalization than those of conventional pseudo inverse model. It could be used more efficiently for air quality management and air pollution reduction.
After the Industrial Revolution, air pollution has been increasing due to rapid industrialization and urbanization. Air pollutants can cause physical damage to the human body directly and/or indirectly and it can lead to social and economic loss.
Air pollutants can be divided into primary pollutants such as sulfur dioxide(SO 2 ), carbon monoxide(CO), and lead(Pb), and secondary pollutants such as nitrogen dioxide(NO 2 ), particulate matter(PM10), and ozone(O 3 ). The contamination of primary pollutants have been reduced by the air pollution regulatory policy intensively promoted since the 1990s. The contamination of secondary pollutants, however, have been increased due to automobiles, industrial activities, and the construction sites [1] . Among them, greenhouse gases causing a large number of complaints and PM10 being harmful to the human body should be managed with particular emphasis.
The greenhouse gases could be generated by energy industries, industrial processes, agriculture, waste, land use, and forestry. In order to reduce the gases, IPCC (Intergovernmental Panel on Climate Change) has presented the guideline for greenhouse gas inventories [2 , 3] .
In Korea, in order to survey a landfill, not only FOD (First Order Decay) method presented by IPCC, but also greenhouse gases direct measuring method using flux chamber to derive the value of its reaction constant, k has been used. It, however, has a defect in that measuring time is limited, emissions from landfill surface are not uniform, and the cost is high. Recently, mainly in the developed countries, not only FOD method but also new estimating techniques using microclimate data around landfills, methane concentration and the application of modeling techniques have been studied [4] .
PM is a complex mixture of solid and liquid particles that vary in size and composition, and remain suspended in the air. PM10 is defined as particulate matter with a diameter less than 10 μm. Many health effect studies have shown an association between exposure to PM10 and increase in daily mortality and symptoms of certain illnesses such as asthma, chronic bronchitis, decreased lung function, and premature death [5] . The social damage cost of the metropolitan area due to particulate matter is estimated to be worth 10 trillion won per year [6] .
It is important to estimate the exact emissions in order to reduce the damage of all of these pollutants. In Korea, the city of Seoul constructs a national and international emissions database with the research results of the National Institute of Environmental Research [7 , 8] , Moon et al. calculate yellow dust emissions associated with the 5 expression of experience and the ADAMS model equations of National Weather Service respectively, and calculate and check the PM10 concentrations using WRF_CMAQ.
Henze et al. at the University of Columbia evaluated PM2.5 emissions in the United States using the GOES-Chem Adjoint model [9] , Jacob, Harvard University's Professor, evaluated the global CO emissions using MOPITT satellite data [10] . Domestic PM10 is largely affected by a long-range trans-boundary movement in the Northeast Asia region. Thus, for the fine metropolitan air quality management, it requires a complex analysis for the long-distance movement and local sources. For this, it is essential to obtain accurate domestic and Northeast Asia emissions data.
In this paper, we have collected the INTEX-B emission inventory data of greenhouse gases in Geumgo-dong landfill and East Asia region. Then, we propose an air pollutant sources tracing model to estimate greenhouse gases, CH 4 , N 2 O and PM10. The purpose of research is the estimation of emissions of each source with greenhouse gas data in domestic and East Asia regions. When measured emissions and contribution concentrations of each source by a chemical transport modeling are given, it is an optimization problem finding emission values of each source to minimize the error between the measured values and the estimated ones.
In this paper, three methods were studied. First, emissions of each source was estimated using the pseudo inverse method. There was a small error between the measured emissions and the estimated ones, but the negative estimate of the emissions occurred, so it should be improved. Second, we use PNN which shows excellent learning capability, given a target value. PNN learning may have negative emissions, so we improve the network adding the learning conditions to limit the negative weights. Then we resolve the pseudo inverse method's defect of negative emission problem. Third, in order to reduce the error between measured emission values and the ones calculated by the proposed PNN, the NNLS method was applied. The results calculated by the NNLS are closer to the measured emissions than those of the PNN.
In section 2, we describe the proposed models. Experimental results are shown in section 3, and concluded in section 4.
- 2.1 The definition of air pollutant tracing model
Given measured emissions and contribution concentrations of each source by a chemical transport modeling, the model should estimate emissions of each source. It is an optimization problem finding emission values, Q of each source to minimize the error between the measured values and the estimated ones, can be expressed as (1).
PPT Slide
Lager Image
  • (C: measured emissions,F(x) : contribution concentrations by chemical transport modeling,Q: emissions of each source)
Also, each term in (1) can be defined as follows.
PPT Slide
Lager Image
  • (ci:i–thmeasured value,i: measuring site,n: site number)
PPT Slide
Lager Image
  • (fij: contribution concentration ofi–thmeauring value ofj–thsite,n: number of measurements,m: number of sources)
PPT Slide
Lager Image
( qi : emission value of i th source, m : number of sources)
- 2.2 Emission estimation using Pseudo Inverse Method
Emission estimation problem can be regarded as estimating Q to fit F ( x )with measured values C , which are described in (1). It can be solved as follows (5), and is called pseudo inverse method [12] .
PPT Slide
Lager Image
However, there exist negative emissions when the pseudo inverse method is applied with the problem. As the negative values are not compatible with the physical world, it should be compensated with non-negative values. Thus we introduce PNN and NNLS to overcome the limitation of pseudo inversion.
- 2.3 Emission estimation using Perceptron Neural Network (PNN)
The human brain performs calculation to react to an external stimulus of environmental factors by the physical interconnection of the cells called neurons. Neural Network model is an intelligent system which mimics the human brain's neurons [11] .
Neural network for the emission estimation problem can be designed with single-layer perceptron network model, which consists of input layer and output layer of neurons. Contribution concentrations, F ( x )are the input for the input layer, measured values C are presented as the output, target for the output layer. With these neural networks, the weights connecting input layer with output are learned, which ultimately is the emissions of each source. Figure 1 shows the proposed neural network model. In the figure, an output pattern is calculated by summation of the results of multiplication weights( ω ) with contribution concentration input( F ( x )). The difference between the output and the measured values(C) is the error for the pattern. PNN regulates the weights ( ω ) with the error and learns the emission values of each source. It is important to include a condition that when a weight has negative value, it should be limited with non-negative value. Because the weights are emission values and there is no negative emission in the real world, it can not be negative. Neural network learning with such condition can improve the negative emission calculated by pseudo inverse method. Table 1 shows the parameters of the proposed PNN.
PPT Slide
Lager Image
Single Layer Perceptron.
Neural Network Parameter
PPT Slide
Lager Image
Neural Network Parameter
- 2.4 Emission estimation using Non-negative Least Square (NNLS)
Using PNN, the negative emission of pseudo inverse method could be resolved. However, NNLS with constraints of (6) is more efficient than PNN for the problem. In (6), f denotes measured emissions, E denotes contribution concentrations obtained by the chemical transport modeling, and x estimated emissions which should be calculated. Namely, NNLS estimates x that approximates an E to f , so it is suitable for the problem. Also, it implements the rule that negative weights should not be allowed like PNN [13 - 21] .
PPT Slide
Lager Image
- 3.1 Experimental environment
There are two experimental data : one is domestic data for Geumgo-dong landfill greenhouse gas, and the other is global data for PM10 of 17 areas in Northeast Asia and 8 regions of the Korean Peninsula. Greenhouse gas measurements were performed on the bank which separates the landfill into two areas, active and inactive, at intervals of 10m. 5 data sets are collected. The emission gases to be estimated are CH 4 and N 2 O.
Second experiments are performed for the global PM10 which is affected by long-distance travel over the Northeast Asia territories. For more accurate calculations, we use INTEX-B emission inventory. INTEX-B is an emissions data to the region since 2001, reflecting the rapid growth in Asia to complement the TRACE-P emissions in 2000. Target year is 2006, the 0.5 ° × 0.5 ° spatial resolution of emissions data of which target is anthropogenic sources, the target materials are SO 2 , NOx, CO, NMVOC, OC, BC, PM10, and PM2.5. Source categories are Power, Industry, Residential, and Transportation. There are included PM10 and PM2.5, but excluded NH3 and biological combustion emissions from the calculation compared with the TRACE-P emissions.
In this paper, we use the PM10 emissions of 17 regions and countries of the Northeast Asia and 8 domestic areas in INTEX-B [22] .
- 3.2 Experimental results
Three experiments are performed : pseudo inverse method, perceptron neural network(PNN), non-negative least square(NNLS).
As a result, pseudo inverse method has the smallest error between measured emissions and the model's output, but it has a negative emission problem. To deal with the problem, we use PNN and NNLS. Eventually, NNLS has smaller error than PNN, and is the most appropriate method among the three.
Figure 2 and Figure 3 are the estimating results of the proposed three methods for the greenhouse gases, CH 4 and N 2 O. Local case 1 ~ 5 are the 5 measurement sets in September 2010 of Daejeon Geumgo-dong landfill. Figure 4 is the estimating results of the proposed three methods for the PM10 emissions of 17 regions and countries of the Northeast Asia and 8 domestic areas. Global case 1 ~ 4 are the 4 PM10 emission data in January 2008, May, August, and October, one for each season. In the graph, x-axis denotes measurement site, y-axis denotes emission. Legends are measured values , pseudo inverse method, NNLS, and PNN respectively.
PPT Slide
Lager Image
NNLS vs. Other Methods with local data(CH4).
PPT Slide
Lager Image
NNLS vs. Other Methods with global data(N2O)
PPT Slide
Lager Image
NNLS vs. Other Methods with global data(PM10).
In addition, Table 2 and Table 3 shows the RMSE of the proposed three methods' estimation.
RMSE of Three Methods (CH4, N2O)
PPT Slide
Lager Image
RMSE of Three Methods (CH4, N2O)
RMSE of Three Methods (PM10)
PPT Slide
Lager Image
RMSE of Three Methods (PM10)
In this paper, we propose air pollutant tracing models by minimizing the error between the measured values and the estimated ones, when measured emissions and contribution concentrations of each source by a chemical transport modeling are given. The study is conducted with pseudo inverse method, PNN, and NNLS to estimate the emissions. Pseudo inverse method estimates emissions closest to the measured ones, but there exist negative emissions. We introduce PNN and NNLS to overcome the problem. As a result, both two method resolve the negative emission problem but NNLS'error is smaller than PNN. So NNLS is the best model for emission tracing.
The proposed air pollutant tracing model does not need expensive equipment or personnel commitments for modeling, so it is efficient in terms of cost and time. However, it has a defect that the minimum or maximum value of the measured emissions may fail to be found. Thus, in order to be an effective model, not only reducing the error between measured emissions and estimated ones but also finding the trends in the emissions is eventually required.
Suk-Hyun Yu
1999 B.S. in Computer Science Engineering,Anyang University
2002 M.S. in Computer Science Engineering,Anyang University
2011 Ph.D. in Computer Science Engineering, Anyang University
2012– Assistant Professor, Department of Infomation & Communications Engineering, Anyang University
2011 Ph.D. in Computer Science Engineering, Anyang University
Hee-Yong Kwon
1983 B.S. in Computer Engineering, Seoul National University
1985 M.S. in Computer Engineering, Seoul National University
1993 Ph.D. in Computer Engineering, Seoul National University
1986–1995 Korea Telecom Research Center Senior Researcher
1995– Professor, Department of Computer Science Engineering, Anyang University
Interest: Pattern Recognition, Neural Network, Parallel Processing Application
Kim Yong-Pyo 2006 “Air Pollution in Seoul Caused by Aerosols” Journal of Korean Society for Atmospheric Environment 22 (5) 535 - 553
IPCC 1996 1996 IPCC Guidelines for National Greenhouse Gas Inventories
IPCC 2006 2006 IPCC Guidelines for National Greenhouse Gas Inventories
Yu Suk-Hyun , Doctoral Dissertation 2011 Air Quality Forecasting and Odor Source Tracking Method Using Neural Network and Nonnegative Least Square Anyang University Doctoral Dissertation
Koo Youn-Seo , Yun Hui-Young , Kwon Hee-Yong , Yu Suk-Hyun 2010 “A Development of PM10 Forecasting System” Journal of Korean Society for Atmospheric Environment 26 (6) 666 - 682    DOI : 10.5572/KOSAE.2010.26.6.666
Gyeonggi Institute of Health Environment 2008 Evaluation Report of Air Pollution in Gyeonggi-do
The Metropolis of Seoul 2010 Characterization Research of PM10 using Batch Monitoring with Airborne PM10 in Seoul
Moon Yun-Seob , Lee Seong-Hwan 2009 “Estimation of Hourly Emission Flux of Asian Bust Using Empirical Formulas in the Source Area” Journal of Korean Society for Atmospheric Environment 25 (6) 539 - 549    DOI : 10.5572/KOSAE.2009.25.6.539
Haneze D.K. , Seinfeld J.H. , Shindell D.T. 2009 “Inverse Modeling and Mapping us Air Quality Influence of Inorganic PM2.5 Precursor Emissions using the Adjoint of CEOS-Chem” Atmos. Chem. Phy. 9 (16) 5877 - 5903    DOI : 10.5194/acp-9-5877-2009
Kopacz M. , Jacob D.J. , Hanze D.K. , Heald C.L. 2007 “Comparision of Adjoint and Analytical Bayesian Inversion Methods for Constraining Asian Sources of Carbon Monoxide Using Satellite(MOPITT) Measurements of CO Columns” Journal of Geophysical Research Atmospheres 114 (D4) 1 - 10
Rumelhart David E. , McClelland James L. the PDP Research Group 1987 Parallel Distributed Processing MIT Press Publishers Cambridge, Massachusetts
Yu Suk-Hyun , Park Sang-Jin , Koo Youn-Seo , Kwon Hee-Yong 2010 “Odor Classification and Source Analysis using Pseudo Inverse” Journal of Korea Multimedia Society 13 (8) 1171 - 1182
Lawson C.L , Hanson R.J 1974 Solving Least Squares Problems Prentice-Hall Publishers Englewood Cliffs, New Jersey
Lee D. , Seung H. 1999 “Learning the Parts of Objects by Non-negative Matrix Factorization” Nature 401 (6755) 788 - 791    DOI : 10.1038/44565
Bapat R.B. , Raghavan T.E.S. 1997 Nonnegative Matrices and Applications Cambridge University Press Publishers Cambridge, UK
Berman A. , Plemmons R. 1994 Nonnegative Matrices in the Mathematical Sciences Academic Press Publishers New York
Vo N. , Moran B. , Challa S. 2009 “Nonnegative Least Square Classifier for Face Recognition” Lecture Notes in Computer Science 5553 449 - 456
Bombara G. , Cococcioni M. , Lazzerini B. , Marcelloni F. 2011 “S-NNLS: An Efficient Nonnegative Least Squares Algorithm for Sequential Data” International Journal for Numerical Methods in Biomedical Engineering 27 (5) 770 - 773    DOI : 10.1002/cnm.1331
Jiaying Wu , van Aardt J.A. , Asner G.P. 2011 “A Comparison of Signal Deconvolution Algorithms Based on Small-Footprint LiDAR Waveform Simulation” IEEE Transactions on Geoscience and Remote Sensing 49 (6) 2402 - 2414    DOI : 10.1109/TGRS.2010.2103080
Kim Yong-Deok , Choi Seung-Jin 2008 “Nonnegative Tucker Decomposition” Journal of KIISE: Computing Practices and Letters 14 (3) 296 - 300
Koo Youn-Seo , Kwon Hee-Yong , Son Eun-Sung , Jin Hyun-Jin , Jung Byoung-Won , Heo Gwi-Wuk 2013 “Review of the Estimation Methodology of Methane Emission in a Landfill using Inverse Modeling Technique” Journal of Korean Society of Odor Research and Engineering 12 (3) 111 - 123    DOI : 10.11161/jkosore.2013.12.3.111
Korea Environmental Industry&Technology Institute 2012 Development of Technology for Improvement of Air Pollutant Amount Inventory and Reliability