Abstract
Air pollution is a global problem. The assessment of air pollution concentration data is important for evaluating human exposure and the associated risk to health. Unfortunately, air pollution monitoring stations often have periods of missing data or do not measure all pollutants. In this study, we experiment with different approaches to estimate the whole time series for a missing pollutant at a monitoring station as well as missing values within a time series. The main goal is to reduce the uncertainty in air quality assessment.
To develop our approach we combine single and multiple imputation, nearest neighbour geographical distance methods and a clustering algorithm for time series. For each station that measures ozone, we produce various imputations for this pollutant and measure the similarity/error between the imputed and the real values. Our results show that imputation by average based on clustering results combined with multiple imputation for missing values is the most reliable and is associated with lower average error and standard deviation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allison, P.D.: Missing Data, vol. 136. Sage Publications, Thousand Oaks (2001)
Arroyo, Á., Herrero, Á., Tricio, V., Corchado, E., Woźniak, M.: Neural models for imputation of missing ozone data in air-quality datasets. Complexity 2018, 14 (2018)
Azid, A., et al.: Prediction of the level of air pollution using principal component analysis and artificial neural network techniques: a case study in Malaysia. Water Air Soil Pollut. 225(8), 2063 (2014). https://doi.org/10.1007/s11270-014-2063-1
Buuren, S., Groothuis-Oudshoorn, K.: MICE: multivariate imputation by chained equations in R. J. Stat. Softw. 1–68 (2010)
Dimitriadou, E., Weingessel, A., Hornik, K.: Voting-merging: an ensemble method for clustering. In: Dorffner, G., Bischof, H., Hornik, K. (eds.) ICANN 2001. LNCS, vol. 2130, pp. 217–224. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-44668-0_31
Gass, K., Klein, M., Chang, H.H., Flanders, W.D., Strickland, M.J.: Classification and regression trees for epidemiologic research: an air pollution example. Environ. Health 13(1), 17 (2014). https://doi.org/10.1186/1476-069X-13-17
Gore, R.W., Deshpande, D.S.: An approach for classification of health risks based on air quality levels. In: 2017 1st International Conference on Intelligent Systems and Information Management (ICISIM), pp. 58–61. IEEE (2017)
Holnicki, P., Nahorski, Z.: Emission data uncertainty in urban air quality modeling–case study. Environ. Model. Assess. 20(6), 583–597 (2015). https://doi.org/10.1007/s10666-015-9445-7
Jhun, I., Coull, B.A., Schwartz, J., Hubbell, B., Koutrakis, P.: The impact of weather changes on air quality and health in the united states in 1994–2012. Environ. Res. Lett. 10(8), 084009 (2015)
Junninen, H., Niska, H., Tuppurainen, K., Ruuskanen, J., Kolehmainen, M.: Methods for imputation of missing values in air quality data sets. Atmos. Environ. 38(18), 2895–2907 (2004)
Kampa, M., Castanas, E.: Human health effects of air pollution. Environ. Pollut. 151(2), 362–367 (2008)
Kang, G.K., Gao, J.Z., Chiao, S., Lu, S., **e, G.: Air quality prediction: big data and machine learning approaches. Int. J. Environ. Sci. Dev. 9(1), 8–16 (2018)
Kaufman, L., Rousseeuw, P.J.: Finding Groups in Data: An Introduction to Cluster Analysis, vol. 344. Wiley, Hoboken (2009)
Luong, L.M., Phung, D., Sly, P.D., Morawska, L., Thai, P.K.: The association between particulate air pollution and respiratory admissions among young children in Hanoi, Vietnam. Sci. Total Environ. 578, 249–255 (2017)
Moritz, S., Bartz-Beielstein, T.: Imputets: time series missing value imputation in R. R J. 9(1), 207–218 (2017)
Norazian, M.N., Shukri, Y.A., Azam, R.N., Al Bakri, A.M.M.: Estimation of missing values in air pollution data using single imputation techniques. ScienceAsia 34(3), 341–345 (2008)
Paparrizos, J., Gravano, L.: k-shape: efficient and accurate clustering of time series. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, pp. 1855–1870. ACM (2015)
Plaia, A., Bondi, A.: Single imputation method of missing values in environmental pollution data sets. Atmos. Environ. 40(38), 7316–7330 (2006)
Raghunathan, T.E., Lepkowski, J.M., Van Hoewyk, J., Solenberger, P., et al.: A multivariate technique for multiply imputing missing values using a sequence of regression models. Surv. Methodol. 27(1), 85–96 (2001)
Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)
Rubin, D.B.: An overview of multiple imputation. In: Proceedings of the Survey Research Methods Section of the American Statistical Association. Citeseer (1988)
Rubin, D.B.: Multiple Imputation for Nonresponse in Surveys, vol. 81. Wiley, Hoboken (2004)
Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26(1), 43–49 (1978)
Sardá-Espinosa, A.: Comparing time-series clustering algorithms in R using the dtwclust package. R Development Core Team, Vienna (2017)
Van Buuren, S., Oudshoorn, K.: Flexible Multivariate Imputation by MICE. TNO, Leiden (1999)
WHO: Ambient air pollution: health impacts (2019). https://www.who.int/airpollution/ambient/health-impacts/en/
Wong, C.M., Vichit-Vadakan, N., Kan, H., Qian, Z.: Public health and air pollution in Asia (PAPA): a multicity study of short-term effects of air pollution on mortality. Environ. Health Perspect. 116(9), 1195–1202 (2008)
Yang, Y., et al.: The association between ambient air pollution and daily mortality in Bei**g after the 2008 olympics: a time series study. PLoS ONE 8(10), e76759 (2013)
Zheng, Y., et al.: Forecasting fine-grained air quality based on big data. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2267–2276. ACM (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Alahamade, W., Lake, I., Reeves, C.E., De La Iglesia, B. (2020). Clustering Imputation for Air Pollution Data. In: de la Cal, E.A., Villar Flecha, J.R., Quintián, H., Corchado, E. (eds) Hybrid Artificial Intelligent Systems. HAIS 2020. Lecture Notes in Computer Science(), vol 12344. Springer, Cham. https://doi.org/10.1007/978-3-030-61705-9_48
Download citation
DOI: https://doi.org/10.1007/978-3-030-61705-9_48
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61704-2
Online ISBN: 978-3-030-61705-9
eBook Packages: Computer ScienceComputer Science (R0)