Abstract
This paper presents an application of the DELTA evaluation tool V3.2 to support the EU Air Quality Directive (AQD 2008). This software, designed in the frame of the FAIRMODE project (Forum for Air Quality Modelling in Europe, http://fairmode.ew.eea.europa.eu/), is currently used as support to working groups of modelers across Europe in the diagnostics and assessment of air quality model performances under the AQD (2008). The skills of the DELTA tool V3.2 are tested by looking at the results of a 1-year (2005) simulation performed using the transport chemical aerosol model (Carnevale et al. 2008) at 6 × 6-km2 resolution over the Po Valley. The modeled daily PM10 concentrations at surface level are compared to observations provided by approximately 50 stations distributed across the domain. The main statistical parameters (i.e., bias, root mean square error, correlation coefficient, standard deviation) as well as different types of diagrams (scatter plots, time series plots, Taylor and target plots) have been produced. A representation of the observation uncertainty in the target plot, used to derive model performance criteria for the main statistical indicators, is also presented and discussed.
Similar content being viewed by others
References
AQD (2008) Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008 on ambient air quality and cleaner air for Europe (no. 152). Official Journal
Borrego C, Monteiro A, Ferreira J, Miranda AI, Costa AM, Carvalho AC, Lopes M (2008) Procedures for estimation of modelling uncertainty in air quality assessment. Environ Int 34:613e–620e
Boylan JW, Russell AG (2006) PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models. Atmos Environ 40:4946e–4959e
Carnevale C, Decanini E, Volta M (2008) Design and validation of a multiphase 3D model to simulate tropospheric pollution. Sci Total Environ 390:166–176
Carnevale C, Finzi G, Pisoni E, Thunis P, Volta M (2012) The impact of thermodynamic module in the CTM performances. Atmos Environ 61:652–660
Carter WPL (1990) A detailed mechanism for the gas-phase atmospheric reactions of organic compounds. Atmos Environ 24A:481–518
Chemel C, Sokhi RS, Yu Y, Hayman GD, Vincent KJ, Dore AJ, Tang YS, Prain HD, Fisher BEA (2010) Evaluation of a CMAQ simulation at high resolution over the UK for the calendar year 2003. Atmos Environ 44:2927e–2939e
Cuvelier C, Thunis P, Vautard R, Amann M, Bessagnet B, Bedogni M, Berkowicz R, Brandt J, Brocheton F, Builtjes P, Carnevale C, Denby B, Douros J, Graf A, Hellmuth O, Hodzic A, Honore C, Jonson J, Kerschbaumer A, de Leeuw F, Minguzzi E, Moussiopoulos N, Pertot C, Peuch VH, Pirovano G, Rouil L, Sauter F, Schaap M, Stern R, Tarrason L, Vignati E, Volta M, White L, Wind P, Zuber A (2007) CityDelta: a model intercomparison study to explore the impact of emission reductions in European cities in 2010. Atmos Environ 41(1):189–207
Daly A, Zannetti P (2007) Air pollution modeling—an overview. In: Zannetti P, Al-Ajmi D, Al-Rashied S (eds) Ambient air pollution, chapter 2.
Denby B (2010) Guidance on the use of models for the European Air Quality Directive. A working document of the Forum for Air Quality Modelling in Europe FAIRMODE (ETC./ACC No. version 6.2)
Derwent D, Fraser A, Abbott J, Willis P, Murrells T (2010) Evaluating the performance of air quality models (No. Issue 3). Department for Environment and Rural Affairs
ECWG (2010) Guide to the demonstrations of equivalence of ambient air monitoring methods
EPA (2005) EPA's guideline on air. Quality models (“guideline”). http://www.epa.gov/scram001/guidance/guide/appw_05.pdf
Fountoukis C, Nenes A, Sullivan A, Weber R, VanReken T, Fischer M, Matias E, Moya M, Farmer D, Cohen R (2009) Thermodynamic characterization of Mexico City aerosol during MILAGRO 2006. Atmos Chem Phys 9:2141–2156
Gilardoni S, Vignati E, Cavalli F, Putaud JP, Larsen BR, Karl M, Stenström K, Genberg J, Henne S, Dentener F (2011) Better constraints on sources of carbonaceous aerosols using a combined 14C–macro tracer analysis in a European rural background site. Atmos Chem Phys Discus 11(1):2503–2547. doi:10.5194/acpd-11-2503-2011
Holstag AAM, Nieuwstadt FTM (1986) Scaling the atmospheric boundary layer. Boundary-Layer Meteorol 36:201–209
Jolliff JK, Kindle JC, Shulman I, Penta B, Friedrichs MAM, Helber R, Arnone RA (2009) Summary diagrams for coupled hydrodynamic-ecosystem model skill assessment. J Mar Syst 76:64e–82e
Marchuk G (1975) Methods of numerical mathematics. Editor: Springer-Verlag, New York, NY
Nenes A, Pandis S, Pilinis C (1998) ISORROPIA: a new thermodynamic equilibrium model for multiphase multicomponent inorganic aerosols. Aquat Geochem 4(416):123–152
Pederzoli A, Thunis P, Georgieva E, Carruthers D, Borge R, Pernigotti D (2012) Performance criteria for the benchmarking of air quality model regulatory applications: the “target” approach. International Journal of Environment and Pollution (IJEP), vol. 50, Nos. 1/2/3/4, 2012
Pepper DW, Kern CD, Long PE (1979) Modelling the dispersion of atmospheric pollution using cubic splines and Chapeau functions. Atmos Environ 13:223–237
Pernigotti D, Georgieva E, Thunis P, Cuvelier C, De Meij A (2012) The impact of meteorology on air quality simulations over the Po Valley in northern Italy. Atmos Environ 51:303–310
Pernigotti D, Thunis P, Gerboles M, Belis CA (2013a) Model quality objectives based on measurement uncertainty. Part II: NO2 and PM10. Atmos Environ 79:869–878
Pernigotti D, Thunis P, Cuvelier C, Georgieva E, Gsella A, De Meij A, Pirovano G, Balzarini A, Riva GM, Carnevale C, Pisoni E, Volta M, Bessagnet B, Kerschbaumer A, Viaene P, De Ridder K, Nyiri A, Wind P (2013b) POMI: a model inter-comparison exercise over the Po Valley. Air Qual Atmos Health 6(4):701–715
Rossa AM, Ferrario ME, Sansone M, Monai M (2012) Climatology of the static stability of the night-time Po Valley pbl from radio sondes and passive microwave radiometers. Proceedings of the 9th International Symposium on Tropospheric Profiling, L'Aquila, Italy, September 2012. ISBN: 978-90-815839-4-7
Scire JS, Insley EM, Yamartino RJ (1990) Model formulation and user’s guide for the CALMET meteorological model. Technical report, California Air Resources Board, Sacramento
Stow CA, Jolliff J, McGillicuddy DJ, Doney SC, Allen, JI, Friedrichs MAM, Rose KA, Wallhead P (2009) Skill assessment for coupled biological/physical models of marine systems. J Mar Syst 76, 4e15
Thunis P, Triacchini G, White L, Maffeis G, Volta M (2009) Air pollution and emission reductions over the Po-Valley: air quality modelling and integrated assessment. Proceedings of the 18th World IMACS/MODSIM Congress, Cairns, Australia, 13–17 July 2009
Thunis P, Cuvelier C, Roberts P, White L, Nyiri A, Stern R, Kerschbaumer A, Bessagnet B, Bergström R, Schaap M (2010) EURODELTA: evaluation of a sectoral approach to integrated assessment. Modelling—second report. http://www.eurosfaire.prd.fr/7pc/doc/1301907090_lbna24474enc_002.pdf?PHPSESSID=75bb8ddcaca78c97a1777f06549d5065
Thunis P, Georgieva E, Pederzoli A (2012a) A FAIRMODE benchmarking tool to evaluate air quality model performances in regulatory applications. Environ Model Softw 38:220–230 (December 2012)
Thunis P, Pederzoli A, Pernigotti D (2012b) Performance criteria for evaluating air quality model applications for policy use. Atmos Environ 59:476–482 (November 2012)
Thunis P, Pederzoli A, Georgieva E, Cuvelier C, Pernigotti D (2012c) DELTA V3.2 user’s guide. http://aqm.jrc.ec.europa.eu/DELTA/Publications.htm
Thunis P, Pernigotti D, Gerboles M, Belis C (2013) Model quality objectives based on measurement uncertainty. Part I: O3. Atmos Environ 79:861–868
Yamartino RJ, Scire JS, Carmichael GR, Chang YS (1992) The CALGRID mesoscale photochemical grid model—I. Model formulation. Atmos Environ 26A:1493–1512
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Carnevale, C., Finzi, G., Pederzoli, A. et al. Applying the delta tool to support the Air Quality Directive: evaluation of the TCAM chemical transport model. Air Qual Atmos Health 7, 335–346 (2014). https://doi.org/10.1007/s11869-014-0240-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11869-014-0240-4