Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 TITLE: SPIN Product Validation Report V2 Reference: SPIN_PVR2 Date of issue: 12/09/2013 Distributed to: This work is supported by the European Space Agency Generated by IUP Page 1-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 DOCUMENT PROPERTIES Title Reference Issue Revision Status Date of issue Document type Product Validation Report V2 SPIN_PVR2 00 01 Draft 12/09/2013 Deliverable FUNCTION NAME LEAD AUTHOR WP 13 science team Katja Weigel (UB) CONTRIBUTING AUTHORS WP12 manager WP12 science team WP12 science team Doug Degenstein (US) Landon Rieger (US) Lena Anneke Brinkhoff (UB) Alexei Rozanov (UB) Greg Bodeker (BS) Jo Urban (CUT) Simo Tukiainen (FMI) Andreas Jonsson (UT) Greg Bodeker (BS) Greg Bodeker (BS) WP13 manager WP14 manager WP16 manager WP17 manager WP18 manager WP22 manager WP24 manager DATE REVIEWED BY APPROVED BY ISSUED BY DOCUMENT CHANGE RECORD Issue Revision Date Modified items 1 0 19.02.2013 Assembled inputs 12.03.2013 Introduction and formatting 19.03.2013 Suggestion for summary and corrections for SCIAMACHY aerosol and water vapour added Generated by IUP Observations Page 2-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 25.03.2013 Updates of results (Stratospheric Temperature) and Summary 26.03.2013 Updates for Stratospheric Temperature 19.08.2013 New contributions for WP22 and WP24. Updates and corrections for the whole text. 12.09.2013 Generated by IUP Updates for WP16 Page 3-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Table of Contents // To update: right click: update field EXECUTIVE SUMMARY 8 APPLICABLE AND REFERENCE DOCUMENTS 8 ACRONYMS AND ABBREVIATIONS 10 1. 11 INTRODUCTION 2. DESCRIPTION OF CORRELATIVE VALIDATION/COMPARISON OF SPIN PRODUCTS DATA USED FOR 11 2.1. Stratospheric temperature 2.1.1. CHAMP 2.1.2. GRACE 2.1.3. TSX 2.1.4. NCEP-CFSR 11 11 12 12 12 2.2. 12 Stratospheric Water Vapour 2.3. Stratospheric Aerosols 2.3.1. OSIRIS 2.3.2. SCIAMACHY 13 13 13 2.4. 13 Stratospheric Ozone 3. DESCRIPTION OF CO-LOCATION CRITERIA USED TO COMPARE SPIN PRODUCTS AGAINST SELECTED GROUND-BASED AND SATELLITE-BASED OBSERVATIONS 14 3.1. Stratospheric Water Vapour 14 3.2. Stratospheric Aerosols 3.2.1. OSIRIS 3.2.2. SCIAMACHY 14 14 15 3.3. 15 4. Stratospheric Ozone VALIDATION RESULTS 15 4.1. Stratospheric temperature 4.1.1. Validation of ACE-FTS, MIPAS and SMR climatologies 4.1.2. Validation of new UT/LS temperature record 15 16 27 4.2. 27 Stratospheric Water Vapour 4.3. Stratospheric Aerosols 4.3.1. OSIRIS 4.3.1.1. SAGE II Extinction Comparison 4.3.1.2. SAGE II Angstrom Comparison Generated by IUP 30 30 30 31 Page 4-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 4.3.1.3. SAGE II Surface Area Density Comparison 4.3.1.4. SAGE III Extinction Comparison 4.3.2. SCIAMACHY 32 33 33 4.4. Stratospheric Ozone 4.4.1. Validation of the GOME Bright Limb (GBL) data set (WP17) 4.4.2. Validation of the combined SAGE II-GOMOS data set from FMI (WP22) 4.4.3. Validation of the merged SAGE II-GOMOS data set from BS (WP22) 5. INTERCOMPARISON CLIMATOLOGIES. 6. SUMMARY DISCLAIMER. AND AND EVALUATION RECOMMENDATIONS. OF 36 36 37 37 SHORT-LIVED SPECIES 37 INPUT TO DATA PRODUCT 40 6.1. Stratospheric Temperature 40 6.2. Stratospheric Water Vapour 41 6.3. Stratospheric Aerosols 6.3.1. OSIRIS 6.3.2. SCIAMACHY 41 41 41 6.4. Stratospheric Ozone 41 6.5. Short-lived species climatologies 42 List of tables // If necessary, insert here a list of tables: menu/insert/reference/index and tables. List of figures Figure 1: Annual mean temperature in 2007 from GRACE. ................................................... 17 Figure 2: Annual mean temperature difference (CHAMP minus GRACE) for 2007. ............. 17 Figure 3: Annual mean temperature difference (TSX minus GRACE) for 2010 (Top) and 2011 (Bottom). ......................................................................................................................... 18 Figure 4: Seasonal mean temperature difference (CHAMP minus TSX) for Jul-Sep 2007. ... 18 Figure 5: Annual mean temperature difference (ERA-Interim minus CHAMP) for 2007. ..... 19 Figure 6: Annual mean temperature difference (NCEP-CFSR minus CHAMP) for 2007. ..... 19 Figure 7: Annual mean temperature difference (ERA-Interim minus TSX) for 2010. ............ 20 Figure 8: Annual mean temperature difference (NCEP-CFSR minus ERA-Interim) for 2007. .................................................................................................................................................. 20 Figure 9: Annual mean temperature difference (MIPAS minus CHAMP) for 2007. .............. 21 Generated by IUP Page 5-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 10: Annual mean temperature difference (SMR minus CHAMP) for 2007. ................ 21 Figure 11: Annual mean temperature difference (MIPAS minus ERA-Interim) for 2007. ..... 22 Figure 12: Annual mean temperature difference (SMR minus ERA-Interim) for 2007. ......... 22 Figure 13: Annual mean temperature difference (ACE-FTS minus ERA-Interim) for 20052009. ......................................................................................................................................... 22 Figure 14: Temperature as a function of latitude at 10 hPa in January for individual years over 2004-2008. The solid black line and the gray shading represent the CHAMP 2004-2008 average and plus minus two standard deviations. The lower right-hand side panel shows the 2004-2008 averages.................................................................................................................. 23 Figure 15: Temperature as a function of month in the tropics at 2 hPa for individual years. Climatologies for ERA Interim, MIPAS and SMR are shown. No RO data is available at this altitude. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. ................................................................................................................. 24 Figure 16: Temperature as a function of month in the tropics at 10 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. ........... 25 Figure 17: Temperature as a function of month in the tropics at 50 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. ........... 26 Figure 18: Temperature as a function of month at northern hemisphere middle latitudes at 10 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 30N-60N. The solid black line shows the multi-year mean. ................................................................................................................. 27 Figure 19: Comparison for SCIAMACHY V3.01 and balloon-borne CFH. Left: all possible collocations, right: collocations to the processed data set (every 8th day globally, every 2nd day between 45°S and 45°N). Black solid lines show the mean percentage difference for CFH data interpolated on the SCIAMACHY retrieval grid, black dotted lines the corresponding standard deviation of the bias corrected difference. Green lines show the mean percentage difference for CFH data smoothed with the SCIAMACHY AVK (solid) and the corresponding standard deviation of the bias corrected difference (dotted). In the right panel the standard error of the mean is indicated as error bars, in the left panel it is smaller than the width of the line and hence not visible. .................................................................................... 29 Figure 20: Comparison for SCIAMACHY V3.01 and MLS v3.3 for different latitude bands. Lines as in Figure 19. ............................................................................................................... 29 Figure 21: Comparison for SCIAMACHY V3.01 and ACE-FTS V3.0 for different latitude bands. Lines as in Figure 19. .................................................................................................... 30 Figure 22: Monthly averaged 750 nm extinction ratio in the tropics. OSIRIS measurements shown in the top panel with SAGE II in the bottom panel. ..................................................... 31 Figure 23: Top panel is the monthly OSIRIS Angstrom coefficient from 750 to 1530 nm from 20°N to 20°S. Bottom panel is the same picture with the SAGE II Angstrom coefficient from 525 to 1020 nm. ........................................................................................................................ 32 Figure 24: Monthly averaged surface area density from OSIRIS in the top panel and SAGE II in the bottom panel. .................................................................................................................. 32 Figure 25: Comparison of SAGE III and OSIRIS aerosol retrievals for yearly coincident measurements. Mean percent differences are shown as solid lines with standard deviation shown as dashed. Version 5.07 retrievals are shown in red with Version 6.00 shown in black. .................................................................................................................................................. 33 Figure 26: Validation results for the latitude bins: 0-20°N, 0-20°S, 20-40°N and 20-40°S. Left panels: comparison of the retrieved 525 nm aerosol extinction profiles (red) with SAGE II Generated by IUP Page 6-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 aerosol extinction (black) and a priori profile (blue) in 8 latitude bins with standard deviation (dashed lines). Right panels: mean relative difference between SCIAMACHY and SAGE II aerosol extinction profiles with standard deviation (dashed). .................................................. 34 Figure 27: Same as Figure 26, but for the latitude bins: 40-60°N, 40-60°S, 60-80°N and 6080°S. ......................................................................................................................................... 35 Figure 28: Same as Figure 26, but for all latitudes from 80°N to 80°S. .................................. 36 Figure 29: Comparison between GBL and GOMOS night ozone. .......................................... 36 Figure 30: Comparison between GBL and MLS ozone. .......................................................... 37 Figure 31: Top row: Modelled diurnal variation of ClO at the altitudes 35, 45 and 55 km (left, middle, right) in the tropics between 20ºS and 20ºN compared to observations made by SMILES, Aura/MLS, and Odin/SMR during the period November 2009 to April 2010. SMILES data are presented by two products; the research product (here called SMILES-R) and the official product (here named SMILES-O). The standard error of the mean is shown in the same colour as the measurements. If not visible, errors are smaller than the symbol size. Model simulations are given for different months (light grey shaded lines: November; dark grey: April). Solid grey lines are for the equator, dotted lines are for 20ºS and dashed lines are for 20ºN. Satellite data have been averaged in bins of 2.5º–3ºdeg in terms of solar zenith angle. The model was run with a vertical resolution of 1 km and the model results have been vertically smoothed using a Gaussian function. The fullwidth-at-half-maximum (in km) is stated in the left upper corner of each plot. MLS and SMR values have been averaged at their ascending/descending nodes. The variability of these measurements in the form of 1-σ standard deviation is shown as vertical error bars in black. The horizontal error bars show the range of solar zenith angles of the respective measurements. Bottom row: same as top row, but offset shifted for high solar zenith angles at night-time or sunrise in order to compare the amplitudes of the SMILES, MLS, and SMR diurnal cycles with the model. The average nighttime or sunrise satellite measurements in the overlapping solar zenith angles and the model were subtracted from the values at other solar zenith angles and a correction term respective to SMILES-R for the same solar zenith angle range has been added. Adapted from Khosravi et al. (2013). ............................................................................................................................. 39 Figure 32: Same as Figure 31, but for HO2. Top row: HO2 from the model, Aura/MLS and Odin/SMR. Bottom row: Offset -shifted view for better comparison of diurnal cycle amplitudes. Note that HO2 from SMR corresponds to the period October 2003 to October 2004 when this species was observed. ..................................................................................... 40 // If necessary, insert here a list of figures: menu/insert/reference/index and tables. Generated by IUP Page 7-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Executive summary The purpose of this document is to detail the validation performed on the data sets developed and used within SPIN. In many cases the data sets developed and matured versions of older data sets. In the first phase of SPIN these data sets are: climatologies of zonal and monthly mean stratospheric temperatures from ACE-FTS, MIPAS and SMR, stratospheric water vapour from SCIAMACHY, stratospheric aerosols from OSIRIS and SCIAMACHY, stratospheric ozone from GOMOS bright limb measurements, and climatologies of short-lived species from SMR and OSIRIS. In the second phase of SPIN the data sets developed, and their validation detailed in this document, include: two different versions of a merged SAGE II+GOMOS ozone data set, an extended upper stratospheric temperature record, and an improved UT/LS temperature record. Applicable and reference documents Beyerle, G., T. Schmidt, G. Michalak, S. Heise, J. Wickert, and C. Reigber (2005), GPS radio occultation with GRACE: Atmospheric profiling utilizing the zero difference technique, Geophys. Res. Lett., 32, L13806, doi:10.1029/2005GL023109. Beyerle, G., L. Grunwaldt, S. Heise, W. Köhler1, R. König, G. Michalak, M. Rothacher, T. Schmidt, J.Wickert, B.D. Tapley, and B. Giesinger (2011), First results from the GPS atmosphere sounding experiment TOR aboard the TerraSAR-X satellite, Atmos. Chem. Phys., 11, 6687–6699. Borsche, M., G. Kirchengast, and U. Foelsche (2007), Tropical tropopause climatology as observed with radio occultation measurements from CHAMP compared to ECMWF and NCEP analyses, Geophys. Res. Lett., 34, L03702. Bourassa, A. E., L. A. Rieger, N. D. Lloyd, and D. A. Degenstein (2011), Odin-OSIRIS stratospheric aerosol data product and SAGE III intercomparison, Atmos. Chem. Phys. Discuss., 11, 25,785-25,811, doi:10.5194/acpd-11-25785-2011. Bourassa, A.E., G. Bodeker, L Brinkhoff, E. Kyrola, P. Liebing, L. Rieger, J. Urban, K. Weigel (2012), Algorithm Theoretical Baseline Document, SPIN-UB-ATBD-1.01, ESA SPARC Initiative – SPIN. Brohede, S., C.A. McLinden, J. Urban, C.S. Haley, A.I. Jonsson, and D. Murtagh (2008), Odin stratospheric proxy NOy measurements and climatology, Atmos. Chem. Phys., 8, 5731-5754. Dupuy, E., Walker, K. A., Kar, J., Boone, C. D., McElroy, C. T., Bernath, P. F., Drummond, J. R., Skelton, R., McLeod, S. D., Hughes, R. C., Nowlan, C. R., Dufour, D. G., Zou, J., Nichitiu, F., Strong, K., Baron, P., Bevilacqua, R. M., Blumenstock, T., Bodeker, G. E., Borsdorff, T., Bourassa, A. E., Bovensmann, H., Boyd, I. S., Bracher, A., Brogniez, C., Burrows, J. P., Catoire, V., Ceccherini, S., Chabrillat, S., Christensen, T., Coffey, M. T., Cortesi, U., Davies, J., De Clercq, C., Degenstein, D. A., De Mazière, M., Demoulin, P., Dodion, J., Firanski, B., Fischer, H., Forbes, G., Froidevaux, L., Fussen, D., Gerard, P., Godin-Beekmann, S., Goutail, F., Granville, J., Griffith, D., Haley, C. S., Hannigan, J. W., Höpfner, M., Jin, J. J., Jones, A., Jones, N. B., Jucks, K., Kagawa, A., Kasai, Y., Kerzenmacher, T. E., Kleinböhl, A., Klekociuk, A. R., Kramer, I., Küllmann, H., Kuttippurath, J., Kyrölä}, E., Lambert, J.-C., Livesey, N. J., Llewellyn, E. J., Lloyd, N. D., Mahieu, E., Manney, G. L., Marshall, B. T., McConnell, J. C., McCormick, M. P., McDermid, I. S., McHugh, M., McLinden, C. A., Mellqvist, J., Mizutani, K., Murayama, Y., Murtagh, D. P., Oelhaf, H., Parrish, A., Petelina, S. V., Piccolo, C., Pommereau, J.-P., Randall, C. E., Robert, C., Roth, C., Schneider, M., Senten, C., Steck, T., Strandberg, A., Strawbridge, K. B., Sussmann, R., Swart, D. P. J., Tarasick, D. W., Taylor, J. R., Tétard, C., Thomason, L. W., Thompson, A. M., Tully, M. B., Urban, J., Vanhellemont, F., Vigouroux, C., von Clarmann, T., von der Gathen, P., von Savigny, C., Waters, J. W., Witte, J. C., Generated by IUP Page 8-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Wolff, M., and Zawodny, J. M. (2009), Validation of ozone measurements from the Atmospheric Chemistry Experiment (ACE), Atmos. Chem. Phys., 9, 287--343, doi:10.5194/acp-9-287-2009. Eichmann, K.-U., von Savigny, C., Reichl, P., Robert, C., Steinwagner, J., Bovensmann, H., and Burrows, J. P. (2009), SCODA: SCIAMACHY Cloud Detection Algorithm from limb radiance measurements, Algorithm Theoretical Baseline Document (ATBD), University of Bremen, Germany. Ernst, F., von Savigny, C., Rozanov, A., Rozanov, V., Eichmann, K.-U., Brinkhoff, L. A., Bovensmann, H., and Burrows, J. P. (2012), Global stratospheric aerosol extinction profile retrievals from SCIAMACHY limb-scatter observations, Atmos. Meas. Tech. Discussion. Fujiwara, M., Voemel, H., Hasebe, F., Shiotani, M., Ogino, S.- Y., Iwasaki, S., Nishi, N., Shibata, T., Shimizu, K., Nishimoto, E., Valverde-Canossa, J. M., Selkirk, H. B., and Oltmans, S. J. (2010), Seasonal to decadal variations of water vapor in the tropical lower stratosphere observed with balloonborne cryogenic frost point hygrometers, J. Geophys. Res., 115, D18304, doi:10.1029/2010JD014179. Hegglin, M. I., Boone, C. D., Manney, G. L., Shepherd, T. G., Walker, K. A., Bernath, P. F., Daffer, W. H., Hoor, P., and Schiller, C. (2008), Validation of ACE-FTS satellite data in the upper troposphere/lower stratosphere (UTLS) using non-coincident measurements, Atmos. Chem. Phys., 8, 1483-1499, doi:10.5194/acp-8-1483-2008. Jones, A., Urban, J., Murtagh, D. P., Sanchez, C., Walker, K. A., Livesey, N., Froidevaux, L., Santee, M.L. (2011), Analysis of HCl and ClO time series in the upper stratosphere using satellite data sets, Atmos. Chem. Phys. 11, 5321-5333, doi:10.5194/acp-11-5321-2011. Khosravi, M., Baron, P., Urban, J., Froidevaux, L., Jonsson, A. I., Kasai, Y., Kuribayashi, K., Mitsuda, C., Murtagh, D. P., Sagawa, H., Santee, M. L., Sato, T. O., Shiotani, M., Suzuki, M., von Clarmann, T., Walker, K. A., and Wang, S.: Diurnal variation of stratospheric and lower mesospheric HOCl, ClO and HO2 at the equator: comparison of 1-D model calculations with measurements by satellite instruments, Atmos. Chem. Phys., 13, 7587-7606, doi:10.5194/acp-13-7587-2013, 2013. McCormick, M. P. (1987), SAGE II: An Overview, Adv. Space Res., 7(3), 219-226. McLinden, C. A., C. S. Haley, N. D. Lloyd, F. Hendrick, A. Rozanov, B.‐M. Sinnhuber, F. Goutail, D.A. Degenstein, E. J. Llewellyn, C. E. Sioris, M. Van Roozendael, J. P. Pommereau,W. Lotz, and J. P. Burrows (2009), Odin/OSIRIS observations of stratospheric BrO: Retrieval methodology, climatology, and inferred Bry, J. Geophys. Res., 115, D15308, 2010, doi:10.1029/2009JD012488. Read, W. G., Lambert, A., Bacmeister, J., Cofield, R. E., Christensen, L. E., Cuddy, D. T., Daffer, W. H., Drouin, B. J., Fetzer, E., Froidevaux, L., Fuller, R., Herman, R., Jarnot, R. F., Jiang, J. H., Jiang, Y. B., Kelly, K., Knosp, B. W., Kovalenko, L. J., Livesey, N. J., Liu, H.-C., Manney, G. L., Pickett, H. M., Pumphrey, H. C., Rosenlof, K. H., Sabounchi, X., Santee, M. L., Schwartz, M. J., Snyder, W. V., Stek, P. C., Su, H., Takacs, L. L., Thurstans, R. P., Vomel, H., Wagner, P. A., Waters, J. W., Webster, C. R., Weinstock, E. M., and Wu, D. L. (2007), Aura Microwave Limb Sounder upper tropospheric and lower stratospheric H2O and relative humidity with respect to ice validation, J. Geophys. Res., 112, D24S35, doi:10.1029/2007JD008752. Rozanov, A., Weigel, K., Bovensmann, H., Dhomse, S., Eichmann, K.-U., Kivi, R., Rozanov, V., Vömel, H., Weber, M., and Burrows, J. P. (2011), Retrieval of water vapor vertical distributions in the upper troposphere and the lower stratosphere from SCIAMACHY limb measurements, Atmos. Meas. Techn., 4, 933-954, doi:10.5194/amt-4-933-2011. Russell, P. B., and M. P. McCormick (1989), SAGE II aerosol data validation and initial data use - An introduction and overview, J. Geophys. Res., 94, 8335-8338, doi:10.1029/JD094iD06p08335. Schmidt, T., J. Wickert, C. Marquardt, G. Beyerle, C. Reigber, R. Galas, and R. König (2004), GPS radio occultation with CHAMP: an innovative remote sensing method of the atmosphere, Adv. Space Res., 33, 1036–1040. Generated by IUP Page 9-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Selkirk, H. B., Vömel, H., Valverde Canossa, J. M., Pfister, L., Diaz, J. A., Fernández, W., Amador, J., Stolz, W., and Peng, G. (2010), Detailed structure of the tropical upper troposphere and lower stratosphere as revealed by balloon sonde observations of water vapor, ozone, temperature and winds during the NASA TCSP and TC4 campaigns, J. Geophys. Res., 115, D00J19, doi:10.1029/2009JD013209. Thomason, L. W., and L. R. Poole (1992), Use of Stratospheric Aerosol Properties as Diagnostics of Antarctic Vortex Processes, J. Geophys. Res., 98, 23,003/23,012, doi:10.1029/93JD02461. Thomason, L. W., L. R. Poole, and T. Deshler (1997), A global climatology of stratospheric aerosol surface area density deduced from Stratospheric Aerosol and Gas Experiment II measurements: 19841994, J. Geophys. Res., 102, 8967-8976, doi:10.1029/96JD02962. Thomason, L. W., and G. Taha (2003), SAGE III aerosol extinction measurements: Initial results, Geophys. Res. Lett., 30, 1631, doi:10.1029/2003GL017317. Velazco, V. A., Toon, G. C., Blavier, J.-F. L., Kleinböhl, A., Manney, G. L., Daffer, W. H., Bernath, P. F., Walker, K. A., and Boone, C. (2011), Validation of the Atmospheric Chemistry Experiment by noncoincident MkIV balloon profiles, J. Geophys. Res., 116, D06306, doi:10.1029/2010JD014928. Wurl, D., R. G. Grainger, A. J. McDonald, and T. Deshler (2010), Optimal estimation retrieval of aerosol microphysical properties from SAGE II satellite observations in the volcanically unperturbed lower stratosphere, Atmos. Chem. Phys., 10, 4295-4317. Acronyms and abbreviations ACE-FTS - Atmospheric Chemistry Experiment - Fourier Transform Spectrometer AVK - Averaging Kernel BS – Bodeker Scientific CFH - Cryogenic Frost point Hygrometer CFSR- Climate Forecast System Reanalyses CHAMP - CHAllenging Mini-satellite Payload DI - Data Initiative ECMWF - European Centre for Medium-Range Weather Forecasts ENVISAT - Environmental Satellite EOS - Earth Observing System ESA - European Space Agency ESA-TPM - ESA Thrid Party Mission FMI – Finnish Meteorological Institute GACMiST - (GRACE, ACE-FTS, CHAMP, MIPAS, SMT, TSX) GBL - GOMOS bright limb GFZ - GeoForschungsZentrum GOMOS Global Ozone Monitoring by Occultation of Stars GRACE – Gravity Recovery and Climate Experiment GPS - Global Positioning System HALOE - The Halogen Occultation Experiment JAXA - Japan Aerospace Exploration Agency MIPAS - Michelson Interferometer for Passive Atmospheric Sounding MLS – Microwave Limb Sounder MPV - modified potential vorticity NCEP - National Centers for Environmental Prediction OSIRIS - Optical System for Imaging and low Resolution Integrated Spectroscopy POAM - Polar Ozone and Aerosol Measurement PVU – Potential Vorticity Units Generated by IUP Page 10-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 RO – Radio Occultation SAD - Surface Area Density SAGE - Stratospheric Aerosol and Gas Experiment SAR Synthetic Aperture Radar SCIAMACHY - Scanning Imaging Absorption Spectrometer for Atmospheric ChartographY SCODA - SCIAMACHY Cloud Detection Algorithm SMILES - Superconducting Submillimeter-Wave Limb-Emission Sounder SMR - Sub-Millimetre Radiometer SPARC - Stratospheric Processes And their Role in Climate SPIN – ESA SPARC Initiative SZA – Solar Zenith Angle WP – Work Package TSX - TerraSAR-X 1. Introduction This document describes the validation of the data sets produced or matured within the SPIN project to evaluate their quality. Chapter 2 describes the correlative data sets used for this purpose for stratospheric temperature, water vapour, aerosols and ozone. The co-location criteria are presented in Chapter 3 for data sets which are validated through the comparison of collocated profiles. These data sets are stratospheric water vapour from SCIAMACHY, stratospheric aerosols from OSIRIS and SCIAMACHY, and stratospheric ozone from GBL measurements. Due to the different sampling regimens, and different availability of correlative data, the co-location criteria differ between the data sets. For stratospheric temperature, climatologies are validated and therefore co-location criteria are not applicable. The validation results for all the data sets developed within SPIN are shown in Chapter 4. Chapter 5 describes the concept for the evaluation of SMR and OSIRIS short-lived species climatologies. Results from the evaluation of these climatologies within the SPARC-DI are included. In Chapter 6, the PVR is summarized and inputs for the data product disclaimer are listed. 2. Description of correlative data used for validation/comparison of SPIN products 2.1. Stratospheric temperature The following radio occultation (RO) data sets have been used to validate the stratospheric temperature climatologies developed within WP18 of SPIN: 2.1.1. CHAMP RO temperature profile measurements were obtained from the CHAMP satellite (Schmidt et al., 2004; Borsche et al., 2007) to generate monthly mean and zonal mean temperature time series on a latitude/pressure grid for the period May 2001 to October 2008. CHAMP provides global coverage of vertical profiles of dry temperature between 0 and 40 km altitude with a vertical resolution of 1.5 km in the stratosphere. The temperature profiles are accurate to approximately 0.5 K between 5-20 km altitude. In the stratosphere, the difference between the dry temperature and the physical temperature is negligible. CHAMP temperature profiles were interpolated in log pressure coordinates from their native pressure levels to the pressure levels defining the satellite-based temperature measurement climatologies i.e. 300, 250, 200, 170, 150, 130, 115, 100, 90, 80, 70, 50, 30, 20, 15, 10, 7, 5, 3, 2, 1.5 1, 0.7, 0.5, 0.3, 0.2, 0.15, Generated by IUP Page 11-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 and 0.1 hPa, although CHAMP temperature profiles at the upper pressure levels (<1 hPa) were not available. Interpolated values were corrected for their representativeness of zonal mean monthly mean temperature using NCEP (National Centers for Environmental Prediction) CFSR (Climate Forecast System Reanalyses) 6 hourly temperature fields on pressure surfaces as: ̅̅̅̅̅̅̅̅̅ 𝑇 (5°,𝑃,𝑚𝑜𝑛𝑡ℎ) 𝑇𝑐𝑜𝑟𝑟 = 𝑇𝑅𝑂 (𝜃, 𝜑, 𝑃, 𝑡) × 𝐶𝐹𝑆𝑅 (𝜃,𝜑,𝑃,𝑡) (3) 𝑇𝐶𝐹𝑆𝑅 where: Tcorr is the bias corrected temperature value, TRO is the RO temperature measurement interpolated onto pressure P at latitude θ, longitude φ at time t, ̅̅̅̅̅̅̅ 𝑇𝐶𝐹𝑆𝑅 (5°, 𝑃, 𝑚𝑜𝑛𝑡ℎ) is the NCEP-CFSR 5° zonal mean monthly mean temperature at pressure P, and TCFSR is the NCEP-CFSR temperature at the same time and location as TRO. Applying equation (3) corrects the RO measurements for their sampling bias both in terms of geographical coverage and coverage within the month of interest. 2.1.2. GRACE This twin satellite configuration is based on CHAMP heritage and was launched on 17 March 2002 (Beyerle et al., 2005). GRACE RO data were processed using the same algorithm as used for CHAMP to create monthly mean 5° zonal mean climatologies on the same pressure grid as used for CHAMP. GRACE temperature climatologies from January 2006 to December 2011 were made available. 2.1.3. TSX TerraSAR-X (hereafter referred to as TSX; Beyerle et al., 2011) RO data are routinely processed at GeoForschungsZentrum (GFZ), Potsdam. These data were treated using the same algorithm as used for CHAMP to create monthly mean 5° zonal mean climatologies on the same pressure grid as used for CHAMP. TSX temperature climatologies from July 2008 to March 2012 were made available. 2.1.4. NCEP-CFSR In addition to the RO temperature climatologies detailed above, climatologies were calculated directly from the NCEP-CFSR reanalyses. These span the period January 1979 to December 2010. The highest level at which the NCEP-CFSR climatologies are available is 1 hPa. The CHAMP, GRACE and TSX radio occultation products have also been used directly in WP24 to create the improved UT/LS temperature record which is then used as the validation standard for the combined MSU4+AMSU9 temperature series. 2.2. Stratospheric Water Vapour The SCIAMACHY limb water vapour profiles are compared against several other instruments: balloon-borne Cryogenic Frost point Hygrometer (CFH) data, measurements from the Earth Observing System (EOS) Microwave Limb Sounder (MLS) on Aura and the Atmospheric Chemistry Experiment – Fourier Transform Spectrometer (ACE-FTS). The CFH data are the same as used by Rozanov et al. (2011). Details on the instrument and measurement campaigns can be found in Vömel et al. (2007), Fujiwara et al. (2010), and Selkirk et al. (2010). The MLS data used were produced by the Jet Propulsion Laboratory, California Institute of Technology under contract with the National Aeronautics and Space Generated by IUP Page 12-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Administration. MLS measures microwave radiation in the limb geometry. Here, water vapour from MLS level 2 data version 3.3 (v3.3) is used (see http://mls.jpl.nasa.gov/data/v33_data_quality_document.pdf). A validation of version 2.2, which is similar to v3.3, can be found in Read et al., 2007. ACE-FTS measures solar occultation of thermal infrared radiation. ACE, which flies on the SCISAT platform, is a Canadian-led mission mainly supported by the Canadian Space Agency and the Natural Sciences and Engineering Research Council of Canada. Version 3.0 ACE-FTS water vapour profiles are used as the validation data sets for the SCIAMACHY water vapour product. A validation of version 2.2 ACE-FTS retrievals can be found e.g. in Velazco et al., 2011 and Hegglin et al., 2008. 2.3. Stratospheric Aerosols 2.3.1. OSIRIS The Stratospheric Aerosol and Gas Experiments (SAGE) II was operation from 1985 to 2005, providing high quality occultation measurements of aerosol extinction at 385, 420, 525 and 1020 nm (Russell and McCormick, 1989). Although SAGE II does not have a 750 nm channel, data from neighbouring channels can be used to infer the Angstrom coefficient around 750 nm and produce a SAGE II 750 nm extinction product. The Angstrom coefficient can also be compared to the retrieved OSIRIS Angstrom coefficient, although the wavelength discrepancy means comparisons will be qualitative only. Finally, SAGE II was used to retrieve integral properties of the particle size distribution such as the surface area density (Thomason, 1992, 1997). Although OSIRIS measurements are used to retrieve parameters of a lognormal distribution, these can be converted to surface area density for comparison with SAGE II. SAGE III was launched in 2002 and operated until 2005, producing aerosol extinction measurements from 385 to 1545 nm (Thomason, 2003). SAGE III was launched into a sunsynchronous orbit which produced measurements from middle to high latitudes. Although SAGE III has not been used to produce an aerosol particle size product, the wavelengths at 755 and 1545 nm are excellent channels for comparison of the OSIRIS extinction coefficient measurements. Thomason et al. (2010) estimate the accuracy and precision of these channels to be within 10%. 2.3.2. SCIAMACHY The SCIAMACHY aerosol retrieval approach is validated by comparing the retrieved aerosol extinction profiles with co-located SAGE II measurements. The Stratospheric Aerosol and Gas Experiment II (SAGE II) was aboard the NASA Earth Radiation Budget Satellite (ERBS) and operated from 1984 to 2005. This solar occultation instrument was equipped with a seven-channel sun photometer, which measured, for example, stratospheric aerosols, ozone, water vapour, and nitrogen dioxide (McCormick, 1987). One of the SAGE II data products is stratospheric aerosol extinction profiles at 525 nm wavelength (e.g., Thomason, 1991). The SAGE II stratospheric aerosol data set is generally considered to be one of the stratospheric aerosol data sets with the highest accuracy, and is therefore well suited to serve as a benchmark for comparisons with the SCIAMACHY data set. 2.4. Stratospheric Ozone To perform initial validation for the GOMOS bright limb ozone profiles, we used reference measurements from the GOMOS night time occultation (v6 data) and version 3.3 MLS data. Generated by IUP Page 13-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 The comparison was done using all available data between 2002 and 2012 with the analyses being done in 20° latitude zones e.g. 50°S-70°S, 30°S-50°S,...50°N-70°N. The difference between the ozone measurements from the two data sets is estimated using the median of the relative individual differences calculated as: (GBLREFERENCE)/REFERENCE×100 % where the reference is GOMOS (night occultation) or MLS. 3. Description of co-location criteria used to compare SPIN products against selected ground-based and satellite-based observations 3.1. Stratospheric Water Vapour For the comparisons of the SCIAMACHY water vapour data against MLS, ACE-FTS and CFH measurements, different collocation criteria were chosen because the validation data sets have differing measurement densities. These criteria are: CFH: less 1000 km and 5 hours; data are available from 2002 to 2008, 171 for collocations are found for V3.01. ACE-FTS: less 500 km and 6 hours; data are available from 2004 to September 2010, 1888 collocations are found for V3.01. MLS: less 100 km and 6 hours; data are available from 2004 to 2012, 13680 collocations are found for V3.01. Additionally, a criterion for the modified potential vorticity (MPV) at 475 K is applied. The MPV is calculated from ECMWF data. Profiles are excluded from the comparison if the MPV differs by more than 3PVU or if the profiles are located at the edge of the polar vortex (3040PVU). The effect of the MPV criterion is not large, which can be expected since it regards a stratospheric quantity and the SCIAMACHY profiles cover only the upper troposphere and lower stratosphere. Therefore, for future comparisons, a criterion which detects different air masses based on their tropopause height should be applied. 3.2. Stratospheric Aerosols 3.2.1. OSIRIS The global coverage and different wavelengths of SAGE II relative to OSIRIS make large scale zonal comparisons ideal, particularly in the tropics where two volcanic eruptions occurred (Mts Ruang and Reventador and Mt. Manam) over the 4 year overlap of the missions. Although SAGE II provides global coverage, this occurs over relatively long time scales compared to OSIRIS measurements, and so averaging is done in monthly bins to provide continuity of measurements. The SAGE III orbit does not yield global coverage and takes measurements at well-defined latitudes over the course of the year. While this makes large scale comparisons difficult, the accuracy of the SAGE III 755 nm channel makes comparisons with coincident measurements an excellent test of the OSIRIS 750 nm extinction product for middle to polar latitudes. The coincidence criteria used here are the same as in Bourassa et al. (2011); the reference tangent points of the OSIRIS and SAGE III measurements are within ±6 hours, ±1° latitude, and ±2.5° longitude. These tight criteria should produce comparisons of similar potential vorticity, Generated by IUP Page 14-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 and because OSIRIS does not make measurements during winter, eliminate comparisons across the polar vortex. 3.2.2. SCIAMACHY The SCIAMACHY aerosol extinction is retrieved at altitudes between 12 and 32 km, using the 75°S modified ECSTRA aerosol extinction profile as the a priori profile for all latitudes. To determine the ground albedo, the Matthews database (Matthews, 1983) was used, which considers vegetation, land use, and land cover on a 1° × 1° grid. A cloud screening was not applied as previous validation results with SAGE II showed that cloud screening does not affect the comparisons between SCIAMACHY and SAGE II (see Ernst et al., 2012). However, below 20 km the frequent occurrence of tropospheric clouds prevents a promising retrieval at these latitudes. An analysis of the tropospheric cloud detection data set obtained with SCODA (SCIAMACHY Cloud Detection Algorithm) (Eichmann et al., 2009) showed that about 95% of all SCIAMACHY limb measurements are affected by tropospheric clouds. The overlapping time period between SCIAMACHY and SAGE II used for the validation is from 1 January 2003 to 17 August 2005. We used all SCIAMACHY limb observations within a spatial distance of 500 km and a temporal difference of 6 hours at most to a SAGE II measurement. SCIAMACHY data with a SZA exceeding 87° were not considered. Moreover, the SCIAMACHY stratospheric aerosol extinction values were converted to 525 nm wavelength for the comparison to SAGE II observations, using the assumed spectral dependence of the aerosol extinction coefficient. First, the Angstrom exponent (α) is calculated from the aerosol extinction coefficients (ε) of the two wavelengths, 470 nm and 750 nm, for each tangent height: α = - log[ε(750nm)/ε(470nm)] / log[750nm/470nm] Afterwards, the aerosol extinction coefficient at 525 nm is calculated by ε(525nm) = ε(750nm)/(750nm/525nm)-α. For the comparison, mean profiles and relative differences of mean profiles ((SCIAMACHYSAGE)/SAGE) of the globally averaged SAGE II and SCIAMACHY stratospheric aerosol extinction profiles at 525 nm wavelength were calculated 3.3. Stratospheric Ozone To compare the GBL data product developed in SPIN with the GOMOS night occultation data, the following criteria were used: Time difference less than 24 hours and a spatial difference less than 250 km. For the night occultation, measurements derived from stars with Mg>1.7 and T<7000K were excluded from the comparison. To compare the GBL and MLS ozone profiles, the following criteria were used: Time difference less than 12 hours and a spatial difference less than 200 km. For this comparison we first converted the GBL profiles from a density/altitude grid to a mixing ratio/pressure grid using ECMWF temperature and pressure profiles. 4. Validation results 4.1. Stratospheric temperature In WP18 monthly and zonal mean temperature climatologies have been produced for three ESA or ESA-TPM based instruments, including ACE-FTS, MIPAS and SMR. To assess the Generated by IUP Page 15-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 quality of these climatologies they have been validated against several radio occultation (RO) climatologies, also produced in WP18. The results of the validation are report in Section 4.1.1. The RO instruments include CHAMP, GRACE, and TSX. Various types of comparisons have been produced, including projecting the climatologies as latitude-pressure maps latitudinal profiles vertical profiles seasonal cycles monthly mean time series Some of these comparisons also include reanalysis data, more specifically ERA-Interim and NCEP-CFSR. Many comparisons are taken over the 2004-2008 time period, as this is the longest record covered by all three of the ESA-based climatologies. To avoid any sampling error affect, the validation of data at all temporal periods, i.e. annual or multi-year averages, are, unless otherwise stated, derived in such a way that a result is only presented if data are available for all time steps over which the averages are calculated (otherwise a no-data-value is a applied). WP24 develops an improved UT/LS temperature record using the ACE-FTS, MIPAS, SMR and radio occultation data sets (CHAMP, GRACE TSX) derived in WP18, and hereafter referred to as the GACMiST (GRACE, ACE-FTS, CHAMP, MIPAS, SMT, TSX) data set. This improved UT/LS record is then used to assess the validity of the MSU4+AMSU9 data splicing. Our improved US/LS temperature record is a monthly mean record in 5° latitude zones on the same pressure grid as used in WP18. GACMiST is validated against: 1. A reanalysis, in particular the NCEPCFSR reanalysis. 2. COSMIC radio occultation data 3. The Integrated Global Radiosonde Archive (IGRA) This validation is reported on in Section 4.1.2. 4.1.1. Validation of ACE-FTS, MIPAS and SMR climatologies Latitude pressure maps First we compare the reference datasets, and we start with the RO climatologies, comparing annual mean temperatures for periods of overlap between the respective missions. The CHAMP climatology extends over 2001-2008, the GRACE climatology extends over 20062011 and the TSX climatology extends over 2008-2012. There are, however, data gaps for individual months, so for complete years there is overlap in time between CHAMP and GRACE only in 2007 and between GRACE and TSX only in 2010 and 2011. Figure 1 Figure 1 shows the annual average temperature in 2007 from GRACE. Figure 2 shows the difference in annually averaged temperature in 2007 between CHAMP and GRACE (CHAMP minus GRACE). GRACE and CHAMP agree to within 0.5 K in the lower stratosphere, around 20 km, but there is a robust bias that increases in magnitude with height, reaching 3-5 Generated by IUP Page 16-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 K in the upper stratosphere, near 40 km. CHAMP is consistently colder than GRACE in the southern hemisphere and consistently warmer than GRACE in the northern hemisphere. Figure 3 shows, in a similar fashion, the difference between TSX and GRACE in 2010 and 2011. Similar to the comparison between CHAMP and GRACE, TSX is consistently colder than GRACE in the southern hemisphere and consistently warmer than GRACE in the northern hemisphere. The biases are of equal sign and magnitude (as in the comparison between CHAMP and GRACE) suggesting a hypothesis that a comparison between CHAMP and TSX should show a much smaller bias if a direct comparison was possible. However, a comparison of TSX with CHAMP annual means is not possible due to the short temporal overlap between their time records. Moreover, comparing different years is not helpful since the magnitude of the interannual variability of monthly zonal mean temperature in the middle atmosphere is comparable to or exceeds the expected biases between the datasets, in the order of a few degrees at most. Figure 4 shows a comparison of CHAMP and TSX over the short overlap between the two datasets, from July to September 2008. The results partly confirm the hypothesis above. In the northern hemisphere CHAMP and TSX generally agrees to within 1 K or better at all heights. In the southern hemisphere, however, CHAMP is colder by up to 15 K in the upper layers. Figure 1: Annual mean temperature in 2007 from GRACE. Figure 2: Annual mean temperature difference (CHAMP minus GRACE) for 2007. Generated by IUP Page 17-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 3: Annual mean temperature difference (TSX minus GRACE) for 2010 (Top) and 2011 (Bottom). Figure 4: Seasonal mean temperature difference (CHAMP minus TSX) for Jul-Sep 2007. Until the anomaly in the GRACE climatology is better understood it makes sense to use CHAMP and TSX as reference datasets for the ESA and ESA-TPM based climatologies. There is overlap between the ESA and ESA-TPM climatologies over 2004-2008, and hence CHAMP will effectively be used rather than TSX. Next we compare the RO climatologies with two reanalysis datasets, ERA-Interim and NCEP-CFSR. Figure 5 shows ERA-Interim minus CHAMP, again annually averaged over 2007. Figure 6 shows NCEP-CFSR minus CHAMP for the same time period. Both ERA- Generated by IUP Page 18-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Interim and NCEP-CFSR are in reasonably good agreement with CHAMP throughout most of the stratosphere, where both reanalyses are generally 0-2 K colder than CHAMP. Although SPIN focuses on the stratospheric temperature record, it can be noted that both reanalyses are much warmer than CHAMP in the troposphere. This bias has not yet been investigated. Comparisons of NCEP-CFSR and ERA-Interim with TSX in 2010 show similar results (Figure 7). Figure 8 shows a comparison between NCEP-CFSR and ERA-Interim for 2007. The two datasets are very close, generally within 0.5 K throughout the troposphere and stratosphere below 30 km. Above 30 km NCEP-CFSR is warmer than ERA-Interim by up to 7 K. It is unclear why both CHAMP and TSX are systematically colder than NCEP-CFSR and ERA-Interim in the stratosphere. The high level of agreement between NCEP-CFSR and ERA-Interim up to 30 km is convincing. To evaluate the ESA and ESA-TPM climatologies we have therefore chosen to show comparisons with ERA-Interim, keeping in mind that both CHAMP and TSX are on average 0-2 K colder than ERA-Interim, and that ERA-Interim temperatures in the upper stratosphere are highly uncertain, as the comparison with NCEPCFSR shows. Figure 5: Annual mean temperature difference (ERA-Interim minus CHAMP) for 2007. Figure 6: Annual mean temperature difference (NCEP-CFSR minus CHAMP) for 2007. Generated by IUP Page 19-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 7: Annual mean temperature difference (ERA-Interim minus TSX) for 2010. Figure 8: Annual mean temperature difference (NCEP-CFSR minus ERA-Interim) for 2007. Figure 9 to Figure 13 shows the difference in annual mean temperature between the ESA and ESA-TPM-based climatologies and CHAMP and ERA-Interim. Figure 9 and Figure 10 shows the difference between MIPAS and CHAMP and the difference between SMR-STRAT and CHAMP, respectively, for 2007. To establish the relative biases between the climatologies also in the upper stratosphere, where the RO climatologies generally don't provide measurements, MIPAS and SMR are also compared to ERA-Interim (Figure 11 and Figure 12). Note that CHAMP is on average 1-2 K warmer than ERA-Interim in the stratosphere up to about 40 km. This contributes to some of the negative biases displayed by both MIPAS and SMR-STRAT with respect to CHAMP (Figure 9 and Figure 10). The MIPAS and SMRSTRAT climatologies both generally compare more favourably with ERA-Interim (Figure 11 and Figure 12). MIPAS agrees very well with ERA-Interim, generally within 2 K throughout the region of comparison. Specifically the agreement is particularly excellent, within 1 K, throughout the 15-30 km region. SMR-STRAT is warmer by up to 5 K at 20-25 km, colder by ~5 K at 35-45 km, and colder by ~20 K at 50 km, than ERA-Interim. The measurement coverage of ACE-FTS is much sparser than that of MIPAS and SMR, and hence latitudinal data gaps are much more prevalent in the ACE-FTS climatology Therefore Generated by IUP Page 20-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 the ACE-FTS climatology is assessed over the five year period from 2005-2009, over which ACE-FTS provides a continuous record (i.e. for which the climatology provides data in each month). Note however, that due to the sparsity of the dataset, for a given latitude, it is generally not possible to derive a multi-year average without the introduction sampling error. This should be kept in mind when interpreting the ACE-FTS results. Figure 13 shows the difference in annual mean temperature between the ACE-FTS and ERA-Interim climatologies. ACE-FTS is generally within 5 K of ERA-Interim at low and middle latitudes but discrepancies reach up to 25 K at high latitudes. These large biases are mostly due to sampling error, which are expected to be largest at high latitude where the interannual variability in temperature is large. Comparisons of ACE-FTS with ERA-Interim and CHAMP on a month to month basis (not shown) show significantly smaller biases, however, such detailed comparisons goes beyond the scope of WP18, which focuses on large scale comparisons, such that can be useful for developing an extension of the global stratospheric temperature record of SSU in WP23. Figure 9: Annual mean temperature difference (MIPAS minus CHAMP) for 2007. Figure 10: Annual mean temperature difference (SMR minus CHAMP) for 2007. Generated by IUP Page 21-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 11: Annual mean temperature difference (MIPAS minus ERA-Interim) for 2007. Figure 12: Annual mean temperature difference (SMR minus ERA-Interim) for 2007. Figure 13: Annual mean temperature difference (ACE-FTS minus ERA-Interim) for 2005-2009. Latitudinal profiles Figure 14 shows the temperature climatologies as a function of latitude at 10 hPa in January over the 2004-2008 period. Generated by IUP Page 22-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 14: Temperature as a function of latitude at 10 hPa in January for individual years over 20042008. The solid black line and the grey shading represent the CHAMP 2004-2008 average and plus minus two standard deviations. The lower right-hand side panel shows the 2004-2008 averages. Vertical profiles Will be added when some of the data issues highlighted in section 4.1.1 have been resolved. Seasonal cycles Figure 15 to Figure 17 shows the temperature climatologies as a function of month in the tropics at 2, 10 and 50 hPa respectively. All available years, for each climatology, are included in the figures. Figure 18 shows the same type of plot at northern hemisphere middle latitudes at 10 hPa. Note that RO data generally do not extend up to the stratopause, so Figure 15 does not include any RO datasets. Also note that at 50 hPa the SMR-STRAT climatology does not provide a complete coverage in the tropics, so the seasonal cycle cannot be fully resolved there. For the tropical comparisons the following can be noted: There is some general offset between the datasets but the seasonal cycle (annual in the lower stratosphere and semi-annual in the upper stratosphere) in terms of magnitude and phase agrees well. There is excellent agreement between MIPAS and ERA-Interim for individual years, e.g. the anomalously warm boreal autumn of 2002 at 2 hPa and the anomalously cold boreal summer of 2010 at the same height. This is to some extent also captured by SMR-STRAT. Generated by IUP Page 23-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 At middle latitudes (Figure 18) there is very little interannual variability in the temperature averages. Note, however, that SMR-STRAT displays significantly more variability than both ERA-Interim and CHAMP, as well as MIPAS. Figure 15: Temperature as a function of month in the tropics at 2 hPa for individual years. Climatologies for ERA Interim, MIPAS and SMR are shown. No RO data is available at this altitude. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. Generated by IUP Page 24-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 16: Temperature as a function of month in the tropics at 10 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. Generated by IUP Page 25-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 17: Temperature as a function of month in the tropics at 50 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 15S-15N. The solid black line shows the multi-year mean. Generated by IUP Page 26-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 18: Temperature as a function of month at northern hemisphere middle latitudes at 10 hPa for individual years. Climatologies for CHAMP, ERA Interim, MIPAS and SMR are shown. The data represents a latitudinal average across 30N-60N. The solid black line shows the multi-year mean. Monthly mean time series Will be added when some of the data issues highlighted in section 4.1.1 have been resolved. 4.1.2. Validation of new UT/LS temperature record Material will be inserted here once the GACMiST data set generation has been completed and validated against the three data sources detailed above. 4.2. Stratospheric Water Vapour The comparisons are done following the method used by Dupuy et al. (2009). For all comparisons the mean percentage difference between the SCIAMACHY profiles and the other instrument is calculated for all altitudes (z) with: 𝑁(𝑧) 1 ∆𝑧 = ∑ 𝛿𝑖 (𝑧) 𝑁(𝑧) 𝑖=1 Where 𝑁(𝑧) is the number of pairs and 𝛿𝑖 (𝑧) are all percentage differences 𝛿(𝑧) between the water vapour profile from SCIAMACHY (𝑥𝑆𝐶𝐼𝐴 ) and the instrument used for comparison (𝑥𝑐𝑜𝑚𝑝 ): 𝛿(𝑧) = 100 ∗ (𝑥𝑆𝐶𝐼𝐴 (𝑧) − 𝑥𝑐𝑜𝑚𝑝 (𝑧))/𝑥𝑟𝑒𝑓 (𝑧) The reference 𝑥𝑟𝑒𝑓 is the average of the two profiles: Generated by IUP Page 27-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 𝑥𝑟𝑒𝑓 (𝑧) = (𝑥𝑆𝐶𝐼𝐴 (𝑧) + 𝑥𝑐𝑜𝑚𝑝 (𝑧)) ∗ 0.5 𝑥𝑐𝑜𝑚𝑝 is either interpolated on the retrieval grid of SCIAMACHY (black lines in the following figures) or smoothed with the Averaging Kernel (AVK) of SCIAMACHY (green lines). The standard deviation of the bias corrected difference is calculated with: 𝑁(𝑧) 1 √ ∑ (𝛿𝑖 (𝑧) − ∆𝑧)2 𝜎(𝑧) = 𝑁(𝑧) − 1 𝑖=1 and the standard error of the mean, which is often not visible because it is smaller than the width of the lines with: 𝜎(𝑧) 𝑆𝐸𝑀(𝑧) = √𝑁(𝑧) Figure 19 shows the mean percentage differences, the standard deviation of the bias corrected difference and the standard error of the mean (only visible in the right panel) for SCIAMACHY V3.01 and the CFH data. In the right panel the results for all collocations to the processed data set (every 8th day globally, every 2nd day between 45°S and 45°N) are shown the left panel includes all possible collocations. For this purpose the retrieval was run additionally to the processing for all collocations found, the MPV criterion in not applied for these data. The data agree well below about 20km altitude. Here, the difference is smaller than 10% if the CFH data are smoothed with the AVK and up to about 20% for the interpolated version, where the differences are larger at 13-14 km. In this altitude range, the vertical gradient of the water vapour profile is often large, while the vertical sampling of SCIAMACHY is coarse: SCIAMACHY measurements are at about 12.0, 15.3, 18.6, 21.9, and 25.2km, and therefore there is no measurement information at 14km and the values for the retrieval grid at these altitudes are derived from the measurements below and above. They are not purely interpolated but rather a result of the regularization, which takes the profile shape of the a priori profile into account. The assumption of the shape is more uncertain for 14 km, than for example for 17 km, because 14 km is often in the troposphere, where the variability of water vapour and its profile shapes is higher than in the stratosphere. This leads to the larger difference between the comparisons based on interpolated or on smoothed CFH values at 14 km. Generated by IUP Page 28-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 19: Comparison for SCIAMACHY V3.01 and balloon-borne CFH. Left: all possible collocations, right: collocations to the processed data set (every 8 th day globally, every 2nd day between 45°S and 45°N). Black solid lines show the mean percentage difference for CFH data interpolated on the SCIAMACHY retrieval grid, black dotted lines the corresponding standard deviation of the bias corrected difference. Green lines show the mean percentage difference for CFH data smoothed with the SCIAMACHY AVK (solid) and the corresponding standard deviation of the bias corrected difference (dotted). In the right panel the standard error of the mean is indicated as error bars, in the left panel it is smaller than the width of the line and hence not visible. Above about 19 or 20 km the SCIAMACHY data are 10-20% lower than the CFH data. For the data, which are part of the already processed V3.01, the differences between SCIAMACHY and CFH are larger than for all possible collocations below 20 km: up to about 20% for the smoothed and 30% for the interpolated CFH data. Hence, the result depends on the availability of collocations and it would be better to regard a larger data set. Therefore, a comparison to two different satellite data sets is also shown. For the satellite comparisons, only data processed for V3.01 (every 8th day globally, every 2nd day between 45°S and 45°N) are used. Due to the small number of collocations, the comparison for the CFH is shown averaged for all available data. The comparisons to the satellite data are split in the latitude band 60°N-90°N, 30°N-60°N, 30°S-30°N, 30°S-60°S, and 60°S-90°S to investigate if the differences vary with latitude. Figure 20: Comparison for SCIAMACHY V3.01 and MLS v3.3 for different latitude bands. Lines as in Figure 19. Figure 20 shows the comparison between SCIAMACHY V3.01 and MLS v3.3. Compared to MLS v3.3, for all regions, SCIAMACHY V3.01 is has lower water vapour values in the stratosphere and higher ones in the troposphere. The altitude, where it changes Generated by IUP Page 29-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 from negative to positive differences varies with region: 12-14km for polar latitudes, 13-16 for mid-latitudes and 18-19 for the tropics, i.e. always somewhat above the average tropopause for the corresponding region. In the stratosphere, the SCIAMACHY data are lower by 10% (tropics) to 25% (northern hemisphere high latitudes). The difference in the troposphere is up to about 50% (tropics, southern hemisphere mid-latitudes). As for the CFH data, there are differences depending on if the MLS data are smoothed with the SCIAMACHY AVK or interpolated, although the resolution of MLS is comparable to the one of SCIAMACHY. These differences are largest in the troposphere, at altitudes where no SCIAMACHY measurements are available and the profile shape differs from the a priori profile. Figure 21: Comparison for SCIAMACHY V3.01 and ACE-FTS V3.0 for different latitude bands. Lines as in Figure 19. Figure 21 shows the results for the comparison with ACE-FTS. For the stratosphere, the results are comparable to the ones seen for MLS, confirming that there is probably a systematic dry bias in the SCIAMACHY data, which is most pronounced in the Northern Hemisphere high latitudes. For the troposphere, the results are different: In the tropics, the SCIAMACHY data are also higher than ACE-FTS by up to 40% but the agreement is better in the mid-latitudes, where SCIAMACHY data are higher by 10-20% and in the Polar Regions. For all regions the agreement between SCIAMACHY and ACE-FTS is good (differences of 10% or smaller) between about 15 and 19 km altitude. The differences between smoothing the ACE-FTS data with the SCAMACHY AVK and interpolation them onto the retrieval grid confirm the effect of a priori profile shape and regularization seen in the other comparisons. Summarizing the comparisons, SCIAMACHY V3.01 shows a dry bias of about 10-20% in the lower stratosphere, which is most pronounced in the northern hemisphere high latitudes. Predominantly around 14 km altitude the profile shape of the SCIAMACHY water vapour is influenced by the profile shape of the a priori profile due to the vertical sampling and the regularization in the retrieval. Compared to MLS, SCIAMACHY shows higher values (up to about 50%) in the troposphere. This is not clearly confirmed by the comparison to ACE-FTS and CFH data but SCIAMACH V3.01 shows also higher values in the troposphere compared to other satellite data (not shown here). Generally, comparisons are challenging in the troposphere due to the high variability of water vapour. 4.3. Stratospheric Aerosols 4.3.1. OSIRIS 4.3.1.1. SAGE II Extinction Comparison Interpolation of the SAGE II 525 and 1020 nm channels in logarithmic space (log wavelength and log extinction) provides a 750 nm extinction product based on the Angstrom coefficient Generated by IUP Page 30-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 between 525 and 1020 nm. This derived product is shown in the bottom of Figure 22 for the duration of the SAGE II mission between 20°N and 20°S. The comparative 750 nm OSIRIS extinction ratio is shown in the top panel. Although exact agreement is not expected since a linear Angstrom coefficient (in log space) is only an approximation, both data sets agree quite well, typically within 20%. The largest discrepancies occur at low altitudes in the volcanic plumes caused by the eruptions of Ruang/Reventador and Mt. Manam. This is likely due to the infrared imager saturating in these conditions which tends to bias the measurements to low aerosol loading conditions. Correction of this is discussed in the recommendations section. OSIRIS SAGE II Figure 22: Monthly averaged 750 nm extinction ratio in the tropics. OSIRIS measurements shown in the top panel with SAGE II in the bottom panel. 4.3.1.2. SAGE II Angstrom Comparison The OSIRIS Angstrom coefficient from 750 to 1530 nm is shown in the top panel of Figure 23. The SAGE II Angstrom coefficient calculated from the 525 and 1020 nm extinction measurements is shown in the bottom panel. In general the OSIRIS Angstrom exponent is larger than the SAGE II measurements, although much of this can be attributed to the wavelength discrepancy of the two instruments. Qualitatively the measurements show many similarities, with a particle size that generally decreases with altitude. In addition, the volcanic eruptions both show a decrease in particle size. The largest difference in the measurements is the six month cycle in the OSIRIS Angstrom data that is not present in the SAGE II measurements. This is likely due to the uncertainty of the 1530 nm albedo used in the OSIRIS retrievals (Bourassa, 2012), which when combined with the Odin orbit produces the 6 month cycle. Generated by IUP Page 31-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 OSIRIS SAGE II Figure 23: Top panel is the monthly OSIRIS Angstrom coefficient from 750 to 1530 nm from 20°N to 20°S. Bottom panel is the same picture with the SAGE II Angstrom coefficient from 525 to 1020 nm. 4.3.1.3. SAGE II Surface Area Density Comparison Surface area density can be derived from OSIRIS measurements using the retrieved particle size distribution and extinction. SAGE II also retrieves surface area density, although does so without the assumption of a particle size distribution. These are compared in Figure 24Figure 23. The top panel shows the retrieved OSIRIS values, with SAGE II results in the bottom panel. Both data sets show similar features with an increase in surface area density after volcanic eruptions, particularly Mt. Manam. OSIRIS tends to retrieve lower SAD values at higher altitudes. This may suggest OSIRIS is underestimating SAD in low aerosol loading conditions, as SAGE II is expected to underestimate SAD as well, due to the insensitivity to small particles (Wurl, 2010). OSIRIS SAGE II Figure 24: Monthly averaged surface area density from OSIRIS in the top panel and SAGE II in the bottom panel. Generated by IUP Page 32-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 4.3.1.4. SAGE III Extinction Comparison The average per cent difference between the SAGE III and the OSIRIS measurements are shown in Figure 25 for each year from 2002 to 2005. The Version 5.07 results are shown in red and are typically within 10% of the SAGE III measurements, although a systematic bias is evident in 2005 when OSIRIS consistently overestimates the SAGE III measurements by 1020%. The Version 6.00 retrievals are shown as black lines in Figure 25. These results are comparable at all altitudes, with a slight improvement during 2005, but also slight underestimation in 2003 and 2004 between approximately 23 and 30 km. In general, substantial improvement between comparisons is not expected as the SAGE III measurements are during conditions when the Version 5.07 particle size assumptions are expected to be relatively accurate. Figure 25: Comparison of SAGE III and OSIRIS aerosol retrievals for yearly coincident measurements. Mean per cent differences are shown as solid lines with standard deviation shown as dashed. Version 5.07 retrievals are shown in red with Version 6.00 shown in black. 4.3.2. SCIAMACHY Figure 26 to Figure 28 show the validation results of the SAGE II and SCIAMACHY stratospheric aerosol extinction profiles at 525 nm wavelength. The profiles were averaged zonally and over all available co-locations as well as binned into eight 20 latitude bins spanning 80°N and 80°S. Generated by IUP Page 33-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 26: Validation results for the latitude bins: 0-20°N, 0-20°S, 20-40°N and 20-40°S. Left panels: comparison of the retrieved 525 nm aerosol extinction profiles (red) with SAGE II aerosol extinction (black) and a priori profile (blue) in 8 latitude bins with standard deviation (dashed lines). Right panels: mean relative difference between SCIAMACHY and SAGE II aerosol extinction profiles with standard deviation (dashed). The panels of Figure 26 show the four bins between 40°N and 40°S. For the two northern latitude bins (0-20°N and 20-40°N), the relative difference above the tropopause at ~ 20 km altitude is around -30%. The same appears for the two southern bins (0-20°S and 20-40°S), except for altitudes at 28 km and above. Here the relative difference grows to -40%. For the latitude bins 40-60°N and 40-60°S (Fig. 2), the difference to SAGE II for altitudes at 15 to 27 km lies between -10 and -20%. Again at higher altitudes, the difference for 40-60°N turns to a maximum value of -40% (at 31 km), while for 40-60°S it stays quite stable until 32 km. Between 60° and 80°N and at 15–23 km, the difference to SAGE II is -15 to +10%, while above the difference increases to a maximum of -50% (Fig. 2). Between 60° and 80°N and at 15–27 km, the difference to SAGE II is smaller or equal to -10%. At 27-32 km it gets worse and grows to +30% at 32 km. Generated by IUP Page 34-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 27: Same as Figure 26, but for the latitude bins: 40-60°N, 40-60°S, 60-80°N and 60-80°S. To summarize, Figure 28 shows the validation results between SAGE II and SCIAMACHY for all latitudes between 80°N and 80°S. The global average, which contains 3562 colocations, results in a difference between +10% and -10% at 15-23 km and shows that SCIAMACHY underestimates at 23-32 km with a maximum difference of -30%. Generated by IUP Page 35-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 28: Same as Figure 26, but for all latitudes from 80°N to 80°S. 4.4. Stratospheric Ozone 4.4.1. Validation of the GOME Bright Limb (GBL) data set (WP17) Figure 29 shows the results from the GBL-GOMOS comparison. The difference is mostly less than 10% except in the 40 km altitude where GBL have 12-18% smaller values. Also, around 50 km GBL is up to 30% larger than the night occultation for latitudes 50°N-70°N and 50°S70°S. The negative bias above 50 km is expected due to diurnal variation of ozone. The comparison with MLS shows very similar results to the comparison with the GOMOS night occultation. The 40 km negative bias (for all latitudes) and the 50 km positive bias (for high latitudes) are evident. Figure 29: Comparison between GBL and GOMOS night ozone. Generated by IUP Page 36-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Figure 30: Comparison between GBL and MLS ozone. 4.4.2. Validation of the combined SAGE II-GOMOS data set from FMI (WP22) Material from FMI to come here 4.4.3. Validation of the merged SAGE II-GOMOS data set from BS (WP22) This section will be completed once the BS version of this merged data set has been completed. We plan to validate our merged database using ozonesonde data at selected locations, comparing vertically integrated profiles with an independent total column ozone data set, and through a comparison with the FMI version of the combined SAGE II-GOMOS data set. 5. Intercomparison climatologies. and evaluation of short-lived species Short-lived species zonal mean climatologies have been created based on measurements from the two Odin instruments, SMR and OSIRIS, for the years 2002 to 2010. These climatologies have been submitted for evaluation to the SPARC data initiative (SPARC-DI). The purpose of the data initiative is to make a comprehensive assessment of climatologies through intercomparisons of a large number of satellite climatologies. Short-lived species climatologies from all chemical families (NOy, Cly, Bry, HOx) are being assessed in terms of absolute concentrations and spatio-temporal variability. The table below provides a list of Odin shortlived species climatologies assessed by the SPARC-DI relevant for the SPIN project and climatologies used for inter-comparison (from ESA and ESA 3rd party missions as well as from NASA and JAXA missions). Odin climatology Instruments for comparison ClO 2001-2010 SMR, MLS, MIPAS, (SMILES) BrO 2002-2010 OSIRIS, SCIAMACHY, (SMILES) NO2 2002-2010 OSIRIS, SCIAMACHY, MIPAS, ACE-FTS, GOMOS, HALOE, SAGE, POAM NO 2003-2010 SMR, MIPAS, ACE-FTS, HALOE HNO3 2001-2010 Generated by IUP SMR, MIPAS, ACE-FTS Page 37-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 HO2 2003-2004 SMR, MLS, (SMILES) Short-lived species concentrations depend strongly on the local solar time of the measurement and SPARC-DI climatologies have therefore been created separately for day and night (SMILES) or am and pm (for sun-synchronous and solar occultation sensors) to allow for a more meaningful inter-comparison. For the Odin climatologies additional "scaled" products have been created with the help of scaling factors obtained from a photo-chemical model, in order to facilitate comparisons with other missions. Observations by the Odin instruments are performed between 6am and 7am (descending node) and between 6pm and 7pm (ascending node) at the equator owing to the satellite's sun-synchronous near-terminator orbit. Observations in the winter hemisphere are consequently performed during night, and day-time observations are performed in the summer hemisphere. The Odin orbit is not stabilized and has been slowly drifting in the 12 years since the launch in 2001. As a result, a correction is essential. Odin climatologies of ClO (am, pm) have therefore been scaled to the local time of Aura/MLS observations at the equator (around 1:30am and 1:30pm). This allows for a comparison in the latitude range ~70°S to ~70°N, whilst at higher latitudes the local time of MLS observations changes quickly from day to night or vice versa. Note that with this approach a total of 4 scaled SMR ClO climatologies were produced (SMR am scaled to 1:30am and 1:30pm and SMR pm scaled to 1:30am and 1:30pm), since am and pm observations from both satellites are handled separately. Note also that scaling has to be performed on individual profiles, i.e. before zonal averaging. As shown earlier by Jones et al. [2011], a consistency check can easily be performed because individually scaled am and pm observations from Odin should give the same long-term trend when averaged (e.g. monthly zonal means) and plotted against time. Jones et al. [2011] reported promising results to date only for the equatorial middle to upper stratosphere (35-45km) region. Further analyses of the SPARC-DI climatologies are expected to provide data also at middle latitudes and lower altitudes. Scaled climatologies have also been produced for OSIRIS NO2 and SMR NO following an approach developed and described by Brohede et al. [2008], only that the chosen reference times for SPARC-DI are those of the MIPAS instrument on Envisat which observes at 10am and 10pm. Finally it should be noted that McLinden et al. [year] constructed a (scaled) zonal mean BrO climatology from OSIRIS measurements which is also under evaluation [McLinden et al, JGR-2010]. [The SPARC-DI assessment is still not finalized at the time of writing (September 2013). Short summaries of results can be inserted here once relevant SPARC-DI short-lived species chapters have been finalized.] In addition to the assessment of climatologies as part of the SPARC-DI activity, systematic comparisons of results from a 1D photo-chemical model with data from three microwave sensors (SMR, MLS, SMILES) and two mid-infrared sensors (ACE/FTS, MIPAS) have been performed. These comparisons concern the short-lived species ClO, HOCl, and HO2 and aim at comparing the diurnal variation of these species in the tropical mid-stratosphere to the lower mesosphere region. A manuscript describing the results of this study was published in ACP in August 2013 [Khosravi et al., ACP-2013]. Examples (for ClO and HO2) are shown in Figure 31 and Figure 32. Intercomparisons of short-lived species measurements from instruments on sun-synchronous satellites (SMR, MLS, MIPAS) and from solar occultation instruments (ACE-FTS) are challenging since the measurements correspond to different solar zenith angles (or local times). However, using a model verified by the new SMILES data sets which cover all local times over a period of several months as reference provides the possibility to indirectly compare the diurnally variable species. The satellite data were averaged for latitudes of 20°S to 20°N for the SMILES observation period from November Generated by IUP Page 38-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 2009 to April 2010 and were compared at three altitudes: 35, 45 and 55 km. The study presents the first evaluation of HO2 Odin/SMR data and the first comparisons of the new SMILES data and the latest version of MLS (version 3.3) data with other satellite observations. It is found that the satellite observations and the carefully initialized model generally agree well in terms of absolute mixing ratios as well as differences between the day and night values. This confirms that gas phase chemistry of these species based on latest recommendations of reaction rate constants is fairly well understood. The generally good agreement of the modelled and observed diurnal variation in terms of shape and amplitude (see Figure 31 for ClO and Figure 32 for HO2) confirms that such a model can be used to scale observations of short-lived species taken at different local times to a common time, at least in the tropics. Figure 31: Top row: Modelled diurnal variation of ClO at the altitudes 35, 45 and 55 km (left, middle, right) in the tropics between 20ºS and 20ºN compared to observations made by SMILES, Aura/MLS, and Odin/SMR during the period November 2009 to April 2010. SMILES data are presented by two products; the research product (here called SMILES-R) and the official product (here named SMILES-O). The standard error of the mean is shown in the same colour as the measurements. If not visible, errors are smaller than the symbol size. Model simulations are given for different months (light grey shaded lines: November; dark grey: April). Solid grey lines are for the equator, dotted lines are for 20ºS and dashed lines are for 20ºN. Satellite data have been averaged in bins of 2.5º–3ºdeg in terms of solar zenith angle. The model was run with a vertical resolution of 1 km and the model results have been vertically smoothed using a Gaussian function. The fullwidth-at-half-maximum (in km) is stated in the left upper corner of each plot. MLS and SMR values have been averaged at their ascending/descending nodes. The variability of these measurements in the form of 1-σ standard deviation is shown as vertical error bars in black. The horizontal error bars show the range of solar zenith angles of the respective measurements. Bottom row: same as top row, but offset shifted for high solar zenith angles at night-time or sunrise in order to compare the amplitudes of the SMILES, MLS, and SMR diurnal cycles with the model. The average night-time or sunrise satellite measurements in the overlapping solar zenith angles and the model were Generated by IUP Page 39-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 subtracted from the values at other solar zenith angles and a correction term respective to SMILES-R for the same solar zenith angle range has been added. Adapted from Khosravi et al. (2013). Figure 32: Same as Figure 31, but for HO2. Top row: HO2 from the model, Aura/MLS and Odin/SMR. Bottom row: Offset -shifted view for better comparison of diurnal cycle amplitudes. Note that HO2 from SMR corresponds to the period October 2003 to October 2004 when this species was observed. [To be added later: (1) results from internal consistency/verification study for updated scaled ClO climatology based on time-series; (2) same for other species, starting with NO. (3) Inter-comparison with SPARC-DI MLS and MIPAS climatologies for ClO, NO, …). 6. Summary and recommendations. Input to data product disclaimer. The PVR presents the validation of the stratospheric temperature, water vapour, aerosols, ozone, and the evaluation of short lived species climatologies, developed in the SPARC-SA initiative (SPIN). These are the main results and inputs for the data product disclaimer for the data sets of the first phase of SPIN: 6.1. Stratospheric Temperature Climatologies of zonal and monthly mean stratospheric temperatures from ACE-FTS, MIPAS and SMR have been produced and compared with several RO and reanalysis data sets. Generated by IUP Page 40-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 Generally, the ESA-based climatologies agree better with ERA-Interim and NCEP-CFSR than with the RO data from CHAMP and TSX, which are on average 1-2K warmer than ERA-Interim in the stratosphere. 6.2. Stratospheric Water Vapour Stratospheric water vapour from SCIAMACHY agrees well with CFH balloon measurements, MLS and ACE-FTS around 15 to 18 km. Above these altitudes a dry bias of about 10-20% is found compared to these data sets, which is largest at the high latitudes in the Northern Hemisphere and smallest in the Tropics. At ~14 km, the comparison differs if the data used are interpolated or smoothed with the AVK of SCIAMACHY. This shows that the vertical sampling of SCIAMACHY and the regularisation used in the retrieval cannot reproduce the strong increase of water vapour in the troposphere at this altitude. Below, the differences do not agree for all regions and instruments. Here, the comparisons is challenging due to the high variability of water vapour in the Troposphere. For the water vapour retrieval, further investigations to improve of the aerosol correction are recommended. 6.3. Stratospheric Aerosols 6.3.1. OSIRIS The OSIRIS Version 6.00 retrieval produces an aerosol particle size product that compares well with SAGE II measurements and produces 750 nm extinction coefficients that are in good agreement with both SAGE II and SAGE III. However, due primarily to the inability to measure the albedo at 1530 nm, the retrieved particle size has systematic errors related to the viewing geometry of the measurements. The variation of the Angstrom coefficient over a 6 month period is typically 10-15%, suggesting an error of at least this much in the Angstrom coefficient. In addition, the infrared channel is considerably noisier than the optical spectrograph data, resulting in a decrease in precision. Although sufficient to improve the 750 nm extinction results, it is recommended that the retrieved Angstrom coefficient be used as a qualitative measure of particle size rather than an absolute. In addition, since the noise in the 1530 nm channel affects the precision of the 750 nm retrieval, it is recommended that the retrieved mode radius be used to produce a particle size climatology. This climatology will then be used with only the 750 nm measurements to retrieve the 750 nm extinction coefficient. This should improve the precision of the 750 nm extinction coefficient and reduce the low bias that is evident in the low altitude volcanic plumes as the saturation of the infrared detector will not be as critical. 6.3.2. SCIAMACHY For the global average, SCIAMACHY and SAGE II agree well between 15 and 23 km. Here, differences up to 10% are found. Above 23 km SCIAMACHY underestimates the aerosol up to 30% in the global average. Larger, varying differences are observed for different 20° latitude bins. Further work is necessary to improve the phase function used in the SCIAMACHY aerosol retrieval. 6.4. Stratospheric Ozone Stratospheric ozone from GBL measurements agrees well with ozone from GOMOS night measurements and MLS, the difference is less than 10% below 40 km. At 40 km there is a Generated by IUP Page 41-42 Title: Product Validation Report V2 Issue 00 - Revision 01 - Status: Draft Date of issue: 12/09/2013 Reference: SPIN_PVR2 negative bias of 12-18% depending on the latitude. At 50 km there a positive bias of up to 30% at high latitudes. The negative bias above 50 km against the GOMOS night occultation can be explained by the diurnal cycle of ozone. 6.5. Short-lived species climatologies Comparisons between climatologies of short-lived species (e.g. BrO, ClO, HNO3, HO2, HOCl, NO, and NO2) from SMR and OSIRIS with other satellite data show that the gas phase chemistry and reaction rate constants are fairly well understood. Differences in the observations due to diurnal variation of the regarded short-lived species can be explained by model simulations. Generated by IUP Page 42-42