WRFDataandU+li+es KellyWerner January2016 SupportedPost-processingPackages hcp://www2.mmm.ucar.edu/wrf/users/docs/user_guide_V3/contents.html Package Users’Guide Page# Informa6on NCL 9-2 Graphicalpackage SupportedbyNCAR/CISL(wrLelp@ucar.edu andncl-talk@ucar.edu) ARWpost 9-29 Converter(GrADS)(wrLelp@ucar.edu) RIP4 9-20 Converterandinterfacetographical Package,NCARgraphics(wrLelp@ucar.edu) UPP 9-36 Converter(GrADS&GEMPAK) (upp-help@ucar.edu) VAPOR 9-38 Converterandgraphicalpackage SupportedbyVAPOR(vapor@ucar.edu) IDV None–see unidata.ucar.edu GRIB(fromUPP) GEMPAK(fromwrf2gem) Vis5d CFcompliantdata(fromwrf_to_cf) Supportedbyunidata (support@unidata.ucar.edu) GEMPAK None-see: unidata.ucar.edu/ sobware/gempak Datafromwrf2gemorUPP Supportedbyunidata (support@unidata.ucar.edu) ChoosingtheRightTool • • • • • • • Canitreadyourdata? Willyouneedtopre-processthedata first? • • Isitpurelyavisualiza+ontool,or doesitincludepost-processing? • Ver+calgrids? Canithandlebigdatasets? • Howaremodel+mestamps handled? Whichdiagnos+c/sta+s+calfunc+ons doesithave? • Easytouse? Howeasyisittoadddiagnos+cs? • Costofpackage? 3Dor2Dvisualiza+on? • Howwellsupportedisit? Canithandlestaggeredgrids? Howisdatabelowtheground handled? DataHandling NCL netCDF GRIB ASCII shapefiles geogrid & metgrid output intermediate file format wrfinput data Idealized data wrfoutput big data V6.2.0 V6.3.0 RIP4 GrADS UPP VAPOR IDV ripdp ARWpost converter converter converter Post-processing NCL RIP4 GrADS UPP VAPOR IDV diagnostics some alot some some limited limited Add diagnostics Veryeasy easy easy Rela+vely easy Notaseasy Notas easy Vertical output Coordinate Model pressure height Model pressure height Model pressure height pressure model model Post-processing Data output 3D Extrapolate Below ground ModelStaggering WhyisaconverternecessaryifapackagecandisplaynetCDFfiles? WRF staggered grid Converterco-locatesdatatomasspoints ARWpost:GeneralInforma+on • Converter – Readsinwrf-arwmodeldata,creates GrADSoutputfiles – RequiresGrADStodisplay • • GrADSsobwareisonlyneededto displaydata,notneededtocompile thecode – hcp://www.iges.org/grads/grads.html Generateanumberofgraphicalplots – – – – – Horizonal Cross-sec+on skewT Meteogram Panel • DownloadCode – hcp://www2.mmm.ucar.edu/wrf/ users/download/get_sources.html • OnlineTutorial – hcp://www2.mmm.ucar.edu/wrf/ users/graphics/ARWpost/ARWpost.htm ARWpost:ExamplePlots SurfaceTemp Vegeta+onFrac+on Skew-TDiagram TotalPrecipita+on ARWpost:ExampleFunc+ons Cross-Sec6ons Zooming ARWpost:Diagnos+cs • • • • • • • • • • • • • • cape–3dcape cin–3dcin mcape–maximumcape mcin–minimumcin clfr–low/middle/highcloudfrac+on dbz–3dreflec+vity max_dbz–maximumreflec+vity geopt–geopoten+al height–modelheightinkm lcl–libingcondensa+onlevel lfc–leveloffreeconvec+on pressure–fullmodelpressureinhPa rh–rela+vehumididy rh2–2mrela+vehumidity • • • • • • • • • • • • theta–poten+altemperature tc–temperatureindegreesC tk–temperatureindegreesK td–dewpointtemperatureindegreesC td2–2mdewpointtemperaturein degreesC slp–sealevelpressure umet&vmet–windsrotatedtoEarth coordinates u10m&v10m–10mwindsrotatedto Earthcoordinates wdir–winddirec+on wspd–windspeedcoordinates wd10–10mwinddirec+on ws10–10mwindspeed ARWpost:Scripts ScriptName Descrip6on cbar.gs Plotsacolorbaronshaded plots rgbset.gs Allowsyoutoadd/change colorsfromcolor#20–99 skew.gs ProgramtoplotaskewT plot_all.gs Automa+callyfindsall.ctlfiles inthedirectoryandliststhem sotheusercanpickwhento use,willplotallfieldschosen rain.gs(realdataonly) Plotstotalrainfall(musthave datathatcontainfieldsRAINC andRAINNC) cross_z.gs(realdataonly) PlotsaNSandEWcross sec+onofRHandT(C) RIP4:ExamplePlots Poten+alVor+city Poten+alTemp Circula+onVectors LanduseCategory Skew-TDiagram RIP4:ExamplePlots CycloneTracking Trajectories ZoomingCapability RIP4:ProgramFlow INPUT DATA R I P D P RIPDP formats one file per TIME & VARIABLE R I P RIP4:GeneralInforma+on • RequiresNCARGraphicsLibraries – hcp://www.ncl.ucar.edu • SourceCode – hcp://www2.mmm.ucar.edu/wrf/users/download/ get_source.html • Documenta+on – Includedinprogram’starfile(inDoc/directory) – hcp://www2.mmm.ucar.edu/wrf/users/docs/ripug.htm • OnlineTutorial – hcp://www2.mmm.ucar.edu/wrf/users/graphics/RIP4/ RIP4.htm U+li+es • Graphics • Designingamodeldomain • OBSGRID • netCDFtools • Data • MET Graphics:ImageMagick hcp://www.imagemagick.org • Convertsgraphicalfilesfromoneformattoanother convertfile.pdf file.png convertfile.png file.bmp • Manyop+onsavailable – Rotateframes,trimwhitespace,etc. • Canmakemovies – Cancreateindividualframesforeachimage • Cannotdealwith.ncgmfiles ModelDomainDesign mpres@mpFillColors = (/"background","DeepSkyBlue", "ForestGreen","DeepSkyBlue", "transparent"/)" " mpres@mpGridSpacingF = 45" " lnres@domLineColors = (/ "white", "Red" , "Red" , "Blue" /)" ! mpres@mpOutlineBoundarySets “NoBoundaries” ; “Geophysical” “National” ; “USStates” “GeophysicalAndUSStates” “AllBoundaries” pares = True pmres@gsMarkerColor = "White” pmres@gsMarkerIndex = 16 pmres@gsMarkerSizeF = 0.01 gsn_polymarker(wks,mp,-77.26,38.56 , pmres) ! • plotgrids.ncl - WPS/u3l/plotgrids.ncl - Readsnamelistinforma+on togenerateplot -X11,png,pdf ModelDomainDesign DOMS = 1 DX = 36. MAP = "mercator" LAT1 = (/ -35.0, -45., -27. /) LAT2 = (/ 0., -20., -23. /) LON1 = (/ 131., 121., 125./) LON2 = (/ 171., 159., 131./) parent_id = (/ 0, 1, 2 /) parent_grid_ratio = (/ 1, 3, 3 /) Suggested namelist options parent_id = 0, parent_grid_ratio = 1, i_parent_start = 1, j_parent_start = 1, e_we = 123, e_sn = 107, dx = 36000, dy = 36000, map_proj = 'mercator', ref_lat = -17.50, ref_lon = 151.00, truelat1 = -17.00, truelat2 = 0.00, stand_lon = 151.00, design_grids.ncl 19 OBSGRID • Toimproveafirst-guessgriddedanalysisby incorpora+ngaddi+onalobserva+onal informa+on – Tradi+onallyfirst-guessanalysiscamefromlow-resolu+on globalanalysisandforecastgrids – Thesedays,higher-resolu+on,regionalscaleanalysesare morereadilyavailable • Whenisthismethoduseful? – Whenusingverycoarseresolu+onfirst-guessinputdata – Ifyouconductedafieldcampaignandhaveacquiredvery high-resolu+onsta+ondata(forexample) OBSGRID:BasicConcept OBSGRID:HowtoRun • Getthesourcecode hcp://www2.mmm.ucar.edu/wrf/users/download/ get_sources.html#u+li+es • • • • • Compile Prepareobserva+onfiles Editthenamelist SeetheWRFUsers’Guidefordetailedinforma+on hcp://www2.mmm.ucar.edu/wrf/users/docs/ Runtheprogram user_guide_V3/users_guide_chap7.htm Checkyouroutput NCOTools hcp://nco.sourceforge.net • ncdiff – Showsthedifferencesbetween2files ncdiff input2.nc input2.nc output.nc • ncrcat(nccat) – Writesspecifiedvariables/+mestoanewfile ncrcat –v RAINNC wrfout* RAINNC.nc ncrcat –d Time,0,231 –v RAINNC wrfout* RAINNC.nc • ncra(ncaverage) – Averagesvariablesandwritestoanewfile ncra –v OLR wrfout* -o OLR.nc • ncks(nckitchensink) – Combina+onofallNCOtoolsin1 – Specificallyniceforsplisngfiles ncks –d Time,1,1 wrfout –o wrfout1.nc NCOTools:OtherAvailableOperators • ncap2:arithme+cprocessor • ncaDed:ATTributeeditor • ncbo:binaryoperator(includesncadd,ncsubtract, ncmul+ply,ncdivide) • ncea:ensembleaverager • ncecat:ensembleconCATenator • ncflint:FiLeINTerpolator • ncpdq:permutedimensionsquickly,packdata quietly • ncrename:RENAME-er • ncwa:weighteraverager ncview hcp://meteora.ucsd.edu/~pierce/ncview_home_page.html ncview ncBrowse hcp://www.epic.noaa.gov/java/ncBrowse/ ncdump • ReadsanetCDFdatasetandprintsinforma+onfrom thatdataset • ncdump –h file – Printsheader(inclusivelistofvariablesinthefile) • ncdump –v VAR file – Printsdataforthevariable‘VAR’ • ncdump –v Times file – Printsthe+mesthatareincludedinthefile ncdump–vTimes netcdf wrfout_d01_2000-01-24_12:00:00 { dimensions: Time = UNLIMITED ; // (3 currently) DateStrLen = 19 ; west_east = 73 ; south_north = 60 ; west_east_stag = 74 ; bottom_top = 27 ; south_north_stag = 61 ; bottom_top_stag = 28 ; variables: char Times(Time, DateStrLen) ; float LU_INDEX(Time, south_north, west_east) ; LU_INDEX:FieldType = 104 ; LU_INDEX:MemoryOrder = "XY " ; LU_INDEX:description = "LAND USE CATEGORY" ; LU_INDEX:units = "" ; LU_INDEX:stagger = "" ; ……… ……… global attributes: ……… ……… :TITLE = " OUTPUT FROM WRF V3.4.1 MODEL"; :START_DATE = "2000-01-24_12:00:00" ; :WEST-EAST_GRID_DIMENSION = 74 ; :SOUTH-NORTH_GRID_DIMENSION = 61 ; :BOTTOM-TOP_GRID_DIMENSION = 28 ; :DX = 30000.f ; :DY = 30000.f ; data: Times = "2000-01-24_12:00:00", "2000-01-24_18:00:00", "2000-01-25_00:00:00" InputData:MandatoryFields • 3DData(dataonpressurelevels,forexample) Temperature UandVcomponentsofwind Geopoten+alHeight Rela+veHumidity • 2DData Surfacepressure Meansea-levelpressure Skintemperature 2metertemperatureandrela+vehumidity 10meterUandVcomponentsofwind • RecommendedFields LANDSEA Soildata(temperatureandmoisture)andsoilheight SST(requiredforclimateruns) Waterequivalentsnowdepth SEAICE ExternalDataSources:Global Name Resolu6on Coverage NCEP/NCAR Reanalysis 2.5° Global Jan1948–present hcp://rda.ucar.edu/ datasets/ds090.0 NCEP/DOE Reanalysis 2.5° Global Jan1979–present hcp://rda.ucar.edu/ datasets/ds091.0 ERAInterimData 0.7° Global Jan1979–present hcp://rda.ucar.edu/ datasets/ds627.0 Jan2011–present hcp://rda.ucar.edu/ datasets/ds113.0 July2015–present hcp://rda.ucar.edu/ datasets/ds083.3 ECMWF’s Opera+onalModel Analysis NCEPGDAS/FNL Reanalysis HighestResolu+on oftheDAand forecastsystem Temporal Availability Website 0.25° Global GFSReal-+me 1° Global NCEPGFS/FNL Reanalysis 1° Global Aug1999–present hcp://rda.ucar.edu/ datasets/ds083.2 GFSGriddedModel Data 0.5° Global Dec2002–present hcp://rda.ucar.edu/ datasets/ds335.0 NCEPGFS0.25° 0.25° Global Jan2015–present hcp://rda.ucar.edu/ datasets/ds084.1 hcp:// www.emc.ncep.noaa .gov ExternalDataSources:NorthAmerica Name Resolu6on Coverage 32/12km NorthAmerica NAMAnalysis 12km NorthAmerica Jan2012–present hcp://rda.ucar.edu/ datasets/ds609.0 GCIPNCEPEta 40km NorthAmerica April1995–present hcp://rda.ucar.edu/ datasets/ds609.2 NCEPNARR 32km NorthAmerica Nov1979–present hcp://rda.ucar.edu/ datasets/ds608.0 NAMReal-+me Temporal Availability Website hcp:// www.emc.ncep.noaa .gov ExternalDataSources:Climate Name Resolu6on Coverage Temporal Availability Website 38km Global Jan1979–Dec2010 hcp://rda.ucar.edu/ datasets/ds093.0 0.2° Global Jan2011–present hcp://rda.ucar.edu/ datasets/ds094.0 NCARCESMCMIP5 data(netCDFformat) Global Jan1950–present hcp://rda.ucar.edu/ datasets/ds316.0 NCARCESMCMIP5 data(IM–Bias Corrected) Global Jan1951–present hcp://rda.ucar.edu/ datasets/ds316.1 NCEPClimate ForecastSystem Reanalysis(CFSR) NCEPClimate ForecastSystem ReanalysisII(CFSR2) SSTDATA NCEPSSTAnalysis 1°-1/12° Global NOMAD3SST 1°-0.25° Global Jan1854–present (dependingwhich product) hcp:// nomads.ncdc.noaa.g ov/data.php 1° Global Jan1854-present hcp://rda.ucar.edu/ datasets/ds277.0 NCEP&NCDC ReconstructedSST hcp:// polar.ncep.noaa.gov /sst ExternalDataSources:NOMADS hcp://nomads.ncdc.noaa.gov NAM GFS RUC CFS NARR R1/R2 SST GRIBDataHandling • Documentsanddecoders – GRIB1andGRIB2 wgrib,wgrib2,unpackgrib2.c,grib2to1.c hcp://rda.ucar.edu/#!GRIB • g1print.exeandg2print.exe – ShowdataavailableinGRIB1andGRIB2files – Availablefromu+l/directoryinWPS • grib2ctl.pl – Create.ctland.idxfiles,sothatyoucanplotGRIBfileswithGrADS – hcp://www.cpc.ncep.noaa.gov/products/wesley/grib2ctl.html • ncl_convert2nc hcp://www.ncl.ucar.edu/Document/Tools/ncl_convert2nc.shtml Wri+ngIntermediateFileFormat • hcp://www2.ucar.edu/wrf/users/docs/user_guide_V3/ users_guide_chap3.htm#_Wri+ng_Meteorological_Data • wrf_wps_write_int FIELD=“SST” UNITS=“K” DESC=“SeaSurfaceTemperature” opt=True opt@map_source =“ERA-IData” opt@projec+on =0 opt@startloc =“SWCORNER” opt@startlon =0.0 opt@startlat =-90.0 opt@deltalon =1.25 opt@deltalat =0.942408 opt@is_wind_earth_rela+ve =False opt@date =“2015-07-26_00:00:00” opt@level =200100. wrf_wps_wr+e_int(IM_name,FIELD,UNITS,DESC,VAR(:,:),opt) ReadingIntermediateFormatFiles • wrf_wps_read_int !opensfile istatus=wrf_wps_open_int(filename) !readsheader wrf_wps_rdhead_int(istatus,head_real,field,h date,\ units,map_source,desc) !readsslab Slab=wrf_wps_rddata_int(istatus,nx,ny) !Loopun3lreachingtheendofthefile • rd_intermediate =========================================== FIELD = TT UNITS = K DESCRIPTION = TEMPERATURE DATE = 2000-01-24_12:00:00 FCST = 0.000000 SOURCE = unknown model from NCEP GRID 212 LEVEL = 200100.000000 I,J DIMS = 185, 129 IPROJ = 1 REF_X, REF_Y = 1.000000, 1.000000 REF_LAT, REF_LON = 12.190000, -133.459000 DX, DY = 40.635250, 40.635250 TRUELAT1 = 25.000002 DATA(1,1) = 295.910950 =========================================== U+lity:plo|mt • Theplo|mtprogramplotsthefieldsintheungribintermediatefiles ncl plotfmt.ncl ‘filename= FNL:2007-09-15_00” PlosngIntermediateFilesinnetCDFFormat • Usetheu+lityint2nc.exe – Convertsintermediatefilescreatedbyungrib.exetonetcdfformat – ./int2nc.exe • Toplot:ploYmt_nc.ncl ncl plotfmt_nc.ncl ‘filename= FNL:2007-09-15_00” PlotUsingncview PlotUsingplo|mt_nc.ncl SpecialWRFOutputVariables • TheWRFmodeloutputsthestatevariablesdefinedintheRegistryfile, andthesestatevariablesareusedinthemodel’sprognos+cequa+ons. Someofthesevariablesareperturba+onfieldsandtherefore,the followingdefini+onsforreconstruc+ngmeteorologicalvariablesare necessary: Totalgeopoten+al PH+PHB Totalgeopoten+alheightinm (PH+PHB)/9.81 Totalpoten+altempinK T+300 Totalpressureinmb (P+PB)*0.01 Windcomponents,gridrela+ve U,V SurfacepressureinPa Psfc Surfacewinds,gridrela+ve U10,V10(validatmasspoints) Surfacetempandmixingra+o T2,Q2 SeeWRFV3/Registry/Registry.EM_COMMONfordescrip+onofvariables METVerifica+onSobware • ModelEvalua+onTools(MET) • Providesallthebasics(e.g.,RMSE,bias,skillscores) • Provides – Advancedspa+almethods(wavelets,objects) – Confidenceintervals • Downloadit hcp://www.dtcenter.org/met/users/downloads/ • Support met_help@ucar.edu • Documenta+on hcp://www.dtcenter.org/met/users/docs/overview.php Ques+ons?