LAND SURFACE SCHEME INTERCOMPARISONS – A BRIEF HISTORY The land surface is the locus of most human activities: it is where we live, grow our food and harvest fresh water. As a consequence, realistic simulation of continental near-surface weather and climate is of importance to people. A land-surface parameterisation scheme, or simply a landsurface scheme (LSS), is an algorithm for determining the exchanges of energy, mass and momentum between the atmosphere and the land surface. These exchanges are complex functions of a number of processes (physical, chemical and biological) that have a range of temporal and spatial scales. It is impossible, and probably unnecessary, to incorporate all the details of these processes into a numerical scheme and hence, land-surface schemes have been developed based on various simplifications. Depending on these simplifications, land-surface schemes in today's atmospheric models exhibit a wide range of complexity from classic "bucket" models (e.g., Manabe 1969) to detailed soil-vegetation-atmosphere transfer schemes (SVATs) (e.g., Dickinson et al., 1993, Sellers et al., 1996). A subset of SVATs takes into account the sub-grid scale variations of surface characteristics and/or atmospheric conditions (e.g., Avissar, 1992; Famiglietti and Wood, 1995; Entekhabi and Eagleson, 1989) to deal with the usually nonlinear relationships among the surface processes/variables. Third generation of LSSs combines the physical processes with the biophysical exchanges needed to represent photosynthesis, respiration and, in some schemes, decay (e.g. Xiao et al., 1998; Tian et al., 1999). The perceived need to systematically analyse these diverse schemes motivated the World Climate Research Programme (WCRP) to launch the Project for the Intercomparison of Land-surface Parameterization Schemes (PILPS) in 1992 (Henderson-Sellers and Brown, 1992; HendersonSellers et al., 1993). PILPS’ goal is to enhance understanding of the parameterisation of fluxes of heat, moisture and momentum between the atmosphere and the continental surface in climate and weather forecast models. PILPS diagnoses the behaviours of participating land-surface schemes (hereafter, "PILPS schemes") in controlled experiments implemented in four phases. The first two phases include studies of scheme behaviour when driven in "off-line" (one-way feedback) mode by atmospheric forcings prescribed from GCM output (Phase 1) (Pitman et al., 1993) or from varied observational data sets (Phase 2) (Shao and Henderson-Sellers 1995; Chen et al., 1997; Wood et al., 1998). PILPS Phase 3 entails the diagnosis of land-surface schemes coupled to their "home" atmospheric host models, while Phase 4 concerns the analysis of results from coupling different land-surface schemes to a common host (Henderson-Sellers et al., 1996). In practice, Phase 3 has involved the analysis of land-surface schemes in the Atmospheric Model Intercomparison Project (AMIP) models, organised as Diagnostic Subproject No. 12 (DSP12). AMIP, another initiative of the WCRP, is a widely implemented protocol for testing the performance of atmospheric general circulation models (AGCMs) under common specifications of radiative forcings and observed ocean boundary conditions (Gates 1992; Gates et al., 1999). The first phase of AMIP (designated as AMIP I) had been conducted between 1992 to 1996. The second phase of AMIP (AMIP II) is currently ongoing. From the perspective of land-surface specialists, AMIP affords a unique opportunity to study the interactions of a wide range of LSSs with their atmospheric host models. DSP12 studies of this type aims to address an overarching question: “To what extent does AGCM performance in simulating continental climates depend on the parameterisations of the coupled LSS?” The importance of answering this question is readily appreciated, since the impacts of climate variability on human populations are most keenly felt at or near the land surface; nevertheless, a definitive resolution remains elusive for several reasons. First, there is the dilemma of how to reliably validate simulation performance, given the present dearth of multi-annual global landsurface data sets. Even if observational data were more plentiful, some inherent ambiguities would remain. Specifically, validation of AGCM continental climate does not verify the workings of the LSS per se since, in addition to the intrinsic properties of the LSS, the continental simulation also is affected by atmospheric forcings and by mediating land-surface characteristics. Despite these complications, there are preliminary indications that characteristic “signatures” of different LSSs can be detected in coupled climate and weather simulations, provided that suitable diagnostics are chosen (e.g. Gedney et al., 1999).. Atmospheric models, in general, and land-surface parameterisation schemes, in particular, are based on many empirical functions. The empirical nature of the schemes implies that they may not perform equally well when generalised (applied) to different environmental conditions. DSP12 aims to test this hypothesis by evaluating the performance and intercomparing simulated land surface climates of the AMIP II GCMs. To perform this test we propose stratifying the global data into different climate zones and evaluate the model simulations over each climate. 2 A Off-line Experiments The Project for Intercomparison of Land-surface Parameterization Schemes (PILPS) The perceived need to systematically analyse these diverse schemes motivated the World Climate Research Programme to launch the Project for the Intercomparison of Land-surface Parameterization Schemes (PILPS) in 1992. The first two phases of PILPS consist of analysis of land-surface schemes in the off-line mode, hence they unrealistically exclude the impacts of feedback of the land surface processes on the atmospheric conditions. The third phase of PILPS, which involves analysis of land-surface simulations in the coupled mode, is organised as Diagnostic Subproject No. 12 (DSP12) of the Atmospheric Model Intercomparison Project (AMIP) models. The first phase of AMIP failed to deliver much information about the land-surface because consistent initialisation of soil moisture differed very wide and because of poor quality control of results related to the continental climate. The analysis was also limited due to the lack of global validation data sets. The second phase of AMIP (AMIP II) offers a new opportunity to evaluate surface simulations of different global climate models globally in well-controlled conditions. A number of reanalysis data sets that estimate the land surface variables for the corresponding AMIP II period have been considered for validation of model simulations. PILPS Phase 1 and Phase 2 experiments were conducted off-line; i.e. there was no feedback to the atmosphere. In PILPS Phase 1, participating LSSs were integrated for many years using synthetic meteorological forcing from a global climate model. The same descriptions of surface vegetation and soil were used by all land-surface schemes. A single year’s meteorology was used for as many annual cycles as was required for a particular LSS to come into equilibrium with the prescribed atmospheric conditions, i.e. until mean changes in the surface heat and moisture storage were negligible. Therefore, it was expected that there would not be a considerable difference among the net radiant energy at the surface among the schemes and the differences should be manifested in the partitioning of this energy between sensible and latent heat fluxes and that of precipitation between evapotranspiration and runoff. The results of the first set of PILPS Phase 1 experiments (1(a)) showed very large differences among the simulations. In an attempt to understand this large scatter, changes in the experimental design were made to assure that models were physically self-consistent. This included checking the 3 convergence of the results to steady state and water and energy balance in the annual means. The results also showed that most land-surface schemes required many years to come to thermal and hydrologic equilibrium with the forcing meteorology and that the needed time and the final equilibrium state could differ depending on the scheme and the initialisation of moisture stores. Thus short period simulations of land-surface disturbances will produce a range of results depending upon initialisation and surface scheme. After all refinements in the experimental design (Phase 1(c)), the range in latent heat flux for the PILPS Phase 1 was about 100 W m -2 in tropical forest and about 50 W m-2 for the grassland with commensurate ranges in the sensible heat flux. Monthly and diurnal ranges were larger (e.g. Pitman et al., 1999) and were found in all diagnosed characteristics of the surface climate. The simpler (bucket) schemes tend to evaporate more than LSSs which include a representation of canopy processes or at least canopy resistance. Phase 2 experiments, where observations from real sites were used, represented major advances over the first phase of PILPS in that comparison were made not only among the schemes themselves, but also with observations. In Phase 2(a) one year (1987) point meteorological data from Cabauw, the Netherlands (51° 58’ N, 4° 56’ E) was used to force the land surface schemes. This site has saturated deep soil year-round, so it overcomes the problem of soil moisture initialisation (Chen et al., 1997). The range amongst the predictions as compared with observed turbulent fluxes and the problem of non-zero total energy budget continued to be a concern as did arbitrary specification of soil depths and hence soil moisture stores (Slater et al., 2001). In PILPS Phase 2(b) (Shao and Henderson-Sellers, 1995) a subset of PILPS schemes were run using measured meteorological forcing from the Caumont site of the HAPEX-MOBILHY experiment. The results were compared with observed surface fluxes for a 35-day intensive observation period and with soil moisture measurements taken over the year. Also, observed runoff from two adjacent catchments was used for the evaluation of the schemes’ results. The results showed that simulation of soil moisture by land surface schemes is sensitive to the choice of soil hydraulic properties/parameters and that there were large differences among the schemes in predicting soil moisture. Results show the predicted seasonal cycles of total soil moisture for the 1.6 m soil layer compared with the HAPEX-MOBILHY measurements, with ±10% error margins. All schemes correctly describe the annual cycle of soil moisture in a qualitative sense. However, there is a range of between 70 mm to 100 mm among the LSSs’ simulations depending on the 4 season. Most schemes showed greater seasonal variations compared to observations, with great underestimation during the growing season. The bucket model performed differently from most of the SVATs with much drier soils during the growing season. Shao and Henderson-Sellers (1995) show the partitioning of precipitation between annual evapotranspiration and runoff by different schemes. Their results reveal that there is surface water imbalance in some of the simulations (deviation of results from a line with a slope of –1 and an intercept of equal to annual precipitation) and that the differences in water partitioning among the schemes was quite large. Most schemes underestimate runoff and hence overestimate evapotranspiration compared to observations, probably due to neglecting the subgrid scale variations of soil moisture/precipitation. Phase 2(c) experiment (Wood et al., 1998), performed over the Red-Arkansas River basin, aimed to evaluate the ability of land-surface schemes to reproduce measured energy and water fluxes over multiple seasonal cycles across a climatically diverse, continental-scale basin. It was also aimed to test the ability of schemes to calibrate their parameters using data from small catchments and to transfer this information from the calibration basins to other small catchments, and to computational grid boxes. The results showed that there were significant differences among the schemes with respect to partitioning water and energy on an average annual basis. For instance, the mean seven-year Bowen ratio averaged over 61 1°1° grids varied from 0.072 to 1.726 and that of runoff ratio varied between 0.020 to 0.409. In general the LSSs that calibrated their parameters based on streamflow of some calibration catchments performed better than uncalibrated schemes in validation runs. The results strongly suggested that there was a value in using catchment data to calibrate the parameters of land surface schemes. One possible implication for global implementation is the desirability of establishing a global set of calibration catchments that could be used by land surface schemes for parameter estimation. In PILPS Phase 2(d) (Slater et al., 2001) the simulation of snow by land surface schemes was investigated using data from Valdai, Russia. The results showed that the LSSs as a group can capture the general patterns of accumulation and ablation on an inter-annual basis, but weaknesses such as mid-season ablation exist. Between the schemes there is a considerable scatter (e.g. 40 days difference in the timing of the complete ablation of snow), but much of the scatter is systematic. It was found that the early part of the snow season, especially during the ablation events, produces considerable scatter because in such low ‘snow water equivalent’ conditions the amount of energy 5 incident to the portion of the grid assigned as snow varies widely across the schemes. The divergence amongst LSSs’ simulations, once established, tends to persist during the winter due to internal feedback processes or LSS-independent snowfall events. All the results from the first and second phases of PILPS showed that the simple ‘bucket’ model behaves differently from more complex land-surface schemes. One of the main objectives of PILPS and DSP12 is to investigate the impact of land-surface parameterisation complexity on the simulation of land-surface climates by atmospheric models. To do this, we have employed a multimode land-surface scheme, CHAmeleon Surface Model (CHASM) (Desborough 1999), to investigate the simulation of land-surface climate as a function of a range of LSS’ complexity. Desborough (1999) compares the partitioning of precipitation between evaporation and runoff as simulated by different modes of CHASM with observations from Valdai, Russia, superimposed on the range of corresponding values by different land-surface schemes, derived from PILPS 2d. The results clearly shows that a considerable portion of the ranges of scaled runoff and scaled evapotranspiration found among the PILPS land-surface schemes for Valdai is due to variation in the complexity of the schemes and that, generally, the more complex schemes tend to simulate values more consistent with observations. To investigate the impact of parameter calibration on scheme simulations, a multi-criteria calibration method (Gupta et al., 1999) has been applied. The results of different modes converged towards the observations, with the greatest improvement occurring for the simplest mode. Although tuning of parameters makes the simple schemes able to perform more consistently with the observations, it is preferable to choose complex schemes for GCMs as long as global data for parameter calibration is not available for tuning or tuning at every point in a global model is deemed too costly in time or resources. Furthermore, calibrated parameters are a function of timescale. While calibrating parameters may improve simulations for a given time-scale (e.g. annual mean), it does not necessarily improve the scheme performance in other time-scales (e.g. diurnal and seasonal variations) (Irannejad, 1999). Experiments with CHASM using data from the Thorne River Basin, used for PILPS Phase 2(e), also show that the simulation of evapotranspiration (latent heat flux) depends on the complexity of the land-surface scheme. Furthermore, it was found that calibrating the parameters (here based on streamflow measurements) improves the performance of the schemes, but it does not fully eliminate the residual errors in the simulations. 6 B Coupled Intercomparisons The first phase of AMIP (designated as AMIP I, circa 1990-1996) saw the participation of about 30 AGCMs that simulated the global climate for the period 1979-1988. From 1990 to 1996, diagnostic subproject 12 contributed analyses of AMIP I results of relevance to the characterisation of the continental climate. In the AMIP I global models, the land-surface schemes were solely boundaries for energy and water exchanges between the air and the land. Most land-surface schemes were well established, dating back to Manabe (1969) and were generally believed to work well. The AMIP I experiment was designed to include evaluation of land-surface. Despite this, there were a number of difficulties associated with the analysis. These included: 1. the failure to initialise soil moisture consistently among AMIP I models; 2. a rather restricted set of “standard output” variables; 3. the limited variety of LSSs in the AGCMs of that time; 4. poor quality control of archived results; and 5. relatively poor documentation of the LSSs which were represented in AMIP I. Despite these obstacles and inhibiting factors, it was possible to undertake evaluations of the simulated land-surface climates. Although it was originally intended to concentrate on “validation”, the outcomes of diagnostic subproject 12 of AMIP I are perhaps best described as “learning on the job”. The AMIP I/12 results can be summarised into three main findings: 1. No “best” land-surface simulation could be identified: every surface climate was an outlier in some respect (Love and Henderson-Sellers, 1994); 2. results revealed serious errors of execution such as non-conservation of continental moisture and/or energy and pronounced trends in moisture stores which were traced back to coding/coupling mistakes and incorrect/inadequate initialisation (Love et al., 1995); 3. at a regional scale, the inter-model scatter in energy and moisture partitions among the coupled simulations were substantially greater than in comparable off-line experiments, suggesting that the hypothesis that two-way feedbacks between land and atmosphere dampen land-surface climate differences is incorrect or at least unproven (Irannejad et al., 1995; Qu and HendersonSellers, 1998). 7 The twofold conclusions of AMIP I/12 was: (i) land-surface codes were not working especially well and certainly not as well as the AGCM owners and users believed and (ii) the neglect of stomatal resistance parameterisation in incorporated LSSs rendered the representation of many continental climates rather poor. Results also suggested that at least two years’ simulation, and often much longer, is required to overcome the difficulties of soil moisture initialisation. Energy and moisture differences over multi-year periods were caused in AMIP I by philosophies underpinning the incorporation of deep soil processes, as a result of poor experimental design, and by coding errors. Following AMIP I analysis by DSP12, the Bureau of Meteorology Research Centre, Australia (BMRC) and the Laboratoire de Meteorologie Dynamique, France (LMD) each undertook a pair of repeats of their AMIP I simulations (termed AMIP revisits) using two different land surface schemes coupled with the GCMs. In each case, a standard bucket hydrology (i.e. BMRC + Bucket, LMD + Bucket) and a biophysically based land-surface scheme (i.e. BMRC + BASE, LMD + SECHIBA) were used (Qu and Henderson-Sellers 1996, Phillips 1997). The results revealed that coupling land-surface schemes with varying degrees of complexity gives rise to widespread statistically significant differences in continental temperature, pressure, and turbulent fluxes-results in accord with those of analogous studies (e.g., Sato et al., 1989, Thompson and Pollard 1995, Yang et al., 1995). Comparisons were undertaken of the scaled latent heat and scaled sensible heat of the AMIP revisit corresponding to the Cabauw (PILPS Phase 2(a)) and Valdai (PILPS Phase 2(d)) grid points. Experiments with different modes of CHASM coupled with the BMRC GCM revealed that for a central desert and a tropical scrub region in Australia the impact of varying LSS complexity on model simulation is not less than that of varying the model atmosphere vertical resolution or by using different convection schemes (Zhang et al., 2001). 8 References Avissar R., 1992, Conceptual Aspects of a Statistical--Dynamical Approach to Represent Landscape Subgrid-scale Heterogeneities in Atmospheric Models. J. Geophys. Res., 97, 2,729-2,742. Betts A.K., Viterbo P. and Wood E., 1998, Surface energy and water balance for the Arkansas-Red River basin from the ECMWF renalysis, J. Climate, 11, 2881-2897. Betts A.K., 1996, Comparing of NCEP-NCAR reanalysis with 1987 FIFE data, Mon. Wea. Rev., 124, 1480-1498. Chen T.H. Henderson-Sellers A., Milly P.C.D., Pitman A.J., Beljaars A.C.M., Polcher J., Abramopoulos F., Boone A., Chang S. Chen F. Dai Y. Desborough CE. Dickinson R.E., Dumenil L., Ek M., Garratt J.R., Gedney N., Gusev Y.M., Kim J., Koster R., Kowalczyk E.A., Laval K., Lean J., Lettenmaier D., Liang X., Mahfouf J.-F., Megelkamp H.-T., Mitchel K., Nasonova O.N., Noilhan J., Robock A., Rozensweig C., Schaake J., Schlosser A., Schulz J.P., Shao Y., Shmakin A.B., Verseghy D.L., Wetzel P., Wood E.F., Xue Y., Yang Z.-L. and Zeng Q., 1997, Cabauw Experimental results from the project for Intercomparison of Landsurface Parameterization Schemes, J. Climate, 10, 1194-1215. Desborough C.E., 1999, Surface energy complexity in GCM land surface models, Climate Dyn., 15, 389-403. Dickinson R.E., Henderson-Sellers A. and Kennedy P., 1993, Biosphere--Atmosphere Transfer Scheme (BATS) Version 1e as Coupled to the NCAR Community Climate Model. Tech Note TN--387+STR, National Centre for Atmospheric Research, Boulder, Col, 72pp. ECMWF, 1999, ECMWF Re-Analysis (ERA) Project, European Center for Medium-Range Weather Forcasts, Reading, England. Accessible online at http:\\www.ecmwf.int/research/era/. Entekhabi D. and Eagleson P., 1989, Land Surface Hydrology Parameterization for the Atmospheric General Circulation Models Including Subgrid Scale Spatial Variability, J. Climate, 2, 816-831. 9 Famiglietti J.S. and Wood E.F., 1995, Effects of Spatial Variability and Scale on Areally Averaged Evapotranspiration. Wat. Resour. Res., 31:699-712. Gates W.L., Boyle J.S., Covey C., Dease C.G., Doutriaux C.M., Drach R.S., Fiorino M., Gleckler P.J., Marlais S., Phillips T.J., Potter G.L., Santer B.D., Sperber K.R., Taylor K.E. and Williams D.N., 1999, An overview of the results of the Atmospheric Models Intercomparison Project (AMIP I), Bull. Amer. Meteor. Soc., 80, 29-55. Gates W.L., 1992, The atmospheric model intercomparison project, Bull. Amer. Meteor. Soc., 73, 1962-1970. Gates W.L., Henderson-Sellers A., Boer G.J., Folland C.K., Kitoh A., McAvaney B.J., Semazzi F., Smith N., Weaver A.J. and Zeng Q.-C., 1996, Climate models - evaluation, In: Houghton J.T., Meira Filho L.G., Callander B.A., Harris N., Kattenberg A. and Maskell K. (eds.), Climate Change 1995. The Science of Climate Change, Cambridge University Press, Cambridge, 229-284. Gedney N., Cox P.M., Douville H., Polcher J. and Valdes P.J., 1999, Characterising GCM land surface schemes to understand their responses to climate change, Hadley Centre Technical Note HCTN 4, United Kingdom Meteorological Office, Bracknell Berkshire, RG12 2SY, United Kingdom. Gupta H.V., Bastidas L.A., Sorooshian S., Shuttleworth W.J. and Yang Z.-L., 1999, Parameter estimation od a land surface scheme using multicriteria methods. J. Geophys. Res., 104, 19,491-19,503. Hahmann A. and Dickinson R.E., 1997, Comparing CCM3/BATS and CCM3/LSM: Summary of PILPS Phase 4a activities. Accessible at World Wide Web address: http://www.atmo.arizona.edu/~bats/pilps97.html. Henderson-Sellers A., McGuffie K. and Pitman A.J., 1996, The Project for the Intercomparison of Land-surface Parameterization Schemes: 1992-1995, Climate Dyn., 12, 847-859. Henderson-Sellers A., Pitman A.J, Love P.K., Irannejad P. and Chen T.H. (1995) The Project for Intercomparison of Landsurface Schemes (PILPS): Phases 2 & 3. Bull. Amer. Meteor. Soc., 73, 962-1970. 10 Henderson-Sellers A., Yang Z.L. and Dickinson R.E., 1993, The Project for Intercomparison of Land-surface Schemes (PILPS). Bull. Amer. Meteor. Soc., 74, 1,335-1,349. Henderson-Sellers A. and Brown V.B., 1992, PILPS: Project for Intercomparison of Land-surface Parameterization Schemes, Workshop Report and and First Science Plan, IGPO Publication Series No. 5, Science and Technology Corporation, Hampton, VA, 51pp. Irannejad, P., 1999, Impacts of land surface scheme structure on the prediction of soil moisture and surface energy fluxes, unpublished thesis, University of New South Wales, 198pp. Irannejad P., Henderson-Sellers A., Phillips T., and McGuffie K., 2000, Analysis of AMIP II models’ simulation of land surface climates, GEWEX News, 10, 5-8. Irannejad P., Henderson-Sellers A., Shao Y. and Love P.K., 1995. Comparison of AMIP and PILPS off-line landsurface simulations. Proceedings of the First International AMIP Scientific Conference, Monterey, California, USA, 15-19 May 1995, WCRP-92, WMO/TD-No. 732, 465-470. ISLSCP, 1999, The International satellite Land Surface Climatology Project, Initiative II, Accessible online at http://islscp2.gsfc.nasa.gov/. Kalnay E., Kanamitsu M., Kistler R., Colins W., Deaven D., Gandin L., Iredell M., Saha S., White G., Woolen J., Zhu Y., Chelliah M., Ebisuzaki W., Higgins W., Janowiak J., Mo K.C., Ropelewski C., Wang J., Leetmaa A., Reynolds R., Jenne R. and Joseph D., 1996, The NMC/NCAR 40-year reanalysis project, Bull. Amer. Meteor. Soc., 77, 437-471. Kanamitsu M., Ebisuzaki W., Woolen J., Potter J. and Fiorino M., 1999, An overview of [NCEP] Reanalysis-2. Accessible online at http://wesley.wwb.noaa.gov/reanalysis2/kana/reanal2-1.htm. Koster, R.D., and Milly P.C.D., 1997, The interplay between transpiration and runoff formulations in land surface schemes used with atmospheric models. J. Climate, 10, 1578-1591. Liang X., Lettenmaier D.P., Wood E.F., Burges S.J., 1994, A Simple Hydrologically Based Model of Land Surface Water and Energy Fluxes for General Circulation Models. J. Geophys. Res., 99(D7):14,415--14,428. 11 Love, P.K., and Henderson-Sellers A., 1994, Land-surface climatologies of AMIP-PILPS models and identification of regions for future investigation (PILPS Phase 3a). GEWEX Report, IGBPO Publication Series No. 13, 48 pp. Love P.K., Henderson-Sellers, A. and Irannejad, P., 1995, AMIP diagnostic subproject 12 (PILPS Phase 3): Land surface processes, Proceedings of the First International AMIP Scientific Conference, Monterey, California, USA, 15-19 May 1995, WCRP-92, WMO/TD-No. 732, Manabe S., 1969, Climate and ocean circulation: 1. The atmospheric circulation and the hydrology of the earth's surface, Mon. Wea. Rev., 97, 739-774. Maurer E.P., Nijssen B. and Lettenmaier D.P., 2000, Use of reanalysis land surface water budget variables in hydrologic studies, GEWEX News, 10, 6-8. NASA, 1999, NASA Data Assimilation Office Reanalysis Experiment, National Aeronautics and Space Administration Goddard Space Flight Center, Greenbelt, Maryland, USA. Accessible online at http://dao.gsfc.nasa.gov/supagers/reanalysis.html. Peylin P., Polcher J., Bonan G., and Williamson D., 1997, Comparison of two complex land surface schemes coupled to the National Center for Atmospheric Research general circulation model. J. Geophys. Res., 102, 19413-19431. Phillips T.J., Henderson-Sellers A., Irannejad P., McGuffie K. and Zhang H., 2000, On validation and diagnosis of land-surface climate simulations, Climate Change Newsletter, 12(1), 3-5. Phillips T.J., Anderson R. and Brosius M., 1995, Summary documentation of the AMIP I models, Accessible online at http://www.pcmdi.llnl.gov/modeldoc/amip1/. Phillips T.J., Henderson-Sellers A., Hahman A. and Pitman A.J., 1998, AMIP II diagnostic subproject 12: Landsurface processes and parameterizations (a joint AMIP/PILPS project). Accessible online at http://www.pcmdi.llnl.gov/pilps3/proposal/. Pitman A.J., Henderson-Sellers A., Desborough, C.E., Yang, Z.-L., Abramopoulos, F., Boone, A., Dickinson, R.E., Gedney, N., Koster, R., Kowalczyk, E., Lettenmaier, D., Liang, X., Mahfouf, J.-F., Noilhan, J., Polcher, J., Qu, W., Robock, A., Rosenzweig, C., Schlosser, C.A., Shmakin, A.B., Smith, J., Suarez, M., Verseghy, D., Wetzel, P., Wood, E. and Xue, Y., 12 1999, Key results and implications from Phase 1(c) of the Project for the Intercomparison of Land-surface Parameterization Schemes, Climate Dyn., 15, 673-684. Pitman A.J., Henderson-Sellers A., Abramopoulos F., Avissar R., Bonan G., Boone A., Cogley J.G., Dickinson R. E., Ek M., Entekhabi D., Famiglietti J., Garratt J.R., Frech M., Hahmann A., Koster R., Kowalczyk E., Laval K., Lean L., Lee T.J., Lettenmaier D., Liang X., Mahfouf J.F., Mahrt L., Milly C., Mitchell K., de Noblet N., Noilhan J., Pan H., Pielke R., Robock A., Rosenzweig C., Running S.W., Schlosser A., Scott R., Suarez M., Thompson S., Verseghy D., Wetzel P., Wood E., Xue Y., Yang Z.L., Zhang L., 1993, Results from the off-line Control Simulation Phase of the Project for Intercomparison of Land Surface Parameterisation Schemes (PILPS). GEWEX Tech Note, IGPO Publ Series, 7:47. Qu W.Q. and Henderson-Sellers A., 1998, Comparing the scatter in PILPS off-line experiments with those in AMIP I coupled experiments, Global Planet. Change, 19, 209-224. Sato N., Sellers P.J., Randall D.A., Schneider E.K., Shukla J., Kinter II J.L., Hou Y-T., and Albertazzi E., 1989, Effects of implementing the Simple Biosphere Model in a general circulation model. J. Atmos. Sci., 46, 2757-2782. Sellers P.J., Meeson B.W., Closs L., Collatz J., Corprew F., Hall F.G., Kerr Y., Koster R., Los S., Mitchell K., McManus J., Myers D., Sun K.-J. and Try P., 1995, An overview of the ISLSCP Initiative I global data sets. Accessible online at http://daac.gsfc.nasa.gov/CAMPAIGN_DOCS/ISLSCP/OVERVIEW_DOCUMENTS/overview.pdf. Sellers P.J., Mintz Y., Sud Y.C., Dalcher A., 1986, A Simplified Biosphere Model (SiB) for Use within General Circulation Model. J. Atmo. Sci., 43, 505-531. Shao Y.P. Henderson-Sellers A., 1996, Validation of soil moisture simulation in landsurface parameterisation schemes with HAPEX data, Global Planet. Change, 13, 11-46, Special Issue. Slater G., Schlosser C.A., Desborough C.E., Pitman A.J., Henderson- Sellers A., Robock A. , Ya K., Vinnikov , Speranskaya N.A., Mitchell K., Boone A., Braden H., Chen F., Cox P., de Rosnay P., Dickinson R.E., Dai Y-J., Duan Q., Entin J., Etchevers P., Gedney N., Gusev Y. M., Habets F., Kim J., Koren V., Kowalczyk E., Nasonova O.N., Noilhan J., Shaake J., 13 Shmakin A.B., Smirnova T., Verseghy D., Wetzel P., Xue Y., Yang Z-L., Zeng Q., 2001, The Representation of Snow in Land-surface Schemes ; results from PILPS 2(d), J. Hydrometeorology, 2, 7-25. Schulz J-P., Dümenil L. and Polcher J., 1997, Two land surface schemes implemented in the ECHAM4 GCM. Accessible at World Wide Web address: http://www-pcmdi.llnl.gov/pilps3/mpi/index.html. Thompson S.L., and Pollard D., 1995, A global climate model (GENESIS) with a land-surface transfer scheme (LSX). Part I: Present climate simulation. J. Climate, 8, 732-761. Taylor K.E., 2001, Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res., 106, 7183-7192. Tian H., Mellilo J.M., Kicklighter D.W., McGuire A.D. and Helfrich J., 1999, The sensitivity of terrestial carbon storage to historical climate variability and atmospheric CO2 in the United :States, Tellus, 51B, 414-452. Wood E.F., Lettenmaier D.P., Liang X., Lohmann D., Boone A., Chang S., Chen F., Dai Y., Dickinson R.E., Duan Q., Ek M., Gusev Y.M., Habets F., Irannejad P., Koster R., Mitchel K.E., Nasonova O.N., Noilhan J., Schaake J., Schlosser A., Shao Y., Shmakin A.B., Verseghy D., Warrach K., Wetzel Y., Xue Y., Yang Z.-L. and Zeng Q.-C., 1998, The Project fo Intercomparison of Land-surface Parameterization Schemes (PIPLS) Phase 2(c) RedArkansas River basin experiment: 1. Experiment description and summary intercomparisons, Global Plannet. Change, 19, 115-135. Xiao X., Mellilo J.M., Kicklighter D.W., McGuire A.D., Prinn R.G., Wang C., Stone P.H. and Sokolov A., 1998, Transient climate change and net ecosystem production of the terrestrial biosphere, Global Biogeochemical Cycles, 12, 345-360. Yang Z.L., Pitman A.J., McAvaney B., and Henderson-Sellers A., 1995, The impact of implementing the bare essentials of surface transfer land surface scheme into the BMRC GCM. Climate Dyn., 11, 279-297. 14 Zhang H., Henderson-Sellers A., Pitman A.J., McGregor J.L., Desborough C.E. and Katzfey J., 2001, Limited-area model sensitivity to the complexity of representation of the land-surface energy balance, J. Climate, 14(19), 3965-3986. 15