Search Results
A generic pixel-to-point comparison for simulated large-scale ecosystem properties and ground-based observations: An example from the Amazon region
Comparing model output and observed data is an important step for assessing model performance and quality of simulation results. However, such comparisons are often hampered by differences in spatial scales between local point observations and large-scale simulations of grid cells or pixels. In this study, we propose a generic approach for a pixel-to-point comparison and provide statistical measures accounting for the uncertainty resulting from landscape variability and measurement errors in ecosystem variables. The basic concept of our approach is to determine the statistical properties of small-scale (within-pixel) variability and observational errors, and to use this information to correct for their effect when large-scale area averages (pixel) are compared to small-scale point estimates. We demonstrate our approach by comparing simulated values of aboveground biomass, woody productivity (woody net primary productivity, NPP) and residence time of woody biomass from four dynamic global vegetation models (DGVMs) with measured inventory data from permanent plots in the Amazon rainforest, a region with the typical problem of low data availability, potential scale mismatch and thus high model uncertainty. We find that the DGVMs under- and overestimate aboveground biomass by 25% and up to 60%, respectively. Our comparison metrics provide a quantitative measure for model-data agreement and show moderate to good agreement with the region-wide spatial biomass pattern detected by plot observations. However, all four DGVMs overestimate woody productivity and underestimate residence time of woody biomass even when accounting for the large uncertainty range of the observational data. This is because DGVMs do not represent the relation between productivity and residence time of woody biomass correctly. Thus, the DGVMs may simulate the correct large-scale patterns of biomass but for the wrong reasons. We conclude that more information about the underlying processes driving biomass distribution are necessary to improve DGVMs. Our approach provides robust statistical measures for any pixel-to-point comparison, which is applicable for evaluation of models and remote-sensing products.
A multi-model analysis of risk of ecosystem shifts under climate change
Climate change may pose a high risk of change to Earth's ecosystems: shifting climatic boundaries may induce changes in the biogeochemical functioning and structures of ecosystems that render it difficult for endemic plant and animal species to survive in their current habitats. Here we aggregate changes in the biogeochemical ecosystem state as a proxy for the risk of these shifts at different levels of global warming. Estimates are based on simulations from seven global vegetation models (GVMs) driven by future climate scenarios, allowing for a quantification of the related uncertainties. 5–19% of the naturally vegetated land surface is projected to be at risk of severe ecosystem change at 2 ° C of global warming (ΔGMT) above 1980–2010 levels. However, there is limited agreement across the models about which geographical regions face the highest risk of change. The extent of regions at risk of severe ecosystem change is projected to rise with ΔGMT, approximately doubling between ΔGMT = 2 and 3 ° C, and reaching a median value of 35% of the naturally vegetated land surface for ΔGMT = 4 °C. The regions projected to face the highest risk of severe ecosystem changes above ΔGMT = 4 °C or earlier include the tundra and shrublands of the Tibetan Plateau, grasslands of eastern India, the boreal forests of northern Canada and Russia, the savanna region in the Horn of Africa, and the Amazon rainforest.
Regional contribution to variability and trends of global gross primary productivity
Terrestrial gross primary productivity (GPP) is the largest component of the global carbon cycle and a key process for understanding land ecosystems dynamics. In this study, we used GPP estimates from a combination of eight global biome models participating in the Inter-Sectoral Impact-Model Intercomparison Project phase 2a (ISIMIP2a), the Moderate Resolution Spectroradiometer (MODIS) GPP product, and a data-driven product (Model Tree Ensemble, MTE) to study the spatiotemporal variability of GPP at the regional and global levels. We found the 2000–2010 total global GPP estimated from the model ensemble to be 117 ± 13 Pg C yr−1 (mean ± 1 standard deviation), which was higher than MODIS (112 Pg C yr−1), and close to the MTE (120 Pg C yr−1). The spatial patterns of MODIS, MTE and ISIMIP2a GPP generally agree well, but their temporal trends are different, and the seasonality and inter-annual variability of GPP at the regional and global levels are not completely consistent. For the model ensemble, Tropical Latin America contributes the most to global GPP, Asian regions contribute the most to the global GPP trend, the Northern Hemisphere regions dominate the global GPP seasonal variations, and Oceania is likely the largest contributor to inter-annual variability of global GPP. However, we observed large uncertainties across the eight ISIMIP2a models, which are probably due to the differences in the formulation of underlying photosynthetic processes. The results of this study are useful in understanding the contributions of different regions to global GPP and its spatiotemporal variability, how the model- and observational-based GPP estimates differ from each other in time and space, and the relative strength of the eight models. Our results also highlight the models' ability to capture the seasonality of GPP that are essential for understanding the inter-annual and seasonal variability of GPP as a major component of the carbon cycle.
The critical role of the routing scheme in simulating peak river discharge in global hydrological models
Global hydrological models (GHMs) have been applied to assess global flood hazards, but their capacity to capture the timing and amplitude of peak river discharge—which is crucial in flood simulations—has traditionally not been the focus of examination. Here we evaluate to what degree the choice of river routing scheme affects simulations of peak discharge and may help to provide better agreement with observations. To this end we use runoff and discharge simulations of nine GHMs forced by observational climate data (1971–2010) within the ISIMIP2a project. The runoff simulations were used as input for the global river routing model CaMa-Flood. The simulated daily discharge was compared to the discharge generated by each GHM using its native river routing scheme. For each GHM both versions of simulated discharge were compared to monthly and daily discharge observations from 1701 GRDC stations as a benchmark. CaMa-Flood routing shows a general reduction of peak river discharge and a delay of about two to three weeks in its occurrence, likely induced by the buffering capacity of floodplain reservoirs. For a majority of river basins, discharge produced by CaMa-Flood resulted in a better agreement with observations. In particular, maximum daily discharge was adjusted, with a multi-model averaged reduction in bias over about 2/3 of the analysed basin area. The increase in agreement was obtained in both managed and near-natural basins. Overall, this study demonstrates the importance of routing scheme choice in peak discharge simulation, where CaMa-Flood routing accounts for floodplain storage and backwater effects that are not represented in most GHMs. Our study provides important hints that an explicit parameterisation of these processes may be essential in future impact studies.
State-of-the-art global models underestimate impacts from climate extremes
Global impact models represent process-level understanding of how natural and human systems may be affected by climate change. Their projections are used in integrated assessments of climate change. Here we test, for the first time, systematically across many important systems, how well such impact models capture the impacts of extreme climate conditions. Using the 2003 European heat wave and drought as a historical analogue for comparable events in the future, we find that a majority of models underestimate the extremeness of impacts in important sectors such as agriculture, terrestrial ecosystems, and heat-related human mortality, while impacts on water resources and hydropower are overestimated in some river basins; and the spread across models is often large. This has important implications for economic assessments of climate change impacts that rely on these models. It also means that societal risks from future extreme events may be greater than previously thought.
Benchmarking carbon fluxes of the ISIMIP2a biome models
The purpose of this study is to evaluate the eight ISIMIP2a biome models against independent estimates of long-term net carbon fluxes (i.e. Net Biome Productivity, NBP) over terrestrial ecosystems for the recent four decades (1971–2010). We evaluate modeled global NBP against 1) the updated global residual land sink (RLS) plus land use emissions (E LUC) from the Global Carbon Project (GCP), presented as R + L in this study by Le Quéré et al (2015), and 2) the land CO2 fluxes from two atmospheric inversion systems: Jena CarboScope s81_v3.8 and CAMS v15r2, referred to as F Jena and F CAMS respectively. The model ensemble-mean NBP (that includes seven models with land-use change) is higher than but within the uncertainty of R + L, while the simulated positive NBP trend over the last 30 yr is lower than that from R + L and from the two inversion systems. ISIMIP2a biome models well capture the interannual variation of global net terrestrial ecosystem carbon fluxes. Tropical NBP represents 31 ± 17% of global total NBP during the past decades, and the year-to-year variation of tropical NBP contributes most of the interannual variation of global NBP. According to the models, increasing Net Primary Productivity (NPP) was the main cause for the generally increasing NBP. Significant global NBP anomalies from the long-term mean between the two phases of El Niño Southern Oscillation (ENSO) events are simulated by all models (p < 0.05), which is consistent with the R + L estimate (p = 0.06), also mainly attributed to NPP anomalies, rather than to changes in heterotrophic respiration (Rh). The global NPP and NBP anomalies during ENSO events are dominated by their anomalies in tropical regions impacted by tropical climate variability. Multiple regressions between R + L, F Jena and F CAMS interannual variations and tropical climate variations reveal a significant negative response of global net terrestrial ecosystem carbon fluxes to tropical mean annual temperature variation, and a non-significant response to tropical annual precipitation variation. According to the models, tropical precipitation is a more important driver, suggesting that some models do not capture the roles of precipitation and temperature changes adequately.
Assessing the impacts of 1.5 °C global warming – simulation protocol of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP2b)
In Paris, France, December 2015, the Conference of the Parties (COP) to the United Nations Framework Convention on Climate Change (UNFCCC) invited the Intergovernmental Panel on Climate Change (IPCC) to provide a "special report in 2018 on the impacts of global warming of 1.5°C above pre-industrial levels and related global greenhouse gas emission pathways". In Nairobi, Kenya, April 2016, the IPCC panel accepted the invitation. Here we describe the response devised within the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP) to provide tailored, cross-sectorally consistent impact projections to broaden the scientific basis for the report. The simulation protocol is designed to allow for (1) separation of the impacts of historical warming starting from pre-industrial conditions from impacts of other drivers such as historical land-use changes (based on pre-industrial and historical impact model simulations); (2) quantification of the impacts of additional warming up to 1.5°C, including a potential overshoot and long-term impacts up to 2299, and comparison to higher levels of global mean temperature change (based on the low-emissions Representative Concentration Pathway RCP2.6 and a no-mitigation pathway RCP6.0) with socio-economic conditions fixed at 2005 levels; and (3) assessment of the climate effects based on the same climate scenarios while accounting for simultaneous changes in socio-economic conditions following the middle-of-the-road Shared Socioeconomic Pathway (SSP2, Fricko et al., 2016) and in particular differential bioenergy requirements associated with the transformation of the energy system to comply with RCP2.6 compared to RCP6.0. With the aim of providing the scientific basis for an aggregation of impacts across sectors and analysis of cross-sectoral interactions that may dampen or amplify sectoral impacts, the protocol is designed to facilitate consistent impact projections from a range of impact models across different sectors (global and regional hydrology, lakes, global crops, global vegetation, regional forests, global and regional marine ecosystems and fisheries, global and regional coastal infrastructure, energy supply and demand, temperature-related mortality, and global terrestrial biodiversity).
Photosynthetic productivity and its efficiencies in ISIMIP2a biome models: Benchmarking for impact assessment studies
Simulating vegetation photosynthetic productivity (or gross primary production, GPP) is a critical feature of the biome models used for impact assessments of climate change. We conducted a benchmarking of global GPP simulated by eight biome models participating in the second phase of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP2a) with four meteorological forcing datasets (30 simulations), using independent GPP estimates and recent satellite data of solar-induced chlorophyll fluorescence as a proxy of GPP. The simulated global terrestrial GPP ranged from 98 to 141 Pg C yr−1 (1981–2000 mean); considerable inter-model and inter-data differences were found. Major features of spatial distribution and seasonal change of GPP were captured by each model, showing good agreement with the benchmarking data. All simulations showed incremental trends of annual GPP, seasonal-cycle amplitude, radiation-use efficiency, and water-use efficiency, mainly caused by the CO2 fertilization effect. The incremental slopes were higher than those obtained by remote sensing studies, but comparable with those by recent atmospheric observation. Apparent differences were found in the relationship between GPP and incoming solar radiation, for which forcing data differed considerably. The simulated GPP trends co-varied with a vegetation structural parameter, leaf area index, at model-dependent strengths, implying the importance of constraining canopy properties. In terms of extreme events, GPP anomalies associated with a historical El Niño event and large volcanic eruption were not consistently simulated in the model experiments due to deficiencies in both forcing data and parameterized environmental responsiveness. Although the benchmarking demonstrated the overall advancement of contemporary biome models, further refinements are required, for example, for solar radiation data and vegetation canopy schemes.
Evapotranspiration simulations in ISIMIP2a—Evaluation of spatio-temporal characteristics with a comprehensive ensemble of independent datasets
Actual land evapotranspiration (ET) is a key component of the global hydrological cycle and an essential variable determining the evolution of hydrological extreme events under different climate change scenarios. However, recently available ET products show persistent uncertainties that are impeding a precise attribution of human-induced climate change. Here, we aim at comparing a range of independent global monthly land ET estimates with historical model simulations from the global water, agriculture, and biomes sectors participating in the second phase of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP2a). Among the independent estimates, we use the EartH2Observe Tier-1 dataset (E2O), two commonly used reanalyses, a pre-compiled ensemble product (LandFlux-EVAL), and an updated collection of recently published datasets that algorithmically derive ET from observations or observations-based estimates (diagnostic datasets). A cluster analysis is applied in order to identify spatio-temporal differences among all datasets and to thus identify factors that dominate overall uncertainties. The clustering is controlled by several factors including the model choice, the meteorological forcing used to drive the assessed models, the data category (models participating in the different sectors of ISIMIP2a, E2O models, diagnostic estimates, reanalysis-based estimates or composite products), the ET scheme, and the number of soil layers in the models. By using these factors to explain spatial and spatio-temporal variabilities in ET, we find that the model choice mostly dominates (24%–40% of variance explained), except for spatio-temporal patterns of total ET, where the forcing explains the largest fraction of the variance (29%). The most dominant clusters of datasets are further compared with individual diagnostic and reanalysis-based estimates to assess their representation of selected heat waves and droughts in the Great Plains, Central Europe and western Russia. Although most of the ET estimates capture these extreme events, the generally large spread among the entire ensemble indicates substantial uncertainties.
Global gridded crop model evaluation: Benchmarking, skills, deficiencies and implications
Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.