May 04 2012

Digital Object Identifiers

Digital Object Identifiers (DOI’s) are often used to uniquely identify and reference digital content of written documents such as scientific publications or books. This is helpful to track a content over a long time period, where the actual location of the content may change, but any reference to it will have to stay the same.

DOI’s are not just suitable for electronic documents but in fact for any digital content. We have now created a DOI for our long term satellite-based Surface Radiation MVIRI Dataset from the Satellite Application Facility on Climate Monitoring by Rebekka Posselt, Richard Müller, Reto Stöckli and Jörg Trentmann (2011):

http://dx.doi.org/10.5676/EUM_SAF_CM/RAD_MVIRI/V001

Mar 15 2012

Remote Sensing of Solar Surface Radiation

We have processed a global irradiance and direct irradiance climate data record from the Meteosat first generation satellites (Meteosats 2 to 7, 1983–2005). The CDRs are available free of charge for all purposes from the EUMETSAT‘s Satellite Application Facility on Climate Monitoring Web User Interface at monthly, daily and hourly means at a spatial resolution of 0.03 degrees.

Climatologies of global (SIS) and direct beam (SID) surface radiation over Europe and Africa derived from Meteosat First Generation Satellites

The processing employed a climate version of the well known Heliosat algorithm combined with a open source clear sky model (gnu-MAGIC) using an eigenvector look-up table method. Modifications to the Heliosat method include a self-calibration algorithm as well as a running mean based clear sky retrieval algorithm.

More information to this dataset and related algorithms can be found on our CM SAF project web site at MeteoSwiss.

R. Posselt, R. W. Mueller, R. Stöckli, and J. Trentmann (2012). Remote sensing of solar surface radiation for climate monitoring — the CM-SAF retrieval in international comparison. Remote Sens. Environ., 118:186–198. doi: 10.1016/j.rse.2011.11.016.

Mar 09 2012

How to “bluemarbelize” Google Maps?

Introduction

Google Maps and Google Earth (hereafter Google Maps) are publicly available tools useful to visually explore the geography of our planet. Globally distributed high resolution satellite data are used as a background to dynamically map physical, geographical, historical, socio-economic or political thematic layers. Nowadays the average, educated person with access to the internet either interactively applies Google Maps for commercial or private activities or passively uses it through media coverage. Hence, the perception of the earth’s visual appearance is successively becoming based on this particular data source.

Google Maps have a highly advanced interface for simultaneously merging and displaying a complex set of data sources. The thematic layers of Google Maps are accurate and they often include real-time information. The background imagery, however, lacks some level of realism, identified here as a weak treatment of the underlying satellite data. Scientific and technical methods were for instance developed and applied in NASA’s Blue Marble Next Generation project (hereafter BMNG, http://bluemarble.nasa.gov) to correct for such issues, and they could serve as a guideline to improve Google Maps. The aim of the following discussion is therefore to outline a few methods that could yield better spatial consistency of the satellite data used in Google Maps. It is important for educational and scientific purposes that the public perceives a realistic view of our planet.

The discussion is accompanied by the following slides, presented by me in a video conference at Google Zurich on 28 February 2012.

Problem Description

Himalaya in Google Maps

Google Maps offer amazing detail when viewed at the street, city and landscape scale. However, regional and continental views of our planet often appear rather discontinuous as a patchwork of different satellite scenes and as a mix of true and false color composites. Problematic regions also include those with a distinct seasonality such as temperate and boreal climates, regions with heavy cloudiness such as the tropics, and regions with high aerosol loads such as areas with biomass burning or with urban pollution.

Most discontinuities are a result of stitching temporally discontinuous satellite datasets with differing atmospheric disturbances, directional effects of the sun-earth-satellite viewing geometry, spectral differences between satellite sensors and last but not least the seasonal differences of the earth surface’s vegetation and snow cover. Most of these effects can be overcome if suitable satellite remote sensing algorithms are applied. We have demonstrated it for the BMNG at 500 m spatial resolution (Stöckli et al. 2005).

Possible Solutions

Himalaya in the Blue Marble Next Generation

In order to carry out a similar set of corrections for Google Maps, fundamental processing of satellite data using well established algorithms could firstly be applied to the satellite scenes used for Google Maps. Secondly, novel methods would have to be developed in order to optimizespatio-temporal compositing of those satellite scenes.

1) Scene Processing

The aim of scene processing is to retrieve the surface reflectance (visible and near-infrared spectral bands) or brightness temperature (infrared spectral bands) for cloud free pixels in each satellite scene. This is mandatory for the further retrieval of physical properties from a satellite dataset. It can be applied to most satellite sensors, including those used for Google Maps (e.g. Landsat, SPOT and probably even to GeoEye, Worldview and QuickBird). Scene processing can be computationally expensive but mature algorithms are publicly available from the science community (for instance the LEDAPS code; Masek et al. 2006). Scene processing requires the existence of level 1 or 1b satellite data including extensive metadata (like sensor calibration, geographic registration, satellite radiances etc.). Processed satellite images or image composites cannot be used for physical retrievals and corrections.

The following steps (among others) are carried out during scene processing:

  • registration & navigation
  • removal of geometric and radiometric artifacts
  • orthorectification
  • radiance (inter-) calibration degraded sensors (de Vries et al. 2007)
  • cloud masking (Khlopenkov and Trishchenko 2007)
  • correction of atmospheric effects (Vermote et al. 2002)
  • spectral conversion to pre-defined bands

Scene processing can yield cloud-free surface reflectances that also include per-pixel estimates of the retrieval error. This error can be defined heuristically from quality flags of each processing step. It can also be estimated by using bayesian algorithms, such as for instance a cloud mask based on an optimal estimation technique. Retrieval errors are an important input for scene compositing, where the clear sky surface reflectances are used for the estimation of model parameters.

2) Scene Compositing

The aim of scene compositing is to achieve spatial consistency by merging the corrected and masked scenes from above processing in time and space. Simple spatial stitching methods are often used, but they cannot provide spatial consistency. Often, neighboring scenes are from a different season or year and they do neither match solar illumination geometry nor the highly variable state of surface. A composite will then have visible boundaries where stitching took place. A better result can be achieved by temporal compositing from a stack of seasonally distributed scenes of the same area of interest. The composite for a given pixel, date, solar and view geometry is then calculated by use of a time series analysis approach. This requires the availability of satellite data with a high enough temporal revisit frequency (every month or less), or with long enough temporal coverage (many years of observation).

The following steps (among others) are required for scene compositing:

  • calculate surface BRDF effects
  • calculate seasonal dynamics of vegetation
  • remove gaps with temporal interpolation

All three steps are best calculated together in one single algorithm since they involve the inversion of semi-empirical models where 3-10 parameters have to be fitted to each pixel. The parameter space often is characterized by a high order of equifinality, thus the minimization of the involved cost function is not trivial. The simplest approach uses 2nd and 3rd order Fourier series and yields a mixed retrieval of BRDF and seasonality based on 2-3 parameters per pixel. If a BRDF model and a phenology model are both available, an optimal estimation or ensemble-based bayesian data assimilation could be applied to retrieve 6-8 parameters per pixel (Stöckli et al. 2011). In case of a poor temporal coverage, multi-sensor parameter estimation may be applied. This for instance means that a landcover-dependent set of BRDF parameters is firstly estimated at MODIS pixel scale. MODIS-based parameters are then down-scaled and applied to Landsat or SPOT resolution (Li et al. 2010).

Conclusions and Outlook

The key ideas outlined above are that scene compositing employs the temporal domain to guarantee consistency of the resulting composite in the spatial domain. The underlying data source has to be properly processed beforehand, and it needs to have a high enough temporal coverage. Such a framework has been successfully applied in the generation of the BMNG dataset. With little or no spatial dependencies involved, the required computations, specifically the model inversions for parameter estimation, can be parallelized very efficiently.

What has worked for the BMNG using MODIS data does not necessarily have to be applicable to other satellite data. NASA’s MODIS sensor offered well-calibrated data at a high temporal revisit frequency and the MODIS science team guaranteed that scene processing was carried out with state-of-the-art algorithms. The scene compositing employed for the BMNG project was therefore based on data that fulfilled very high technical and scientific standards.

In order to find out how Landsat and SPOT based global satellite composites could be generated, the following questions would need to be answered:

  • What kind of processing and compositing is applicable to the Landsat and SPOT satellite data (inventory of data sources)?
  • What kind of processing and compositing can be readily applied and yield good improvements (low hanging fruit)?
  • Which processing and compositing step would yield high improvements at a high investment (exceptionally sweet but high hanging fruit?)
  • Which scene processing has already been applied to Landsat and SPOT data (inventory of methods)?
  • Which scene compositing has already been applied to Landsat and SPOT data (inventory of methods)?
  • Which scientific and technical methods are available and have been successful (literature review)?
  • What are the most wanted user requirements (prioritize tasks)?
  • Which are the geographic areas that need most attention (prioritize region)?
  • Has anything similar been done at the MODIS, SPOT, Landsat science team (harvest knowledge, avoid duplication)?

Based on such an “inventory” a strategy could then be generated for how to improve, what to improve and where to improve at what cost. Even a partial execution of scene processing and compositing could result in a substantial improvements of the Landsat and SPOT based satellite layer used in Google Maps.

References

R. Stöckli, E. Vermote, N. Saleous, R. Simmon, and D. Herring. True color earth data set includes seasonal dynamics. EOS, 87(5):49, 55, 2006.

R. Stöckli, T. Rutishauser, I. Baker, M. Liniger, and A. S. Denning. A global reanalysis of vegetation phenology. J. Geophys. Res. – Biogeosciences, 116(G03020), 2011. doi: 10.1029/2010JG001545.

F. Li, D. L. B. Jupp, S. Reddy, L. Lymburner, N. Mueller, P. Tan, and A. Islam. An evaluation of the use of atmospheric and brdf correction to standardize landsat data. Ieee Journal of Selected Topics In Applied Earth Observations and Remote Sensing, 3(3):257–270, Sept. 2010. doi: 10.1109/JSTARS.2010.2042281.

C. de Vries, T. Danaher, R. Denham, P. Scarth, and S. Phinn. An operational radiometric calibration procedure for the landsat sensors based on pseudo-invariant target sites. Remote Sensing of Environment, 107(3):414–429, Apr. 2007. doi: 10.1016/j.rse.2006.09.019.

E. F. Vermote, N. Z. E. Saleous, and C. O. Justice. Atmospheric correction of MODIS data in the visible to middle infrared: first results. Remote Sens. Environ., 83:97–111, 2002.

J. Masek, E. Vermote, N. Saleous, R. Wolfe, F. Hall, K. Huemmrich, F. Gao, J. Kutler, and T. Lim. A landsat surface reflectance dataset for north america, 1990-2000. Ieee Geoscience and Remote Sensing Letters, 3 (1):68–72, Jan. 2006. doi: 10.1109/LGRS.2005.857030.

K. V. Khlopenkov and A. P. Trishchenko. Sparc: New cloud, snow, and cloud shadow detection scheme for historical 1-km avhhr data over canada. J Atmos Oceanic Tech, 24(3):322–343, Jan 2007. doi: 10.1175/JTECH1987.1.

 

Feb 24 2012

Art from Space

I am working on a solar position and orbit predictor application for the International Space Station that will serve as planning tool for a new art project of Christian Waldvogel.

For updates visit his website http://www.waldvogel.com

Jan 01 2012

Satellite-based planning of Solar Energy Applications

My tasks at MeteoSwiss include the analyses of the spatial and temporal variability of the surface solar irradiance with special emphasis on the complex Alpine terrain and the diverse interactions of horizon, snow cover and cloudiness in this terrain. One major result of this work is a satellite-based climatology of solar irradiance including its radiation components derived from Meteosat Second Generation SEVIRI data back to 2004.

The potential yield of solar irradiance (kWh/m2) for Switzerland fo rthe period 2004-2009. The map was derived from Meteosat Second Generation satellite data with special emphasis on the complex interaction of topography, snow cover and cloudiness.

The data set can be used to evaluate the suitability of a photovoltaic or thermal power plant or for calculating the energy consumption of a building. The data set currently covers the area of Switzerland at a spatial resolution of around 1-2 km and a temporal resolution of 15 minutes. It can be extended to any location and region over Europe and Africa upon request, and it can be extended in time by unifying it with our long term climate data record based on the Meteosat First Generation satellite.

More information including a point of contact for ordering the data can be found on the MeteoSwiss Solar Energy website.

Aug 25 2011

Global Re-Analysis of Vegetation

Our previous work on the remote-sensing based data assimilation framework has been extended to regional and global scales. It employs a subgrid‐scale representation of plant functional types (PFTs) and elevation classes to generate a globally applicable phenological parameter set. We are able to predict (or hindcast) a 50 year long (1960–2009) daily 1° × 1° global phenology climate data record with a mean FPAR and LAI prediction error of 0.065 (−) and 0.34 (m^2 m^−2).

Mean annual leaf area index (LAI) from our satellite-model reanalysis project

The data set as well as the underlying data assimilation and prediction code with all parameters are available publicly as open source:

http://phenoanalysis.sourceforge.net

R. Stockli, T. Rutishauser, I. Baker, M. Liniger, and A. S. Denning. A global reanalysis of vegetation phenology. J. Geophys. Res. – Biogeo- sciences, 116(G03020), 2011. doi: 10.1029/2010JG001545.

Nov 26 2008

Remote Sensing Data Assimilation

We have developed a computational framework for data assimilation of Fraction of Photosynthetically Active Radiation absorbed by vegetation (FPAR) and Leaf Area Index (LAI) from the MODerate Resolution Imaging Spectroradiometer (MODIS) to constrain empirical temperature, light, moisture and structural vegetation parameters in a prognostic phenology model.

Model-simulated FPAR (red curve) and LAI (blue curve) with a-posteriori parameters after the data assimilation compared to MODIS-based states (grey and black)

 

It uses the Ensemble Kalman Filter (EnKF) after Evensen [2003] employing around 1000 ensemble members as a sequential data assimilation model to assimilate satellite-derived vegetation states into the phenology model. The data assimilation is very effective in constraining model parameters which then yields a better a-posteriori prediction of vegetation states.

The method is firstly suitable to derive gap-free climatologies minimizing the errors of incomplete satellite retrievals, and it can be applied to parameterize prognostic vegetation models for use in prediction of vegetation states beyond the period of satellite coverage.

All code and related datasets are available as open source to the public:

http://phenoanalysis.sourceforge.net

R. Stockli, T. Rutishauser, D. Dragoni, J. O’Keefe, P. E. Thornton, M. Jolly, L. Lu, and A. S. Denning. Remote sens- ing data assimilation for a prognostic phenology model. Journal of Geophysical Research-Biogeosciences, 113(G4), Nov. 2008. doi: 10.1029/2008JG000781.

 

 

 

 

 

 

 

Jan 01 2007

Blue Marble images on the IPCC 4th assessment report (2007)

The Blue Marble western and eastern hemispheres by Reto Stöckli (NASA Earth Observatory) are displayed to the left as printed on the front cover of the IPCC (Intergovernmental Panel on Climate Change) 4th assessment WGI report “The Physical Science Basis”.

 

These images integrate land, ocean, sea ice and clouds into a visual representation of the earth’s climate system. They are based on space-borne earth observation data from NASA’s MODIS (MODerate resolution Imaging Spectroradiometer) sensor aboard the TERRA and AQUA satellites.

The visualizations of both hemispheres were created using the Blue Marble Next Generation (BMNG, 2005). The BMNG resolves 500 m per pixel and is the successor of the Blue Marble (2002) project providing a set of layers covering the earth’s climate system. Both datasets are still the most detailed continuous and seamless true-color images of the Earth’s surface ever produced.

I hope that you also feel inspired by these images and find them useful. They exemplify the comprehensive global observing capabilities of today’s state-of-the-art satellite sensors. They also display the beauty and diversity of the Earth as a combined and interrelated system.

Visual perception of Earth system dynamics can foster interest to further explore the underlying science. Furthermore such visualizations can help to increase public understanding and awareness of causes and effects of changes in Earth’s climate system.

The images and underlying datasets are provided at no cost to the public and there are no restrictions for commercial purposes. You’re welcome to send complimentary copies of products where you have applied these images. The high resolution  versions can be found here.

Citation: “Blue Marble Imagery by Reto Stöckli (NASA Earth Observatory) http://earthobservatory.nasa.gov “

Nov 27 2006

The European Heat wave of 2003 as seen from MODIS

Europe was experiencing a historic heat wave during the summer 2003. Compared to the long term climatological mean, temperatures in July 2003 were sizzling. Figure 1 below shows the differences in day time land surface temperatures of 2003 to the ones collected in 2000, 2001, 2002 and 2004 by the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Terra satellite.

Figure: The visualization displays TERRA MODIS (MODerate resolution Imaging Spectroradiometer) derived land surface temperature data of 1km spatial resolution (Click on the image to get the high resolution TIFF file). The difference in land surface temperature is calculated by subtracting the average of all cloud free data during 2000, 2001, 2002 and 2004 from the ones in measured in 2003, covering the date range of July 20 – August 20. (Cite this image as: Image by Reto Stöckli, Robert Simmon and David Herring, NASA Earth Observatory, based on data from the MODIS land team).

Image story

A blanket of deep red across southern and eastern France (left of image center) shows where radiative temperatures were 10 degrees Celsius (18 degrees Fahrenheit) hotter in summer 2003 than in the other years. White areas show where temperatures were similar, and blue shows where temperatures were cooler in 2003 than in 2000,2001,2002 and 2004.

Even the Alps, which arc across southeastern France, Switzerland, Austria, and northern Italy (just below image center), were very warm this year. Glaciers were melting rapidly and swelling rivers and lakes to dangerously high levels. Climbers had to be evacuated from Switzerland’s famous Matterhorn after melting triggered the collapse of a rock face. The popular climbing destination had been closed while geologists assess the possibility of further collapses.

The heat wave stretched northward all the way to the United Kingdom, particularly southern England (bottom of island) and Scotland (top of island). In London, trains were shut down over fears that tracks would buckle in the heat, while in Scotland the high temperatures combined with falling water levels in rivers and streams are threatening the spawning and survival of salmon. Throughout France, Spain, Portugal, and Italy, the intense heat and dry conditions sparked devastating forest fires.

Download

Please find the highest resolution version of the 2003 LST, LAI and FPAR anomaly here.

References

Schär, C., P.L. Vidale, D. Lüthi, C. Frei, C. Häberli, M. Liniger and C. Appenzeller, 2004: The role of increasing temperature variability in European summer heat waves. Nature ,doi:10.1038/nature02300

Black, E., Blackburn, M., Harrison, G., Hoskins, B.J. and Methven, J. 2004. Factors contributing to the summer 2003 European heatwave. Weather, 59 , 217-223

R. Allen, Richard Lord Q.C., 2004: Climate change: the spectre of liability. Nature, 432, 551-552 (includes the above visualization).

Links

Jan 01 2006

Terra satellite launch & deploy (Remake from 2006)

For Terra’s 5th anniversary I have created a remake of the original launch & deploy 3D animation: