Atmospheric Science Data Center; Link to Home Page.

CERES Aqua Edition2A SSF
Data Quality Summary

Surface Fluxes - Accuracy and Validation

One of the principal objectives for the CERES data products is to provide improved estimates of surface fluxes (net and downward) for shortwave (SW) and longwave (LW) radiation. To achieve this objective, considerable effort has been focused upon obtaining consistent fluxes at the surface, within the atmosphere, and at the top of the atmosphere, all of which are produced as part of the CERES CRS data product using the SSF as input data. Validated CRS surface fluxes, however, are just now becoming available. Thus, a second effort was initiated which uses much simpler algorithms either:

Consequently, these simpler SSF surface flux parameterizations are more comparable to results used in past analyses of surface radiation data sets based on ERBE or geostationary data. In general, however, they are not expected to be as precise as the CERES CRS surface fluxes, though they do represent an independent method to get to the more difficult surface flux estimates.

The CERES SSF data product provides 4 surface flux algorithm results:

  1. Shortwave Flux Model A, Daytime only, Clear-sky only
  2. Shortwave Flux Model B, Daytime only, Clear and All-sky
  3. Longwave Flux Model A, Daytime and Nighttime, Clear-sky only
  4. Longwave Flux Model B, Daytime and Nighttime, Clear and All-sky

For Aqua surface fluxes, clear-sky conditions are defined for CERES footprints with an imager determined cloud cover percentage less than 0.1%. Thus, to be consistent with the angular distribution models, our validation effort has also taken clear-sky to be defined as a CERES footprint with an imager determined cloud cover percentage less than 0.1%. The SSF surface fluxes are being validated using both theoretical analyses and simultaneous matching of satellite data to a range of surface sites. Preliminary results are discussed in the sections which follow.

The CERES SSF surface flux estimates are derived using the Aqua data starting with July 2002 and running through March 2005. The coincident surface fluxes are nominally gathered from the Atmospheric Radiation Measurement (ARM) networks which include the Southern Great Plains (SGP), Tropical Western Pacific (TWP) and North Slope Alaska (NSA) sites, the Global Monitoring Division, Earth System Research Laboratory (GMD/ESRL) [formerly known as the Climate Modeling and Diagnostic Laboratory (CMDL)] network, the Baseline Surface Radiation Network (BSRN) and the Surface Radiation (SURFRAD) network. Unless otherwise noted, surface site fluxes are 1 minute averages and are compared to the CERES footprint which includes the surface site.

The validation results reported in this data quality statement compare Aqua Edition 2A.

Clear-sky Shortwave Downward Flux Validation: Models A and B

For the shortwave, two models have been used to produce the surface fluxes. Both of these shortwave models are part of our validation effort; however, Model A currently produces fluxes only for clear-sky conditions while Model B produces fluxes for both clear and all-sky conditions. When the column ozone exceeds 500 DU, Model B net and downward SW surface flux values are not computed. Instead they are set to the CERES fill value.

Validation studies of the TRMM Edition 2B surface fluxes demonstrated that shortwave Model A overestimated surface insolation at the ARM Central Facility by approximately 30 W m-2. Considering that such biases were not observed for pristine high-latitude surface sites, it was hypothesized that the effects of aerosols could be the cause. Thus, an aerosol correction factor based on the Masuda et al. (1995) method and using the GFDL climatological aerosols (Haywood et al., 1999) was incorporated into shortwave Model A. The use of the Masuda et al. (1995) method with the GFDL climatological aerosols was shown earlier to produce a significant improvement to shortwave Model A. Further improvements in the estimation of the contribution of aerosols have been achieved by replacing the GFDL climatological aerosol product with a five year climatology of the aerosols based upon the Model of Atmospheric Transport and Chemistry (MATCH) aerosol product (Rasch et al., 1997 and Collins et al., 2001) developed by the National Center for Atmospheric Research (NCAR). The MATCH climatological aerosol data product was incorporated into the CERES SSF Model A processing with Aqua Edition 2A. Concurrently, the simple aerosol maps used by Model B have been replaced by the climatological aerosol maps based upon the MATCH and OPAC (Optical Properties of Aerosols and Clouds) data products. For the OPAC data the reader should refer to Hess et al. (1998). Model B has further been improved by replacing the monthly climatological ERBE clear-sky TOA albedos with the corresponding values derived from 46 months of Terra data.

In contrast to earlier versions of the SSF Data Quality Summaries, Terra 2B, Aqua 1B and later versions (including Aqua 2A) group together surface sites with similar characteristics: Continental, Desert, Coastal, Island and Polar, rather than grouping together surface sites from a single source. This has allowed for a better interpretation of those surface and climatological types that have proven to be the most problematic.

The following tables for the clear-sky cases compare shortwave Models A and B to the surface measured fluxes. Biases are defined to be CERES derived surface fluxes minus surface measured fluxes. Substituting the MATCH climatological aerosol data for the corresponding GFDL climatological aerosol data in Model A resulted in a modest change, of order -5 W m-2, between the results provided within the Aqua 1B and Aqua 2A processing. In contrast, substituting the MATCH climatological aerosol data for the WCP-55 aerosols in Model B resulted in a substantial change, of order +40 W m-2, between the results provided within the Aqua 1B and Aqua 2A processing. Preliminary studies indicated that the changes made to Models A and B should produce modest changes to the flux, similar to those actually seen in the Model A results. Thus, the significantly larger flux changes seen in the Model B results must be considered suspect. We are currently investigating these unanticipated results, and expect to update Model B before the next CERES edition.

Downward Shortwave Model A Comparisons, Clear-Sky, 1 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 1680 -12.80 W m-2
(-1.82%)
28.51 W m-2
(4.06%)
25.45 W m-2
(3.62%)
Desert 635 -26.03 W m-2
(-3.13%)
50.50 W m-2
(6.07%)
40.26 W m-2
(4.84%)
Coastal 164 -3.48 W m-2
(-0.52%)
22.98 W m-2
(3.46%)
22.60 W m-2
(3.40%)
Island 53 35.69 W m-2
(4.11%)
124.30 W m-2
(14.32%)
71.61 W m-2
(8.25%)
Polar 323 -44.73 W m-2
(-11.12%)
52.05 W m-2
(12.94%)
24.94 W m-2
(6.20%)

Downward Shortwave Model B Comparisons, Clear-Sky, 1 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 1680 16.93 W m-2
(2.41%)
28.86 W m-2
(4.11%)
23.26 W m-2
(3.31%)
Desert 635 23.01 W m-2
(2.77%)
47.46 W m-2
(5.71%)
41.47 W m-2
(4.99%)
Coastal 164 11.36 W m-2
(1.71%)
28.42 W m-2
(4.28%)
26.01 W m-2
(3.92%)
Island 53 41.30 W m-2
(4.76%)
125.71 W m-2
(14.48%)
68.52 W m-2
(7.89%)
Polar 323 1.87 W m-2
(0.46%)
16.18 W m-2
(4.02%)
16.06 W m-2
(3.99%)

All-sky Shortwave Downward Flux Validation: Model B

Results are also presented for the all-sky Model B case. To reduce the considerable variance introduced by broken cloud fields, the surface data is averaged over the 60 minutes centered on the time of the satellite overpass. Note, the variance introduced by broken cloud fields is far greater than that introduced by the temporal averaging.

As with the clear-sky cases, substituting the MATCH climatological aerosol data for the WCP-55 aerosols in Model B resulted in a substantial flux change for most cases, of order +30 W m-2, between the results provided within the Aqua 1B and Aqua 2A processing. The notable exception was the Polar cases, which showed very little change to the fluxes, of order -5 W m-2. As with the clear-sky cases, preliminary studies of the algorithm changes made to Model B indicated that these changes should produce only modest flux changes. Thus, we consider the flux values calculated with Model B to be suspect. We are currently investigating these unanticipated results, and expect to update Model B before the next CERES edition.

Downward Shortwave Model B Comparisons, All-Sky, 60 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 12595 47.27 W m-2
(9.08%)
100.86 W m-2
(19.38%)
84.20 W m-2
(16.18%)
Desert 3035 39.32 W m-2
(5.26%)
93.21 W m-2
(12.48%)
77.89 W m-2
(10.43%)
Coastal 1888 45.80 W m-2
(9.00%)
86.79 W m-2
(17.06%)
65.09 W m-2
(12.79%)
Island 3298 74.44 W m-2
(12.01%)
144.07 W m-2
(23.24%)
109.48 W m-2
(17.66%)
Polar 8866 14.43 W m-2
(6.44%)
67.83 W m-2
(30.28%)
65.43 W m-2
(29.21%)

Clear-sky Longwave Downward Flux Validation: Model A

Longwave Model A uses CERES-derived window and non-window TOA fluxes as well as the meteorological profiles to obtain surface fluxes for clear sky conditions. Biases are defined to be CERES derived surface fluxes minus surface measured fluxes.

Downward Longwave Model A Comparisons, Clear-Sky, 1 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 5012 -4.48 W m-2
(-1.59%)
16.46 W m-2
(5.85%)
15.80 W m-2
(5.61%)
Desert 1634 -0.41 W m-2
(-0.13%)
24.81 W m-2
(7.90%)
22.80 W m-2
(7.26%)
Coastal 607 4.92 W m-2
(1.72%)
14.44 W m-2
(5.06%)
12.91 W m-2
(4.53%)
Island 138 -0.75 W m-2
(-0.20%)
12.01 W m-2
(3.18%)
11.96 W m-2
(3.17%)
Polar 899 -16.02 W m-2
(-14.30%)
19.67 W m-2
(17.56%)
11.04 W m-2
(9.85%)

Theoretical studies and validation studies employing data from Central Equatorial Pacific Experiment (CEPEX), reported by Inamdar and Ramanathan (1997), are consistent with our results. The parameterization over land surfaces was initially developed using a limited set of emissivity data available from IRIS measurements aboard NIMBUS 4 (Prabhakara and Dalu 1976). The current version of longwave Model A, however, was developed using the global emissivity maps developed by Wilber et al. (1999) and thus can be applied to the extra-tropics as well as to the tropics. Other possible sources of errors include:

  1. Specification of the true radiating temperature (especially land surfaces);

  2. Errors in scene identification;

  3. Emissions from aerosols in the boundary layer. For instance, Inamdar and Ramanathan (1997) noted that sensitivity studies had revealed that thick haze in the boundary layer (visibilities less than 15 km) could increase the downward emissions by about 3 - 5 W m-2.

All-sky Longwave Downward Flux Validation: Model B

Longwave Model B uses the meteorological profiles and CERES MODIS-derived cloud properties, but not the CERES-derived TOA fluxes, to obtain surface fluxes for clear and all-sky conditions. Biases are defined to be CERES derived surface fluxes minus surface measured fluxes.

Model B has recently been modified to handle clouds more precisely for cases where the cloud base pressures have not been specified over high altitude areas, such as Tibet. Although important for some cases, this modification has no impact on the results provided in this document since none of our validation sites are located at such high altitudes.

Downward Longwave Model B Comparisons, Clear-Sky, 1 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 5012 -6.93 W m-2
(-2.46%)
16.97 W m-2
(6.03%)
15.38 W m-2
(5.46%)
Desert 1634 -5.15 W m-2
(-1.64%)
23.40 W m-2
(7.45%)
21.07 W m-2
(6.71%)
Coastal 607 -0.15 W m-2
(-0.05%)
13.51 W m-2
(4.74%)
13.23 W m-2
(4.64%)
Island 138 -0.77 W m-2
(-0.20%)
13.91 W m-2
(3.68%)
13.76 W m-2
(3.65%)
Polar 899 -8.83 W m-2
(-7.88%)
14.14 W m-2
(12.62%)
11.05 W m-2
(9.86%)

Downward Longwave Model B Comparisons, All-Sky, 1 min data
Scene Type # of Points Mean Bias RMS Difference Standard Deviation
Continental 26442 -4.12 W m-2
(-1.33%)
21.70 W m-2
(6.98%)
21.30 W m-2
(6.85%)
Desert 6034 7.48 W m-2
(2.25%)
30.71 W m-2
(9.23%)
27.14 W m-2
(8.16%)
Coastal 3971 2.10 W m-2
(0.62%)
18.57 W m-2
(5.47%)
18.29 W m-2
(5.38%)
Island 6872 5.57 W m-2
(1.36%)
15.85 W m-2
(3.87%)
14.82 W m-2
(3.62%)
Polar 18820 -6.48 W m-2
(-2.88%)
26.94 W m-2
(11.99%)
24.89 W m-2
(11.08%)

Return to Quality Summary for: SSF Aqua Edition2A
CERES Access Data Table | ASDC Home Page | Questions/Feedback