Th`ese Marouan BOUALI - Sites personnels de TELECOM ParisTech
Th`ese Marouan BOUALI - Sites personnels de TELECOM ParisTech
Th`ese Marouan BOUALI - Sites personnels de TELECOM ParisTech
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
École Doctorale<br />
d’Informatique,<br />
Télécommunications<br />
et Électronique <strong>de</strong> Paris<br />
Thèse<br />
présentée pour obtenir le gra<strong>de</strong> <strong>de</strong> docteur<br />
<strong>de</strong> l’Ecole Nationale Supérieure <strong>de</strong>s Télécommunications<br />
Spécialité : Signal et Images<br />
<strong>Marouan</strong> <strong>BOUALI</strong><br />
Destriping data from multi<strong>de</strong>tector imaging<br />
spectrometers : a study on the MODIS<br />
instrument<br />
Soutenue le 36 avril 2040 <strong>de</strong>vant le jury composé <strong>de</strong><br />
Bidule<br />
Truc Muche<br />
Machin<br />
Chose<br />
Tartampion<br />
Patrice Henry<br />
Nozha Boujemaa<br />
Saïd Ladjal<br />
Prési<strong>de</strong>nt<br />
Rapporteurs<br />
Examinateurs<br />
Directeurs <strong>de</strong> thèse
3<br />
« Rajouter une citation ici. »<br />
Auteur – Oeuvre
5<br />
Résumé<br />
Nou abordons dans cette thèse le problème <strong>de</strong> ...<br />
Abstract<br />
In this thesis, we tackle the issue of ...
7<br />
Table <strong>de</strong>s matières<br />
1 Introduction 11<br />
2 Remote Sensing with MODIS 15<br />
2.1 The evolution of remote sensing . . . . . . . . . . . . . . . . . . . . . . . . . 15<br />
2.2 Applications of satellite imagery . . . . . . . . . . . . . . . . . . . . . . . . 16<br />
2.2.1 Monitoring land changes . . . . . . . . . . . . . . . . . . . . . . . . . 16<br />
2.2.2 Studying the atmosphere dynamics . . . . . . . . . . . . . . . . . . . 17<br />
2.2.3 Cryosphere and climate change . . . . . . . . . . . . . . . . . . . . . 19<br />
2.2.4 Recent exemples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19<br />
2.2.4.1 The Eyjafjallajökull . . . . . . . . . . . . . . . . . . . . . . 20<br />
2.2.4.2 Deepwater Horizon oil spill . . . . . . . . . . . . . . . . . . 20<br />
2.3 The importance of oceans in the Earth system . . . . . . . . . . . . . . . . 21<br />
2.3.1 The ocean’s carbon cyle . . . . . . . . . . . . . . . . . . . . . . . . . 21<br />
2.3.2 Phytoplancton and ocean color . . . . . . . . . . . . . . . . . . . . . 22<br />
2.4 Constraints in remote sensing . . . . . . . . . . . . . . . . . . . . . . . . . . 23<br />
2.4.1 Sensor Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23<br />
2.4.2 Atmospheric correction . . . . . . . . . . . . . . . . . . . . . . . . . 25<br />
2.4.3 Sun glint . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25<br />
2.4.4 Cloud coverage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27<br />
2.5 The Mo<strong>de</strong>rate Resolution Imaging Spectroradiometer (MODIS) . . . . . . . 28<br />
2.5.1 Context and objectives . . . . . . . . . . . . . . . . . . . . . . . . . . 28<br />
2.5.2 Technical specifications . . . . . . . . . . . . . . . . . . . . . . . . . 29<br />
2.5.3 Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29<br />
2.5.4 MODIS products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33<br />
2.5.5 Stripe noise on MODIS . . . . . . . . . . . . . . . . . . . . . . . . . 33<br />
3 Standard <strong>de</strong>striping techniques and application to MODIS 39<br />
3.1 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39<br />
3.2 Moment Matching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40<br />
3.3 Histogram Matching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42<br />
3.4 Overlapping Field-of-View Method . . . . . . . . . . . . . . . . . . . . . . . 48
8 TABLE DES MATIÈRES<br />
3.5 Frequency filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51<br />
3.5.1 Spectral Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51<br />
3.5.2 Band-pass filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52<br />
3.6 Haralick Facet filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55<br />
3.7 Multiresolution approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57<br />
3.7.1 Limitations of fourier transform . . . . . . . . . . . . . . . . . . . . . 57<br />
3.7.2 Multiresolution analysis . . . . . . . . . . . . . . . . . . . . . . . . . 58<br />
3.7.3 Wavelet basis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58<br />
3.7.4 Filter banks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59<br />
3.7.5 2D wavelet basis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60<br />
3.7.6 Destriping with wavelet coefficient thresholding . . . . . . . . . . . . 62<br />
3.8 Assessing <strong>de</strong>striping quality . . . . . . . . . . . . . . . . . . . . . . . . . . . 63<br />
3.8.1 Noise Reduction Ratio and Image Distortion . . . . . . . . . . . . . 65<br />
3.8.2 Radiometric Improvement Factors . . . . . . . . . . . . . . . . . . . 66<br />
3.8.3 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67<br />
4 A Variational approach for the <strong>de</strong>striping issue 73<br />
4.1 PDEs and variational methods in image processing . . . . . . . . . . . . . . 73<br />
4.2 Rudin, Osher and Fatemi Mo<strong>de</strong>l . . . . . . . . . . . . . . . . . . . . . . . . 76<br />
4.3 Striping as a texture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82<br />
4.3.1 Yves Meyer’s mo<strong>de</strong>l for oscillatory functions . . . . . . . . . . . . . . 83<br />
4.3.2 Vese-Osher’s Mo<strong>de</strong>l . . . . . . . . . . . . . . . . . . . . . . . . . . . 84<br />
4.3.3 Osher-Solé-Vese’s Mo<strong>de</strong>l . . . . . . . . . . . . . . . . . . . . . . . . . 86<br />
4.3.4 Other u + v mo<strong>de</strong>ls . . . . . . . . . . . . . . . . . . . . . . . . . . . 87<br />
4.3.5 Experimental results and discussion . . . . . . . . . . . . . . . . . . 88<br />
4.4 Destriping via gradient field integration . . . . . . . . . . . . . . . . . . . . 91<br />
4.5 A unidirectional variational <strong>de</strong>striping mo<strong>de</strong>l . . . . . . . . . . . . . . . . . 94<br />
4.6 Optimal regularization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97<br />
4.6.1 Tadmor-Nezzar-Vese (TNV) hierarchical <strong>de</strong>composition . . . . . . . 99<br />
4.6.2 Osher et al. iterative regularization method . . . . . . . . . . . . . . 100<br />
4.6.3 Stopping criteria . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102<br />
4.6.4 Experimental results and discussion . . . . . . . . . . . . . . . . . . 103<br />
5 Application : Restoration of Aqua MODIS Band 6 111<br />
5.1 Context . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111<br />
5.2 Existing restoration techniques . . . . . . . . . . . . . . . . . . . . . . . . . 113<br />
5.2.1 Global interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . 113<br />
5.2.2 Local interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114<br />
5.3 Proposed approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114<br />
5.3.1 Spectral similarity . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115<br />
5.3.1.1 Spectral Correlation Measure . . . . . . . . . . . . . . . . . 115<br />
5.3.1.2 Spectral Angle Measure . . . . . . . . . . . . . . . . . . . . 116
9<br />
5.3.1.3 Euclidian Distance Measure . . . . . . . . . . . . . . . . . . 116<br />
5.3.1.4 Spectral Information Divergence Measure . . . . . . . . . . 116<br />
5.3.2 Spectral inpainting . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116<br />
5.4 Experimental results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119<br />
5.4.1 Validation of spectral inpainting using NDSI measurements . . . . . 119<br />
5.4.2 Assessing the impact of stripe noise . . . . . . . . . . . . . . . . . . 122<br />
Conclusion 126<br />
Bibliographie 135
10 TABLE DES MATIÈRES
11<br />
Chapitre 1<br />
Introduction<br />
Over the years, climate change and its impact on life have become an alarming question<br />
for science to answer. Historical weather records show evi<strong>de</strong>nce of cyclic brutal climate<br />
fluctuations occuring since the formation of Earth and due to volcanic eruptions, meteorite<br />
impacts, solar activity, plate tectonic movements and <strong>de</strong>viations in the Earth rotational<br />
axis. Today, human industrial activities constitues an extra variable that interfers with<br />
land, ocean and atmosphere natural processes.<br />
To un<strong>de</strong>rstand, quantifie and mo<strong>de</strong>l the dynamic interactions between the earth system<br />
components, scientists have to relie on information available over the entire globe with a<br />
satisfactory time frequency. These requirements can only be satisfied by the use of satellite<br />
sensors orbiting the earth at a high altitu<strong>de</strong>s. Multiyear to multi<strong>de</strong>cadal data sets collected<br />
in the ultraviolet, visible, infrared and microwave portions of the energy spectrum, provi<strong>de</strong><br />
valuable information for researchers to interconnect the Earth’s main geophysical variables.<br />
Nevertheless, the complexity of physical processes involved in global change imposes<br />
data quality standards that satellite instruments fail to meet, <strong>de</strong>spite the continuous technological<br />
innovations in imaging sensors <strong>de</strong>sign. In<strong>de</strong>ed, a given geophysical variable (chlorophyll<br />
concentration for exemple) is <strong>de</strong>termined from raw satellite measurements subsequently<br />
used as input for geolocation, radiometric calibration, atmospheric correction, sun<br />
glint correction, bio-optical mo<strong>de</strong>ls, vicarious calibration, temporal bining...and the list is<br />
certainly not exaustive. This long processing chain makes the estimation of any geophysical<br />
parameter extremely sensitive to initial quantity acquired by satellite instruments.<br />
In simple words, small errors in the instrument response will irreversibly compromise the<br />
accuracy of high level products.<br />
Given the crucial role of oceans in global climate change and the stringent requirements<br />
associated with ocean color remote sensing, space agencies have given high priority<br />
to instrument <strong>de</strong>sign and pre-launch/on-orbit calibration procedures. Despite this effort,<br />
many issues related to image quality can still be observed as visual artifacts and require<br />
further processing. These typically inclu<strong>de</strong> straylight, optical leaks, gaussian noise, speckle<br />
noise (for active sensors), blurring, <strong>de</strong>ad pixels, line dropouts..
12 1. Introduction<br />
A common issue for Earth observing instruments, known as striping effect have persisted<br />
for more then 30 years, i.e, since the launch of Landsat 1. It was since reported on<br />
many imaging spectrometers :<br />
- Landsat Multi Spectral Scanner (MSS) and Thematic Mapper (TM)<br />
- Geostationary Operational Environmental Satellites (GOES)<br />
- Advanced Very High Resolution Radiometer (AVHRR)<br />
- Mo<strong>de</strong>rate Resolution Imaging Spectrometer (MODIS)<br />
- Compact High Resolution Imaging Spectrometer (CHRIS)<br />
- HYPERION<br />
- MEdium Resolution Imaging Spectrometer (MERIS)<br />
- Compact Reconnaissance Imaging Spectrometer for Mars (CRISM)<br />
- GLobal Imager (GLI)<br />
- Advanced Land Imager (ALI)<br />
The previous list inlu<strong>de</strong>s both whiskbroom and pushbroom sensors which are the two<br />
main techniques used for Earth observation.<br />
Whiskbroom instruments, also known as cross-track scanners acquire a series of lines in<br />
the direction perpendicular to the satellite orbital motion. A scan sweep from one si<strong>de</strong> of<br />
the swath to the other is ensured by a continuously rotating mirror. A limited set of <strong>de</strong>tectors,<br />
sensitive to spectific wavelenghts, then captures the radiation emitted or reflected<br />
by the Earth before its convertion into digital numbers.<br />
Pushbroom sensors (along-track scanners) also exploit the orbital motion of the platform<br />
to generate the second dimension of the acquired signal. They differ from the whiskbroom<br />
<strong>de</strong>sign in that the rotating mirror is replaced by a linear array of numerous <strong>de</strong>tectors that<br />
capture simultaneously each pixel of a single scan line.<br />
In both acquisition principles, images are formed by enterlacing or concatanating scan<br />
lines, acquired separately by different <strong>de</strong>tectors. Consequently, the imperfect calibration<br />
of individual <strong>de</strong>tectors induces a sharp pattern across or along the scanning direction that<br />
compromises both visual interpretation and quantitative analysis. More specifically, striping<br />
is disturbingly visible over low-radiance homogeneous regions, which often coinci<strong>de</strong><br />
with oceanographic areas. In fact, the impact of stripe noise on satellite <strong>de</strong>rived geophysical<br />
variables, including ocean color products, is increasingly attracting the interest of<br />
remote sensing research groups.<br />
Although an extensive litterature has tackled the striping issue, existing techniques are<br />
often not able to satisfie the requirements imposed by several remote sensing applications<br />
namely, complete stripe removal without signal distortion or additional post-processing<br />
artifacts.<br />
The goal of this thesis is to analyse the limitations of standard <strong>de</strong>striping methods<br />
and to explore the issue of stripe noise removal using variational mo<strong>de</strong>ls. We illustrate the
13<br />
results of our work using data from NASA’s MODIS instrument.<br />
Our focus on the MODIS sensor is justified by 1) the complexity and amplitu<strong>de</strong> of<br />
stripe noise visible on its emissive bands and 2) the importance of MODIS data in variety<br />
of remote sensing disciplines<br />
This thesis is organised as follows :<br />
Chapter 1 briefly exposes main aspects and constraints of ocean color remote sensing.<br />
This chapter also <strong>de</strong>scribes the Mo<strong>de</strong>rate Resolution Imaging Spectrometer (MODIS) and<br />
characterises the striping effect on MODIS products.<br />
Chapter 2 constitutes a non exaustive state-of-the-art of the <strong>de</strong>striping litterature. Several<br />
approaches are <strong>de</strong>scribed and illustrated on MODIS data. Experimental results and<br />
comparative study are presented at the end of the chapter. The limitations of existing<br />
techniques are analysed and used as a basis to <strong>de</strong>fine the requirements of an optimal<br />
<strong>de</strong>striping.<br />
Chapter 3 is the main contribution of this work. After an overview of variational methods<br />
for image processing applications, we explore Rudin, Osher and Fatemi total variation<br />
mo<strong>de</strong>l. Yves Meyers variational mo<strong>de</strong>ls for oscillatory paterns, are used in an attempt to<br />
extract stripe noise as a texture component. Our exploration of the striping issue from a<br />
variational angle eventually comes down to a unidirectional variation based regularizing<br />
mo<strong>de</strong>l able to efficiently remove all the stripe noise without signal distortion.<br />
Chapter 4 present an application that beneficits from the <strong>de</strong>veloped <strong>de</strong>striping technique.<br />
We propose a new approache to restore Aqua MODIS band 6 based on non-local filters<br />
and spectral similarity.
14 1. Introduction
15<br />
Chapitre 2<br />
Remote Sensing with MODIS<br />
2.1 The evolution of remote sensing<br />
Look far and wi<strong>de</strong>... This could well have been one of the un<strong>de</strong>rlying rules used by<br />
evolution to produce life as we can see it all over the Earth. From the multiple eyes of<br />
arachnophibia species to the mobile stereoscopic eyes of the chameleon, nature offers a<br />
variety of elegant examples. The very origin of hominid bipedism have been investigated<br />
by many evolutionnary scientists and attributed to a survival need. The ability to stand<br />
on two feet in the hostile environment of prehistory, enabled early Homo-Sapiens to look<br />
beyond savanna’s high grasses and thus avoid any uncomfortable encounters.<br />
Jumping back to comtemporary times, the numerous satellites orbiting the earth can<br />
be also perceived as the result of a long-term survival instinct. Remote sensing aims at<br />
measuring information and <strong>de</strong>termining specific properties of an object or phenomenon<br />
without direct physical contact. Today, this term commonly refers to the set of techniques<br />
used to <strong>de</strong>rive geophysical variables of the Earth (or other planets, stars, galaxies...).<br />
The <strong>de</strong>velopment of remote sensing is a direct consequence of the technological advances<br />
ma<strong>de</strong> in aviation from the begining of twentieth century. The first and second world war<br />
triggered an interest in aviation strong enough to attract heavy investments from most of<br />
the countries involved in war. Planes were not only used as a fast transportation vehicule,<br />
but were also consi<strong>de</strong>red a strategic advantage for their ability to monitor simultaneously<br />
wi<strong>de</strong> spatial areas. The invasion of Normandie is a good illustration of how planes were<br />
put to contribution. Aerial photographes were taken and analysed to establish appropriate<br />
landing surfaces and <strong>de</strong>termine the <strong>de</strong>pth and state of coastal waters. More significantly,<br />
infrared filters were already inclu<strong>de</strong>d in the primitive imaging <strong>de</strong>vices to distinguish natural<br />
vegetation from enemy camouflages. The following steps towards mo<strong>de</strong>rn remote sensing<br />
were achieved as consecutive technological intimidation attempts between USA and USSR<br />
during the cold war, leading to a brutal race to space ; Spoutnik and Explorer, quickly<br />
followed by the creation of NASA, the first men on the moon and the first habited spatial<br />
station (Saliout-1).
16 2. Remote Sensing with MODIS<br />
In 1970, inspired by spatial photographs taken during Mercury and Gemini’s missions,<br />
and motivated by the possibility to monitor agriculture crop yelds, NASA launched<br />
Landsat 1, the first satellite aiming at observing the earth surface and providing data<br />
for scdientists from different disciplines. Following the success of the Landsat series ( 7<br />
sensors since 1972), today’s intense research in remote sensing technologies is motivated<br />
by <strong>de</strong>eper questions. Climate change and its potential disastrous impact on human life<br />
urges an improved un<strong>de</strong>rstanding of earth sciences, ranging from carbon cycle mo<strong>de</strong>lling<br />
to weather forecasting. Such achievements are stricly limited by the quality of data collected<br />
by satellite /aerial sensors and require a continous increase of spatial, temporal and<br />
spectral resolution.<br />
2.2 Applications of satellite imagery<br />
Satellite and airborne sensors provi<strong>de</strong> a continuous flow of data exploited in fields as<br />
diverse as telecommunications, agriculture, <strong>de</strong>forestation, geology, hydrology, oceanography,<br />
urban management and fire monitoring to cite a few. For its abilities to capture wi<strong>de</strong><br />
portions of the globe, satellite <strong>de</strong>rived data offers a high potential for the surveillance of<br />
both local and global changes occuring in the Earth main systems.<br />
2.2.1 Monitoring land changes<br />
Among many human-induced activites, <strong>de</strong>forestation is highly responsible for both<br />
weather and climate change. Forests play a crucial role in the climate stability as they<br />
absorb and trap large quantities of carbon dioxi<strong>de</strong> (CO2) present in the atmopshere. The<br />
massive <strong>de</strong>struction of forests for urbanization and agricultural <strong>de</strong>velopment, inevitably<br />
releases in the atmopshere all the CO2 and other greenhouse gazes stored in trees for<br />
<strong>de</strong>ca<strong>de</strong>s. Assessing the amount and rate of carbon emissions from <strong>de</strong>forestation or other<br />
activities, remotely sensed data can be used to monitor primary variables of the Earth<br />
land surface such as the spectral reflectance, albedo and temperature. In addition, higher<br />
or<strong>de</strong>r variables in the form of vegetation indices can provi<strong>de</strong> valuable information on land<br />
change. A well-known variable is the Normalized Difference Vegetation In<strong>de</strong>x (NDVI)<br />
[Rouse et al., 1973], <strong>de</strong>fined as the ratio between the difference and the sum of reflectances<br />
in the visible (red) and near-infrared spectral bands :<br />
NDVI = ρ NIR − ρ Red<br />
ρ NIR + ρ Red<br />
(2.1)<br />
A major disadvantage of he NDVI in<strong>de</strong>x is that it tends to saturate over <strong>de</strong>nse vegetation<br />
and is highly <strong>de</strong>pen<strong>de</strong>nt on the background soil composition. In the presence of high<br />
biomass, the Enhanced Vegetation In<strong>de</strong>x (EVI) [Huete, 2002] provi<strong>de</strong>s an optimized vegetation<br />
signal able to capture high variability. and minimizes the influence of atmospheric
17<br />
Figure 2.1 – Deforestation in Brazil, in the region of Mato Grosso, monitored using the<br />
Normalized Difference Vegetation In<strong>de</strong>x (NDVI) (TL) RGB image from Terra MODIS<br />
captured on june 17, 2002 (TR) NDVI in<strong>de</strong>x (BL) RGB image from Terra MODIS<br />
captured in the same region on june 28 2006 (BR) NDVI in<strong>de</strong>x<br />
effects. The EVI is <strong>de</strong>fined as :<br />
EVI =<br />
2.5ρ NIR − ρ Red<br />
L + ρ NIR + C 1 ρ Red − C 2 ρ Blue<br />
(2.2)<br />
where the coefficient L corrects for canopy background, while C 1 and C 2 reduce the effects<br />
of aerosol. The values selected for the MODIS-EVI product are L = 1, C1 = 6 and<br />
C 2 =7.5.<br />
2.2.2 Studying the atmosphere dynamics<br />
The atmosphere <strong>de</strong>termines the amount of solar radiance actually reaching the Earth<br />
surface and therefore acts as a regulator of local and global climate processes. Depending
18 2. Remote Sensing with MODIS<br />
Figure 2.2 – A dust storm over the Red Sea, monitored using the Normalized Difference<br />
Dust In<strong>de</strong>x (NDDI) (Left) RGB image acquired by Aqua MODIS on May 13, 2005<br />
(Right) NDDI*<br />
on the nature and concentration of its components, the atmosphere can scatter and absorb<br />
a given percentage of the energy coming from the sun. In addition, the solar radiation<br />
reaching the Earth’s surface and reflected back to the atmosphere can be re-scatter or reabsorbed<br />
by the atmposhere. The equilibrium between incoming and outgoing energy is<br />
highly <strong>de</strong>pen<strong>de</strong>nt on the atmospheric characteritics in terms of clouds, water vapor and<br />
aerosols content. Clouds for exemple, tend to cool the Earth during the day by reflecting<br />
away incoming solar energy. At night, the presence of clouds blocks the outgoing energy<br />
and consequently warms the Earth. In addition to cloud <strong>de</strong>tection, satellite-based imagery<br />
is vital to measure the type and concentration of aerosols present in the atmosphere. Aerosols<br />
are microscopic particules abundant in <strong>de</strong>sert dust, volcanic ashes, fire smoke, sea<br />
salt and pollution <strong>de</strong>rived gazes. Their impact on the Earth’s radiation budget through albedo<br />
variations results directly from the scattering and absorption of sun light. Indirectly,<br />
aerosols intervene in the formation of clouds as they provi<strong>de</strong> a surface where water vapor<br />
emanating from the Earth surface can con<strong>de</strong>nsate and form liquid droplets. Furthermore,<br />
the size of aerosol particules influences greatly the optical properties of clouds. Clouds<br />
containing high concentrations of aerosols emitted from industrial activies, are composed<br />
of smaller liquid water drops than those containing aerosols <strong>de</strong>rived from natural processes.<br />
The resulting high brightness of these clouds increases the portion of solar radiation reflected<br />
back to space and tend to reduce the Earth surface temperature.<br />
The study of the atmosphere through the analysis of multispectral/hyperspectral satellite<br />
imagery is an important step in the un<strong>de</strong>rstanding of ocean-land-atmosphere physical interactions.<br />
Furthermore, the atmospheric layer between the Earth surface and space acts<br />
as a filter and attenuates the signal measured by satellite intruments. Estimation of the<br />
atmosphere optical characteristics is necessary to compute efficient atmosperic correction<br />
and <strong>de</strong>rive accurately primary variables used in global climate mo<strong>de</strong>ls.
19<br />
Figure 2.3 – Monitoring snow cover with the Normalized Difference Snow In<strong>de</strong>x (NDSI)<br />
(Left) RGB image acquired by Terra MODIS on May 5, 2001 in Alaska (Right) NDSI,<br />
notice how the in<strong>de</strong>x erroneously indicates snow cover over the ocean<br />
2.2.3 Cryosphere and climate change<br />
The cryosphere <strong>de</strong>signates the Earth system where water can be found in solid form. It<br />
is composed of snow, lake and sea ice, glaciers, ice caps and frozen ground and represents<br />
during the winter seasons, 17 % of the Earth surface. For instance, the Greenland and<br />
Antarctic Ice sheets together are equivalent to 70 m of sea level rise. Given its mass and<br />
latent heat capacity, the cryosphere plays a role in climate change almost as important as<br />
the oceans. First, the high surface reflectivity of snow covered regions have a significant<br />
impact on the Earth albedoand even small variations in snow or ice fractional cover can lead<br />
to short-term climate changes. In addition, the quantity of fresh water stored on cryosphere<br />
can interfer with ocean currents. The variations in sea level, temperature and salinity of<br />
ocean waters due to seasonal snowmelt can modify the interactions between oceans and the<br />
atmosphere. Furthermore, global warming in the polar region induces permafrost melting<br />
which in turn releases large quantities of methane stored in frozen soils. Un<strong>de</strong>rstanding<br />
the interactions between cryosphere and other parts of the Earth system, requires short<br />
and long-term quantitative measurements provi<strong>de</strong>d by satellite instruments.<br />
2.2.4 Recent exemples<br />
The year 2010 was subject to few unfortunate hazards. The political and economical<br />
implications of these events have emphasized the crucial role played by satellite sensors in<br />
the management of such disasters.
20 2. Remote Sensing with MODIS<br />
Figure 2.4 – The ash plume resulting from the Eyjafjallajokull eruption, monitored by<br />
two sensors on April 17, 2010 (Left) Image acquired by NASA’s Aqua MODIS on April 17,<br />
2010 showing a diffuse cloud of volcanic ash and a column plume rising at higher altitu<strong>de</strong>s<br />
(Right) Image from CNES/NASA CALIOP, lidar instrument aboard CALIPSO <strong>de</strong>dicated<br />
to the study of the atmosphere vertical profile of aerosol.<br />
2.2.4.1 The Eyjafjallajökull<br />
Around 20 Mars 2010, Eyjafjallajökull, a volcano located in the south of Iceland began<br />
its first erupting phase. A more explosive phase started on 14 april 2010. The volcano being<br />
located beneath glacial ice, the melting water flowing back in the volcano vent resulted in<br />
the formation of silica particules and ash, explosively rejected in the atmosphere at heights<br />
reaching 10 km. In addition, the south-easterly path of the Jet Stream, unusually stable<br />
at that specific period, progressively dispersed the ash plume across Europe’s airspace. Although<br />
not specifically quantified by manufacturers, the sensitivity of aircraft engines to<br />
ash particules, forced the Fe<strong>de</strong>ral Aviation Administration (FAA) to shut down air-traffic<br />
in most european countries. The financial losses caused by airspace closure to the airline<br />
industry were estimated approximatively at 150 ME per day from 15 to 23 April. The<br />
quantity of rejected ash and the trajectory of the resulting plumes were eventually monitored<br />
with numerous satellite-based instruments including CALIPSO, VEGETATION<br />
and MODIS (figure 2.4). As the eruptive phase of the volcano persisted, satellite images<br />
of the ash cloud were used to <strong>de</strong>termine its trajectory and establish low-risk air corridors.<br />
2.2.4.2 Deepwater Horizon oil spill<br />
In April 20, 2010, an offshore drilling platform, Deepwater Horizon, located southeast<br />
of the Louisiana coast explo<strong>de</strong>d and sank in the ocean. The explosion was followed by the<br />
release of 8500 m 3 of cru<strong>de</strong> oil per day and is consi<strong>de</strong>red today as the largest oil spill in the<br />
history of petroleum industry. Data collected from several spatial instruments were used<br />
to analyse the extend of the oil spill, and evaluate its spreading evolution with respect<br />
to wind direction. The reflection of sun light off the ocean surface (sun glint) highlights
21<br />
Figure 2.5 – RGB images from MODIS showing the evolution of the oil spill after the<br />
Deepwater Horizon platform explosion in 2010 (TL) April 29 (TR) May 4 (BL) May 9<br />
(BR) In 24 May, the oil spill reach the shores of Blind Bay and Redfish Bay at the eastern<br />
edge of the Mississippi River <strong>de</strong>lta. Credit : NASA/MODIS Rapid Response Team<br />
oil contaminated waters, which appear in satellite imagery as bright silvery stains. High<br />
concentrations of oil in the ocean surface tend to reduce the magnitu<strong>de</strong> of waves and the<br />
formation of whitecaps. This change in the ocean surface optical properties can increase<br />
the reflection of light in the sensor viewing direction (see section 2.4.3) specially if the<br />
oil-covered waters are located near the specular reflection.<br />
2.3 The importance of oceans in the Earth system<br />
2.3.1 The ocean’s carbon cyle<br />
Oceans occupie 71% of the earth and constitute a large reservoir of carbon present<br />
in both organic and non-organic form. Their impact on the regulation of our climatic<br />
system flows directly from the fundamental role they play in the global carbon cycle and<br />
justifies the importance given by space agencies to the study of physical and biological<br />
processes along the ocean-atmosphere interface. The carbon cycle <strong>de</strong>signates the process
22 2. Remote Sensing with MODIS<br />
Figure 2.6 – The ocean carbon cycle. Credit : NASA Robert Simmon<br />
of carbon exchange fluxes between the earth’s dynamic systems, namely biosphere, lithosphere,<br />
hydrosphere and atmosphere. Oceans are the earth’s largest active carbon reservoir<br />
and contain approximatively 4.10 19 gC. They hold a double role in the global carbon cycle<br />
refered to as solubility and biological pumps. The exchange of carbon dioxi<strong>de</strong> between<br />
ocean and atmosphere occurs in the air-sea interface and its flux F can be mo<strong>de</strong>lled as :<br />
(<br />
)<br />
F = K. PCO Ocean<br />
2<br />
− P Atmosphere<br />
CO 2<br />
(2.3)<br />
where PCO Ocean<br />
2<br />
(respectively P Atmosphere<br />
CO 2<br />
) is the partial pressure of CO 2 in the ocean (resp.<br />
atmosphere) and K a coefficient known as piston velocity. The term PCO Ocean<br />
2<br />
is <strong>de</strong>pen<strong>de</strong>nt<br />
on other thermodynamic parameters such as the water temperature and salinity, and thus<br />
dictates the directional exchange of CO 2 while its rate is related to K and to wind driven<br />
turbulence. The <strong>de</strong>positing of atmospheric CO 2 in the <strong>de</strong>ep layers f the ocean is ensured<br />
by a continuous mechanism known as solubility pump ; Once trapped in surface waters,<br />
the CO 2 is transfered to <strong>de</strong>eper ocean layers. This process occurs in high latitu<strong>de</strong>s areas,<br />
where overturning circulation is generated by the formation and sinking of <strong>de</strong>nse waters<br />
(figure 2.6).<br />
2.3.2 Phytoplancton and ocean color<br />
The intense biological activity witin the ocean and the resulting photosynthetic production<br />
(also known as primary production) constitutes the fastest exchange of CO 2 between<br />
oceans and atmosphere. In eutophic areas (upper layer of the oceans located between 0-<br />
200m), algal micro-organisms such as phytoplanton, absorb the energy <strong>de</strong>rived from solar
23<br />
radiance and other mineral compounds to convert CO 2 into organic matter in the form of<br />
particulate or dissolved organic carbon. This process is refered to as photosynthesis :<br />
nCO 2 + nH 2 O → (CH 2 O) n + nO 2 (2.4)<br />
Phytoplancton is a major regulator of the glocal carbon cycle. These microscopic algae<br />
are in fact at the base of the marine food chain and ensure the survival of most species<br />
including other micro-organisms such as zooplancton, responsible for the exportation of<br />
CO 2 to the <strong>de</strong>ep ocean. Phytoplancton organisms are composed of pigments with specific<br />
ligh absorption spectra. Chlorophyll-a for example, is an ubiquitous pigment that attributes<br />
the green color to most marine and continental plants. Despite their microscopic<br />
size, the concentration of phytoplancton in the water column <strong>de</strong>termines the ocean color.<br />
From oligotrophic to eutrophic waters, the increase of phytoplancton biomass and its<br />
primary production shifts the color of the ocean from <strong>de</strong>ep blue to green. Consequently,<br />
satellite-<strong>de</strong>rived measurements of the water-leaving radiance can be used to evaluate the<br />
phytoplancton biomass and quantify the ocean carbon fluxes. The spectral analysis of<br />
the radiance emanating from the oceans can be coupled to bio-optical mo<strong>de</strong>ls in or<strong>de</strong>r<br />
to retrived the ocean biomass constituents. Chlorophyll-a pigment concentration, a major<br />
geophysical variable in oceanography, can be expressed as :<br />
[Chla] = 10 (c 0+c 1 .ρ+c 2 .ρ 2 +c 3 .ρ 3 ) (2.5)<br />
where c 0 , c 1 , c 2 , c 3 are empirically-<strong>de</strong>rived constants and ρ = ρ 488 /ρ 551 is the ratio of<br />
remote sensing reflectances at wavelenght 488 nm and 551 nm [Aiken et al., 1995].<br />
Another parameter used to study the optical properties of ocean waters is the diffuse<br />
attenuation coefficient K. This coefficient <strong>de</strong>termines the attenuation of light intensity<br />
within the water column. At a wavelenght of 490 nm, K is a direct indicator of water<br />
turbidity and is <strong>de</strong>fined as :<br />
K(490) = 0.016 + 0.156<br />
where L w <strong>de</strong>signates the water leaving radiance.<br />
( )<br />
Lw (490) −1.54<br />
(2.6)<br />
L w (555)<br />
2.4 Constraints in remote sensing<br />
2.4.1 Sensor Calibration<br />
In or<strong>de</strong>r to provi<strong>de</strong> reliable information, the response of an instrument needs to be<br />
characteriszed precisely with respect to a lage data set of controlled input signals. This<br />
process known as calibration, occurs during the pre-launch and in-flight stages of the sensor<br />
mission as data quality highly <strong>de</strong>pends on it. The raw counts measured by a sensor<br />
can not be used directly for quantitative studies because they are not associated with
24 2. Remote Sensing with MODIS<br />
any unit. Radiometric calibration converts instrument digital numbers (DN) to physical<br />
radiance values (W.sr −1 .m −2 ). Since CZCS (Coastal Zone Color Scanner), most space<br />
instruments relie on on-board, in-flight internal calibration systems that inclu<strong>de</strong> a solar<br />
diffuser plate oriented towards the sun. The solar irradiance reaching the diffuser is then<br />
used as a radiance reference to adjust the sensor absolute radiometric calibration. Furthermore,<br />
pre-flight calibrations are not necessarely optimal in the actual space environment<br />
of the sensors and might require further adjustments. On many instruments, the continous<br />
exposure of the diffuser plate to solar radiations and bombardment by space particules,<br />
induces a progressive <strong>de</strong>gradation that needs to be accounted for in the overall system<br />
(see section ). This can be achieved using an additional diffuser to monitor the primary<br />
diffuser <strong>de</strong>gradation (MERIS) or by comparing lunar observations to the light scattered<br />
by the solar diffuser (MODIS and SeaWiFS).<br />
In addition to absolute and relative radiometric calibration, vicarious calibration techniques<br />
are used to minimize errors between satellite-<strong>de</strong>rived data and stable ground targets<br />
with known radiance values. Typical calibration sites inclu<strong>de</strong> <strong>de</strong>sertic regions, ice sheets,<br />
clouds and ocean targets contaminated with sun glint. Assuming the availability of an<br />
extensive in situ data set and a reliable atmospheric correction, the sensor response can<br />
be adjusted so that the values of a geophysical variable estimated from satellite radiances,<br />
Figure 2.7 – The ocean color from satellite imagery is <strong>de</strong>termined by the organic constituents<br />
of the ocean upper surface. These images acquired by MODIS illustrate phytoplancton<br />
blooms in the South Atlantic Ocean, off of the cost of Argentina. Phytoplancton<br />
blooms offer a wi<strong>de</strong> variety of colors ranging from turquoise blue to dark green. The strong<br />
color variations are due to the pigment composition of each phytoplancton specie and their<br />
<strong>de</strong>pth in the eutophic layer.
25<br />
coinci<strong>de</strong> with those <strong>de</strong>rived from ground measurements.<br />
2.4.2 Atmospheric correction<br />
Prior and after its reflection on the Earth surface, solar radiation is subject to molecular<br />
and aerosol scattering. The cumulation of these processes, combined with the high altitu<strong>de</strong><br />
of satellites, reduces the magnitu<strong>de</strong> of the radiance reaching the sensor. The received signal,<br />
known as Top-Of-Atmosphere (TOA) can be expressed as a sum of radiance contributions<br />
related to several processes. Atmospheric Correction then estimates the radiative portion<br />
of these effect prior to the generation of surface reflectances. Atmospheric correction is<br />
particularly complex in the case of ocean color remote sensing where the TOA radiance<br />
can be written in a simplified form as :<br />
L T OA = L Rayleigh + L Aerosol + L Rayleigh−Aerosol + TL Glint + tL W ater (2.7)<br />
In the previous equation,<br />
- T and t are the direct and diffuse atmospheric transmittances between the ocean surface<br />
and the instrument. The portion of energy that reaches the sensor is related to the optical<br />
thickness of aerosols contained in the atmopshere<br />
- L Glint is the specular reflection of sun light on the oceanic surface towards the sensor<br />
viewing direction<br />
- L Rayleigh and L Aerosol both translate scattering effects of light and <strong>de</strong>pend on atmospheric<br />
pressure, temperature and polarization.<br />
- L Rayleigh−Aerosol accounts for coupling processes between Rayleigh and Mie scaterring.<br />
- L W ater is the signal to be retrieved after atmopheric correction and corresponds to the<br />
water-leaving radiance<br />
The L W ater term represents a weak portion (less than 10%) of the TOA signal and its<br />
extraction from the combined surface/atmosphere system highly <strong>de</strong>pends on the accuracy<br />
of the atmopheric correction. In fact, a 1% error on the measured L T OA leads to a 10%<br />
error on the estimated L W ater . In addition to scattering effects, many gazes present in the<br />
atmosphere such as ozone, oxygen and water vapor can absord solar radiation in specific<br />
regions of the electromagnetic spectrum.<br />
The effective removal of atmospheric contribution from the TOA signal is a major requirement<br />
for the generation of operational land and ocean colour products.<br />
2.4.3 Sun glint<br />
The greatest obstacle for the generation of ocean color products is the presence of sun<br />
glint. Sun glint is the specular reflection of sunlight off the ocean surface and into the<br />
satellite sensor. This optical phenomena occurs when the ocean surface directs the solar<br />
radiation in the exact viewing direction of the sensor and as such, <strong>de</strong>pends on the sea<br />
surface state, the sun position and the satellite viewing geometry. The high intensity of
26 2. Remote Sensing with MODIS<br />
Figure 2.8 – Sun glint, a major obstacle for the generation of ocean color products appears<br />
on MODIS images as a wi<strong>de</strong> and bright vertical stripe. It results from the reflection of sun<br />
light off the ocean surface.<br />
sun glint radiance L Glint (often close to the sensor saturation) compromises the estimation<br />
of water-leaving radiance and all the <strong>de</strong>rived oceanic geophysical variables. In addition,<br />
atmospheric correction over ocean targets often fails to distinguish sun glint from high<br />
concentrations of white aerosols. Many techniques have been <strong>de</strong>vised to remove the sun<br />
glint contribution from the TOA signal. The most common approach for medium resolution<br />
instruments relie on the well-known Cox and Munk statistical mo<strong>de</strong>l of sea surface<br />
roughness [Cox and W.Munk, 1954]. For a given sensor viewing geometry, the amount of<br />
sun glint radiance can be expressed as a function of the probability <strong>de</strong>nsity function of sea<br />
surface slopes which in turn, <strong>de</strong>pend on the wind speed and direction. The reflectance due<br />
to sun glint can be predicted from the sensor viewing geometry and the wind speed with :<br />
ρ Glint (λ, θ s ,θ v ,φ s ,φ v ,W)= P (θ s,θ v ,φ s ,φ v ,W)f(w, λ)<br />
4cos 4 βcosθ v cosθ s<br />
(2.8)<br />
where :<br />
- θ s and φ s are the zenith and azimuth angles of the sun<br />
- θ v and φ v are the zenith and azimuth angles of the sensor<br />
- f(w, λ) is the Fresnel reflectance at the ocean surface for an angle of inci<strong>de</strong>nce of w<br />
- W is the wind speed<br />
- P (θ s ,θ v ,φ s ,φ v ,W) is the probability distribution function of Cox/Munk mo<strong>de</strong>l corresponding<br />
to a 4 th or<strong>de</strong>r Gramm-Charlier expansion and often approximated with a Gaussian<br />
distribution.<br />
Although implemented in numerous ocean colour sensors, Cox and Munk based correcting<br />
schemes [Montagner et al., 2003], [Wang and Bailey, 2001], [Fukushima et al., 2007], [Ottaviani<br />
et al., 2008] can only process mo<strong>de</strong>rate sun glint. Also, the results are limited by<br />
the accuracy and resolution of available wind data. Motivated by these limitations, Steinmetz,<br />
Deschamps and Ramon, [Steinmetz et al., 2008] recenly introduced a new approach,
27<br />
POLYMER based on neural networks. The TOA reflectance is mo<strong>de</strong>lled as :<br />
ρ T OA (λ) =c 0 + c 1 λ −1 + c 2 λ −4 + tρ W ater (λ) (2.9)<br />
where c 0 inclu<strong>de</strong>s spectrally flat components such as sun glint, c 1 λ −1 accounts for aerosol<br />
effects and c 2 λ −4 represents coupling processes between sun glint and aerosols. The water<br />
reflectance ρ W ater is assumed to be a function of chlorophyll concentration, <strong>de</strong>rived from<br />
bio-optical mo<strong>de</strong>ls. Rather different techniques are employed to process sun glint effects<br />
on high resolution imagery (1-20m)[Hochberg et al., 2003], [Hedley et al., 2005], [Lyzenga<br />
et al., 2006], [Kutser et al., 2009]. They are mostly based on the assumption of neglectable<br />
water-leaving radiance at Near-Infrared (NIR) bands and the linear relationship of reflectances<br />
at visible and NIR bands. An aternative option for sun glint correction is sun glint<br />
avoidance. Several instruments are <strong>de</strong>signed with the ability to tilt the sensors viewing<br />
direction (SeaWiFS) or to inclu<strong>de</strong> a multi-angle viewing mo<strong>de</strong> (POLDER). The presence<br />
of such mechanisms can reduce consi<strong>de</strong>rably the loss of data related to strong sun glint<br />
contamination and increase the spatial coverage of ocean products.<br />
2.4.4 Cloud coverage<br />
Persisting cloud coverage in satelite imagery disturbs the study of many geological and<br />
oceanographic processes because it reduces the availability of exploitable data. More specifically,<br />
it disables the <strong>de</strong>tection of changes occuring at temporal frequencies higher than<br />
the persistence of clouds and, therefore poses a serious challenge for applications related to<br />
disaster management (see section 2.2.4.2). As a reponse to the limited set of measurements<br />
available in high level geophysical variables, many studies have focused on possible techniques<br />
to enhance the daily spatial coverage. A common approach in ocean color remote<br />
sensing is to exploit data measured by many sensors at slightly different times. Un<strong>de</strong>r the<br />
assumption of stationnay oceanic processes, measurements acquired within a reasonable<br />
time frame can be merged to fill in the gaps related to clouds. In the context of ocean color<br />
remote sensing, combination of data from multiple instruments was explored for SST in<br />
[Reynolds and Smith, 1994] and have since been <strong>de</strong>eply investigated by the SIMBIOS project<br />
of NASA [M. E. and Gregg, 2003], [Fargion and McClain], [Kwiatkowska and Fargion,<br />
2002]. Common techniques for the merging of chlorophyll concentration products inclu<strong>de</strong> :<br />
- Weighted averaging : estimation of missing values is <strong>de</strong>termined from different sensors<br />
using a weighted average where the weights are <strong>de</strong>pen<strong>de</strong>nt on the accuracy of observations.<br />
- Statistical objective analysis, also known as optimal interpolation, consists in filling<br />
gaps through spatial and temporal interpolation.<br />
More recently, the Short-term Prediction and Research Transition (SPoRT) program of<br />
NASA has <strong>de</strong>velopped a composite product for MODIS SST [Haines et al., 2007] to improve
28 2. Remote Sensing with MODIS<br />
Figure 2.9 – The issue of limited spatial coverage illustrated on Aqua MODIS Level 3<br />
nightime 11 µm Sea Surface Temperature (SST) (Left) Daily product with missing measurements<br />
due to clouds, sun glint and distance between swaths (Right) 8 day composite<br />
product showing a substantial increase in spatial coverage.<br />
regional weather prediction mo<strong>de</strong>ls. The methodology tackles the issue of cloud contamination<br />
using a temporal compositing approach, able to estimate SST missing values while<br />
ensuring global spatial continuity of SST gradients.<br />
2.5 The Mo<strong>de</strong>rate Resolution Imaging Spectroradiometer<br />
(MODIS)<br />
2.5.1 Context and objectives<br />
In 1978, the Coastal Zone Color Scanner (CZCS) was launched aboard the spacecraft<br />
Nimbus-7. Designed as a proof-of-concept instrument with a mission duration of one year,<br />
CZCS primary goal was to <strong>de</strong>termine the potential of satellite imagery for the quantification<br />
of ocean chlorophyll concentration and other dissoved and suspen<strong>de</strong>d organic<br />
matter. Despite many limitations related to its prelaunch characterisation and on-orbit<br />
calibration, CZCS imposed the basis of mo<strong>de</strong>rn ocean color satellite sensors. The CZCS<br />
operational period (1978-1986) was followed by the launch of several instruments <strong>de</strong>dicated<br />
to the study of oceans, MOS, OCTS, POLDER and SeaWiFS, each including specific<br />
technological innovations with increased dynamic range, signal-to-noise ratio and number<br />
of spectral bands. Motivated by the <strong>de</strong>manding requirements of remote sensing scientists,<br />
the improvement in satellite sensors <strong>de</strong>sign reached its climax with the Mo<strong>de</strong>rate Resolution<br />
Imaging Spectrometer (MODIS). As a multipurpose mission, MODIS primary goals<br />
are :<br />
- Ensure the continuity of data collection provi<strong>de</strong>d by heritage sensors such as AVHRR,<br />
CZCS, SeaWiFS and HIRS<br />
- Deliver products in a variety of disciplines with improved radiometric quality<br />
- Monitor changes that occur at short time-scales combining Terra and Aqua MODIS
29<br />
morning and afternoon observations<br />
- Provi<strong>de</strong> highly consistent time series of observations used to improve our un<strong>de</strong>rstanding<br />
of climate change at seasonal-to-<strong>de</strong>cadal time scales<br />
The first prototype of MODIS was launched on December 18, 1999 aboard the Terra<br />
EOS-AM-1 platform. The MODIS on the Aqua EOS-PM1 spacecraft was launched on<br />
May 4, 2002.<br />
2.5.2 Technical specifications<br />
MODIS was initially conceptualized as a double instrument MODIS-N (Nadir) and<br />
MODIS-T (Tilt). Aiming improved ocean colour capabilities, MODIS-T was <strong>de</strong>signed with<br />
the ability to tilt away from specular reflection directions and avoid sun glint effects.<br />
Despite its success on SeaWiFS, a tilting mechanism was not retained for the MODIS<br />
project because the combination of data collected from Terra and Aqua MODIS was proven<br />
to provi<strong>de</strong> almost similar spatial coverage [Gregg, 1992], [Gregg and Woodward, 2007],<br />
with the additional advantage of both morning and afternoon observations. MODIS is<br />
composed of 36 spectral bands ranging from the visible (0.4µm) to the far infrared (14µm)<br />
and centered at wavelenghts <strong>de</strong>dicated to three major applications. Bands 1-7 are <strong>de</strong>voted<br />
to the study of land remote sensing, cloud <strong>de</strong>tection and aerosol estimation. These bands<br />
are centered at wavelenghts similar to Landsat TM and measure data at spatial resolutions<br />
of 250 m for bands 1-2 and 500 m for bands 3-7. Stringent requirements associated with<br />
ocean color monitoring and studies conducted on CZCS and SeaWiFS instruments lead to<br />
nine spectral bands on MODIS (8-16). Compared to SeaWiFS, MODIS ocean color bands<br />
are narrower (average of 10 nm width compared to 20 nm on SeaWiFS), and, therefore<br />
allow more reliable atmospheric correction with higher signal-to-noise ratio values. Most<br />
of the remaining bands 17-26 were spectrally positioned with respect to HIRS, AVHRR<br />
and ATRS. To provi<strong>de</strong> accurate Sea Surface Temperatures (SST), two split-windows at<br />
mid-wave infrared (MWIR) (bands 23-24) and long-wave infrared (LWIR) (bands 31 and<br />
32) were inclu<strong>de</strong>d. The split-window composed of bands 31-32 enables the <strong>de</strong>rivation of<br />
day time SST measurements, because channels 23 and 24 are contaminated with sun glint<br />
effects, still persisting in the MWIR portion of the electromagnetic spectrum. MODIS<br />
was <strong>de</strong>signed as a whiskbroom sensor ; it uses the obital motion of the satellite to acquire<br />
successive lines using a scanning mirror that rotates at ± 55˚. MODIS swath reaches 2330<br />
km and allows a global coverage of the entire earth every one to two days.<br />
2.5.3 Components<br />
Compared to its pre<strong>de</strong>cessors, MODIS inclu<strong>de</strong>s many components (figure 2.10), each<br />
playing a specific role in the acquisition process. As we shall see, emphasis was given to the<br />
calibration of the instrument. We present here a brief <strong>de</strong>scription of the main subsytems.
30 2. Remote Sensing with MODIS<br />
Main application Band Spectral Center Spectral Width<br />
Land/Cloud/Aerosols Boundaries<br />
1 645 nm 25 nm<br />
2 856 nm 15 nm<br />
3 469 nm 20 nm<br />
4 555 nm 20 nm<br />
Land/Cloud/Aerosols Properties 5 1240 nm 20 nm<br />
6 1640 nm 24 nm<br />
7 2130 nm 50 nm<br />
8 412 nm 15 nm<br />
9 443 nm 10 nm<br />
10 493 nm 10 nm<br />
11 531 nm 10 nm<br />
Ocean Color/Phytoplankton 12 551 nm 10 nm<br />
13 667 nm 10 nm<br />
14 678 nm 10 nm<br />
15 748 nm 10 nm<br />
16 869 nm 15 nm<br />
17 905 nm 30 nm<br />
Atmospheric Water Vapor 18 936 nm 10 nm<br />
19 940 nm 50 nm<br />
20 3.750 µm 0.180 µm<br />
Surface/Cloud Temperature<br />
21 3.959 µm 0.030 µm<br />
22 3.959 µm 0.030 µm<br />
23 4.050 µm 0.060 µm<br />
Atmospheric Temperature<br />
24 4.465 µm 0.065 µm<br />
25 4.515 µm 0.067 µm<br />
26 1.375 µm 0.030 µm<br />
Cirrus Clouds Water Vapor 27 6.715 µm 0.360 µm<br />
Cloud Properties 29 8.550 µm 0.300 µm<br />
Ozone 30 9.730 µm 0.300 µm<br />
Surface/Cloud Temperature<br />
31 11.030 µm 0.500 µm<br />
32 12.020 µm 0.500 µm<br />
33 13.335 µm 0.300 µm<br />
Cloud Top Altitu<strong>de</strong><br />
34 13.635 µm 0.300 µm<br />
35 13.935 µm 0.300 µm<br />
36 14.235 µm 0.300 µm<br />
Table 2.1 – MODIS spetral bands<br />
More <strong>de</strong>tails are provi<strong>de</strong>d in (Barnes et al., 1998).
31<br />
Figure 2.10 – Main Components of the MODIS instrument<br />
Scan mirror assembly The energy from Earth radiation is reflected into the focal<br />
plane assembly via a double sid<strong>de</strong>d scan mirror, composed of nickel-plated Beryllium. The<br />
rotation of the mirror at 20.3 rpm is ensured by a 2-phase brushless DC motor and the<br />
stability of its speed is monitored by a 14-bit optical enco<strong>de</strong>r with an accuracy of 11-<br />
microradian . The system mirror-motor-enco<strong>de</strong>r has been limited to a weight of 4.3 kg<br />
and only requires a power of 2.9 W.<br />
Focal plane assembly Dichroic beamsplitters are used to separate the scene radiation<br />
into 4 Focal Plane Assemblies (FPA) associated with each spectral region (VIS, NIR,<br />
SWIR-MWIR, LWIR). Each FPA contains <strong>de</strong>tector arrays of pixels which size ranges<br />
from 135 to 540 µm. Bands with spatial resolution of 1 km have 10 <strong>de</strong>tectors array, while<br />
bands at 250m and 500m, have 20 and 40 <strong>de</strong>tectors. This is illustrated in figure 2.11.<br />
The FPAs are highly responsible for the presence of stripe noise in the images as striping<br />
originates partly from the miscalibration and non-linear responses of the pixels contained<br />
in the <strong>de</strong>tector arrays.<br />
The onboard calibration system inclu<strong>de</strong>s four complementary components :<br />
Solar Diffuser The solar diffuser (SD) is a pressed plate located in the forward part<br />
of the instrument and used for the calibration of the reflective bands. Periodically (once<br />
per orbit, at the north and south pole to avoid loss of data), the SD provi<strong>de</strong>s diffuse<br />
solar illumination to the scan mirror. Assuming a good characterization of the SD surface<br />
reflectance and precise estimation of the sun position, the solar diffuser radiance provi<strong>de</strong>s<br />
a stable source for absolute radiometric calibration.
32 2. Remote Sensing with MODIS<br />
Figure 2.11 – Four Focal Plane Assemblies composed of <strong>de</strong>tector arrays<br />
Solar Diffuser Stability Monitor Due to exten<strong>de</strong>d exposure to sun radiation during<br />
the mission, the solar diffuser can be subject to a progressive <strong>de</strong>terioration that translates<br />
as slight variations in its bidirectional reflectance distribution function (BRDF). Such<br />
<strong>de</strong>gradation can impact the radiometric calibration of the sensor and is monitored in<strong>de</strong>pen<strong>de</strong>ntly<br />
with the solar diffuser stability monitor (SDSM). Deviations of the SD response<br />
can be <strong>de</strong>duced by comparing measurements from its solar-illumated surface with measurements<br />
obtained directly from the sun. This is done with a spherical integrating source<br />
(SIS) composed of nine filtered <strong>de</strong>tectors that succcessively view the SD, a dark scene<br />
(space view) and the sun.<br />
Spectral Radiometric Calibration Assembly The Spectral Radiometric Calibration<br />
Assembly (SRCA) provi<strong>de</strong>s on orbit radiometric, spectral and spatial calibration without<br />
interfering with the sensor current acquisition. An integrating sphere with four lamps<br />
directs light on a toroidal relay mirror that reflects it towards a Czerny-Turner monochromator.<br />
A grating/mirror assembly then points the monocromatic light into the VIS, NIR<br />
and SWIR bands to evaluate spectral response <strong>de</strong>viations. Radiometric response is evaluated<br />
when the entrance and exit aperture of the SRCA are open and a mirror replaces<br />
the grating. The SRCA integrating sphere provi<strong>de</strong>s six-level radiometric sources used for<br />
the radiometric calibration of the reflective bands. Band-to-Band spatial registration is<br />
achieved with reticule patterns placed at the exit of the monochromator and projected<br />
into MODIS optical system.
33<br />
Blackbody : The calibration of MODIS emissive bands is achieved with the Blackbody,<br />
a component with zero reflectivity and an effective emissivity above 0.992. The temperature<br />
of the Blackbody is <strong>de</strong>termined with a precision of ±0.1 K and is measured with twelve<br />
thermistors. For every scan line (1.47s), a two-point calibration of the thermal bands is<br />
achieved with the scan mirror successively viewing space and the blackbody.<br />
2.5.4 MODIS products<br />
The generation of MODIS products from instrument raw data is done at NASA’s<br />
DAAC (Distributed Active Archive Center). The distribution of the products is then<br />
ensured by NASA’s Goddard Space Flight Center, the United States Geological Survey’s<br />
(USGS) EROS Data Center and the NOOA’s National Snow and Ice Data Center<br />
(NSIDC). MODIS products are organized in three levels.<br />
Level 1A products are composed of digital counts and data related to spacecraft and<br />
instrument telemetry. L1A data is processed at the EOS Data and Operations Systems<br />
(EDOS), then stored in 5-min granules containing all necessary information for further<br />
geolocation and calibration.<br />
Level 1B products are <strong>de</strong>duced from L1A and correspond to Top of the Atmosphere<br />
(TOA) calibrated radiances.<br />
Level 2 products result from the application of atmospheric correction and bio-optical<br />
algorithms to L1B data. L2 data represents geolocated geophysical variables.<br />
Level 3 products correspond to spatially binned L2 data accumulated during a time<br />
period of one day, 3 days, 8 days, a mounth or an entire year. L3 data are mapped in an<br />
Equidistant Cylindrical Projection grid of the earth and available at resolutions of 4 km<br />
and 9 km.<br />
MODIS geophysical products belong to four major disciplines, Ocean, Land, Atmosphere<br />
and Cryosphere (Table 2.2).<br />
2.5.5 Stripe noise on MODIS<br />
The analysis of MODIS level 1B data <strong>de</strong>rived from reflective and emmissive bands reveals<br />
the presence of striping with slightly different aspects. [Gumley, 2002] was the first to<br />
point out that three types of stripes can actually be seen on MODIS (figure 2.12). Mirror<br />
si<strong>de</strong> stripes (mirror banding) affects most reflective bands and some emissive bands located<br />
below the MWIR range. However, they are visible only over bright targets. Mirror banding<br />
appears to be the result of a quasi constant offset between forward and backward scans<br />
(we recall that MODIS scanning mirror is double si<strong>de</strong>d) and is systematically located in<br />
regions displaying radiance values high enough to bring the sensor close to its saturation
34 2. Remote Sensing with MODIS<br />
Figure 2.12 – Three types of stripe noise on Terra MODIS Level 1B geolocated calibrated<br />
radiances (Left) Detector-to-<strong>de</strong>tector stripes (Band 27) (Center) Mirror si<strong>de</strong> stripes<br />
(Band 9) (Right) Random stripes (Band 33). All the images are 200×200 pixels in size<br />
with a resolution of 1km<br />
mo<strong>de</strong>. Typical cases of mirror banding can be seen in homogeneous areas contaminated<br />
with sun glint or high concentrations of aerosol. The analysis of oceanographic data indicates<br />
that mirror banding reaches a maximal amplitu<strong>de</strong> in the specular direction, (highest<br />
level of sun glint) and tends to fa<strong>de</strong> away as the sun glint intensity <strong>de</strong>creases. This shows<br />
that mirror si<strong>de</strong> stripes are <strong>de</strong>pen<strong>de</strong>nt on the signal level and can be correlated with the<br />
scan angle.<br />
Detector-to-<strong>de</strong>tector stripes take the form of a periodic pattern of stripes and unlike mirror<br />
banding they cover entire MODIS swaths. Studies related to other sensors Horn and<br />
Woodham [1979], attribute the presence of these periodic stripes to a poor gain/offset<br />
calibration of the indivual <strong>de</strong>tectors composing the sensor. Furthermore, <strong>de</strong>tectors responses<br />
display strong non linear effects in the low radiance range (figure 3.4).<br />
The third type of stripes are random and appear clearly on Terra MODIS band 33 as<br />
black and white stripes with a limited lenght over a given scan line. Noisy stripes are<br />
presumably due to errors in the internal system and random noise.<br />
The processing of level 1B data to level 2 geophysical products does not inclu<strong>de</strong> a correcting<br />
algorithm for striping. The most recent version of MODIS data (collection 5),<br />
inclu<strong>de</strong>s a <strong>de</strong>striping procedure [] limited only to land surface reflectances. As atmospheric<br />
correction and bio-optical algorithms combine the information from multiple spectral<br />
bands to generate level 2 data, striping tends to be emphazised in the <strong>de</strong>rived geophysical<br />
products. Mirror banding clearly affects ocean colour products such as normalized<br />
water leaving radiance and chlorophyll concentration (figure 2.13). Level 2 daytime Sea<br />
Surface Temperature (SST) is computed from bands 31 and 32, and shows evi<strong>de</strong>nce of<br />
<strong>de</strong>tector-to-<strong>de</strong>tector stripes. Going further in MODIS processing chain, striping appears<br />
to persist even in level 3 products, altough this effect migh also be originating from the<br />
poor resolution of level 3 data (4km). It is clear, that stripe noise on level 1B data impacts<br />
the quality of higher level products and needs to be corrected efficiently before the gene-
35<br />
ration of level 2 and level 3 products. Because the stripe noise does not affect similarly<br />
all spectral bands, the <strong>de</strong>rivation of geophysical variables often results in a stripe noise<br />
amplification. For instance, striping can hardly be seen on bands 31 and 32. Yet, SWIR<br />
and LWIR SST products display stripe noise. MODIS SST is obtained with an NLSST<br />
(Non linear SST) algorithm that can be expressed as :<br />
SST = a 0 + a 1 .BT 11 + a 2 .(BT 11 − BT 12 )+a 3 .(BT 11 − BT 12 ).( 1 − 1) (2.10)<br />
µ<br />
where a 0 , a 1 , a 2 , a 3 are time <strong>de</strong>pen<strong>de</strong>nt coefficients <strong>de</strong>termined by the Rosentiel School of<br />
Marine and Atmospheric Science from in-situ measurements. BT 11 and BT 12 are brightness<br />
temperatures of bands 31 and 32, and µ is the cosine of the sensor zenith angle. The<br />
difference between bands 31 and 32 is used to correct atmospheric effects due to waper<br />
vapor absorption and is responsible for the introduction of striping in the SST. The amplification<br />
of striping can be stronger on products generated from algorithms that inclu<strong>de</strong><br />
multiplicative operations between spectral bands, which is the case of many bio-optical<br />
mo<strong>de</strong>ls used to estimate oceanographic variables.
36 2. Remote Sensing with MODIS<br />
Figure 2.13 – Stripe noise on Aqua MODIS Level 2 ocean products (TL) Remote sensing<br />
reflectance at 412 nm (TR) Chlorophyll concentration (BL) Diffuse attenuation coefficient<br />
at 490 nm (BR) Sea surface temperature at 11 µm
37<br />
Discipline Product ID Product name<br />
MOD01 Level-1A Radiance Counts<br />
– MOD02 Level-1B Calibrated Geolocation Radiances<br />
MOD03 Geolocation Data Set<br />
MOD04 Aerosol Product<br />
MOD05 Total Precipitable Water<br />
Atmosphere<br />
MOD06 Cloud Product<br />
MOD07 Atmospheric Profiles<br />
MOD08 Grid<strong>de</strong>d Atmospheric Product<br />
MOD035 Cloud Mask<br />
Cryosphere<br />
MOD010 Snow Cover<br />
MOD029 Sea Ice Cover<br />
MOD09 Surface Reflectance (Atmospheric Correction)<br />
MOD011 Land Surface Temperature and Emissivity<br />
MOD012 Land Cover/Land Cover Change<br />
MOD013 Grid<strong>de</strong>d Vegetation Indices (NDVI & EVI)<br />
MOD014 Thermal Anomalies - Fires and Biomass Burning<br />
Land MOD015 Leaf Area In<strong>de</strong>x (LAI) and FPAR<br />
MOD016 Evapotranspiration<br />
MOD017 Vegetation Production, Net Primary Productivity (NPP)<br />
MOD040 Grid<strong>de</strong>d Thermal Anomalies<br />
MOD043 Surface Reflectance BRDF/Albedo Parameter<br />
MOD044 Vegetation Cover Conversion<br />
MOD018 Normalized Water-leaving Radiance<br />
MOD019 Pigment Concentration<br />
MOD020 Chlorophyll Fluorescence<br />
MOD021 Chlorophylla Pigment Concentration<br />
MOD022 Photosynthetically Available Radiation (PAR)<br />
MOD023 Suspen<strong>de</strong>d-Solids Concentration<br />
MOD024 Organic Matter Concentration<br />
MOD025 Coccolith Concentration<br />
Ocean MOD026 Ocean Water Attenuation Coefficient<br />
MOD027 Ocean Primary Productivity<br />
MOD028 Sea Surface Temperature<br />
MOD029 Sea Ice Cover<br />
MOD031 Phycoerythrin Concentration<br />
MOD032 Processing Framework and Match-up Database<br />
MOD036 Total Absorption Coefficient<br />
MOD037 Ocean Aerosol Properties<br />
MOD039 Clean Water Epsilon<br />
Table 2.2 – MODIS products
38 2. Remote Sensing with MODIS
39<br />
Chapitre 3<br />
Standard <strong>de</strong>striping techniques<br />
and application to MODIS<br />
3.1 Data<br />
The characteristics of stripe noise on the MODIS instrument are more complex than<br />
those observed on other imaging spectrometers. We shall see that early <strong>de</strong>striping techniques<br />
<strong>de</strong>velopped to improve the quality of Landsat MSS/TM images, provi<strong>de</strong> unsatisfactory<br />
results for MODIS data. As illustrated in figure 2.12, images extracted from MODIS<br />
are contaminated with three different types of stripes, ubiquitous on few spectral bands.<br />
Although this increases the difficulties associated with <strong>de</strong>striping, it constitutes - in addition<br />
to the importance of MODIS in earth science research - a complementary motivation<br />
to explore new techniques.<br />
Despite a growing number of <strong>de</strong>striping methodologies, very few take into account particular<br />
cases of stripe noise. In fact, a major concern on MODIS is the presence of random<br />
stripes, so far discussed only in [Rakwatin et al., 2007]. In this chapter, we explore several<br />
techniques and we analyse the results obtained on images extracted from specific emissive<br />
bands of MODIS.<br />
The algorithms <strong>de</strong>scribed in each section are applied on both Terra and Aqua level 1B<br />
TOA calibrated radiances. Given the consi<strong>de</strong>rable size of MODIS swaths (2330 km cross<br />
track ), we illustrate most of the results on 512 × 512 sub-images to allow accurate visual<br />
examination of small scale features. We specifically selected bands 27, 30 and 33 for Terra<br />
MODIS and bands 27, 30 and 36 for Aqua MODIS as they are representative of an extreme<br />
case due to severe striping with strong non-linear effects. All these bands display periodic<br />
stripes (mainly <strong>de</strong>tector-to-<strong>de</strong>tector), except band 33 of Terra MODIS which contains<br />
mostly random stripes. The data set used for this study is composed of three images for<br />
Terra MODIS and three images for Aqua MODIS, each extracted from a different spectral<br />
band (see figure 3.1). The scene captured by Terra MODIS was acquired on July 1 st , 2009<br />
in the Mediterannean Sea. The images from Aqua MODIS were acquired on November
40 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.1 – MODIS data set used for the analysis of <strong>de</strong>striping algorithms and composed<br />
of level 1B TOA calibrated radiances (TL) Terra band 27 (TC) Terra band 30 (TR) Terra<br />
band 33 (BL) Aqua band 27 (BC) Aqua band 30 (BR) Aqua band 36<br />
10, 2009, in the Pacific Ocean on the west coast of USA.<br />
3.2 Moment Matching<br />
The need for post-processing algorithms and the <strong>de</strong>velopment of <strong>de</strong>striping methods<br />
quickly followed the distribution of data collected by Landsat MSS. The MSS incorporates<br />
a rotating scan mirror that redirects the scene energy to six separate <strong>de</strong>tectors.<br />
After completion of an entire scan sweep, the orbital motion of the satellite ensures the<br />
acquisition of six additional lines and so forth. The six individual <strong>de</strong>tectors of MSS are<br />
not perfectly i<strong>de</strong>ntical and the corresponding transfer functions are subject to slight <strong>de</strong>viations<br />
from each other. During the acquisition process, the radiometric drift between<br />
<strong>de</strong>tectors produces an un<strong>de</strong>sirable striping effect in the image(*add*). The removal of<br />
this artifact requires an accurate characterization of the <strong>de</strong>tectors response in term of<br />
<strong>de</strong>viations from nominal operational mo<strong>de</strong>. Assuming that input/output functions of the<br />
<strong>de</strong>tectors established during the pre-launch calibration stage remain the same during onorbit<br />
operations, a simple inversion of these functions could provi<strong>de</strong> a reliable correction
41<br />
for striping. The drift observed on MSS <strong>de</strong>tectors response was attributed in [Horn and<br />
Woodham, 1979] to the <strong>de</strong>gradation of photomultipliers with respect to exposure time.<br />
Despite the calibration system on-board LANDSAT, MSS images still contain stripes and<br />
additional radiometric correction were <strong>de</strong>velopped by [Strome and Vishnubhatla, 1973]<br />
and [Sloan and Orth, 1977]. The resulting method is referred to as moment matching and<br />
is based on the assumption of both linear and time invariant behavior of the <strong>de</strong>tectors.<br />
Stripe noise is assumed to be the result of relative uncorrected gain and offset coefficients.<br />
Hereafter, we <strong>de</strong>note d k the signal acquired by <strong>de</strong>tector number k. In the case of MODIS,<br />
k =1..10 (for FPAs with 1 km resolution), images are formed by interlacing signals from<br />
the 10 <strong>de</strong>tectors. Un<strong>de</strong>r the assumption of linear responses, the signal from <strong>de</strong>tector k can<br />
be written as :<br />
d k = G k .d c k + O k (3.1)<br />
where G k and O k are gain and offset parameters, d k is the noisy signal and d c k<br />
is the true<br />
signal for <strong>de</strong>tector k. Once G k and O k are <strong>de</strong>termined, values of <strong>de</strong>tector k are corrected<br />
as :<br />
d c k = d k − O k<br />
(3.2)<br />
G k<br />
Unless calibration targets with known radiance values are used, absolute values for G k and<br />
O k remain un<strong>de</strong>termined. Nevertheless, <strong>de</strong>striping only requires relative gain/offset coefficients.<br />
These can be estimated statistically from the entire image. In fact, the acquisition<br />
process of whiskbroom systems makes it reasonnable to assume that signals acquired by<br />
each <strong>de</strong>tector share similar statistical characteristics. The validity of this hypothesis holds<br />
for images with high dimensions. Relative gain/offsets can then be <strong>de</strong>termined from the<br />
mean value and standard <strong>de</strong>viation of a signal d ref acquired by a pre<strong>de</strong>termined reference<br />
<strong>de</strong>tector. Let us <strong>de</strong>note µ k and σ k , - respectively µ ref et σ ref - the mean value and standard<br />
<strong>de</strong>viation of d k , - resp. d ref -. Moment matching adjusts the response of a noisy <strong>de</strong>tector<br />
by forcing its mean value and standard <strong>de</strong>viation to coinci<strong>de</strong> with those <strong>de</strong>rived from the<br />
reference <strong>de</strong>tector. Using equation (3.1), this translates to :<br />
and gain and offset are obtained as :<br />
µ k = G k .µ ref + O k<br />
σ k = G k .σ ref<br />
(3.3)<br />
G k =<br />
σ k<br />
σ ref<br />
O k = µ k − µ ref . σ k<br />
σ ref<br />
(3.4)<br />
Replacing equations (3.4) in (3.2), the signal from <strong>de</strong>tector k is corrected with :<br />
ˆd c k = σ ref .(d k − µ k )<br />
σ k<br />
− µ ref (3.5)
42 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Detector Terra Band 27 Terra Band 30 Terra Band 33<br />
– Mean value Std <strong>de</strong>viation Mean value Std <strong>de</strong>viation Mean value Std <strong>de</strong>viation<br />
d 1 12982 1043.6 16933 2441.9 23072 1660.9<br />
d 2 12982 1043.6 16933 2441.4 23072 1660.9<br />
d 3 12982 1043.7 16934 2442.5 23072 1661.1<br />
d 4 12981 1043.7 16934 2442.1 23072 1661.3<br />
d 5 12982 1043.9 16934 2442.1 23072 1661.6<br />
d 6 12982 1043.9 16934 2442.1 23072 1661.0<br />
d 7 12984 1044.1 16934 2442.0 23072 1661.0<br />
d 8 12981 1044.0 16934 2442.0 23072 1660.9<br />
d 9 12980 1044.0 16934 2442.0 23072 1660.9<br />
d 10 12980 1043.9 16934 2442.0 23072 1660.6<br />
Table 3.1 – Mean/standard <strong>de</strong>viation values (DN) of 10 <strong>de</strong>tectors for Terra<br />
MODIS bands 27, 30 and 33. The small statistical <strong>de</strong>viation between <strong>de</strong>tectors<br />
discredits the application of moment matching on MODIS data<br />
The moment matching technique only rectifies first/second or<strong>de</strong>r statistics and as such<br />
requires a careful selection of the reference signal. If a <strong>de</strong>tector with strong statistical<br />
<strong>de</strong>viations from others (a <strong>de</strong>tector responsible for random stripes for exemple) is used<br />
as a reference, moment matching can result in very poor <strong>de</strong>striping. Many strategies based<br />
on the analysis of inter-<strong>de</strong>tector response statistics can be used (see section 3.4). A<br />
common option is to rely on mean/standard <strong>de</strong>viation values computed over the entire<br />
scene. Altough the simplicity of its implementation makes it a popular technique, moment<br />
matching suffers from many limitations <strong>de</strong>scribed in [Horn and Woodham, 1979]. A major<br />
issue pointed out on MSS is the impact of non-linearities in photomultipliers responses,<br />
presumably abscent in more sophisticated imaging <strong>de</strong>vices. Mean/standard <strong>de</strong>viation values<br />
reported in tables 3.1, 3.2 and experiments conducted on both Terra and Aqua MODIS<br />
data, illustrate how moment matching only results in partial <strong>de</strong>striping (figure 3.3). In<strong>de</strong>ed,<br />
the gain/offset mo<strong>de</strong>l only modifies the affine response of the <strong>de</strong>tectors and fails to<br />
take into account non-linear effects, highly responsible for residual stripes. Local analysis<br />
of MODIS swaths reveals a <strong>de</strong>pen<strong>de</strong>ncy of <strong>de</strong>tectors linear response to the signal intensity.<br />
This can be verified experimentally by estimating gains/offsets from swaths covering<br />
different levels of radiances (oceans and clouds). Furthermore, first or<strong>de</strong>r statistics make<br />
the method very sensitive to the geophysical content of the images. In many cases, small<br />
clouds or other highly reflective targets, are only visible by a limited set of <strong>de</strong>tectors and<br />
the resulting statistical bias is not accounted for in the moment matching procedure.<br />
3.3 Histogram Matching<br />
The hypothesis of linear and stationnary response exploited by the moment matching<br />
method is too strong to provi<strong>de</strong> reliable results on MODIS data. Investigation of<br />
tables 3.1, 3.2 shows that on Terra/Aqua bands severely contaminated with stripes, <strong>de</strong>tectors<br />
have very similar mean/standard <strong>de</strong>viation values. The visual examination of su-
Figure 3.2 – Sub-images acquired by each of the 10 <strong>de</strong>tectors of Terra MODIS in band<br />
27. From Top to bottom and left to right, signals from <strong>de</strong>tectors d 1 to d 10 . Visual analysis<br />
indicates that stripes are not only due to differences between mean values and variances<br />
of adjacent <strong>de</strong>tectors. Images <strong>de</strong>rived from some individual <strong>de</strong>tectors also display strong<br />
striping. This is clearly visible for <strong>de</strong>tectors 1 and 6<br />
43
44 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.3 – (Left) Noisy image from Terra MODIS band 27 (Right) Image <strong>de</strong>striped<br />
with moment matching<br />
Detector Aqua Band 27 Aqua Band 30 Aqua Band 36<br />
– Mean value Std <strong>de</strong>viation Mean value Std <strong>de</strong>viation Mean value Std <strong>de</strong>viation<br />
d 1 14026 3508.2 14684 2872.0 22497 1420.3<br />
d 2 14026 3508.1 14685 2871.7 22497 1420.4<br />
d 3 14027 3507.8 14685 2871.2 22498 1420.3<br />
d 4 14027 3508.3 14685 2871.0 22498 1420.5<br />
d 5 14027 3508.4 14685 2870.9 22497 1420.7<br />
d 6 14028 3508.3 14685 2870.9 22498 1420.8<br />
d 7 14028 3508.2 14686 2870.6 22498 1420.8<br />
d 8 14027 3507.2 14685 2870.6 22498 1420.6<br />
d 9 14029 3508.3 14686 2870.3 22498 1420.6<br />
d 10 14030 3508.5 14687 2870.2 22499 1420.6<br />
Table 3.2 – Mean/standard <strong>de</strong>viation values of 10 <strong>de</strong>tectors for Aqua MO-<br />
DIS bands 27, 30 and 36<br />
bimages extracted from individual <strong>de</strong>tectors (figure 3.2) shows evi<strong>de</strong>nce of striping. This<br />
means that suddle <strong>de</strong>viations occur within a single <strong>de</strong>tector between two consecutive scan<br />
sweeps. Given the short time period between two scans, 1.477 seconds, these intra-<strong>de</strong>tector<br />
<strong>de</strong>viations cannot be related to a potential physical <strong>de</strong>gradation but are very likely to be<br />
induced by the on-board calibration procedure itself ; For instance, the blackbody (section<br />
) provi<strong>de</strong>s a two-point calibration for all emmissive bands every 1.477s.<br />
The inefficiencies of moment matching due to non linear effects on MSS, gave rise to an<br />
improved method. To overcome the limitations of first or<strong>de</strong>r statistics, [Horn and Woodham,<br />
1979] introduced a refined approach where the probability distribution function of<br />
scene radiances captured by each <strong>de</strong>tector is assumed to be i<strong>de</strong>ntical. In fact, radiations<br />
emmitted or reflected by the earth reach all the <strong>de</strong>tectors with approximatively the same
45<br />
magnitu<strong>de</strong>. The <strong>de</strong>rived technique, histogram matching, then consists in adjusting the empirical<br />
cumulative distribution function (ECDF) of each <strong>de</strong>tector to an ECDF selected as<br />
reference. Let us consi<strong>de</strong>r the signal measured by <strong>de</strong>tector k as a discrete random variable<br />
X k , with a probability distribution p k (x). The ECDF of X k is <strong>de</strong>fined as :<br />
and computed as :<br />
P k (x) =P (X k ≤ x) (3.6)<br />
P k (x) =<br />
x∑<br />
p k (i) (3.7)<br />
We consi<strong>de</strong>r P ref to be the ECDF of a reference <strong>de</strong>tector, x is a value measured by <strong>de</strong>tector<br />
k and x ′ its corresponding corrected value. Forcing <strong>de</strong>tector k to have the same ECDF as<br />
the reference <strong>de</strong>tector, the following relation holds :<br />
i=0<br />
P ref (x ′ )=P k (x) (3.8)<br />
The ECDF P ref is a non increasing function and can be inversed to <strong>de</strong>termine an estimate<br />
value of x ′ as :<br />
x ′ = P −1<br />
ref (P k(x)) (3.9)<br />
When applied to the set of acquired values, equation (3.9) provi<strong>de</strong>s a normalization lookup<br />
table that associates to every signal value x, its corrected value x ′ (figures 3.4 and 3.5).<br />
Analogously to moment matching, the reference <strong>de</strong>tector can be <strong>de</strong>termined experimentally<br />
from the analysis of each <strong>de</strong>tector or by selecting the ECDF of the entire swath.<br />
Following the results obtained on Landsat MSS, the histogram matching method was<br />
later used in 1985 by [Poros and Peterson, 1985] for the <strong>de</strong>striping of Landsat TM. The limitations<br />
of histogram matching were first discussed in [Wegener, 1990] and a modification<br />
of the original approach was introduced to reinforce the assumption of similar <strong>de</strong>tectors<br />
ECDFs. The consi<strong>de</strong>rable size of captured swaths systematically garantees the acquisition<br />
of geophysical data diverse enough in terms of radiances to contradict the hypothesis of<br />
statistically i<strong>de</strong>ntical ECDFs. Wegener suggested to constrain the estimation of <strong>de</strong>tectors<br />
statistics to the only homogeneous regions of the swath. In his approach, a noisy image<br />
is <strong>de</strong>composed into subimages which size is a multiple of the number of <strong>de</strong>tectors in the<br />
instrument. In the case of Landsat MSS, images are fragmented into blocs of 12 × 12<br />
pixels (MSS has 6 <strong>de</strong>tectors), and used for the computation of ECDFs if they satisfy a<br />
homogeneous criteria established by Bienaymé-Tchebychev inequality :<br />
P (|x − µ| > kσ) ≤ k −2 (3.10)<br />
where µ and σ are mean/standard <strong>de</strong>viation values of a subimage, and k ≤ 1 a real number<br />
that <strong>de</strong>termines the percentage of rejected sub-images.<br />
Another interesting implementation of histogram matching was introduced by [Weinreb<br />
et al., 1989], for the <strong>de</strong>striping of meteorological data acquired by GOES (Geostationary
46 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d1<br />
d7<br />
d8<br />
d9<br />
d10<br />
9000 10500 12000 13500 15000 16500<br />
Radiance values<br />
Corrected Radiances<br />
16000<br />
14000<br />
12000<br />
10000<br />
8000<br />
d1<br />
d7<br />
d8<br />
d9<br />
d10<br />
6000<br />
6000 8000 10000 12000 14000 16000<br />
Measured Radiances<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d1<br />
d3<br />
d5<br />
d6<br />
d8<br />
12000 14000 16000 18000 20000 22000<br />
Radiance values<br />
Corrected Radiances<br />
16000<br />
14000<br />
12000<br />
10000<br />
8000<br />
d1<br />
d3<br />
d5<br />
d6<br />
d8<br />
6000<br />
6000 8000 10000 12000 14000 16000<br />
Measured Radiances<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d1<br />
d2<br />
d5<br />
d7<br />
d9<br />
20000 21500 23000 24500 26000<br />
Radiance values<br />
Corrected Radiances<br />
25000<br />
22000<br />
19000<br />
16000<br />
13000<br />
d1<br />
d2<br />
d5<br />
d7<br />
d9<br />
10000<br />
10000 13000 16000 19000 22000 25000<br />
Measured Radiances<br />
Figure 3.4 – (Left) From top to bottom, Empirical Cumulative Distribution Functions<br />
for noisy <strong>de</strong>tectors of Terra MODIS bands 27, 30 and 33. (Right) From top to bottom,<br />
Normalization Look-up table for the same <strong>de</strong>tectors obtained with the histogram matching<br />
technique (IMAPP) and used to correct striping. Nonlinear effects are highly present in<br />
the low-radiance range<br />
Operational Environmental Satellites). The methodology was <strong>de</strong>dicated to the pre-launch<br />
calibration of the 8 <strong>de</strong>tectors composing GOES I-M (launched by NOAA in 1990). While<br />
the original method of [Horn and Woodham, 1979] <strong>de</strong>rives and applies a normalization
47<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d3<br />
d6<br />
d8<br />
d9<br />
d10<br />
6000 9000 12000 15000 18000 21000<br />
Radiance values<br />
Corrected Radiances<br />
18000<br />
15000<br />
12000<br />
9000<br />
6000<br />
d3<br />
d6<br />
d8<br />
d9<br />
d10<br />
3000<br />
3000 6000 9000 12000 15000 18000<br />
Measured Radiances<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d3<br />
d4<br />
d8<br />
d9<br />
d10<br />
7000 10000 13000 16000 19000 22000<br />
Radiance values<br />
Corrected Radiances<br />
17000<br />
14000<br />
11000<br />
8000<br />
d3<br />
d4<br />
d8<br />
d9<br />
d10<br />
5000<br />
5000 8000 11000 14000 17000<br />
Measured Radiances<br />
ECDF<br />
1<br />
0.9<br />
0.8<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
0.1<br />
0<br />
d1<br />
d2<br />
d3<br />
d4<br />
d8<br />
18000 19500 21000 22500 24000 25500<br />
Radiance values<br />
Corrected Radiances<br />
24000<br />
22000<br />
20000<br />
18000<br />
d1<br />
d2<br />
d3<br />
d4<br />
d8<br />
16000<br />
16000 18000 20000 22000 24000<br />
Measured Radiances<br />
Figure 3.5 – (Left) From top to bottom, Empirical Cumulative Distribution Functions<br />
for noisy <strong>de</strong>tectors of Aqua MODIS bands 27, 30 and 36. (Right) From top to bottom,<br />
Normalization Look-up table for the same <strong>de</strong>tectors obatined with the histogram matching<br />
technique (IMAPP). Comparison with Terra normalization look-up table indicates<br />
a improved pre-launch calibration<br />
look-up table to a single image, Weinreb suggests using the same table to process in<strong>de</strong>pen<strong>de</strong>nt<br />
acquisitions. The normalization table is generated from a specific sample covering<br />
a wi<strong>de</strong> dynamic range of radiances. An image acquired by GOES-7 on May 18, 1988 was
48 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.6 – (Left) Noisy image from Terra MODIS band 27 (Right) Image <strong>de</strong>striped<br />
with histogram matching (IMAPP)<br />
used to establish the 8 <strong>de</strong>tectors normalization curves. The look-up table was then successfully<br />
applied to <strong>de</strong>stripe an in<strong>de</strong>pen<strong>de</strong>nt image collected two weeks later on June 1,<br />
1988.<br />
More recently, this approach was adopted by [Xiaoxiang et al., 2007] for the <strong>de</strong>striping of<br />
CMODIS (SZ-3 Chinese MODIS) data.<br />
It is currently implemented in the NASA IMAPP (International MODIS/AIRS Processing<br />
Package) software and distributed by the university of Madison-Wisconsin for MODIS<br />
users (http ://cimss.ssec.wisc.edu/imapp/). Additional features specific to MODIS data<br />
have been inclu<strong>de</strong>d in the software. Two sets of look-up tables were <strong>de</strong>veloped for both<br />
Terra and Aqua MODIS, and their application <strong>de</strong>pends on the acquisition date of images to<br />
be <strong>de</strong>triped. The comparative study of section 3.8 uses the histogram matching technique<br />
implemented in the NASA IMAPP software.<br />
3.4 Overlapping Field-of-View Method<br />
The Overlapping Field-of-View method (OFOV) was specifically <strong>de</strong>signed for MODIS.<br />
Its basic principle was introduced by [Antonelli et al., 2004] and recently examined by<br />
[di Bisceglie et al., 2009]. This technique relies on another artifact of MODIS, the bowtie<br />
effect. When the scan angle of the mirror increases, the actual resolution of pixels also<br />
increases due to the earth curvature. The nominal resolution of a pixel is 1 × 1 km at<br />
Nadir and reaches 4.8 × 2km at the begining and ending of every scan, which correspond<br />
to scan angles of ±55˚. As a result of pixel resolution growth, a swath will cover an<br />
exten<strong>de</strong>d area of 20km along track at scan extremums, causing overlaps with previous<br />
and next swaths (figure 3.7a). Areas affected with the bowtie effect will display i<strong>de</strong>ntical
49<br />
Figure 3.7 – (Left) Bowtie effect due to the growth of pixel size in the cross track<br />
direction of a swath (Right) Image from Terra MODIS band 17, extracted from an area<br />
with a scan angle raging from 47˚ to 55˚. Bowtie effect appears as overlapping fields of<br />
view.<br />
geometrical features in successive scans. This is clearly visible along land/ocean transitions<br />
(figure 3.7b). The OFOV method then exploits the information redundancy to equalize<br />
the <strong>de</strong>tectors responses. In the bowtie region (areas corresponding to scan angles higher<br />
than ±25˚), some of MODIS <strong>de</strong>tectors are viewing exactly the same scene and, therefore<br />
thus <strong>de</strong>viations in the <strong>de</strong>tectors reponses are only due to stripe noise. The OFOV algorithm<br />
is divi<strong>de</strong>d in two steps. Following the classification of the <strong>de</strong>tectors as in-family and outof<br />
family <strong>de</strong>tectors, a reference <strong>de</strong>tector is selected and equalization functions are <strong>de</strong>rived<br />
using only bow-tie measurements. The equalization curves are then applied to the <strong>de</strong>tectors<br />
over the entire swath. To assess the accuracy of relative inter-<strong>de</strong>tectors calibration, a Bowtie<br />
Based Detector Distance (BTBDD) between <strong>de</strong>tectors i and j is <strong>de</strong>fined as :<br />
d i,j =<br />
∑ Ni,j<br />
n=1 |I i(n) − I j (n)| .W (n)<br />
∑ Ni,j<br />
n=1 W (n) (3.11)<br />
where N i,j is the number of OFOVs of <strong>de</strong>tectors i and j, with an overlapping percentage<br />
above η, a value fixed to 65%. I i (n) (respectively I j (n)) is the radiance measured by<br />
<strong>de</strong>tector i (respectively j) on the n th OFOV and W (n) is the overlapping percentage. In<br />
addition to the BTBDD distances, the similarity between <strong>de</strong>tectors ECDFs is computed<br />
using the Kolmogorov-Smirnov distance :<br />
D i,j = 1<br />
N obs<br />
N obs<br />
∑<br />
|P i (r(n)) − P j (r(n))| (3.12)<br />
n
50 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Table 3.3 – Mean Kolmokorov-Smirnov <strong>de</strong>tectors distance for bands 27, 30<br />
and 33 for Terra MODIS and 27, 30 and 36 for Aqua MODIS<br />
– Terra Aqua<br />
Detector Band 27 Band 30 Band 33 Band 27 Band 30 Band 36<br />
d 1 0.3544 0.1108 0.0413 0.0265 0.0114 0.0189<br />
d 2 0.1637 0.0253 0.0150 0.0253 0.0113 0.0142<br />
d 3 0.1624 0.0261 0.0149 0.0338 0.0120 0.0192<br />
d 4 0.1604 0.0253 0.0140 0.0246 0.0130 0.0139<br />
d 5 0.1562 0.0312 0.0181 0.0245 0.0111 0.0114<br />
d 6 0.1579 0.0273 0.0130 0.0278 0.0111 0.0106<br />
d 7 0.1973 0.0259 0.0154 0.0255 0.0106 0.0118<br />
d 8 0.2188 0.0429 0.0142 0.0958 0.0125 0.0135<br />
d 9 0.3195 0.0260 0.0218 0.0353 0.0134 0.0134<br />
d 1 0 0.2587 0.0248 0.0152 0.0514 0.0379 0.0140<br />
where P i and P j are the ECDFs of <strong>de</strong>tectors i and j, and r(n) is the set of radiances<br />
observed by both <strong>de</strong>tectors. The Kolmogorov-Smirnov distance measures the distributional<br />
distance for every couple of <strong>de</strong>tectors and can be averaged for a single <strong>de</strong>tector i ≠ j as :<br />
D i =<br />
1<br />
card(M i ) − 1<br />
∑<br />
D i,j<br />
(3.13)<br />
where M i is the set of <strong>de</strong>tectors. [Antonelli et al., 2004] and [di Bisceglie et al., 2009],<br />
specify that the classification of <strong>de</strong>tectors and the selection of a reference one is <strong>de</strong>termined<br />
from both BTBDD and Kolmogorov-Smirnov distances. However, it is not mentioned how<br />
this is done. As an alternative, we will rely only on the Kolmogorov-Smirnov distances ;<br />
the weakest value D M i<br />
i<br />
<strong>de</strong>termines the reference <strong>de</strong>tector to be used for the radiometric<br />
equalization. Let us <strong>de</strong>note by B r (n) and B i (n) the set of radiances measured in the<br />
bowtie region by a reference <strong>de</strong>tector r and a noisy <strong>de</strong>tector i. The equalization function<br />
is obtained with a polynomial regression between B r (n) and B i (n) :<br />
j∈M i<br />
j≠i<br />
B r (n) =p 0 + p 1 .B i (n)+p 2 .B 2 i (n)+... + p N .B N i (n) (3.14)<br />
where p 0 , p 1 ...p N are the coefficients of the best fitting polynome. The radiometric equalisation<br />
of the signal I i (n) measured by the <strong>de</strong>tector i over the entire swath is then corrected<br />
as :<br />
Î i (n) =p 0 + p 1 .I i (n)+p 2 .I 2 i (n)+... + p N .I N i (n) (3.15)<br />
All the other <strong>de</strong>tectors are corrected with the same procedure. Destriping results obtained<br />
with the OFOV technique are illustrated in figure 3.7. When the equalization is based on<br />
polynomial functions of or<strong>de</strong>r 1, the OFOV method might be comparable to the moment<br />
matching technique because only the affine response of the <strong>de</strong>tectors is modified. However,<br />
while moment matching is based on statistical assumptions satisfied only over homogeneous<br />
areas, the OFOV method relies entirely on the bowtie effect to equalize the <strong>de</strong>tectors
51<br />
Figure 3.8 – (Left) Noisy image from Terra MODIS band 27 (Right) Image <strong>de</strong>striped<br />
with the IFOV method<br />
response. To this extent, the OFOV method can be viewed as a radiometric calibration<br />
procedure. It is worth mentionning that only the range of radiances contained in the bowtie<br />
region is corrected and additional processing is required to cover the entire dynamic<br />
range of the acquired signal. In our implementation, the equalization functions were <strong>de</strong>rived<br />
from measurements with scan angles higher than ±25˚. Linear and quadratic fitting<br />
computed on the selected images showed little differences and only first or<strong>de</strong>r polynomes<br />
were used. Radiance values not contained in the bowtie region were not equalized.<br />
3.5 Frequency filtering<br />
Frequency filtering methods has been wi<strong>de</strong>ly used for the elimination of stripes on<br />
satellite images. [Srinivasan et al., 1988] proposed a new approach for Landsat TM and<br />
MSS based on a spectral analysis of the stripe noise. Despite extensive research in this<br />
direction [Crippen, 1989], [Simpson et al., 1995], [Simpson et al., 1998], [Chen et al., 2003]<br />
and good visual results on GOES and Landsat sensors, frequency filtering can only be<br />
viewed as a cosmetic improvement. The smoothed results obtained with low-pass filtering<br />
can nonetheless be used as a reference to compare the performances of other <strong>de</strong>triping<br />
techniques. In this subsection, we briefly explore the application of frequency filtering on<br />
MODIS data.<br />
3.5.1 Spectral Analysis<br />
In most cases, striping can be consi<strong>de</strong>red as a periodic noise. The application of a lowpass<br />
filter (an averaging filter in the spatial domain for exemple) reduces the visual impact
52 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.9 – (Left) Noisy image from Terra MODIS band 27 (Right) Module of its<br />
fourier transform, showing lobes in the vertical axis of the fourier domain<br />
of stripes but inevitably removes fine structures of the signal and, therefore compromisies<br />
further quantitative analysis. To minimize the loss of high-frequency information, the<br />
filtering procedure shall take into account the periodic nature of stripes prior to the <strong>de</strong>sign<br />
of a band-pass filter. Stripe-related frequencies are <strong>de</strong>termined from the spectrum of the<br />
noisy image I s , which we consi<strong>de</strong>r as a two dimensional vector of size M × N. Its discrete<br />
fourier transform is given by :<br />
I F s (u, v) =<br />
M∑<br />
N∑<br />
i=1 k=1<br />
( ( jui<br />
I s (i, k)exp −<br />
2πM + jvk ))<br />
2πN<br />
(3.16)<br />
where j is the imaginary unity (j = √ −1). Periodic stripes on images translate in the<br />
fourier spectrum as a signature taking the form of multiple lobes, concentrated along the<br />
vertical axis (figure 3.9b). An accurate estimation of periodic stripe frequencies requires a<br />
distinction from the frequencies related to the true signal structures. For instance, the frequency<br />
power spectrum estimated on the striped signal values, barely reveals the presence<br />
of periodic noise (figure 3.10a). The spectral components of stripes can be highlighted<br />
using the averaging method of<br />
3.5.2 Band-pass filtering<br />
The spectral analysis of MODIS data <strong>de</strong>scribed above, i<strong>de</strong>ntifies the frequencies to be<br />
reduced. [Simpson et al., 1995] proposed several possible implementations of Finite Impulsional<br />
Response (FIR) filters. The approach we retain here is based on a two-dimensional<br />
filter in fourier space composed of wells centered at stripe frequencies. The band-pass filter
53<br />
12<br />
11<br />
10<br />
10<br />
Power spectrum<br />
8<br />
6<br />
4<br />
2<br />
0<br />
Power spectrum<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
−2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
3<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
Figure 3.10 – (Left) Power spectrum computed directly on the noisy image, frequncies<br />
of striping are not visible (Right) Power spectrum computed as an average of the columns<br />
periodograms ; striping frequencies appear as distinct peaks<br />
1<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
1<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
u<br />
u<br />
v<br />
v<br />
Figure 3.11 – Frequency response of the filter H 1 . As the value of σ increases, the wells<br />
(represented here as lobes for visual clarity) overlap. When frequencies located near the<br />
center of fourier domain are reached by the lobes, the band-pass filter H 1 becomes a high<br />
pass filter<br />
takes the form :<br />
H 1 (u, v) =1− ∑<br />
(u s,v s)<br />
exp<br />
(− (u − u s) 2 +(v − v s ) 2 )<br />
σ 2<br />
(3.17)<br />
where u s and v s are the center coordinates of the wells in the fourier domain and σ<br />
controls the sharpness of the wells. The <strong>de</strong>sign of the FIR filter H 1 in the fourier 2D<br />
domain, implicitly takes into account the unidirectional spatial property of stripes noise<br />
by placing the wells along the vertical axis, centered at the same coordinates as the stripe<br />
lobes observed in figure 3.8. With increasing values of σ, the wells start to overlap with<br />
each other and eventually affect low-frequencies (figure 3.11b). For high values of σ, the<br />
filter H 1 shifts from a band-pass filter to a high-pass filter that removes all the low-pass
54 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.12 – (Left) Original image from Terra MODIS band 27 (Right) Image <strong>de</strong>striped<br />
with the filter H 1<br />
components. This results in high-pass filtered images containing mostly stripe noise. In<br />
addition, the mean value of filtered images differs from the original signal. To overcome<br />
this issue, we consi<strong>de</strong>r the following low-pass filter :<br />
H B (u, v) =exp<br />
(− u2 + v 2 )<br />
σ 2 B<br />
(3.18)<br />
where σ B is small enough so that the filter H B mainly retrieves the mean value of the<br />
noisy image. The <strong>de</strong>striped image is then obtained with the filter :<br />
H 2 (u, v) =H 1 (u, v)+H B (u, v) (3.19)<br />
An alternative implementation of the FIR filter can be done in the spatial domain by<br />
convolving each column with a unidimensional spatial FIR filter kernel <strong>de</strong>rived from the<br />
Parks-McClellan (PM) algorithm [Parks and Mcclellan, 1972]. Destriping in the spatial<br />
domain overcomes many limitations compared to the 2D fourier filtering. It removes the<br />
constraints related to images dimensions being a power of two and slightly reduces horizontal<br />
edge effects.<br />
Another FIR filtering approach was presented in [Srinivasan et al., 1988] for the <strong>de</strong>striping<br />
of Landsat. The fourier response of the proposed filter is composed of concentric<br />
rings centered at stripe frequencies. This method however, smoothes data equally in both<br />
directions and introduces blurring and ringing artefacts along the discontinuities of the<br />
images.
55<br />
Image distortion ID<br />
1<br />
0.98<br />
0.96<br />
0.94<br />
0.92<br />
0.9<br />
0.88<br />
0.86<br />
0.84<br />
0<br />
0 10 20 30 40 50<br />
σ<br />
ID<br />
NR<br />
2000<br />
1600<br />
1200<br />
800<br />
400<br />
Noise reduction NR<br />
Image distortion ID<br />
1<br />
0.98<br />
0.96<br />
0.94<br />
0.92<br />
0.9<br />
0.88<br />
0.86<br />
0.84<br />
ID<br />
NR<br />
30<br />
25<br />
20<br />
15<br />
10<br />
0<br />
0 10 20 30 40 50<br />
σ<br />
5<br />
Noise reduction NR<br />
Figure 3.13 – ID and NR in<strong>de</strong>xes as a function of σ in the filter H 2 for images of (Left)<br />
Terra band 27 and (Right) Terra band 30. The value of σ B is fixed to 5. Images from band<br />
27 are representative of smooth atmospheric effects and therefore, small scale structures<br />
in the images are mostly due to striping. In (Left) for σ > 21, the filter H 2 behaves<br />
as a high-pass filter that retains only high-frequency components, coinci<strong>de</strong>nt with stripe<br />
noise, hence the <strong>de</strong>crease in NR. This effect is not visible on images from band 30 where<br />
high-frequencies are composed of land-ocean-clouds discontinuities.<br />
3.6 Haralick Facet filtering<br />
Destriping techniques <strong>de</strong>scribed this far are only <strong>de</strong>dicated to only periodic stripes<br />
and fail to process random stripes. Application on images extracted from Terra MODIS<br />
band 33 do not display any improvement (and therefore are not illustrated). The study<br />
presented in [Rakwatin et al., 2007] was the first to tackle the issue of random stripes on<br />
MODIS. Rakwatin proposed an hybrid approach that combines histogram matching for<br />
the removal of <strong>de</strong>tector-to-<strong>de</strong>tector stripes and mirror banding, with an iterated weighted<br />
least squares facet filtering for random stripes. The facet mo<strong>de</strong>l introduced in [Haralick and<br />
Watson, 1981] <strong>de</strong>composes a given image into connected facets. A given pixel is contained<br />
in K 2 different blocks each composed of K × K pixels.<br />
For a pixel i, we <strong>de</strong>note W i,k a resolution cellcomposed of k = {1, .., K × K} neighbooring<br />
pixels. A given pixel is contained in several resolution cells as they overlap with each other.<br />
Let us <strong>de</strong>note by J ik (r, c) the signal value at row r and column c in the resolution cell<br />
W ik . Haralick’s sloped facet mo<strong>de</strong>l assumes that J ik (r, c) can be expressed as :<br />
J ik (r, c) =α ik r + β ik c + γ ik + n ik (r, c) (3.20)<br />
where α ik , β ik and γ ik represent the slope plan coefficients of the facet mo<strong>de</strong>l in the<br />
cell W ik and n ik is the noise. Denoting (−L, −L) (resp. (L, L)) the relative row-column<br />
coordinates of a cell upper-left corner (resp. lower-right corner), the values of a resolution<br />
cell slope plane coefficients can be estimated by minimizing the following quadratic energy
56 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
functional :<br />
E(α ik ,β ik ,γ ik )=<br />
L∑<br />
L∑<br />
r=−L c=−L<br />
(α ik r + β ik c + γ ik − J ik (r, c)) 2 (3.21)<br />
Least square estimates of the facet mo<strong>de</strong>l coefficients are obtained by consi<strong>de</strong>ring the<br />
partial <strong>de</strong>rivatives of the functional E with respect to α ik , β ik and γ ik and lead to the<br />
following :<br />
α ik =<br />
β ik =<br />
γ ik =<br />
3<br />
L(L + 1)(2L + 1) 2<br />
3<br />
L(L + 1)(2L + 1) 2<br />
1 ∑<br />
L<br />
(2L + 1) 2<br />
L∑<br />
r=−L c=−L<br />
L ∑<br />
r=−L<br />
L ∑<br />
c=−L<br />
r<br />
c<br />
L∑<br />
c=−L<br />
L∑<br />
r=−L<br />
J ik (r, c)<br />
J ik (r, c)<br />
J ik (r, c)<br />
(3.22)<br />
Let us consi<strong>de</strong>r the particular case where L = 1, which corresponds to blocks composed<br />
of 3 × 3 pixels. Using the least square estimates of α ik , β ik and γ ik from equation (3.22)<br />
with L = 1 , Ĵ ik (r, c) can be written as :<br />
Ĵ ik (r, c) = 1 18 [(−3r − 3c + 2)J ik(−1, −1) + (−3r + 2)J ik (−1, 0) + (−3r +3c + 2)J ik (−1, 1)<br />
+(−3c + 2)J ik (0, −1) + 2J ik (0, 0) + (3c + 2)J ik (0, 1)<br />
+(3r − 3c + 2)J ik (1, −1) + (3r + 2)J ik (1, 0) + (3r +3c + 2)J ik (1, 1)]<br />
(3.23)<br />
Each 3 × 3 pixels block is represented by a set of 9 coefficients and is associated with an<br />
estimate error <strong>de</strong>fined as :<br />
L<br />
ɛ 2 ik (r, c) =<br />
∑<br />
L∑<br />
r=−L c=−L<br />
) 2 (Ĵik (r, c) − J ik (r, c)<br />
(3.24)<br />
In the original approach introduced in [], the value of a pixel is <strong>de</strong>termined using the slope<br />
coefficients of the block which induces minimal error ɛ ik . Another alternative proposed in<br />
Li and Tam [2000] is to estimate the value at pixel i with an iterative procedure :<br />
Ĵ (n+1)<br />
ik<br />
=<br />
L∑<br />
L∑<br />
r=−L c=−L<br />
w ik (r, c)Ĵ (n)<br />
ik<br />
(3.25)<br />
The weighting coefficients w ik <strong>de</strong>pend on the estimate errors obtained for each bloack and<br />
are computed as :<br />
(<br />
)<br />
L∑ L∑<br />
w ik (r, c) =1/ ɛ ik (r, c) ɛ −1<br />
ik (r, c) (3.26)<br />
r=−L c=−L
57<br />
Figure 3.14 – (Left) Image from Terra MODIS band 33 affected mostly with random<br />
stripes (Right) Destriped result obtained after histogram matching and Haralick’s sloped<br />
facet mo<strong>de</strong>l filtering.<br />
The application of Haralick’s mo<strong>de</strong>l is not <strong>de</strong>voted to the correction of periodic stripes and<br />
Rakwatin et al. suggest using the iterative facet filtering procedure only on specific pixels.<br />
Detector-to-<strong>de</strong>tector stripes are initially corrected via the histogram matching technique.<br />
Lines acquired by noisy <strong>de</strong>tectors are then visually <strong>de</strong>tected and processed with the sloped<br />
facet mo<strong>de</strong>l. In pratice, we selected a facet window of size 3 × 3 pixels. As the number of<br />
iterations of the weighted facet filtering procedure increases (3.25), the visual impact of<br />
random stripes <strong>de</strong>creases. For the image from Terra MODIS band 33, 10 iterations were<br />
required to achieve a cosmetic improvement (see figure 3.14).<br />
3.7 Multiresolution approach<br />
3.7.1 Limitations of fourier transform<br />
The Fourier transform is a remarquable tool in signal processing. Shifting to the frequency<br />
domain offers the possibility to extract information that would otherwise be unperceptible<br />
in the spatial or temporal domain. Nevertheless, the fourier transform has a<br />
major drawback. The shift in fourier domain is inevitably followed by a loss of temporal/spatial<br />
information ; The frequency of a given event can only be known at the expense<br />
of it occuring times. A compromise can be achieved with the short-term fourier transform<br />
(STFT). It consists in limiting the computation of fourier transform to local portions of<br />
the signal, using a fixed size sliding analysing window. The Heiseinberg principle then<br />
highlights the limitations of the STFT ; For small sized windows, a good temporal localisation<br />
is achieved with approximative frequency localisation. For increasing windows size,
58 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
one eventually converges to the original fourier transform where temporal information is<br />
completely lost.<br />
3.7.2 Multiresolution analysis<br />
Multiresolution analysis, and more precisely wavelet transform constitutes a powerful<br />
alternative to fourier transform, exploited in numerous signal processing applications.<br />
Multiresolution analysis allows the <strong>de</strong>composition of a function f ∈ L 2 (R 2 ), as a sum of<br />
approximations associated with different resolution levels. In [Mallat, 2000], Mallat <strong>de</strong>fines<br />
an multiresolution approximation as a set of closed vector sub-spaces {V j } j∈Z that verify<br />
several properties among which :<br />
∀j ∈ Z, ⊂ V j+1 ⊂ V j ⊂ L 2 (R) (3.27)<br />
∀j ∈ Z,f(t) ∈ V j ⇔ f( t 2 ) ∈ V j+1 (3.28)<br />
The embedding property (3.27) of vector spaces {Vj} ensures that the approximation of<br />
the function f at resolution 2 j is obtained from an approximation at a higher resolution<br />
2 j+1 . The property (3.28) garantees that the projection of f on the space V j contains<br />
twice as much <strong>de</strong>tails as the projection on the space V j+1 . Denoting φ, a function ∈ L 2 (R)<br />
which translations {φ(t − k)} k∈Z form an orthonormal basis of the space V 0 , it is shown<br />
that the family of functions {φ j,k } k∈Z obtained as dilatations and translations of φ is an<br />
orthonormal basis of V j where :<br />
φ j,k = 1 √<br />
2 j φ ( t<br />
2 j − k )<br />
(3.29)<br />
The function φ, known as scale function or father wavelet, is dilated and translated to<br />
form an orthonormal basis of the space V j , where the orthorgonal projection of a function<br />
f <strong>de</strong>fines its approximation at the resolution 2 −j .<br />
3.7.3 Wavelet basis<br />
Going from a resolution 2 j to a lower resolution 2 j+1 , leads to a loss of information.<br />
Details visible in the approximation of resolution 2 j are lost at the resolution 2 j+1 . The<br />
embedding property of multiresolution approximations and the inclusion of vector space<br />
V j in V j−1 can be used to <strong>de</strong>fine the space of <strong>de</strong>tails W j as the orthogonal complementary<br />
of V j in V j−1 :<br />
V j−1 = V j ⊕ W j (3.30)<br />
Similarly to the vector space of approximations V 0 , it is shown that the space of <strong>de</strong>tails W 0<br />
is generated from an orthonormal basis composed of translated version {ψ(t − k)} k∈Z of a
59<br />
function ψ, the mother wavelet. The family of functions {ψ j,k } k∈Z obtained as dilatations<br />
and translations of ψ is an orthonormal basis of W j and is expressed as :<br />
ψ j,k = √ 1 ( ) t<br />
ψ<br />
2 j 2 j − k (3.31)<br />
The wavelet transform of a function f then provi<strong>de</strong>s the approximation coefficients <strong>de</strong>noted<br />
a j [k] and the <strong>de</strong>tails coefficients d j [k]. These are obtained by projecting f on the vector<br />
spaces V j and W j :<br />
a j [k] =< f, φ j,k > (3.32)<br />
d j [k] =< f, ψ j,k > (3.33)<br />
where the symbol < ., . > <strong>de</strong>notes the scalar product in L 2 (R).<br />
3.7.4 Filter banks<br />
The property (3.27) implies that the vector space V j is inclu<strong>de</strong>d in V j−1 . Then, any<br />
function in V j−1 can be written as a linear combination of a function in V j . If we consi<strong>de</strong>r<br />
a given sequence h[k], the function √ 1<br />
2<br />
φ ( t<br />
2)<br />
can be expressed with respect to the family<br />
of functions {φ(t − k)} k∈Z as :<br />
(<br />
1 t<br />
∞∑<br />
√ φ = h[k]φ(t − k) (3.34)<br />
2 2)<br />
where :<br />
k=−∞<br />
h[k] =< √ 1 φ( t ),φ(t − k) > (3.35)<br />
2 2<br />
W j being also a sub-space of V j−1 , the function √ 1<br />
2<br />
ψ ( t<br />
2)<br />
can be expressed with respect to<br />
the family of functions {φ(t − k)} k∈Z and a different sequence g[k] :<br />
where :<br />
1<br />
√<br />
2<br />
ψ<br />
( t<br />
=<br />
2)<br />
∞∑<br />
k=−∞<br />
g[k]φ(t − k) (3.36)<br />
g[k] =< √ 1 ψ( t ),φ(t − k) > (3.37)<br />
2 2<br />
Equations (3.34) and (3.36) are known as the two scale equations and are used to expresss<br />
the inter-scale relationship between the scaling function and the mother wavelet<br />
with respect to their translations and the coefficients of filters h[k] and g[k]. Through the<br />
combination of equations (3.32), (3.33), (3.34) and (3.36) it is shown that wavelet <strong>de</strong>composition<br />
and reconstruction are computed as a series of discrete convolutions with filters h<br />
and g. In the <strong>de</strong>composition stage, approximations and <strong>de</strong>tails coefficients are given with :<br />
∞∑<br />
a j+1 [k] = h[n − 2k]a j [n] =a j ⋆ h[2k] (3.38)<br />
n=−∞
60 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
d j+1 [k] =<br />
∞∑<br />
n=−∞<br />
g[n − 2k]d j [n] =d j ⋆ g[2k] (3.39)<br />
where h[k] =h[−k] and ⋆ is the convolution symbol. The approximation coefficients a j+1<br />
result from the convolution of approximations a j with the low-pass filter h, followed by<br />
a sub-sampling of factor 2. The sub-sampling operation consists in preserving only one<br />
coefficient out of two. Details coefficients d j+1 are <strong>de</strong>duced from the convolution of d j<br />
with the high-pass filter g. The reconstruction of the signal is obtained with the inverse<br />
wavelet transform :<br />
∞∑<br />
∞∑<br />
a j [k] = h[k − 2n]a j+1 [n]+ g[k − 2n]d j+1 [n]<br />
(3.40)<br />
n=−∞<br />
=ă j+1 ⋆h + ˘d j+1 ⋆g<br />
n=−∞<br />
The successive approximations a j are obtained with a convolution of signals ă j+1 and ˘d j+1<br />
with the filters h and g. ă results from an up-sampling of factor 2 of a, where zeros are<br />
inserted between succesive samples as :<br />
ă[2n] =a[n]<br />
ă[2n + 1] = 0<br />
(3.41)<br />
The <strong>de</strong>composition and illustration in filter banks is illustrated in figure . Filters ¯h, ḡ,<br />
h and g are quadrature mirror filters due to the orthogonality relation between h and g :<br />
3.7.5 2D wavelet basis<br />
g[k] = (−1) 1−n h[1 − k] (3.42)<br />
The wavelet <strong>de</strong>composition of a bidimensional signal f ∈ L 2 (R 2 ) can be seperately<br />
computed along its dimensions, using separable wavelet basis generated from the tensor<br />
product of unidimensional orthogonal wavelet basis. In the 2D case, the wavelet <strong>de</strong>composition<br />
is computed first on the lines and then on the columns (or inversely). The sequence<br />
{Vj 2}<br />
j∈Z <strong>de</strong>fined as Vj 2 = V j ⊗ V j is a separable multiresolution approximation of L 2 (R 2 ).<br />
Similarly to the unidimensional case, the space of <strong>de</strong>tails Wj<br />
2 is <strong>de</strong>fined as the orthogonal<br />
complementary of Vj 2 in Vj−1 2 : Vj−1 2 = Vj 2 ⊕ Wj 2 (3.43)<br />
An orthonormal wavelet basis of L 2 (R 2 ) can be constructed from the scaling functions<br />
φ and the mother wavelet ψ. To this prupose, let us <strong>de</strong>fine ∀(x, y) ∈ R 2 , the following<br />
wavelets :<br />
ψ 1 (x, y) =φ(x)φ(y)<br />
ψ 2 (x, y) =ψ(x)φ(y)<br />
ψ 3 (x, y) =ψ(x)ψ(y)<br />
(3.44)
61<br />
Figure 3.15 – (Left) Noisy image from Terra MODIS band 30 (Right) Wavelet <strong>de</strong>composition<br />
at two resolution levels showing that (1) stripe noise is isolated in the only<br />
horizontal <strong>de</strong>tails d 1 j (2) Wavelet coefficients associated with stripes have a magnitu<strong>de</strong> of<br />
the same or<strong>de</strong>r than those related to the image edges<br />
We then consi<strong>de</strong>r the dilated and translated versions of these wavelets <strong>de</strong>fined for k =1, 2, 3<br />
as :<br />
ψj,m,l k = 1 ( x − 2 j m<br />
2 j ψk 2 j , y − )<br />
2j l<br />
2 j (3.45)<br />
The wavelet family {ψj,m,l 1 ,ψ2 j,m,l ,ψ3 j,m,l } (m,l)∈Z 2 is an orthonormal basis of the <strong>de</strong>tails<br />
vector space Wj 2 and the family {ψ1 j,m,l ,ψ2 j,m,l ,ψ3 j,m,l } (j,m,l)∈Z3 is an orthonormal basis of<br />
L 2 (R 2 ).<br />
The separability of bidimensional wavelet basis is an interesting property for the multiresolution<br />
analysis of images. In fact, the wavelet family {ψj,m,l 1 ,ψ2 j,m,l ,ψ3 j,m,l } (m,l)∈Z 2 allows<br />
the extraction of <strong>de</strong>tails in the horizontal, vertical and diagonal directions. This particular<br />
feature is in<strong>de</strong>ed the main motivation behind the use of wavelet analysis for the striping issue.<br />
Wavelet <strong>de</strong>composition and reconstruction of a function f ∈ L 2 (R 2 ) is computed with<br />
separable bidimensional convolutions. Using the conjugate mirror filters h and g of the<br />
mother wavelet ψ, wavelet coefficients at level 2 j+1 are obtained from the approximation<br />
at level 2 j with :<br />
a j+1 [m, l] =a j ⋆ ¯h[m]¯h[l]<br />
d 1 j+1[m, l] =a j ⋆ ¯h[m]ḡ[l]<br />
d 2 j+1[m, l] =a j ⋆ ḡ[m]¯h[l]<br />
d 3 j+1[m, l] =a j ⋆ ḡ[m]ḡ[l]<br />
(3.46)<br />
The bidimensional wavelet <strong>de</strong>composition of an image contaminated with stripe noise is<br />
illustrated in figure 3.15.
62 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
3.7.6 Destriping with wavelet coefficient thresholding<br />
As exposed in the previous section, the discrete dyadic wavelet transfom offers a sparse<br />
representation of a signal, well suited for many image processing applications. In the case<br />
of <strong>de</strong>noising, a major limitation not mentionned this far is the translation invariance condition,<br />
not satisfied by the discrete dyadic wavelet transfom. This drawback does not affect<br />
the wavelet <strong>de</strong>composition in itself, however, if the wavelet coefficients are modified, the<br />
wavelet reconstruction introduces artifacts along the image discontinuities. These artifacts,<br />
visible as pseudo-Gibbs oscillations come from the <strong>de</strong>cimation of wavelet coefficients between<br />
successive <strong>de</strong>composition levels. To avoid these effects, we will rely on the stationary<br />
wavelet transform [Nason and Silverman, 1995]. The multiscale <strong>de</strong>composition of an image<br />
provi<strong>de</strong>s wavelet coefficients with a magnitu<strong>de</strong> <strong>de</strong>pen<strong>de</strong>nt on the local regularity of the<br />
signal in a given resolution. Assuming a mo<strong>de</strong>rate amount of noise in the observed signal,<br />
strong wavelet coefficients will be distributed along the edges of an image while weak coefficients<br />
will be located in homogenenous areas. The noise can then be reduced from the<br />
image by consi<strong>de</strong>ring only specific wavelet coefficients in the reconstruction process. The<br />
seminal work of [Donoho and Johnstone, 1994] <strong>de</strong>scribes two <strong>de</strong>noising techniques based<br />
on the thresholding of wavelet coefficients. A first intuitive approach consists in setting<br />
to zero all wavelet coefficients with an amplitu<strong>de</strong> lower than a fixed threshold λ. This<br />
operation is known as hard thresholding and is represented by a function S hard that takes<br />
the following form :<br />
{ 0 if d<br />
Sλ hard (d k k<br />
j )=<br />
j ≤ λ<br />
d k j if d k j >λ (3.47)<br />
where {d k j } k=1,2,3 are <strong>de</strong>tail coefficients in the horizontal (k = 1), diagonal (k = 2) and<br />
vertical (k = 3) directions, obtained at the resolution 2 j .<br />
An alternative approach in the selection of wavelet coefficients is based on soft thresholding<br />
or wavelet shrinkage ; Coefficients that exceed a threshold are attenuated by the value of<br />
the threshold. The resulting thresholding function S soft<br />
λ<br />
is given by :<br />
{<br />
S soft<br />
0 if d<br />
λ<br />
(d k k<br />
j )=<br />
j ≤ λ<br />
d k j − sign(dk j )λ if dk j >λ (3.48)<br />
The quality of the reconstructed signal highly <strong>de</strong>pends on the choice of the threshold which<br />
can be the same for all resolutions or vary from one resolution to the other. A common<br />
methodology relies on the universal thresholding of [Donoho and Johnstone, 1994] where<br />
the value of the threshold is fixed as :<br />
λ =ˆσ √ 2 log(M × N) (3.49)<br />
where M × N is the number of pixels in the image and ˆσ is an estimation of the noise<br />
variance, <strong>de</strong>termined from the <strong>de</strong>tail coefficients of the highest resolution with :<br />
λ<br />
ˆσ = median{dk 0 } k=1,2,3<br />
0.6745<br />
(3.50)
63<br />
The highest resolution is used for the estimation of σ because its wavelet coefficients are<br />
mostly related to the noisy component of the signal.<br />
Going back to the striping issue, let us un<strong>de</strong>rscore an important point. Most <strong>de</strong>noising<br />
technique presented in the litterature and based on wavelet coefficients thresholding are<br />
<strong>de</strong>votd to the elimination of isotropic noise (gaussian, poissonian, speckle noise). Although<br />
the basic principle of wavelet thresholding remains valid for our study, specific aspects such<br />
as the choice of the threshold have to be revised and adapted for the case of stripe noise.<br />
Destriping via wavelet thresholding have already been used on MODIS in [Yang et al.,<br />
2003]. However, the proposed methodology is based on a soft thresholding applied to <strong>de</strong>tail<br />
coefficients of all directions. A refinement of this approach was introduced in [Torres and<br />
Infante, 2001] for the <strong>de</strong>striping of Landsat MSS images. This technique, which we apply<br />
here to MODIS data, exploits the unidirectional signature of striping and its impact on the<br />
multiresolution <strong>de</strong>composition. As illustrated in figure 3.15, the presence of stripe noise<br />
affects only the horizontal component of the image. It is then reasonnable to restrain the<br />
manipulation of wavelet coefficients to the horizontal <strong>de</strong>tails d 1 j . Figure 3.15 also indicates<br />
that unlike white gaussian noise, striping translates as wavelet coefficients with very high<br />
intensity. The amplitu<strong>de</strong> of wavelet coefficients associated with the image edges is actually<br />
dominated by stripe noise and application of classic thresholding strategies cannot be<br />
consi<strong>de</strong>red in our case. The strategy <strong>de</strong>veloped in [Torres and Infante, 2001] consists in<br />
eliminating all horizontal wavelet coefficients of the m highest resolution levels, m being<br />
<strong>de</strong>termined heuristically. This procedure is equivalent to a hard thresholding where all<br />
horizontal coefficients are set to zero. Its thresholding function is :<br />
{ 0 if k = 1 and 1 ≤ j ≤ m<br />
S λ (d k j )=<br />
otherwise<br />
d k j<br />
(3.51)<br />
The <strong>de</strong>striping quality <strong>de</strong>pends on the parameter m. When m is small, only small scale<br />
<strong>de</strong>tails of the striping effect are removed. If m takes high values, the thresholding function<br />
3.51 removes the horizontal low-frequency component of the image and introduces strong<br />
blurring. The visual analysis of successive approximations shows that the impact of striping<br />
tends to diminish through lower resolutions. The hard thresholding should then be limited<br />
to resolutions where the stripe noise signature is still persistent (see figure 3.17). Wavelet<br />
<strong>de</strong>striping through hard thresholding can provi<strong>de</strong> good visual results <strong>de</strong>pending on the<br />
manipulation of horizontal coefficients. However it inevitably eliminates <strong>de</strong>tails related to<br />
the image sharp structures.<br />
3.8 Assessing <strong>de</strong>striping quality<br />
In the previous sections, several approaches have been <strong>de</strong>scribed and applied to MODIS<br />
data severely affected with stripe noise. Visual examination of <strong>de</strong>striped results indicates<br />
that equalization methods, either based on statistical or radiometric consi<strong>de</strong>rations, fail<br />
to completely remove the noise in that a consi<strong>de</strong>rable amount of residual stripes are still
64 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
Figure 3.16 – (Left) Noisy image from Terra MODIS band 30 (Right) Destriped result<br />
setting to zero vertical <strong>de</strong>tails d 1 1 , d1 2 and d1 3 (m=3) prior to wavelet reconstruction<br />
Image distortion ID<br />
0.93<br />
0.925<br />
0.92<br />
0.915<br />
0.91<br />
0.905<br />
0.9<br />
0.895<br />
0.89<br />
0.885<br />
0.88<br />
ID<br />
NR<br />
7000<br />
6000<br />
5000<br />
4000<br />
3000<br />
2000<br />
1 2 3 4 5 6 7 8 0 1000<br />
m (db2)<br />
Noise reduction NR<br />
Image distortion ID<br />
0.935<br />
0.93<br />
0.925<br />
0.92<br />
0.915<br />
0.91<br />
0.905<br />
ID<br />
NR<br />
7000<br />
6000<br />
5000<br />
4000<br />
3000<br />
2000<br />
0.9<br />
1000<br />
0.895<br />
1 2 3 4 5 6 7 8 0<br />
m (db4)<br />
Noise reduction NR<br />
Figure 3.17 – Image distortion (ID)* and Noise reduction (NR)* as a function of the<br />
thresholding parameter m for Terra MODIS band 27. The selected wavelets are (Left)<br />
db2 and (Right) db4. The breaking points visible in the NR curves at m = 5 for the<br />
wavelet db 2 and m = 3 for db 4 , translate the reduction of striping from higher to lower<br />
resolution scales. Depending on the number of vanishing moments of the selected wavelet,<br />
the striping will be concentrated in the wavelet coefficients of higher resolutions and its<br />
impact on vertical wavelet coefficients eventually fa<strong>de</strong>s below at given scale, hence the<br />
constant NR in lower resolutions.<br />
visible. This is due to non-linear effects and random stripes, mostly present on Terra MO-<br />
DIS. Despite uncomplete <strong>de</strong>striping, equalization techniques are often prefered for their<br />
ability to preserve the signal radiometry.<br />
On the other hand, filtering methods (frequency filtering, facet filtering and wavelet thre-
65<br />
sholding) can be tuned to regulate the amount of distortion introduced in the restored<br />
image. A rigourous comparison of these methods requires additional criteria other than<br />
visual interpretation. In this section, we recall the <strong>de</strong>finition of several qualitative in<strong>de</strong>xes<br />
used to evaluate the <strong>de</strong>striping quality.<br />
3.8.1 Noise Reduction Ratio and Image Distortion<br />
The spectral analysis conducted in section 3.5.1, takes advantage of the unidirectional<br />
aspect of striping to highlight its spectral signature. Periodic stripes related to <strong>de</strong>tectorto-<strong>de</strong>tector<br />
and mirror banding introduces peaks, clearly visible in the ensemble averaged<br />
power spectrum down the columns. A reliable <strong>de</strong>striping should reduce the stripe peaks<br />
without interfering with the global shape of the original signal’s power spectrum. Let us<br />
<strong>de</strong>note P 0 -resp. P 1 - the power spectrum obtained as an average of the periodograms of<br />
the noisy image -resp. the <strong>de</strong>striped image- columns. We <strong>de</strong>fine :<br />
N 0 =<br />
∑<br />
P 0 (f)<br />
f∈BW N<br />
N 1 =<br />
∑<br />
P 1 (f)<br />
f∈BW N<br />
(3.52)<br />
where BW N is the noisy part of the frequency spectrum (f ∈ BW N corresponds to f ∈<br />
{0.1, 0.2, 0.3, 0.4, 0.5} in the case of <strong>de</strong>tector-to-<strong>de</strong>tector stripes). N 0 and N 1 contain the<br />
spectral components of stripes in both the noisy image and the restored one. The Noise<br />
Reduction ratio (NR) is then <strong>de</strong>fined as :<br />
NR = N 0<br />
N 1<br />
(3.53)<br />
The NR in<strong>de</strong>x measures the attenuation of the frequency peaks in the power spectrum and<br />
hence can only be used for images affected with periodic stripes. Furthermore, evaluation<br />
of a <strong>de</strong>striping techniques with the NR in<strong>de</strong>x has to be imperatively completed with a<br />
distortion in<strong>de</strong>x that quantifies the blur introduced in the <strong>de</strong>striped result. Denoting :<br />
S 0 =<br />
∑<br />
P 0 (f)<br />
f∈BW S<br />
S 1 =<br />
∑<br />
P 1 (f)<br />
f∈BW S<br />
(3.54)<br />
where BW S is the noise-free portion of the spectrum, the image distortion in<strong>de</strong>x used in<br />
[Pan and Chang, 1992] is <strong>de</strong>fined as :<br />
ID = N 0<br />
N 1<br />
(3.55)
66 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
The previous <strong>de</strong>finition contrains the computation of the ID in<strong>de</strong>x to the only portion of<br />
the frequency spectrum not affected with noise and, therefore tends to over estimate its<br />
value. In addition, the sums in the terms N 0 and N 1 are dominated by the amplitu<strong>de</strong> of<br />
low-frequency power spectrum, which are approximatively the same for both noisy and<br />
<strong>de</strong>striped images. This results in ID values very close to unity even in the presence of blur.<br />
An alternative option is to focus on the periodograms of lines. Denoting Q 0 -resp. Q 1 -,<br />
the ensemble averaged power spectrum down the lines of the noisy -resp. <strong>de</strong>striped imagewe<br />
<strong>de</strong>fine :<br />
S 0 =<br />
∑<br />
Q 0 (f)<br />
S 1 =<br />
f∈BW<br />
∑<br />
f∈BW<br />
Q 1 (f)<br />
(3.56)<br />
where BW represents the entire frequency spectrum (BW = BW N + BW S ). The Image<br />
Distortion (ID) in<strong>de</strong>x is then <strong>de</strong>fined as :<br />
ID =1−<br />
1<br />
card(BW)<br />
∑<br />
f∈BW<br />
3.8.2 Radiometric Improvement Factors<br />
|Q 0 (f) − Q 1 (f)|<br />
Q 0 (f)<br />
(3.57)<br />
Results achieved with standard <strong>de</strong>striping techniques display consi<strong>de</strong>rable residual<br />
stripes <strong>de</strong>spite the reduction of the spectral component related to periodic noise. In fact,<br />
both in<strong>de</strong>xes NR and ID are <strong>de</strong>fined in the fourier domain and cannot measure the spatial<br />
regularity of the restored image. In the spatial domain, periodic and random stripes<br />
translate as strong fluctuations of the image values along the vertical axis. Let us <strong>de</strong>note<br />
m Is [j] and mÎ[j] the unidimensional signals associated with the mean values of lines j in<br />
the noisy image I s and the <strong>de</strong>striped image Î. The <strong>de</strong>striping quality in the spatial domain<br />
can then be <strong>de</strong>termined by comparing the values of m Is [j] and mÎ[j]. To this purpose, let<br />
us consi<strong>de</strong>r a reference signal I ref with a smooth cross-track profile. I ref is obtained from<br />
the noisy image I s with a low-pass filter given by :<br />
H(u, v) =exp<br />
(− u2 + v 2 )<br />
σ 2 (3.58)<br />
Since the filter H is only used to provi<strong>de</strong> a reference regularized cross-track profile, it can<br />
also be replaced by a simple averaging filter in the spatial domain. Denoting :<br />
d s [j] =m Is [j] − m Iref [j]<br />
d e [j] =mÎ[j] − m Iref [j]<br />
the first radiometric improvement factor is <strong>de</strong>fined as :<br />
(∑ )<br />
j<br />
IF 1 = 10log d2 s[j]<br />
10 ∑<br />
j d2 e[j]<br />
(3.59)<br />
(3.60)
67<br />
A secondary in<strong>de</strong>x, in<strong>de</strong>pen<strong>de</strong>nt of I ref , consi<strong>de</strong>rs the radiometric errors :<br />
∆ s [j] =m Is [j] − m Isj−1[j]<br />
∆ e [j] =mÎ[j] − mÎ[j − 1]<br />
The second or<strong>de</strong>r radiometric improvement factor is then given by :<br />
(∑ )<br />
j<br />
IF 2 = 10log ∆2 s[j]<br />
10 ∑<br />
j ∆2 e[j]<br />
(3.61)<br />
(3.62)<br />
3.8.3 Conclusion<br />
Destriping techniques presented in this chapter can be classified in two major categories.<br />
The first class is composed of statistical or radiometric equalization techniques such<br />
as moment matching, histogram matching and the OFOV method. All these approaches<br />
rely on the acquisition principle of pushbroom imaging systems to equalize the response of<br />
individual <strong>de</strong>tectors. Their application to MODIS data illustrates a significant amount of<br />
residual stripes. Figure 3.20 shows that even after <strong>de</strong>striping, rapid fluctuations can still<br />
be seen in the cross-track profiles of the <strong>de</strong>noised data. The analysis of column ensemble<br />
averaged power spectrums (figure ) indicates that the amplitu<strong>de</strong> of peaks related to periodic<br />
stripes is reduced. To improve visual analysis of noise reduction, power spectrums<br />
are plotted with a logarithmic scale, as a function of normalized frequency.<br />
Equalization techniques do not account for non linear effects which are predominant in<br />
MODIS data. Residual stripes in the images affect its power spectrum in two ways. Strong<br />
non linear effects result in poor <strong>de</strong>tector-to-<strong>de</strong>tecotr stripes reduction and appear as persisting<br />
peaks with a lower magnitu<strong>de</strong> located at the same frequencies of 0.1, 0.2, 0.3, 0.4 and<br />
0.5 pixels per cycles. Random stripes translate as strong variations of the power spectrum<br />
in the high frequency range. Despite residual stripes, equalization techniques maintain the<br />
image distortion in<strong>de</strong>x close to 1.<br />
Alternative approaches to equalization are based on filtering techniques. The periodicity<br />
of stripes can be exploited by a band-pass filter that cuts-off stripe related frequencies.<br />
This can be achieved by placing narrow wells in the fourier response of the filter, centered<br />
on the coordinates associated with periodic stripes. As seen in figure e, periodic peaks<br />
are properly removed from the power spectrums. However, the overall shape of the column<br />
power spectrum is strongly distorted. This is even more visible on the line ensemble<br />
averaged power spectrum, which should be i<strong>de</strong>ntical for both noisy and <strong>de</strong>striped images.<br />
Wavelet analysis also offers an interesting perspective on the striping issue. The multdirectional<br />
representation provi<strong>de</strong>d by wavelet transform is well suited to process striping<br />
since only horizontal wavelet coefficients are contaminated with stripes. Setting to zero the<br />
wavelet coefficients of the m highest resolution scales prior to wavelet reconstruction can<br />
reduce the visual impact of stripe noise. The choice of the parameter m is fixed according<br />
to the NR and ID in<strong>de</strong>xes values and highly <strong>de</strong>pends on the number of vanishing moments
68 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
of the selected wavelet. If the analysing wavelet has enough vanishing moments, regular<br />
areas will have small wavelet coefficients and the stripe noise will be isolated in the highest<br />
resolution scales (figure 3.17b). On the contrary, if the number of vanishing moments is<br />
weak, stripe noise will also affect wavelet coefficients of lower resolutions (figure 3.17a)<br />
and therefore, wavelet <strong>de</strong>striping provi<strong>de</strong>s images with a weak ID in<strong>de</strong>x.<br />
The facet filtering mo<strong>de</strong>l proposed in [Rakwatin et al., 2007] is used over the histogram<br />
matching techniques to process random stripes. Due to its hybrid aspect, it is not compared<br />
to other techniques.<br />
Filtering techniques provi<strong>de</strong> results that are visually better than equalization methods because<br />
the removal of stripes can be tuned with σ for band-pass frequency filtering or m for<br />
wavelet thresholding. However, blurring and ringing artifacts introduced in the corrected<br />
signal discards any further quantitative analysis based on radiometric values.<br />
The limitations of standard techniques exposed in this chapter serve as a basis for<br />
the <strong>de</strong>velopment of a robust <strong>de</strong>striping technique. An optimal <strong>de</strong>striping algorithm should<br />
satisfy the following requirements :<br />
- Complete removal of stripe noise, whether periodic or random<br />
- Minimization of the distortion introduced in the restored image<br />
From the <strong>de</strong>finition of the NR and ID in<strong>de</strong>xes, an optimal <strong>de</strong>striping algorithm increases<br />
NR while leaving ID close to 1. To achieve such results, we explore in the next chapter<br />
the striping issue from a variational perspective.
Figure 3.18 – Destriped results on Terra MODIS band 30 (TL) Original image (TC)<br />
Moment matching (CL) Histogram matching (CR) IFOV method (BL) Frequency filtering<br />
(BR) Wavelet thresholding. Reflectances over oceanic regions are highlighted to<br />
emphasize the presence of residual stripes.<br />
69
70 3. Standard <strong>de</strong>striping techniques and application to MODIS<br />
13500<br />
13500<br />
Mean value<br />
13000<br />
12500<br />
Mean value<br />
13000<br />
12500<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
13500<br />
13500<br />
Mean value<br />
13000<br />
12500<br />
Mean value<br />
13000<br />
12500<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
13500<br />
13500<br />
Mean value<br />
13000<br />
12500<br />
Mean value<br />
13000<br />
12500<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
12000<br />
0 100 200 300 400 500<br />
Line Number<br />
Figure 3.19 – Cross track profiles computed for (TL) Original image (TR) Moment<br />
matching (CL) Histogram matching (CR) IFOV method (BL) Frequency filtering (BL)<br />
Wavelet thresholding.
71<br />
10<br />
10<br />
9<br />
9<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
10<br />
10<br />
9<br />
9<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
10<br />
10<br />
9<br />
9<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
Power spectrum<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
Figure 3.20 – Ensemble averaged power spectrums downn the columns for (TL) Original<br />
image (TR) Moment matching (CL) Histogram matching (CR) IFOV method (BL)<br />
Frequency filtering (BR) Wavelet thresholding.
Table 3.4 – Noise Reduction (NR), Image distortion (ID), radiometric Improvement Factors IF 1 and<br />
IF 2 for the Terra MODIS band 27, 30 and 33<br />
– Terra band 27 Terra band 30 Terra band 33<br />
in<strong>de</strong>x NR ID IF 1 IF 2 NR ID IF 1 IF 2 NR ID IF 1 IF 2<br />
moment matching 45.8895 0.6305 7.3085 11.5732 9.4280 0.9963 6.2656 6.6818 – 0.9995 0.1637 0.1724<br />
histogram (IMAPP) 101.0629 0.9459 8.5463 20.1003 15.3316 0.8816 5.7455 12.8977 – 0.9773 4.8320 11.1566<br />
IFOV 100.5751 0.9692 5.8563 13.7338 5.4195 0.8991 4.6190 5.7684 – 0.9388 -0.1046 0.5466<br />
Frequency filtering 1784 0.9868 9.8866 21.5316 25.5615 0.9884 7.3092 14.8566 – – – –<br />
Wavelet thresholding 5749 0.9326 9.8649 38.3728 48.9917 0.9050 6.2421 18.6632 – 0.8892 4.7349 17.0134<br />
Table 3.5 – Noise Reduction (NR), Image distortion (ID), radiometric Improvement Factors IF 1 and<br />
IF 2 for the Aqua MODIS band 27, 30 and 36<br />
– Aqua band 27 Aqua band 30 Aqua band 36<br />
in<strong>de</strong>x NR ID IF 1 IF 2 NR ID IF 1 IF 2 NR ID IF 1 IF 2<br />
moment matching 12.643 0.984 10.4393 12.0686 4.2363 0.9991 6.4180 12.6573 1.90 0.9997 3.1844 2.3252<br />
histogram (IMAPP) 33.8517 0.9828 11.5966 18.1798 4.4847 0.9839 5.5991 12.6135 1.9593 0.9957 3.2537 2.4242<br />
IFOV 1 12.1310 0.9890 9.3335 11.9212 1.8756 0.9646 -3.6762 8.9016 1.1396 0.8627 -1.8263 2.3097<br />
frequency filtering 510.5828 0.9854 10.3039 24.8529 7.8478 0.9874 6.35 17.8977 3.2048 0.9868 0.7912 10.6393<br />
wavelet thresholding 1131 0.9280 9.6601 25.4008 13.4574 0.9288 6.1015 17.9192 5.2528 0.8918 -0.1918 11.3379<br />
72 3. Standard <strong>de</strong>striping techniques and application to MODIS
73<br />
Chapitre 4<br />
A Variational approach for the<br />
<strong>de</strong>striping issue<br />
4.1 PDEs and variational methods in image processing<br />
Many disciplines from physical sciences such as thermodynamics and fluids mechanics<br />
have inspired the application of Partial Differential Equations (PDEs) in the field<br />
of image processing. Early <strong>de</strong>noising methods are mostly based on smoothing operations,<br />
either computed directly in the spatial domain via a convolution with a filter, or in the<br />
frequency domain. Assuming the noise to be contained in the high frequencies of the observed<br />
signal, a common restoration technique consists in convolving the noisy image with<br />
a linear operator. Denoting u 0 the noisy signal <strong>de</strong>fined in a boun<strong>de</strong>d domain Ω of R 2 , an<br />
estimate of the true image u is obtained by consi<strong>de</strong>ring the scale-space generated by u 0<br />
as :<br />
∫<br />
u(x, y, t) = G(x − ξ, y − η, t)u 0 (ξ, η)dxdy, (x, y) ∈ Ω (4.1)<br />
Ω<br />
Typically, the operator G is a bidimensional gaussian kernel :<br />
G(x, y, t) = 1 ( −(x 2<br />
4πt exp + y 2 )<br />
)<br />
4t<br />
(4.2)<br />
where the variance σ 2 =2t of the gaussian operator controls the <strong>de</strong>gree of smoothing in<br />
the restored image u. The work of [Koen<strong>de</strong>rink, 1984] reformulates the convolution with<br />
a gaussian kernel as a diffusion process where the value of a pixel can be expressed with<br />
respect to a neighboorhood which size is <strong>de</strong>termined by the variance σ 2 of the operator<br />
G. The noise free image u can be seen as the solution of a simple parabolic PDE :<br />
∂u<br />
∂t (x, y, t) u<br />
=∂2 ∂ 2 x (x, y, u<br />
t)+∂2 ∂ 2 (x, y, t)<br />
y<br />
u(x, y, 0) = u 0 (x, y)<br />
(4.3)
74 4. A Variational approach for the <strong>de</strong>striping issue<br />
The previous PDE, also known as the heat equation, translates an isotropic diffusion process<br />
where all directions are smoothed i<strong>de</strong>ntically. The isotropic property of the heat<br />
equation is a major drawback for <strong>de</strong>noising applications. In fact, noise in homogeneous<br />
regions is effectively removed, however in heterogeneous areas, sharp discontinuities related<br />
to edges are processed similarly to noise. The corresponding high gradient magnitu<strong>de</strong><br />
is therefore reduced which results in a significant loss of contrast in the restored image.<br />
This limitation was first explored by [Perona and Malik, 1990] by means of anisotropic<br />
diffusion mo<strong>de</strong>l, where the intensity of the diffusion process is <strong>de</strong>pen<strong>de</strong>nt on the local<br />
gradient value. The <strong>de</strong>gree of smoothing is inversely proportional to the gradient value<br />
so that homogeneous areas are strongly diffused while edge-discontinuities are preserved.<br />
The anisotropic diffusion PDE proposed by Perona and Malik can be formulated as :<br />
∂u<br />
∂t (x, y, t) =div (φ(|∇u(x, y, t)|)∇u(x, y, t)) (4.4)<br />
where div is the divergence operator, ∇ <strong>de</strong>signates the spatial gradient operator and ψ is<br />
a <strong>de</strong>creasing function. The <strong>de</strong>creasing property of φ ensures that the smoothing process is<br />
weaker in regions with strong gradient values, and stronger in flat areas. Common choices<br />
for φ inclu<strong>de</strong> exponentially <strong>de</strong>creasing functions as :<br />
φ(|∇u|) =exp(− |∇u|2<br />
k 2 ) (4.5)<br />
If φ is a constant function, the PDE equation (4.4) of Perona and Malik is reduced to :<br />
∂u<br />
∂t (x, y, t) =div (∇u(x, y, t)) (4.6)<br />
which is another formulation of the isotropic heat equation. The anisotropic diffusion (4.4)<br />
also faces limitations. The presence of noise introduces strong oscillations which can be<br />
consi<strong>de</strong>red as edges and be subsenquently preserved. To circumvent this issue, alternative<br />
techniques were proposed in<strong>de</strong>pen<strong>de</strong>ntly in [Catté et al., 1992] and [Nitzberg and Shiota,<br />
1992]. The gradient of the image is replaced by a smoothed version and the PDE (4.4)<br />
becomes :<br />
∂u<br />
∂t (x, y, t) =div (φ(|∇(G σ ∗ u(x, y, t))|)∇u(x, y, t)) (4.7)<br />
where G σ is gaussian operator with variance σ. Further research in the field of anisotropic<br />
diffusion introduced in [Alvarez et al., 1992] resulted in a non linear PDE :<br />
∂u<br />
∂t (x, y, t) =g (|∇(G σ ∗ u(x, y, t))|) |∇u(x, y, t)| div<br />
( ∇u(x, y, t)<br />
|∇u(x, y, t)|<br />
)<br />
(4.8)<br />
where g is a <strong>de</strong>creasing function that tends to 0 when ∇u tends to infinity. The( second )<br />
<strong>de</strong>rivative of u in the direction orthogonal to the gra<strong>de</strong>nt ∇u is the term |∇u|div ∇u<br />
|∇u|<br />
,<br />
and coinci<strong>de</strong>s with the image level lines. The intensity of the diffusion process is regulated
75<br />
Figure 4.1 – (Left) Noisy image from Terra MODIS band 30 (Center) Application of the<br />
heat equation (ID=0.41) (Right) Application of the Perona-Malik algorithm (ID=0.84).<br />
by the term g (|∇G σ ∗ u|). In homogeneous areas, strong values of g (|∇G σ ∗ u|) induce an<br />
anisotropic diffusion in the direction orthogonal to the gradient. Along the edges of the<br />
images (strong gradient values), the weak weighting due to the <strong>de</strong>screasing property of g<br />
disables the diffusion process.<br />
In [Nordstrom, 1990], the original PDE of Perona and Malik is formulated in a way that<br />
forces the estimated solution to be close to the observed image u 0 . The resulting PDE<br />
takes the following form :<br />
∂u<br />
∂t (x, y, t) − div(φ(|G σ ∗∇u(x, y, t)|)∇u(x, y, t)) = β (u(x, y, t) − u 0 (x, y)) (4.9)<br />
where the coefficient β regulates the fi<strong>de</strong>lity of the estimated solution to the orignal noisy<br />
sinal u 0 .<br />
In the unifying framework proposed in [Deriche and Faugeras, 1995], the authors show<br />
that image restoration based on the resolution of PDEs can be reformulated as the minimization<br />
of energy functionals. Such formulation is a<strong>de</strong>quate to many ill-posed inverse<br />
problems encountered in computer vision applications such as <strong>de</strong>noising, <strong>de</strong>convolution or<br />
inpainting. According to Hadamard’s <strong>de</strong>finition, a mathematical problem can be consi<strong>de</strong>red<br />
as ill-posed if at least one of the following conditions is not satisfied :<br />
- A solution exists<br />
- If a solution exists, it is unique<br />
- The solution is stable ; A small perturbation in the observed data induces a small perturbation<br />
in the estimated solution.<br />
Ill-posed inverse problems are systematically regularized to impose well-posedness and<br />
are tackled un<strong>de</strong>r the assumption of a specific image formation mo<strong>de</strong>l. Let us <strong>de</strong>note by<br />
K a linear transformation that accounts for the sensor multiple <strong>de</strong>gradations (diffraction,<br />
<strong>de</strong>focalisation, mouvement blur). The observed image f resulting from the acquisition
76 4. A Variational approach for the <strong>de</strong>striping issue<br />
process is given by :<br />
f = Ku + n (4.10)<br />
where n is generally assumed to be a zero mean gaussian noise. Equation (4.10) is refered to<br />
as the direct problem and the inverse problem then consists in <strong>de</strong>termining the real image<br />
u from the noisy observation f. This can not be achieved through the inversion of the<br />
operator K, since existence and stability of the inverse of K are not garanteed. Instead,<br />
a stable approximation of K −1 can be consi<strong>de</strong>red by introducing a priori regularizing<br />
information to enlarge the space of admissible solutions. The estimation of the true image<br />
u from (4.10) reduces to an optimization problem based on the minimization of an energy<br />
or cost function as <strong>de</strong>scribed in (Deriche and Faugeras, 1995) :<br />
E(u) =E 1 (u)+λE 2 (u) (4.11)<br />
The term E 1 (u) translates the fi<strong>de</strong>lity of the solution to the observed image while E 2 (u)<br />
is a regularizing term that smoothes the estimated solution and is often related to the<br />
gradient of u. The parameter λ balances the tra<strong>de</strong>off between a good fit to the observed<br />
image and a regularized solution. Typically,<br />
E 1 (u) =‖f − Ku‖ 2<br />
∫<br />
E 2 (u) = φ(|∇u|)<br />
Ω<br />
(4.12)<br />
In the particular case (4.12), an estimate of the true image û is obtained as the solution<br />
to the following optimization problem :<br />
∫<br />
û = argmin u ‖u − f‖ 2 + λ φ(|∇u|)dΩ (4.13)<br />
The selection of φ(|∇u|) =|∇u| 2 corresponds to the well-known Tikhonov regularization.<br />
4.2 Rudin, Osher and Fatemi Mo<strong>de</strong>l<br />
Among many variational based image restoration procedures, the total variation regularization<br />
introduced in the seminal work of [Rudin et al., 1992] provi<strong>de</strong>s efficient results<br />
for image <strong>de</strong>noising because it is well suited for piecewise constant signals and therefore<br />
allows the retrieval of sharp discontinuities. Total variation regularization was first proposed<br />
in the context of image <strong>de</strong>noising, and have been successively applied to a variety<br />
of fields including image recovery [Blomgren et al., 1997], image interpolation [Guichard<br />
and Malgouyres, 1998], image <strong>de</strong>composition (see section 4.3), scale estimation [Luo et al.,<br />
2007], image inpainting [Chan et al., 2005] and super resolution [D.Babacan et al., 2008].<br />
Let us recall the image formation mo<strong>de</strong>l where we assume the linear operator K to be<br />
unity :<br />
f = u + n (4.14)<br />
Ω
77<br />
The goal is to find the true image u from the noisy observation f assuming n to be white<br />
gaussian noise with a known variance σ 2 . This ill-posed problem can be regularized by<br />
assuming that the true image u belongs to the space of functions of boun<strong>de</strong>d variations,<br />
<strong>de</strong>noted BV and <strong>de</strong>fined as :<br />
BV (Ω) =<br />
{<br />
u ∈ L 1 (Ω)|sup ϕ∈C 1 c ,|ϕ|≤1<br />
(∫<br />
) }<br />
u divϕ < ∞<br />
(4.15)<br />
The total variation of a signal u ∈ BV (Ω) is equivalent to the L 1 norm of its gradient<br />
norm and is given by :<br />
{∫<br />
}<br />
TV(u) =sup u divϕ, ϕ ∈Cc 1 , |ϕ| ≤ 1<br />
(4.16)<br />
Hereafter, we consi<strong>de</strong>r u to be in BV (Ω) ∩C 1 , and the total variation simplifies into :<br />
∫<br />
TV(u) = |∇u|dΩ (4.17)<br />
To retrieve u from f, Rudin, Osher and Fatemi propose to solve a constrained optimisation<br />
problem :<br />
minimize<br />
TV(u)<br />
subject to ∫ Ω f = ∫ Ω u, and ‖u − f‖2 = σ 2 (4.18)<br />
In the previous formulation the equality constraint is not convex and can be replaced by<br />
an inequality constraint as :<br />
Ω<br />
minimize<br />
TV(u)<br />
subject to ∫ Ω f = ∫ Ω u, and ‖u − f‖2 ≤ σ 2 (4.19)<br />
Chambolle and Lions have shown in [Chambolle and Lions, 1997] that if ‖f− ∫ Ω fdΩ‖2 >σ 2<br />
then problems (4.18) and (4.19) are equivalent. (4.19) can then be reformulated as the<br />
minimization of :<br />
E(u) =λ‖u − f‖ 2 + TV(u) (4.20)<br />
where the lagrangian multiplier λ> 0 regulates the compromise between the fi<strong>de</strong>lity term<br />
and the regularizing term. For a given value of λ, Karush-Kuhn-Tucker conditions ensure<br />
the equivalence between (4.19) and (4.20). The energy functional (4.20) will be refered to<br />
hereafter as the ROF mo<strong>de</strong>l. The minimization of ROF mo<strong>de</strong>l is obtained via its Euler-<br />
Lagrange equation :<br />
⎛<br />
⎛<br />
−2λ(u − f)+ ∂<br />
∂x<br />
⎜<br />
⎝<br />
√ ( ∂u<br />
∂x<br />
∂u<br />
∂x<br />
) 2<br />
+<br />
(<br />
∂u<br />
∂y<br />
⎞<br />
⎟<br />
) 2 ⎠ + ∂ ⎜<br />
∂y ⎝<br />
√ ( ∂u<br />
∂x<br />
∂u<br />
∂x<br />
) 2<br />
+<br />
(<br />
∂u<br />
∂y<br />
⎞<br />
⎟<br />
) 2 ⎠ =0 (4.21)
78 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.2 – (Left) Noisy image from Terra MODIS band 30 (Right) Denoising with<br />
TV regularization (ID=0.51)<br />
which can take the simple form :<br />
−2λ(u − f) + div<br />
( ) ∇u<br />
= 0 (4.22)<br />
|∇u|<br />
From a computational point of view, the non-differentiability of the term |∇u| for ∇u =0<br />
is problematic. In [Acar and Vogel, 1994], the authors suggest a smoothed version of the<br />
energy functional where the total variation norm is relaxed with a small positive parameter<br />
ɛ. The original ROF energy functional (4.20) becomes :<br />
∫<br />
√<br />
E ɛ (u) =λ‖u − f‖ 2 + |∇u| 2 + ɛdΩ (4.23)<br />
which leads to the following Euler-Lagrange Equation :<br />
(<br />
)<br />
∇u<br />
−2λ(u − f) + div √ = 0 (4.24)<br />
|∇u| 2 + ɛ 2<br />
From the following inequality :<br />
∫<br />
∫<br />
∀u ∈ L 1 (Ω), |∇u|dΩ ≤<br />
Ω<br />
Ω<br />
Ω<br />
√<br />
∫<br />
|∇u| 2 + ɛdΩ ≤<br />
Ω<br />
|∇u|dΩ+ √ ɛ|Ω| (4.25)<br />
it follows that :<br />
√<br />
∫<br />
lim |∇u|<br />
ɛ→0<br />
∫Ω<br />
2 + ɛdΩ = |∇u|dΩ (4.26)<br />
Ω<br />
When the value of ɛ tends to zero, the solution of the optimisation problem (4.20) converges<br />
to that of (4.25).
79<br />
Fast and exact minimization algorithms for TV-based energy functionals have been subject<br />
to intense research, and many methods can be used to solve ROF mo<strong>de</strong>l. In their original<br />
work, Rudin, Osher and Fatemi relied on a fixed step gradient <strong>de</strong>scent. Quasi-Newton<br />
schemes have been investigated in [Chambolle and Lions, 1997], [Dobson and Vogel, 1997],<br />
and [Nikolova and Chan, 2007]. The dual formulation of TV minimization was explored<br />
in [Cha] and later lead to Antonin Chambolle’s projection algorithm [Chambolle, 2004].<br />
The approach <strong>de</strong>veloped by Chambolle was the first to provi<strong>de</strong> a solution to the exact<br />
TV minimization problem (4.20) instead of a smoothed version. More recently, techniques<br />
based on graph cuts have proved successfull in [Boykov et al., 2001] and [Dar]. In this<br />
section, we propose a fixed point technique based on a Gauss-Sei<strong>de</strong>l iterative method. The<br />
image domain Ω is discretized into a grid where (x i = ih) and (y i = jh), h being the cell<br />
size. Let us <strong>de</strong>note D + , D − and D 0 the forward, backward and central finite differences.<br />
In the x-direction for exemple, we can write :<br />
(D ±x u) i,j = ± u i±1,j − u i,j<br />
h<br />
(D 0x u) i,j = u i+1,j − u i−1,j<br />
2h<br />
(4.27)<br />
The divergence operator is implemented using the non-negative discretization which offers<br />
more stability than a discretization based solely on central differences. The discret form<br />
of Euler-Lagrange equation (4.24) is :<br />
u i,j = f i,j + 1<br />
2λ D −x<br />
+ 1<br />
2λ D −y<br />
(<br />
(<br />
)<br />
D +x u i,j<br />
√<br />
(D+x u i,j ) 2 +(D 0y u i,j ) 2 + ɛ 2<br />
)<br />
D +y u i,j<br />
√<br />
(D0x u i,j ) 2 +(D +y u i,j ) 2 + ɛ 2<br />
(<br />
)<br />
= f i,j + 1<br />
u i+1,j − u i,j<br />
2λh 2 √<br />
(D+x u i,j ) 2 +(D 0y u i,j ) 2 + ɛ − u i,j − u i−1,j<br />
√ 2 (D−x u i,j ) 2 +(D 0y u i−1,j ) 2 + ɛ 2<br />
(<br />
)<br />
+ 1<br />
u i,j+1 − u i,j<br />
2λh 2 √<br />
(D0x u i,j ) 2 +(D +y u i,j ) 2 + ɛ − u i,j − u i,j−1<br />
√ 2 (D0x u i,j−1 ) 2 +(D −y u i,j ) 2 + ɛ 2<br />
(4.28)<br />
The linearization of the previous equation leads to :<br />
⎛<br />
⎞<br />
u n+1<br />
i,j<br />
= f i,j + 1<br />
u<br />
⎝<br />
n i+1,j − un+1 i,j<br />
u n+1<br />
i,j<br />
− u n i−1,j<br />
2λh 2 − √<br />
⎠<br />
√(D +x u n i,j )2 +(D 0y u n i,j )2 + ɛ 2 (D −x u n i,j )2 +(D 0y u n i−1,j )2 + ɛ 2<br />
⎛<br />
⎞<br />
+ 1<br />
u<br />
⎝<br />
n i,j+1 − un+1 i,j<br />
u n+1<br />
i,j<br />
− u n i,j−1<br />
2λh 2 − √<br />
⎠<br />
√(D 0x u n i,j )2 +(D +y u n i,j )2 + ɛ 2 (D 0x u n i,j−1 )2 +(D −y u n i,j )2 + ɛ 2<br />
(4.29)
80 4. A Variational approach for the <strong>de</strong>striping issue<br />
To simplifie notations, we introduce :<br />
1<br />
C 1 = √<br />
(D +x u n i,j )2 +(D 0y u n i,j )2 + ɛ 2<br />
1<br />
C 2 = √<br />
(D −x u n i,j )2 +(D 0y u n i−1,j )2 + ɛ 2<br />
(4.30)<br />
1<br />
C 3 = √<br />
(D 0x u n i,j )2 +(D +y u n i,j )2 + ɛ 2<br />
1<br />
C 4 = √<br />
(D 0x u n i,j−1 )2 +(D −y u n i,j )2 + ɛ 2<br />
The solution of (4.24) is obtained with the following iterative scheme :<br />
u n+1<br />
i,j<br />
= 2λh2 f i,j + C 1 u n i+1,j + C 2u i−1,j + C 3 u n i,j + C 4u n i,j−1<br />
2λh 2 + C 1 + C 2 + C 3 + C 4<br />
(4.31)<br />
To satisfy Neumann boundary condition ∂u<br />
∂n = 0, u i,j is exten<strong>de</strong>d by reflection outsi<strong>de</strong> the<br />
domain Ω.<br />
Since it’s introduction in 1992, total variation regularization has grown very popular in the<br />
field of image processing. Nevertheless, for <strong>de</strong>noising purposes, its application is limited<br />
to the removal of isotropic noises such as gaussian or speckle noise [Sheng et al., 2005].<br />
Given the unidirectionality of stripe noise, tackling the striping issue with TV regularization<br />
might not be appropriate. The wavelet analysis conducted in chapter 2 un<strong>de</strong>rscored<br />
another geometrical feature of striping ; on most of MODIS emisssive bands, the amplity<strong>de</strong><br />
of stripe noise is of the same or<strong>de</strong>r as the edges of the image. Discontinuities due to<br />
striping are perceived as image sharp structures and are therefore preserved by the TV<br />
mo<strong>de</strong>l. Distinction between stripe noise and image edges can not be achieved directly with<br />
the TV mo<strong>de</strong>l and regardless the choice of the lagrange multiplier λ, reduction of striping<br />
effect is inevitably followed by a loss of contrast (figure 4.2).<br />
Nonetheless, an alternative use of ROF mo<strong>de</strong>l is conceivable. Recently, a variational approach<br />
was proposed in the context of image <strong>de</strong>striping and inpainting. It is based on a<br />
maximum a posteriori (MAP) algorithm applied to a modified image formation mo<strong>de</strong>l<br />
where the noisy observation f is given by :<br />
f = Au + B + n (4.32)<br />
where Au is a point to point multiplication. The <strong>de</strong>gradation process is assumed to be<br />
linear and inclu<strong>de</strong>s the parameters A and B associated with gain and offset values for<br />
every pixel. A and B are matrices of the same size as the image. n is assumed to be zero<br />
mean gaussian noise. The true image u is <strong>de</strong>duced from a MAP estimate :<br />
û = argmax<br />
u<br />
p(u|f) (4.33)
81<br />
Using Bayes’rule the previous equations becomes :<br />
û = argmax<br />
u<br />
p(f|u)p(u)<br />
p(f)<br />
(4.34)<br />
The a posteriori term p(u|f) being in<strong>de</strong>pen<strong>de</strong>nt on p(f), problem (4.33) reduces to :<br />
û = argmax<br />
u<br />
Application of the logarithm function on (4.35) then gives :<br />
p(f|u)p(u) (4.35)<br />
û = argmax<br />
u<br />
{log (p(f|u)) + log (p(u))} (4.36)<br />
Un<strong>de</strong>r the assumption of white additive gaussian noise, the conditional <strong>de</strong>nsity of f given<br />
u is given by :<br />
p(f|u) = 1 (<br />
Z exp − 1 )<br />
2 ‖K− 1 2 (f − Au − B)‖<br />
2<br />
(4.37)<br />
where Z is a normalizing constant and K is a diagonal matrix containing the variance<br />
values of the noise n. The prior <strong>de</strong>nsity probability function p(u) is <strong>de</strong>pen<strong>de</strong>nt on the prior<br />
contraint imposed on the image. The Markov prior for example is given by :<br />
⎛<br />
⎞<br />
p(u) = 1 Z exp ⎝− 1 ∑ ∑<br />
ρ(d c (u i,j )) ⎠ (4.38)<br />
2λ<br />
where C is the set of image cliques and d c (u i,j ) is a spatial measure of u at pixel (i, j),<br />
expressed as a function of first or second or<strong>de</strong>r differences. In [Shen et al., 2008], the<br />
authors selected an edge-preserving prior based on the Huber potential function <strong>de</strong>fined<br />
as :<br />
{<br />
x<br />
ρ(x) =<br />
2 if |x| ≤ µ<br />
2µ|x|− µ 2 (4.39)<br />
if |x| >µ<br />
The maximization of the posterior probablility distribution (4.36) is equivalent to the<br />
minimization of the following energy :<br />
i,j<br />
c∈C<br />
E(u) =λ‖K − 1 2 (f − Au − B)‖ 2 + ∑ i,j<br />
∑<br />
ρ(d c (u i,j ))<br />
c∈C<br />
(4.40)<br />
The work of [Shen et al., 2008] can be directly transposed to the TV framework. Since<br />
the Huber-Markov mo<strong>de</strong>l is used mainly for its edge-preserving ability, the prior <strong>de</strong>nsity<br />
probability function p(u) can also relie on the TV norm as :<br />
p(u) = 1 exp (−λT V (u)) (4.41)<br />
Z
82 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.3 – (Left) Image from Terra MODIS band 30 <strong>de</strong>noised with TV regularization<br />
(ID=0.5750) (Right) Denoised with the variational mo<strong>de</strong>l () (ID=0.7768)<br />
If we discard the presence of gaussian noise n or assume it is implicitly accounted for in<br />
the gain and offset parameters A and B, the covariance matrix K reduces to the i<strong>de</strong>ntity<br />
matrix and can be discar<strong>de</strong>d. Then, a <strong>de</strong>striping approach similar to [Shen et al., 2008]<br />
can be achieved by minimizing :<br />
E(u) =λ‖(f − Au − B)‖ 2 + TV(u) (4.42)<br />
Destriping via the minimization of (4.42) relies on the observational mo<strong>de</strong>l (4.32)) where<br />
A and B are assumed to be known. This is however not the case in pratice and a preprocessing<br />
stage is required to estimate the values of A and B. In their work, [Shen et al.,<br />
2008] used the moment matching technique to evaluate the values of A and B from the<br />
image mean value and variance. The limitations of such approach are directly attached to<br />
its hybrid aspect. In fact, the TV or Huber-Markov regularization acts as a post-processing<br />
stage, smoothing residual stripes that moment matching or any other technique based on<br />
linear adjustment (OFOV method for exemple) fails to remove. Nonetheless, the <strong>de</strong>striped<br />
results are much less distorted than those obtained with a direct application of the ROF<br />
mo<strong>de</strong>l (figure 4.3).<br />
4.3 Striping as a texture <br />
The main characteristic of stripping effect lies on it’s unidirectional aspect. To this<br />
extent, stripe noise can be consi<strong>de</strong>red as a structured texture with sharp fluctuations<br />
along a single axis of the image. This is particularly the case on MODIS spectral bands<br />
where striping is periodic. Texture discriminating variational mo<strong>de</strong>ls inspired from Yves
83<br />
Meyer’s work can then be used in hope of isolating the stripe noise from other structures<br />
present in the true scene.<br />
4.3.1 Yves Meyer’s mo<strong>de</strong>l for oscillatory functions<br />
The total variation regularization used in the previous section as a <strong>de</strong>noising technique<br />
can be seen from a different perspective as an image <strong>de</strong>composition mo<strong>de</strong>l, where<br />
the observed image f is approximated by a sketchy version u that lies in the BV space<br />
and the component v = f − u contains small sace <strong>de</strong>tails such as noise and/or texture.<br />
Many variational methods have the explicit goal of extracting an image u composed of<br />
homogeneous areas separated by sharp discontinuities but do not retain the component<br />
v as it is consi<strong>de</strong>red to be noise. This can be problematic for images containing texture<br />
because noise and texture are both oscillatory functions, processed equally with the TV<br />
regularization. From an image <strong>de</strong>composition perspective, ROF mo<strong>de</strong>l can be formulated<br />
as the following minimization :<br />
inf<br />
(u,v)∈BV (Ω)×L 2 (Ω)/u+v=f<br />
(<br />
)<br />
TV(u)+λ‖v‖ 2 L 2 (Ω)<br />
(4.43)<br />
In his investigation of the standard ROF mo<strong>de</strong>l [Meyer, 2002], Yves Meyer pointed out<br />
that small values of λ can remove fine <strong>de</strong>tails related to texture. To overcome this issue,<br />
he proposes a different <strong>de</strong>composition, where the classical L 2 norm associated with the<br />
residual v = f − u is replaced by a weaker-norm, more sensitive to oscillatory functions.<br />
Yves Meyer suggests finding a component v in the space G <strong>de</strong>fined as the Banach space<br />
composed of all distributions v which can be written as :<br />
v(x, y) =∂ x g 1 (x, y)+∂ y g 2 (x, y) (4.44)<br />
where g 1 and g 2 both belong to the space L ∞ (R 2 ). The space G is endowed with the norm<br />
‖v‖ G <strong>de</strong>fined as the lower bound of all L ∞ norms of the functions |⃗g| where ⃗g =(g 1 ,g 2 )<br />
and |⃗g(x, y)| = √ g 1 (x, y) 2 + g 2 (x, y) 2 . Additionnaly to G, which can be viewed as the<br />
dual space of BV , Meyer introduces the spaces E and F also suited to mo<strong>de</strong>l texture.<br />
The space E (dual of Ḃ 1,1<br />
1 ) is <strong>de</strong>fined similarly to G except that g 1,g 2 are in the space<br />
of boun<strong>de</strong>d mean oscillations functions <strong>de</strong>noted by BMO(R 2 ). For the space F (dual of<br />
H 1 ), g 1 ,g 2 belong to Besov space B∞<br />
−1,∞ (R 2 ). When the texture component v is assumed<br />
to lie in the space G, Yves Meyer proposes the following <strong>de</strong>composition mo<strong>de</strong>l :<br />
(<br />
TV(u)+λ‖v‖G(Ω ))<br />
2 (4.45)<br />
inf<br />
(u,v)∈BV (Ω 2 )×G(Ω 2 )/u+v=f<br />
The ‖.‖ G -norm can efficiently capture oscillating patterns because it is weaker than the<br />
‖.‖ 2 -norm (L 2 (Ω) ⊂ G(Ω) ). However, due to its mathematical form, the Euler-Lagrange<br />
equation of (4.45) cannot be expressed explicitly and several u + v <strong>de</strong>composition mo<strong>de</strong>ls<br />
have been later introduced as an approximation to Yves Meyer mo<strong>de</strong>l.
84 4. A Variational approach for the <strong>de</strong>striping issue<br />
4.3.2 Vese-Osher’s Mo<strong>de</strong>l<br />
Vese and Osher were the first to overcome the difficulty of Meyer’s functional minimization.<br />
They proposed a pratical resolution in [Vese and Osher, 2002] where they<br />
approximate the L ∞ norm of |⃗g| with :<br />
√<br />
∥ ‖|⃗g|‖ L ∞ =<br />
∥ g1 2 + ∥∥∥ g2 2∥ = lim<br />
√g 2<br />
L ∞ p→∞<br />
1 + g2 ∥<br />
2<br />
∥<br />
L p<br />
(4.46)<br />
As pointed out in [Meyer, 2002], the residual v = f − u in the original ROF mo<strong>de</strong>l, can<br />
be expressed as the divergence of a vector field ⃗g ∈ L ∞ (Ω) since :<br />
v = − 1 ( ) ∇u<br />
2λ div |∇u|<br />
Vese and Osher then consi<strong>de</strong>r the space of generalized functions :<br />
(4.47)<br />
G p (Ω) = {v = div(⃗g), ⃗g =(g 1 ,g 2 ), g 1 ,g 2 ∈ L p (Ω)} (4.48)<br />
induced by the norm :<br />
‖v‖ Gp(Ω) =<br />
inf<br />
v=div(⃗g), g 1 ,g 2 ∈L p (Ω)<br />
√<br />
∥ g1 2 + g2 2∥ (4.49)<br />
As an approximation to Yves Meyer mo<strong>de</strong>l, Vese and Osher propose the following <strong>de</strong>composition<br />
:<br />
inf<br />
(u,⃗g)∈BV (Ω)×L p (Ω) 2 |u| BV (Ω) + λ‖f − (u + div(⃗g))‖ 2 L 2 (Ω) + µ ‖|⃗g|‖ L p (Ω) (4.50)<br />
which approximates the original <strong>de</strong>composition mo<strong>de</strong>l of Yves Meyer when λ →∞and<br />
p →∞. The minimization problem () also writes as :<br />
∫<br />
inf<br />
|∇u|dxdy + λ |f − u − ∂ x g 1 − ∂ y g 2 |<br />
(u,(g 1 ,g 2 ))∈BV (Ω)×L p (Ω)<br />
∫Ω<br />
2 dxdy<br />
2 Ω<br />
(∫ √<br />
+ µ<br />
(<br />
Ω<br />
g 2 1 + g2 2 )p dxdy<br />
) 1<br />
p<br />
(4.51)<br />
where λ and µ are tuning parameters. The first term in () forces u to lie in the space<br />
BV (Ω). The second term insures that the noisy image can be approximated as f ≈<br />
u + div(⃗g). The last term is a penalty on the G p norm of v which regulates the amount of<br />
texture extracted in the component v. The minimization of Vese-Osher functional requires<br />
the computation of its partial <strong>de</strong>rivative with respect to u, g 1 and g 2 which leads to three
85<br />
coupled Euler-Lagrange equations :<br />
u = f − ∂g 1<br />
∂x − ∂g 2<br />
∂y + 1 ( ) ∇u<br />
2λ div |∇u|<br />
) ( p−2 ∥∥∥∥ √<br />
) 1−p (<br />
µg 1<br />
(√g1 2 + g2 2 g1 2 + g2 ∂(u − f)<br />
2∥ =2λ<br />
p<br />
∂x<br />
) ( p−2 ∥∥∥∥ √<br />
) 1−p (<br />
µg 2<br />
(√g1 2 + g2 2 g1 2 + g2 ∂(u − f)<br />
2∥ =2λ<br />
p<br />
∂y<br />
)<br />
+ ∂2 g 1<br />
∂ 2 x + ∂2 g 2<br />
∂x∂y<br />
)<br />
+ ∂2 g 1<br />
∂x∂y + ∂2 g 2<br />
∂ 2 y<br />
(4.52)<br />
In [Vese and Osher, 2002], Vese and Osher observed similar results for 1 ≤ p ≤ 10. When<br />
p ≫ 10, only texture associated with small scale <strong>de</strong>tails can be extracted. As suggested<br />
by Vese and Osher, we consi<strong>de</strong>r the case p = 1 for computational speed and the previous<br />
equations reduce to :<br />
u = f − ∂g 1<br />
∂x − ∂g 2<br />
∂y + 1 ( ) ∇u<br />
2λ div |∇u|<br />
( )<br />
g 1<br />
∂(u − f)<br />
µ √ =2λ<br />
+ ∂2 g 1<br />
g<br />
2<br />
1 + g2<br />
2 ∂x ∂ 2 x + ∂2 g 2<br />
∂x∂y<br />
( )<br />
g 2<br />
∂(u − f)<br />
µ √ =2λ<br />
+ ∂2 g 1<br />
g<br />
2<br />
1 + g2<br />
2 ∂y ∂x∂y + ∂2 g 2<br />
∂ 2 y<br />
(4.53)<br />
Neumann conditions are used at the boundary of the image domain Ω. Let us <strong>de</strong>note<br />
by (n x ,n y ) the normal to the boundary ∂Ω of the image domain, Neumann conditions<br />
translate to :<br />
∇u<br />
|∇u| (n x,n y ) = 0<br />
(<br />
)<br />
f − u − ∂g 1<br />
∂x − ∂g 2<br />
∂y<br />
n x =0<br />
(<br />
)<br />
f − u − ∂g 1<br />
∂x − ∂g 2<br />
∂y<br />
n y =0<br />
(4.54)<br />
The three coupled equations <strong>de</strong>rived from Vese-Osher mo<strong>de</strong>l are discretized and linearized<br />
as in section 4.2. Mixed <strong>de</strong>rivatives of g 1 (and g 2 ) are approximated with :<br />
∂ 2 g 1,i,j<br />
∂x∂y = 1<br />
4h 2 (g 1,i+1,j+1 + g 1,i−1,j−1 − g 1,i+1,j−1 − g 1,i−1,j+1 ) (4.55)
86 4. A Variational approach for the <strong>de</strong>striping issue<br />
Using the same notations for C 1 , C 2 , C 3 , C 4 as in section 4.2, estimates for u, g 1 and g 2<br />
are obtained via the fixed point iterative scheme :<br />
(<br />
) (<br />
u n+1<br />
1<br />
i,j<br />
=<br />
1+ 1<br />
f i,j − gn 1,i+1,j − gn 1,i−1,j<br />
(C<br />
2λh 2 1 + C 2 + C 3 + C 4 )<br />
2h<br />
− gn 2,i,j+1 − gn 2,i,j−1<br />
+ 1<br />
)<br />
2h 2λh 2 (C 1u n i+1,j + C 2 u n i−1,j + C 3 u n i,j+1 + C 4 u n i,j−1)<br />
⎛<br />
g1,i,j n+1 = ⎝<br />
4λ<br />
h 2 µ<br />
⎞<br />
(<br />
2λ<br />
u<br />
n<br />
√<br />
⎠ i+1,j − u n i−1,j<br />
g1,i,j n 2 + g2,i,j n 2 2h<br />
− f i+1,j − f i−1,j<br />
2h<br />
+ gn 1,i+1,j − gn 1,i−1,j<br />
h 2 + 1<br />
4h 2 (g 2,i+1,j+1 + g 2,i−1,j−1 − g 2,i+1,j−1 − g 2,i−1,j+1 )<br />
⎞<br />
(<br />
⎝<br />
2λ<br />
u<br />
n<br />
√<br />
⎠ i,j+1 − u n i,j−1<br />
− f i,j+1 − f i,j−1<br />
g1,i,j n 2 + g2,i,j n 2 2h<br />
2h<br />
⎛<br />
g2,i,j n+1 =<br />
4λ<br />
h 2 µ<br />
+ gn 2,i,j+1 − gn 2,i,j−1<br />
h 2 + 1<br />
4h 2 (g 1,i+1,j+1 + g 1,i−1,j−1 − g 1,i+1,j−1 − g 1,i−1,j+1 )<br />
4.3.3 Osher-Solé-Vese’s Mo<strong>de</strong>l<br />
)<br />
)<br />
(4.56)<br />
The mo<strong>de</strong>l proposed by Osher, Solé and Vese in [Osher et al., 2002], provi<strong>de</strong>s another<br />
practical approximation of (4.45). If the texture component can be written as v = f − u =<br />
div(⃗g) with ⃗g ∈ L ∞ (Ω) 2 then the Hodge <strong>de</strong>composition of ⃗g leads to :<br />
⃗g = ∇P + ⃗ Q (4.57)<br />
where ⃗ Q is a divergence free vector. Consi<strong>de</strong>ring the divergence of the previous equation,<br />
the texture component f − u can be written as :<br />
f − u = div(⃗g) =div(∇P + ⃗ Q)=div(∇P )=△P (4.58)<br />
From the previous equation, P can be expressed as P = △ −1 (f − u). Osher et al. then<br />
suggest to replace the L ∞ -norm by the L 2 -norm of |⃗g|. Neglecting Q ⃗ in the Hodge <strong>de</strong>composition<br />
of ⃗g, Osher et al. consi<strong>de</strong>r the simple minimization problem :<br />
∫ ∫<br />
inf<br />
u∈BV (Ω)<br />
Ω<br />
|∇u| + λ<br />
inf<br />
u∈BV (Ω)<br />
Ω<br />
Ω<br />
|∇(△ −1 )(f − u)| 2 dx dy (4.59)<br />
Using the norm in the space H −1 <strong>de</strong>fined by ‖v‖ H −1 = ∫ Ω |∇(△−1 )(v)| 2 dx dy, the previous<br />
minimization problem can be simplified to :<br />
∫<br />
|∇u| + λ‖f − u‖ 2 H−1 (4.60)
87<br />
The minimization of (4.60) is obtained with the Euler-Lagrange equation :<br />
( ) ∇u<br />
2λ △ −1 (f − u) =div<br />
|∇u|<br />
which takes a pratical form after application of the Laplacian operator :<br />
( ( )) ∇u<br />
2λ(f − u) =△ div<br />
|∇u|<br />
(4.61)<br />
(4.62)<br />
Equation (4.62) can be solved using a fixed step gradient <strong>de</strong>scent. The estimation of u at<br />
iteration n + 1 is given by :<br />
( ( ))) ∇u<br />
u n+1 = u n − ∆ t<br />
(2λ(f − u n n<br />
) −△ div<br />
|∇u n |<br />
(4.63)<br />
u 0 = f<br />
It is interesting to point out that Osher-Solé-Vese mo<strong>de</strong>l is very similar to the particular<br />
case of Vese-Osher mo<strong>de</strong>l where p = 2 and λ = ∞. In fact, the space G p (Ω) coinci<strong>de</strong>s<br />
with the Sobolev space W −1,p (Ω) which is the dual of W 1,p′<br />
0 (Ω) where p and p ′ satisfie the<br />
relationship 1 p + 1 p<br />
= 1. If p = 2, then the texture component v lies in G ′ 2 (Ω) = W −1,2 (Ω) =<br />
H −1 (Ω). The <strong>de</strong>composition mo<strong>de</strong>l of Vese and Osher can then be written as :<br />
inf |u| BV (Ω) + λ‖f − (u + v)‖ 2 L 2 (Ω) + µ ‖v‖ H −1 (Ω) (4.64)<br />
(u,v)∈BV (Ω)×H −1 (Ω)<br />
4.3.4 Other u + v mo<strong>de</strong>ls<br />
More image <strong>de</strong>composition mo<strong>de</strong>ls were introduced following [Vese and Osher, 2002]<br />
and [Osher et al., 2002]. In [Aujol et al., 2005], the following energy is consi<strong>de</strong>red :<br />
(<br />
)<br />
TV(u)+λ‖f − (u + v)‖ 2 L 2 (Ω)<br />
(4.65)<br />
inf<br />
(u,v)∈BV (Ω)×G µ(Ω)<br />
where the space G µ is <strong>de</strong>fined as :<br />
G µ = {v ∈ G(Ω)/‖v‖ G ≤ µ)} (4.66)<br />
The minimization of (4.66) is obtained with the projection algorithm of Chambolle.<br />
[Daubechies and Teschke, 2005] introduced an image <strong>de</strong>composition mo<strong>de</strong>l based on a<br />
wavelet framework as :<br />
inf<br />
(u,v)∈B 1 1 (L1 (Ω))×H −1 (Ω)<br />
(<br />
)<br />
2α|u| B 1<br />
1 (L 1 (Ω)) + ‖f − (u + v)‖2 L 2 (Ω) + ‖‖2 H −1 (Ω)<br />
(4.67)<br />
The space BV (Ω) used in most image <strong>de</strong>composition mo<strong>de</strong>ls is replaced by a space suited<br />
for wavelet coefficients, namely the Besov space B 1 1 (Ω).
88 4. A Variational approach for the <strong>de</strong>striping issue<br />
We also refer to the variational mo<strong>de</strong>l initially proposed for 1D signals in [] and later<br />
explored by [Nikolova, 2004]. The proposed functional replaces the L 2 norm of the original<br />
ROF mo<strong>de</strong>l by the L 1 norm as :<br />
inf<br />
(u,v)∈BV (Ω) 1 (Ω)<br />
(<br />
)<br />
TV(u)+λ‖f − (u + v)‖ 1 L 1 (Ω)<br />
(4.68)<br />
4.3.5 Experimental results and discussion<br />
The original ROF mo<strong>de</strong>l, Vese-Osher (VO) and Osher-Solé-Vese (OSV) <strong>de</strong>composition<br />
mo<strong>de</strong>ls have been applied to Terra MODIS images from band 30 and 33, in an attempt to<br />
extract stripe noise in the texture component v. The u + v <strong>de</strong>compositions are illustrated<br />
in figures 4.4 and 4.5. Traditionally, the lagrange multiplier λ is selected so that the L 2<br />
norm of v is the same for every <strong>de</strong>composition mo<strong>de</strong>l. This strategy aims at visually<br />
evaluating the ability of <strong>de</strong>composition mo<strong>de</strong>ls to discriminate texture and noise from the<br />
image main content and is well suited when no requirements are imposed on the cartoon<br />
component u. In our case however, the primary goal is to isolate the striping on v while<br />
preserving an acceptable distortion in u as it constitute an estimate of the <strong>de</strong>striped image.<br />
Consequently, we proceed by selecting a value of λ that ensures approximatively the same<br />
ID in<strong>de</strong>x for u for every <strong>de</strong>composition mo<strong>de</strong>l.<br />
Figures 4.4 and 4.5 un<strong>de</strong>rscore a better ability of (VO) and (OSV) mo<strong>de</strong>ls compared to the<br />
ROF mo<strong>de</strong>l in terms of texture discrimation. In fact, it can be seen that the v component<br />
of the ROF mo<strong>de</strong>l also contains smooth structures related to ocean and clouds, and not<br />
visible with VO and OSV <strong>de</strong>compositions. Nevertheless, <strong>de</strong>spite a strong regularization<br />
(ID=0.7), striping is still visible in the u-component of all three <strong>de</strong>composition mo<strong>de</strong>ls.<br />
Remarquably, we point out that the u-component <strong>de</strong>rived from ROF mo<strong>de</strong>l contains less<br />
stripes than that obtained with (VO) and (OSV) mo<strong>de</strong>ls. This observation is in agreement<br />
with the conlusion drawn from the wavelet analysis of section 3.7. In<strong>de</strong>ed, as a result of its<br />
high intensity (in terms of gradient values), striping tends to be consi<strong>de</strong>red as an image<br />
discontinuity and is therefore better preserved in the cartoon component u of texture<br />
discriminating variational mo<strong>de</strong>ls.<br />
For all three mo<strong>de</strong>ls, the presence of residual stripes <strong>de</strong>spite oversmoothing, is a limitation<br />
related to the contradictive compromise between the terms of the energy functionals. In<br />
fact, in addition to the true image u being attached simply to the noisy image f (regardless<br />
the norm used), the commonly used TV-norm reinforces the anisotropic preservation of<br />
structures and does not distinguish strong gradient values related to striping from those<br />
corresponding to edges. We recall that the initial motivation behind the use of variational<br />
<strong>de</strong>composition mo<strong>de</strong>ls is the textured aspect of striping due to its unidirectionality. This<br />
feature however, is not accounted for neither in the fi<strong>de</strong>lity term nor in the regularizing<br />
term.<br />
We shall see in the following sections how the introduction of directional information in<br />
variational mo<strong>de</strong>ls offers a new perpective for the removal of stripe noise.
Figure 4.4 – Decomposition of the image from Terra MODIS band 30 as u (Left) +<br />
v (Right). λ is selected so that ID(u) is the same for the three mo<strong>de</strong>ls. From top to<br />
bottom, TV mo<strong>de</strong>l (NR=4.56, ID=0.739), VO mo<strong>de</strong>l (NR=4.23, ID=0.735) and OSV<br />
mo<strong>de</strong>l (NR=2.47, ID=0.735)<br />
89
90 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.5 – Decomposition of the image from Terra MODIS band 33 as a cartoon u<br />
(Left) + v (Right). λ is selected so that ID(u) is the same for the three mo<strong>de</strong>ls. From<br />
top to bottom, TV mo<strong>de</strong>l (ID=0.447), VO mo<strong>de</strong>l (ID=0.472) and OSV mo<strong>de</strong>l (ID=0.461)
91<br />
4.4 Destriping via gradient field integration<br />
This far, we introduced variational methods based on PDE’s and energy functional minimization,<br />
with image <strong>de</strong>noising applications in mind. These techniques are actually used<br />
extensively in computer vision/graphics, to solve over-constrained geometric problems.<br />
It is typically the case of Photometric Stereo Methods (PSM) and Shape From Shading<br />
(SFS) applications where the goal is to recover a <strong>de</strong>pth map (or an image) by integrating<br />
a gradient field with discrete values.<br />
Let us <strong>de</strong>note by G =(G x ,G y ) a bidimensional gradient vector <strong>de</strong>fined in a subspace<br />
Ω of R 2 . The problem of gradient field integration consists in <strong>de</strong>termining a function u<br />
whose gradient ∇u is close to G. Two classes of techniques can be used to tackle this<br />
ill-posed problem and estimate the true image u. Local integration techniques [Coleman<br />
et al., 1982], [Healey and Jain, 1984] and [Wu and Li, 1988] rely on a curve integration :<br />
∫<br />
u(x, y) =u(x 0 ,y 0 )+ G x dx + G y dy (4.69)<br />
where γ is the integration path from a starting point (x 0 ,y 0 ) to pixel (x, y) ∈ Ω. Local integration<br />
techniques recover an image u starting with an initial height and then propagating<br />
height values according to the neighborhood gradient values. Local integration techniques<br />
are <strong>de</strong>pen<strong>de</strong>nt on the data accuracy and can propagate error values when <strong>de</strong>aling with<br />
noisy gradient fields. Global integration methods [Horn and Brooks, 1986], [], [Frankot<br />
and Chellappa, 1988] and [Horn, 1990] can be formulated in a variational framework as<br />
the minimization of an energy functional :<br />
∫<br />
E(u) =<br />
Ω<br />
γ<br />
( ) ∂u 2 ( ) ∂u 2<br />
∂x − G x +<br />
∂y − G y dx dy (4.70)<br />
Unlike <strong>de</strong>noising and <strong>de</strong>composition variational mo<strong>de</strong>ls <strong>de</strong>scribed this far, both terms in the<br />
energy functional (4.70) are fi<strong>de</strong>lity terms that measure the L 2 norm difference between the<br />
gradient field components of u and the observed gradient field G. For instance, the energy<br />
functional does not inclu<strong>de</strong> any lagrange multiplier λ. The Euler-Lagrange equations of<br />
the previous functionals leads to :<br />
∂<br />
∂x<br />
( ∂u<br />
∂x − G x<br />
which can be simplified into the following Poisson equation :<br />
)<br />
+ ∂ ( ) ∂u<br />
∂x ∂y − G y = 0 (4.71)<br />
∇ 2 u = ∇.G (4.72)<br />
The previous equation can be solved using a fast marching method [Ho et al., 2006] or<br />
the streaming multigrid method proposed in [Kazhdan and Hoppe, 2008]. Among several<br />
other techniques, we draw a particular attention to the well-known Frankot-Chellapa
92 4. A Variational approach for the <strong>de</strong>striping issue<br />
(FC) algorithm [Frankot and Chellappa, 1988], which provi<strong>de</strong>s a solution by consi<strong>de</strong>ring<br />
the Fourier transform of the gradient field G components. Let us <strong>de</strong>note by (ξ x ,ξ y ) the<br />
frequency components as in [Bracewell, 1986] and recall the differentiation properties of<br />
the Fourier transform :<br />
F<br />
⎧⎪ ( ∂u<br />
( ∂x)<br />
) = j.ξx F(u)<br />
⎨ F ∂u<br />
∂y<br />
= j.ξ y F(u)<br />
( )<br />
F ∂ 2 u<br />
= ξ 2 (4.73)<br />
xF(u)<br />
⎪ ⎩<br />
∂ 2 x<br />
F<br />
(<br />
∂ 2 u<br />
∂ 2 y<br />
)<br />
= ξyF(u)<br />
2<br />
where j is the imaginary unit √ −1. The fourier transform of the Poisson equation (4.72)<br />
can be written as :<br />
(<br />
ξ<br />
2<br />
x + ξy<br />
2 )<br />
F(u) =−jξx F(G x ) − jξ y F(G y ) (4.74)<br />
Denoting u F , G F x and G F y the fourier transform of u, G x and G y , the Frankot-Chellapa<br />
reconstruction algorithm gives :<br />
u F = −jξ xG F x − jξ y G F y<br />
ξ 2 x + ξ 2 y<br />
(4.75)<br />
As we will see, gradient field integration problems and their gradient-based variational<br />
formulation offer an interesting perspective on the <strong>de</strong>striping issue. In fact, compared to<br />
other restoration-oriented variational mo<strong>de</strong>ls, the energy functional (4.70) clearly separates<br />
the information related to vertical gradient and horizontal gradient. Going further<br />
in this gradient-based reasoning, we make the following remark :<br />
If the stripe noise is additive, it mostly affects the vertical gradient of the striped image<br />
Let us the consi<strong>de</strong>r the following image formation mo<strong>de</strong>l :<br />
I s = I + n (4.76)<br />
where I is the stripe free true image and n is the stripe noise. The linear operator K is<br />
consi<strong>de</strong>red to be the i<strong>de</strong>ntity. Let us assume that the unidirectional signature of the stripe<br />
noise n translates on its horizontal gradient as :<br />
∂n(x, y)<br />
∂x<br />
≈ 0 (4.77)<br />
The partial <strong>de</strong>rivatives along the x and y-axis of the image formation mo<strong>de</strong>l (4.76) :<br />
∂I s<br />
∂x = ∂I<br />
∂x + ∂n<br />
∂x<br />
∂I s<br />
∂y = ∂I<br />
∂y + ∂n<br />
∂y<br />
(4.78)
93<br />
Figure 4.6 – (Left) Horizontal and (Right) vertical gradient of the image from Terra<br />
MODIS band 30. The stripe noise is isolated in the vertical gradient<br />
can be simplified un<strong>de</strong>r the assumption (4.77) into :<br />
∂I s<br />
∂x ≈ ∂I<br />
∂x<br />
∂I s<br />
∂y = ∂I<br />
∂y + ∂n<br />
∂y<br />
(4.79)<br />
Since the stripe noise only affects the horizontal gradient of the image (figure 4.6), we<br />
propose a variational mo<strong>de</strong>l where the directional information is distributed separately on<br />
the fi<strong>de</strong>lity term and the regularizing term. In addition, the regularization is limited to the<br />
direction of the stripe noise. Un<strong>de</strong>r these requirements, we minimize the following energy :<br />
∫<br />
E(u) =<br />
Ω<br />
∂(u − I s )<br />
∥ ∂x<br />
∥<br />
2<br />
∫<br />
dx dy + λ<br />
Ω<br />
∂(u − H ⊗ I s )<br />
∥ ∂y<br />
∥<br />
2<br />
dx dy (4.80)<br />
where H is a low-pass filter applied to the noisy image I s only to approximate the true<br />
image cross-track profile. In fact, if the regularizing term in (4.80) is replaced with ‖ ∂u<br />
∂y ‖2 ,<br />
lines of the estimated solution u will have zero mean. Frankot-Chellapa algorithm presented<br />
previously can be used to minimize the previous energy functional which Euler-Lagrange<br />
equation is :<br />
∂ 2 (<br />
u<br />
∂ 2 x − ∂2 I s ∂ 2 )<br />
∂ 2 x + λ u<br />
∂ 2 y − ∂2 (H ⊗ I s )<br />
∂ 2 =0 (4.81)<br />
y<br />
Using the differienciation properties of the fourier transform, the previous equation can<br />
be expressed as :<br />
ξ 2 x(u F − I F s )+λξ 2 y(u F − H F .I F s )=0 (4.82)
94 4. A Variational approach for the <strong>de</strong>striping issue<br />
1<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
1<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
u<br />
u<br />
v<br />
v<br />
Figure 4.7 – Frequency response of the filter ˜H. As the value of λ <strong>de</strong>creases, only frequencies<br />
close to the vertical axis of the fourier domain are reduced.<br />
where u F , Is<br />
F and H F are the fourier transform of u, I s and H. An estimate of the stripe<br />
free true image u is obtained with a simple inverse fourier transform :<br />
)<br />
u = F −1 (<br />
(ξ<br />
2<br />
x + λξ 2 yH F ).I F s<br />
ξ 2 x + λξ 2 y<br />
(4.83)<br />
Remark : If we ignore the term H ⊗I s in (4.80) and <strong>de</strong>note ˜H a filter <strong>de</strong>fined in the fourier<br />
domain as :<br />
ξx<br />
˜H 2 =<br />
ξx 2 + λξy<br />
2 (4.84)<br />
<strong>de</strong>striping via the variational mo<strong>de</strong>l (4.80) is equivalent to filtering with ˜H. The fourier<br />
response of the filter ˜H is illustrated in figure 4.7.<br />
The <strong>de</strong>striping variational mo<strong>de</strong>l (4.80) is applied to images extracted from Terra<br />
MODIS band 27, 30 and 33 and the results are illustrated in figures 4.8 and 4.9. In the case<br />
of homogeneous data, as in band 27, we observe a complete removal of the striping effect<br />
without any visible blur in the <strong>de</strong>striped result. We point out that the overall blur, i.e the<br />
image distortion in<strong>de</strong>x <strong>de</strong>fined in section 3.8, <strong>de</strong>pends on the lagrange multiplier λ, whch<br />
choice is discussed further in section 4.6. Although the results on band 27 are satisfactory,<br />
the <strong>de</strong>striping mo<strong>de</strong>l does not perform as well on images containing strong discontinuities.<br />
Figure 4.9, clearly shows local blurring artifacts along sharp edges at ocean-land and oceanclouds<br />
transitions. This major limitation is, analogically to Tikhonov regularization, due<br />
to the L 2 norm used in (4.80) which is not able to preserve sharp structures.<br />
4.5 A unidirectional variational <strong>de</strong>striping mo<strong>de</strong>l<br />
From a variational perspective, we first tackled the striping issue with ROF total variation<br />
regularization mo<strong>de</strong>l. We also explored image <strong>de</strong>composition mo<strong>de</strong>ls for their ability
95<br />
Figure 4.8 – (Left) Noisy image from Terra MODIS band 27 (Right) Image <strong>de</strong>striped<br />
with the variational mo<strong>de</strong>l (3.76) showing no evi<strong>de</strong>nce of stripes or distortion (ID=0.989)<br />
Figure 4.9 – (Left) Noisy image from Terra MODIS band 30 (b) Image <strong>de</strong>striped with the<br />
variational mo<strong>de</strong>l (3.76). Although stripes have been completely removed, local blurring<br />
artifacts appear along the image discontinuities.<br />
to discriminate texture. The attempt to isolate the stripe noise in the texture component<br />
v fails as the total variation norm in the fi<strong>de</strong>lity term provi<strong>de</strong>s oversmoothed results.<br />
Gradient field integration algorithms based on a variational formulation are suited for the<br />
issue of <strong>de</strong>striping because of the separation between vertical and horizontal information<br />
in the energy functional to be minimized. The <strong>de</strong>striping variational mo<strong>de</strong>l <strong>de</strong>rived in the<br />
previous section performs well on homogeneous areas but introduces local blur artifacts
96 4. A Variational approach for the <strong>de</strong>striping issue<br />
along strong edges. In this section, we overcome this drawback and introduce a new variational<br />
mo<strong>de</strong>l that satisfies the requirements of optimal <strong>de</strong>striping.<br />
In chapter 3, we attributed the limitations of standard <strong>de</strong>striping techniques to the simplistic<br />
assumptions ma<strong>de</strong> on the stripe noise. Equalization based methods (moment matching,<br />
histogram matching and OFOV techniques) assume that the stripe noise can be mo<strong>de</strong>lled<br />
with a gain and offset between the <strong>de</strong>tectors of the sensor. The presence of strong nonlinearities<br />
on MODIS <strong>de</strong>tectors responses, discredits this assumption. A simple and more<br />
realistic assumption lies in the directional aspect of stripe noise. For instance, if we <strong>de</strong>note<br />
by n the stripe noise, it is resonable to assume that :<br />
∣ ∀(x, y) ∈ Ω,<br />
∂n(x, y)<br />
∣∣∣ ∣ ∂x ∣ ≪ ∂n(x, y)<br />
∂y ∣ (4.85)<br />
The integration of the previous inequality over the entire image domain Ω results in :<br />
∫<br />
∫<br />
∂n(x, y)<br />
∣ ∂x ∣ ≪ ∂n(x, y)<br />
∣ ∂y ∣ (4.86)<br />
Ω<br />
which translates a realistic characteristic of stripe noise when written as :<br />
Ω<br />
TV x (n) ≪ TV y (n) (4.87)<br />
where TV x and TV y are respectively horizontal and vertical variations of the noise n.<br />
The L 1 norm being an edge-preserving norm can be introduced in a variational mo<strong>de</strong>l<br />
where the fi<strong>de</strong>lity term takes into account the stripe free horizontal information while<br />
the regularization term only smoothes the result along the vertical axis. We propose a<br />
<strong>de</strong>striping variational mo<strong>de</strong>l based on the minimization of the following energy :<br />
E(u) =TV x (u − I s )+λT V y (u) (4.88)<br />
We anticipate the non-differentiability of this functional at points where ∂u<br />
= 0 by introducing a small parameter ɛ in (4.88) which becomes :<br />
∂u<br />
∂y<br />
∂x = ∂Is<br />
∂x<br />
and<br />
∫<br />
E ɛ (u) =<br />
Ω<br />
√ (∂(u ) − Is ) 2 ∫<br />
+ ɛ 2 + λ<br />
∂x<br />
Ω<br />
√ (∂u ) 2<br />
+ ɛ 2 (4.89)<br />
The mo<strong>de</strong>l (4.89) will be refered to hereafter as the Unidirectional Variational Destriping<br />
Mo<strong>de</strong>l (UVDM). Its Euler-Lagrange equation is given by :<br />
− ∂<br />
∂x<br />
⎛<br />
⎜<br />
⎝<br />
∂(u−I s)<br />
∂x<br />
√ (<br />
∂(u−Is)<br />
∂x<br />
⎞<br />
⎛<br />
⎟<br />
) 2 ⎠ − λ ∂ ⎜<br />
∂y ⎝<br />
+ ɛ 2<br />
√ (<br />
∂u<br />
∂y<br />
∂u<br />
∂y<br />
∂y<br />
⎞<br />
⎟<br />
) 2 ⎠ =0 (4.90)<br />
+ ɛ 2
97<br />
Using the same notations as in sections 4.2, equation (4.90) can be discretized as :<br />
(<br />
) (<br />
)<br />
D +x (u i,j − f i,j )<br />
D +y u i,j<br />
D −x √ + λD −y √ =0<br />
(D+x (u i,j − f i,j )) 2 + ɛ 2 (D+y u i,j ) 2 + ɛ 2<br />
(<br />
)<br />
(u i+1,j − u i,j − f i+1,j + f i,j )<br />
√ − (u i,j − u i−1,j − f i,j + f i−1,j )<br />
√<br />
(D+x (u i,j − f i,j )) 2 + ɛ 2 (D−x (u i,j − f i,j )) 2 + ɛ 2<br />
+λ<br />
(<br />
)<br />
u i,j+1 − u i,j<br />
√<br />
(D+y u i,j ) 2 + ɛ − u i,j − u i,j−1<br />
√ =0<br />
2 (D−y u i,j ) 2 + ɛ 2<br />
(4.91)<br />
We introduce the following linearization :<br />
⎛<br />
⎞<br />
⎝ (un i+1,j − un+1 i,j<br />
− f i+1,j + f i,j )<br />
√<br />
− (un+1 i,j<br />
− u n i−1,j − f i,j + f i−1,j )<br />
√<br />
⎠<br />
(D +x (u n i,j − f i,j)) 2 + ɛ 2 (D −x (u n i,j − f i,j)) 2 + ɛ 2<br />
⎛<br />
⎞<br />
+λ ⎝<br />
un i,j+1 − un+1 i,j<br />
√<br />
− un+1 i,j<br />
− u n i,j−1<br />
√<br />
⎠ =0<br />
(D +y u n i,j )2 + ɛ 2 (D −y u n i,j )2 + ɛ 2<br />
(4.92)<br />
If we <strong>de</strong>note :<br />
C 1 =<br />
C 2 =<br />
C 3 =<br />
C 4 =<br />
1<br />
√<br />
(D +x (u n i,j − f i,j)) 2 + ɛ 2<br />
1<br />
√<br />
(D −x (u n i,j − f i,j)) 2 + ɛ 2<br />
(4.93)<br />
1<br />
√<br />
(D +y u n i,j )2 + ɛ 2<br />
1<br />
√<br />
(D −y u n i,j )2 + ɛ 2<br />
The <strong>de</strong>striped image is obtained with a fixed point iterative scheme :<br />
u n+1<br />
i,j<br />
= C 1(u n i+1,j − f i+1,j + f i,j )+C 2 (u n i−1,j + f i,j − f i−1,j )+λC 3 u n i,j+1 + λC 4u n i,j−1<br />
C 1 + C 2 + λC 3 + λC 4<br />
(4.94)<br />
4.6 Optimal regularization<br />
The limitations of standard <strong>de</strong>striping techniques discussed at the end of chapter 3,<br />
were used as a starting point to establish the requirements of optimal <strong>de</strong>striping. One of
98 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.10 – (Left) Noisy image from Terra MODIS band 30 (Center) Destriped<br />
with histogram matching (IMAPP) showing residual stripes (Right) Destriped with the<br />
UVDM illustrating complete removal of striping without any bluring or ringing artifacts<br />
Figure 4.11 – (Left) Noisy image from Terra MODIS band 33 (Center) Destriped<br />
with histogram matching (IMAPP) showing residual stripes in spite of noisy <strong>de</strong>tectors<br />
being replaced with neighbors (Right) Image <strong>de</strong>striped with the UVDM showing efficient<br />
removal of radom striping without bluring or ringing artifacts<br />
these requirements dictates minimum distortion in the <strong>de</strong>striped image. The ID in<strong>de</strong>x in<br />
clearly <strong>de</strong>pen<strong>de</strong>nt on the choice of the lagrange multiplier λ. The coefficient λ regulates<br />
the smoothness of the solution and its impact on the restored image can be interpreted as<br />
follows : A large value of λ may result in an oversmoothed solution, visually similar to what<br />
could be achieved with a low-pass filter, or a hard thresholding of wavelet coefficients in<br />
the lower scales. On the other hand, if λ is too small, the result might still contain noise. In<br />
fact, if we consi<strong>de</strong>rer the ROF mo<strong>de</strong>l, its minimizer converges to the original noisy image<br />
f when λ → 0. In the case of the UVDM, when λ → 0, the solution converges to that of<br />
the following optimization problem :<br />
√<br />
∫ (∂(u ) − Is ) 2<br />
E ɛ (u) =<br />
+ ɛ<br />
∂x<br />
2 (4.95)<br />
Ω
99<br />
which is not unique. In<strong>de</strong>ed, the solution of (4.95) is the set {u ∈ BV (Ω)/u = f +<br />
C, ∫ ∂C<br />
Ω ∂x<br />
=0} which corresponds to the set of images that differs from f on a constant<br />
per line. Due to the variations of stripe noise along the x-direction, any solution of (4.95)<br />
will still display residual stripes. We are then lead to the question of how to <strong>de</strong>termine a<br />
value of λ that removes all the stripe noise while maintainin the image distortion in<strong>de</strong>x<br />
close to 1.<br />
4.6.1 Tadmor-Nezzar-Vese (TNV) hierarchical <strong>de</strong>composition<br />
In [Tadmor et al., 2004], the authors introduce a multiscale image representation based<br />
on a hierarchical adaptive <strong>de</strong>composition. The ROF mo<strong>de</strong>l is iteratively solved to generate<br />
a sequence of solutions which sum converges to the original image. We propose a<br />
mo<strong>de</strong>st adaptation of this strategy to our variational <strong>de</strong>striping mo<strong>de</strong>l. Let us consi<strong>de</strong>r<br />
the following <strong>de</strong>composition for a striped image I s :<br />
[u 0 ,v 0 ]= argmin<br />
(u,v)/u+v=I s<br />
TV x (v)+λ 0 TV y (u)<br />
(4.96)<br />
If the inital value λ 0 is not too small, then u 0 can be consi<strong>de</strong>red as a cartoon approximation<br />
of the true stripe-free image I, while the component v 0 mainly contains stripe noise.<br />
Following Tadmor et al.’s remark that a texture at a scale λ contains edges at a refined<br />
scale λ 2 , the noisy component v 0 can also be <strong>de</strong>composed using the same variational mo<strong>de</strong>l :<br />
[u 1 ,v 1 ]= argmin<br />
(u,v)/u+v=v 0<br />
TV x (v)+ λ 0<br />
2 TV y(u) (4.97)<br />
The previous <strong>de</strong>composition can be seen as a dyadic refinement to the approximation u 0<br />
and can be iterated as follows :<br />
[u k ,v k ]= argmin<br />
(u,v)/u+v=v k−1<br />
TV x (v)+ λ 0<br />
2 k TV y(u) (4.98)<br />
leading to a simple multilayered representation of the original noisy image I s :<br />
I s = u 0 + v 0<br />
= u 0 + u 1 + v 1<br />
= u 0 + u 1 + u 2 + v 2<br />
(4.99)<br />
= ...<br />
= u 0 + u 1 + u 2 + u 3 + ... + u k + v k<br />
The previous expansion translates the hierarchical <strong>de</strong>composition of I s :<br />
j=k<br />
∑<br />
lim u j = I s (4.100)<br />
k→∞<br />
j=0
100 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.12 – Optimal <strong>de</strong>striping using Tadmor et al. hierarchical <strong>de</strong>composition approach.<br />
From left to right and top to bottom, noisy image from Terra band 30 and successive<br />
<strong>de</strong>striped results for iterations 1 to 7. The value λ 0 = 10 have been selected to ensure<br />
initial oversmoothing<br />
This iterated process provi<strong>de</strong>s a multiscale representation of I s where the successive terms<br />
u k extract <strong>de</strong>tails of the noise-free image I related to the scale λ 0 2 k , while sharper <strong>de</strong>tails<br />
associated with stripe and inclu<strong>de</strong>d in the finer scale λ 0 2 k+1 are isolated in the term v k . The<br />
original TNV hierachical <strong>de</strong>composition was initially proposed as a multiscale framework<br />
in the context of ROF regularization but does not aim at removing noise from the images.<br />
In the later case, a stopping criteria is required so that the term ∑ j=k<br />
j=0 u j does not contain<br />
stripe <strong>de</strong>tails. This is discussed in section 4.6.3. TNV hierarchical <strong>de</strong>composition is applied<br />
to a striped image extracted from Terra MODIS band 30 and illustrated in figure 4.12.<br />
The stripe noise extracted at each iteration is displayed in figure 4.13<br />
4.6.2 Osher et al. iterative regularization method<br />
In the orignal ROF mo<strong>de</strong>l, the term f − u can still contain fine edges and textures if<br />
the lagrange multiplier λ is not choosen carefully. To minimize the removal of structures<br />
from the estimate solution, [Osher et al., 2005] introduced an iterative refinement of the<br />
ROF mo<strong>de</strong>l and proposed a generalization for other variational mo<strong>de</strong>ls based on the use of<br />
Bregman distances. In the case of ROF regularization, the iterative methodology follows<br />
three steps :<br />
Step 1 : Solve the original ROF mo<strong>de</strong>l :<br />
{∫ ∫<br />
u 1 =<br />
inf<br />
u∈BV (Ω)<br />
|∇u| + λ<br />
Ω<br />
Ω<br />
(f − u) 2 }<br />
(4.101)
101<br />
Figure 4.13 – From left to right and top to bottom, extracted stripe noise using Tadmor<br />
et al. hierarchical <strong>de</strong>composition approach for iterations 1 to 8.<br />
This leads to a <strong>de</strong>composition of the image f as f = u 1 + v 1 where v 1 is the estimated<br />
noisy component.<br />
Step 2 : Inject the noise estimated in the first step v 1 in the fi<strong>de</strong>lity term and solve :<br />
{∫ ∫<br />
u 2 =<br />
inf<br />
u∈BV (Ω)<br />
|∇u| + λ<br />
Ω<br />
Ω<br />
(f + v 1 − u) 2 }<br />
(4.102)<br />
This correction step provi<strong>de</strong>s a <strong>de</strong>composition of the form f + v 1 = u 2 + v 2<br />
Step 3 : Solve :<br />
{∫ ∫<br />
}<br />
u k+1 = inf |∇u| + λ (f + v k − u) 2<br />
u∈BV (Ω) Ω<br />
Ω<br />
(4.103)<br />
where v k is obtained after k iterations as v k = v k−1 + f − u k . This iterated methodology<br />
is exten<strong>de</strong>d by Osher et al. to other inverse problems by consi<strong>de</strong>ring a general variational<br />
mo<strong>de</strong>l of the form :<br />
inf {J(u)+H(u, f)} (4.104)<br />
u<br />
where J(u) is a convex non negative regularizing functional and H(u, f) the fi<strong>de</strong>lity term.<br />
The general case consists of iteratively solving :<br />
u k+1 = inf<br />
u<br />
{J(u)+H(u, f)− < u, p k >} (4.105)<br />
where < ., . > is the duality product and p k is a subgradient of J at u k . The adaptation to<br />
the UVDM is straightforward. Replacing J(u) with λT V y (u) and H(u, f) with TV x (u−f),
102 4. A Variational approach for the <strong>de</strong>striping issue<br />
the iterative procedure can be written as :<br />
u k+1 = inf<br />
u<br />
{<br />
TV x (u − f)+λT V y (u) −<br />
∫<br />
Ω<br />
}<br />
u∂J(u k )<br />
(4.106)<br />
In practice, we consi<strong>de</strong>r a smoothed version of TV y , and the subdifferential ∂J can be<br />
replaced by the gradient of J(u) with respect to u. Equation (4.106) then becomes :<br />
⎛ ⎛<br />
⎞⎞<br />
∫<br />
u k+1 = inf TV x (u − f)+λT V y (u) − u ⎝λ ∂ ∂u k<br />
⎝<br />
∂y<br />
√ ⎠⎠ (4.107)<br />
u<br />
Ω ∂y<br />
( ∂u k<br />
∂y )2 + ɛ<br />
4.6.3 Stopping criteria<br />
Whether using TVN <strong>de</strong>composition or Osher et al. methodology, there exists an iteration<br />
k, where the estimate û k is the closest to the true sripe free image. In both cases,<br />
if k →∞, û k converges to the noisy image I s . In [Osher et al., 2005] the discrepancy<br />
principle is used as a stopping rule. Assuming that the noise level δ is known, the iterative<br />
procedure is stopped as soon as the residual term ‖û k − I s ‖ reaches a value of the same<br />
or<strong>de</strong>r as δ. In our case, the stripe noise level is not known and we have to relie on another<br />
approach. The unidirectionality of stripe noise can be exploited, again, to <strong>de</strong>fine a reliable<br />
stopping criteria. The variational mo<strong>de</strong>l (4.84), was <strong>de</strong>signed in or<strong>de</strong>r to constrain the<br />
regularization only to the direction of striping. Nevertheless, if the lagrange multiplier λ is<br />
exessively high, the estimated solution will also be smoothed in the horizontal direction.<br />
If we recall that the unidirectionality of striping translates as the horizontal gradients of<br />
the noisy image I s and the true image I being of the same or<strong>de</strong>r, λ has to be chosen so<br />
that :<br />
∫<br />
∂(û − f)<br />
∣ ∂x ∣ ≤ ɛ (4.108)<br />
Ω<br />
where ɛ is a tolerance parameter that regulates the amount of distortion introduced in<br />
û. In pratice, the difficulties related to the <strong>de</strong>termination of ɛ can be easily overcome. In<br />
fact, an optimal <strong>de</strong>striping is expected to preserve the ensemble averaged power spectrum<br />
down the lines of the noisy image because striping only affects one direction. This means<br />
that the spectral distribution of the information averaged accross the swath should be<br />
approximatively the same for the striped image and the estimated true scene. Conveniently,<br />
such measure is provi<strong>de</strong>d by the Image distortion in<strong>de</strong>x (ID) ; We recall that the ID reflects<br />
a spectral fi<strong>de</strong>lity between the <strong>de</strong>striped and original signals in the direction orthogonal to<br />
striping. As TVN <strong>de</strong>composition and Osher et al. iterative procedures result in a sequence<br />
of solutions {u k } that converges to an image û = I s + C with TV x (C) = 0, we have :<br />
lim<br />
k→∞ ID(u k)=1 (4.109)<br />
A stopping criteria can then be established using a threshold value, ID thres = 0.95.<br />
This threshold was <strong>de</strong>termined heuristically to ensure simultaneously complete removal
103<br />
Image distortion<br />
1<br />
0.95<br />
0.9<br />
0.85<br />
0.8<br />
0.75<br />
0.7<br />
0.65<br />
0.6<br />
0.55<br />
0.5<br />
1 2 3 4 5 6 7 8<br />
Iteration<br />
Image distortion<br />
1<br />
0.95<br />
0.9<br />
0.85<br />
0.8<br />
0.75<br />
0.7<br />
0.65<br />
0.6<br />
0.55<br />
0.5<br />
0.45<br />
0.4<br />
1 2 3 4 5 6 7 8 9 10 11 12<br />
Iteration<br />
Figure 4.14 – Image distortion in<strong>de</strong>x as a function of number of iterations starting with<br />
λ 0 = 10 and using (Left) Tadmor et al. dyadic hierarchical <strong>de</strong>composition (Right) Osher<br />
et al. iterative method<br />
of stripes and minimum distortion. If the threshold value is very close to 1, the estimated<br />
solution might inclu<strong>de</strong> residual striping due to non linearities or random stripes. In fact,<br />
the case ID = 1 corresponds to λ = 0.<br />
4.6.4 Experimental results and discussion<br />
The UVDM was applied to the entire data set used in this study. Experimental comparison<br />
of TVN and Osher et al. procedure shows that TVN provi<strong>de</strong>s a faster convergence<br />
to the solution with an ID close to 1. It also offers more flexibility to reduce the number of<br />
iterations which is <strong>de</strong>pen<strong>de</strong>nt on the initial choice of λ 0 . This can be achieved using tryadic<br />
or higher or<strong>de</strong>r n updates of the lagrange multiplier λ as λ k+1 = λ 0 /n k . The application of<br />
TVN hierarchical <strong>de</strong>composition on the image from Terra MODIS band 30 shows the gradual<br />
extraction of <strong>de</strong>tails through the iterations without retrieval of striping (figure 4.12).<br />
Figure 4.13 illustrates how the extracted striping noise is progressively <strong>de</strong>correlated from<br />
the original signal and isolated from the true scene structures.<br />
Figures 4.10 and 4.11 show the <strong>de</strong>striping results obtained with NASA’s IMAPP software<br />
and the UVDM on images from Terra MODIS band 30 and 33. We point out that the<br />
strategy adopted in the IMAPP software to remove non linear effects and random stripes<br />
is to replace corresponding <strong>de</strong>tectors with neighboors. Despite the distortion introduced by<br />
such procedure, residual stripes are still persistent in the resotred image. Complementary<br />
analysis of cross-track profiles (figure 4.15) and ensemble averaged power spectrum down<br />
the columns (figure 4.16), un<strong>de</strong>rscores the performances of the UVM. Cross-track profiles<br />
are properly smoothed without erasing sharp fluctuations related to transitions between<br />
ocean and land. Futhermore, examination of column power spectrums obtain with the<br />
UVM show that 1) spectral peaks associated with periodic stripes are completely removed<br />
2) rapid fluctuations in the high frequency range due to random stripes are canceled 3)<br />
the overall shape of the column spectrum is preserved. These qualitative observations are
104 4. A Variational approach for the <strong>de</strong>striping issue<br />
supported by quantitative measurements reported in tables 4.1 and 4.2.<br />
Although the UVM was <strong>de</strong>rived intuitively by combining edge-preserving mo<strong>de</strong>ls and gradient<br />
field integration approaches, similar results can be achieved with slightly different<br />
variational mo<strong>de</strong>ls. These are based on the minimization of the following energy functionals<br />
:<br />
E 1 (u) =TV x (u − f)+λT V (u) (4.110)<br />
∫ ( ) ∂ (u − f) 2<br />
E 2 (u) =<br />
+ λT V (u) (4.111)<br />
Ω ∂x<br />
∫ ( ) ∂ (u − f) 2<br />
E 3 (u) =<br />
+ λT V y (u) (4.112)<br />
∂x<br />
Ω<br />
In the mo<strong>de</strong>l (4.112), the L 1 -norm on the x-gradient is replaced by the L 2 -norm. This<br />
modification does not cause bluring artifacts as the edges are still preserved by the regularizing<br />
term which inclu<strong>de</strong>s the L 1 -norm of the y-gradient. Nevertheless, the original<br />
UVDM is more suited to isolate striping due to the L 1 -norm being weaker than the standard<br />
L 2 -norm (L 2 (Ω) ∈ L 1 (Ω)). For u-components holding the same ID in<strong>de</strong>x and <strong>de</strong>rived<br />
from (4.112) and the UVDM, the noisy component v extracted with the UVDM contains<br />
more stripe-related texture. This feature comes in handy in the TVN hierarchical <strong>de</strong>composition<br />
where the <strong>de</strong>striped image is obtained by progressively extracting striping from<br />
oversmoothed u estimates. The L 1 -norm in the fi<strong>de</strong>lity term then ensures a minimal number<br />
of iterations compared to the L 2 -norm.<br />
The mo<strong>de</strong>l (4.110) replaces the regularizing term of the UVM mo<strong>de</strong>l with the commonly<br />
used TV-norm which provi<strong>de</strong>s similar results than the UVM but increases the computational<br />
cost required for the minimization of its energy functional. This drawback, together<br />
with the use of L 2 -norm in the fi<strong>de</strong>lity term are both present in the variational mo<strong>de</strong>l<br />
(4.111).<br />
From a <strong>de</strong>noising perspective, the UVDM and mo<strong>de</strong>ls (4.110), (4.111), (4.112) satisfy the<br />
<strong>de</strong>striping requirements imposed in chapter 3, namely complete stripe removal without<br />
blur/ringing artifacts. In fact, both TVN and/or Osher et al. iterative procedures ensure<br />
that the ID in<strong>de</strong>x of the optimally <strong>de</strong>striped image is close to 1. This emphazises the<br />
importance of a suitable fi<strong>de</strong>lity term which, for all <strong>de</strong>striping mo<strong>de</strong>ls <strong>de</strong>scribed above,<br />
takes into account the unidirectional property of striping.
105<br />
17500<br />
23500<br />
Mean value<br />
16500<br />
15500<br />
Mean value<br />
23000<br />
22500<br />
14500<br />
0 100 200 300 400 500<br />
Line Number<br />
22000<br />
0 100 200 300 400 500<br />
Line Number<br />
17500<br />
23500<br />
Mean value<br />
16500<br />
15500<br />
Mean value<br />
23000<br />
22500<br />
14500<br />
0 100 200 300 400 500<br />
Line Number<br />
22000<br />
0 100 200 300 400 500<br />
Line Number<br />
17500<br />
23500<br />
Mean value<br />
16500<br />
15500<br />
Mean value<br />
23000<br />
22500<br />
14500<br />
0 100 200 300 400 500<br />
Line Number<br />
22000<br />
0 100 200 300 400 500<br />
Line Number<br />
Figure 4.15 – Cross-Track profiles for Terra MODIS band 30 (Left) and band 33 (Right).<br />
From top to bottom : Original image, histogram matching with IMAPP and proposed<br />
UVDM
106 4. A Variational approach for the <strong>de</strong>striping issue<br />
10<br />
8<br />
Power spectrum<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
Power spectrum<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
10<br />
8<br />
Power spectrum<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
Power spectrum<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
10<br />
8<br />
Power spectrum<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
Power spectrum<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
2<br />
0 0.1 0.2 0.3 0.4 0.5<br />
Normalized frequency<br />
Figure 4.16 – Column power spectrum for Terra MODIS band 27 (Left) and band 33<br />
(Right). From top to bottom : Original image, histogram matching with IMAPP and<br />
proposed UVDM
Table 4.1 – Noise Reduction (NR), Image distortion (ID), radiometric Improvement Factors IF 1 and<br />
IF 2 for the Terra MODIS band 27, 30 and 33<br />
– Terra MODIS band 27 Terra MODIS band 30 Terra MODIS band 33<br />
in<strong>de</strong>x NR ID IF 1 IF 2 NR ID IF 1 IF 2 NR ID IF 1 IF 2<br />
moment matching 45.8895 0.6305 7.3085 11.5732 9.4280 0.9963 6.2656 6.6818 – 0.9995 0.1637 0.1724<br />
histogram (IMAPP) 101.0629 0.9459 8.5463 20.1003 15.3316 0.8816 5.7455 12.8977 – 0.9773 4.8320 11.1566<br />
IFOV 100.5751 0.9692 5.8563 13.7338 5.4195 0.8991 4.6190 5.7684 – 0.9388 -0.1046 0.5466<br />
Frequency filtering 1784 0.9868 9.8866 21.5316 25.5615 0.9884 7.3092 14.8566 – – – –<br />
Wavelet thresholding 6194 0.9039 9.9038 38.4647 54.1577 0.8956 6.34871 18.7944 – 0.8765 4.9008 17.1591<br />
Proposed 2602 0.9881 9.7695 42.3641 15.6980 0.9897 11.8861 22.4904 – 0.9877 8.3956 21.3488<br />
Table 4.2 – Noise Reduction (NR), Image distortion (ID), radiometric Improvement Factors IF 1 and<br />
IF 2 for the Aqua MODIS band 27, 30 and 36<br />
– Aqua MODIS band 27 Aqua MODIS band 30 Aqua MODIS band 36<br />
in<strong>de</strong>x NR ID IF 1 IF 2 NR ID IF 1 IF 2 NR ID IF 1 IF 2<br />
moment matching 12.643 0.984 10.4393 12.0686 4.2363 0.9991 6.4180 12.6573 1.90 0.9997 3.1844 2.3252<br />
histogram (IMAPP) 33.8517 0.9828 11.5966 18.1798 4.4847 0.9839 5.5991 12.6135 1.9593 0.9957 3.2537 2.4242<br />
IFOV 1 12.1310 0.9890 9.3335 11.9212 1.8756 0.9646 -3.6762 8.9016 1.1396 0.8627 -1.8263 2.3097<br />
frequency filtering 510.5828 0.9854 10.3039 24.8529 7.8478 0.9874 6.35 17.8977 3.2048 0.9868 0.7912 10.6393<br />
wavelet thresholding 1284 0.9176 9.7060 25.6599 14.8403 0.9198 6.2033 18.1075 5.6922 0.8790 -0.1253 11.6181<br />
Proposed 282.1545 0.9788 12.0818 36.1859 3.8588 0.9985 10.3925 14.4371 2.3648 0.9868 10.4755 15.8115<br />
107
108 4. A Variational approach for the <strong>de</strong>striping issue<br />
Figure 4.17 – Destriping results with the UVDM on the MODIS data set (TL) Terra<br />
band 27 (TR) UVMD on Terra band 27 (CL) Terra band 30 (CR) UVMD on Terra<br />
band 30 (BL) Terra band 33 (BR) UVMD on Terra band 33
Figure 4.18 – Destriping results with the UVDM on the MODIS data set (TL) Aqua<br />
band 27 (TR) UVMD on Aqua band 27 (CL) Aqua band 30 (CR) UVMD on Aqua<br />
band 30 (BL) Aqua band 36 (BR) UVMD on Aqua band 36<br />
109
110 4. A Variational approach for the <strong>de</strong>striping issue
111<br />
Chapitre 5<br />
Application : Restoration of Aqua<br />
MODIS Band 6<br />
5.1 Context<br />
In light of the <strong>de</strong>striping results reported in the chapter 3, it is clear that the quality<br />
of Aqua MODIS data is higher than that collected by Terra MODIS and have been given<br />
preference for many remote sensing applications including ocean colour product generation.<br />
This is mainly due to a better pre-launch calibration and limited non linear effects of<br />
the individual <strong>de</strong>tectors response. Nevertheless, a major issue have been reported on one<br />
of Aqua MODIS bands. 15 of the 20 <strong>de</strong>tectors of Aqua MODIS band 6 (data available at<br />
a resolution of 500 m) are either non functional or noisy. Non functional <strong>de</strong>tectors do not<br />
measure any information and the resulting missing lines, in addition to functional <strong>de</strong>tectors<br />
mis-calibrations, induces a sharp striping pattern accross the entire swath (figure 5.1).<br />
Due to the placement of band 6 (1.6281.652 µm) in the electromagnetic spectrum, many<br />
important applications are affected by this <strong>de</strong>gradation. Two aerosol products, M and<br />
A-aerosols and the corresponding aerosol optical <strong>de</strong>pth are <strong>de</strong>rived over the ocean by the<br />
CERES Science Team using band 6 and band 1 [Tanre et al., 1997], [Ignatov et al., 2005].<br />
Forest biomass estimation and canopy water stress also relie on SWIR range measurements<br />
[Fensholt and Sandholt, 2003]. The relationship between biomass and MODIS band 6 reflectance<br />
was characterized in [Baccini et al., 2004]. More importantly, in the context of<br />
climate change, the missing and noisy scans of Aqua MODIS band 6 is a serious problem<br />
for MODIS snow products. Snow cover information have gained attention of many scientific<br />
studies due to its impact on climate change. The spatial distribution and temporal<br />
evolution of snow provi<strong>de</strong>s a valuable information on the amount of snowmelt, used as<br />
input for water management applications and hydrological cycle studies. In addition, the<br />
Earth’s albedo, amount of solar energy reflected back into the atmosphere, is partially regulated<br />
the snow cover. Depending on their fractional cover, snow and ice high reflectivity<br />
acts as a shield against sun radiation thus reducing the Earth surface temperature. Most
112 5. Application : Restoration of Aqua MODIS Band 6<br />
Figure 5.1 – (Left) Image from Aqua MODIS band 6 showing 4 non functional <strong>de</strong>tectors<br />
(Right) Image from Aqua band 6 after removal of missing lines : functional <strong>de</strong>tectors are<br />
contaminated with stripe noise<br />
approaches related to the analysis of snow cover use the Normalized Difference Snow In<strong>de</strong>x<br />
(NDSI). This in<strong>de</strong>x exploits snow high reflectivity in the visible (0.5-0.7 µm) and its low<br />
reflectance in the SWIR (1-4 µm). Defined as a spectral band ratio, the NDSI allows a<br />
robust separation of snow from clouds and also reduces the influence of atmospheric effects<br />
and viewing geometry [Salomonson and Appel]. On MODIS, the NDSI can be expressed<br />
as the difference of reflectances ρ measured in the visible band 4 (0.555 µm) and a SWIR<br />
band such as band 6 divi<strong>de</strong>d by the sum of the two reflectances :<br />
NDSI 16 = ρ 4 − ρ 6<br />
ρ 4 + ρ 6<br />
(5.1)<br />
The evaluation of the NDSI in<strong>de</strong>x on the Aqua sensor is problematic due to the non<br />
functional <strong>de</strong>tectors. Nevertheless, to ensure complementary observations to Terra MODIS<br />
band 6 and provi<strong>de</strong> continuous monitoring and mapping of snow coverage, scientists have<br />
relied on Aqua MODIS band 7 (2.105-2.155 µm). This is a reasonnable alternative, given<br />
that snow has similar reflectance properties over bands 6 and 7, which happen to display a<br />
high correlation over land surfaces. As a result, Aqua-based snow coverage is <strong>de</strong>termined<br />
using a secondary NDSI <strong>de</strong>fined as :<br />
NDSI 17 = ρ 4 − ρ 7<br />
ρ 4 + ρ 7<br />
(5.2)<br />
It was however pointed out in [Hall et al.], that the reflectance of snow is slightly weaker<br />
in band 7 compared to band 6. Consequently, values of NDSI 17 are higher than NDSI 16<br />
and the estimation of snow coverage is compromised. Given the importance of retrieving
113<br />
Figure 5.2 – Location of the Terra MODIS scenes selected over snow-covered regions<br />
for the study of Aqua MODIS band 6 restoration (Left) Alaska, May 5, 2001 (Center)<br />
Labrador, Canada, November 7, 200 (Right) Siberia, Russia, May 24, 2001<br />
accurate quantitative variables associated with snow and ice components, and used in<br />
climate change numerical mo<strong>de</strong>ls, an alternative option to NDSI 17 is mandatory. To this<br />
purpose, restoration techniques for Aqua MODIS band 6 have been recently proposed.<br />
5.2 Existing restoration techniques<br />
5.2.1 Global interpolation<br />
[L. L. Wang and Nianzeng] were the first to investigate the relationship between bands<br />
6 and 7 and <strong>de</strong>monstrated the feasability of restoring Aqua MODIS band 6 missing data.<br />
The authors first remarqued that the difference of snow reflectance between Terra MODIS<br />
bands 6 and 7 is very close to the same difference on Aqua MODIS. Using observations<br />
consisting of Terra MODIS level 1B calibrated and geolocated radiances at TOA, polynomial<br />
regression was used to quantify the analytical relationship between Terra MODIS<br />
bands 6 and 7. Quantitative analysis conducted by the authors over snow covered areas,<br />
shows that TOA reflectances in Terra MODIS band 6/7, and NDSI 16 /NDSI 17 were highly<br />
correlated with correlation coefficients of 0.9821 and 0.9777 respectively. Linear, quadratic,<br />
cubic, and fourth-<strong>de</strong>gree polynomials were <strong>de</strong>rived from Terra bands 6/7 scatter plots in<br />
or<strong>de</strong>r to be applied to Aqua MODIS. Wang et al. suggest restoring Aqua MODIS band 6<br />
using cubic and quadratic polynomes of the corresponding band 7 reflectances :<br />
ρ 6 =1.6032ρ 3 7 − 1.9458ρ 2 7 +1.7948ρ 7 +0.012396<br />
ρ 6 = −0.70472ρ 2 7 +1.5369ρ 7 +0.025409<br />
(5.3)<br />
These analytical relationships between bands 6 and 7 were <strong>de</strong>rived fom Terra measurements<br />
over snow covered regions. It obviously do not account for land surface cover types,<br />
spectral characteristics, scanning geometry. Application of this approach to restore band 6
114 5. Application : Restoration of Aqua MODIS Band 6<br />
missing data over vegetation, clouds, <strong>de</strong>sert or oceanic surfaces require further refinement<br />
to distinguish surface cover types. In addition, it is assumed that the polynomial relation<br />
established on Terra data is transposable to Aqua. This assumption is all the more sensitive<br />
to unknown calibration differences between Terra and Aqua MODIS, and the striping<br />
noise <strong>de</strong>scribed in the previous chapters. Furthermore, the analytical relation is <strong>de</strong>rived<br />
without prior pre-processing of bands 7 and 6 for stripe noise removal.<br />
5.2.2 Local interpolation<br />
More recently, Rakwatin2009 proposed a restoration procedure for Aqua MODIS band<br />
6 that consists in three step :1) the <strong>de</strong>termination of non functioning <strong>de</strong>tectors ; 2) the<br />
correction of periodic stripes for functioning <strong>de</strong>tectors using histogram matching ; 3) the<br />
estimation of missing pixels via local cubic polynomial regression between band 6 and band<br />
7. Similarly to the approach proposed in [L. L. Wang and Nianzeng], the high correlation<br />
between band 6 and 7 reflectances is quantified using polynomial regression. However, the<br />
fitting is computed locally to account for land cover types. The restoring algorithm can<br />
be summarized with the following :<br />
1) For a <strong>de</strong>ad pixel x in band 6, a initial rectangular window of size 15 × 3 is centered<br />
at x. The minimum and maximum values of the window in band 7, respectively ρ min<br />
7<br />
and ρ max<br />
7 and their location x min , x max are <strong>de</strong>termined.<br />
2) If ρ min<br />
7 ≤ ρ 7 (x) ≤ ρ max<br />
7 , a local cubic polynomial function is calculated from the<br />
values ρ 7 (x min ), ρ 7 (x max ), ρ 6 (x min ) and ρ 6 (x max ) and used to estimated the values of<br />
ρ 6 (x)<br />
3) If ρ 7 (x) < ρ min<br />
7 , ρ 7 (x) > ρ max<br />
7 or if pixels x min or x max in band 6 are also <strong>de</strong>ad,<br />
the size of the analizing window is increased until these criteria are met.<br />
4) Step 1, 2 and 3 are repeated for every <strong>de</strong>ad pixel of band 6<br />
This local cubic interpolation procedure is illustrateed in figure 5.3.<br />
5.3 Proposed approach<br />
We propose here a simple methodology to estimate the value of Aqua MODIS band 6<br />
missing pixels. The approach is based on a concept wi<strong>de</strong>ly used in the field of hyperspectral<br />
image classification, spectral similarity. Data collected from MODIS can be perceived as a<br />
cube, where the third dimension represents the signal’s wavelenght and can also be used to<br />
extract useful information. In hyperspectral remote sensing, the <strong>de</strong>termination of surface<br />
composition requires the analysis of its reflectance spectrum and comparison with known<br />
field spectra via spectral matching techniques [Kruse et al.]. Although conditionned by the<br />
number of available spectral bands, this reasoning also applies to multispectral imagery.
115<br />
ρ 6 (x max )<br />
MODIS Band 6<br />
ρ 6 (x) <br />
ρ 6 (x min )<br />
ρ 7<br />
min<br />
ρ 7 (x)<br />
MODIS Band 7<br />
ρ 7<br />
max<br />
Figure 5.3 – Restoration procedure for Aqua MODIS band 6 proposed in (Rakwatin et<br />
al., 2009) and based on a local cubic interpolation<br />
For the issue of Aqua MODIS band 6 restoration, missing pixels can be estimated using<br />
spectrally similar pixels from functionning <strong>de</strong>tectors. To this purpose, let us first recall<br />
the <strong>de</strong>finition of few spectral similarity measures commonly used in hyperspectral image<br />
classification.<br />
5.3.1 Spectral similarity<br />
We <strong>de</strong>note by ρ(x) the reflectance of a given pixel x, which we consi<strong>de</strong>r as a vector in<br />
a n-dimensional space as :<br />
ρ(x) =(ρ 1 (x),ρ 2 (x), ..., ρ n (x)) T (5.4)<br />
Each component of the vector ρ(x) in (5.4) corresponds to the reflectance of pixel x in a<br />
given spectral band.<br />
5.3.1.1 Spectral Correlation Measure<br />
The Spectral Correlation Measure (SCM) was <strong>de</strong>fined in [<strong>de</strong>r Meero and Bakker] and<br />
is computed for two pixels x and y as :<br />
n ∑ n<br />
1<br />
SCM(x, y) =<br />
ρ(x)ρ(y) − ∑ n<br />
1 ρ(x) ∑ n<br />
√<br />
1<br />
∑ ρ(y)<br />
[n n<br />
1 ρ(x)2 − ( ∑ n<br />
1 ρ(x))2 ][n ∑ n<br />
1 ρ(y)2 − ( ∑ n<br />
(5.5)<br />
1 ρ(y))2 ]<br />
where n is the number of overlapping spectral bands. The SCM measures the correlation<br />
between the two vectors ρ(x) and ρ(y) and takes into account the mean value and variance<br />
of the overall spectral shape. The values of SCM are contained in the interval [-1,1].
116 5. Application : Restoration of Aqua MODIS Band 6<br />
5.3.1.2 Spectral Angle Measure<br />
The Spectral Angle Measure (SAM) is <strong>de</strong>fined in [Kruse et al.] as the following angle :<br />
( ∑n<br />
1<br />
SAM(x, y) = arcos<br />
ρ(x) ∑ )<br />
n<br />
1<br />
√∑ ρ(y)<br />
n<br />
1 ρ2 (x) ∑ n<br />
(5.6)<br />
1 ρ2 (y)<br />
The SAM is not very sensitive to pixel reflectance values and as such tends to reduce<br />
differences due to atmospheric effects or viewing geometry.<br />
5.3.1.3 Euclidian Distance Measure<br />
The Euclidian Distance Measure (EDM) between pixels x and y is computed as :<br />
∑<br />
EDM(x, y) = √ n (ρ(x) − ρ(y)) 2 (5.7)<br />
Unlike the SCM and SAM, the EDM <strong>de</strong>pends on the reflectance differences between pixels<br />
x and y.<br />
5.3.1.4 Spectral Information Divergence Measure<br />
The Spectral Information Divergence Measure (SIDM) is a stochastic in<strong>de</strong>x that measures<br />
the distance between the probability distribution of spectrums associated with pixels<br />
x and y :<br />
SIDM(x, y) =D(x||y)+D(y||x) (5.8)<br />
D(x||y) is the relative entropy of y with respect to x computed as :<br />
1<br />
D(x||y) =<br />
n∑<br />
p i (x)D i (ρ i (x)||ρ i (y)) =<br />
i=1<br />
n∑<br />
p i (x)(I(ρ i (x)) − I(ρ i (y))) (5.9)<br />
i=1<br />
where<br />
p i (x) =<br />
ρ i (x)<br />
∑ n<br />
j=1 ρ j(x) and I(ρ i(x)) = −log p i (x) (5.10)<br />
The measure I(ρ i (x)) is the self-information of x in the spectral band i.<br />
5.3.2 Spectral inpainting<br />
It is clear from the limitations discussed in [L. L. Wang and Nianzeng] that a reliable<br />
restoration of Aqua MODIS band 6 requires accurate distinction of land cover types which<br />
can not be achieved using only the correlation between band 6 and 7. To compute robust<br />
estimate of missing pixels values from band 6, we suggest to rely solely on spectral information<br />
available in other bands where all the <strong>de</strong>tectors are knnown to be functional. Dead
117<br />
pixels can then be restored with a spectral-based non local approach.<br />
Non local or neighborhood filters have been first introduced in the context of image processing<br />
for <strong>de</strong>noising applications [Yaroslavsky and E<strong>de</strong>n, 1996]. In the general case, we<br />
consi<strong>de</strong>r a noisy image f <strong>de</strong>fined in a boun<strong>de</strong>d domain Ω of R 2 . The <strong>de</strong>noised value of a<br />
pixel x is obtained as an average of pixels that have a value close to f(x). Such radiometric<br />
neighborhood is used in the Yarolavsky non local filter and the <strong>de</strong>noised value of a pixel x<br />
is given by :<br />
Y NF h,r (f(x)) = 1 ∫<br />
f(y)e − |f(y)−f(x)|2<br />
h<br />
C(x)<br />
2 (5.11)<br />
B r(x)<br />
where B r (x) is a ball of radius r centered at pixel x, C(x) is a normalization factor<br />
and h is a filtering parameter that controls the <strong>de</strong>cay of the weighting coefficients. More<br />
recently, the high redunduncy observed in natural images was used for texture synthesis<br />
in [Efros and Leung, 1999]. Efros and Leung algorithm exploits non local self similarities<br />
and is particularly suited for inpainting applications. This very principle is used in the<br />
Non Local Means <strong>de</strong>noising algorithm introduced in [Bua<strong>de</strong>s et al., 2005]. With analogy<br />
to the Yaroslavsky filter, the <strong>de</strong>noised value of a pixel x is obtained as a weighted average<br />
of pixels with a similar local configuration as :<br />
NL(f(x)) = 1<br />
C(x)<br />
∫<br />
Ω<br />
f(y)w(x, y)dy (5.12)<br />
where w(x, y) is a weighting between pixels x and y obtained by comparing intensity<br />
patches of windows centered at x and y as :<br />
( ∫<br />
G a (z)|f(x + z) − f(y + z)| 2 )<br />
w(x, y) =exp −<br />
dz<br />
(5.13)<br />
Ω<br />
where G a is a gaussian function with standard <strong>de</strong>viation a.<br />
The concept of neighborhood used in nonlocal filters for image processing applications is<br />
a valuable tool for the restoration of Aqua MODIS band 6. In<strong>de</strong>ed, the value of a <strong>de</strong>ad<br />
pixel can be <strong>de</strong>termined from the set of pixels with similar spectral properties. For a given<br />
Spectral Similarity Measure (SSM), we <strong>de</strong>fine the spectral neighborhood of a pixel x as :<br />
h 2<br />
S(x) ={y ∈ Ω|SSM(x, y)
118 5. Application : Restoration of Aqua MODIS Band 6<br />
Reflectance<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
Land<br />
Ice over land<br />
Sea ice<br />
Coastal waters<br />
Deep ocean<br />
Cloud<br />
Reflectance<br />
0.7<br />
0.6<br />
0.5<br />
0.4<br />
0.3<br />
0.2<br />
Ice 1<br />
Ice 2<br />
Ice 3<br />
Ice 4<br />
Ice 5<br />
0.1<br />
0.1<br />
0<br />
3 4 5 6 7<br />
MODIS Spectral band<br />
0<br />
3 4 5 6 7<br />
MODIS Spectral band<br />
Figure 5.4 – Illustration of spectral similarity (Left) Reflectance spectrum of pixels<br />
selected over areas of different geophysical nature (Right) Reflectance spectrum of pixels<br />
all selected over a homogeneous snow-covered area<br />
band 6. For example, the EDM of two pixels x and y is given by :<br />
∑<br />
EDM(x, y) = √<br />
7 (ρ i (x) − ρ i (y)) 2 (5.16)<br />
i=3,i≠6<br />
Additionally, for a missing pixel x from band 6, we <strong>de</strong>fine its spectral neighborhood as :<br />
S(x) ={y ∈ Ω|SSM(x, y)
119<br />
Figure 5.5 – Restoration of Terra Modis Band 6 with synthetic non functional <strong>de</strong>tectors.<br />
From left to right : Original image (Alaska), restored with local interpolation, restored with<br />
gobal interpolation and restored with spectral inpainting. Striping is a clear indication of<br />
poor estimation of missing pixels value<br />
Figure 5.6 – From left to right : Original image (Labrador), restored with local interpolation,<br />
restored with gobal interpolation and restored with spectral inpainting.<br />
Figure 5.7 – From left to right : Original image (Siberia), restored with local interpolation,<br />
restored with gobal interpolation and restored with spectral inpainting.<br />
5.4 Experimental results<br />
5.4.1 Validation of spectral inpainting using NDSI measurements<br />
Three Terra MODIS images have been selected to evaluate the restoration of Aqua<br />
MODIS band 6 obtained with [L. L. Wang and Nianzeng], [Rakwatin et al.] and the pro-
120 5. Application : Restoration of Aqua MODIS Band 6<br />
1<br />
1<br />
0.8<br />
0.8<br />
Simulated NDSI<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
−0.2<br />
Simulated NDSI<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
−0.2<br />
−0.4<br />
−0.4<br />
−0.6<br />
−0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1<br />
Measured NDSI<br />
−0.6<br />
−0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1<br />
Measured NDSI<br />
Simulated NDSI<br />
1<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0<br />
−0.2<br />
−0.4<br />
−0.6<br />
−0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1<br />
Measured NDSI<br />
Figure 5.8 – Scatter plots of simulated and measured NDSI from Terra MODIS band 6<br />
(Labrador) (Left) Local interpolation (Right) Global interpolation (Bottom) Spectral<br />
inpainting<br />
posed approache refered to hereafter as spectral inpainting. The locations of these scenes<br />
coinci<strong>de</strong> with those used in the work of [Salomonson and Appel] where MODIS data were<br />
used to estimate fractional snow cover. We recall that <strong>de</strong>tectors of Terra MODIS band<br />
6 are all functional and therefore, restoring algorithms <strong>de</strong>scribed above are applied on<br />
images where measurements from 4 <strong>de</strong>tectors have been set to zero to simulate non functional<br />
<strong>de</strong>tectors. The true and estimated images for Terra band 6 are then combined with<br />
band 4 data in or<strong>de</strong>r to compute the NDSI in<strong>de</strong>x. The resulting measured and simulated<br />
NDSI in<strong>de</strong>xes are then compared in terms of absolute mean difference, root mean square<br />
error and correlation coefficients to evaluate the efficiency of each approach. Results are<br />
reported in table .<br />
Let us mention few notes on the computational aspect of the spectral inpainting method.<br />
In practice, for a missing pixel x from band 6, a window of limited size (instead of the<br />
entire image domain Ω) is used to <strong>de</strong>termine the spectral similarity between its pixels and<br />
pixel x. Since the proposed approach does not relie on spatial information, standard periodic<br />
or symmetric extensions of boundaries cannot be used. Instead, the search window can
e square or rectangular <strong>de</strong>pending on the position of the pixel with respect to the image<br />
bor<strong>de</strong>rs. Alternatively, the image can be fragmented into blocks of K × K pixels and the<br />
algorithm is applied separately for each block with a search window composed of the entire<br />
domain of the subimage. The choice of K then <strong>de</strong>pends on the available computational<br />
power. Results illustrated in this study were obtained with K = 200.<br />
Another pratical aspect of the spectral inpainting method lies in the selection of the parameter<br />
N in equation (5.20). The choice N = 1 holds a physical meaning and ensures<br />
radiometric coherence as it corresponds to the case where a missing pixel from band 6 is<br />
given the same value as the most spectrally similar available pixel in the same band. Furthermore,<br />
all spectral bands (3, 4, 5, 6 and 7) have been <strong>de</strong>striped prior to the restoration<br />
procedure and, therefore all measurements used in the spectral inpainting can be assumed<br />
to be noise free.<br />
The spectral similarity measures <strong>de</strong>fined in the previous section have all been tested except<br />
the Spectral Correlation Measures which requires overlapping spectral bands.<br />
The two existing techniques for the restoration of Aqua MODIS band 6 are entirely based<br />
on the correlation of measurements between bands 6 and 7. The global polynomial regression<br />
proposed in [L. L. Wang and Nianzeng] only applies to snow covered regions and do<br />
not make any distinction in land cover types. Estimation of band 6 missing lines via equations<br />
(5.3) results in strong striping in the restored image even over snow covered areas.<br />
Improved results are obtained when the global polynomial relationship between band 6<br />
and 7 is estimated using data from the current swath.<br />
Another limitation of the global interpolation method proposed by Wang et al., is attached<br />
to the assumption that the relationship between bands 6 and 7 of Terra MODIS can be<br />
directly transposed to Aqua MODIS. In pratice, this assumption do not hold because of<br />
calibration differences between Terra and Aqua MODIS instruments.<br />
The local interpolation procedure <strong>de</strong>scribed in [Rakwatin et al.] is a refinement of the<br />
global interpolation. To account for land cover types, the estimation of missing pixels is<br />
<strong>de</strong>rived from a polynomial regression between bands 6 and 7, restricted to a local windows.<br />
Results achieved with this technique are often disapointing, as confirmed by the<br />
strong striping visible in the restored band 6. This can be attributed to the incoherent<br />
mixing of spatial and spectral information. In<strong>de</strong>ed, the value of a <strong>de</strong>ad pixel from band<br />
6 is <strong>de</strong>termined from minimum and maximum values of band 7 in a local window, which<br />
actually correspond to spectrally distant pixels. With such a procedure, the spatial locality<br />
does not garantee any distinction in land cover types. On the contrary, the approach<br />
of [Rakwatin et al.] amounts to a spatio-spectral interpolation where pixels used for the<br />
restoration are spectrally distant and spatially close.<br />
The spectral inpainting method <strong>de</strong>scribed above enables a robust estimation of missing<br />
lines as it is only based on spectral information. As illustrated in figures 5.5, 5.6 and 5.7<br />
restoration with spectral inpainting provi<strong>de</strong>s images visually i<strong>de</strong>ntical to the original band<br />
6, and unlike global and local interpolation does not display any stripes. Scatter plots (figure<br />
) and quantitative analysis reported in table indicate reliable results obtained<br />
with the spectral inpainting for all three images of Alaska, Labrador and Siberia.<br />
121
122 5. Application : Restoration of Aqua MODIS Band 6<br />
5.4.2 Assessing the impact of stripe noise<br />
The UVDM <strong>de</strong>scribed in the previous chapter was applied to all bands used by the<br />
spectral inpainting technique. Nevertheless, the striping on Terra MODIS bands 3 to 7<br />
is extremely weak and its impact on the retrieval of NDSI in<strong>de</strong>x is not substantial. We<br />
propose here to quantitatively evaluate the necessity of a robust <strong>de</strong>striping methodology<br />
prior to the generation of high level products. To this purpose, the UVDM was used to<br />
extract a stripe noise from Terra MODIS emissive band 27. This band was specifically<br />
chosen beacause its <strong>de</strong>tectors suffer from strong nonlinear effects that standard <strong>de</strong>striping<br />
techniques fail to correct. The stripe noise from band 27 is then injected in bands 5, 6 and<br />
7 with different intensity levels so that the Peak Signal-to-Noise ratio (PSNR) of images<br />
from each of these bands is equal to 5, 10, 15, 20, 25, 30 and 35 dB. The spectral inpainting<br />
method is then applied to restore band 6 missing lines with and without preliminary<br />
<strong>de</strong>striping. The spectral similarity measure used for this experiment is the EDM as it has<br />
shown to provi<strong>de</strong> better results compared to SAM and SDI. In addition to the UVDM,<br />
histogram matching is also used to illustrate the impact of residual stripes on the retrieval<br />
of NDSI in<strong>de</strong>xes.<br />
Simulated and measured NDSI values have been compared for each level of striping using<br />
three scenarios :<br />
- Images from bands 5, 6 and 7 are not <strong>de</strong>striped prior to spectral inpainting<br />
- Images from bands 5, 6 and 7 are <strong>de</strong>striped with the histogram matching prior to spectral<br />
inpainting<br />
- Images from bands 5, 6 and 7 are <strong>de</strong>striped using the UVDM prior to spectral inpainting<br />
Absolute mean difference (AMD), Root Mean Square Errors (RMSE) and Correlation<br />
(CORR) coefficients for the three scenarios are reported in table . Many interesting<br />
observations can be ma<strong>de</strong> from these results (also plotted in figure 5.10) to un<strong>de</strong>rscore the<br />
benefits of a reliable <strong>de</strong>striping algorithm.<br />
It can be seen that for a reasonable amount of stripe noise (PSNR≥35 dB), the histogram<br />
matching techniques does not provi<strong>de</strong> any improvement in the estimation of the NDSI<br />
in<strong>de</strong>x. In case of very strong striping (PSNR=5dB), the application of the UVDM before<br />
the restoration of band 6 results in NDSI values as accurate as those obtained with the<br />
histogram matching when the stripe noise corresponds to a PSNR=25dB. In addition, the<br />
correlation coefficient obtained with the UVDM, remains above 0.99 for all tested levels of<br />
striping. The extreme case of PSNR=5dB, illustrated in figure 5.9 shows how the UVDM<br />
enables the preservation of the structures contained in the original image.
Figure 5.9 – (TL) Original image from Terra MODIS band 6 (TR) Extreme striping on<br />
band 6 (PSNR=5dB) prior to synthetic non functional <strong>de</strong>tectors. Bands 5 and 7 are contaminated<br />
with a similar striping (BL) Restoration with spectral inpainting after <strong>de</strong>striping<br />
with histogram matching (BR) Restoration with spectral inpainting after <strong>de</strong>striping with<br />
UVDM<br />
123
– Alaska Labrador Siberia<br />
Restoration AMD RMSE CORR AMD RMSE CORR AMD RMSE CORR<br />
Wang et al. 0.0087 9.0000 0.9944 0.0031 12.8145 0.9901 4.3822e-004 5.3724 0.9987<br />
Rakwatin et al. 0.0120 12.4084 0.9893 0.0188 16.2538 0.9859 0.0230 11.9939 0.9950<br />
Proposed SAM 5.5582e-004 6.4964 0.9969 1.7451e-004 6.9496 0.9971 0.0011 7.4547 0.9974<br />
SDIM 6.5480e-004 6.5729 0.9968 3.3377e-004 6.5852 0.9974 0.0016 5.4037 0.9986<br />
EDM 1.7882e-004 3.0273 0.9993 6.5103e-005 4.3314 0.9989 0.0021 2.3593 0.9998<br />
Table 5.1 – Absolute mean difference (AMD), Root Mean Square Error (RMSE) and Correlation<br />
(CORR) between simulated and measured NDSI values using different restoration techniques for<br />
Aqua MODIS band 6<br />
– Without <strong>de</strong>striping Histogram matching UVDM<br />
Stripe noise level AMD RMSE CORR AMD RMSE CORR AMD RMSE CORR<br />
PSNR=5dB 1.1632 7.2247e+004 0.0054 0.0136 36.5744 0.9407 0.0014 10.9336 0.9944<br />
PSNR=10dB 0.3251 4.5093e+003 0.0081 0.0078 24.8579 0.9731 0.0020 7.4031 0.9975<br />
PSNR=15dB 0.0572 81.8125 0.7653 0.0055 17.4133 0.9878 0.0017 5.7920 0.9985<br />
PSNR=20dB 0.0157 39.0451 0.9335 0.0046 12.3446 0.9950 0.0012 4.9865 0.9989<br />
PSNR=25dB 0.0057 22.0486 0.9777 0.0042 9.7847 0.9976 8.1850e-004 3.5721 0.9994<br />
PSNR=30dB 0.0030 13.5149 0.9915 0.0039 8.4876 0.9986 5.0663e-004 3.1400 0.9995<br />
PSNR=35dB 0.0021 7.6345 0.9973 0.0036 7.6683 0.9991 3.8126e-004 2.4931 0.9997<br />
Table 5.2 – Absolute mean difference (AMD), Root Mean Square Error (RMSE) and Correlation<br />
(CORR) between simulated and measured NDSI values using spectral inpainting with EDM and different<br />
levels of stripe noise in bands 5, 6 and 7 prior to restoration<br />
124 5. Application : Restoration of Aqua MODIS Band 6
125<br />
40<br />
1<br />
40<br />
1<br />
35<br />
30<br />
0.99<br />
35<br />
30<br />
0.99<br />
RMSE<br />
25<br />
20<br />
15<br />
RMSE<br />
CORR<br />
0.98<br />
0.97<br />
CORR<br />
RMSE<br />
25<br />
20<br />
15<br />
RMSE<br />
CORR<br />
0.98<br />
0.97<br />
CORR<br />
10<br />
5<br />
0.96<br />
10<br />
5<br />
0.96<br />
0<br />
0.95<br />
5 10 15 20 25 30 35<br />
Level of stripe noise (dB)<br />
0<br />
0.95<br />
5 10 15 20 25 30 35<br />
Level of stripe noise (dB)<br />
Figure 5.10 – RMSE and CORR values between simulated and measured NDSI values<br />
obtained for the Alaska image when different levels of stripe noise are injected in bands<br />
5, 6 and 7. Band 6 is restored using the spectral inpainting method with the EDM. Both<br />
histogram matching (Left) and the UVDM (Right) are used to remove stripe noise prior<br />
to the restoration. In presence of extreme striping (PSNR=5dB) the UVDM allows an<br />
estimation of the NDSI in<strong>de</strong>x as accurate as the one provi<strong>de</strong>d by the histogram matching<br />
technique for a stripe noise level corresponding to a PSNR=25dB
126 5. Application : Restoration of Aqua MODIS Band 6
127<br />
Conclusion<br />
Contribution<br />
Perspectives and furtur work
128 Conclusion
129<br />
Bibliographie<br />
R. Acar and C. R. Vogel. Analysis of boun<strong>de</strong>d variation penalty methods for ill-posed<br />
problems. In Inverse Problems, pages 1217–1229, 1994.<br />
J. Aiken, G. Moore, C. Trees, S. Hooker, and D. Clark. The seawifs czcs-type pigment<br />
algorithm. In SeaWiFS technical report series, page 29, 1995.<br />
L. Alvarez, P. L. Lions, and J. M. Morel. Image selective smoothing and edge <strong>de</strong>tection<br />
by nonlinear diffusion. ii. SIAM J. Numer. Anal., 29 :845–866, 1992.<br />
P. Antonelli, M. di Bisceglie, R. Episcopo, and C. Galdi. Destriping MODIS data using<br />
IFOV overlapping. 7(3) :4568–4571, 2004.<br />
J. F. Aujol, G. Aubert, L. Blanc-Féraud, and A. Chambolle. Image <strong>de</strong>composition into<br />
a boun<strong>de</strong>d variation component and an oscillating component. J. Math. Imaging Vis.,<br />
22 :71–88, 2005.<br />
A. Baccini, M. A. Friedl, C. E. Woodcock, R. Warbington, and L. Remer. Forest biomass<br />
estimation over regional scales using multisource data. J. Geophys. Res. Lett., 31(10) :<br />
L10501.1–L10501.4, 2004.<br />
P. Blomgren, T. F. Chan, P. Mulet, and C. Wong. Total variation image restoration :<br />
Numerical methods and extensions. In in Proc. IEEE ICIP, pages 384–387, 1997.<br />
Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph<br />
cuts. IEEE Trans. Pattern Anal. Mach. Intell., 23 :1222–1239, 2001.<br />
R. Bracewell. The fourier transform and its applications. In Mcgraw, 1986.<br />
A. Bua<strong>de</strong>s, B. Coll, and J. M. Morel. A review of image <strong>de</strong>noising algorithms, with a new<br />
one. Simul, 4 :490–530, 2005.<br />
F. Catté, P. L. Lions, J. M. Morel, and T. Coll. Image selective smoothing and edge<br />
<strong>de</strong>tection by nonlinear diffusion. SIAM J. Numer. Anal., 29 :182–193, 1992.
130 BIBLIOGRAPHIE<br />
A. Chambolle. An algorithm for total variation minimization and applications. J. Math.<br />
Imaging Vis., 20 :89–97, 2004.<br />
A. Chambolle and P. L. Lions. Image recovery via total variation minimization and related<br />
problems. Numer. Math., 76(2) :167–188, 1997.<br />
T. F. Chan, A. M. Yip, and F. E. Park. Simultaneous total variation image inpainting<br />
and blind <strong>de</strong>convolution. International Journal of Imaging Systems and Technology, 15<br />
(1), 2005.<br />
J. S. Chen, Y. Shao, H. D. Guo, W. Wang, and B. Zhu. Destriping CMODIS data by<br />
power filtering. 41(9) :2119–2124, 2003.<br />
E. N. Coleman, Jr., and R. Jain. Obtaining 3-dimensional shape of textured and specular<br />
surfaces using four-source photometry. Computer Graphics and Image Processing, 18<br />
(4) :309–328, 1982.<br />
C. Cox and W.Munk. Measurement of the roughness of the sea surface from photographs<br />
of the suns glitter. J. Opt. Soc. Am, 44(11) :838–850, 1954.<br />
R. E. Crippen. A simple spatial filtering routine for the cosmetic removal of scan line<br />
noise from Lansat TM P-tape imagery. Photogramm. Eng. Remote Sens., 55(3) :327–<br />
331, 1989.<br />
I. Daubechies and G. Teschke. Variational image restoration by means of wavelets :<br />
simultaneous <strong>de</strong>composition, <strong>de</strong>blurring and <strong>de</strong>noising. Appl. Comp. Harm. Anal., 19 :<br />
1–16, 2005.<br />
S. D.Babacan, R. Molina, and A. K. Katsaggelos. Total variation super resolution using<br />
a variational approach. In IEEE International Conf. on Image Processing 2008, San<br />
Diego, USA, October 2008.<br />
F. V. <strong>de</strong>r Meero and W. Bakker.<br />
R. Deriche and O. Faugeras. Les edp en traitement <strong>de</strong>s images et vision par ordinateur.<br />
In Technical Report 2697, INRIA, 1995.<br />
M. di Bisceglie, R. Episcopo, C. Galdi, and S. L. Ullo. Destriping MODIS data using<br />
overlapping field-of-view method. 47(2) :637–651, 2009.<br />
D. C. Dobson and C. R. Vogel. Convergence of an iterative method for total variation<br />
<strong>de</strong>noising. SIAM J. Numer. Anal., 34 :1779–1791, 1997.<br />
D. L. Donoho and I. M. Johnstone. I<strong>de</strong>al spatial adaptation by wavelet shrinkage. Biometrika,<br />
81(3) :425–455, 1994.
131<br />
A. Efros and T. Leung. Texture synthesis by non-parametric sampling. In In International<br />
Conference on Computer Vision, pages 1033–1038, 1999.<br />
G. S. Fargion and C. R. McClain. Modis validation, data merger and other activities<br />
accomplished by the simbios project : 20022003. In NASA TM-2003-212249.<br />
R. Fensholt and I. Sandholt. Derivation of a shortwave infrared water stress in<strong>de</strong>x from<br />
modis near- and shortwave infrared data in a semiarid environment. Remote Sensing of<br />
Environment, 87(1) :111–121, 2003.<br />
R. T. Frankot and R. Chellappa. A method for enforcing integrability in shape from<br />
shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence,<br />
10 :439–451, 1988.<br />
H. Fukushima, M. Toratani, H. Murakami, P. Deschamps, R. Frouin, and A. Tanaka.<br />
Evaluation of a<strong>de</strong>os-ii gli ocean color atmospheric correction using simbada handheld<br />
radiometer data. J. Oceanogr., 63(3) :533–543, 2007.<br />
W. W. Gregg. Analysis of orbit selection for seawifs : Ascending versus <strong>de</strong>scending no<strong>de</strong>.<br />
In NASA Tech. Memo. 104556, volume 2, 1992.<br />
W. W. Gregg and R. Woodward. Improvements in coverage frequency of ocean color :<br />
Combining data from seawifs and modis. IEEE Trans. Geosci. Remote Sens., 26(4) :<br />
13501353, 2007.<br />
F. Guichard and F. Malgouyres. Total variation based interpolation. In Proceedings of<br />
Eusipcoapos ;98, pages 1741–1744, 1998.<br />
L. Gumley. Scanner Characteristics Image Artifacts Destriping. In Western Australian<br />
Satellite Technology and Applications Consortium MODIS Workshop, Nov. 2002.<br />
S. L. Haines, G. J. Jedlovec, and S. M. Lazarus. A modis sea surface temperature composite<br />
for regional applications. IEEE Trans. Geosci. Remote Sens., 45(9) :2919–2927, 2007.<br />
D. K. Hall, G. A. Riggs, and V. V. Salomonson.<br />
R. M. Haralick and L. T. Watson. A facet mo<strong>de</strong>l for imag data. Comput. Graph. Image<br />
Process., 15(12) :113–129, 1981.<br />
G. Healey and R. Jain. Depth recovery from surface normals. In ICPR’84, 1984.<br />
J. Hedley, A. Harborne, and P. Mumby. Simple and robust removal of sun glint for mapping<br />
shallow-water benthos. Int. J. Remote Sens., 26(10) :2107–2112, 2005.<br />
J. Ho, J. Lim, M. Yang, and D. Kriegman. Integrating surface normal vectors using fast<br />
marching method. In Lecture Notes in Computer Science, page 239250, 2006.
132 BIBLIOGRAPHIE<br />
E. Hochberg, S. Andrefouet, and M. Tyler. Sea surface correction of high spatial resolution<br />
ikonos images to improve bottom mapping in near-shore environments. IEEE Trans.<br />
Geosci. Remote Sens., 41(7) :1724–1729, 2003.<br />
B. K. P. Horn. Height and gradient from shading. International Journal of Computer<br />
Vision, 5(1) :37–75, 1990.<br />
B. K. P. Horn and M. J. Brooks. The variational approach to shape from shading. Comput.<br />
Vision Graph. Image Process., 33 :174–208, 1986.<br />
B. K. P. Horn and R. J. Woodham. Destriping Landsat MSS images by histogram modification.<br />
Comput. Graph. Image Process., 10(1) :69–83, 1979.<br />
A. Huete. Overview of the radiometric and biophysical performance of the modis vegetation<br />
indices. Remote Sensing of Environment, 83(1-2) :195–213, nov 2002.<br />
A. Ignatov, P. Minnis, N. Loeb, B. Wielicki, W. Miller, S. Sun-Mack, D. Tanré, L. Remer,<br />
I. Laszlo, and E. Geier. Two modis aerosol products over ocean on the terra and aqua<br />
ceres ssf datasets. Journal of the Atmospheric Sciences, 62(4) :1008–1031, 2005.<br />
M. Kazhdan and H. Hoppe. Streaming multigrid for gradient-domain operations on large<br />
images. In Proc. of ACM SIGGRAPH, 2008.<br />
J. J. Koen<strong>de</strong>rink. The structure of images. Biological Cybernetics, 50 :363–370, 1984.<br />
F. Kruse, A. Lefkoff, J. Boardman, K. Hei<strong>de</strong>brecht, A. Shapiro, P. Barloon, and A. Goetz.<br />
T. Kutser, E. Vahtmäe, and J. Praks. Sun glint correction method for hyperspectral<br />
imagery containing areas with non-negligible water leaving nir signal. Remote Sens.<br />
Environ., 113(10) :2267–2274, 2009.<br />
E. J. Kwiatkowska and G. S. Fargion. Merger of ocean color data from multiple satellite<br />
missions within the simbios project. In SPIE Symposium : Remote Sensing of the<br />
Atmosphere, Ocean, Environment, and Space. Ocean Remote Sensing and Applications,<br />
page 168182, 2002.<br />
X. S. H. X. X. Y. L. L. Wang, J. J. Qu and C. Nianzeng.<br />
C. H. Li and P. R. S. Tam. A facet mo<strong>de</strong>l for imag data. Pattern Recogn., 33(2) :281–293,<br />
2000.<br />
B. Luo, J. F. Aujol, Y. Gousseau, S. Ladjal, and H. Maitre. Resolution-in<strong>de</strong>pen<strong>de</strong>nt<br />
characteristic scale <strong>de</strong>dicated to satellite images. IEEE transactions on image processing,<br />
16 :2503–2514, 2007.<br />
D. Lyzenga, N. Malinas, and F. Tanis. Multispectral bathymetry using a simple physically<br />
based algorithm. IEEE Trans. Geosci. Remote Sens., 44(8) :2251–2259, 2006.
133<br />
C. M. E. and W. W. Gregg. Comparison of global chlorophyll climatologies : In situ,<br />
czcs, blen<strong>de</strong>d in situ-czcs and seawifs. International Journal of Remote Sensing, 24(5) :<br />
969–991, 2003.<br />
S. Mallat. Une exploration <strong>de</strong>s signaux en on<strong>de</strong>lettes. 2000.<br />
Y. Meyer. Oscillating patterns in image processing and nonlinear evolution equations. In<br />
University Lecture Series, volume 22, 2002.<br />
F. Montagner, V. Billat, and S. Bélanger. Meris atbd 2.13 sun glint flag algorithm. 2003.<br />
URL http://envisat.esa.int/instruments/meris/atbd/atbd_2_13.pdf.<br />
G. P. Nason and B. W. Silverman. The stationary wavelet transform and some statistical<br />
applications. pages 281–300. Springer-Verlag, 1995.<br />
M. Nikolova. A variational approach to remove outliers and impulse noise. J. Math.<br />
Imaging Vis., 20 :99–120, 2004.<br />
M. Nikolova and R. H. Chan. The equivalence of half-quadratic minimization and the<br />
gradient linearization iteration. IEEE Transactions on Image Processing, 16(6) :1623–<br />
1627, 2007.<br />
M. Nitzberg and T. Shiota. Nonlinear image filtering with edge and corner enhancement.<br />
IEEE Trans. Pattern Anal. Mach. Intell., 14 :826–833, 1992.<br />
K. N. Nordstrom. Biased anisotropic diffusion-a unified regularization and diffusion. Image<br />
and Vision Computing, 4 :318–327, 1990.<br />
S. Osher, A. Sole, and L. Vese. Image <strong>de</strong>composition<br />
and restoration using total variation minimization and the<br />
h − 1norm. Multiscale Mo<strong>de</strong>ling and Simulation : A SIAM Interdisciplinary Journal, 1:<br />
349 −−370, 2002.<br />
S. Osher, M. Burger, D. Goldfarb, J. Xu, and W. Yin. An iterative regularization method<br />
for total variation-based image restoration <strong>de</strong>compositions in. Multiscale Mo<strong>de</strong>l. Simul., 4<br />
(2) :460–489, 2005.<br />
M. Ottaviani, H. A. Ei<strong>de</strong>, K. H. Stamnes, W. Li, W. J. Wiscombe, and W. Su. Improving<br />
the <strong>de</strong>scription of sunglint for accurate prediction of top-of-the-atmosphere radiances. J.<br />
Quant. Spectrosc. Radiat. Transf., 109(14) :2364–2375, 2008.<br />
J. J. Pan and C. I. Chang. Destriping of Landsat MSS images by filtering techniques.<br />
Photogramm. Eng. Remote Sens., 58(10) :1417–1423, 1992.<br />
T. W. Parks and J. H. Mcclellan. Chebyshev approximation for nonrecursive digital filters<br />
with linear phase. IEEE Transactions on Circuits and Systems, 19(2) :189–194, 1972.
134 BIBLIOGRAPHIE<br />
P. Perona and J. Malik. Scale-space and edge <strong>de</strong>tection using anisotropic diffusion. IEEE<br />
Trans. Pattern Anal. Mach. Intell., 12 :629–639, 1990.<br />
D. J. Poros and C. J. Peterson. Methods for <strong>de</strong>striping landsat thematic mapper images - a<br />
feasibility study for an online <strong>de</strong>striping process in the thematic mapper image processing<br />
system (tips). Photogrammetric Engineering and Remote Sensing., 51 :1371–1378, 1985.<br />
P. Rakwatin, W. Takeuchi, and Y. Yoshifumi.<br />
P. Rakwatin, W. Takeushi, and Y. Yasuoka. Stripe Noise Reduction in Modis data by<br />
combining histogram matching with facet filter. 45(6) :1844–1856, 2007.<br />
R. W. Reynolds and T. M. Smith. Improved global sea surface temperature analyses using<br />
optimum interpolation. Journal of climate, 7(6) :929–948, 1994.<br />
J. W. Rouse, R. H. Haas, J. A. Schell, and D. W. Deering. Monitoring vegetation systems<br />
in the great plains with erts. In Proceedings of the Third ERTS Symposium, volume 1,<br />
pages 309–317, 1973.<br />
L. I. Rudin, S. Osher, and E. Fatemi. Nonlinear total variation based noise removal algorithms.<br />
Phys. D, 60 :259–268, 1992.<br />
V. V. Salomonson and I. Appel.<br />
H. F. Shen, T. H. Ai, and P. X. Li. Destriping and inpainting of remote sensing images using<br />
maximum a-posteriori method. In ISPRS 2008, volume 37, pages 63–70, 2008.<br />
C. Sheng, Y. Xin, Y. Liping, and S. Kun. Total variation-based speckle reduction using<br />
multi-grid algorithm for ultrasound images. In ICIAP, volume 3617, pages 245–252, 2005.<br />
J. J. Simpson, J. I. Gobat, and R. Frouin. Improved <strong>de</strong>striping of GOES images using finite<br />
impulse response filters. Remote. Sens. Environ., 52(1) :15–35, 1995.<br />
J. J. Simpson, J. R. Stitt, and D. M. Leath. Improved finite impulse response filters for<br />
enhanced <strong>de</strong>striping of geostationary satellite data. Remote. Sens. Environ., 66(3) :235–<br />
249, 1998.<br />
D. S. Sloan and R. Orth. A self-contained landsat data reception and precision cartographic<br />
image poduction system. In Int. Symp. of Comm. III of the Int. Soc. for Photogrammetry,<br />
Graz, Austria, Oct. 1977.<br />
R. Srinivasan, M. Cannon, and J. White. Lansat data <strong>de</strong>striping using power filtering. Opt.<br />
Eng., 27(11) :939–943, 1988.<br />
F. Steinmetz, P. Deschamps, and D. Ramon. Atmospheric correction in presence<br />
of sun glint :application to meris. In 2nd MERIS-(A)ATSR workshop, Frascati,<br />
2008. URL http://earth.esa.int/workshops/meris_aatsr2008/participants/75/<br />
pres_75_Steinmetz.pdf.
135<br />
W. M. Strome and S. S. Vishnubhatla. A sytem for improving the radiometric corrections<br />
for erts-1 mss data. In XXIV Int. Astronautical Congress, Baku, USSR, Oct. 1973.<br />
E. Tadmor, S. Nezzar, and L. Vese. A multiscale image representation using hierarchical<br />
(BV , L 2 ) <strong>de</strong>compositions. Multiscale Mo<strong>de</strong>l. Simul., 2(4) :554–579, 2004.<br />
D. Tanre, Y. J. Kaufman, M. Herman, and S. Matoo. Remote sensing of aerosol properties<br />
over oceans using the modis/eos spectral radiances : Passive remote sensing of tropospheric<br />
aerosol and atmospheric corrections from the new generation of satellite sensors. J.<br />
Geophys. Res., 102(D14) :1697116988, 1997.<br />
J. Torres and S. O. Infante. Wavelet analysis for the elimination of striping noise in satellite<br />
images. Opt. Eng., 40(7) :13091314, 2001.<br />
L. Vese and S. Osher. Mo<strong>de</strong>ling textures with total variation minimization and oscillating<br />
patterns in image processing. Journal of Scientific Computing, 19 :553–572, 2002.<br />
M. Wang and S. W. Bailey. Correction of sun glint contamination on the seawifs ocean and<br />
atmosphere products. Appl. Opt., 40(27) :4790–4798, 2001.<br />
M. Wegener. Destriping multiple <strong>de</strong>tector imagery by improved histogram matching. Int J.<br />
Remote Sens., 11(5) :859–875, 1990.<br />
M. P. Weinreb, R. Xie, J. H. Lienesch, and D. S. Crosby. Destriping GOES images by<br />
matching empirical distribution functions. Remote. Sens. Environ., 29(2) :185–195, 1989.<br />
Z. Wu and L. Li. A line-integration based method for <strong>de</strong>pth recovery from surface normals.<br />
Comput. Vision Graph. Image Process., 43 :53–66, 1988.<br />
Z. Xiaoxiang, F. Tianxi, and H. Qian. Destripe multi-sensor imaging spectroradiometer data.<br />
In CGMS XXXII, 2004. CMA-WP 07, 2007.<br />
Z. Yang, J. Li, W. P. Menzel, and R. A. Frey. Destriping for modis data via wavelet shrinkage.<br />
In Applications with Weather Satellites, volume 4895, pages 187–199, 2003.<br />
L. P. Yaroslavsky and M. E<strong>de</strong>n. Texture synthesis by non-parametric sampling. In Fundamentals<br />
of Digital Optics, Birkhauser Boston, 1996.