03.10.2013 Views

Oil spill monitoring from spaceborne and airborne sensors

Oil spill monitoring from spaceborne and airborne sensors

Oil spill monitoring from spaceborne and airborne sensors

SHOW MORE
SHOW LESS

Transform your PDFs into Flipbooks and boost your revenue!

Leverage SEO-optimized Flipbooks, powerful backlinks, and multimedia content to professionally showcase your products and significantly increase your reach.

<strong>Oil</strong> <strong>spill</strong> <strong>monitoring</strong> <strong>from</strong> <strong>spaceborne</strong><br />

<strong>and</strong> <strong>airborne</strong> <strong>sensors</strong><br />

UNIVERSITETET I<br />

OSLO<br />

Anne H. Schistad Solberg <strong>and</strong> Camilla Brekke<br />

Institutt for informatikk, Universitetet i Oslo<br />

Contributions <strong>from</strong> partners in the EU-project Oceanides<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 1


Agenda<br />

• State-of-the art in detection of illegal oil <strong>spill</strong>s<br />

– Airborne <strong>and</strong> <strong>spaceborne</strong> <strong>sensors</strong><br />

– Sensor coverage <strong>and</strong> limitations<br />

– Monitoring costs<br />

– Present <strong>monitoring</strong>: joint aircraft/satellite coverage<br />

• Automatic methods for oil <strong>spill</strong> detection<br />

– SAR imaging of oil <strong>spill</strong>s<br />

– Algorithms for automatic detection<br />

– Performance of automatic vs. manual detection<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 2


Illegal oil <strong>spill</strong>s<br />

Spills <strong>from</strong> ships in open seas e.g. due to tank cleaning<br />

<strong>Oil</strong> <strong>spill</strong>s <strong>from</strong> oil platforms<br />

600 000 tons/year in the Mediterranean<br />

Monitoring used to identify polluters <strong>and</strong> check if clean-up<br />

necessary<br />

Polluter received fine of $3.5M in the US (June 2004)<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 3


UNIVERSITETET I<br />

OSLO<br />

Example<br />

satellite image<br />

Envisat SAR image <strong>from</strong><br />

Baltic Sea 21 July 2003<br />

Arrows show oil <strong>spill</strong>s<br />

Image size ~100x100km<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 4


Spill sources<br />

Bright spots: ship or<br />

platforms<br />

Left: outlets <strong>from</strong><br />

stationary sources<br />

UNIVERSITETET I<br />

OSLO<br />

Right: outlets <strong>from</strong><br />

moving ship<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 5


Temporal development<br />

Ship releasing oil<br />

UNIVERSITETET I<br />

OSLO<br />

Wind, current <strong>and</strong><br />

waves affect the<br />

shape of the oil<br />

Older <strong>spill</strong>s are<br />

irregular in shape<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 6


<strong>Oil</strong> <strong>spill</strong> map of the Baltic Sea (HELCOM)<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 7


Remote sensing of oil <strong>spill</strong>s<br />

UNIVERSITETET I<br />

OSLO<br />

• Aircrafts cover narrow swaths<br />

– Can identify polluter<br />

– Determines if clean-up is necessary<br />

– Can also operate during nighttime<br />

• Satellites cover large swaths<br />

– Early warning of oil <strong>spill</strong>s<br />

– 400x400 km 2 in a single image<br />

– All-weather/all-day capability<br />

– Can not identify the polluter<br />

– Can sometimes confuse oil <strong>and</strong> algae<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 8


Comparison of Radarsat <strong>and</strong> aircraft<br />

SLAR image<br />

RADARSAT image<br />

UNIVERSITETET I<br />

OSLO<br />

SLAR image<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 9


Comparison of Radarsat <strong>and</strong> aircraft<br />

photos<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 10


Aircraft <strong>sensors</strong><br />

Sensor Coverage Capabilities Nighttime operation<br />

SLAR 30 km Location Yes<br />

UV 250 m Spatial extent No<br />

IR 250 m Spatial extent Yes<br />

Microwave<br />

Radiometer<br />

Laser<br />

Fluorosensor<br />

UNIVERSITETET I<br />

OSLO<br />

250 m <strong>Oil</strong> thickness Yes<br />

75 m <strong>Oil</strong> type<br />

<strong>Oil</strong> thickness<br />

Yes<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 11


Satellite <strong>sensors</strong> for oil <strong>spill</strong><br />

• Optical <strong>sensors</strong>:<br />

– Need cloud-free scenes<br />

– Cannot operate at night<br />

– Can be used to discriminate between oil <strong>and</strong> algae if spatial<br />

resolution is high<br />

• Synthetic aperture radar (SAR):<br />

– Can operate all day <strong>and</strong> in clouded areas<br />

– <strong>Oil</strong> <strong>spill</strong>s visible in wind speed <strong>from</strong> 3 m/s to approx. 12-15 m/s<br />

– Covers wide areas<br />

– Temporal coverage: close to daily<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 12


SAR satellite <strong>sensors</strong><br />

Satellite Launched Owner Frequency/<br />

UNIVERSITETET I<br />

OSLO<br />

Polarization<br />

ERS-1 1991-1996 ESA C-b<strong>and</strong>/VV<br />

ERS-2 1995- ESA C-b<strong>and</strong>/VV<br />

RADARSAT-1 1995- CSA<br />

(Canadian)<br />

ENVISAT<br />

(ASAR)<br />

C-b<strong>and</strong>/HH<br />

2002- ESA C-b<strong>and</strong>/VV <strong>and</strong><br />

HH, alt pol. <strong>and</strong><br />

cross pol.<br />

RADARSAT-2 2005 CSA C-b<strong>and</strong>/<br />

pol.<br />

combinations<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 13


ENVISAT Satellite passes pr. month<br />

UNIVERSITETET I<br />

OSLO<br />

• Coverage depends on<br />

latitude<br />

• Almost daily coverage<br />

in Norwegian waters<br />

Images pr. month<br />

1-7<br />

8-11<br />

12-15<br />

16-18<br />

19-24<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 14


Monitoring costs example<br />

• Example <strong>from</strong> the EU-project Oceanides<br />

• Aircraft <strong>monitoring</strong> (Germany):<br />

– I flight hour: 4-5000 Euro<br />

– 12 flight hours to cover a full 400x400km scene<br />

– Cost of covering the entire Baltic sea: 126 000 Euro<br />

• Satellite <strong>monitoring</strong>:<br />

– Cost of 1 Envisat Near-real time scene: 850 Euro<br />

– Envisat images to cover the entire Baltic Sea: 2550 Euro<br />

• International cooperation needed to share costs<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 15


Joint aircraft/satellite <strong>monitoring</strong><br />

UNIVERSITETET I<br />

OSLO<br />

• Satellite acquisitions <strong>and</strong> flight plans<br />

coordinated<br />

• Satellite image downloaded <strong>and</strong> inspected<br />

at KSAT in Tromsø<br />

• KSAT reports suspect slicks to surveillance<br />

aircrafts by fax/email/phone<br />

• Aircraft flies to reported locations to verify<br />

• Aircraft tries to catch the polluter <strong>and</strong><br />

collect evidence<br />

• Service presently used in Sweden,<br />

Denmark, Finl<strong>and</strong>, Germany, Netherl<strong>and</strong>s,<br />

UK<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 16


Manual oil <strong>spill</strong> detection: KSAT<br />

• Manual inspection by trained operators<br />

– Information about wind speed used<br />

– Information about oil rig, pipelines, coastlines etc. is overlaid<br />

the image<br />

• <strong>Oil</strong> <strong>spill</strong>s are assigned confidence levels:<br />

– Low<br />

– Medium<br />

– High<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 17


Manual vs. automatic detection<br />

• Automatic methods faster<br />

– Manual: average processing time 10 min<br />

– Automatic: average processing time 1.45 min<br />

• Benchmarking studies show that automatic<br />

algorithms can perform comparable to manual<br />

detection in detecting verified oil <strong>spill</strong>s<br />

• Manual verifification of suspect slick should be<br />

done prior to alarming the aircraft<br />

• Our automatic system will be installed <strong>and</strong> run at<br />

KSAT in Tromsø as part of ESA-project<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 18


Automatic algorithm based on SAR images<br />

• Starting in 1993, an advanced algorithm for oil <strong>spill</strong> detection in ERS<br />

images was developed by the Norwegian Computing Center (NR).<br />

• Collaboration project<br />

– NR<br />

– University of Oslo.<br />

• The work has been extended to RADARSAT-1 ScanSAR <strong>and</strong><br />

ENVISAT ASAR WideSwath images.<br />

– Sensor specific modules developed:<br />

UNIVERSITETET I<br />

OSLO<br />

» some differences in the dark spot detector<br />

» very similar features<br />

» sensor specific set of rules<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 19


The automatic<br />

oil <strong>spill</strong><br />

detection<br />

algorithm<br />

• Main parts:<br />

– Dark spot detection<br />

– Spot feature extraction<br />

– Spot classification<br />

» Make a decision if<br />

oil or look-alike,<br />

based on a<br />

statistical model for<br />

oil in different wind<br />

conditions <strong>and</strong> of<br />

different shapes.<br />

UNIVERSITETET I<br />

OSLO<br />

<strong>Oil</strong> <strong>spill</strong><br />

desciption<br />

database<br />

Preprocessing <strong>and</strong><br />

calibration<br />

Masking<br />

Dark spot<br />

detection<br />

Spot feature<br />

extraction<br />

Spot<br />

classification<br />

Warning<br />

if classified as oil<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 20<br />

e<br />

Weather<br />

information


Dark spot deteksjon<br />

• Adaptive thresholding:<br />

– T is set to k dB below the estimated local mean backscatter<br />

level.<br />

– Wind information used to estimate k.<br />

• Power-to-mean ratio:<br />

– Local homogeneity is computed by PMR.<br />

– T is adjusted accordingly.<br />

• Pyramid approach:<br />

– Thresholding done in different scales. Result is merged.<br />

• Thin linear slicks (New ENVISAT approach):<br />

– Fragments located by thresholding as described, but fixing k at<br />

a small dB value. 1 st invariant planar moment an indicator of<br />

elongatedness.<br />

– Object oriented bounding box for each selected fragment.<br />

– Bounding box extended in the orientation of the slick <strong>and</strong> a<br />

threshold is applied inside the box.<br />

– Only pixels close to/on an edge are selected.<br />

– Segmented slicks merged with the original segmented image.<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 21


Dark spot<br />

detection –<br />

thin,<br />

linear slicks<br />

example<br />

Large part of oil <strong>spill</strong> detected as background.<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 22<br />

<strong>Oil</strong> <strong>spill</strong> example<br />

(ENVISAT ASAR<br />

WideSwath).<br />

Improved result. Larger part of the oil <strong>spill</strong> detected<br />

<strong>and</strong> still separated <strong>from</strong> the background.


Feature extraction<br />

• ENVISAT <strong>and</strong> RADARSAT uses the same set of features (only<br />

slight modifications).<br />

– Simple ship detector tailored for each sensor.<br />

• The features are a mix of st<strong>and</strong>ard region descriptors <strong>and</strong> features<br />

tailored to oil <strong>spill</strong> detection.<br />

– Spot geometry <strong>and</strong> shape (e.g. area, width, complexity)<br />

– Intensity level (e.g. spot border gradient, local contrast)<br />

– Spot contextual features (e.g. spot local <strong>and</strong> global neighbours)<br />

– Texture (PMR)<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 23


Slick classification<br />

• M spots to be classified as either oil <strong>spill</strong> or look-alike.<br />

• A statistical classifier model is applied which<br />

incorporates prior knowledge in terms of loss<br />

functions, <strong>and</strong> a rule-based approach. (See Solberg<br />

et al. 1999 IEEE Trans. on geoscience <strong>and</strong> remote<br />

sensing for details).<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 24


Detected oil <strong>spill</strong><br />

ENIVSAT ASAR WS.<br />

Detected as oil <strong>spill</strong> by KSAT <strong>and</strong> our algorithm, verified by Finnish surveillance aircraft,<br />

UNIVERSITETET I<br />

OSLO<br />

21 July 2003.<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 25


Detected oil <strong>spill</strong><br />

UNIVERSITETET I<br />

OSLO<br />

ENIVSAT ASAR WS.<br />

Detected as oil <strong>spill</strong> by KSAT <strong>and</strong> our algorithm,<br />

verified by German surveillance aircraft, 2 September 2003.<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 26


Algorithm compared to manual <strong>and</strong> semi<br />

manual approaches<br />

• Benchmark study<br />

– Training set: 100 RADARSAT <strong>and</strong> 64 ENVISAT images.<br />

– Test set: 32 RADARSAT <strong>and</strong> 28 ENVISAT images.<br />

Approach/<br />

Detected oil<br />

<strong>spill</strong>s<br />

UNIVERSITETET I<br />

OSLO<br />

RADARSAT:<br />

18 oil <strong>spill</strong>s verified by<br />

aircraft<br />

KSAT 15<br />

Our algorithm<br />

14<br />

ENVISAT:<br />

11 oil <strong>spill</strong>s verified by<br />

aircraft<br />

QinetiQ 12<br />

5<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 27<br />

7<br />

8


<strong>Oil</strong> <strong>spill</strong>s detected both by RADARSAT <strong>and</strong><br />

ENVISAT ASAR<br />

Two oil <strong>spill</strong>s verified by aircraft the 21 st July 2003 at 23:26 pm.<br />

Wind speed 10 m/s. Spot to the right: 59,50 Lat <strong>and</strong> 21.98 Lon.<br />

RADARSAT SCN image, 21 st July 2003, 16:05 pm.<br />

None of the satellite approaches detected the oil <strong>spill</strong> to<br />

the right. KSAT, QinetiQ <strong>and</strong> NR detected the oil <strong>spill</strong> to<br />

the left.<br />

UNIVERSITETET I<br />

OSLO<br />

ENVISAT ASAR WS image, 21 st July 2003, 19:54 pm. <strong>Oil</strong><br />

<strong>spill</strong> to the right detected by KSAT <strong>and</strong> NR. None of the<br />

satellite based approaches detected the <strong>spill</strong> to the left.<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 28


<strong>Oil</strong> <strong>spill</strong> missed by satellite<br />

ENVISAT ASAR WS. Classified as oil by German surveillance aircraft, 3<br />

August 2003. Not detected by KSAT, our algorithm or QinetiQ.<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 29


Look-alikes <strong>and</strong> false alarms<br />

• Look-alikes:<br />

– Natural films<br />

– Grease ice<br />

– Threshold wind speed areas (< 3m/s)<br />

– Wind sheltering by l<strong>and</strong><br />

– Rain cells<br />

– Shear zones<br />

– Internal waves<br />

– Natural oil seepage etc.<br />

• In certain cases, a SAR sensor alone is not sufficient to<br />

discriminate between oil, natural films <strong>and</strong> algae.<br />

• To detect all true oil <strong>spill</strong>s, a certain number of false<br />

alarms must be expected.<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 30


Algae<br />

examples<br />

UNIVERSITETET I<br />

OSLO<br />

ENVISAT ASAR WS. Classified as algae by German surveillance aircraft, 7. august<br />

2003.<br />

ENVISAT ASAR WS. Classified as algae by<br />

Finnish surveillance aircraft, 11. August 2003.<br />

RADARSAT ScanSAR. Classified as<br />

algae by aircraft, 1. August 2003.<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 31


Algae study<br />

• Additional information necessary to distinguish<br />

between algae <strong>and</strong> oil <strong>spill</strong>s in SAR images.<br />

– Suitable <strong>sensors</strong>:<br />

UNIVERSITETET I<br />

OSLO<br />

» MERIS? 300m spatial resolution.<br />

» MODIS? 250-300 m spatial resolution.<br />

» Low resolution.<br />

» Cloud coverage <strong>and</strong> light conditions a problem.<br />

– Algae maps <strong>and</strong> probabilities of observing algae in different<br />

areas at different times of the year.<br />

» Summer months in the Baltic sea.<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 32<br />

Algae in ASAR<br />

WS image. Length<br />

of spot ~7050 m<br />

(pixel size is 75 m).


Summary<br />

• Future operational oil <strong>spill</strong> <strong>monitoring</strong> a combination of<br />

– SAR satellites (RADARSAT-1/-2, ENVISAT) with wide coverage <strong>and</strong> a<br />

spatial resolution


<strong>Oil</strong> <strong>spill</strong> statistics<br />

• >1000 <strong>spill</strong>s observed annualy in European water<br />

• <strong>Oil</strong> <strong>spill</strong> lifetimes range <strong>from</strong> hours to days<br />

– Most oil <strong>spill</strong>s are not observed the following day<br />

• Environmental effect depends on position,<br />

amount, oil type etc.<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 34


<strong>Oil</strong> <strong>spill</strong> statistics – Finl<strong>and</strong> (<strong>from</strong> SYKE)<br />

UNIVERSITETET I<br />

OSLO<br />

INSTITUTT FOR INFORMATIKK Proof seminar - 35

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!