20.01.2015 Views

Download services - INSPIRATION

Download services - INSPIRATION

Download services - INSPIRATION

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>INSPIRATION</strong> – Spatial Data Infrastructure in the Western Balkans<br />

<strong>Download</strong> <strong>services</strong><br />

2nd INSPIRE Training - Zagreb, Croatia<br />

25th - 26th September, 2012<br />

Martin Koška, SAŽP<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Outlines<br />

Legislation regarding INSPIRE download <strong>services</strong><br />

Implementation of INSPIRE download <strong>services</strong><br />

ATOM implementation<br />

WFS implementation<br />

Demonstration of WFS <strong>services</strong> - examples<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

INSPIRE architecture<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

General usage scenario of SDI<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

INSPIRE legislation and guidelines<br />

Directive 2007/2/EC of the European Parliament and of the<br />

Council of 14 March 2007 establishing an Infrastructure for<br />

Spatial Information in the European Community (INSPIRE)<br />

[INS DIR]<br />

Commission Regulation amending Regulation (EC) No<br />

976/2009 as regards download <strong>services</strong> and transformation<br />

service<br />

Technical Guidance for the implementation of INSPIRE<br />

<strong>Download</strong> Services published 12-06-2012, Version 3.0 (not<br />

legally binding)<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Implementing Rule versus Technical<br />

Guidance<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Standards regarding download <strong>services</strong><br />

ISO 19142:2010 Geographic information - Web Feature<br />

Service, ISO 19142<br />

ISO 19143:2010 Geographic information - Filter encoding, ISO<br />

19143<br />

IETF RFC 4287 The Atom Syndication Format, ATOM<br />

GeoRSS-Simple The Simple Serialization of GeoRSS,<br />

http://www.georss.org/simple GeoRSS<br />

OpenSearch Description Document format,<br />

http://www.opensearch.org/Specifications/OpenSearch/1.1 OpenSearch<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Related subjects<br />

XML - Extensible Markup Language - is a markup language that defines a set of rules for encoding documents in<br />

a format that is both human-readable and machine-readable. It is defined in the XML 1.0 Specification<br />

produced by the W3C, and several other related specifications<br />

XML is common interchange data format<br />

XML uses easy syntax for structuring information (elements, atributes, processing instructions ...)<br />

XML “X“ stands for extensible -> it means everybody can make new elements<br />

XML SCHEMA - is formal language which allows user to define specific class of XML document<br />

<br />

<br />

Helps to define structure of class of documents in terms of allowed elements their attributes, cardinality<br />

of elements and their content.<br />

Then it is possible to validate XML document against XML schema<br />

GML - Geography Markup Language Encoding Standard - XML grammar defined by the Open Geospatial<br />

Consortium (OGC) to express geographical features, which uses XML schemas as technology<br />

GML application schemas (actually 3.2.1 in OGC specidication) - the basis for domain - or community-specific<br />

"Application Schemas", which in turn support data interoperability within a community of interest.<br />

All 34 INSPIRE datasets are represented by GML application schemas which extends basic GML<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

What is download service<br />

Chapter IV, Article 11 (Network <strong>services</strong>) of the Directive define<br />

download service as:<br />

“<strong>Download</strong> <strong>services</strong> enabling copies of complete spatial datasets,<br />

or of parts of such sets, to be downloaded.”<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

When is implementation required<br />

Article 4: Not later than 28 June 2012, Member States shall<br />

provide the <strong>Download</strong> Services with initial operating<br />

capability.<br />

Article 4: Not later than 28 December 2012, Member States<br />

shall provide the <strong>Download</strong> Services in conformity with this<br />

Regulation.<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Non-Interoperable and Interoperable<br />

<strong>Download</strong> Services<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Legal Requirements<br />

ANNEX I - QUALITY OF SERVICE<br />

For the Get <strong>Download</strong> Service Metadata operation, the response time for sending the initial<br />

response shall be maximum 10 seconds in normal situation.<br />

For the Get Spatial Data Set operation and for the Get Spatial Object operation, and for a<br />

query consisting exclusively of a bounding box, the response time for sending the initial<br />

response shall be maximum 30 seconds in normal situation then, and still in normal situation,<br />

the download service shall maintain a sustained response greater than 0,5 Megabytes per<br />

second or greater than 500 Spatial Objects per second.<br />

For the Describe Spatial Data Set operation and for the Describe Spatial Object Type<br />

operation, the response time for sending the initial response shall be maximum 10 seconds in<br />

normal situation then, and still in normal situation, the download service shall maintain a<br />

sustained response greater than 0,5 Megabytes per second or greater than 500 descriptions<br />

of Spatial Objects per second.<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Legal Requirements<br />

ANNEX I - CAPACITY<br />

The minimum number of simultaneous requests to a download service to be served in<br />

accordance with the quality of service performance criteria shall be 10 requests per second.<br />

The number of requests processed in parallel may be limited to 50.<br />

ANNEX I – AVAILABILITY<br />

The probability of a network service to be available shall be 99 % of the time.<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Mandatory Operations<br />

ANNEX IV - <strong>Download</strong> Operations<br />

All download <strong>services</strong><br />

<br />

<br />

<br />

<br />

Get <strong>Download</strong> Service Metadata - Provides all necessary information about the service, the available<br />

Spatial Data Sets, and describes the service capabilities.<br />

Get Spatial Data Set - The Get Spatial Data Set operation allows the retrieval of a Spatial Data Set.<br />

Describe Spatial Data Set - This operation returns the description of all the types of Spatial Objects<br />

contained in the Spatial Data Set.<br />

Link <strong>Download</strong> Service - Allows the declaration, by a Public Authority or a Third Party, of the availability of<br />

a <strong>Download</strong> Service for downloading Spatial Data Sets or, where practicable, Spatial Objects, through the<br />

Member State’s <strong>Download</strong> Service while maintaining the downloading capability at the Public Authority or<br />

the Third Party location.<br />

Direct access<br />

<br />

<br />

Get Spatial Object - This operation allows the retrieval of Spatial Objects based upon a query.<br />

Describe Spatial Object Type - This operation returns the description of the specified Spatial Objects<br />

types.<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Types of INSPIRE <strong>Download</strong> Service<br />

Pre-Defined <strong>Download</strong> Service<br />

<br />

<br />

<br />

One or more files representing either the full dataset or subsets<br />

These files are accessed via a file or data repository (e.g. FTP)<br />

<strong>Download</strong>ed in their entirety and the content cannot be changed (i.e. encoding, CRS)<br />

Direct Access <strong>Download</strong> Service<br />

Users define a set of request criteria that subsets the data to return only the features needed:<br />

<br />

<br />

<br />

<br />

Select all data within a bounding box<br />

Select only feature type arbitrary<br />

Select feature by identifier<br />

Select all features using temporal criteria within and area of interest<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Implementing INSPIRE <strong>Download</strong><br />

Services<br />

Possible ways for implementation of INSPIRE <strong>Download</strong> Services<br />

<br />

Atom-based implementation - The Atom syndication format provides a simple, widely understood<br />

mechanism for publishing information on the web in the form of feeds in a way that is compatible with<br />

existing web architecture and many tools.<br />

<br />

WFS-based implementation - The OGC Web Feature Service allows a client to retrieve and update<br />

geospatial data encoded in Geography Markup Language (GML)* from multiple Web Feature Services.<br />

WFS provides much more sophisticated web service for downloading and directly access data online. WFS<br />

supports the ability for users to retrieve only the data they are interested in.<br />

*geospatial data can be encoded in different formats<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Options for implementing INSPIRE<br />

<strong>Download</strong> Services<br />

3 options for implementing INSPIRE <strong>Download</strong> Services (in present):<br />

1. ATOM Feed providing access to pre-defined datasets<br />

2. OGC WFS 2.0 serving pre-defined datasets<br />

3. OGC WFS 2.0 serving features (Direct Access)<br />

Conformance Class<br />

Atom Feed<br />

Pre-defined WFS<br />

Direct access WFS<br />

Quality of service<br />

Obligation<br />

C<br />

(M, if WFS (Predefined) is not<br />

conformed to)<br />

C<br />

(M, if Atom Feed is not<br />

conformed to)<br />

O<br />

M<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Introduction to ATOM<br />

<br />

<br />

<br />

<br />

<br />

XML based web content and metadata syndication format (similar as RSS)<br />

Application-level protocol for publishing and editing web resources belonging to periodically updated<br />

websites<br />

ATOM feeds push links to updated content to subscribed users<br />

Removes need for user to repeatedly return to source to check for updates<br />

Minimal implementation cost and complexity<br />

ATOM Feed readers<br />

<br />

<br />

<br />

Web Browser (e.g. Firefox, Opera, IE, Safari, Chrome)<br />

Web-based feed reader (e.g. Google Reader)<br />

Desktop feed reader (e.g. MS Outlook)<br />

ATOM feed contains:<br />

<br />

<br />

Descriptive metadata describing the feed itself<br />

One or more entries that describes the content (i.e. pre-defined dataset)<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Example of atom feed<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Atom feeds to make available pre-defined datasets for<br />

INSPIRE download <strong>services</strong><br />

<br />

<br />

<br />

<br />

A single Atom feed is published as a top-level “<strong>Download</strong> Service Feed”.<br />

This feed contains a link to an OpenSearch description document which provides operations metadata for<br />

the <strong>Download</strong> Service. The OpenSearch description document provides information about the operations<br />

implemented by the download service.<br />

This feed contains one or more Atom entries: one per pre-defined data set.<br />

Each of these Atom entries shall contain a link to another Atom Feed (a “Dataset Feed”) that<br />

describes the particular pre-defined data set.<br />

<br />

<br />

Each of these “Dataset Feeds” shall contain Atom Entries with links to download the predefined dataset in<br />

different formats (e.g. in GML, ShapeFile etc) and in different Coordinate Reference Systems. One link shall<br />

be provided for each format/CRS combination.<br />

Feeds may be provided in multiple languages<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Overview of Atom feed structures<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Elements required to describe feed and<br />

entries<br />

Feed<br />

<br />

<br />

<br />

<br />

<br />

Title<br />

ID<br />

Author<br />

Update<br />

Rights<br />

Subtitle, GeoRSS polygon (Dataset Feed)<br />

Links to related metadata and content:<br />

<br />

<br />

<br />

<br />

<br />

INSPIRE ISO Metadata<br />

OpenSearch Description<br />

Spatial object description<br />

Self Referencing Link<br />

Optional link to alternate representations of feed<br />

Entries<br />

<br />

<br />

<br />

<br />

<br />

Title<br />

ID<br />

Update<br />

Category (CRS)<br />

Link(s) to Content<br />

<br />

<br />

URL for Dataset Feed (Top Feed)<br />

URL for Dataset (Dataset Feed)<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

WFS implementation of download<br />

<strong>services</strong><br />

<br />

The Web Feature Service (WFS) represents a change in the way geographic information is created,<br />

modified and exchanged on the Internet. Rather than sharing geographic information at the file level using<br />

File Transfer Protocol (FTP), for example, the WFS offers direct access to geographic information at the<br />

feature and feature property level. Web feature <strong>services</strong> allow clients to only retrieve or modify the data<br />

they are seeking, rather than retrieving a file that contains the data they are seeking and possibly much<br />

more. That data can then be used for a wide variety of purposes, including purposes other than their<br />

producers' intended ones.<br />

<br />

In the taxonomy of <strong>services</strong> defined in ISO 19119, the WFS is primarily a feature access service but also<br />

includes elements of a feature type service, a coordinate conversion/transformation service and<br />

geographic format conversion service<br />

OpenGIS Web Feature Service 2.0 Interface Standard equals ISO 19142<br />

Other standards – WFS 1.0.0, WFS 1.1.0<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Main operations<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

GetCapabilities (discovery operation)<br />

DescribeFeatureType (discovery operation)<br />

GetPropertyValue (query operation)<br />

GetFeature (query operation)<br />

GetFeatureWithLock (query & locking operation)<br />

LockFeature (locking operation)<br />

Transaction (transaction operation)<br />

<br />

<br />

<br />

<br />

CreateStoredQuery (stored query operation)<br />

DropStoredQuery (stored query operation)<br />

ListStoredQueries (stored query operation)<br />

DescribeStoredQueries (stored query operation)<br />

New in WFS 2.0.0 used by INSPIRE<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

GetCapabilities operation<br />

The GetCapabilities operation generates a service metadata document<br />

describing a WFS service provided by a server.<br />

Parameters<br />

ServiceType = "WFS"<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

DescribeFeatureType operation<br />

The DescribeFeatureType operation returns a schema description of feature<br />

types offered by a WFS instance.<br />

Parameters<br />

service :"WFS"<br />

version : "2.0.0“<br />

typeName - A comma separated list of feature types to describe. If no<br />

value is specified, then all feature types are returned.<br />

outputFormat : "text/xml; subtype=gml/3.2"<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

GetFeature operation<br />

The GetFeature operation returns a selection of features from a data store. A<br />

WFS processes a GetFeature request and returns a response document to<br />

the client that contains zero or more feature instances that satisfy the<br />

query expressions specified in the request.<br />

Parameters<br />

service :"WFS"<br />

version : "2.0.0“<br />

Typename - A list of feature type names to query<br />

Output format - The output format used to describe feature data returned by WFS<br />

Result type<br />

Maxfeatures<br />

Filter - A filter specification describes a set of features to operate upon. The filter is defined<br />

as specified in the OGC Filter Encoding Specification<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Mapping to WFS requests<br />

<br />

<br />

<br />

<br />

Get <strong>Download</strong> Service Metadata - GetCapabilities<br />

Get Spatial Data Set - GetFeature<br />

Describe Spatial Data Set - DescribeFeatureType<br />

Link <strong>Download</strong> Service - PublishMetadata function of an INSPIRE compliant discovery service<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Mapping INSPIRE download service requests<br />

to WFS requests – predefined datasets<br />

Mapping to WFS requests<br />

<br />

<br />

<br />

<br />

Get <strong>Download</strong> Service Metadata – GetCapabilities - The Get <strong>Download</strong> Service Metadata request is a<br />

GetCapabilities request to the WFS indicated in the metadata record<br />

Get Spatial Data Set – GetFeature - ISO 19142 describes the operations ListStoredQueries and<br />

DescribeStoredQueries. The former is used to retrieve a list of stored queries that are available and the<br />

later is used to request more information about a particular stored query (or queries) such as the<br />

parameter arguments that are required to make a GetFeature request using the stored query<br />

Describe Spatial Data Set - DescribeFeatureType<br />

Link <strong>Download</strong> Service - PublishMetadata function of an INSPIRE compliant discovery service<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Mapping INSPIRE download service requests<br />

to WFS requests – direct access<br />

Mapping to WFS requests<br />

<br />

<br />

<br />

<br />

<br />

<br />

Get <strong>Download</strong> Service Metadata - GetCapabilities<br />

Get Spatial Data Set - GetFeature<br />

Describe Spatial Data Set - DescribeFeatureType<br />

Link <strong>Download</strong> Service - PublishMetadata function of an INSPIRE compliant discovery service<br />

Get Spatial Object - GetFeature request with required query arguments is made to the WFS<br />

Describe Spatial Object Type – GetCapabilities - The WFS responds with the XML schema for the<br />

requested Spatial Object types<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Examples of requests-responses from<br />

WFS server<br />

Geoserver – open source software providing several kind of <strong>services</strong> also WFS service<br />

In present time provide data also in GML format using interface WFS 1.0.0, WFS 1.1.0<br />

Link:<br />

• http://geoserver.org<br />

• Scenario: how to serve district borders layer using WFS (download) service and make it<br />

permanently actual<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Examples of using WFS service<br />

Biodiversity web application SK, BG, AT<br />

INSPIRE mashup application which provides:<br />

- Filtering the features<br />

- <strong>Download</strong> features<br />

- Weaving (portrayal) the features<br />

- Possibility to supplement the application by other data from other countries<br />

Components:<br />

Database and data<br />

Link:<br />

• http://geo.enviroportal.sk/geoserver/www/ps_mashup/index.html<br />

A multi-country project funded by the<br />

European Union and implemented by


I N S P I R AT I O N – S p a t i a l D a t a I n f r a s t r u c t u r e i n t h e W e s t e r n B a l k a n s<br />

Thank you.<br />

http://geoportal.sazp.sk<br />

http://geo.enviroportal.sk<br />

http://inspire.gov.sk<br />

http://www.enviroportal.sk<br />

http://www.sazp.sk<br />

A multi-country project funded by the<br />

European Union and implemented by

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!