HLRS - Industrial Workshop on Grid - CoreGRID Network of ...

coregrid.ercim.eu

HLRS - Industrial Workshop on Grid - CoreGRID Network of ...

Managed by

CoreGRID: European Research Network on

Foundations, Software Infrastructures and

Applications for large scale distributed, GRID and

Peer-to-Peer Technologies

Thierry PRIOL

Scientific Coordinator

INRIA/ERCIM

http://www.coregrid.net

Thierry.Priol@inria.fr


CoreGRID objectives

To build a European-wide research laboratory

– To avoid fragmentation of Grid research activities in Europe

– Create the European “Grid Lighthouse” and be seen as such

worldwide

– To achieve integration and sustainability

To build solid foundations for GRID and Peer-to-Peer (P2P) technologies

– Both on a methodological basis and a technological basis.

– Support medium and long term research activities

Achieve and promote scientific and technological excellence within & beyond

the Grid research community

Gather and disseminate European research

A think-tank for spin-off projects

– EC funded, bilateral projects, international cooperations, …

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

2


A clear evidence of fragmentation

Grid National initiatives:

• Belgium Be-GRID

• Bulgarian BG-Grid

• Cyprus CyGrid

• Czech Metacenter

• French ACI GRID

• German D-GRID

• Greek Hellas-GRID

• Hungarian Grid

• Italian GRID.IT

• Polish SGIGrid

• Scandinavian NORDUGRID

• Spanish IRISGrid

• Swiss SwissGRID

• The Netherlands DAS

• UK e-Science

NORDUGRID

E-SCIENCE

DAS

D-GRID SGIGRID

METACENTER

BE-GRID

H-GRID

ACI GRID SWISSGRID

GRID.IT

IRISGRID

BG-GRID

HELLAS-GRID

CYGRID

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

3


Network priorities

Excellence

CoreGRID brings together a European critical mass of

well-known experts in GRID and P2P research allowing

to compete with research and development in North

America and Asia

– An ambitious joint program of activities to deal with well

identified challenges

Long-term integration & structuring

– Set-up a sustainable European research laboratory with

an associated management

• With several Institutes

• With research groups assigned to Institutes

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

4


A NoE managed by ERCIM

ERCIM is a

consortium

of leading research

institutions from

18 countries (17

European)

committed

to information

technology

and applied

mathematics.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

5


CoreGRID membership

42 partners

18 Countries (1 from S. America)

120 Researchers

165 PhD Students

IC

RAL-CCLRC

U. Belfast

U. Cambridge

U. Cardiff

U. Manchester

U. Newcastle

U. Wesminster

INRIA

CNRS

ERCIM

Delft U.

Vrije U.

CETIC

UCL

CNR-ISTI

INFN

U. Calabria

U. Lecce

U. Pisa

FhG

FZJ

USTUTT

U. Muenster

UNI DO

U. Passau CYFRONET

ZIB Masaryk U.

EPFL

UASF

KTH

SICS

VTT

U. Chile PSC

U. Coimbra

UPC

SZTAKI

CLPP-BAS

ICS-FORTH

U. Cyprus

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

6


Joint Program of Activities

Sergei

Gorlatch

Joint Programme of Activities

Pierre

Guisset

Integrated

Activities

Jointly Executed

Research

Spreading of

Excellence

Coordinated Programming

of Partners’ activities

Coordinated approach to

prepare project proposals

Domenico

Talia

Marco

Danelutto

Knowledge &

Data Management

Programming Model

Public Website

Technical reports

ong>Workshopong>s & conferences

Internal Collaboration

and Dissemination

Annual Integration

ong>Workshopong>

Artur

Andrzejak

Ludek

Matyska

System Architecture

Grid Information and

Monitoring Service

Industry

GRID User community

Newsletter

Common Understanding

Trust & Security

Grid Testbed

Mobility of researchers

Ramin

Yahyapour

Vladimir

Getov

Resource Management

And Scheduling

PSE, tools and

GRID systems

Conferences

Brochures

Training & Education

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

7


Collaboration with other EU Grid projects

Wolfgang

Ziegler

Leadership

Collaboration Gateway

Exploitation of synergies /

technical concertation

Joint fora for exchange

and dissemination

Co-ordination ordination of

standardisation efforts

Repository of reference

Implementations and Grid

middleware

Collaboration on research

Inventories and roadmaps

Indicators and impact

assessment

CoreGRID is participating to

the Collaboration Gateway

and leads two activities :

• Roadmaps

• Trainings

Leadership

Training activities

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

8


A set of well identified research challenges

Knowledge & Data Management

– Handling information/data that are required/produced by a wide range

of diverse processing power

Programming Model

– Making the programming of Grid infrastructures as simple and

transparent as possible

System Architecture

– Designing the next generation Grid middleware

Grid Information and Monitoring Services

– Scalable information service to implement a service view of the Grid

Resource Management & Scheduling

– Scheduling jobs/applications/tasks/computation within a Grid

environment

Problem Solving Environments, tools and GRID systems

– Integrating various middleware, tools and applications for problem

solving

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

9


Knowledge & Data Management

• Integration of data management and knowledge discovery with

GRID technologies for providing knowledge-based GRID services

• Define a unified vision of the data and knowledge management in

Grids through a layered approach

• Research activities

– Distributed data management

• Based on commodity storage devices and interconnects

– Information and knowledge management

• Semantic modeling through metadata

– Data mining and knowledge discovery

• Semantic description for service discovery

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

10


Programming Model

• Raise the level of abstraction to make the programming of grids

easier

– OGSA and WSRF are just the instruction set of grid computing

infrastructures

• Definition of a lightweight component model for grid applications

– A clear illustration of the research fragmentation

• At least 9 partners are working on component programming

– Specific requirements: heterogeneity, dynamicity, scalability

– Targeted applications: grid middleware & scientific computing

• Research activities

– Application requirements

– Communication between components

– Component model definition and hierarchical composition

– Advanced programming models based on components framework

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

11


System Architecture

• Next Generation Grid System Architecture

– Implement the “invisible Grid” vision of the NGG report

• Focus on specific deficiencies of present day Grid systems

– Today Grid middleware

• centralized or semi-centralized

• Short-term prediction models and tools

• Fault tolerance mechanisms only for small/medium scale systems

– Specific requirements: scalability, adaptability and dependability

• Research activities

– Definition of capabilities and architectural components of Grids

– Scalable Grid Services

• follow a P2P approach instead of a client/server approach

– Mechanism for adaptive Grids

• tools and models for long-term prediction

– Dependability in Grids

• Fault tolerant middleware and runtime

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

12


Grid Information & Monitoring Service

• Improve various services such as monitoring, information and

user/accounting management

– Avoid centralized management as much as possible

• Research activities

– Checkpointing services

– Workflow services

– Accounting and user management services in large scale system

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

13


Resource Management & Scheduling

• Develop generic solution for Grid scheduling and management

– Not only able to manage computational resources

• Definition of a pervasive RMS middleware for different application

scenarios

– Consider different kind of resources

– Common interface and models

– Support business models

• Research activities

Grid scheduling architecture

– Multi-level scheduling strategies

– Workflow scheduling strategies for jobs with temporal dependencies

– Fault-tolerance and reliability in scheduling

– Coordinating scheduling with data management

– Performance prediction for advanced scheduling

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

14


Problem Solving Environment, tools and

applications for problem solving

• Develop a novel software environments and tools for Grid

systems

– Today Grid middleware systems are not component-based although

their high-degree of complexity

• Definition of a generic component system to integrate

applications, tools and system components

– Based on the CoreGRID components model

• Research activities

– Definition of a generic platform

– Mediator components

– Integrated toolkit

– Advanced tools and environments

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

15


Organizational Map

Scientific Advisory Board ong>Industrialong> Advisory Board Specific Task Forces

Members

General

Assembly

Chair:

D. Laforenza

(CNR-ISTI)

Administrative &

Financial Co-ordinator

B. Le Dantec (ERCIM)

Spreading Excellence

P. Guisset (CETIC)

Integration Monitoring Committee

Chair: R. Perrott (U. Belfast)

Scientific

Co-ordinator

T. Priol (INRIA)

Integrated Activities

S. Gorlatch (U. Munster)

Executive

Committee

CoreGRID

Institutes

Knowledge &

Data Management

D. Talia (U. Calabria)

Programming

Model

M. Danelutto (U. Pisa)

System

Architecture

A. Andrzejak (ZIB)

Grid Information

& Monitoring

L. Matyska (U. Masaryk)

Scheduling

R. Yahyapour

(U. Dortmund)

PSE, tools and

GRID systems

V. Getov (U. Wesminster)

Collaboration Gateway

W. Ziegler (FhG)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

16


Scientific Advisory Board (SAB)

Objectives:

– Annual external assessment of the scientific quality of the work

– Provide guidance to the strategic orientations

– Formulate recommendations guard the excellence of the Network

Three senior Network scientists and three external advisors

Internal members:

• Jarek Nabrzyzki (PSNC - Poland)

• Henri Bal (Vrije U. - The Netherlands)

• Uwe Schwiegelshohn (Dortmund U. - Germany)

External members:

• Dennis Gannon (Indiana U. - USA)

• Michel Cosnard (Nice U. - France)

• Sato Sekiguchi (AIST - Japan)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

17


ong>Industrialong> Advisory Board (IAB)

IAB has four primary objectives:

– To communicate to the Network European Industry’s long-term Grid-related technology

needs and challenges

– To provide the Network with Grid validation cases

– To help identify the market sector(s) to be addressed within the Grid User Community, in

order to ensure a quick adoption of next generation Grid technologies within European

industry

– To report to the Scientific Advisory Board its recommendation with respect to future

strategic GRID-related research objectives

IAB is composed of 15 members from the European industrial sector

Confirmed members:

• Federico Rossi, DATAMAT (Italy)

• Yannis Perros, Algosystems (Greece)

• Bernd Kosch, FUJITSU SIEMENS COMPUTER (Germany)

• Mark Gilbert, European Microsoft Innovation Center (Germany)

• John Easton, IBM Grid Computing (UK)

• Anssi Karhinen, Nokia Research Center (Finland)

• Igor Klapka, SAMTECH (Belgium)

• Guillaume Alléon, EADS (France)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

18


Some of the CoreGRID results

http://www.coregrid.net Newsletter Technical Report

Announcement

ong>Workshopong> on Network Centric Operating systems

March 16-17, Brussels

Information available at the CoreGRID web site

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

19


http://www.ercim.org/publication/Ercim_News/enw59/

Conclusion

CoreGRID started in September 1st, 2004

– A very active project although it is in its early stage

– Funding from the EC: 8.2 M€ for the first 4 years

– Involvement of the main European Key players in Grid

computing (both institutions and researchers)

– The only one Network of Excellence in Grid funded by the

EU

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer

Technologies

20

More magazines by this user
Similar magazines