BWI - ETH Zürich - Information Management - ETH Zürich
BWI - ETH Zürich - Information Management - ETH Zürich
BWI - ETH Zürich - Information Management - ETH Zürich
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>BWI</strong> - <strong>ETH</strong> Zürich<br />
Trends and Directions in IT and<br />
<strong>Information</strong> <strong>Management</strong><br />
Innovative Technologien für „Event Driven“ IT Infrastrukturen<br />
Francis Kuhlen<br />
Managing Director IBM<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Accelerating Advances in Technology<br />
1E+12<br />
$1000 Buys: Computations per second<br />
1E+9<br />
1E+6<br />
1E+3<br />
1E+0<br />
1E-3<br />
1E-5<br />
1900 1920 1940 1960 1980 2000 2020<br />
Source: Kurzweil 1999 – Moravec 1998<br />
2<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Accelerating Advances in Technology<br />
1E+12<br />
$1000 Buys: Computations per second<br />
1E+9<br />
1E+6<br />
1E+3<br />
1E+0<br />
1E-3<br />
$, €, CHF<br />
1E-5<br />
1900 1920 1940 1960 1980 2000 2020<br />
Source: Kurzweil 1999 – Moravec 1998<br />
3<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
The Internet and World Wide Web<br />
1500<br />
$6000<br />
Users/Buyers/Devices Millions<br />
1000<br />
500<br />
Users<br />
Buyers<br />
Devices<br />
eCommerce<br />
Spending<br />
eCommerce Spending $Billions<br />
0<br />
2000 2001 2002 2003 2004 2005 2006<br />
$0<br />
4<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
The Event-Driven World<br />
IPv6 Map<br />
VoIP, VoD, IMS, etc.<br />
RFID-enabled Checkout<br />
Intelligent Oil Field<br />
ENRON Chairman<br />
indicted……..<br />
Surveillance<br />
RFID-enabled Scanning<br />
• Billing<br />
• Security<br />
• Fraud alerts<br />
• Retrospective<br />
processing<br />
5<br />
Fraud/Compliance<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
Location Based Service (Traffic)<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
The Event-Driven World<br />
The accelerating need to handle large volumes of time-dependent<br />
events will give rise to new classes of middleware, programming<br />
models, and tools<br />
● There is a growing need to monitor, capture, process, and store massive volumes of<br />
time-dependent events<br />
• Smart sensors, RFID, program trading, fraud management, risk and compliance, intelligent oil field, location<br />
based service, logistics, presence (SIP), in-line analytics, etc.<br />
● An increasing number of companies are addressing the needs of the time-dependent<br />
infrastructure market<br />
• Developing event engines that route, transform and derive events from multiple streams<br />
• Delivering content management solutions supporting large volumes of time-dependent data<br />
• Extracting event information from applications (ERP, CRM, etc.) and sensors<br />
● Standards are emerging<br />
• Real-time Specification for Java (JSR 1), Distributed Real-Time Specification (JSR 50)<br />
• Web Services Notification and Web Services Eventing<br />
• OMG Data Distribution Service (DDS) and IEEE 1516 for battlefield simulation<br />
● Middleware will evolve to deal with the throughput and time-dependent needs of the<br />
event-driven world. New programming models and tools will also emerge<br />
• Data integration will evolve to event integration<br />
6<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Any Network<br />
Provide optimized access seamlessly to user or machine over any network<br />
Personal Space<br />
(Office, Briefcase,<br />
Person, Broadband)<br />
On-Campus /<br />
Public (Office,<br />
SOHO, Airport,<br />
Hotel, Coffee Shop,<br />
Broadband)<br />
City, Community<br />
(Last Mile, Remote<br />
Coverage, Fixed and<br />
Mobile Broadband)<br />
Cellular/ PCS /Satellites<br />
(Miles / Regions, National,<br />
Continents, Fixed and<br />
Mobile Narrowband)<br />
PAN<br />
LAN MAN WAN<br />
7<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Future Networks<br />
Data, voice and multimedia will be carried over a heterogeneous<br />
physical network running IP<br />
● Supports large number of<br />
devices…<br />
• Wireless communicators: Cell phones,<br />
PDA’s, pagers, etc.<br />
• Interactive “smart” sensors (health monitors,<br />
environmental sensors, etc.)<br />
• RFID tags<br />
● “True” mobile computing will be<br />
enabled<br />
• Complete range of service (internet, TV,<br />
VoIP, etc.)<br />
• Self-configuring<br />
• Seamless roaming<br />
• On demand remote storage<br />
Location-based<br />
Services<br />
PSTN<br />
Gateway<br />
Cellular<br />
Radio<br />
PAN<br />
Base station<br />
Edge of Network<br />
Services<br />
Server<br />
Enhanced IP<br />
Core Network<br />
PAN<br />
WLAN<br />
Smart<br />
Sensors /<br />
RFID tags<br />
On<br />
Demand<br />
Storage<br />
Distributed<br />
storage<br />
Intelligent network<br />
elements<br />
Access<br />
Router<br />
Access-point<br />
SAN<br />
8<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Event Driven: Pervasive/Ubiquitous Computing<br />
● Smart Interconnected Devices<br />
● Multimodal User Interfaces<br />
● Sensor-based Applications<br />
9<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Personal Mobile Hub<br />
Open platform for<br />
• Providing open interfaces to service<br />
infrastructure to appliances, accessories,<br />
sensors, etc.<br />
• Extending (third party) services &<br />
applications to the mobile user<br />
• Enabling (third party) services & applications<br />
provisioning on the mobile device<br />
• Running on Standard OS<br />
And offering the following advantages<br />
• Short time-to-market for new applications<br />
based<br />
on specialized, tailored devices<br />
• New functionality inexpensive to attach<br />
• Opens up niche market<br />
Applications<br />
• Entertainment, education, logistics,<br />
maintenance, monitoring, healthcare,<br />
well-being, ….<br />
• Bluetooth<br />
• 802.11 a,b,g<br />
• UWB<br />
Near<br />
Far<br />
• GSM/GPRS<br />
• UMTS<br />
• 802.11 a,b,g<br />
• UWB<br />
Local devices<br />
(sensors, appliances)<br />
Personal<br />
Mobile<br />
Hub<br />
Network Services<br />
10<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Personal Mobile Health Hub<br />
Peekflow<br />
Body Weight<br />
Activity<br />
Inhalation<br />
Registration<br />
Heart Rate<br />
Injection<br />
Registration<br />
Blood<br />
Pressure<br />
Glucose<br />
Auscultation<br />
ECG Monitor<br />
Pill Dispenser<br />
11<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Network Architecture Proposal for Cars<br />
Broadcast<br />
Digital<br />
Car Radio<br />
Mobile Computer Platform<br />
Software<br />
Application<br />
Speech<br />
Processing<br />
Wireless<br />
Mobile Phone,<br />
Pager<br />
Positioning<br />
GPS<br />
Flash<br />
RAM<br />
Embedded<br />
Power PC<br />
Operating System<br />
Java Virtual Machine<br />
Navigation<br />
Internet<br />
E-mail<br />
Smart Card<br />
eCommerce<br />
Other<br />
Smart Card<br />
Reader<br />
Gateway &<br />
Communication Interfaces<br />
Automotive Bus<br />
12<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Event Driven: Pervasive/Ubiquitous Computing<br />
● Smart Interconnected Devices<br />
● Multimodal User Interfaces<br />
● Sensor-based Applications<br />
13<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Scenarios and Applications<br />
Equipment Equipment<br />
Sensors Sensors and and<br />
Controls Controls<br />
Industrial<br />
Automation<br />
Automated Automated<br />
Data Data<br />
Collection Collection<br />
Chemical<br />
Industry<br />
Remote<br />
Metering<br />
Location<br />
Positioning<br />
Distribution &<br />
Retail Industry<br />
Remote Remote<br />
Diagnostics<br />
Diagnostics<br />
and and Service Service<br />
Controls Controls<br />
Automotive<br />
Private<br />
Security<br />
RF ID Tags<br />
Security Security<br />
Sensors Sensors and and<br />
Controls Controls<br />
Electronic<br />
Health<br />
Context<br />
Awareness<br />
Asset<br />
<strong>Management</strong><br />
Ambient<br />
Intelligence<br />
Lighting Lighting<br />
Monitors Monitors and and<br />
Controls Controls<br />
Smart<br />
Home<br />
HVAC HVAC<br />
Sensors Sensors and and<br />
Controls Controls<br />
14<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
RFID Tag Characteristics<br />
● Frequencies<br />
• ~100kHz access control, animal ID<br />
• ~10 MHz smart cards<br />
• ~1000 MHz toll roads & item management<br />
• ~2.45 GHz item management<br />
● Power<br />
• Passive, semi-passive (battery assisted), active (battery powered)<br />
● Capabilities<br />
• Read-only, write-once (identity tags)<br />
• Read-write (multiple), user memory<br />
• Act as reader<br />
• Encryption, sensors, ...<br />
‣Above factors influence price, read range, life time, and kind of data<br />
cllected/stored<br />
15<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
EPC Tag Classes<br />
16<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
A Simple Sensor Network<br />
Challenge: end-to-end system solutions<br />
SU<br />
SU<br />
SU<br />
data aggregation<br />
& abstraction<br />
publish / subscribe<br />
SU<br />
SU<br />
SU<br />
Sytem Components:<br />
•Middleware<br />
•Servers<br />
•Custom designed units<br />
SU<br />
AU<br />
BS<br />
Server<br />
Server<br />
BS<br />
SU<br />
SU<br />
SU<br />
SU<br />
Systems aspects:<br />
•Sensor diagnostics<br />
•System diagnostics<br />
•Remote overview<br />
•Remote configuration<br />
•Remote SW updates<br />
•Sensor data access for<br />
business applications<br />
SU<br />
BS<br />
further data aggregation<br />
business applications<br />
BS<br />
AU<br />
actuator unit<br />
SU<br />
SU<br />
SU<br />
severe power consumption<br />
constraints if wireless<br />
SU<br />
AU<br />
SU<br />
BS<br />
sensor unit<br />
base station<br />
17<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
The Challenge . . .<br />
Industrial<br />
Sensors<br />
Internet<br />
Scalability problem<br />
due to I/O limitations<br />
Environmental<br />
Sensors<br />
Data, Events, Messages …<br />
Application Server<br />
Telematics Applications<br />
Data or Events Generated<br />
By Telco Equipments<br />
18<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Directional Shift in Network Traffic<br />
The massive deployment of smart, networked sensors will dramatically<br />
affect network volume and traffic patterns<br />
Client<br />
Server<br />
Client<br />
Server<br />
Client<br />
Server<br />
Sensors<br />
Server<br />
1:50<br />
1:1<br />
1:1<br />
100:1<br />
Web Server<br />
VoIP<br />
Conversation<br />
P2P File<br />
Sharing<br />
Sensor/RFID<br />
System<br />
● Traditionally, client requests are accommodated by caching<br />
● In future, computation will move to the edge of the network to aggregate,<br />
synthesize and filter data<br />
19<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
The Solution: Edge Server Software<br />
Server<br />
Delegating parts of the<br />
application to the edge<br />
Application<br />
“edgification”<br />
Clients<br />
Booster Box<br />
Application Code<br />
Modules<br />
Infrastructure to<br />
1. deploy part of the code at<br />
the edge of the network<br />
2. relay processed information<br />
to/from the server<br />
20<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Event Driven: Pervasive/Ubiquitous Computing<br />
● Smart Interconnected Devices<br />
● Multimodal User Interfaces<br />
● Sensor-based Applications<br />
21<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
A Short History of User Interfaces on Desktop<br />
From green screen to web portals<br />
Windowed Desktop<br />
Visual<br />
composition of<br />
several<br />
applications on a<br />
screen<br />
Portals<br />
Visual<br />
composition of<br />
multiple web<br />
sites into one<br />
view<br />
• Evolving Web Services<br />
Interfaces<br />
• Integration of multiple<br />
information sources and<br />
functions<br />
"Green Screen"<br />
Single<br />
screen per<br />
machine<br />
Single<br />
application<br />
at a time<br />
Browser and Web Site<br />
Integration of local &<br />
remote resources<br />
22<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
User Interaction Becomes Multimodal<br />
Smart Environments<br />
Voice & Pointing based interaction<br />
from a distance (e.g. JestureTek)<br />
Microphone/Camera arrays<br />
Person tracking<br />
PC/Desktop<br />
Head / hand as a mouse (with<br />
well-controlled background, glove)<br />
Gaze tracking<br />
Conversational interaction<br />
Ink character and word input<br />
3D articulated body gestures<br />
Multi-scale analysis of user position, orientation,<br />
facial features, gestures<br />
Steerable user-centric interfaces<br />
Multimodal interaction, person id<br />
Handwriting capture/reco without touchsceen<br />
3D gesture based manipulation without glove<br />
Monitoring of user focus of attention and user<br />
reaction<br />
3D head model capture for facial interface and<br />
virtual conferencing<br />
Natural, multimodal (voice, GUI, ink, visual)<br />
Mobile device<br />
Laser projected keyboards<br />
(e.g. VKB/Siemens)<br />
Video capture of face<br />
Conversational interaction<br />
Ink character input, messaging<br />
Increasingly seamless transition between<br />
PDA/mobile, PC, smart space<br />
3D head coding for transmission<br />
audio-visual speech recognition<br />
Voice+pen+gesture interaction<br />
23<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
InfoScope<br />
● Combines mobile computing with augmented reality<br />
● <strong>Information</strong> augmentation system based on recognition of<br />
objects in scene images<br />
● Provide relevant information to travelers, mobile<br />
professionals, wherever they are and when they need it<br />
• Automatic text translation<br />
• About buildings<br />
• About products<br />
• About events<br />
• …<br />
24<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
InfoScope – Automatic Sign/Text Translation<br />
Client GSM/GPRS Server<br />
Scene Text Detection<br />
Yongye Shaola Meat Supermarket<br />
Character<br />
Segmentation &<br />
Recognition<br />
Provide Fresh Meat Every Day<br />
Language<br />
Translation<br />
Text Augmentation<br />
25<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
InfoScope – <strong>Information</strong> Augmentation in the City<br />
Client<br />
GSM/GPRS<br />
Server<br />
Object Detection<br />
Building Recognition<br />
<strong>Information</strong> Retrieval<br />
<strong>Information</strong><br />
Augmentation<br />
26<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Page 6<br />
Examples of Time-Dependent Events<br />
Internet packet data – Handle huge volumes of intelligent messaging, voice, and video<br />
over IP networks<br />
RFID – Track location, count, and flow of parts in global supply chains<br />
Plant floor automation – Monitoring people and equipment in buildings and plants<br />
Real-time fraud detection – Monitor transaction authorization systems to identify<br />
fraudulent behavior and generate real-time alerts before the transaction is approved<br />
Surveillance – Monitor people in airports for suspicious activity and generate timely alerts<br />
Intelligent oil field – Generate early warnings to initiate oil well shutdowns by using<br />
signals and complex analysis from multiple sensors<br />
Financial Services – Exploit time-dependent opportunities in currency trading and index<br />
arbitrage<br />
Health – Detect early warnings of large-scale disease pandemics<br />
Space – Observe corona mass ejections to obtain early warning of disruptions in global<br />
weather patterns<br />
Autonomic – Autonomic monitoring and management of large-scale, virtualized systems<br />
27<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
RFID-Enabled Supply Chain<br />
RFID enables automated monitoring, routing, and inventory management<br />
of transportation vehicles, pallets, cases, items, etc., across supply chains<br />
Manufacturer<br />
Distribution<br />
Centers<br />
2005 WW Statistics:<br />
500 million pallets per year<br />
100 billion cases per year<br />
2 trillion items per year<br />
Retail Store<br />
28<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Surveillance<br />
Example<br />
Stamford, CT<br />
Newark Airport, NJ<br />
Sensor Analytics<br />
Sensor Analytics<br />
Person entering<br />
restricted tunnel<br />
Suspicious Activity Detection ~ 1 sec<br />
Pub/Sub<br />
Client<br />
Messaging<br />
Hub<br />
DBMS<br />
Pub/Sub<br />
Client<br />
Messaging<br />
Hub<br />
Abandoned bag<br />
on platform<br />
Event Anomaly<br />
Detection<br />
Event Anomaly<br />
Detection<br />
29<br />
Correlation of<br />
Suspicious<br />
Activity ~ 20 sec<br />
Distributed Event Miner<br />
Alert: Potentially Coordinated Attack<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Tracking customer shopping patterns<br />
How do customers navigate the store?<br />
● Use Digital Video to establish customer<br />
traffic patterns<br />
● Map statistically with any parameters<br />
• Time of day, day of week, by type of sale<br />
● Integrate with Dynamic Merchandizing<br />
• “If I show this content – people go there”<br />
● Measure customer traffic by product mix<br />
● Integrate with people count capabilities<br />
30<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Traffic Flow and Display Effectiveness using heat maps<br />
Plot all tracks:<br />
‣ Density<br />
‣ Flow<br />
31<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Streaming Data Example: Soccer<br />
Events<br />
Informix<br />
Real-time<br />
Loader<br />
(RTL/DSE)<br />
In-Memory<br />
Database<br />
Informix<br />
Dynamic<br />
Server<br />
SQL<br />
queries<br />
• Ball, players, and referees are RF tagged (26 transmitters)<br />
• Position and speed data are streamed to RTL/DSE (± 1.5 cm, 100K messages/s)<br />
• RTL/DSE stores time-stamped data in database at the rate of 7K-12K messages/sec<br />
• Prototyped for use in World Cup Soccer 2006<br />
Periodic<br />
writes to<br />
database<br />
DB2<br />
Timestamped<br />
data<br />
history<br />
32<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Data Being Captured at Increasing<br />
Spatiotemporal Resolution<br />
● People sensors: location<br />
(inferred from that of their<br />
devices), activities (inferred from<br />
calendar and desktop<br />
information), biometrics, etc.<br />
● Place sensors: room status<br />
(inferred from anonymous<br />
motion/sound detectors),<br />
presence (of people and things),<br />
congestion (inferred from<br />
pressure pads or camera<br />
images), etc.<br />
● Thing sensors: location (RFID),<br />
status (monitoring sensors such<br />
as telematics, desktop), etc.<br />
● Business sensors: context from<br />
databases (medical data, credit<br />
history, location history), context<br />
from processes<br />
33<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
General Framework for Time-Dependent Event Handling<br />
Financial<br />
Market Data<br />
RFID Data<br />
Rich Media<br />
An event-based<br />
engine routes,<br />
sequences, and<br />
filters event data in a<br />
time-dependent<br />
fashion<br />
Continuously<br />
Analyze Event<br />
Streams<br />
Event Analysis<br />
Event-based Engine<br />
Selectively<br />
Notify Systems<br />
& Personnel<br />
Event Notification<br />
Identify Patterns<br />
of Interest<br />
Event Action<br />
Surveillance<br />
TD<br />
DB<br />
DBMS<br />
DB<br />
Data<br />
Warehouse<br />
TD: Time-dependent<br />
34<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Reference Architecture for Event-Driven Middleware<br />
Realtime SOA<br />
Data<br />
Source 1<br />
DB Tradeoffs for Event-Handling<br />
1. Latency for Consistency<br />
2. Throughput for Persistence<br />
…<br />
Data<br />
Source N<br />
Intelligent, Timedependent,<br />
Pub/Sub, and<br />
Routing Hub<br />
DBMS<br />
Short-term<br />
storage<br />
ETL<br />
Data<br />
Warehouse<br />
Longterm<br />
storage<br />
ESB responsible for:<br />
App 1<br />
…<br />
App N<br />
• High-throughput data handling<br />
• Low-latency messaging and routing<br />
35<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Requirements for Event-Driven Applications<br />
Responsiveness<br />
Event<br />
Throughput<br />
(events/sec<br />
/server)<br />
Event Processing Language<br />
Richness Ease of Use<br />
Scalability<br />
Hard real-time<br />
(deterministic, us)<br />
100,000’s<br />
Inductive reasoning<br />
- Untrained patterns<br />
- Trained patterns<br />
Internet scale:<br />
100,000’s endpoints<br />
Increasing Capability<br />
Soft real-time<br />
(scheduled, ms)<br />
Near real-time<br />
(< sec)<br />
Transactional<br />
OLTP<br />
10,000’s<br />
1000’s<br />
100’s<br />
Integration with processes,<br />
workflows<br />
General multi-stream<br />
pattern specifications<br />
Tools for integrating<br />
content behavior models<br />
Tools for distributed<br />
deployment<br />
Tools for designing event<br />
flow<br />
Collaborating domains<br />
Managed ESB with event<br />
services<br />
Event server clusters<br />
Data Mining<br />
OLAP<br />
10’s<br />
Sequences, thresholds,<br />
groups<br />
Simple event pattern tool<br />
support<br />
Single server<br />
Data Warehouse<br />
1’s<br />
Message at a time<br />
filter/route<br />
36<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
Middleware for Time-Dependent Internet Traffic<br />
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Responsiveness<br />
Event<br />
Throughput<br />
(events/sec<br />
/server)<br />
Event Processing Language<br />
Richness Ease of Use<br />
Scalability<br />
Hard real-time<br />
(deterministic, us)<br />
100,000’s<br />
Inductive reasoning<br />
- Untrained patterns<br />
- Trained patterns<br />
Internet scale:<br />
100,000’s endpoints<br />
Increasing Capability<br />
Soft real-time<br />
(scheduled, ms)<br />
Near real-time<br />
(< sec)<br />
Transactional<br />
OLTP<br />
10,000’s<br />
1000’s<br />
100’s<br />
Internet Traffic<br />
Integration with processes,<br />
workflows<br />
General multi-stream<br />
pattern specifications<br />
Tools for integrating<br />
content behavior models<br />
Tools for distributed<br />
deployment<br />
Tools for designing event<br />
flow<br />
Collaborating domains<br />
Managed ESB with event<br />
services<br />
Event server clusters<br />
Data Mining<br />
OLAP<br />
10’s<br />
Sequences, thresholds,<br />
groups<br />
Simple event pattern tool<br />
support<br />
Single server<br />
Data Warehouse<br />
1’s<br />
Message at a time<br />
filter/route<br />
37<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Middleware for RFID Applications<br />
Responsiveness<br />
Event<br />
Throughput<br />
(events/sec<br />
/server)<br />
Event Processing Language<br />
Richness Ease of Use<br />
Scalability<br />
Hard real-time<br />
(deterministic, us)<br />
100,000’s<br />
Inductive reasoning<br />
- Untrained patterns<br />
- Trained patterns<br />
Internet scale:<br />
100,000’s endpoints<br />
Increasing Capability<br />
Soft real-time<br />
(scheduled, ms)<br />
Near real-time<br />
(< sec)<br />
Transactional<br />
OLTP<br />
10,000’s<br />
1000’s<br />
100’s<br />
Integration with processes,<br />
workflows<br />
General multi-stream<br />
pattern specifications<br />
Tools for integrating<br />
content behavior models<br />
RFID for retail, distribution,<br />
manufacturing<br />
Tools for distributed<br />
deployment<br />
Tools for designing event<br />
flow<br />
Collaborating domains<br />
Managed ESB with event<br />
services<br />
Event server clusters<br />
Data Mining<br />
OLAP<br />
10’s<br />
Sequences, thresholds,<br />
groups<br />
Simple event pattern tool<br />
support<br />
Single server<br />
Data Warehouse<br />
1’s<br />
Message at a time<br />
filter/route<br />
38<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Middleware for Surveillance Applications<br />
Responsiveness<br />
Event<br />
Throughput<br />
(events/sec<br />
/server)<br />
Event Processing Language<br />
Richness Ease of Use<br />
Scalability<br />
Hard real-time<br />
(deterministic, us)<br />
100,000’s<br />
Inductive reasoning<br />
- Untrained patterns<br />
- Trained patterns<br />
Internet scale:<br />
100,000’s endpoints<br />
Increasing Capability<br />
Soft real-time<br />
(scheduled, ms)<br />
Near real-time<br />
(< sec)<br />
Transactional<br />
OLTP<br />
10,000’s<br />
1000’s<br />
100’s<br />
Integration with processes,<br />
workflows<br />
General multi-stream<br />
pattern specifications<br />
Tools for integrating<br />
content behavior models<br />
Surveillance Markets<br />
Tools for distributed<br />
deployment<br />
Tools for designing event<br />
flow<br />
Collaborating domains<br />
Managed ESB with event<br />
services<br />
Event server clusters<br />
Data Mining<br />
OLAP<br />
10’s<br />
Sequences, thresholds,<br />
groups<br />
Simple event pattern tool<br />
support<br />
Single server<br />
Data Warehouse<br />
1’s<br />
Message at a time<br />
filter/route<br />
39<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Middleware for Financial Services<br />
Responsiveness<br />
Event<br />
Throughput<br />
(events/sec<br />
/server)<br />
Event Processing Language<br />
Richness Ease of Use<br />
Scalability<br />
Hard real-time<br />
(deterministic, us)<br />
100,000’s<br />
Inductive reasoning<br />
- Untrained patterns<br />
- Trained patterns<br />
Internet scale:<br />
100,000’s endpoints<br />
Increasing Capability<br />
Soft real-time<br />
(scheduled, ms)<br />
Near real-time<br />
(< sec)<br />
Transactional<br />
OLTP<br />
10,000’s<br />
1000’s<br />
100’s<br />
Integration with processes,<br />
workflows<br />
General multi-stream<br />
pattern specifications<br />
Tools for integrating<br />
content behavior models<br />
Financial market information and<br />
program trading<br />
Tools for distributed<br />
deployment<br />
Tools for designing event<br />
flow<br />
Collaborating domains<br />
Managed ESB with event<br />
services<br />
Event server clusters<br />
Data Mining<br />
OLAP<br />
10’s<br />
Sequences, thresholds,<br />
groups<br />
Simple event pattern tool<br />
support<br />
Single server<br />
Data Warehouse<br />
1’s<br />
Message at a time<br />
filter/route<br />
40<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Industry Implications<br />
● The real world is being captured (through sensors) and modeled at<br />
increasing spatiotemporal resolution<br />
● On demand businesses will need to evolve to deal with (monitor,<br />
process, store, and respond) the increasingly event-driven world<br />
● New middleware, programming models, and tools will emerge to<br />
deal with the increasing volume and time-dependent requirements of<br />
event-driven data<br />
● SOA will be augmented with event orientation and processing,<br />
resulting in a hybrid between a web service and an event<br />
programming model<br />
41<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Towards 3-D Internet<br />
Level of Interaction<br />
Connected<br />
Inside<br />
Individual<br />
42<br />
Time<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Early Virtual Worlds Business Applications<br />
Commerce<br />
Collaboration<br />
and Events<br />
Education<br />
and Training<br />
Other<br />
Emerging<br />
Applications<br />
43<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Building an On Demand Environment<br />
Evolving priorities<br />
44<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
What about today‘s IT Challenges<br />
IDC Directions 2007,<br />
CIO Strategies to Build the Next Generation Data Center,<br />
Doc #DR2007_5VT, Feb 2007<br />
Spending<br />
(US$B)<br />
$300<br />
$250<br />
$200<br />
$150<br />
$100<br />
$50<br />
Power and cooling costs<br />
Server mgmt. and admin. costs<br />
New server spending<br />
65<br />
60<br />
55<br />
50<br />
45<br />
40<br />
35<br />
30<br />
25<br />
20<br />
15<br />
10<br />
5<br />
Millions<br />
Logical<br />
server installed<br />
base:<br />
Physical<br />
server installed<br />
base:<br />
$0<br />
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010<br />
0<br />
45<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
What about today‘s IT Challenges<br />
● <strong>Management</strong> costs grew 7X as fast as IT spend over last decade<br />
● Power and Cooling Costs soon to equal Server Spending<br />
● 15 years ago 75% of IT budgets were spent on new hardware and<br />
software; today 75% is spent on just running the infrastructure<br />
● Complexity and administrative cost are growing faster than<br />
hardware cost<br />
● Growing revenue while containing cost remains #1 concern of<br />
management<br />
● Businesses cannot address the need for integration of people, etc<br />
without first addressing the underlying infrastructure<br />
46<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Event Driven IT<br />
Requires an Event Driven Operating Environment<br />
● Open<br />
● Virtualization<br />
● Autonomic<br />
● Green Technology<br />
47<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Evolution to an Open Standard<br />
Need<br />
Initiator Core group Standards body<br />
Open<br />
Customer need for<br />
technical solution to<br />
known problem<br />
Lack of industry<br />
accepted technical<br />
solution<br />
May be competing<br />
technical approaches<br />
or single proprietary<br />
solution<br />
Lack of<br />
interoperability<br />
A company, individual<br />
or group of<br />
companies or<br />
individuals agree to<br />
address issue<br />
Resources devoted to<br />
developing best<br />
technical solution,<br />
often in collaborative<br />
fashion<br />
Interested parties publish<br />
specifications<br />
Specifications publicly<br />
available sufficient to<br />
enable implementation,<br />
interoperability<br />
Can be implemented<br />
with little or no<br />
restrictions<br />
Developers may create<br />
reference or commercial<br />
implementation<br />
Developers declare<br />
intent to have solution<br />
accepted as standard<br />
Standards body reviews<br />
technical solution, adopts<br />
as standard<br />
Specifications publicly<br />
available are sufficient to<br />
enable implementation,<br />
interoperability<br />
Can be implemented with<br />
little or no restrictions<br />
Standards body open to<br />
broad participation, open<br />
decision making process<br />
Standard implemented in<br />
competing IT products by<br />
multiple vendors.<br />
48<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Spectrum of open standards<br />
Global<br />
SMB<br />
Computer<br />
Services<br />
Insurance<br />
Financial<br />
Markets<br />
Accounting<br />
Banking<br />
Finance<br />
Open OS<br />
Industry-Specific<br />
Linux<br />
Business<br />
Function<br />
Open Networks<br />
IP<br />
HTML<br />
XHTML<br />
Energy &<br />
Utilities<br />
Human<br />
Resources<br />
Open<br />
Publishing<br />
Chemicals &<br />
Petroleum<br />
Industrial<br />
Products<br />
Marketing<br />
Aerospace<br />
& Defense<br />
Automotive<br />
Telecommunications<br />
Pervasive<br />
& Wireless<br />
Media &<br />
Entertainment<br />
Education<br />
Technology<br />
<strong>Information</strong><br />
<strong>Management</strong><br />
Government<br />
US Federal<br />
Open<br />
Interchange<br />
Grid<br />
Procurement<br />
Life<br />
Sciences<br />
Web<br />
Services<br />
STANDARDS<br />
J2EE<br />
Open Programming<br />
Standards<br />
Standards<br />
XML<br />
Autonomic<br />
Open Data<br />
Customer<br />
Support<br />
Standard<br />
s<br />
Relationship<br />
<strong>Management</strong><br />
Travel &<br />
Transport<br />
Trading Partner<br />
Collaboration<br />
Product<br />
Life Cycle<br />
Wholesale<br />
Electronics<br />
Consumer<br />
Products<br />
Retail<br />
49<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
“Event Driven” IT Standards Are Emerging<br />
Existing and evolving standards<br />
• Real-time Specification for Java (JSR 1), Distributed Real-Time Specification (JSR 50)<br />
• Web Services Notification (WS-Notification); Web Services Eventing (WS-Eventing)<br />
– Standard for describing event distribution mechanism (like pub/sub), WS-Notification is broader and<br />
includes decoupled (brokered) operation<br />
• OMG Data Distribution Service (DDS):<br />
– Standard interface for Pub/Sub communications for real-time systems<br />
– Has appeared in requirements from many federal RFPs and RFQs<br />
• IEEE 1516 (formerly, High Level Architecture – HLA)<br />
– Standard for communications between computer simulations across disparate computing platforms<br />
– Being explored for distributed simulation in games, life sciences, and communication networks<br />
Gaps in standards<br />
• New event programming languages emerging in open source community<br />
• Web Services and SOA extensions to handle event-driven applications<br />
• Streaming data standards for analytics and interchange (e.g., “RSS for events”)<br />
50<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Virtualization<br />
“Virtualization is the process of<br />
presenting computing resources in<br />
ways that users and applications can<br />
easily get value out of them, rather<br />
than presenting them in a way<br />
dictated by their implementation,<br />
geographic location, or physical<br />
packaging. In other words, it provides<br />
a logical rather than physical view of<br />
data, computing power, storage<br />
capacity, and other resources.” user<br />
Jonathan Eunice, Illuminata Inc.<br />
user<br />
user<br />
manufacturing<br />
Resource Pool<br />
data center<br />
design<br />
user<br />
partners<br />
51<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Virtualization<br />
Virtualization can help improve the Utilization of<br />
IT Resources, <strong>Information</strong> and Human Assets<br />
Pools of virtual resources<br />
Servers Storage<br />
Distributed Network<br />
Partitioning<br />
SAN volumes<br />
GRID<br />
VLANs<br />
Clustering<br />
Workload<br />
<strong>Management</strong><br />
TotalStorage<br />
Virtualization<br />
TotalStorage<br />
Virtualization<br />
expanded capabilities<br />
Server allocation for<br />
Web application<br />
servers<br />
ISV Grid middleware<br />
HiperSockets /<br />
Virtual ethernet<br />
Differentiated<br />
services<br />
Vendor alliances<br />
52<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Virtualization Layers<br />
Applications<br />
Virtual Server<br />
Hosting<br />
Heterogeneous<br />
Workload<br />
<strong>Management</strong><br />
End-to-End<br />
Automation<br />
Middleware<br />
Shared<br />
Services<br />
Security<br />
<strong>Management</strong><br />
End-to-End<br />
Systems<br />
<strong>Management</strong><br />
Disaster<br />
Recovery<br />
Heterogeneous<br />
Clustering<br />
OS OS OS<br />
Partition<br />
Hypervisor<br />
Hardware<br />
Dynamic LPAR<br />
CIM<br />
Lightpath I/O<br />
Software Rejuvenation<br />
Virtual LANs<br />
Wireless Support<br />
53<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Server Virtualization: Dynamic LPAR<br />
200<br />
200<br />
OS OS OS<br />
150<br />
100<br />
Whitespace<br />
System B<br />
Whitespace<br />
System A<br />
150<br />
100<br />
Whitespace<br />
System B<br />
System A<br />
Partition<br />
Hypervisor<br />
50<br />
0<br />
50<br />
0<br />
Hardware<br />
08.00<br />
11.00<br />
14.00<br />
17.00<br />
20.00<br />
23.00<br />
02.00<br />
05.00<br />
08.00<br />
11.00<br />
14.00<br />
17.00<br />
20.00<br />
23.00<br />
02.00<br />
05.00<br />
OS1 OS2 OS3<br />
+WLM<br />
Processors<br />
P P P P P P P P P P P P P P P P P P P P P P P P<br />
Memory<br />
Memory<br />
Memory<br />
Memory<br />
Memory<br />
Memory<br />
Channels<br />
I/O<br />
I/O<br />
I/O<br />
54<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Spectrum of Server Virtualization<br />
Resource virtualization and application virtualization are complementary and can co-exist<br />
App<br />
App<br />
App<br />
App<br />
App<br />
App<br />
LPARS,<br />
PPARS<br />
Resource<br />
Partitions<br />
Runtime<br />
Environment<br />
OS 1<br />
Hypervisor<br />
Hardware<br />
Server<br />
Virtualization<br />
Runtime<br />
Environment<br />
OS 2<br />
PHYP,<br />
Xen,<br />
VMware<br />
Runtime<br />
Environment<br />
Mediator<br />
OS<br />
Hardware<br />
Runtime<br />
Environment<br />
Application Environment<br />
Virtualization<br />
PDS, Softricity,<br />
Meiosys,<br />
Veritas Appscale<br />
Java Virtual<br />
Machines<br />
CICS Regions<br />
Deep<br />
Complete isolation between OSs<br />
Run different OSs<br />
Smaller trusted computing base<br />
Less<br />
Only HW resources are shared<br />
Larger container<br />
More context switching overhead<br />
Isolation<br />
Sharing<br />
Isolation only between Apps<br />
Running 1 version of OS<br />
Trust depends on entire OS<br />
Shallow<br />
More<br />
Apps share common OS services<br />
Smaller container<br />
Less context switching overhead<br />
55<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Server and SW Virtualization Is Becoming Pervasive<br />
● Hypervisors will virtualize the underlying HW platform<br />
• IBM LPARs, EMC VMware, Xen, HP VM hypervisor (12/2005), MS Virtual Server<br />
• Future HW support: Intel (VT-x, Oct. 2005; VT-i, 2006) and AMD (Pacifica, 1H06)<br />
• Hypervisors will become integrated as a BIOS/firmware function in 1-2 years<br />
● Hypervisors will become bundled with operating Systems<br />
• MS Virtual Partitions, Sun Solaris containers, HP-UX Secure Resource Partitions<br />
● Self-virtualizing I/O adapters will become available<br />
• Fibre Channel N_Port ID Virtualization (NPIV) is a first step<br />
• Standard PCI-E adapters will become self-virtualizing in 2-3 years<br />
● Application containers will gain acceptance as an efficient<br />
method for consolidating many applications on the same OS,<br />
while providing isolation<br />
• AIX Corrals leveraging Meiosys, PDS (on Linux & Windows), Veritas<br />
56<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Next Generation Internet: GRID Computing<br />
● Shared resources accessed via the Internet or private intranets using open<br />
protocols<br />
● Open Source standards coordinated by Globus and the Global Grid Forum<br />
● Technical foundation for eSourcing, or ‘utility’ computing<br />
● Grid Computing: Delivering Software, Server and Data Storage Resources<br />
like Power from a Socket<br />
57<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #1: IBM Download GRID<br />
58<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #1: IBM Download GRID<br />
Download Clients<br />
● Java Application<br />
• Interfaces directly with the<br />
download service<br />
● Java Applet<br />
• Interfaces with the the download<br />
service throuh a web application<br />
• The web applications handles<br />
web services calls<br />
• Compatible with every browser<br />
running Java<br />
59<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #2: World Community Grid<br />
60<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #2: World Community Grid<br />
www.worldcommunitygrid.org<br />
IBM Philanthropic Initiative<br />
● Mission is to create the largest public computing grid of PCs benefiting<br />
humanity.<br />
How It Works<br />
● Volunteers download a small, free agent at www.worldcommunitygrid.org. When<br />
idle, PCs request data from World Community Grid’s server, perform<br />
computations, send the results back to the server and prompt it for new work.<br />
Human Proteome Folding Project<br />
● First project will provide scientists with data that predicts the shape of human<br />
proteins. With an understanding of how each protein affects human health,<br />
scientists can develop new cures for human diseases.<br />
Advisory Board<br />
● International group of experts specializing in health sciences, technology, and<br />
philanthropy.<br />
Volunteer Base<br />
● Individuals, companies, associations, universities, foundations<br />
61<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #2: World Community Grid<br />
62<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Case Study #2: World Community Grid<br />
63<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
GRID Implementierungen<br />
Inter-Grids<br />
Inter-Grids<br />
Extra-Grids<br />
Extra-Grids<br />
Intra-Grids<br />
Intra-Grids<br />
VPN<br />
64<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Virtualization Solutions - Stages<br />
Orchestrate Infrastructure:<br />
Sense and respond to changes<br />
based on business policies<br />
Secure Cross Enterprises:<br />
Enable internal and external<br />
integration and resources.<br />
Automate Workflows:<br />
Tasks like change/<br />
configuration,<br />
ITIL processes<br />
Virtualize Outside The Enterprise:<br />
Suppliers, partners, customers<br />
and external resources<br />
(opportunity: Deep Computing Capacity on<br />
demand centers or ASP solutions)<br />
Virtualize The Enterprise:<br />
Enterprise wide Grids and Global<br />
Fabrics<br />
(opportunity: Clash Analysis solutions on grid;<br />
visualization solutions)<br />
Virtualize Unlike Resources:<br />
Heterogeneous systems, application<br />
based Grids and networks<br />
(opportunity: EWLM for managing heterogeneous<br />
environment; IDI for MySAP)<br />
Virtualize Like Resources:<br />
Homogenous systems, storage and networks<br />
(opportunity: consolidate similar servers onto a Blades or other<br />
series machines; Storage virtualization)<br />
Updated IT Governance and <strong>Management</strong> Processes<br />
65<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Built on Standards<br />
Standards and Open Source<br />
Blade.org<br />
66<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Virtualization Platform<br />
Workload Virtualization<br />
Provisioning Orchestration<br />
Resource Pooling Scheduling<br />
<strong>Information</strong> Virtualization<br />
Federation Cleansing<br />
Transformation Global File System<br />
Standards and Open Source<br />
Virtual Access and <strong>Management</strong><br />
Workload <strong>Management</strong> Usage and Accounting Resource <strong>Management</strong> Discovery and Mapping<br />
Resource Virtualizers<br />
Hypervisors Containers Block Virtualization VIO VLAN<br />
Servers<br />
Storage<br />
Networks<br />
67<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Value of a Virtualized Infrastructure<br />
• Improve TCO<br />
Decrease management cost<br />
Increase asset utilization<br />
Decrease Power and Cooling<br />
Link infrastructure performance to business goals<br />
• Access Through Shared Infrastructure<br />
Leverage common tools across many systems<br />
Improve business resilience and security<br />
Establish Service Oriented Infrastructure Foundation<br />
• Increase Flexibility<br />
Create pools of system resources<br />
Maintain freedom of choice with open standards<br />
Simplify by masking complexity<br />
68<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Autonomic Computing<br />
IBM Development Initiative for Self-Managing Systems<br />
Improved Availability and Security<br />
Lower Costs for Maintaining and<br />
Deploying Systems<br />
Self-Configuring<br />
Self-Healing<br />
Self-Protecting<br />
Self-Optimizing<br />
Self-managing Systems reduce Downtime,<br />
Staffing and other administrative Expenses<br />
Today:<br />
Cost of skills:<br />
For every $1 U.S. spent on server HW, $10 U.S.<br />
will be spent on people to manage the HW<br />
Cost of downtime:<br />
$10,000 U.S. per minute<br />
for e-commerce<br />
69<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Evolution to Autonomic Computing<br />
Basic<br />
Level 1<br />
Rely on reports,<br />
product and<br />
manual actions<br />
to manage IT<br />
components<br />
Managed<br />
Level 2<br />
<strong>Management</strong><br />
software in place<br />
to provide<br />
facilitation and<br />
automation of IT<br />
tasks<br />
Benefits<br />
Greater system<br />
awareness<br />
Improved<br />
productivity<br />
Predictive<br />
Level 3<br />
Individual<br />
components and<br />
systems<br />
management tools<br />
able to analyze<br />
changes and<br />
recommend<br />
actions<br />
Benefits<br />
Reduced<br />
dependency on<br />
deep skills<br />
Faster/better<br />
decision making<br />
Adaptive<br />
Level 4<br />
IT components<br />
collectively able<br />
to monitor,<br />
analyze and take<br />
action with<br />
minimal human<br />
intervention<br />
Benefits<br />
Balanced<br />
human/system<br />
interaction<br />
IT agility and<br />
resiliency<br />
Autonomic<br />
Level 5<br />
IT components<br />
collectively and<br />
automatically<br />
managed by<br />
business rules<br />
and policies<br />
Benefits<br />
Business policy<br />
drives IT<br />
management<br />
Business agility<br />
and resiliency<br />
Manual<br />
Autonomic<br />
70<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Solution Positioning<br />
Software Policy<br />
<strong>Management</strong><br />
Patch<br />
<strong>Management</strong><br />
Data Center Automation<br />
LPAR<br />
VMware<br />
Physical<br />
Servers<br />
UNIQUE REQUIREMENTS<br />
Highest Value from Automation Solutions<br />
• Execute repetitive, error-free best<br />
practices<br />
Interfaces to Data Center devices<br />
• Server provisioning<br />
• Network provisioning<br />
• Storage provisioning<br />
• Security provisioning<br />
COMMON REQUIREMENTS<br />
Software<br />
Deployment and<br />
Packaging<br />
Software Distribution<br />
and <strong>Management</strong><br />
(Branch Office – Departmental)<br />
Servers<br />
Clients<br />
UNIQUE REQUIREMENTS<br />
Highest Value from <strong>Management</strong><br />
Solutions<br />
Interfaces to remote branch devices<br />
Network Considerations<br />
Scalability Requirements<br />
• Thousands of autonomous remote<br />
sites<br />
Checkpoint Restart at Job/Network levels<br />
Asset<br />
Inventory<br />
Bare-Metal<br />
Installation<br />
Software Distribution<br />
and <strong>Management</strong><br />
(Pervasive – Mobile Client)<br />
Clients - Pervasive<br />
UNIQUE REQUIREMENTS<br />
Interfaces to What’s Remote<br />
• Windows 2000, Windows XP, Windows<br />
CE, Palm OS, phones<br />
Significantly higher scalability<br />
requirements<br />
• Tens of thousands of “intermittently<br />
connected” clients<br />
Server control point at central site<br />
71<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
Pervasive Virtualization drives<br />
IT <strong>Management</strong> Simplification<br />
● Redistributing workloads to optimize performance/QoS,<br />
improved resource utilization<br />
● Security and isolation through partitioning<br />
● Provisioning new systems using pre-built images (freezedried<br />
stacks)<br />
● Concurrently supporting incompatible environments<br />
● Robust retention compliance through archive of entire system<br />
image (data, application, middleware, OS, etc.)<br />
72<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM
<strong>BWI</strong> – <strong>ETH</strong> Zürich<br />
73<br />
<strong>Information</strong> <strong>Management</strong> | Zürich, 18. Juni 2007<br />
© 2007 Francis Kuhlen, IBM