Storage Management Interface – Specification (SMI- S) - OpenMPE

openmpe.com

Storage Management Interface – Specification (SMI- S) - OpenMPE

Storage

Management

Interface

Specification (SMI-

S)

Gene Chesser

Microsoft IOP Program Manager

Hewlett-Packard

© 2004 Hewlett-Packard Development Company, L.P.

The information contained herein is subject to change without notice


The Storage Networking Industry

Association

• The SNIA Mission

− To ensure that storage networks become efficient, complete, and trusted

solutions

• The SNIA Vision

− Accelerate new technology development and evolution of standards

− Define smart, collaborative, rigorous methods

− Collaborate with the IT community to address relevant business issues

− Deliver materials, programs and services

− Educate and evangelize acceptance among vendors and IT

professionals

2


3

SNIA Core

Security

Security

OSD

OSD

Policy

Policy

NAS

NAS

Discovery

Discovery

Storage

Storage

Media

Media

Library

Library

File

File

Systems

Systems

DRM

DRM

Backup

Backup

Fibre

Fibre

Channel

Channel

Web

Web

Development

Development

Marketing

Marketing

Education

Education

Finance

Finance

Inter

Interoperability

operability

Membership

Membership

Development

Development

Conference

Conference

Development

Development

Strategic

Strategic

Planning

Planning

Technology

Technology

Council

Council

11 members

11 members


4

IP Storage

IP Storage

Forum

Forum

Supported

Supported

Solutions

Solutions

Forum

Forum

SNIA

SNIA

Europe

Europe

SNIA

SNIA

Japan

Japan

Storage

Storage

Security

Security

Industry

Industry

Forum

Forum

Storage

Storage

Management

Management

Initiative

Initiative

SNIA

SNIA

India

India

SNIA

SNIA

Australia

Australia

New

New-Zealand

Zealand

SNIA

SNIA

South

South-Asia

Asia

SNIA

SNIA

International

International

Security

Security

OSD

OSD

Policy

Policy

NAS

NAS

Discovery

Discovery

Storage

Storage

Media

Media

Library

Library

File

File

Systems

Systems

DRM

DRM

Backup

Backup

Fibre

Fibre

Channel

Channel

Web

Web

Development

Development

Marketing

Marketing

Education

Education

Finance

Finance

Inter

Interoperability

operability

Membership

Membership

Development

Development

Conference

Conference

Development

Development

Strategic

Strategic

Planning

Planning

Technology

Technology

Council

Council

11 members

11 members

End

End-User

User

Committee

Committee

Data

Data

Management

Management

Forum

Forum


5

STANDARDS MANAGEMENT SECURITY AVAILABILITY

SNIA Technical Activities

Goals

IT Concerns

SNIA

Technical

Activities

Usage

Models

Access

Models…

Changing!

Block I/O NAS Object

Infrastructure

Complexity…

Increasing!

PERFORMANCE INTEROPERABILITY DATA PROTECTION

SCSI

2001 2002 2003 2004 2005

Required

Storage

Capacity…

Increasing

iSCSI

Fibre Channel

FC Tunneling

Over LAN/WAN

InfiniBand

SAS, S-ATA

OSD


The SNIA Storage Management

Initiative (SMI)

• The Storage Network Industry Association

(SNIA) is creating and driving to broad

adoption a highly functional and

interoperable management interface for

multi-vendor storage networking products.

• The SMI is:

• Enabling the integration of larger and more diverse

multi-vendor storage networks.

• Creating a new class of more powerful management

applications.

• In support of these goals the SNIA is now working

toward the strategic imperative of: “All storage

managed by the SMI Interface in 2005”.

6


CIM

Common

Information Model

SNIA

Technical

Workgroup

definitions

Blue fin

Specification

SNMP

Simple Network

Management

Protocol

7


Storage Management

Environment Today

Management Application

Analysis & UI

Database

Acquisition & Control

• Difficult to Manage

− Different data standards

(SNMP, DMI, SES, …)

− Different terminology

− Proprietary MIBs

− Missing data (topologies

and dependencies)

Proprietary API

SNMP

RPC

SCSI

Proxy

8


Management App Dilemma

Management Application

Discovery Services

9

Integration Infrastructure

Security Services

RPC

Command

Line

Telnet

CORBA

C++Library

C Library

Java Library

SCSI Mode

XML

DTD

SNMP

FC-GS

TCP/IP

Socket

Tape Library Switch Array Many Other

Vendor

Unique

Object

Models


Management App Accelerator

Management Application

Auto-generation of

application and

infrastructure

constructs

Integration Infrastructure

Object Model Mapping – Vendor Unique Features

SMIS

Interface

Platform Independent

Distributed

Automated Discovery

Security

Locking

Object Oriented

CIM/WBEM

Technology

Tape Library Switch Array Many Other

MOF MOF MOF MOF

Standard

Object

Model per

Device

Vendor

Unique

Function

10


Device Vendor Dilemma

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor

Mgmt. App. Vendor

MIB -1 MIB -2 MIB -N

SDK- UNIX 1

(Java, C++, C)

SDK- O.S. -1

(Java, C++, C)

SDK- UNIX N

(Java, C++, C)

SDK- O.S.-N

(Java, C++, C)

SNMP

Transport

(UDDP)

SNMP Agent

Device Vendor

Vendor

Proprietary

Distributed

Transport

Tape Library Product 1

Tape Library Product 2

Tape Library Product N

11


Device Vendor Accelerator

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

Mgmt. App. Vendor

SMIS

Interface

MOF

•Platform Independent

•Distributed

•Object Oriented

CIM/WBEM

Technology

Vendor Unique

Functionality

SMIS Agent or Object Manager

Device Vendor

Tape Library Product 1

Tape Library Product 2

Tape Library Product N

12


The Larger Problem

Systems Management “Stovepipes”

Common

Model

Needed

13

Network Management

Applications Management

Processor Complex Mgmt.

Storage Management

Database Management


SNIA Shared Storage Model

•Application

Application

•File/record layer

File/record layer

Database

Database

(dbms)

File system

(fs)

File system

•Block aggregation

Host

Network

Device

Storage devices

Storage domain

Host

Block

aggregation

Network

Storage devices

Device

Services

14


The Data Path

Storage domain

Database

(dbms)

Application

File/record layer

Host

Network

Block

aggregation

Storage devices (disks, …)

Block layer

File system

(FS)

Device

Native Control Functions

Real time requirement

Functional API/Protocol

• Used to transfer Data

• open/close/read/write

• Already Standardized

•POSIX

•SCSI

•etc.

Administrative API/Protocol

• Used for metadata control

• Configuration

• Monitoring Status

• Control Operations

• Few Standards

• SNMP MIBs rare

• CIM/WBEM better

15


The Control Path

Application

CIM

Model

for

Agents

Storage domain

Database

(dbms)

File/record layer

Host

Network

Block

aggregation

Storage devices (disks, …)

Block layer

File system

(FS)

Device

Agent

Agent

Agent

Agent

Agent

Agent

Need to Instrument the Native Control

Functions with SMI Management Agents

CIM-XML

Protocol for

Communication

with Managers

16


Architectural Vision

of Standardized Management

Graphical User Interface

Management Frameworks

Users

Management Tools

Storage Resource Management

Performance

Capacity Planning

Resource Allocation

Container Management

Volume Management

Media Management

Other…

Data Management

File System

Database Manager

Backup & HSM

Storage Management Interface Specification

Physical Components

Removable Media

Tape Drive

Disk Drive

Robot

Enclosure

Host Bus Adapter

Switch

Managed Objects

Logical Components

Volume

Clone

Snapshot

Media Set

Zone

Other…

17


Management Model

Requirements

Multi-Level Manageability Requirements

Business Information Management

File System

Management

Mailbox

Management

Database

Management

Custom Apps

Management

Standard Protocol

Storage Operations Management

New Device

Installation

Consolidation

Management

Topology

Management

Discovery

Mgmt

Capacity

Management

Standard Protocol

Storage System Management

Path

Management

Standard Protocol

Storage Device Management

Configuration

Mgmt

Snapshot Mgmt Rem Repl Mgmt

Performance

Management

Asset Chargeback

Management Management

Capacity

Management

Statistics

Mgmt

Health Mgmt

Ticketing

Workflow

Server HBA Switch Interconnect

Policy

Management

Event

Mgmt

SRM

Performance

Management

Status Mgmt

Tape

Recoverability

Management

Configuration

Management

Event

Correlation

LUN

Map/Mask

Zone Mgmt

Storage Array

Generic

Platform

Requirements

Scalability

Flexibility

Extensibility

Security

Usability

Traceability

Manageability of

Heterogeneous

Infrastructure

Integrated with

External Systems

18


Storage Management Model

Business Information Management

File System

Management

New Device

Installation

Consolidation

Management

Topology

Management

Discovery

Mgmt

Mailbox

Management

Database

Management

Custom Apps

Management

Storage System Management

Path

Management

Capacity

Management

Standard Protocol

Storage Operations Management

Capacity

Management

Asset

Management

Standard Protocol

Performance

Management

Standard Protocol

Storage Device Management

Configuration

Mgmt

Snapshot Mgmt Rem Repl Mgmt

Performance

Management

Chargeback

Management

Statistics

Mgmt

Health Mgmt

Server HBA Switch Interconnect

Policy

Management

Ticketing

Workflow

Event

Mgmt

SRM

Status Mgmt

Tape

CIM-XML/Vendor API

Heterogeneous Storage Devices

Recoverability

Management

Configuration

Management

Event

Correlation

LUN

Map/Mask

Zone Mgmt

Storage Array

Management

Framework

Infrastructure

Ext Mgmt

Interface

Client

Service

Data

Service

Schema

Service

Logging

Service

Scheduling

Service

Event

Service

Policy

Service

Security

Service

Provider

Creation

Service

19


Common Information Model

(CIM)

20


Layers (Client)

Object Model

Discovery and Mapping

Lock Manager

Interface

Client

Application

Policy

Constituent

Discovery

Service Interface

(SLP)

Intrinsic Methods

(Get/Set, Enumerate Objects,

/Instances)

Extrinsic Methods

(Create ZoneSet,

Modify LUNmask)

Security

Services

Message Marshalling/UnMarshalling

Communications Transport

Client

Wire Protocol

Server

21


Layers (Server)

Client

Wire Protocol

Communications Transport

Server

Constituent

Discovery

Service (SLP)

Message Marshalling/UnMarshalling

Message Dispatching

Security

Services

Lock Manager

Functions

CIM Agent

Functions

Dedicated

Agent

CIMOM

Device

Device

w/ Provider

22


Profile Content

Profile Element

Goal

Description

A textual introduction to the SAN entity being profiled. It provides a high-level

foundation for the more detailed descriptions to follow.

Schema Diagram

A diagram of the subset of the PDP Object Model that is most concerned with the

SAN entity being described.

Instance Diagrams

One or more instance diagrams to highlight common implementations that employ

this section of the Object Model.

Client Considerations

This section summarizes the implementation concerns that will be encountered by

products and services that rely on the SAN entity being described.

Agent Considerations

This section summarized the implementation concerns that must be accounted for

by agent implementations (either embedded or proxy) that provide information from

one or more of the SAN entities to PDP clients.

Indications

This section details any indications that have been defined in conjunction with this

SAN entity.

Classes

This section provides a list of the classes upon which this class of SAN entity relies,

information on whether the class is required for the particular profile, and profilespecific

notes. Each class reference includes a cross-reference to the detailed

definition of the class.

23


Lock

Manager

SA 0…n

Directory

Server

Directory

Agent 0…n

Client

User

Agent 0…n

SLP

TCP/IP

CIMxml

CIM operations over http

TCP/IP

SA

Agent

Device or

Subsystem

0…n

Proxy Model

Service Agent (SA)

Agent

0…n

Embedded

Model

SA

Object Manager

Provider

Device or

Subsystem

1

1

Proprietary

Proprietary

1 n

Device or

Device

Subsystem

Proxy

Model

0…n

24


Existing Vendor

Instrumentation

Device Management

Web Pages

Device

Web Server

Device Management Web Pages

• Allows configuration of the device

• Doesn’t scale for monitoring

• Doesn’t allow interoperability

SNMP

Agent

Embedded SNMP Agent

• Used for discovery of the device

• Can send traps, provide status for

monitoring

• Typically doesn’t allow

configuration and control

Enterprise

Management

Frameworks

25


Legacy/Installed Base Proxy

SMI

Proxy Agent

CIM-XML

SMI Proxy Agent

• Works with legacy, installed base

• Can use existing proprietary protocols

• Upgrades device to new standard

• Can run on an attached host, or plug

into existing infrastructure

Device

Web Server

SNMP

Agent

26


Embedded Instrumentation

Device Management

Web Pages

Device

Web Server

CIM-XML

SMI Agent Instrumentation

• Used for discovery of the device

• Can send events, provide status for

monitoring

• Allows interoperable configuration and

control

• Integrates with management frameworks

• Supports locking, transactions for

consistency

Instrumentation

27


SMI Builds off of Web-Based

Enterprise Management

Data Description

CIM


Transport Encoding

HTTP

Access

28


Storage Management Initiative

Open

Standard

CIM-SAN

Demonstrations

Conformance

Testing

Education

Disk Resource

• Array Configuration

• Copy Services

• Resource Mapping

Fabric

• Discovery

• Zoning Control

• Topology Mgt

• Multi-pathing

• HBA Management

• Secured data path

Indications

CIM

XML

HTTP

WBEM

…AND MORE !

Storage

Management

Forum

NAS

• Discovery

• Configuration

• Resource Mapping

Recipes

Tape Libraries

• Library Configuration

• Resource Mapping

• Media Management

iSCSI

Technical

Steering

Group

Interoperability

Testing

29


All Storage Managed by the SM-S

“ All new storage networking

products containing SMI-S Object

models that GA after 2005 from

SNIA member companies will use

the SMI-S interface for

management”

SNIA Board of Directors - 2002

Jordan Doe

CIO, ABC Company


Strategic Questions

• How does the SNIA:

− successfully augment/complete the Bluefin SAN

management specification?

− drive vendor implementation of the interface?

− create multi-vendor interoperability for vendors

who implement the interface?

− move from SAN management into Storage

Management?

31


SMI Infrastructure Development

SNIA

Board of Directors

SNIA

Technical Council

Storage Management

Steering Committee

Storage Management

Technical Steering Group

Management Triad

Storage Management

Forum

32


SMI Conformance Test Process

• SNIA-CTP bulletproofs SMI-S

• SNIA-CTP certification Instills trust

• Vendors passing receive SNIA “Mark”

• Privacy/confidentiality for vendors

• Source code made available to vendors

33


Industry Standards Collaboration

• DMTF

− WBEM (Web-Based Enterprise Mgmt), CIM

• INCITS / ANSI / ISO

− T10 (SCSI, Object-oriented Storage Device)

− T11 (Fibre Channel, Storage Network Management)

• IEEE

− Media management and tape

• IETF

− SNMP, IP SANs, IP storage, directories/LDAP and policy

• And others

− FCIA – Fibre Channel Industry Association

− IBTA – InfiniBand Trade Association

34


SMI-lab Topology

Management

applications

Demo

client

Device

Managers

Disk arrays

Monitoring and

configuration

FileSystem/

Volume manager

Logical disk

information

WBEM

(XML over HTTP)

Tape Libraries

Integrates information from

SNIA SNMP MIB

FC HBA’s

Integrates information

from SNIA HBA API

FC Switches

Port & zone

information

Active management

35


SMI-S Strategic Vision

Q4 of 2003: End-users,

OEMs, and integrators

will be able to ascertain

interface compliance

Q2 of 2004: >50 percent

of the SNIA members

companies, ship product

using SMI-S

All storage managed by

SNIA SMI in 2005

Q3 2003, SNIA-CTP Conformance

Testing Launched

Q2 2003: SMI-S V1.0

Publicly Available

36


SMI-S v1.0 Functionality

Array Volume Creation

Create logical volumes

in an array and make them

available to a host

Indications

Provide device awareness

and operations monitoring

Array LUN Masking

Control the visibility of

logical volumes to hosts

(a form of security)

Array Snapshot & Mirror Control

Create, split, and synchronize

snapshots and mirrors

Fabric Topology & Zoning Discovery

Discover the path between hosts,

switches and arrays; configure and

report on zones

Tape Library Management

Track library health, capacity

and resources, plus LAN-based

media movement

37


SMI: Functionality Onion

CIM Storage Profiles

SLP Discovery

Bluefin

Contribution to

SNIA

SNIA CTP Tests

SMI-S S Test Specification

Arrays, Switches, Libraries, Hosts

Policy

Object Based

Improvements

Storage

Management

Services

Health/Fault

OS Attach

Management

Authorization

Policy

CIM

2.7

Initial

Release

SNIA

SMI-Specification

V1.0

‘Recipes’ for

Interoperable

operations

SMI-Lab validation

CIM

2.8

Deeper

NAS

Functionality

2.x

CIM 2.10 SNIA

Broadened

CIM

Coverage 2.9

SNIA

QoS

SMI-Specification

V1.1 Performance

iSCSI

Cascading

Ownership

Locking

Moving up

The “Stack”

SMI-Specification

V1.2

Single

Sign-on

SNIA

SMI-S

V2.X

2002 2003

2004 2005 2006

ILM

CIM

CIM 3.0

Databases

CIM-Soap

Applications

38


SNIA Technology Trends:

Storage Management Automation

In the old days,

airplanes were a

very hands-on

activity…

Today:

Commercial Aircraft can be monitored…

rather than flown

39


questions?

40


Co-produced by:

More magazines by this user
Similar magazines