27.05.2014 Views

Smart Grid Reference Architecture - PointView

Smart Grid Reference Architecture - PointView

Smart Grid Reference Architecture - PointView

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Smart</strong> <strong>Grid</strong><br />

<strong>Reference</strong><br />

<strong>Architecture</strong><br />

Volume 1<br />

Using Information and Communication Services to<br />

Support a <strong>Smart</strong>er <strong>Grid</strong><br />

<strong>Smart</strong> <strong>Grid</strong> realization is a utility’s journey through a series of architectures. It starts with the<br />

predominant business‐silo model with point‐to‐point interfaces, to one best described as a<br />

systems‐of‐systems integrated by shared services and infrastructure.<br />

SCE‐Cisco‐IBM SGRA Team<br />

July 14, 2011<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NOTES<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

ii


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Contents<br />

1. Executive Summary ...................................................................................................................................1<br />

2. Introduction .................................................................................................................................................2<br />

The <strong>Smart</strong> <strong>Grid</strong> Architectural Challenge ................................................................................................2<br />

3. <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> ............................................................................................................................3<br />

<strong>Smart</strong> <strong>Grid</strong> Architectural Goals and Principles ......................................................................................3<br />

From a Siloed <strong>Architecture</strong> to a Layered Services <strong>Architecture</strong> ..........................................................7<br />

4. <strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services ...................................................... 13<br />

5. <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views ............................................................................................ 14<br />

Application Services ................................................................................................................................. 16<br />

Analytics Services ..................................................................................................................................... 23<br />

Data Services ............................................................................................................................................. 29<br />

Control Services ........................................................................................................................................ 34<br />

Security Services ....................................................................................................................................... 40<br />

Communications Services ....................................................................................................................... 44<br />

Management .............................................................................................................................................. 53<br />

6. Summary .................................................................................................................................................... 59<br />

Appendix A. System of Systems Design Patterns ...................................................................... Appendix 1<br />

Appendix B. Services Classes Concepts .................................................................................... Appendix 11<br />

Applications Services ............................................................................................................ Appendix 11<br />

Analytic Services .................................................................................................................... Appendix 19<br />

Data Services .......................................................................................................................... Appendix 29<br />

Control Services ..................................................................................................................... Appendix 33<br />

Security Services .................................................................................................................... Appendix 39<br />

Communication Services ...................................................................................................... Appendix 45<br />

Management Services ........................................................................................................... Appendix 60<br />

Structural Model Framework Template ............................................................................. Appendix 65<br />

Appendix C. <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)....................................... Appendix 67<br />

Business Requirements ......................................................................................................... Appendix 67<br />

<strong>Smart</strong> <strong>Grid</strong> Business Services ............................................................................................... Appendix 76<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

iii


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

<strong>Smart</strong> <strong>Grid</strong> Cross‐Domain Foundational Services ............................................................ Appendix 86<br />

Appendix D. Roadmap & Maturity Model .............................................................................. Appendix 103<br />

Policy Timeline .................................................................................................................... Appendix 103<br />

Pursuing the <strong>Smart</strong> <strong>Grid</strong> Vision ........................................................................................ Appendix 103<br />

Maturity Model .................................................................................................................... Appendix 107<br />

Appendix E. Glossary of Terms ................................................................................................ Appendix 109<br />

Appendix F. Bibliography ......................................................................................................... Appendix 115<br />

Tables<br />

Table 1 ‐ Typical Application Specifications ...................................................................................................... 20<br />

Table 2 ‐ Applicable Application Standards ...................................................................................................... 21<br />

Table 3 ‐ Application Technology Recommendations ..................................................................................... 22<br />

Table 4 ‐ Typical Analytics Specifications .......................................................................................................... 26<br />

Table 5 ‐ Recommended Analytics Standards ................................................................................................... 28<br />

Table 6 ‐ Recommended Analytics Technology ................................................................................................ 28<br />

Table 7 ‐ Typical Data Services Specifications ................................................................................................... 31<br />

Table 8 ‐ Data Standards and Technology Recommendations ....................................................................... 32<br />

Table 9 ‐ Typical Control Specifications ............................................................................................................. 37<br />

Table 10 ‐ Recommended Control Standards and Technology ....................................................................... 38<br />

Table 11‐ Advanced Control Elements and Technologies ............................................................................... 39<br />

Table 12 ‐ Security Standards and Technology Recommendations ............................................................... 43<br />

Table 13 ‐ Typical Communications Specifications .......................................................................................... 47<br />

Table 14 ‐ Recommended Communications Standards and Technology ...................................................... 52<br />

Table 15 ‐ Recommended Management Standards and Technology ............................................................. 58<br />

Table 16 – Analytics Capability Maturity Model ........................................................................... Appendix 29<br />

Table 17 – Market Domain Business Services ................................................................................. Appendix 77<br />

Table 18 – Operations Domain Business Services .......................................................................... Appendix 78<br />

Table 19 – Service Provider Domain Business Services ................................................................ Appendix 80<br />

Table 20 – Generation Domain Business Services .......................................................................... Appendix 81<br />

Table 21 – Transmission Domain Business Services ...................................................................... Appendix 82<br />

Table 22 – Distribution Domain Business Services ........................................................................ Appendix 84<br />

Table 23 – Customer Domain Business Services ............................................................................ Appendix 86<br />

Table 24 – Security Services............................................................................................................... Appendix 87<br />

Table 25 – Communications Services ............................................................................................... Appendix 89<br />

Table 26 – Data Management Services ............................................................................................ Appendix 95<br />

Table 27 ‐ Glossary ........................................................................................................................... Appendix 109<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

iv


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figures<br />

Figure 1 ‐ GWAC Interoperability Context Setting Framework Diagram (GWAC Stack) ....................... viii<br />

Figure 2 ‐ NIST <strong>Smart</strong> <strong>Grid</strong> Framework 1.0 ....................................................................................................... ix<br />

Figure 3 – SCAP Requirements by NIST Domain ............................................................................................. ix<br />

Figure 4 ‐ Silo <strong>Architecture</strong> for EMS/SCADA and Metering/Billing Functions..............................................7<br />

Figure 5 ‐ Enterprise Service Bus <strong>Architecture</strong> ....................................................................................................8<br />

Figure 6 ‐ Converged Communication <strong>Architecture</strong> ..........................................................................................9<br />

Figure 7 – System‐of‐Systems <strong>Architecture</strong> Based on Open Standard Services ........................................... 10<br />

Figure 8 ‐ <strong>Smart</strong> <strong>Grid</strong> Conceptual Model ........................................................................................................... 14<br />

Figure 9 ‐ Layered Services Tier View ................................................................................................................ 15<br />

Figure 10 ‐ Application Services Logical Model ................................................................................................ 16<br />

Figure 11 ‐ Application Services Structural Model ........................................................................................... 19<br />

Figure 12 ‐ Analytics Logical Model ................................................................................................................... 23<br />

Figure 13 ‐ Analytics Structural Model .............................................................................................................. 25<br />

Figure 14 – Data Services Logical Model ........................................................................................................... 29<br />

Figure 15 ‐ Data Services Structural Model ....................................................................................................... 31<br />

Figure 16 ‐ Control Services Logical Model ....................................................................................................... 34<br />

Figure 17 ‐ Control Services Structural Model .................................................................................................. 36<br />

Figure 18 ‐ Security Logical Model ..................................................................................................................... 40<br />

Figure 19 ‐ Security Structural Model ................................................................................................................. 42<br />

Figure 20 – Communications Services Logical Model ..................................................................................... 44<br />

Figure 21 ‐ Communications Services Structural Model.................................................................................. 46<br />

Figure 22 ‐ Management Framework ................................................................................................................. 53<br />

Figure 23 ‐ Management Logical Model ............................................................................................................. 54<br />

Figure 24 ‐ Management Services Structural Model ......................................................................................... 56<br />

Figure 25 ‐ Silo <strong>Architecture</strong> ............................................................................................................... Appendix 4<br />

Figure 26 ‐ ESB <strong>Architecture</strong> ............................................................................................................... Appendix 5<br />

Figure 27 ‐ Adapter <strong>Architecture</strong> ....................................................................................................... Appendix 6<br />

Figure 28 ‐ Service‐Centric <strong>Architecture</strong> ........................................................................................... Appendix 9<br />

Figure 29 ‐ Dis‐aggregation of a Monolithic System ..................................................................... Appendix 12<br />

Figure 30 ‐ Functional Services Organization ................................................................................. Appendix 13<br />

Figure 31 ‐ Network Operations planning and optimization ...................................................... Appendix 14<br />

Figure 32 ‐ <strong>Smart</strong> <strong>Grid</strong> Analytics Taxonomy .................................................................................. Appendix 20<br />

Figure 33 ‐ Analytics Latency Hierarchy ......................................................................................... Appendix 26<br />

Figure 34 ‐ EIM Framework .............................................................................................................. Appendix 32<br />

Figure 35 ‐ Multi‐Controller / Multi‐Objective Design Patterns (van Breeman, 2001) ............. Appendix 36<br />

Figure 36 ‐ Control Center Functional <strong>Architecture</strong> (IEC, 2005) .................................................. Appendix 37<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

v


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 37 ‐ Hierarchical Control Design Pattern ............................................................................ Appendix 39<br />

Figure 38 ‐ Security Threats Classification ...................................................................................... Appendix 41<br />

Figure 39 ‐ Conceptual and Services Layers ................................................................................... Appendix 45<br />

Figure 40 ‐ Communication Services Layer Functions .................................................................. Appendix 50<br />

Figure 41 ‐ Transport Services Consideration Process .................................................................. Appendix 51<br />

Figure 42 ‐ Conceptual <strong>Reference</strong> Diagram for <strong>Smart</strong> <strong>Grid</strong> Information Networks ................. Appendix 52<br />

Figure 43 ‐ Management Layer Organization ................................................................................ Appendix 62<br />

Figure 44 ‐ <strong>Smart</strong> <strong>Grid</strong> Management Layers .................................................................................. Appendix 64<br />

Figure 45 ‐ Structural Model Template ............................................................................................ Appendix 66<br />

Figure 46 ‐ Communication Services Layer Functions .................................................................. Appendix 89<br />

Figure 47 ‐ California <strong>Smart</strong> <strong>Grid</strong> Policy Timeline ...................................................................... Appendix 103<br />

Figure 48 ‐ <strong>Smart</strong> <strong>Grid</strong> Project Portfolios as a Function of Maturity ......................................... Appendix 104<br />

Figure 49 ‐ <strong>Grid</strong> 1.0 Evolution to <strong>Grid</strong> 2.0 ..................................................................................... Appendix 106<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

vi


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong><br />

<strong>Architecture</strong><br />

Using Information and Communication Services to<br />

Support a <strong>Smart</strong>er <strong>Grid</strong><br />

About this document<br />

This <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> document is designed to<br />

address the challenges, concerns and questions facing smart grid<br />

architects implementing smart grid solutions for their utility. As<br />

with any reference architecture, it aims to provide a foundation<br />

for utilities in the development of their particular smart grid<br />

architectures and to serve as a guide for implementing specific<br />

features designed to make their electric grid smarter.<br />

The architects using this document most likely work within utility<br />

organizations in the areas of operations, generation, transmission<br />

and distribution, customer services, information technology, and<br />

research and development.<br />

<strong>Reference</strong><br />

<strong>Architecture</strong><br />

Wikipedia definition:<br />

A reference architecture<br />

provides a proven template<br />

solution for an architecture<br />

for a particular domain.<br />

A proven architecture is<br />

problematic due to the<br />

scale and immaturity of<br />

the smart grid domain.<br />

The reader should judge<br />

the viability of this<br />

document based upon the<br />

considerable real world<br />

experience of the SCE‐<br />

Cisco‐IBM SGRA Team.<br />

Additional audiences may include:<br />

Utility executives needing clarification on developing a coherent investment roadmap to request and<br />

secure funding to achieve their enterprise’s vision for a smarter grid.<br />

Utilities trying to transition from the specialized, targeted architectures developed for individual<br />

business units toward a more seamless, transparent architecture to be used across all business units.<br />

This architecture is to meet the requirements for optimal smart grid benefits while managing the<br />

complexities inevitably introduced by the requirements for a smarter grid.<br />

Standards organizations (SDOs, SSOs) and policy makers needing to clearly convey a smart grid<br />

vision with enough detail to be actionable by utilities, regardless of size. As utilities transition to the<br />

system‐of‐systems architectural model a number of challenges and issues will arise requiring<br />

assistance from SDOs, SSOs and state/federal policy making bodies.<br />

Vendors providing equipment and services to electric utilities, especially those companies whose<br />

products become more widely used.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

vii


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Foundation Frameworks<br />

A number of informative smart grid documents, white papers, and frameworks are available on the<br />

Internet. The following are especially relevant to this reference architecture and worthy of study:<br />

A Systems View of the Modern <strong>Grid</strong> by the National Engineering Technology Laboratory (NETL, 2007)<br />

‐ this white paper inspired many of the concepts expanded upon in subsequent publications. It<br />

identifies five primary interdependent elements desirable for a modern grid and defines those concepts<br />

including the seven smart grid principal characteristics listed in section 2.<br />

The <strong>Grid</strong>Wise® Interoperability Context‐Setting Framework by the <strong>Grid</strong>Wise® <strong>Architecture</strong> Council<br />

(GWAC, 2008) – a work that focuses on the interface between two or more interacting parties and<br />

provides a framework for discussing the integration of collaborative processes and independent<br />

automation components. It identifies eight interoperability categories defined by the framework and 10<br />

crosscutting issues applicable in every category. The categories are tagged as technical, informational<br />

or organizational, and are stacked according to their increasing level of abstraction [Figure 1].<br />

Figure 1 ‐ GWAC Interoperability Context Setting Framework Diagram (GWAC Stack)<br />

While this structure is not used to organize the reference architecture described in this document, it<br />

provides the basis for the structural models presented in the reference architectural views in section 5.<br />

The NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards by the National<br />

Institute for Standards and Technology (NIST, 2010) ‐ a conceptual model created to support the<br />

planning and organization of the interconnected networks expected in the <strong>Smart</strong> <strong>Grid</strong>. The NIST<br />

approach divided the <strong>Smart</strong> <strong>Grid</strong> into the seven domains shown in Figure 2.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

viii


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 2 ‐ NIST <strong>Smart</strong> <strong>Grid</strong> Framework 1.0<br />

In 2010 NIST commissioned the <strong>Smart</strong> <strong>Grid</strong> Interoperability Panel’s (SGIP) <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong><br />

Committee (SGAC) to lead its <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP). The SCAP working<br />

group took top‐down and bottom‐up approaches to establish a foundation for the development of<br />

smart grid business requirements.<br />

The SGAC ‘s top‐down approach involved a review of all major federal energy legislation signed into<br />

law since 2000, more than 9,500 pages. Review of these documents resulted in the identification of 400<br />

goals. The bottom‐up efforts reviewed more than 600 use cases written by a variety of industry<br />

organizations, including more than 20 systems requirement documents produced by industry working<br />

groups. The bottom‐up review produced more than 8000 business requirements for the <strong>Smart</strong> <strong>Grid</strong>.<br />

Figure 3 illustrates the distribution of the smart grid business requirements by domain. (SGIP SGAC)<br />

Figure 3 – SCAP Requirements by NIST Domain<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

ix


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

This preliminary work created 400 families of requirements covering the seven NIST domains. These<br />

high‐level business requirements (available on the NIST website) encompass the entire <strong>Smart</strong> <strong>Grid</strong><br />

from market to customer – from bulk generation to distribution. They form the basis of what the <strong>Smart</strong><br />

<strong>Grid</strong> requires from a business standpoint and to meet federal government’s energy goals. 0 provides a<br />

list of the SCAP Business Requirements and Services.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> by the P2030 Working Group (IEEE) ‐ this document, expected in<br />

the third quarter of 2011 (draft published in March 2011), will provide guidelines for smart grid<br />

interoperability, including a discussion of best practices. The P2030 guide will also provide a<br />

knowledge base addressing terminology, characteristics, functional performance and evaluation<br />

criteria, and the application of engineering principles for grid interoperability with end‐use<br />

applications and loads. At first the SCE‐Cisco‐IBM reference architecture team expressed concern on<br />

the potential overlap between the P2030 guide and this document, but after a thorough comparison of<br />

the two drafts, the consensus is that this reference architecture merely complements the P2030 guide.<br />

Whereas the P2030 Guide documents a catalog of interfaces, this document addresses the architecture<br />

and foundational services necessary to develop <strong>Smart</strong> <strong>Grid</strong> systems, interfaces, and processes.<br />

The alert reader will notice this document is entitled Volume 1. It includes a set of views on smart grid<br />

architecture largely written from the point of view of system integration. It is expected to be a useful<br />

companion to IEEE P2030. As IEEE P2030 catalogues smart grid system interfaces, the SGRA Volume 1<br />

catalogues smart grid system services. Similarly, the NIST SGCA lists elemental smart grid functions<br />

(unit operations); the NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards<br />

identifies relevant smart grid interface standards; and the GWAC Interoperability Context‐Setting<br />

Framework, as a companion to the NIST Framework, provides rigor around the concept of<br />

interoperability. Each contains more than described above, as their authors will attest, but these<br />

characterizations are helpful in framing each document in the context of the entire set.<br />

Each one of these documents is a valuable contribution to the field of smart grid architecture, and<br />

smart grid architects are strongly urged to study each of them. However, after this document was<br />

completed, the team sensed a set of architectural views was needed to tie these contributions into a<br />

unified whole that would make the SGRA actionable in both the near term and throughout the general<br />

smart grid utility transformation journey. That is why this document was labeled Volume 1, to be<br />

followed shortly by Volume 2. The Volume 2 document will synthesize the various expositions on<br />

interfaces, standards, and services, as well as measurement, data management, control,<br />

communications, and security from the above mentioned <strong>Smart</strong> <strong>Grid</strong> documents into a practical<br />

consolidated architectural guide representing how best to implement smart grids. Volume 2 will also<br />

tie together energy delivery elements of particular importance as the smart grid scales up, resulting in<br />

interactions of increasing complexity with simultaneous impact to once‐independent utility tiers.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

x


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

1. Executive Summary<br />

The <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> is intended as a template for <strong>Smart</strong> <strong>Grid</strong> architects to follow as<br />

they build <strong>Smart</strong> <strong>Grid</strong> Information and Communications Technologies (ICT) architecture for their<br />

utility, regardless of the architect’s specialty (transmission, distribution, metering, IT, communications).<br />

The goal of this document is to accelerate the construction of a utility’s <strong>Smart</strong> <strong>Grid</strong> architecture and<br />

implementation strategy by leveraging the reference architecture constructs contained therein.<br />

This reference architecture recognizes the need to logically transition from the existing, largely ad hoc<br />

nature of the typical utility grid architecture to one based on open interoperability standards, and<br />

designed to manage complex solutions while facilitating the integration of emergent smart grid<br />

capabilities. It explores three migrations across four transition states and takes into consideration the<br />

many years required to develop sound recommendations for smart grid architecture.<br />

Security is an integral element of the grid ICT architecture and a multi-layered approach is advocated,<br />

including both physical and ICT-based security mechanisms. Layering smart grid services using the<br />

proposed system-of-systems architecture should minimize the stranded costs utilities invest in one-off<br />

solutions. A layered service-centric architecture also minimizes the expense, configuration headaches,<br />

and management complexity a utility faces pursuing a point-to-point interoperability architecture.<br />

Another aspect emphasized in this reference architecture that could lead to considerable cost and time<br />

savings for utilities are the implementation of data services and data management. Greater access to<br />

and use of data is critical to the realization of a grid’s ability to accommodate new capabilities while<br />

improving security, reliability and quality.<br />

A significant portion of this reference architecture is dedicated to discussing common foundational<br />

services and the corresponding architectural views, important for maintaining the high levels of<br />

performance and efficiency required by a modern grid ICT. Recognizing that some services are best<br />

centralized while others must reside primarily within grid-state aware edge components, this<br />

discussion also explores the best central-versus-edge mix for deploying various domain components.<br />

This <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> was produced by a team of architects from Southern California<br />

Edison (SCE), Cisco Systems, and IBM. Its development spanned a period of nine months (July 2010<br />

through March 2011) and involved a number of face-to-face team workshops and web-based meetings.<br />

An external review by EnerNex added additional insight and content.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Executive Summary • 1


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

2. Introduction<br />

The <strong>Smart</strong> <strong>Grid</strong> Architectural Challenge<br />

The January 2007 white paper, A Systems View of the Modern <strong>Grid</strong>, by the U. S. Department of Energy’s<br />

(DOE) National Energy Technology Laboratory (NETL) identifies seven smart grid characteristics:<br />

self-healing<br />

able to motivate and engage the customer<br />

resistant to attacks<br />

provides power quality suitable for 21st century needs<br />

accommodates all generation and storage options<br />

enables markets<br />

optimizes assets and operates efficiently<br />

There are a number of <strong>Smart</strong> <strong>Grid</strong> definitions, but no matter which is used, there is little dispute over<br />

the vastness of program scopes faced by smart grid architects. Incorporating information and<br />

communications technologies into what the National Academy of Engineering calls "the greatest<br />

engineering achievement of the last century" (NAE, 2011) will be the one of the most complex human<br />

endeavors ever undertaken. This robust engineering achievement must be extended to support<br />

enhanced situational awareness (via synchrophasors), industrial-scale energy storage, distributed<br />

(dispersed) energy resources, improved field worker effectiveness (via wireless communications and<br />

automated asset management), remedial action scheme expansion, substation automation, volt/VAR<br />

optimization, fine-grained demand response, distribution automation, improved power quality, power<br />

disturbance self-healing, micro-grids, personal and fleet electric vehicles, automated metering,<br />

premises area networks, enhanced customer energy management, power grid congestion-management,<br />

advanced integrated command and control, transmission/distribution smart sensor deployment, very<br />

low-latency protection communications, and not yet identified technologies that are certain to emerge<br />

as the <strong>Smart</strong> <strong>Grid</strong> matures. All this must be accomplished as the world's largest machine, the electric<br />

grid, continues to operate unabated, while maintaining present or improving reliability. In addition,<br />

embedded security measures must be built concurrently to marginalize the possibility of successful<br />

cyber and physical attacks from an ever-growing number of threats, and prevent unauthorized use of<br />

customer personal data and energy usage information. Finally, there are demands from regulators,<br />

political leaders, and social groups to make the grid smarter quickly, while addressing environmental<br />

objectives and keeping electric rates low.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Introduction • 2


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

3. <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong><br />

The <strong>Smart</strong> <strong>Grid</strong> architectural challenge is a daunting one. This is especially true for those within the<br />

electric utility industry known for their conservative approach toward incorporation of ICT-based<br />

systems to help run and manage the electric grid. Most automated grid systems in use today were built<br />

to address narrowly targeted requirement sets. As a result, a typical utility has a plethora of purchased<br />

and homegrown systems stitched together over the last three decades with point-to-point interfaces.<br />

This approach is unsustainable for a utility to efficiently and effectively implement smart grid<br />

capabilities over the next two decades. This document presents a different approach to utility system<br />

design and integration, using newer paradigms to deal with complex and legacy system integration.<br />

<strong>Smart</strong> <strong>Grid</strong> Architectural Goals and Principles<br />

The next two decades will see the “Old <strong>Grid</strong>” evolve into a “<strong>Smart</strong> <strong>Grid</strong>” as legacy grid infrastructure<br />

is merged with the latest ICT. This will put extraordinary demands on the ICT architecture; therefore,<br />

high-level goals and principles are needed to guide the smart grid architects tasked with developing<br />

any aspect of an organization’s grid architecture. Additionally, a highly flexible, adaptive Enterprise<br />

<strong>Smart</strong> <strong>Grid</strong> architecture is critical for this transition to be successful. The architecture must support<br />

existing ICT infrastructure operations and be able to keep infrastructure complexity manageable as<br />

new smart grid capabilities are added.<br />

How a utility defines its smart grid architecture will vary according to their organizations particular<br />

needs. Some possible goals are:<br />

Facilitate bridging new and emerging information and communications technology to legacy<br />

architecture over extended time periods (technology roadmap).<br />

Manage the increasing complexity of ICT needed to support smart grid implementation.<br />

Align technology usage with the utility’s smart grid strategic objectives.<br />

Provide guidance on how packaged solutions can support the smart grid architectural vision.<br />

Facilitate the communication of the utility’s smart grid strategy and plans across the enterprise<br />

Help sell the utility’s smart grid vision to business unit leadership, IT management, suppliers,<br />

regulatory agencies, contractors, etc.<br />

Help stakeholders (application developers, IT managers, and end users) plan, budget, implement<br />

and use smart grid information and communication technologies.<br />

Make the utility smart grid architecture easily accessible and transparent.<br />

Support the interactions of processes, tools, technology and people to achieve business ICT goals.<br />

Once a utility has defined its smart grid architecture goals it should develop a set of written principles<br />

to provide high-level direction during architecture development. Some principles a utility may<br />

consider important are:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 3


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

1. Design for simplification by exploiting strategic assets<br />

Motivations:<br />

Reduce complexity and cost<br />

Let the enterprise’s employees focus on customer, not on internal processes<br />

Implications:<br />

Establish single architecture control point for requests to expand the portfolio<br />

Finish what is started to enable legacy sunsets<br />

Reduce complexity and low value work steering investment & effort to high value activities<br />

2. Reuse process, data, and ICT assets whenever appropriate<br />

Motivations:<br />

Accelerate business capability delivery<br />

Reduce cost<br />

Increase enterprise consistent use of best practice designs<br />

Increase responsiveness to regulatory requirements<br />

Implications:<br />

Must identify, adopt and reuse process, data and ICT assets for enterprise wide use<br />

Must promote business modularity from strategy through deployment<br />

Must direct funding to develop and adopt best practice assets<br />

3. Use off-the-shelf rather than build solutions<br />

Motivations:<br />

Reduce cost and time to market<br />

Improve time to market<br />

Implications:<br />

Understand what off-the-shelf solutions exist and what processes they support<br />

Re-engineer the business process or model to use off-the-shelf products and services<br />

4. Use Business Process Driven development to move toward a process-centric organization<br />

Motivations:<br />

ICT development will be driven by Enterprise Business Process<br />

Process will drive continual improvement across the enterprise<br />

Use business priorities to drive technology adoption<br />

Continually improve ICT effectiveness and efficiency<br />

Facilitate cross enterprise integration<br />

Implications:<br />

Align enterprise processes with enterprise strategy<br />

Close business-IT partnership with IT engaged early in the solution development process<br />

Ongoing maintenance/management of enterprise business processes<br />

5. Base architecture on total cost of ownership (TCO)<br />

Motivations:<br />

Provide a common approach for dealing with applications<br />

Optimize operational manageability while making key business and technology decisions<br />

Minimize cost of complexity while making these decisions<br />

Free up resources from low value to higher business value application through optimization<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 4


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Implications:<br />

Elimination of low value applications at every possible opportunity<br />

Avoid introduction of new low-value applications for short lived business requirements<br />

TCO based approach to be used for major technology decisions<br />

6. Ensure business decisions are based on information from appropriate trusted data sources<br />

Motivations:<br />

Achieve highest degree of integrity and validity for business decisions<br />

Minimize IT costs for managing and maintaining data<br />

Enhance ease of doing business by eliminating manual data integration, normalization, etc<br />

Implications:<br />

Practitioners more likely to know what trusted sources exist, and which ones to use<br />

Solution teams realize reduced cost benefits using appropriate trusted sources<br />

7. Develop data models and a data dictionary for the entire portfolio<br />

Motivations:<br />

Improve operational excellence<br />

Reduce unnecessary transformations of data and related re-work<br />

Enable meta data sharing for exchange and integration purposes<br />

Improve future system design and programming projects<br />

Improved documentation and control mechanisms<br />

Implications:<br />

Project teams bound by data model/dictionary governance processes<br />

Close collaboration between business and IT stakeholders<br />

Easy access to data model/dictionary given to designers and programmers<br />

8. Master data – element created from one trusted source<br />

Motivations:<br />

Increased data integrity and reliability<br />

Cost reduction for managing information and data quality<br />

Implications:<br />

Consistently invest in, and comply with, the trusted sources architecture<br />

Processes engineered to maintain consistent master data management and consumption<br />

9. Only store copies of data within approved trusted sources<br />

Motivations:<br />

Achieve highest degree of integrity and validity for business decisions<br />

Minimize ICT costs for managing and maintaining data<br />

Enhance ease of doing business by eliminating manual data integration, normalization, etc<br />

Implications:<br />

Practitioners more likely to know what trusted sources exist, and which ones to use<br />

Solution teams realize reduced cost benefits using appropriate trusted sources<br />

Data currency is in line with business expectations.<br />

10. Implement data quality plans for all business solutions<br />

Motivations:<br />

Maximize data integrity and validity for business operations and decision making<br />

Avoid operational disruption due to data errors<br />

Reduce cost and complexity<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 5


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Implications:<br />

Real cost implications associated with avoidance of data quality plans<br />

Data quality easier to implement and sustain<br />

11. Design solutions that provide measurable business performance and value<br />

Motivations:<br />

Maximize ICT ROI<br />

Focus design and development teams on business success goals<br />

Validate the ICT governance model<br />

Achieve measurable performance gains<br />

Implications:<br />

Link strategy to business case and customer requirements to metrics<br />

Enable collection, analysis and reporting of metrics, actual to plan<br />

Design generation of metric data into solutions<br />

Establish process-level Key Performance Indicators<br />

12. Enable applications for reuse and portability as services<br />

Motivations:<br />

Ability to quickly add, modify, remove or replace service functions<br />

Reduction of integration expense and partner boarding costs<br />

Facilitate the reuse of strategic applications and business functions<br />

Enable application and function relocation for process or cost effectiveness<br />

Improve support of acquisitions and divestitures<br />

Reduce point-to-point integration solutions<br />

Implications:<br />

High return investment hotspots emphasized<br />

Centralized support for design enablement<br />

Enterprise group assigned to enhance competency on standards and references<br />

Portability design based upon being agnostic on platform, location and virtualization<br />

Adoption of service modeling methodology<br />

13. Design and test solutions to satisfy non-functional requirements<br />

Motivations:<br />

Stabile platforms supporting the enterprise business<br />

Ensured Return On Investment<br />

Implications:<br />

Need to understand the target audience and expected workload of new solutions<br />

Infrastructure impact of new solutions known early in the design cycle<br />

Infrastructure constraints considered in analysis of growth markets<br />

14. Design solutions to make use of infrastructure common services<br />

Motivations:<br />

Reduction of infrastructure duplication and cost<br />

Less complexity for the end user<br />

Improvement of system interoperability<br />

Implications:<br />

Re-use of existing common services, reduction of new service construction<br />

Need for common services to be robust and user-friendly<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 6


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

From a Siloed <strong>Architecture</strong> to a Layered Services <strong>Architecture</strong><br />

Architectural evolution can be defined as how a typical utility implements its smart grid<br />

transformation in stages. A white paper discussing this evolutionary process in depth can be found in<br />

Appendix A. For the purposes of this paper the process has been divided into four stages.<br />

Stage One: The predominate architecture of grid systems is a collection of silos. Figure 4 is an example<br />

of silo architecture for EMS/SCADA and metering/billing functions. Different functions (SCADA, EMS,<br />

DMS, OMS, Billing, and Metering) use disparate information with minimal interaction.<br />

Figure 4 - Silo <strong>Architecture</strong> for EMS/SCADA and Metering/Billing Functions<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 7


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The silo architecture worked well for utilities for decades - each silo served the needs of a business unit,<br />

each having very different needs. Utilities operated efficiently with little integration across silos. The<br />

silo solution, however, is not sustainable to support the <strong>Smart</strong> <strong>Grid</strong>. The number of stakeholders<br />

needing real-time data from every silo cannot be support long-term point-to-point interfaces.<br />

Stage Two: Some utilities have taken the next step in smart grid evolution – the integration of the back<br />

office and applications via a common service bus, such as the enterprise service bus architecture shown<br />

in Figure 5 . This is often a difficult and costly process. In addition, service-bus integration requires<br />

enforcement of standards on data models and ICT services. Without the enforcement of standards, the<br />

service bus is simply a shared communication device with little resolution of silo weaknesses.<br />

Figure 5 - Enterprise Service Bus <strong>Architecture</strong><br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 8


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Stage Three: The next step towards a unified, shared infrastructure is realized by moving away from a<br />

series of single-purpose networks to a converged communication infrastructure [Figure 6]. This shared<br />

infrastructure enables as-needed data transfer from end points to consuming applications in<br />

accordance with stated requirements (quality of service, criticality, bandwidth, latency, etc.).<br />

Figure 6 - Converged Communication <strong>Architecture</strong><br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 9


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Stage Four: The ultimate <strong>Smart</strong> <strong>Grid</strong> ICT architecture is converging on layered, open standard services<br />

architecture. It provides capabilities across functional and organizational boundaries; from a<br />

data/control center to edge devices and data consumers (applications and end users).<br />

Figure 7 – System-of-Systems <strong>Architecture</strong> Based on Open Standard Services<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 10


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The system-of-system architecture shown in Figure 7 supports the following capabilities:<br />

Components can be added, replaced or modified without affecting the remainder of the system<br />

Components are distributable (can run on arbitrary servers)<br />

Components communicate with each other by messages or service invocations<br />

Component interfaces are defined using standard metadata<br />

Component interfaces are discoverable by application developers<br />

One component can replace another with the same interface<br />

Services can be used multiple times by disparate applications or the same application.<br />

Achieving such smart grid capabilities requires a great amount of interaction among systems. For<br />

instance, most utilities rely on customers to report an outage; in the future, the advanced metering<br />

infrastructure (AMI) will interact with the outage management system (OMS) to predict and confirm<br />

outages. Once OMS confirms an outage, the distribution management system (DMS) calculates the<br />

necessary switching steps needed to isolate the fault area and restore service in a timely manner. The<br />

field workforce will directly interact with the OMS and DMS, responding to automatically issued work<br />

orders and providing a detailed estimate of restoration time. Meanwhile, the customer can be notified<br />

of the outage status in real-time via user-defined means (cell phone, web, etc.). As the capabilities of the<br />

communication infrastructure advances, additional intelligence will be deployed closer to the<br />

customers’ premises, allowing pro-active decisions to be made locally to avoid or minimize outages,<br />

while informing the utility systems and operators of the locally implemented actions for potential<br />

adjustment and optimization of energy resources.<br />

The <strong>Smart</strong> <strong>Grid</strong>’s capabilities will need to be facilitated by an architecture that enables the connected<br />

devices and systems to securely interact and exchange information and control. Field devices and<br />

electrical equipment should not only publish data to help improve real-time monitoring of the electrical<br />

grid, they will need to subscribe to other devices' information as well, allowing the devices to respond<br />

to control signals and data requests issued by applications and systems responsible for grid monitoring<br />

and control. This dispersion of data across the grid poses a significant challenge to utility data<br />

management. The quality of the data is also a concern, requiring intelligent devices to be properly<br />

configured and maintained. Device configuration control is best performed by a common management<br />

tool tasked with component provisioning and de-provisioning. Even though the future communication<br />

infrastructure is expected to be more robust and feature high performance communication channels,<br />

the large amount of data, data sources and data consumers requires grid intelligence to have<br />

decentralized and centralized aspects:<br />

Decentralized embedded systems and applications will be responsible for analysis, filtering and<br />

taking particular actions based on the data provided by local field devices.<br />

Centralized systems will be responsible for coordinating the decentralized systems, ensuring the<br />

overall reliability and stability of network.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 11


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

With applications and systems physically dispersed into the network to lower the cost of deployment<br />

and maintenance, each component of the <strong>Smart</strong> <strong>Grid</strong> system-of-systems will be required to satisfy four<br />

key principles of layered services architecture:<br />

1. Individual components can be added, replaced or modified without impact to other systems.<br />

2. Components are distributable, communicating by messages or service invocations.<br />

3. Interfaces between components are discoverable and leverage standard metadata<br />

4. Component services can be easily reused by different applications.<br />

While reusable and shared services reduce costs and minimize complexity, they also enable faster<br />

deployment of new applications. This will be crucial for the utility to efficiently adapt to evolving<br />

regulatory mandates.<br />

To transition from a Stage 1 silo architecture, or a Stage 2 partially integrated architecture to a Stage 3<br />

or Stage 4 layered services architecture, the utility must define and plan for strategic investments in<br />

modernizing its infrastructure and systems. To be successful, each planned investment must be<br />

reviewed and assessed from an enterprise standpoint to ensure investments help the organization<br />

transition toward the future <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong>. Adoption of shared services, standards and a<br />

unified infrastructure need to be understood as intrinsic requirements for each planned investment.<br />

A transition plan some companies have adopted is to first move from a siloed architecture to<br />

middleware integration architecture. This is followed by a gradual migration to an open-standards<br />

based architecture, incrementally developing and adopting standards and common services. Each<br />

increment helps move the enterprise toward the vision of this <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong>. The<br />

timing of the transitions is often documented by a smart grid roadmap. Appendix D presents one<br />

technique for constructing a roadmap. It also provides a brief discussion on the <strong>Smart</strong> <strong>Grid</strong> Maturity<br />

Model (SGMM) sponsored by Carnegie Mellon University.<br />

The smart grid architect should apply the system-of-systems architecture patterns described to first<br />

develop use cases and a comprehensive set of requirements. These can then be used to develop the<br />

shared services and target physical architectures needed to support the desired capabilities across the<br />

utility’s smart grid.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 12


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

4. <strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services<br />

Seven domains comprise the conceptual model described in NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong><br />

Interoperability Standards, Release 1.0 (NIST, 2010). A smart grid has inherent power flow and grid state<br />

complexity embedded primarily within this model’s Operations domain. This SGRA recommends two<br />

additional domains should an architect wish to explicitly address these complexities. In addition, the<br />

SGRA supports the concept of foundation-level services used by multiple domains.<br />

The NIST smart grid conceptual model domains are:<br />

Customer: the functional needs within the customers’ premises, including the ability to generate,<br />

store, monitor and control the electricity usage of customers (both residential and commercial).<br />

Market: the functional and operational need for operators and participants in the electricity market.<br />

This is where efficient matching of energy production and consumption is performed.<br />

Service Provider: the functional needs of organizations offering or leveraging utility services. These<br />

include power producers, distributors, regulatory agencies, banks, credit bureaus, etc.<br />

Operations: managers of electricity movement, responsible for the smooth operation of the grid<br />

Bulk Generation: the needs of power generation entities producing more than 300 megawatts.<br />

Transmission: the applications and tools to deliver bulk electricity over long distances, such as a<br />

Regional Transmission Operator or Independent System Operator (RTO/ISO).<br />

Distribution: often considered the primary focus of smart grid changes, offers all the required<br />

functional services to electricity distributors to and from customers, as well as the services to<br />

manage distributed energy resources, including energy storage and plug-in electric vehicles.<br />

Supplementing the NIST-defined domains, the following are potential expansions to the architect’s<br />

smart grid conceptual model:<br />

Balance – required for the dispatch of distributed energy resources and demand response due to<br />

their roles in balancing supply vs. demand on the grid; increasingly data interaction between the<br />

utility, the consumer and the balance authority will be needed in the <strong>Smart</strong> <strong>Grid</strong> environment.<br />

Interchange – the visibility onto grid state required to address increased power flow complexity,<br />

placing requirements on smart grid systems for data communications and management.<br />

Cross domain foundational services are those that two or more domains rely upon and therefore need to<br />

be interoperable across domains. For example, a system having one form of encryption in one domain<br />

and a different one in another will lead to problems when the two exchange information, thus causing<br />

additional work to correct the problem in the final implementation. This could be avoided by a single<br />

encryption method used by all systems as a cross domain foundational service.<br />

Cross domain services are broken down into six groups: Analytics, Data, Control, Security,<br />

Communication, and Management. Discussions on each service group can be found in Appendix B.<br />

Architects and others interested are encouraged to study this appendix for more detail.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services • 13


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

5. <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views<br />

The comprehensive, end-to-end, high-level architecture needed to support the utility business domains<br />

and common enabling services discussed in Section 4, uses a model that assumes a service-oriented<br />

governance process exists supporting the intrinsic characteristics of layered services architecture. The<br />

model’s seven business domains are each logical groupings of business capabilities providing related<br />

business functions while requiring similar skills and expertise. These match the domains identified by<br />

NIST in Special Publication 1108, NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards,<br />

Release 1.0 (NIST, 2010).<br />

These functional areas form the basis for defining the boundaries of ICT capabilities and systems, and<br />

provide a means to classify components and services. Common enabling services provide a variety of<br />

services for systems and subsystems to accomplish business functions. Governance provides a<br />

framework to define the relationships and processes used to direct and control grid activities, as well as<br />

the actions, authority and metrics used to realize business benefits while balancing risk versus reward.<br />

The left side of Figure 8 shows the seven NIST utility domains as distinct logical groupings of common<br />

capabilities. A utility may elect to combine some domains (i.e. distribution and transmission) and plan<br />

a single logical infrastructure to support the <strong>Smart</strong> <strong>Grid</strong>. In addition, utilities opting for interactions of<br />

<strong>Smart</strong> <strong>Grid</strong> elements with the Balance and Interchange domains will need to extend this model.<br />

Figure 8 - <strong>Smart</strong> <strong>Grid</strong> Conceptual Model<br />

The top of Figure 9 names five smart grid end-state architecture tiers (user/device, channel,<br />

presentation/edge, integration, services). In this tiered architecture, data flows from left to right (and<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 14


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

back) through the various tiers, each with layered service groups or capabilities. The large box at the<br />

bottom of the figure (spanning the three right tiers) represents the cross domain foundational services<br />

discussed in section 4 above.<br />

Figure 9 - Layered Services Tier View<br />

Each services group discussed in the following subsections provides a:<br />

Logical architecture diagram<br />

Structural architecture diagram<br />

Table of typical architectural specifications for the service group<br />

Table of relevant standards for the service group<br />

Table of relevant technologies for the service group<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 15


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Application Services<br />

<strong>Smart</strong> grid applications services provide functionalities for the presentation tier, the services tier, and a<br />

mechanism to integrate various applications through the integration tier as depicted in Figure 9.<br />

Applications consume services to present secure, timely, relevant, and understandable information in<br />

response to a validated stakeholder request.<br />

Applications Services Logical Model<br />

The Application Services Logical Model [Figure 10] is made up of three views, (1) application component,<br />

(2) application services stack and (3) application synergy.<br />

Figure 10 - Application Services Logical Model<br />

The application component view depicts in block format the primary functional components used to<br />

build the architecture being described. This model follows the IEC 61968 and 61970 specifications, most<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 16


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

notably the Interface <strong>Reference</strong> Model (IRM) categorization of functional components necessary for<br />

smart grid transformation within a utility.<br />

The application services stack view defines the services required by smart grid applications. Due to the<br />

number and broad range of services consumed by applications, the list is best understood by grouping<br />

the services into broad service types. The stack services are therefore divided into four categories:<br />

Foundation services –many key technical foundational services are required by the application<br />

architecture tier. Used throughout the architecture, these services are leveraged to varying<br />

degrees by other technical and functional services. For example, the enterprise service bus is one<br />

of the foundation services used throughout the architecture.<br />

Core services – the primary service stack for the application architecture are service governance<br />

through a services registry and repository, a message gateway, web Integration services, a state<br />

machine, and a business process execution language (BPEL) engine and workflow. These core<br />

services provide baseline capability in the application tier.<br />

Integration services – services such as enterprise services bus, rule engine, the Common<br />

Information Model (CIM) binding, service orchestration, security agents, and policy cache<br />

provide the integration needed between the functional services and other architectural tiers.<br />

Support services – the application architecture utilizes common support services for security,<br />

communication, data management, smart grid management, analytics, and control. Support<br />

services underpin application architecture and are re-used extensively in each services group.<br />

The application synergy view [Figure 10, upper left] depicts some of the key issues faced by an<br />

enterprise architect while architecting the <strong>Smart</strong> <strong>Grid</strong> application architecture. The data generated by a<br />

device or end point may serve multiple consumers in a format specific to each consumer’s needs. The<br />

application architect can use the model to identify re-use opportunities for data and integration<br />

services as smart grid application functionalities are built. Potential synergy prospects are those with<br />

similar paths through the various tiers.<br />

The tiers and how they relate to the <strong>Smart</strong> <strong>Grid</strong> are:<br />

Source Tier: Different data generation sources (sensors, feeder devices, etc.) in the <strong>Smart</strong> <strong>Grid</strong><br />

produce the four different data classes (telemetry, waveforms, events, user data) shown in the<br />

application synergy model portion of Figure 10. This tier is comprised of the various parameters<br />

used to differentiate sources. There are important architectural considerations when selecting the<br />

(1) components to process the data, (2) communication infrastructure to transport the data, and<br />

(3) security services needed to protect the data. The frequency at which a source generates data<br />

is dependent on the purpose of the data. For example, if data is expected to be used for<br />

calculating grid state, the data generation frequency will be high. If the data represents<br />

consumer usage data, the frequency is much less – perhaps once every several minutes. Thus the<br />

purpose of each datum and source needs to be analyzed, and only then should relevant<br />

architectural components be selected to implement the requirements.<br />

Data Classes: There are four high-level data class types supported in <strong>Smart</strong> <strong>Grid</strong> architecture.<br />

Waveforms data represent values of electrical measurements such as current, voltage, phase, etc.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 17


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Telemetry data represent readings generated by field sensors. Event messages can be generated<br />

by field crew, distributed energy resources (DER), automated demand response (ADR), etc.<br />

Usage data is generated by consumer smart meters. These data classes are presented to ensure<br />

the application architecture supports all data classes, and to help the architect choose the best<br />

integration pattern.<br />

Application Services: This tier represents how different components must interact to provide<br />

desired business functionality. Different data classes connect to the <strong>Smart</strong> <strong>Grid</strong> infrastructure<br />

through the enterprise services bus (ESB). This provides multiple capabilities, such as handling<br />

request/response, publish/subscribe (event) processing, event interception, gateway<br />

communication, business rules, CIM binding, policy caching, etc. The core ESB features<br />

provided (protocol transformation, routing, etc.) allows the service bus to act as a mediator<br />

between the data source and consumer. Web integration services can consume usage data and<br />

provide data to customer service hosted by a third party or utility partner. Similarly, third party<br />

consumers may connect to smart grid applications through gateway services. Applications often<br />

require workflow, CIM binding, access to an external rules engine, and service discovery for<br />

building functional capabilities. Refer to Appendix B for more detail on application services.<br />

Consumers/Processes: These are the high level business functions identified in the IEC IRM.<br />

These business functions are developed using application services to collect and process source<br />

data for end-user consumption. Edge presentation services may be used for some consumers<br />

while others are supported by application servers via the ESB. Functional components<br />

developed on application servers make use of rules engines, workflow, process services, BPEL<br />

engines, state machines, complex event processing, gateway services, etc. Web integration<br />

services are used to develop support services and user-generated content, including derivative<br />

applications from pre-existing sources (mashups).<br />

Application Services Structural Model<br />

The application services structural model [Figure 11] is provided to help the smart grid architect<br />

consider how to best deploy the various application services using a stylized representation of a typical<br />

utility network infrastructure. At the top of the model are elements needed to support external agencies<br />

(regulators, interchange and balancing authorities, etc.). At the bottom are the application services<br />

needed by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In<br />

between are a dozen other tiers where application services may be located to support residing devices<br />

and functionality. A self-describing template used for this model is on the last page of Appendix B,<br />

Services Classes Concepts. Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 18


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 11 - Application Services Structural Model<br />

Applications <strong>Architecture</strong> Specifications<br />

Each smart grid application will have a list of specifications for the application architecture to support.<br />

This topic is, however, does not address every specific smart grid application. It is instead intended to<br />

be a discussion of common specifications for an abstracted collection of smart grid applications.<br />

Table 1 is therefore a list of general specifications with potential relevance to a smart grid application.<br />

The justification for each is provided to enhance the reader’s understanding of each specification.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 19


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The table does not include detailed business or technical requirements a specific application would<br />

fulfill. Each utility will build a detailed application requirements list as part of any smart grid project.<br />

Table 1 - Typical Application Specifications<br />

Specification<br />

Application access shall be tightly controlled.<br />

The application architecture shall use common<br />

services instead of building redundant services.<br />

The application infrastructure shall leverage<br />

virtualization at the data center.<br />

The application shall be deployable in a distributed<br />

fashion. Places in the grid for application<br />

deployment are illustrated in an hierarchical model.<br />

Application infrastructure must be rugged for<br />

applications that are deployed on substation,<br />

feeder, and premises area.<br />

The application shall use common auditing/logging<br />

capabilities to support comprehensive management<br />

architecture.<br />

Applications architecture shall promote open<br />

standards and avoid vendor lock-in.<br />

Whenever possible, management of systems shall<br />

be centrally and uniformly managed.<br />

Business rules (i.e., implementations of the policies<br />

and practices of a business organization)<br />

externalization shall be supported.<br />

Any commercial-off-the-shelf (COTS) application<br />

package used shall be minimally customized.<br />

A comprehensive design, build and run platform<br />

shall be used to support implementation of the<br />

<strong>Smart</strong> <strong>Grid</strong> application architecture.<br />

All information shall have defined authoritative<br />

sources (information stewards).<br />

A comprehensive architecture governance<br />

mechanism shall be used during application<br />

architecture development.<br />

As needed, common services shall be developed for<br />

communication, security, and data architecture as a<br />

precursor to the development of the application<br />

services architecture. (similar to second spec listed)<br />

Enterprise business service definitions shall be<br />

managed and enabled for automatic discovery.<br />

Justification<br />

Applications must be protected from unauthorized access.<br />

Common services such as authentication and authorization,<br />

communication, and management services, if reused properly can<br />

drastically cut costs.<br />

Reducing the consumption of key resources such as energy and<br />

personnel while improving the utilization of IT hardware and<br />

software can yield environmental as well as financial benefits.<br />

Each location where data is generated or information is consumed is<br />

a location candidate for the appropriate application. Communication<br />

network elements hosting additional software are also good<br />

candidates, since communications elements generally exist where<br />

data sources and consumers reside. By making use of such elements<br />

to host applications, it is possible to provide the benefits of<br />

distributed architecture while minimizing the number of devices to<br />

be managed and maintained. Zero-touch deployment is crucial.<br />

Event logging is necessary to support post mortem analyses of<br />

various kinds. With the volume of events generated by a <strong>Smart</strong> <strong>Grid</strong>,<br />

management of the event logs is a large issue; therefore, care must<br />

be taken for selecting consistent mechanisms across the enterprise.<br />

Proprietary applications are difficult to integrate and generally<br />

defeats system-of-systems primary design principles.<br />

Integration with the management services architecture is necessary<br />

to make distributed application architecture operations feasible.<br />

Decoupling and externalizing business rules can provide a number of<br />

advantages: variable logic can easily be changed, duplication of logic<br />

at multiple places can be avoided, and discovery of and fixing<br />

miscreant rules can be simplified.<br />

Minimum customization of COTS allows version upgrades and<br />

enhancements.<br />

Application development lifecycle management through integrated<br />

development platform enables disciplined application development.<br />

Data needs to be made available in a timely and accurate form, and<br />

must be captured and validated.<br />

<strong>Architecture</strong> governance enables fundamental aspects of service<br />

oriented architecture, which provides inputs vital to the development<br />

of the application architecture.<br />

This is vital to the development of the application architecture, since<br />

common services are significant providers of support functions.<br />

Sometimes a “chicken or egg” conundrum, however, for enterprises<br />

with an immature SOA infrastructure.<br />

Basic service repository mechanisms can reduce integration cost and<br />

help in business flexibility.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 20


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Specification<br />

Enterprise class service: development of services<br />

used across the enterprise shall trump the<br />

development of similar or duplicative services<br />

provided solely to a particular organization.<br />

For low latency applications, implementation shall<br />

be located at or very near the data source(s) and<br />

the primary outputs destination(s),<br />

Software and hardware shall conform to defined<br />

standards that promote interoperability for data,<br />

applications, and technology.<br />

Unique version namespaces shall be used for<br />

service versioning.<br />

Modular design shall be used wherever possible<br />

(moving away from monolithic systems).<br />

Multiple channels supporting client application<br />

delivery shall be available, with an ability to tailor<br />

the delivery mechanism to the client.<br />

ICT shall plan, design, and construct for growth and<br />

expansion of services across the <strong>Smart</strong> <strong>Grid</strong>.<br />

The federated architecture shall promote reduced<br />

complexity and enable integration to the maximum<br />

extent possible through adoption of standards.<br />

The architecture shall be based on a design of<br />

services mirroring real-world business activities<br />

managed by the enterprise business processes.<br />

Justification<br />

Duplicate capability is expensive to build and maintain. It also poses<br />

challenges in maintaining data integrity.<br />

This is a direct consequence of the distributed nature of power grids<br />

and their control systems. The requirement avoids hops to and from<br />

remote processing centers. Embedded processing is used, but the<br />

actual application is downloadable.<br />

Standards help ensure consistency, thus improving the ability to<br />

manage systems, improve user satisfaction, protect existing IT<br />

investments, maximize return on investment and reduce costs.<br />

Standards for interoperability help ensure support from multiple<br />

vendors for an asset, and facilitate supply chain integration.<br />

Application programming interface versioning is a common problem<br />

in the design of any distributed system, and services are no<br />

exception, they must be versioned for correctness and manageability.<br />

Modular design provides flexibility in design and helps in scaling a<br />

solution. A solution's overall functionality can be decomposed into<br />

smaller functional building blocks and, ideally, perform only one<br />

conceptual function.<br />

Consumers, partners and field force want channel of service delivery<br />

to fit their individual preferences and circumstances. Having multichannel<br />

access protects against single point of access failure.<br />

Application architecture and design must plan for growth to provide<br />

business flexibility.<br />

Complex application systems with many data and transactional<br />

functions are difficult to manage and risky to change. Applications<br />

with tightly coupled modules risk creating a dependency failure.<br />

Service orientation delivers enterprise agility and boundary-less<br />

Information Flow.<br />

<strong>Architecture</strong> Standards and Technology Recommendations<br />

The following tables of architecture standards and technology recommendations are provided to the<br />

smart grid architect as references. Over time, however, innovations will inevitably diminish their<br />

completeness. The architect should always research the latest information on these topics, but these<br />

should provide a good starting point. Table 2 lists the most important 2011 standards, while Table 3<br />

lists technology recommendations, with brief explanations of their purpose or relevance.<br />

Table 2 - Applicable Application Standards<br />

Standards<br />

Distributed<br />

Network Protocol<br />

(DNP3)<br />

IEC 60870-6<br />

Purpose/Relevance/Comments<br />

Defines a set of communications protocols used between components in process automation systems.<br />

This protocol facilitates communications between various types of data acquisition and control<br />

equipment and plays a crucial role in SCADA systems.<br />

Describe the Inter-Control Center Protocol (ICCP) for data exchange between control centers.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 21


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Standards<br />

COMTRADE<br />

IEC 61850<br />

IEC 61968, 61970<br />

IEC CIM GID<br />

Interface Services<br />

(GDA, HSDA,<br />

TSDA, GSE)<br />

IEC Common<br />

Information<br />

Model<br />

IEEE 37.118<br />

NRECA<br />

Multispeak<br />

Web Services<br />

Standards (SOAP,<br />

WSDL, WS-*<br />

specification)<br />

XML<br />

ZigBee <strong>Smart</strong><br />

Energy Profile<br />

Purpose/Relevance/Comments<br />

Common Format for Transient Data Exchange. It is intended for use by digital-computer-based devices<br />

which generate or collect transient data from electric power systems. This standard facilitates<br />

exchange of the transient data for the purpose of simulation, testing, validation, or archival storage.<br />

For designing electrical substation automation.<br />

Describe the business functions, business sub-functions and abstract components for distribution<br />

management and set of applications for energy management system.<br />

Four services associated with IEC CIM for data interchange in four classes: generic data, high speed<br />

data, time series, and events<br />

Primary schema for data representation; should also be applied to analytics outputs, which in<br />

themselves are treated as data for purposes of transport, persistence, and interface to various<br />

consuming systems.<br />

Define Phasor Measurement data<br />

Defines what data need to be exchanged between software applications in order to support the<br />

business processes commonly applied at utilities. This leverages definitions of common data semantics,<br />

definitions of message structure and definition of which messages are required to support specific<br />

business process steps.<br />

For defining interfaces and standards for interoperable system integration and service oriented<br />

architecture.<br />

For message oriented integration.<br />

It enables wireless communication and control between utility companies and common household<br />

devices such as smart thermostats and appliances.<br />

Table 3 - Application Technology Recommendations<br />

Application Technology<br />

Application/transaction<br />

processing server<br />

Business Process Engine<br />

Business process<br />

integrator<br />

Business rules engine<br />

Connector framework<br />

Enterprise Service Bus<br />

(ESB)<br />

Event processing<br />

Integration middleware<br />

Load balancers<br />

Message gateway<br />

Message queue<br />

SOA governance tool<br />

Web portal<br />

Web servers<br />

Purpose/Relevance/Comments<br />

A middleware software component dedicated to efficient execution of programs supporting<br />

application construction.<br />

Implements Business Process Execution Language (WS-BPEL) for process choreography.<br />

Automates and optimizes business processes, within the organization and across the customers,<br />

partners, and supply chains.<br />

Software executing one or more business rules in a runtime production environment.<br />

Allows data access from diverse sources.<br />

Software providing complex architectures with fundamental services via an event-driven and<br />

standards-based messaging engine. Foundational capabilities include invocation, routing,<br />

mediation, protocol transformation, process choreography, service orchestration, complex<br />

event processing, and QOS measures (reliable delivery, transaction management, & security)<br />

Handles messaging resulting from pre-defined circumstances occurring across the enterprise.<br />

Allows data contained in one database to be accessed through another.<br />

Provides techniques for distributing workload evenly across two or more servers.<br />

An integrated suite of components for an easy-to-use entry point to all enterprise business info<br />

Allows independent and potentially non-concurrent applications on a distributed system to<br />

communicate with each other.<br />

SOA control and management tools (service interface management & discovery, monitoring)<br />

Integrates and presents information from diverse sources in a unified way.<br />

Delivers content (web pages) using the Hypertext Transfer Protocol (HTTP), over the web<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 22


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Analytics Services<br />

<strong>Smart</strong> grid analytics generally reside within the cross domain foundational services box in the lower<br />

right area of Figure 9 - Layered Services Tier View. Analytics provide the services needed to make<br />

sense out of the data being created by smart grid sensors (smart meters, grid components, energy<br />

management devices, etc.). Analytic tools are designed to turn large amounts of structured and<br />

unstructured data into information useful to humans (consumers, utility operators, regulators) and<br />

smart grid control mechanisms (demand response, outage management, advanced load controls).<br />

Analytics Logical Model<br />

The Analytics Logical Model [Figure 12] consists of three views: (1) analytics synergy, (2) analytics<br />

services stack, and (3) analytics component.<br />

Figure 12 - Analytics Logical Model<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 23


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The synergy model illustrates a key concept of <strong>Smart</strong> <strong>Grid</strong> architecture: the manner in which data<br />

sources from the grid produce data which, when processed in multiple ways through multiple<br />

analytics, can support multiple business outcomes. Therefore, data sources (sensors) and analytics<br />

processing tools and components can and should be shared over multiple capabilities. By arranging the<br />

architecture to take advantage of the synergy, the <strong>Smart</strong> <strong>Grid</strong> architect can minimize infrastructure cost<br />

while maximizing realized business value of the sensing and analytics elements of the <strong>Smart</strong> <strong>Grid</strong>.<br />

While the synergy model is complex and can be difficult to understand, it has the potential for high<br />

payback. In this synergy model diagram, data sources are arrayed at the bottom. Data from these<br />

sources falls into one or more of four data classes as shown in the second tier. In the third tier, six<br />

classes of analytics (process data from the data sources according to data class. In the top tier, analytics<br />

support one or more utility business processes. Line coloring does not have a special meaning except to<br />

make line groupings somewhat easier to follow on a crowded diagram. Finally, because visualization is<br />

pervasive, it is shown as a blue box in the synergy model third tier, essentially underlying all of the<br />

analytics classes, signifying their use in GUI-based decision support.<br />

Analytics Structural Model<br />

The analytics services structural model [Figure 13] is provided to help the smart grid architect consider<br />

how to best deploy the various analytics services using a stylized representation of a typical utility<br />

network infrastructure. At the top of the model are elements needed to support external agencies<br />

(regulators, interchange and balancing authorities, etc.). At the bottom are the analytics services needed<br />

by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a<br />

dozen other tiers where analytics services may be located to support residing devices and functionality.<br />

A self-describing template used for this model is on the last page of Appendix B, Services Classes<br />

Concepts. Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 24


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 13 - Analytics Structural Model<br />

The Analytics Structural Model illustrates how analytics functionality can be distributed across a <strong>Smart</strong><br />

<strong>Grid</strong>. This is important to the smart grid architect because a distributed architecture can address issues<br />

of latency, scale, and robustness. There are many places on the grid where analytics elements may<br />

reside, and a key aspect of smart grid architecture is to develop a proper combination of distributed<br />

and centralized analytics elements. There are significant tradeoffs between the degree to which<br />

analytics are distributed and the resulting requirements for communications services, as well as data<br />

services. Furthermore, the distribution of analytics must be coordinated with the control architecture,<br />

since some analytics are consumed by controls systems which are also distributed and require the<br />

analytics as inputs on a low-latency basis.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 25


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Analytics <strong>Architecture</strong> Specifications<br />

Table 4 is a list of general analytics specifications. The justification for each is provided to enhance the<br />

reader’s understanding of each specification.<br />

The table does not include detailed business or technical requirements a specific analytics tool would<br />

fulfill. Each utility must include requirements for analytics services in every relevant smart grid project.<br />

Table 4 - Typical Analytics Specifications<br />

Specification<br />

Analytics shall be dynamically re-distributable – a service to<br />

manage the re-distribution must be included in the analytics<br />

architecture.<br />

Analytics services shall be centrally and uniformly managed. The<br />

management mechanism should be integrated with the general<br />

network and grid device management services.<br />

Analytics services shall be deployable in a distributed fashion.<br />

Places on the grid for analytics deployment include:<br />

Data centers<br />

Control centers<br />

Substations<br />

Mobile devices<br />

Edge devices, including meters, gateways<br />

Communications devices<br />

Cloud services (private and third party)<br />

Distribution feeder power system devices<br />

Analytics shall be distributed according to a latency hierarchy.<br />

Some analytics will be implemented close to data sources and<br />

consumers, while others can be implemented at control centers<br />

or data centers. Analytics associated with protection and control<br />

should be distributed; analytics for asset health and stress<br />

accumulation can be centralized. Analytics for grid state should be<br />

distributed. Analytics for consumer behavior can be centralized.<br />

<strong>Smart</strong> grid analytics services architecture shall include analytics<br />

tool management. Such tools include those that enable the<br />

development and deployment of rules for event processing<br />

engines, configuration tools for computational analytics, and<br />

workbenches for tools highly interactive in nature.<br />

Data quality monitoring for low latency analytics shall be<br />

incorporated into the analytics service at the point of deployment<br />

for immediate detection of data channel failures.<br />

The control systems architecture shall be developed as a<br />

Justification<br />

Analytics change as the <strong>Smart</strong> <strong>Grid</strong> evolves and it is<br />

impractical to physically visit distributed analytics<br />

elements to make changes.<br />

It is impractical to use a distributed architecture that<br />

requires field frequent visits to devices, in fact, Zero<br />

Touch deployment is necessary for <strong>Smart</strong> <strong>Grid</strong>s at<br />

scale. Integration with the management services<br />

architecture for distributed architecture operations to<br />

be feasible.<br />

Wherever data is generated or information consumed<br />

is a location candidate for appropriate analytics.<br />

Communication network elements hosting additional<br />

software are also good candidates, since generally<br />

these elements are where data sources and consumers<br />

reside. Use of these to host analytics makes it possible<br />

to provide the benefits of distributed architecture<br />

while minimizing the number of devices to be managed<br />

and maintained. Zero-touch deployment is crucial.<br />

The tradeoff between degree of distributed<br />

intelligence and communications requirements is one<br />

of the most significant decisions smart grid architects<br />

must make. This tradeoff must be made early in the<br />

design process and revisited periodically as the grid<br />

transformation proceeds.<br />

As the utility transforms its grid, forms and uses of<br />

analytics will change. In addition, new analytics are<br />

being developed as grid data becomes available. The<br />

utility must not expect analytics deployment to remain<br />

static. Thus, having access to the appropriate tools to<br />

manage the analytics transformation is crucial.<br />

Many data acquisition devices suffer data channel<br />

failures with the device not generating a fault alarm.<br />

Since the data may be used in a real-time mode, it is<br />

necessary to have ways to detect faulty data in realtime.<br />

This must be done at or near the source since<br />

much of this data will never reside in a database. In<br />

addition, real-time control may depend on the<br />

correctness of this data and the consequent analytics.<br />

Since controls consume analytics widely, the control<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 26


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

precursor to the analytics services architecture development.<br />

Comprehensive data access strategy, grid observability strategy<br />

and sensor architecture shall be developed to support the<br />

development of the analytics services architecture.<br />

Distributed analytics in hierarchical analytics services architecture<br />

shall be designed to reduce data volumes for data moving from<br />

edge devices up through successive layers of data management<br />

and analytics to the points of data persistence. This is one of the<br />

points of intersection between analytics services architecture and<br />

communications services and data services architectures. Note<br />

that this type of volume reduction does not apply to usage<br />

(meter) data. Aggregation of non-usage analytics should generally<br />

be homologous with the disaggregation of control signals (see<br />

Control section).<br />

Distributed analytics shall provide logging capabilities for<br />

evaluating analytics operation. This includes event processing, and<br />

the management of analytics logs is a significant data services<br />

architecture issue.<br />

Multiple deployment models to implement analytics shall be used<br />

for distributed analytics including standalone, hierarchical, and<br />

peer models. Event analytics may be broken into event stream<br />

processing at endpoints, feeding higher level complex event<br />

processing at substations, control centers, and data centers.<br />

For low latency analytics, implementations shall be located at or<br />

very near the source(s) of data and the primary outputs<br />

destination(s), without sending data to and from remote<br />

processing centers. Embedded processing shall be used, but the<br />

actual analytics must be downloadable.<br />

Information-sharing among distributed analytics is often<br />

necessary; <strong>Smart</strong> <strong>Grid</strong> analytics services architecture shall include<br />

a real-time distributed data sharing mechanism. This is essential<br />

for access to a global grid state, which is needed not only by<br />

analytics, but also by control and other applications.<br />

Interface of distributed analytics services at the system level<br />

requires that analytics be treated in two ways: as data bound for<br />

data persistence (data stores) and as streams (synchronous or<br />

asynchronous) bound for consumption by applications in realtime.<br />

In some cases, the analytics outputs will be treated both<br />

ways simultaneously, leading to implications for data and<br />

communications services architecture.<br />

As-operated grid connectivity shall be made available to analytics<br />

requiring grid context (grid state), each analytic sensitive to grid<br />

topology must have the correct grid state time-aligned with the<br />

formation of the data or event upon which the analytic depends.<br />

Security shall be part of analytics services design. This includes:<br />

Permissions for source and target data sources<br />

Permissions to execute on centralized and distributed locations<br />

systems architecture is a vital analytics design input.<br />

Provides inputs vital to the development of the<br />

analytics architecture, due to the infrastructure<br />

optimization problem discussed in the section for the<br />

analytics structural model.<br />

The point is that analytics extract key information,<br />

generally resulting in a data volume reduction while<br />

maintaining essential information. In some cases, raw<br />

data may be retained and persisted for later analysis<br />

based on application-specific trigger conditions, but<br />

generally lower latency analytics will consume raw data<br />

and pass along information to either consuming<br />

applications, or higher level analytics. This may not be<br />

feasible in non-hierarchical analytics services<br />

architectures (tier-based data volume management).<br />

Event logging is necessary to support post mortem<br />

analyses of various kinds. With the volume of events<br />

that can be generated in a <strong>Smart</strong> <strong>Grid</strong>, management of<br />

the event logs is a large issue.<br />

It is important to recognize that distributed analytics<br />

elements do not have to be functionally complete in<br />

themselves; it is often more useful for elements to<br />

compute partial results and the either forward them<br />

upward into a hierarchy or exchange partial results<br />

with other distributed elements.<br />

This is a direct consequence of the distributed nature<br />

of power grids and their control systems.<br />

Electrical effects propagate across the grid at very high<br />

speeds and with wide reach. Effects at the distribution<br />

level can affect transmission and vice versa. <strong>Grid</strong> state<br />

and other data may be needed almost anywhere to<br />

support analytics and control.<br />

Some analytics operate on telemetry, but are not used<br />

for real-time operations. They may be monitored by<br />

agents or simply archived for batch processing to<br />

support various business processes. Consequently,<br />

there are both communications and data services<br />

implications that must be coordinated by the smart<br />

grid architect.<br />

This problem is fundamental due to the frequent<br />

topology changes to distribution grids. It is also an<br />

issue for wide area measurement systems. For many<br />

processes it is possible for the grid topology to change<br />

before a prior event or datum is processed, so past<br />

values of grid topology must remain available.<br />

This set of security and management features must be<br />

integrated with the overall security and management<br />

architectures. For implementations of distributed<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 27


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Permissions for analytics to communication to other analytics<br />

Permissions for users to access the dashboards or KPI<br />

Permissions on who can modify/start/stop/deploy analytics<br />

Tools for tracking changes in the actual analytical algorithms<br />

Visualizations are analytics for the eye/brain; therefore,<br />

visualization shall be a part of analytics services architecture.<br />

analytics such as multi-agent systems and others<br />

providing downloadable, zero-touch capability, it is<br />

crucial that the downloadable elements be verifiably<br />

legitimate via certificates, etc.<br />

The smart grid architect should treat visualization as an<br />

integral part of the analytics architecture. Visualization<br />

is needed at many grid levels and locations; treating it<br />

as a separate centralized function can lead to difficulty<br />

in uniformly providing the service.<br />

<strong>Architecture</strong> Standards and Technology Recommendations<br />

Technologies will evolve as a utility’s <strong>Smart</strong> <strong>Grid</strong> transformation takes place over a period of many<br />

years. Changes in analytics services technologies are inevitable. As of this writing, a number of<br />

technologies and standards are appropriate for implementing analytics services. Table 5 lists these<br />

standards with their purpose or relevance; Table 6 similarly lists the in-place or emerging technologies.<br />

Table 5 - Recommended Analytics Standards<br />

Standards<br />

IEC 61850 GOOSE messaging<br />

IEC CIM GID Interface Services<br />

(GDA, HSDA, TSDA, GSE)<br />

IEC Common Information Model<br />

IEEE Computer Society FIPA<br />

(Foundation for Intelligent Physical Agents)<br />

Purpose/Relevance/Comments<br />

For use in low latency protection and control messaging, where analytics<br />

outputs are being used in applications such as adaptive protection and real<br />

time grid stabilization<br />

Four services associated with IEC CIM for data interchange in four classes:<br />

generic data, high speed data, time series, and events<br />

Primary schema for data representation; should also be applied to analytics<br />

outputs, which in themselves are treated as data for purposes of transport,<br />

persistence, and interface to various consuming systems.<br />

For analytics implementations using multi-agent systems<br />

Table 6 - Recommended Analytics Technology<br />

Analytics Technology<br />

Data mining<br />

Digital signal processing<br />

Event stream/complex<br />

event processing<br />

OLAP/Cubing/Dashboard<br />

s<br />

Phasor/power system<br />

calculation processing<br />

Statistical analyses<br />

Visualization<br />

Purpose/Relevance/Comments<br />

Needed to analyze vast volumes of grid data to detect and extract underlying patterns and<br />

models<br />

Needed to extract information from low level grid data such as waveforms and sensor telemetry<br />

Needed to filter, throttle, correlate, and extract situational understanding from multiple<br />

asynchronous event streams from up to millions of grid devices; management of event stream<br />

bursts.<br />

These are visualization tools for data trending and status indication. Such tools should be<br />

connected via appropriate security services to data and analytics output feeds from the control<br />

center, as well as data residing in enterprise databases.<br />

Necessary to support a wide range of real time analytics involving grid state, device utilization,<br />

power flow and load control, and fault analysis<br />

a variety of statistical analysis tools may be applied to problems such as demand and variable<br />

energy resources modeling, as well as customer behavior modeling.<br />

Crucial to translate both data and numerical analytics into forms readily comprehended by<br />

humans for decision support; typically coupled with geospatial and grid topology information<br />

for context; also includes graphics for trending and forecasting on sensor telemetry<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 28


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Data Services<br />

<strong>Smart</strong> grid data services generally reside within the cross domain foundational services box in the<br />

lower right area of Figure 9 - Layered Services Tier View (labeled Data Management Services).<br />

Data Services Logical Model<br />

The Data Services Logical Model [Figure 14] consists of three views: (1) data services synergy, (2) data<br />

services stack, and (3) data management component.<br />

Consumers/<br />

Processes<br />

Data Management Services<br />

Data Classes<br />

Sources<br />

Analytics<br />

SCADA<br />

Data Discovery<br />

System Mgmt<br />

Data<br />

Data Indexing and<br />

<strong>Reference</strong><br />

Data Collection<br />

MDM<br />

Data Services Synergy Model<br />

Protection<br />

Equipment<br />

Unstructured<br />

Content<br />

Data Registration and Life<br />

Cycle Management<br />

Customer<br />

Interface<br />

Enterprise Application<br />

Third<br />

Parties<br />

Data Access & Update<br />

External<br />

Data Feeds<br />

B2B<br />

Field<br />

crews<br />

Consumer Service<br />

Content Management<br />

Master Data Management Data Transformation Data Flow Orchestration<br />

Data Quality and Integrity<br />

Data Storage<br />

IVR/Call<br />

Center<br />

Data Manipulation<br />

Data Security<br />

Operational Data Time Series Data Event Data Records Meta Data<br />

Enterprise<br />

Application<br />

Data Services Stack Model<br />

Foundation<br />

Core<br />

Integration<br />

Visualization<br />

Analysis<br />

Reporting<br />

Network state estimation<br />

Electrical Network model<br />

Measurement model<br />

CIM/61850 interface<br />

Customer information<br />

Premises information<br />

messaging<br />

transformation<br />

encryption<br />

Support Services<br />

governance<br />

transport<br />

storage<br />

Network measurements<br />

Geospatial information<br />

Manually entered information<br />

(inspections, readings, etc.)<br />

Market operations signals<br />

Market operations model<br />

Asset catalogue<br />

Compatible units<br />

Asset data<br />

Edge device model<br />

data access<br />

data synchronization<br />

master data management<br />

access control services<br />

semantic model management<br />

message & service definition<br />

Data Management Component Model<br />

Meta Data<br />

Management<br />

Semantic Model<br />

Management<br />

ETL ESB EII<br />

Persistent Data<br />

Storage<br />

Archive<br />

Figure 14 – Data Services Logical Model<br />

The synergy model (upper left area of Figure 14) shows how <strong>Smart</strong> <strong>Grid</strong> ICT must simultaneously<br />

manage data from many sources to support multiple business outcomes. Data must therefore be<br />

decoupled from data sources to allow sharing of both the data and the components used for moving,<br />

manipulating and storing it. By arranging the architecture to leverage this synergy, the <strong>Smart</strong> <strong>Grid</strong><br />

architect can minimize infrastructure cost while maximizing the realized business value of enterprise<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 29


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

<strong>Smart</strong> <strong>Grid</strong> information management. The Synergy Model has the primary data sources arrayed at the<br />

bottom. Data from these sources fall into one or more of the five data classes depicted in the second<br />

tier. In the third tier, key data management services of the Utility Services Layer and the Core Business<br />

Services Layer process data from the data sources according to data class. In the top tier, various<br />

business processes and consumers leverage the data management services to accomplish higher level<br />

business functions. Line coloring does not have a special meaning except to make line groupings easier<br />

to follow on the crowded diagram. Pervasive security is represented as a blue box in the model’s third<br />

tier, underlying all data management services.<br />

In the data service stack model (upper right area of Figure 14), the core grouping is an abstraction of<br />

capability services types (refer to the discussion of services in Appendix B). These services focus on<br />

business capabilities and are intended to be independent of any particular business process. The stack<br />

model also contains services from the process service and solution service layers used to accomplish<br />

higher level services within the foundation grouping. These foundational services, as well as lower<br />

service layers, are used by the consumers/processes tier of the synergy model to accomplish needed<br />

business functionality.<br />

Data Services Structural Model<br />

The data services structural model [Figure 15] illustrates how data services can be distributed across a<br />

smart grid. This is important to the smart grid architect because distributed data architecture can<br />

address issues of data access, storage, transformation, latency, encryption, and synchronization within<br />

and across layers in the physical grid. While traditionally these services have been concentrated in data<br />

and control centers, in a smart grid these distributed data services will reside in substations, field<br />

devices, and in various network locations from the end use premises to the control center. A selfdescribing<br />

template used for this model is on the last page of Appendix B, Services Classes Concepts.<br />

Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 30


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 15 - Data Services Structural Model<br />

Data <strong>Architecture</strong> Specifications<br />

Table 7 is a list of general data specifications. The justification for each is provided to enhance the<br />

reader’s understanding of each specification.<br />

Table 7 - Typical Data Services Specifications<br />

Specification<br />

A semantic model shall be built to create and<br />

maintain common business definitions,<br />

business rules (requirements), and metadata.<br />

Data classification shall be performed.<br />

Justification<br />

The creation of common business definitions will facilitate<br />

communications in all directions within the organization. This should be<br />

accomplished as an integral part of incrementally building the enterprise<br />

semantic model.<br />

Classify data for security and management purposes.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 31


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Specification<br />

Data Enrichment shall be provided where<br />

necessary.<br />

Data integration shall be provided.<br />

Data movement shall be provided.<br />

Data quality and integrity shall be source<br />

guaranteed.<br />

Appropriate security shall be applied to data.<br />

Data shall not be tied to applications<br />

Appropriate access shall be provided to data<br />

sources<br />

Data synchronization shall be supported<br />

where necessary.<br />

Data transformation shall be provided where<br />

necessary.<br />

Data shall be validated as appropriate.<br />

Data Object Indexing and referencing shall be<br />

provided.<br />

Data growth shall be managed.<br />

Master data management shall be provided.<br />

Methods shall be provided for understanding<br />

and removing data duplication<br />

Justification<br />

Enrich the data by supplementing it with other sources as needed and per<br />

the understood the business process that is implemented<br />

Integration data for process automation and business transactions.<br />

Enable data to move from one source to another.<br />

Ensure that the data is guaranteed by the source to be of primary source<br />

quality and not derived or distorted by secondary views.<br />

Provide security for data in accordance with its classifications. Security<br />

activities include authentication and authorization, logging, and control.<br />

Data should be made available as master data. A single view of data<br />

should exist across the enterprise – shared, complete, and accurate.<br />

Provide access to data sources, either through application or directly,<br />

while maintaining appropriate security.<br />

Synchronize data instance and content for multiple systems of same data.<br />

Transform data from one semantic and syntax to another.<br />

Validate data in accordance with defined business rules.<br />

Centralize a robust means of translating data object identifications<br />

between disparate systems.<br />

Adhering to EIM practices will avoid having the same data expressed in<br />

multiple ways, each with the same or similar meaning. Data growth is also<br />

managed by understanding what data must be retained for what periods<br />

of time and within which physical data stores and systems.<br />

Ensure consistent master information across transactional and analytical<br />

systems.<br />

Have repeatable rules definition for guaranteeing data quality.<br />

Data <strong>Architecture</strong> Standards and Technology Recommendations<br />

The following table of data standards and technology recommendations is provided to the smart grid<br />

architect for reference. Over time, however, innovations will inevitably diminish its completeness. The<br />

architect should always research the latest information on these topics, but this table is a good starting<br />

point. Table 8 lists important 2011 standards and technology recommendations applicable to data<br />

services, each with a brief explanation of their purpose or relevance.<br />

Table 8 - Data Standards and Technology Recommendations<br />

Standards<br />

Applicable functional<br />

standards of the IEC<br />

61968 and 61970 series<br />

of standards<br />

IEC 61850<br />

IEC 61968-11<br />

Purpose/Relevance/Comments<br />

Industry standard message payloads are defined using XSD and RDF. Canonical Data Models<br />

(CDMs) of a utility may be compliant with, or based of (if extensions are required) these industry<br />

standard message payloads.<br />

Object oriented protocol for retrieving data and controlling devices at substations and along<br />

feeder networks.<br />

System Interfaces For Distribution Management Part 1 Interface <strong>Architecture</strong> and General<br />

Requirements<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 32


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Standards<br />

Purpose/Relevance/Comments<br />

IEC 61968-11 and IEC IEC Common Information Model. Information model for data representation which is used as a<br />

61970-301<br />

basis for defining industry standard application interfaces.<br />

MultiSpeak<br />

The MultiSpeak project is funded by National Rural Electric Cooperative Association (NRECA). It<br />

defines standardized interfaces among software applications commonly used by electric utilities.<br />

It defines details of data that need to be exchanged between software applications in order to<br />

support different processes commonly applied at utilities.<br />

OASIS UDDI<br />

Universal Description, Discovery and Integration (UDDI) is a platform-independent, Extensible<br />

Specification<br />

Markup Language (XML)-based registry is a mechanism to register and locate web service<br />

applications.<br />

Simple Object Access SOAP, originally defined as Simple Object Access Protocol, is a protocol specification for<br />

Protocol (SOAP) exchanging structured information in the implementation of Web Services in computer networks.<br />

It relies on Extensible Markup Language (XML) for its message format, and usually relies on other<br />

Application Layer protocols, most notably Remote Procedure Call (RPC) and Hypertext Transfer<br />

Protocol (HTTP), for message negotiation and transmission. SOAP can form the foundation layer<br />

of a web services protocol stack, providing a basic messaging framework upon which web services<br />

can be built. This XML based protocol consists of three parts: an envelope, which defines what is<br />

in the message and how to process it, a set of encoding rules for expressing instances of<br />

application-defined data types, and a convention for representing procedure calls and responses.<br />

W3C XML Specification Extensible Markup Language (XML) is a set of rules for encoding documents in ... in the XML 1.0<br />

Specification produced by the W3C.<br />

WSDL<br />

WSDL is an XML-based language for describing Web services and how to access them.<br />

WS-I Basic Profile The WS-I Basic Profile (official abbreviation is BP), a specification from the Web Services<br />

Interoperability industry consortium (WS-I), provides interoperability guidance for core Web<br />

Services specifications such as SOAP, WSDL, and UDDI. The profile uses WSDL to enable the<br />

description of services as sets of endpoints operating on messages.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 33


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Control Services<br />

<strong>Smart</strong> grid control services generally reside within the cross domain foundational services box in the<br />

lower right area of Figure 9 - Layered Services Tier View.<br />

Control Services Logical Model<br />

The Control Services Logical Model [Figure 16] has three views: control synergy, control services stack,<br />

and control component.<br />

Figure 16 - Control Services Logical Model<br />

The synergy model diagram (upper left area of Figure 16) is the most complex, containing four tiers.<br />

The bottom two tiers match the analytics synergy model described previously. The third tier consists of<br />

key smart grid control services. The top tier shows control-oriented business processes. At the bottom<br />

of the second tier, connectors illustrate how various grid devices create data for use in control. Line<br />

color is only for the purpose of visual clarification – the colors do not signify any special property or<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 34


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

characteristic. The synergy model diagram highlights several crucial issues for the smart grid architect<br />

to analyze:<br />

Need for grid state aggregation and publication.<br />

Use of multi-controller, multi-objective control inherent in smart grid design using grid data<br />

sources to support multiple business processes via processing of multiple analytics.<br />

Federation of control systems as a consequence of multi-controller, multi-objective control.<br />

Disaggregation of control command at the device level. This must take into account the<br />

actual grid topology at the time of control actuation, as well as various grid state variables.<br />

These significantly impact the design of controls, communications, sensor, and analytics architectures.<br />

Control Services Structural Model<br />

The control services structural model [Figure 17] is provided to help the smart grid architect consider<br />

how to best deploy the various control services using a stylized representation of a typical utility<br />

network infrastructure. At the top of the model are elements needed to support external agencies<br />

(regulators, interchange and balancing authorities, etc.). At the bottom are the control services needed<br />

by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a<br />

dozen other tiers where control services may be located to support residing devices and functionality.<br />

A self-describing template used for this model is on the last page of Appendix B, Services Classes<br />

Concepts. Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 35


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 17 - Control Services Structural Model<br />

Control <strong>Architecture</strong> Specifications<br />

Table 9 is a list of general control specifications. The justification for each is provided to enhance the<br />

reader’s understanding of each specification.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 36


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Table 9 - Typical Control Specifications<br />

Specification<br />

Control signals must be disaggregated in a hierarchical manner<br />

in parallel to both the general structure of the power grid and<br />

the aggregation of analytics and grid state (see Analytics<br />

section).<br />

Control system architecture must provide means to control<br />

systems not part of the grid itself.<br />

Control system must integrate adaptive protection at both<br />

transmission and distribution levels.<br />

Control systems for demand response and DER control must<br />

provide for dispatch from the balancing authority; control<br />

signals must be disaggregated to the distribution substation<br />

level, and from there to the feeder device and premises level.<br />

IVVC must be coordinated with DR at the distribution feeder<br />

level, so the control architecture must provide for control<br />

disaggregation and recalculation at multiple levels in the grid.<br />

Control systems must have access to grid state determined by<br />

both wide area measurement as well as deep measurement;<br />

deep measurement means grid state at the distribution and<br />

premises levels must be part of extended grid state; the control<br />

system architecture must provide for wide distribution of grid<br />

state across control elements.<br />

Control systems must support both event-driven functions and<br />

closed loop servo functions. Close loop servo control<br />

architecture must accommodate multiple time scale operation,<br />

so control architectures must provide means for complex<br />

feedback and feed forward.<br />

For grids where stabilization or compensation is required at the<br />

distribution level, the control system shall be capable of<br />

operating with a complete closed loop path execution in less<br />

than two power cycles.<br />

<strong>Grid</strong> state determination for wide area measurement and wide<br />

area control shall depend to the maximum degree possible on<br />

actual measurement, with the minimum estimation necessary<br />

to complete the grid state view. Control system architecture<br />

must distribute grid state across control systems elements in<br />

real time in a secure manner.<br />

Justification<br />

All grid systems are interconnected through the analog<br />

power grid with many interactions. To provide the means<br />

to reconcile control commands and eliminate<br />

undesirable interactions, the grid structure must guide<br />

control signal disaggregation. Control system<br />

architecture not providing for disaggregation at the<br />

various levels of the grid hierarchy will limit the ability of<br />

control system designers to solve interaction problems.<br />

Secondary load control for Demand Response and<br />

integration of DER, microgrids, and PEV charging<br />

stations/networks requires utility interface due to<br />

interactions resulting in grid management issues.<br />

The increasing penetration of secondary load control<br />

systems causes interactions, including non-outage cold<br />

load pickups requiring dynamic modification of<br />

protection settings based on both grid state and control<br />

actions.<br />

Without the proper disaggregation, interaction between<br />

DR and IVVC can cause grid violations, and can cause DR<br />

to be significantly less effective than expected. Other<br />

interactions of grid controls and secondary load controls<br />

can occur, up to and including wide area blackout.<br />

Extended grid state is the essence of deep situational<br />

awareness and is the primary set of observations driving<br />

control systems. As multiple control sub-systems share<br />

common elements, ubiquitous access to grid state<br />

becomes crucial.<br />

Some control functions can be event based, but other<br />

highly dynamic processes such as stabilization require<br />

continual closed loop control update. With multi-time<br />

scale systems, control loops must be more complex than<br />

simple feedback, so control architecture must support<br />

multi-feedback, multi-time scale operation.<br />

Dynamics of close loop stabilization require much faster<br />

response and much lower latencies than traditional<br />

distribution automation. New control devices are<br />

capable of acting at these speeds (see Control<br />

Technology table below).<br />

Advanced grid controls need access to actual grid state;,<br />

especially at the distribution level where estimation is<br />

effectively impossible. In addition, extended grid state<br />

contains elements not susceptible to estimation, such as<br />

quality state.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 37


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Specification<br />

Multiple control systems must be federated before control<br />

signals are sent to individual devices. The control service<br />

environment shall be a multi-controller, multi-objective<br />

environment.<br />

Power grid control must be a hybrid of centralized and<br />

distributed control elements, with distributed control extending<br />

into substations and to distribution grid elements; control<br />

elements shall be able to use peer-to-peer communication to<br />

cooperate on control tasks and shall be capable of autonomous<br />

operation when communication with higher level controls is not<br />

possible.<br />

<strong>Smart</strong> grid control systems can require cross tier integration;<br />

this may be accomplished in a hierarchical fashion normally or<br />

via “tier-jumping” where very low latency is required. Control<br />

system architecture must allow for cross-tier control solutions.<br />

System models (connectivity models) for transmission,<br />

substations, and distribution are context for control - control<br />

systems must have a means to receive the relevant portions of<br />

connectivity models from the master sources in a secure and<br />

timely manner. Timeliness is dependent on the rate at which<br />

connectivity changes can occur relative to the essential time<br />

constants of the relevant control subsystems.<br />

Teleprotection must be done via packet switching (Ethernetbased)<br />

networks rather than circuit switching networks<br />

Justification<br />

As smart grid functionality increases in sophistication,<br />

more control processes have reasons to access the same<br />

control elements in the grid. Such sharing is important<br />

for economic reasons but the controls must not collide at<br />

the control elements; hence the need for federation in<br />

the architecture to provide resolution mechanisms.<br />

Centralized control is not adequate for fully built out<br />

smart grids; using a combination of centralize and<br />

distributed control elements provides scalability and<br />

robustness while maintaining central supervision and<br />

management of the grid.<br />

<strong>Smart</strong> grid controls are increasingly required to deal with<br />

effects propagating through the grid, including from<br />

distribution to transmission. In addition, some business<br />

models allow for secondary control systems external to<br />

the utility control system and operating across tiers.<br />

System models are context for both analytics and<br />

control; without this context proper control action<br />

cannot be determined.<br />

Tele-protection in a smart grid environment needs<br />

flexibility not available via circuit switching<br />

Control <strong>Architecture</strong> Standards and Technology Recommendations<br />

The following table of control standards and technology recommendations is provided to the smart<br />

grid architect for reference. Over time, however, innovations will inevitably diminish its completeness.<br />

The architect should always research the latest information on these topics, but this table is a good<br />

starting point. Table 10 lists important 2011 standards and technology recommendations applicable to<br />

control services, each with a brief explanation of their purpose or relevance.<br />

Table 10 - Recommended Control Standards and Technology<br />

DNP3<br />

Standards<br />

IEC 60870-5-101,104<br />

IEC 61850 GOOSE messaging<br />

IEC 61850-90-5<br />

IEC CIM GID Interface Services<br />

(GDA, HSDA, TSDA, GSE)<br />

Purpose/Relevance/Comments<br />

Commonly used for communication with grid control devices. May be<br />

operated in native serial fashion, or over IP.<br />

Serial communication for control devices.<br />

For use in low latency protection and control messaging<br />

Draft standard for PMU communications –support for multi-cast<br />

Four services associated with IEC CIM for data interchange in four classes:<br />

generic data, high speed data, time series, and events<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 38


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Standards<br />

IEC Common Information Model<br />

IEEE C37.118<br />

IEEE Computer Society FIPA<br />

(Foundation for Intelligent Physical Agents)<br />

Purpose/Relevance/Comments<br />

Primary schema for data representation; should also be applied to<br />

analytics outputs, which in themselves are treated as data for purposes of<br />

transport, persistence, and interface to various consuming systems.<br />

PMU communications<br />

For control implementations using multi-agent systems<br />

Most grid control devices and control systems are well known. The section below discusses some<br />

advanced control elements and technologies.<br />

Table 11- Advanced Control Elements and Technologies<br />

Control Technology<br />

Distribution level PMU<br />

networks<br />

DSTATCOM<br />

Multi-agent systems<br />

STATCOM / SVC /<br />

FACTS / fast ancillary<br />

storage<br />

VAR-controllable AC-<br />

DC inverters<br />

WAMS/PMU networks<br />

Purpose/Relevance/Comments<br />

Can provide distribution grid state, fault intelligence, asset utilization measurement and outage<br />

intelligence inputs for the relevant control sub-systems.<br />

Distribution STATCOM provides electronic stabilization and dynamic power quality compensation<br />

at the distribution level.<br />

Software technology for implementation of distributed intelligence; can be used to implement<br />

distributed control agents.<br />

Increasingly important for electronic stabilization as grid rotational inertia is decreased through<br />

the displacement of traditional generation with VER. Includes such applications as model power<br />

oscillation damping and frequency compensation.<br />

When used as grid interfaces from DG and microgrids, and when controlled by the utility, these<br />

can provide fast VAR compensation (much faster than capacitors) and can provide much finer<br />

granularity in VAR control.<br />

Provide necessary state measurement for transmission control.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 39


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Security Services<br />

<strong>Smart</strong> grid security services generally reside within the cross domain foundational services box in the<br />

lower right area of Figure 9 - Layered Services Tier View.<br />

Security Logical Model<br />

The Security Logical Model [Figure 18] has three views: the security component, the security services<br />

stack, and security synergy.<br />

Figure 18 - Security Logical Model<br />

The Security Component Model depicts in block format the primary security components used.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 40


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The Security Services Stack Model has several parts:<br />

• Support services – services that may come from another portion or tier of the architecture but<br />

are necessary to support the services in the tier being described<br />

• Foundation services – key security services, generally needed throughout the architecture which<br />

other services depend or expand upon<br />

• Core services – the primary security architecture service stack<br />

• Integration services – services specifically providing integration between security and other<br />

architectural tiers or business systems<br />

The Security Synergy Model illustrates how security services can be shared to meet various <strong>Smart</strong> <strong>Grid</strong><br />

security requirements. If the architecture can take advantage of this synergy, the utility can build cost<br />

effective security infrastructure services, reused across multiple <strong>Smart</strong> <strong>Grid</strong> systems.<br />

Security Structural Model<br />

The security structural model [Figure 19] is provided to help the smart grid architect consider how to<br />

best deploy the various security services using a stylized representation of a typical utility network<br />

infrastructure. At the top of the model are elements needed to support external agencies (regulators,<br />

interchange and balancing authorities, etc.). At the bottom are the security services needed by premise<br />

devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a dozen other<br />

tiers where security services may be located to support residing devices and functionality. A selfdescribing<br />

template used for this model is on the last page of Appendix B, Services Classes Concepts.<br />

Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 41


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 19 - Security Structural Model<br />

The structural model illustrates how security functionality may be distributed across a <strong>Smart</strong> <strong>Grid</strong>. The<br />

<strong>Smart</strong> <strong>Grid</strong> architect needs to work closely with security experts to ensure appropriate security<br />

principles are applied at every level of the <strong>Smart</strong> <strong>Grid</strong> structure. As the grid evolves, millions of new<br />

components will be introduced; each is expected to ensure power systems operations maintain cyber<br />

confidentiality, integrity, and availability. The NIST Interagency Report 7628 (NISTIR 7628), Guidelines<br />

for <strong>Smart</strong> <strong>Grid</strong> Cyber Security: Vol. 1 (NIST-ITL, 2010) provides a <strong>Smart</strong> <strong>Grid</strong> Logical <strong>Reference</strong> Model<br />

with dozens of logical interfaces identified. Chapter 2 and Appendix G of NISTIR 7628 should be<br />

studied to ensure appropriate security attributes are addressed for each logical interface category.<br />

NISTIR 7628 is freely available on the NIST <strong>Smart</strong> <strong>Grid</strong> website: www.nist.gov/smartgrid<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 42


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Security <strong>Architecture</strong> Specifications<br />

NISTIR 7628, Chapter 3, has an extensive listing of high level <strong>Smart</strong> <strong>Grid</strong> security requirements.<br />

Security Standards and Technology Recommendations<br />

The following table of security standards and technology recommendations is provided to the smart<br />

grid architect for reference. Over time, however, innovations will inevitably diminish its completeness.<br />

The architect should always research the latest information on these topics, but this table is a good<br />

starting point. Table 12 lists important 2011 standards and technology recommendations applicable to<br />

security, each with a brief explanation of their purpose or relevance.<br />

Table 12 - Security Standards and Technology Recommendations<br />

Standards<br />

Purpose, Relevance or Comments<br />

Digital Signature (DSS, DSA, RSA, etc.)<br />

Cryptography and network security<br />

DNP3 Secure Authentication<br />

User & device authentication, data integrity protection<br />

Encryption (AES, RSA, etc.)<br />

Facilitates secure (secret) communication<br />

Hash (SHA-1, SHA-256, HMAC, etc.)<br />

Cryptographic hash functions employed in several widely used security<br />

applications<br />

IEC 62351 Utility Communication Security Developed to handle the security of IEC Technical Committee 57<br />

protocols (IEC 61850, 61968, etc.)<br />

IEEE 1686 IED Security<br />

Minimum requirement set for intelligence electronic device security<br />

compliance with NERC CIP requirements<br />

IEEE 1711 Trial Use Standard for a SCADA Serial Cyber Security of substation serial links<br />

Link Cryptographic Modules and Protocol<br />

IPSec<br />

Internet Protocol Security secures IP communications by authenticating<br />

and encrypting each session’s IP packets<br />

NERC Critical Infrastructure Protection (CIP) The NERC Critical Infrastructure Protection program aims to improve<br />

Standards<br />

physical and cyber security for the bulk power system of North America<br />

as it relates to reliability.<br />

Public Key Infrastructure (X.509)<br />

A cryptographic ITU-T standard for a public key infrastructure (PKI) for<br />

single sign-on (SSO) and Privilege Management Infrastructure (PMI)<br />

PubsFIPS<br />

Federal Information Processing Standards (FIPS) Publications - a series<br />

of documents for the U.S. Federal government issued by NIST<br />

TLS<br />

Transport Layer Security, a network protocol and successor to Secure<br />

Sockets Layer (SSL)<br />

Wireless Security (WEP, WPA, etc.)<br />

IEEE 802.1X encryption standards designed to prevent unauthorized<br />

access or damage to computers using wireless networks<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 43


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Communications Services<br />

<strong>Smart</strong> grid communications services generally reside within the cross domain foundational services<br />

box in the lower right area of Figure 9 - Layered Services Tier View.<br />

Communications Services Logical Model<br />

The Communications Services Logical Model [Figure 20] has three views: the communications services<br />

component, communications services stack, and communications services synergy.<br />

Figure 20 – Communications Services Logical Model<br />

The Communications Services Component Model depicts in block format the primary communications<br />

components used in the architecture.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 44


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The Communications Services Stack Model has several parts:<br />

• Support services – services that may come from another portion or tier of the architecture but<br />

are necessary to support the services in the tier being described<br />

• Foundation services – key security services, generally needed throughout the architecture which<br />

other services depend or expand upon<br />

• Core services – the primary communications architecture service stack<br />

• Integration services – services specifically providing integration between communications and<br />

other architectural tiers or business systems<br />

The Communications Synergy Model illustrates how communications services can be shared to meet<br />

various <strong>Smart</strong> <strong>Grid</strong> communications requirements. If the architecture can take advantage of this<br />

synergy, the utility can build a cost effective communications infrastructure services, reused across<br />

multiple <strong>Smart</strong> <strong>Grid</strong> systems.<br />

Communications Services Structural Model<br />

The communications services structural model [Figure 21] is provided to help the smart grid architect<br />

consider how to best deploy the various communications services using a stylized representation of a<br />

typical utility network infrastructure. At the top of the model are elements needed to support external<br />

agencies (regulators, interchange and balancing authorities, etc.). At the bottom are the<br />

communications services needed by premise devices (smart appliances, PEV chargers, building energy<br />

managers, etc.). In between are a dozen other tiers where communications services may be located to<br />

support residing devices and functionality. A self-describing template used for this model is on the last<br />

page of Appendix B, Services Classes Concepts. Included are descriptions of all fourteen tiers used in the<br />

model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 45


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 21 - Communications Services Structural Model<br />

Communications <strong>Architecture</strong> Specifications<br />

Table 13 is a list of general control specifications. The justification for each is provided to enhance the<br />

reader’s understanding of each specification.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 46


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Table 13 - Typical Communications Specifications<br />

Specification<br />

<strong>Architecture</strong> for end-to-end communications shall be divided into functional<br />

subnetworks including the following:<br />

Extranet<br />

Data/Control Center Networks<br />

Two Tier Wide Area Network<br />

Core Network<br />

Backhaul Network<br />

Substation Network<br />

Two Tier Field Area Network<br />

Tier 1 Multipurpose FAN<br />

Tier 2 Purpose-Built FAN<br />

Premises Network<br />

Backhaul Wide-Area Networks Deployment<br />

Design specs shall:<br />

Accommodate tightly controlled access from remote networks<br />

Provide a high degree of security<br />

Provide high network performance primarily using fiber, microwave and<br />

other infrastructures<br />

Provide flexible network segmentation/virtualization capabilities, in support<br />

of a variety of application, security, and geographical domains<br />

Support data, voice, video, and control services<br />

Be based on IPv6 technologies<br />

Support convergence such that, if desired, traffic from one does not harm or<br />

adversely impact traffic from other environments<br />

Operational specs should:<br />

Support key remote locations where grid logic is employed<br />

Be under autonomous control by utility (if private) or accompanied by strict<br />

service-level agreements (if public)<br />

Provide a high degree of network monitoring and system management<br />

Communication architecture shall anticipate and support highly distributed data<br />

collection, control, and analytics environments.<br />

Communication networks shall be based on standardized packet transport<br />

services and utilize IPv6 technology.<br />

Justification<br />

Each of the sub-network domains<br />

has unique functional<br />

characteristics regardless of<br />

communications technology<br />

considered.<br />

Provides high performance and<br />

resilient connectivity between<br />

core wide-area networks and key<br />

remote facilities (such as outlying<br />

substations) or to points of<br />

network concentration (such as<br />

remote communications huts).<br />

High performance attributes:<br />

from hundreds of Megabits to<br />

multi-Gigabit, extremely low<br />

latency, deterministic traffic<br />

support, very high reliability.<br />

Data collection, control and<br />

analytics are evolving from<br />

centralized to distributed<br />

environments and the<br />

communication architecture must<br />

support this evolution.<br />

IPv6 offers superior networking<br />

functionality and can scale to<br />

meet the needs of <strong>Smart</strong> <strong>Grid</strong>.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 47


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Specification<br />

Communication services must be centrally and uniformly managed. The<br />

management mechanism should be integrated with grid device management.<br />

Completion of a comprehensive set of anticipated use cases is a critical<br />

foundation for the development of the communication services architecture<br />

Core Wide-Area Networks Deployment<br />

Design specs should:<br />

Accommodate tightly controlled access from remote networks<br />

Provide the highest degree of security<br />

Provide high network performance (multi-Gigabit, extremely low latency,<br />

deterministic traffic support, very high reliability, rapid failover, extensive<br />

redundancy) primarily using fiber and other infrastructures<br />

Provide flexible network segmentation/virtualization capabilities, in support<br />

of a variety of application, security and geographical domains<br />

Support data, voice, video, and control services<br />

Be based on IPv6 technologies<br />

Utilize diversely connected, redundant connectivity architectures (such as<br />

ring or mesh topologies)<br />

Support convergence such that, if desired, traffic from one environment<br />

does not harm or adversely impact traffic from other environments<br />

Operational specs should<br />

Directly support key remote locations where grid logic has been employed<br />

Be under autonomous control by utility (if private) or be accompanied by<br />

strict Service Level Agreements (if public)<br />

Provide a high degree of network monitoring and system management<br />

Development of holistic end-to-end communication architecture is critical to<br />

support entire application, control and analytics environments.<br />

Justification<br />

Communication systems entail<br />

many diverse, interconnected and<br />

interdependent communication<br />

links. These systems are also<br />

interdependent with grid devices<br />

and each management system<br />

should inform the other for<br />

service impacts.<br />

Provides comprehensive inputs<br />

and requirements vital to the<br />

development of the<br />

communications architecture.<br />

Prevents silo view that can lead<br />

to duplicate infrastructure and<br />

expenses.<br />

Provides high performance and<br />

resilient connectivity within the<br />

same organization’s data/control<br />

centers, from data/control<br />

centers to key remote facilities<br />

(such as substations), and from<br />

data/control centers to points of<br />

backhaul network<br />

interconnection<br />

Application, control and analytics<br />

endpoints span multiple domains<br />

of the communications<br />

architecture.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 48


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Extranet Network Deployment<br />

Design specs should:<br />

Specification<br />

Provide network security suitable for a plethora of access scenarios<br />

Support access for thousands to millions of users (based on the number of<br />

customers served by the utility)<br />

Interconnect to several public infrastructures (carriers) and offer various<br />

networking services (Internet, data, voice, video, control)<br />

Provide performance and capacity commensurate to normal business needs<br />

as well as sufficient additional capacity to accommodate emergency<br />

situations<br />

Include link and service failover mechanisms to alternative external<br />

networks and/or service providers<br />

Operational specs should:<br />

Assume that extranet connectivity may not allow utility autonomous control<br />

over service<br />

Assume that extranet connectivity offers lesser degree of monitoring and<br />

management to remote devices than private networking<br />

Consider extranet connectivity is dependent on others for reliability and<br />

performance<br />

Consider extranet connectivity cost structure is largely capacity driven<br />

Local Area Networks within Operations/Data Centers Deployment<br />

Design specs should:<br />

Provide extremely tight access controls<br />

Provide the highest degree of security<br />

Provide highest degree of network performance (multi-Gigabit, extremely<br />

low latency, highest reliability, rapid failover, extensive redundancy) using<br />

fiber and other infrastructures<br />

Provide complete virtualization capabilities, including server, network,<br />

storage, security, and application services<br />

Support data, voice, video, and control services<br />

Minimize power consumption and provide redundant/backup power<br />

Operational specs should:<br />

Serve as a key location for grid intelligence<br />

Serve as termination facility for redundant extranet communications<br />

Serve as termination facility for redundant internal core networks<br />

Be under full autonomous control by utility or their designee<br />

Provide the highest degree of monitoring and system management<br />

Justification<br />

Provides connectivity outside the<br />

utility (to customers, suppliers,<br />

business partners, emergency<br />

services, the public at large, and<br />

to off-site utility employees) with<br />

appropriate access and isolation<br />

For high-performance hosting of<br />

centralized data collection,<br />

control and analytics applications;<br />

hosting storage systems and<br />

enabling operator/worker access,<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 49


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Premises Networks Deployment<br />

Design specs:<br />

Specification<br />

Provide controlled access to premises-located devices<br />

Provide the highest degree of security<br />

Provide network performance commensurate with applications (from tens<br />

to several hundred kilobits, application specific latency, sufficient reliability,<br />

and redundancy where appropriate)<br />

Support data and control services<br />

Be based on IPv6 technologies<br />

Operational Specs should:<br />

Aggregate and deliver traffic from premises devices to energy controllers,<br />

displays, or gateways<br />

Use unlicensed spectrum under control of premises owner/operator<br />

Support self-discovery and auto-configuration of endpoint devices<br />

Substation Local Area Network Deployment<br />

Design Specs should:<br />

Accommodate very tightly controlled access from intra-station devices or<br />

from field area networks<br />

Provide the highest degree of security<br />

Provide high network performance primarily using fiber and other high<br />

performance infrastructures<br />

Support virtualization capabilities internal to the station as well as to the<br />

Backhaul WAN<br />

Require segregated overlay solutions for separating process bus traffic from<br />

other traffic<br />

Support data, voice, video, and control services<br />

Be based on IPv6 technologies<br />

Be capable (if desired) of supporting diversely connected WAN uplinks<br />

Support convergence such that, if desired, traffic from one environment<br />

does not harm or adversely impact traffic from other environments<br />

Provide autonomous support for low-level networking functions (such as<br />

DHCP, distributed DNS, and gateway services)<br />

Operational Specs should:<br />

Directly support devices and systems where grid logic is collected, executed,<br />

and stored<br />

Be under autonomous control by utility<br />

Provide the highest degree of network monitoring and system management<br />

Support interconnection of Field Area Networks<br />

Justification<br />

To provide connectivity to<br />

premises devices (such as inhome<br />

displays, programmable<br />

communicating thermostats, etc)<br />

and premises energy controllers<br />

or a gateway,<br />

To provide coverage to smart<br />

devices within and nearby the<br />

substation. High performance<br />

attributes: several hundred<br />

Megabit or even multi-Gigabit,<br />

extremely low latency,<br />

deterministic traffic support, very<br />

high reliability rapid failover,<br />

redundancy<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 50


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Tier 1 Field Area Networks Deployment<br />

Design Specs should:<br />

Specification<br />

Provide controlled access from field-located devices or from subtending<br />

Tier 2 Field Area Networks<br />

Provide the highest degree of security<br />

Provide high network performance commensurate with applications<br />

(from one to tens of Megabits, low latency, sufficient reliability, and<br />

redundancy where appropriate)<br />

Support virtualization capabilities to maintain traffic segmentation<br />

Support data, voice, video, and control services<br />

Be based on IPv6 technologies<br />

Operational Specs should:<br />

Aggregate and deliver traffic to places where grid intelligence has been<br />

distributed<br />

Require the spectrum to be under autonomous control by the utility<br />

when wireless networking technologies are deployed<br />

Provide the highest degree of network monitoring and system<br />

management<br />

Support self-discovery and auto-configuration of endpoint devices<br />

Support interconnection of Tier 2 Field Area Networks<br />

Tier 2 Field Area Networks Deployment<br />

Design Specs should:<br />

Provide controlled access from field-located devices<br />

Provide the highest degree of security<br />

Provide network performance commensurate with applications (from tens<br />

to several hundred kilobits, application specific latency, sufficient reliability,<br />

and redundancy where appropriate)<br />

Support data and control services<br />

Be based on IPv6 technologies<br />

Operational Specs should:<br />

Aggregate and deliver traffic to places where grid intelligence has been<br />

distributed<br />

Require the spectrum to be under autonomous control by the utility when<br />

wireless networking technologies are deployed<br />

Provide the highest degree of network monitoring and system management<br />

Support self-discovery and auto-configuration of endpoint devices<br />

Justification<br />

To provide general multi-purpose<br />

connectivity and access services<br />

to field devices so that they can<br />

connect to data/control centers,<br />

distributed applications (perhaps<br />

at substations), and to other fieldlocated<br />

endpoints (for peer-topeer<br />

communications)<br />

To provide purpose-built<br />

coverage and access services to<br />

field devices designed to connect<br />

to data/control centers,<br />

distributed applications (perhaps<br />

at substations), and to other fieldlocated<br />

endpoints (for peer-topeer<br />

communications)<br />

Communications <strong>Architecture</strong> Standards and Technology Recommendations<br />

Table 14 lists key standards for the <strong>Smart</strong> <strong>Grid</strong> communications architecture view. Standards<br />

continually change as technologies evolve; therefore this list should not be considered a comprehensive<br />

or exhaustive list of standards and technology recommendations.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 51


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Table 14 - Recommended Communications Standards and Technology<br />

Standards<br />

Purpose/Relevance/Comments<br />

IEC 61850 family of standards<br />

IEEE 1613<br />

IPv6<br />

Multi-Protocol Label Switching (MPLS)<br />

OSI <strong>Reference</strong> Model<br />

PHY - MAC standards typical to the various<br />

communication sub-networks:<br />

Extranet – PSTN technologies (ITU-T), SONET/SDH<br />

technologies, Metro-Ethernet<br />

Data/Control Center – Ethernet (IEEE 802.3<br />

family), Fiber Channel Protocol (INCITS T11)<br />

WAN – SONET/SDH technologies, Metro-Ethernet<br />

Field Area Networks – LTE (carrier-provided), IEEE<br />

802.16 (WiMAX), IEEE 802.11 (WiFi), IEEE<br />

802.15.4 (<strong>Smart</strong> Utility Networks), IEEE 802.3<br />

(Ethernet)<br />

Premises Area Networks – IEEE 802.11 (WiFi),<br />

IEEE 802.15.4 (Zigbee), IEEE P1901 (Power Line<br />

Communications)<br />

Describes communication principles, models, and capabilities used to<br />

support applications in electric power systems.<br />

Deals with environmental requirements for communication networks<br />

supporting electric power substations.<br />

The latest version of the Internet Protocol which has significantly more<br />

address space and enhanced networking features<br />

A hybrid data-link/network-layer packet-based transport service used<br />

in Wide Area Networks. Can support circuit-oriented or packetoriented<br />

communications. Capable of supporting deterministic traffic.<br />

Offers high degree of network virtualization.<br />

<strong>Reference</strong> model for describing communication systems using seven<br />

layers of functionality (physical, data link, network, transport, session,<br />

presentation, application). Each layer provides a common set of<br />

services to other adjacent layers.<br />

Each communication sub-network has functional requirements<br />

commonly addressed by using certain types of communication<br />

technologies. While standardization at the network layer and above<br />

helps support end-to-end interoperability, choices must be made at the<br />

physical layer (PHY) and media access control layer (MAC) largely based<br />

on geographic and environmental issues.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 52


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Management<br />

<strong>Smart</strong> grid management services generally reside within the cross domain foundational services box in<br />

the lower right area of Figure 9 - Layered Services Tier View.<br />

Management Framework<br />

The Management Framework [Figure 22] presents smart grid management services as a stack of layers<br />

reaching from electrical devices at the bottom to systems management at the top. This should help the<br />

reader visualize the pervasive nature of management services and the resulting architectural scope..<br />

Figure 22 - Management Framework<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 53


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The architecture is a model with four management layers (MLs). Element ML is at the bottom, the<br />

System ML and Services ML in the middle and <strong>Smart</strong> <strong>Grid</strong> ML at the top. Lifecycle and Technology<br />

Management Services are on the Element ML. Event, Asset and Security Management comprise the<br />

System ML. Performance and Policy Management is on Services ML. The Manager of Managers,<br />

performing all services orchestration, is on the <strong>Smart</strong> <strong>Grid</strong> ML. The System ML manages <strong>Smart</strong> <strong>Grid</strong><br />

Systems. The Element ML interacts with <strong>Smart</strong> <strong>Grid</strong> Communications Elements.<br />

Management Logical Model<br />

The Management Logical Model [Figure 23] contains three views: management component, management<br />

services stack, and management synergy.<br />

Figure 23 - Management Logical Model<br />

In the Management Synergy model (upper left portion of Figure 23), the data sources are at the bottom<br />

and data consumers at the top. The Management Services (middle layer) depict the shared<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 54


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

management services across systems and is divided into three sub-layers. The Lifecycle and<br />

Technology Management Services deal with end devices. The Configuration, Event, Security and<br />

Performance Management Services take data from the layer below, and process the data for<br />

consumption by the Policy Management Layer at the top.<br />

Various utility operations are end-consumers of management services. Operational functions request<br />

Management Services by SLAs and policies. Policy Management orchestrates all management services<br />

per the policies and the SLA. Two broad types are depicted. Data exchanged between end devices are<br />

based on raw standards. The higher data classes are exchanged between Consumers-Processes and<br />

Policy Management to ensure correct SLA and policy rules are being followed.<br />

Management Structural Model<br />

The management structural model [Figure 21] is provided to help the smart grid architect consider<br />

how to best deploy the various management services using a stylized representation of a typical utility<br />

network infrastructure. At the top of the model are elements needed to support external agencies<br />

(regulators, interchange and balancing authorities, etc.). At the bottom are the management services<br />

needed by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In<br />

between are a dozen other tiers where management services may be located to support residing devices<br />

and functionality. A self-describing template used for this model is on the last page of Appendix B,<br />

Services Classes Concepts. Included are descriptions of all fourteen tiers used in the model.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 55


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 24 - Management Services Structural Model<br />

Management <strong>Architecture</strong> Principles<br />

The following are architecture principles recommended for developing management architecture:<br />

• Management across Systems: The management architecture should support management across<br />

systems. For example, if an urgent (security) need is being addressed to push new firmware to<br />

all meters, the performance management will address contextual needs and inputs from other<br />

systems (such as Volt/VAR, fault management etc.) before the push is performed.<br />

• Ease of deployment independent of scale: management architecture deployment should be<br />

ambivalent to the size of the existing systems and the new systems to be deployed.<br />

• Support for legacy and emerging systems: management infrastructure must support legacy<br />

(protocols, technologies, devices) and emerging systems<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 56


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

• Exhaustive support for management services: management infrastructure shall support all<br />

<strong>Smart</strong> <strong>Grid</strong> management services (discussed in Appendix B).<br />

• Management operations interface at policy level: The default operations interface of the<br />

management architecture should be at the policy level (giving policies as inputs to the<br />

management architecture), as opposed to configuration level. For example, security<br />

configuration at the element level might be ACL configuration and at a policy level. Multiple<br />

such ACL configurations along with privacy and authentication configurations can be part of a<br />

“remote access policy”. The security operator must deploy the management architecture to<br />

interface with the architecture giving it the remote access policy as the input as opposed to<br />

dealing with multiple configurations at multiple devices.<br />

• Support for input from internal and external entities: The management architecture should<br />

support taking inputs from utility actors (such as actors from generation, transmission,<br />

distribution and consumer functions) and actors external to an utility (such as NERC, weather<br />

systems, etc)<br />

• Support for disaster recovery scenarios: The management architecture should support<br />

management services for disaster recovery scenarios such as local management (with out access<br />

to central management resources) and out-of-band management<br />

<strong>Architecture</strong> Choices<br />

The following are the architecture choices made in support of the above principles:<br />

Hierarchical architecture for ease of operations: a hierarchical architecture is optimal for ease of<br />

operations (policy level management at the top and the element level management at the bottom).<br />

Distributed architecture for support of deployment: data, software (such as firmware and<br />

configuration settings) and intelligence required for <strong>Smart</strong> <strong>Grid</strong> elements must be close to end<br />

devices to avoid network bottlenecks during firmware update distributions. Therefore, a distributed<br />

architecture is optimal for Management <strong>Architecture</strong>.<br />

Modular architecture for support of scale: Management architecture (policy management at the top<br />

and element management at the bottom) requires policy management to remain stable to changes,<br />

and to element additions (Element Management Layer) to the <strong>Smart</strong> <strong>Grid</strong> infrastructure. Therefore,<br />

the management architecture should be a modular architecture with support for multiple types of<br />

management at the element management layer would fit into the policy management layer<br />

<strong>Architecture</strong> Standard and Technology Recommendations<br />

The following table of management standards and technology recommendations is provided to the<br />

smart grid architect for reference. Over time, however, innovations will inevitably diminish its<br />

completeness. The architect should always research the latest information on these topics, but this table<br />

is a good starting point. Table 15 lists important 2011 standards and technology recommendations<br />

applicable to management, each with a brief explanation of their purpose or relevance.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 57


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Table 15 - Recommended Management Standards and Technology<br />

Technology<br />

SNMP V3 for get/set configurations of smart<br />

grid elements<br />

Syslog for logging capabilities of smart grid<br />

elements<br />

IEC 61850 suite for common configuration<br />

across electric and communication devices<br />

Netflow for event and behavior analysis<br />

XML based standards for complex device<br />

management<br />

NETCONF<br />

SSL and SSH for device-level configuration<br />

Justification<br />

SNMP V3 has embedded security and provisions for encryption<br />

SNMP is widely deployed across network devices of various technologies.<br />

Syslog standard can be exported securely.<br />

Many parsing functions are available for syslog.<br />

IEC 61850 is well-defined and becoming the standard for electrical and the<br />

communication devices that interface with those electric devices.<br />

Netflow is a simple protocol.<br />

Netflow is suitable for behavior analysis.<br />

XML is becoming the standard for:<br />

Substation Configuration Language:<br />

CIM: CIM is based on XML<br />

SOAP for configuration<br />

NETCONF<br />

XML is slow because of the parsing involved,<br />

NETCONF is the IETF protocol for manipulating and installing configuration<br />

files base<br />

CLI-based configuration should be done through secure versions of<br />

management protocols such as SSL and SSH.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 58


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

6. Summary<br />

Introduced less than 50 years ago, Information and Communications Technology (ICT) <strong>Architecture</strong><br />

remains a relatively new discipline. Unlike architectural disciplines dating back to ancient times, those<br />

that produced the many human artifacts we use and tend to take for granted today, ICT has relatively<br />

limited experience with the materials it employs. While many classes of information and<br />

communications materials are now stable and well understood, some ICT aspects continue to evolve<br />

quickly. Thus, it is not surprising that <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong>, being even more recent than ICT, must<br />

proceed while its building blocks remain untested in large-scale utility deployments.<br />

This document is one of the first end-to-end <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> descriptions developed<br />

in North America. Unlike many existing technology-dependent smart grid frameworks, the intent of<br />

this work was to develop technology-neutral smart grid architecture, and to document methods and<br />

recommendations for utilities’ continued reference as smart grid technologies and applications mature.<br />

Several conclusions became evident while this document was being debated and written:<br />

1. The architecture and resulting infrastructure must be based on layered services architecture<br />

principles. As new ideas and applications emerge, it is critical for the architecture to not only<br />

evolve with them, but to support them with little or no re-working.<br />

2. Interoperability is key. Many vendors will develop pieces of equipment, software and other<br />

items to be integrated with the grid. True interoperability is critical to reducing the cost of<br />

adding each item to the mix. It also lowers the threshold for testing innovative ideas – if the<br />

interoperability testing setup cost is too high, new ideas die on the drawing board.<br />

3. Data flows from many sources to many applications. This data interweaving requires an ability<br />

to move massive volumes of data quickly. Data exchange between applications must also be<br />

segregated based on operational needs. An infrastructure with robust data networks, adaptors,<br />

and service busses is critical for a utility to have a fully functional smart grid.<br />

4. A utility based on silo-optimized business functions is incompatible with grid renewal. As<br />

smart grid systems must interoperate seamlessly, so must the underlying business functions.<br />

This architecture document can help the “Old <strong>Grid</strong>” evolve into a “<strong>Smart</strong> <strong>Grid</strong>” as legacy grid<br />

infrastructure is merged with the latest ICT. It recommends high-level goals and principles to guide<br />

those tasked with developing smart grid architecture. Additionally, it describes a highly flexible,<br />

adaptive architecture critical for grid transformation. If properly planned, existing ICT infrastructure<br />

operations will continue while infrastructure complexity remains manageable as capabilities are added.<br />

Demands on each utility’s smart grid will change as results from experiments and demonstration<br />

projects become available. <strong>Smart</strong> grid architectural demands will also change as new applications<br />

evolve. Finally, many unknown factors will impact the <strong>Smart</strong> <strong>Grid</strong> ICT architecture over time. For all<br />

these reasons, this document must be revised periodically to remain useful.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Summary • 59


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NOTES<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Summary • 60


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix A. System of Systems Design Patterns<br />

<strong>Smart</strong> <strong>Grid</strong><br />

System-of-Systems <strong>Architecture</strong>s<br />

System Evolution to Guide Strategic Investments in Modernizing the Electric <strong>Grid</strong><br />

K. Mani Chandy, California Institute of Technology<br />

Jeff Gooding, Southern California Edison<br />

Jeremy McDonald, Saker Systems<br />

Introduction<br />

The electrical power system which has served humanity efficiently for a century must now evolve to<br />

meet changing requirements: increasing renewable energy sources, decreasing fossil fuel usage,<br />

managing greater total demand, using electricity to fuel transportation, enabling more customer control<br />

of both demand and supply, dealing with security threats, and adapting to disruptive technologies. An<br />

established industry must adapt to rapid, unaccustomed rates of change.<br />

System of Systems <strong>Architecture</strong>s<br />

<strong>Smart</strong> <strong>Grid</strong> designers face the challenge of planning the evolution of the grid’s architecture from its<br />

current instantiation to meet the needs of a changing uncertain future. This challenge can be met by<br />

managing the evolution of the grid as a System of Systems (SoS). A plan for the systematic evolution of<br />

<strong>Smart</strong> <strong>Grid</strong> architecture, as a System of Systems, should be the basis for: developing requirements and<br />

standards, making design decisions, procuring solutions, and managing the <strong>Smart</strong> <strong>Grid</strong> over the<br />

coming decades.<br />

A SoS is defined as a collaborative set of systems in which its components: 1) Fulfill valid purposes in<br />

their own right, and continue to operate to fulfill those purposes if disassembled from the overall<br />

system and 2) are managed (at least in part) for their own purposes rather than the purposes of the<br />

whole. The components systems are separately acquired and integrated to form a single system but the<br />

components maintain a continuing operational existence independent of the collaborative system.<br />

Consequently properties, which do not belong to any of the constituent parts, will emerge from the<br />

combined system of systems. Moreover, the system of systems evolves as constituent systems are<br />

replaced.<br />

System of Systems Design Patterns<br />

Appendix • 1


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Central Principles of System of Systems <strong>Architecture</strong><br />

Architects must enforce the following two central principles of SoS to ensure that the <strong>Smart</strong> <strong>Grid</strong> is not<br />

overwhelmed by change:<br />

The complexity of the SoS framework does not grow as constituent systems are modified, and SoS<br />

concepts for integrating constituents remain unchanged even as components are added and removed.<br />

The constituent systems do not need to be re-engineered as other constituent systems are added,<br />

removed, or replaced.<br />

These ideas are not new and form the basis of engineering design in many domains including software.<br />

We show how to evolve the architecture of the <strong>Smart</strong> <strong>Grid</strong> in a systematic, evolutionary manner, by<br />

adhering to these well-tested principles.<br />

This paper describes four <strong>Smart</strong> <strong>Grid</strong> SoS architecture patterns and their benefits and risks. In this<br />

paper we propose a specific evolutionary trajectory for the architecture of the grid as it takes on<br />

characteristics of these four patterns. Tradeoffs between different evolutionary trajectories are<br />

discussed, and the risks in the specific plan we propose are described in detail.<br />

Trends that Impact Evolution of <strong>Grid</strong> <strong>Architecture</strong><br />

We next list trends in technology that impact the <strong>Smart</strong> <strong>Grid</strong> and show how these trends impact the<br />

systematic evolution of grid’s architecture.<br />

A System of Everything: The <strong>Smart</strong> <strong>Grid</strong> is evolving to include control of many devices that were not<br />

considered in designs of the current grid; these devices include distributed energy sources and storage,<br />

electric vehicles, and appliances. <strong>Smart</strong> <strong>Grid</strong> architecture must consider integration – at some level – of<br />

widely different kinds of systems that deal with all aspects of life from transportation to healthcare. We<br />

use the hyperbole, “system of everything,” to make the point that the grid is one of the focal points by<br />

which individuals and organizations monitor and control their lives.<br />

The Penetration of the Internet and the Web: Large segments of the public use the Internet as a core<br />

technology for their work, social networking and recreation. Widespread access to broadband and<br />

increasing use of smart phones and tablets has resulted in large segments of the public, especially the<br />

young, viewing the Internet as a “system of everything.” This view is likely to strengthen as today’s<br />

young enter the workforce. Worldwide penetration of Internet and cellular data technologies will<br />

continue to make these technologies more powerful and affordable.<br />

The evolution of the <strong>Smart</strong> <strong>Grid</strong> architecture will reflect evolution of Internet architecture because the<br />

public will not want two competing “systems of everything.” Moreover, consumers and organizations<br />

System of Systems Design Patterns<br />

Appendix • 2


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

will want tighter control of their electrical devices as energy tariffs based on time of day become<br />

common and they will expect to manage their devices using the same Internet protocols that they use<br />

for other activities.<br />

Continuous Evolution of a Heterogeneous <strong>Smart</strong> <strong>Grid</strong>: The information infrastructure supporting the<br />

grid will remain highly heterogeneous for several reasons. Different grid functions have widely<br />

different systems characteristics such as requirements for security, timeliness, and bandwidth; for<br />

example these requirements are very different for fault protection and metering, and for demand<br />

response in homes and data centers.<br />

The <strong>Smart</strong> <strong>Grid</strong> will evolve continuously over decades; there will not be a single massive replacement<br />

of the current grid. Information technologies for sensing, metering, actuation, communication, and<br />

computation are developing continuously and rapidly. So, there is no ideal single point in time for a<br />

wholesale replacement of all devices. The architecture must be designed for continuous adaptation.<br />

Next we discuss the costs and benefits of using different SoS architectures at different points in the<br />

evolution of the <strong>Smart</strong> <strong>Grid</strong><br />

<strong>Smart</strong> <strong>Grid</strong> SoS <strong>Architecture</strong> Patterns<br />

The Silo <strong>Architecture</strong><br />

The current SoS architecture of the electric grid can be characterized as a collection of silos. Different<br />

functions of the grid such as billing and energy distribution use different information silos that are<br />

integrated by a thin IT layer. The silo architecture worked well for utilities for decades because each<br />

silo served the needs of a business unit, and different business units in a utility had very different<br />

needs. Utilities operated efficiently with little integration across silos.<br />

System of Systems Design Patterns<br />

Appendix • 3


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 25 - Silo <strong>Architecture</strong><br />

The silo architecture, though adequate in the past, will be inefficient for the future for several reasons.<br />

One reason is the increasing demand by a number of stakeholders for a greater control of energy usage.<br />

From the 1960s to 2010, utilities and ISOs controlled generation and distribution, and they specified<br />

well-defined interfaces to consumers: Customers turned switches on and off, paid bills, and called<br />

utilities when power failed. In the future utilities will coordinate activities by multiple stakeholders<br />

across multiple interfaces. For example, integrating distributed generation requires new interfaces. If<br />

the silo architecture is retained then separate interfaces will have to be developed between each type of<br />

stakeholder and each type of silo. Moreover, these separate interfaces will have to evolve separately as<br />

requirements evolve. Our challenge is to design an evolutionary path from today’s silo architecture to<br />

an evolving SoS architecture.<br />

System of Systems Design Patterns<br />

Appendix • 4


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Integration using Enterprise Services Buses<br />

Figure 26 - ESB <strong>Architecture</strong><br />

A step in the evolution is to integrate the back office using an ESB. Some utilities are taking this step.<br />

Though the step appears simple, it requires considerable cost, time and effort from IT staff and<br />

business units. Most importantly, integration using an ESB requires discipline that enforces enterprisewide<br />

standards on data models and IT services. If this discipline is not enforced, the ESB merely serves<br />

as an integrated physical communication opportunity, but all the problems of the silo architecture<br />

remain.<br />

Integration of the back office results in considerable efficiencies in utility operation. Back office<br />

integration does not, however, solve problems of multiple interfaces between different types of agents<br />

System of Systems Design Patterns<br />

Appendix • 5


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

who will participate actively in consuming and producing electrical energy. Moreover, the ESB<br />

architecture doesn’t move towards the utility customer’s need for an integrated system of everything.<br />

Thus, the ESB architecture is a good step, but not the final step, in the evolution of <strong>Smart</strong> <strong>Grid</strong><br />

architecture.<br />

Adapter <strong>Architecture</strong><br />

Figure 27 - Adapter <strong>Architecture</strong><br />

A possible next step in the evolution of the <strong>Smart</strong> <strong>Grid</strong> SoS architecture is that proposed for networkcentric<br />

warfare by the Department of Defense. A central feature of this architecture is that it provides<br />

each participant a user-defined operational picture (UDOP) for situational awareness. As a battlefield<br />

situation unfolds, possibly in unpredicted ways, UDOP provides each warfighter with the information<br />

that he or she needs, while ensuring that warfighters are not overloaded with data irrelevant to their<br />

System of Systems Design Patterns<br />

Appendix • 6


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

operations. DoD is using network-centric architectures to integrate army, navy, marine and air force<br />

operations to help provide overall situation awareness.<br />

Major benefits of this architecture are the enforcement of protocols that guarantee:<br />

Security throughout the system and<br />

Rapid delivery of high-priority information.<br />

The DoD enforces standards on its vendors: New IT components are designed and tested to guarantee<br />

system-wide security and performance.<br />

The challenge for utilities is to derive the benefits of DoD’s network-centric architecture while dealing<br />

with a marketplace that is very different from DoD’s operational environment. The <strong>Smart</strong> <strong>Grid</strong> consists<br />

of a collaboration of multiple utilities and ISOs. As the electricity grid gets increasingly integrated<br />

across states and even countries, the number of collaborating utilities and ISOs will increase. New<br />

types of stakeholders, such as manufacturers of electric cars, distributed energy generators, and energy<br />

storage devices participate in designing new interfaces to the grid. Control by a single agency of multistate,<br />

multi-national, multi-vendor integration, while possibly desirable, is more difficult to implement<br />

in the <strong>Smart</strong> <strong>Grid</strong> than in the DoD.<br />

The adapter architecture has critically important features; notably it supports the continuous evolution<br />

of a heterogeneous system of systems. The architecture does not, however, adequately meet the<br />

public’s needs for a system that integrates all devices. Nor does the adapter architecture sufficiently<br />

exploit the huge opportunities provided by open Internet technologies. Protocols layered on top of the<br />

Internet are not ideal for all applications; however, these protocols will evolve over time to meet needs<br />

for security, performance and other features required by many applications including the <strong>Smart</strong> <strong>Grid</strong>.<br />

Though the adapter architecture goes a long way towards meeting <strong>Smart</strong> <strong>Grid</strong> requirements, the<br />

architecture doesn’t go far enough to meet the technological or societal needs of a utility’s customers.<br />

<strong>Architecture</strong> Based on Open Standard Service Mechanisms<br />

A great deal has been written about Service-Oriented <strong>Architecture</strong> (SOA). A definition of SOA, offered<br />

by Roy Schulte of Gartner who coined the term, is that an SOA system satisfies the following five<br />

principles.<br />

1. Components can be added, replaced or modified individually without affecting the remainder of the<br />

system.<br />

2. Components must be distributable, i.e., run on arbitrary servers and communicate with each other<br />

by messages or service invocations.<br />

3. Component interfaces must be defined using standard metadata and the interfaces must be<br />

discoverable by application developers.<br />

4. A component can replace another with the same interface.<br />

System of Systems Design Patterns<br />

Appendix • 7


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

5. Services can be used multiple times by disparate applications or the same application.<br />

These characteristics also satisfy the two main principles of System of Systems architecture.<br />

Services may be organized in business domains so that some services are only available to others<br />

within the same domain; however, a central point of standard services is common metadata for service<br />

interfaces regardless of the business domain in which the service lies.<br />

The Adapter <strong>Architecture</strong> is a service-oriented architecture. The central differences between adapter<br />

architectures and one based on standard open services are the protocols by which services are invoked.<br />

Since the IT infrastructure for the <strong>Smart</strong> <strong>Grid</strong> will need to take steps towards satisfying customers’<br />

needs for a “System of Everything,” we are faced with two options.<br />

Ensure that the mechanisms for specifying, invoking and maintaining services for the <strong>Smart</strong> <strong>Grid</strong> are<br />

the same as, or consistent with, mechanisms for invoking other services.<br />

Have two mechanisms for managing services, one for the <strong>Smart</strong> <strong>Grid</strong> and the other for everything<br />

else, and build bridges between <strong>Smart</strong> <strong>Grid</strong> and everything else.<br />

There are advantages and disadvantages for both approaches. An advantage for the two-mechanism<br />

approach is that a <strong>Smart</strong> <strong>Grid</strong> IT infrastructure is designed specifically for the particular needs of the<br />

<strong>Smart</strong> <strong>Grid</strong>. A disadvantage of this approach is that all the thousands of utilities and other agents<br />

participating in the <strong>Smart</strong> <strong>Grid</strong> will have to adopt either a single standard (or a very small number of<br />

standards) designed specifically for the <strong>Smart</strong> <strong>Grid</strong>, and build integration layers between the <strong>Smart</strong><br />

<strong>Grid</strong> standard and protocols to manage both business and personal needs in other domains.<br />

System of Systems Design Patterns<br />

Appendix • 8


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 28 - Service-Centric <strong>Architecture</strong><br />

The development of a <strong>Smart</strong> <strong>Grid</strong> system of systems based on Internet (e.g. REST) or Web-services<br />

protocols requires an understanding of the key points of interoperability across the entire <strong>Smart</strong> <strong>Grid</strong>.<br />

The silos in the current infrastructure can be architected in layers, with layers across different silos<br />

having the same interface. The new architecture must specify standard interfaces at each layer so that<br />

different business functions are architected in the same way and reuse components. The architecture<br />

must also specify common services such as network management, security, and diagnostics, and these<br />

common services should be accessible to all systems and devices used to execute different business<br />

functions.<br />

System of Systems Design Patterns<br />

Appendix • 9


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Summary<br />

Strategic investments in modernizing the grid must be based on a plan for transitioning today’s silo<br />

architecture to a system of systems architecture based on widely adopted standards, common services,<br />

and loosely coupled systems. Strategic investments will pay off only if they designed for a carefully<br />

planned trajectory of grid architecture.<br />

Successful execution of a transition plan requires early and continuing investments in <strong>Smart</strong> <strong>Grid</strong><br />

standards, unified infrastructure and the co-evolution of processes to support migration from<br />

centralized to distributed operation. Massive changes in architecture, operations, and training will be<br />

required over the transition period. So, a utility should adopt an evolutionary approach that doesn’t<br />

exceed the utility’s capacity in these domains.<br />

A transition plan that some companies have adopted is to first move from a silo architecture to an<br />

enterprise service bus (ESB) architecture and then move incrementally to an open-standards based<br />

architecture, developing and adopting standards and common services in steps. The utility should,<br />

however, have an overall architecture transition plan, including designs for system-wide security and<br />

system-wide timeliness at every step of the plan, before making incremental changes.<br />

Each of the four architectural patterns discussed in this paper has benefits and risks. Each transition<br />

from one architectural pattern to another has substantial costs, takes time, and requires expertise in<br />

both the grid and IT architecture. Utilities must, however, develop architecture plans before making<br />

strategic investments in the grid.<br />

System of Systems Design Patterns<br />

Appendix • 10


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix B. Services Classes Concepts<br />

Applications Services<br />

As discussed previously, the utility industry is being transformed by <strong>Smart</strong> <strong>Grid</strong> initiatives.. This<br />

transformation affects functional business processes, as well as associated technology and applications.<br />

These changes will lead to a re-engineering of how these applications are used and interact with other<br />

domains. Applications will be transformed to leverage shared services to better allow the utility<br />

business domains to interchange available information. Interoperability and loose coupling between<br />

application functionalities is best assured if the application services interact through well-defined<br />

interfaces based upon standards, e.g. IEC 61968 and IEC 61970.<br />

<strong>Smart</strong> <strong>Grid</strong> architects, over time, will disaggregate monolithic systems into smaller atomic functional<br />

components. These will be used to aggregate, compose, choreograph and orchestrate business<br />

processes leveraging smaller atomic functional components. The “optimizes assets and operates efficiently”<br />

baseline <strong>Smart</strong> <strong>Grid</strong> goal requires applications to be designed for maximum flexibility and reusability.<br />

If applications are adequately service enabled, the design of flexible, smart grid processes can leverage<br />

industry standards such as BPEL (Business Process Execution Language). For example, suppose a giant<br />

distribution management system is decomposed into many smaller functional components, each with<br />

small functions implemented as self-contained services. A utility functional section can, through BPEL,<br />

rapidly devise business processes by orchestrating a set of services to perform a business process. Since<br />

the services are designed for re-use, another business group could devise a similar process using the<br />

same services orchestrated in a way to best meet its particular business needs. Business analysts can<br />

design a multitude of different business processes by assembling the same functional components into<br />

different combinations. This approach provides analytics needed to measure process efficiency since<br />

properly designed services include introspection and self-testing. Analytics to tune process efficiency<br />

can be implemented with each process piece, and re-used by every business process using the services.<br />

P1<br />

Service A<br />

Service E<br />

P1<br />

P2<br />

P3<br />

P4<br />

Monolithic<br />

Application<br />

P2<br />

P3<br />

Service B<br />

Service C<br />

Service F<br />

Service G<br />

Service I<br />

Service J<br />

Service K<br />

P4<br />

Service D<br />

Service H<br />

Figure 29 - Dis-aggregation of a Monolithic System<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 11


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Functional Aspects of Application Services<br />

The Operations functional domain manages the movement of electricity through the efficient operation<br />

of the power system. It therefore impacts many other business domains:<br />

a. Network Operations: includes supervision of substation topology and control equipment status,<br />

network connectivity, loading conditions, fault management, outage management and location<br />

of field crews.<br />

b. Network Extension Planning: develops long-term plans for the adequacy and reliability of the<br />

electrical networks needed to fulfill evolving energy usage needs.<br />

c. Operations Planning and Optimization: includes the definition, preparation and optimization<br />

of workflows, plus the operational sequences required for the maintenance, monitoring and<br />

control of networks.<br />

d. Metering: performs reading of the information recorded at customers’ service points; sends<br />

alerts and notifications; controls customer equipment interfaces.<br />

e. Record and Asset Management: includes electrical substation and network assets either owned<br />

by the utility or having legal responsibility for.<br />

f. Maintenance and Construction: addresses functional needs for equipment to perform better<br />

and extend its service life.<br />

g. Customer Support: manages operational aspects of customer interfaces such as trouble calls,<br />

point of sale, account management, etc.<br />

h. Enterprise Systems: supports the overall utility businesses, including, but not limited to, human<br />

resources, corporate finances, and supply chain management.<br />

i. Bulk Energy Management: serves Generation and Transmission Control, Topology Processing,<br />

Account Settlement, Market Operations, Load Management, Energy and Transmission<br />

Scheduling, Dispatcher Training Simulation, SCADA (Supervisory Control And Data<br />

Acquisition), Alarm Processing, etc.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 12


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 30 - Functional Services Organization<br />

As discussed above, the Operations domain boundary includes an edge to most utility domains and<br />

thereby can provide a large set of application services.<br />

As an illustrative example, consider the application services offered by the Network Operations<br />

Planning and Optimization. The related services can be classified into three sub-categories, which can<br />

be further decomposed into various functional, modular and reusable components or services:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 13


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 31 - Network Operations planning and optimization<br />

The Network Operations and Optimization Application Services are:<br />

Load Forecast Service: The Load Forecasting function predicts short-term, mid-term and long-term<br />

system loads and maintains a real-time forecast and a study forecast. The real-time forecast is based<br />

on actual historical load and weather data and generates a load forecast for the current minutes,<br />

hour and day. The study forecast uses a completely independent set of historical and predicted data<br />

the operator may configure to evaluate hypothetical situations in the future.<br />

Power Flows Service: This service provides the calculation engine for external systems to estimate<br />

the network conditions based on provided network status and measurements. This service is used in<br />

real-time to provide dispatchers with an accurate and precise estimation of current network state.<br />

This service is also leveraged by advanced network features requiring real-time base power flow<br />

results for further analysis, (e.g. Contingency Analysis, Volt/VAR Control, or FLISR – Fault Location,<br />

Isolation and Services Restoration). This service can also be leveraged by Network Planning<br />

engineers to determine the effects of control actions (breaker switching, tap changing, and<br />

interchange adjustments).<br />

Contingency Analysis Service: This service enables the real-time study of the effects from a system<br />

component failure. Contingency analysis relies on the Incident Simulation Service to model the<br />

effects of identified contingencies. Once all relevant contingencies have been simulated, the<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 14


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Contingency Analysis Service ranks the results based on the current network conditions to inform<br />

the grid operators of areas of possible risks or congestions. The Contingency Analysis Service can<br />

also be in used in an engineering exploration or training environment.<br />

Short-Circuit Analysis service: This service is responsible for analyzing short circuits in<br />

transmission and distribution networks. These include single line to ground, line to line, double line<br />

to ground, three lines to ground, single line open, double line open, etc.<br />

Optimal Power Flow service: This function allows dispatchers or network planning engineers to<br />

optimize power system control actions based on given criteria (flows of real or reactive power,<br />

switching of compensation devices, optimal settings for voltage control, etc.). In optimal power flow,<br />

the control actions are automatically predetermined within the limitations of the power system.<br />

Supply Restoration Assessment Service: This service analyzes the switching options after a<br />

network fault is identified in order to restore the power for as many customers as possible in the<br />

shortest time possible. In distribution systems, this service is generally invoked by the Fault<br />

Location, Isolation and Services Restoration service to provide alternate switching plans for the<br />

operators to manually or automatically select for restoring power to customers when the normal<br />

feeder configuration does not allow the supplying power to affected customers.<br />

Switching Simulation Service: This service enables the simulation of switching operations. This<br />

service is leveraged by many other services, in both real-time or study environments. For example,<br />

the real-time Supply Restoration Assessment Service calls it to simulate the switching steps<br />

necessary to isolate faulty devices or restore power to customer. Another example, in the training<br />

environment settings, when the trainee operators issues a supervisory control, the Operator Training<br />

Simulator calls the Switching Simulation Service to operate the selected devices.<br />

Incident Simulation Service: This service provides the ability to simulate and recreate an incident<br />

on the network for analysis or training purposes. This service leverages the Switching Simulation<br />

Service to perform switching steps on the network and on the Power Flow Service to compute the<br />

resulting network conditions. The Incident Simulation Service is leveraged in both real-time and<br />

study mode environments. For example, the Operator Training Simulator heavily relies on this<br />

service to drive the simulated network state and conditions.<br />

Weather forecast analysis service: Weather is monitored to predict impacts on the electrical<br />

networks, especially where outages are likely to occur due to heavy storm activity. Temperature and<br />

wind speed are sometimes used to calculate dynamic load limits on electrical network assets.<br />

Fire risk analysis service: It analyzes the risk of fire in the network. For example, thermal rating of<br />

network equipment. There is a certain temperature for which transformers may be at risks of<br />

malfunctioning, failing or worst, exploding.<br />

Define operational limits service: It defines operating limits for monitoring operations of the<br />

transmission and distribution facilities.<br />

Thermal ratings of network equipment and lines: Changes in electrical asset performance limits<br />

based on temperature and wind speed and current season. This is distinguished from Asset<br />

Investment Planning (AIP) counterpart, which includes new construction and re-conductoring.<br />

For all these services to properly interact and fulfill the utility objectives, an integration layer is<br />

required to ensure the orchestration and communication of these services. The next section describes<br />

these integration services.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 15


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Integration Services<br />

Integration services and patterns are very important in reducing ICT complexity while allowing it to<br />

quickly and easily deliver on business needs while enabling continued innovation. Integration services<br />

leveraging the enterprise service bus pattern (1) offer ways to cut down point-to-point connectivity; (2)<br />

maintain a higher level of reliability; and (3) improve flexibility in the architecture. The presence of an<br />

ESB is fundamental to simplifying the task of invoking services – services can be used wherever needed<br />

from wherever they reside within the enterprise; used without specific knowledge of where the<br />

services reside or how to transport requests across the network to invoke those services. Some of<br />

common capabilities needed in integration services are routing and brokerage, mediation, protocol<br />

conversion, namespace translation, service virtualization, and aggregation.<br />

Business Process Orchestration and Choreography Service<br />

Business process choreography and orchestration capabilities, associated with the composition and<br />

coordinated execution of services, provide flexibility in building new processes and managing process<br />

change. Business process execution language (BPEL) is one of the standards used for building<br />

orchestrated ICT-enabled business processes. Once developed, the process is deployed on servers<br />

running a BPEL engine and utilized by business systems shepherding the processes for the enterprise.<br />

Choreography is used when more complex behavior is needed, with each atomic-process reacting to<br />

the actions of other processes using pre-established heuristics, without central coordination.<br />

Business Rules Services<br />

As ICT Systems began supporting ever increasing, ever changing business processes, events and<br />

decisions, the need to identify and manage business rules became obvious. The rules needed to reflect<br />

business policy in a form comprehensible to business users and executable by a business rules engine.<br />

Separating the business rules from application code simplifies system changes, allows re-use of the<br />

rules across applications/processes, and supports rapid rules selection and execution.<br />

Registry and Repository Services<br />

The registry functions provide publication of metadata about the function, requirements, and semantics<br />

of services allowing service consumers to find services or to analyze relationships between services.<br />

The repository function provides the ability to store, manage, and version service metadata.<br />

Business application services<br />

Business application services provide ability to deploy and manage robust, agile and reusable SOA<br />

business applications and services of all types. These are service components designed specifically as<br />

services within a business model and represent the basic building blocks of the utility’s business design<br />

– services not decomposable within the business model, but composable to form higher level services.<br />

This allows creation of new services and service enablement of legacy packages and applications. These<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 16


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

services allow the user to develop innovative applications through their support of open standards and<br />

programming models, including: OSGi, CEA, JPA, SAML, SCA, SDO, SIP, Web 2.0, and XML.<br />

Gateway Services<br />

Gateway services provide filtering and data stream processing, receive all events from the device and<br />

send control commands to device. They also act as interaction services for machine to machine<br />

interaction, control access to applications, services and data based on customizable roles and rights<br />

thereby enable consistent enforcement of security and governance policies. These services also enables<br />

web integration services through the support of Web 2.0 technologies with JSON filtering and<br />

validation<br />

Complex Event Processing (CEP) Services<br />

Complex Event Processing services provide the ability to simultaneously access and analyze thousands<br />

of data streams from both inside and outside the corporate firewall and delivering the result directly to<br />

business application services. It supports events conformant to the Common Base Event specification<br />

and other messaging formats. It extends the one message at a time paradigm by detecting complex<br />

situations involving composition of messages/events sensitive to context (i.e. semantic, temporal,<br />

spatial, spatio-temporal, or scope).<br />

Workflow services<br />

A workflow service provides automation of a series of tasks assigned to application users based on<br />

their roles. When the application containing the workflow is instantiated, a user is assigned a task<br />

based on his or her role. This service is used for developing simple service composition. When<br />

complex, parallel service composition is required, workflow is best served by choreography services.<br />

CIM Binding Services<br />

The Common Information Model (IEC, 2003) is a key standard in the utility business domain. To<br />

expose a business service, this binding service maps the CIM model with backend data attributes. This<br />

service provides a CIM data model to handle the large portfolio of existing and extensible CIM classes.<br />

Visualization Services<br />

Visualization services include presentations of grid topology, alarms, switching state, and business<br />

capabilities. Presentation often is tailored to role-sensitive contexts –system behavior and visual cues<br />

adjust based on user job role and, perhaps, user location. To address the risk of data overload,<br />

presentation services can help transform the flood of smart grid data into nuggets of information<br />

presented in an optimal format for grid operators to make appropriate decisions. Thus, visualization<br />

services are essential to <strong>Smart</strong> <strong>Grid</strong> decision support systems.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 17


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Web Integration Services<br />

There are many characteristics of Web Integration (i.e. Web 2.0) services such as web as a platform,<br />

harnessing collective intelligence, lightweight programming model, software above the single device,<br />

light weight user interface apply to smart applications. There are multiple applications of concepts of<br />

these services within utility domain (i.e., mashups) to build visualization and situational services,<br />

aggregation of usage, including PEV charging usage and customer information etc.<br />

Cloud Services<br />

The cloud computing architecture is a flexible computing platform implemented with a highly<br />

virtualized, automated and service-oriented design. Utility companies can leverage cloud computing<br />

for rapid, real-time access to considerable computing power, immense storage and numerous<br />

applications. By using cloud computing, utilities can improve new application development and<br />

deployment and quality of service. It also enables prompt response to evolving consumer priorities and<br />

market challenges on a utility’s core products. As agility is key to future business success, and cloud<br />

computing provides ICT agility, cloud services may fit well in utility System of Systems architectures.<br />

Cloud computing’s inherent reliance on standardization will increase operational efficiency. Public<br />

clouds drive process standardization by identifying scalable workloads able to be managed in mass.<br />

Private clouds leverage the scale inherent in existing utility hardware by dramatically improving asset<br />

utilization. Rather than deploying and maintaining multiple application instances, cloud computing<br />

enables standardization on a single instance. Standardization on this scale significantly reduces labor<br />

and other ICT operating expenses while increasing availability. Similarly, highly virtualized<br />

infrastructure reduces ICT capital expenses, consolidates data center resources and reduces<br />

investments in hardware and facilities.<br />

Non Functional Aspects of Application Services<br />

The issues of High Availability, Performance and Scalability are key architectural concerns for all<br />

enterprise architects, particularly for <strong>Smart</strong> <strong>Grid</strong> architects. As enterprise ICT architectural approaches<br />

are increasingly applied to the grid, solution resiliency increases in importance. These issues are highly<br />

interrelated and often impacted by technological, temporal, spatial and budget constraints.<br />

Additionally, there is limited precedence for the <strong>Smart</strong> <strong>Grid</strong> architect to rely upon, and the domain is<br />

rapidly evolving. This section addresses these aspects by defining terms and their inevitable trade-offs.<br />

Performance and Scalability<br />

Performance has two facets. The first is the speed the system supports a single request. The second,<br />

system throughput, is the number of simultaneous requests supported with acceptable response times.<br />

Scalability is a measure of how well the system accepts higher volumes with acceptable performance<br />

and availability. A scalable architecture allows a system to grow with reasonable hardware and<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 18


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

software accommodations. In contrast, growth of a non-scalable architecture requires major changes to<br />

subsystems, hardware configurations, or new processor types.<br />

Performance and Scalability approaches are highly interdependent. High availability and performance<br />

goals can be achieved by paralleling system components, resulting in load reduction and response<br />

improvement for any element. Generally, additional units can be easily added if the architecture has<br />

the units paralleled. At the same time, improved availability is enabled by the presence of redundant<br />

hardware in this architecture. An architecture using parallel elements can also apply dynamic Quality<br />

of Service rules to ensure critical transaction completion when components are compromised.<br />

Analytic Services<br />

Analytics are data transformations used to extract information actionable by systems and people. As<br />

such, some analytics are cyber (machine-to-machine), while others are used for decision support after<br />

appropriate presentation (machine-to-human). The scope of analytics includes:<br />

Basic database queries for routine operational and business process issues<br />

Real time streaming data transformations used in closed-loop control systems<br />

Large scale data visualizations used for operator decision support<br />

KPI’s and dashboards used for executive review<br />

Reports for submission to regulators<br />

Data mining for system planning and asset management<br />

Many <strong>Smart</strong> <strong>Grid</strong> analytics are used to transform raw grid-derived data into a high-level depiction of<br />

grid state, supporting total situational awareness. <strong>Grid</strong> state includes knowledge of operational<br />

electrical parameters, device/system status, power quality, stress factors, and loading conditions. This<br />

grid state information is embedded in low-level data too voluminous and detailed to be<br />

comprehensible or actionable. Analytics extract the essential meaning from the data at the numerous<br />

grid intelligence tiers, from Protection & Control to System Planning & Optimization.<br />

As information and system complexity increase, presentation sophistication must necessarily increase.<br />

For some target audiences, reports or dashboards are inadequate. Advanced visualization capabilities<br />

are often needed to present analytics derived from sets of large, complex and dynamic data.<br />

Types of Analytics<br />

A wide variety of <strong>Smart</strong> <strong>Grid</strong> analytics exist, and more are constantly being developed. These analytics<br />

can be categorized in multiple ways, but one in particular is helpful. Figure 32 below depicts a<br />

taxonomy of <strong>Smart</strong> <strong>Grid</strong> analytics.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 19


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 32 - <strong>Smart</strong> <strong>Grid</strong> Analytics Taxonomy<br />

The taxonomy has six major classes of grid analytics, all driven by data from grid devices and systems.<br />

The classes support three high-level intelligence categories: Technical and Engineering, Operational,<br />

and Business.<br />

Signal Analytics<br />

Signals are the lowest level data coming from grid sensors. Therefore, Signal Analytics are often the<br />

"earliest" analytics (the ones first applied to raw data) and generally take the form of digital signal<br />

processing functions. The Signal Analytics profile follows:<br />

Example Usage: transform voltage and current waveform samples into Root Mean Square (RMS)<br />

values, along with real and reactive power, Total Harmonic Distortion (THD), and other relevant<br />

characterizations<br />

Data Frequency: real-time, may be hundreds of waveform samples per cycle over multiple channels<br />

for three phase voltages and currents.<br />

Data Types: integer digitized values, later converted to float engineering units<br />

Analytic Processing Frequency: ranges from per sample up to typical SCADA data rates (e.g. four<br />

second cycle time)<br />

Event Analytics<br />

Events are discrete, real-time messages from grid components caused by temporal or value limits being<br />

reached (logs, alarms, alerts). The Event Analytics profile follows:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 20


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Example Usage: processing power outage notification message bursts from smart meters during an<br />

outage or voltage sag<br />

Inbound Data Frequency: real-time, can be thousands of events within a few seconds<br />

Data Types: numerous event message formats<br />

Analytic Processing Frequency: real-time to manage bursts with low (millisecond to second) latency<br />

without message loss<br />

Result Set Publish Frequency: per event, asynchronous<br />

State Analytics<br />

State data from the grid supports real-time utility network analysis, monitoring, and control. The State<br />

Analytics profile follows:<br />

Example Usage: monitoring and control of grid power flows<br />

Inbound Data Frequency: real-time, from per cycle up to typical SCADA data rates (e.g. four second<br />

cycle time)<br />

Data Types: various SCADA and sensor formats<br />

Analytic Processing Frequency: real-time as per control system requirements; can be SCADA cycle<br />

time or as fast as GOOSE message times (4 msec max latency)<br />

Result Set Publish Frequency: SCADA rates to minutes for most processes; milliseconds for<br />

protection and control functions<br />

Engineering Analytics<br />

Engineers need analytics to perform long-term planning and operational analysis. The Engineering<br />

Analytics profile follows:<br />

Example Usage: circuit and substation planning<br />

Inbound Data Frequency: real-time - mostly SCADA data rates<br />

Data Types: usually floating point values from circuits, customer usage data records, maintenance<br />

event logs, waveform files<br />

Analytic Processing Frequency: quarterly, yearly, multi-year<br />

Result Set Publish Frequency: on demand as planning and analysis processes are performed<br />

Operations Analytics<br />

Operations depends on analytics for short-term optimization of asset effectiveness. The Operations<br />

Analytics profile follows:<br />

Example Usage: all aspects of asset management for utilities, including asset health assessment via<br />

remote monitoring, asset stress accumulation monitoring for support of condition-based and<br />

predictive maintenance, and asset utilization, both in real-time and for system planning.<br />

Inbound Data Frequency: real-time at SCADA data rates or slower; directed mostly to historian<br />

databases, except for data used in load balancing and optimization.<br />

Data Types: floating point sensor readings and integer operations counts<br />

Analytic Processing Frequency: SCADA rates for real-time control functions; as needed for analysis<br />

reports<br />

Result Set Publish Frequency: same as Analytic Processing Frequency<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 21


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Consumer Analytics<br />

Utilities better serve their customers by analyzing data on electric producers and consumers<br />

(prosumers). The Consumer Analytics profile follows:<br />

Example Usage: all aspects of prosumer interaction with the utility, from billing and complaint<br />

management to interface for distributed energy resources, demand response (DR), and pluggable<br />

electric vehicle charge management.<br />

Inbound Data Frequency: rates for meter reading, DR feedback and prosumer interactions are slow<br />

compared to grid operations; may be minutes to months<br />

Data Types: meter usage data, DR data (<strong>Smart</strong> Energy Profile), event log messages<br />

Analytic Processing Frequency: on demand, mostly monthly or longer; some analytics for DR may<br />

be from minutes to hours<br />

Result Set Publish Frequency: on demand<br />

<strong>Smart</strong> <strong>Grid</strong> Data Classes<br />

Given the many potential sources of power grid data, for analytics and data management purposes it is<br />

helpful to classify them into seven categories. These categories aid the proper implementation of<br />

analytics, the design and placement of data persistence elements, and the sizing of communication<br />

network elements.<br />

Operational data<br />

Operational data is mostly real-time state measurements of circuits and devices. As this data changes<br />

from moment to moment, most analytics are concerned only with present data values. This data is<br />

persisted in various ways, primarily by overwriting old values. A log may be kept by placing snapshots<br />

of operational data in a time series (historian) database.<br />

Non-operational data<br />

This data category has telemetry used to monitor remote assets: equipment condition, environmental<br />

monitoring, stress indicators, etc. Most of this data is collected on a regular basis and persisted in a time<br />

series database.<br />

Meter usage data<br />

Besides its obvious use for meter-to-cash, meter data is often input to various technical and business<br />

analytics. While some analytics could use the default meter data repository, this approach may not<br />

scale well for more advanced, real-time analysis. Alternate data services could therefore be necessary<br />

for some metering analytics.<br />

Event streams<br />

Many <strong>Smart</strong> <strong>Grid</strong> devices produce asynchronous event messages. Analytics for such data streams may<br />

need special processing tools (Complex Event Processing engines) to quickly respond to periodic data<br />

bursts from grid devices. Event messages may also be logged for post-mortem analytics.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 22


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Waveform data<br />

Waveforms are often produced by grid devices based on some event or condition. This data are<br />

generally collected into files (COMTRADE or PQDIF formats) for post-event analysis. The files are<br />

typically batch transferred into a waveform repository for later use by analytics tools.<br />

Analytics as data<br />

Many analytics are real-time data streams, especially those used for line sensing and remote asset<br />

monitoring. These low-level output streams can be inputs to other analytics. They can also be stored in<br />

a time series data store for later analysis.<br />

Meta-data<br />

A wide variety of grid environmental data give context to actionable information. The architecture<br />

must provide, persist and distribute pertinent meta-data for use by analytics.<br />

Analytics Properties and Issues<br />

Architects should understand fundamental analytics properties and usage issues to properly align<br />

analytics into <strong>Smart</strong> <strong>Grid</strong> architecture. This understanding will reveal analytics as more than simply a<br />

set of services provided to the <strong>Smart</strong> <strong>Grid</strong> System of Systems.<br />

Analytics as filters<br />

Analytics may be viewed as both filters and data reduction mechanisms. Raw data from grid devices<br />

can be too voluminous for centralized processing. Low-level analytics services effect a data reduction<br />

by extracting useful information to characterize larger data sets while preserving essential content.<br />

Event processing as analytics<br />

Many grid devices generate asynchronous event messages based on a variety of physical and virtual<br />

events. Such event streams contain valuable information but typically arrive in large bursts needing<br />

low latency handling. As most utility systems cannot deal directly with such data, a complex event<br />

processing (CEP) analytics tool is used to simultaneously extract core information while throttling or<br />

filtering event message bursts. An example is the processing of power outage notification message<br />

bursts from smart meters; CEP is used to reduce the burst of raw messages to a single informative<br />

event message representing the underlying physical event. In addition, grid sensor event data streams<br />

can also be marshaled by CEP, such as Phasor Measurement Unit (PMU) data frames. When processed<br />

through CEP, PMU information can be used to detect, characterize and locate fault and pre-fault<br />

transient phenomena in real-time.<br />

Real time analytics for protection/control<br />

Many grid analytics support real-time protection and control operations. Since these analytics are often<br />

characterized by very low latency (as fast as sub-cycle), the data must be processed faster than any<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 23


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

database persistence can be applied. The data source is therefore connected directly to the analytic, and<br />

the analytics output routes directly to a machine consumer.<br />

Telemetry monitoring<br />

Much of <strong>Smart</strong> <strong>Grid</strong> data consists of remote asset and grid state monitoring telemetry. These produce<br />

high data volume with a steady and relentless delivery. Under normal operating conditions, the data is<br />

unremarkable. As monitored parameters trend away from nominal, actions should be taken, but the<br />

large data volume makes it impractical for people to constantly watch the data. A solution is to have<br />

analytics agents continually scan the data for specific conditions or trends, then issue appropriate alerts<br />

and notifications. Defining all possible alert analytics rules is impossible, therefore the analytics agents<br />

should be configurable, with subscriptions made or dropped as needed. End users of the analytics<br />

should also be allowed to perform some configuration. The <strong>Smart</strong> <strong>Grid</strong> Architect will need to secure<br />

this flexibility by providing appropriate access control via role-based identity management.<br />

Visualization<br />

Many <strong>Smart</strong> <strong>Grid</strong> analytics involve extensive numerical data used in making operational decisions. The<br />

need to present information in an operations-optimized format makes visualization a crucial element of<br />

the analytics architecture. While its overall usefulness to analytics makes visualization is a core<br />

analytical tool, it is also useful to other grid services (data synchronization, workforce enablement,<br />

customer empowerment). This therefore places visualization as a cross-cutting asset in the <strong>Smart</strong> <strong>Grid</strong><br />

architecture.<br />

Concatenated analytics<br />

Many analytics are best structured in concatenated form, where output from one analytic becomes the<br />

input to another. For <strong>Smart</strong> <strong>Grid</strong>, this can occur in one of two ways. In a distributed architecture,<br />

individual analytic agents may cooperate in a calculation, with each agent contributing a portion of the<br />

result. Alternately, analytics may be structured in tiers. An example would be the low-level analytics<br />

converting power quality (PQ) information into measures of grid asset stress. The stress analytic output<br />

are inputs to a second tier of analytics converting stress to abstract measures such as Loss of Life,<br />

Expected Time to Failure, and Asset Failure System Risk. These abstract measures are then made<br />

available to an asset management application incapable of processing the original low-level PQ data.<br />

Sourcing of data for analytics<br />

A key issue for analytics architecture is how to best minimize the number of new sensors. Properly<br />

chosen and located sensors can produce grid data capable of supporting many separate business needs<br />

when processed through multiple analytics. This multi-faceted aspect makes necessary a sensing<br />

strategy to accommodate business requirements while minimizing investment in new sensing<br />

infrastructure.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 24


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Delivery of analytics results<br />

In good grid architecture, analytics results will be distributed in various ways. Many analytics can be<br />

used by more than one business process (1:N delivery model). Some business processes require the<br />

combined results of many analytics (N:1 delivery model). Finally, should both situations fit, the N:N<br />

delivery model could be employed. These delivery models need to influence the modeling of any<br />

business process reliant on analytics.<br />

Persistence of analytics<br />

Analytics output, if treated as data, may need some type of persistence. One simple approach is to store<br />

analytics outputs in a time series database (historian). Not all analytical results need to be kept for long<br />

periods of time. For example, analytics used for converting raw grid data to grid state information will<br />

persist until over-written with fresh grid state; the persistence may be in a distributed or shared<br />

database, with individual values lasting only seconds before being refreshed.<br />

Analytics <strong>Architecture</strong> Considerations<br />

The <strong>Smart</strong> <strong>Grid</strong> Architect must consider many factors while developing the analytics services<br />

architecture. This section outlines several key issues for analytics architecture.<br />

Analytics Latency Hierarchy<br />

How analytics outputs are consumed is an important consideration for a <strong>Smart</strong> <strong>Grid</strong> system. Some<br />

applications must perform with very low latency in response to events or conditions, whereas others<br />

may respond over days or months. The vast majority fall in the middle, with latency ranging from<br />

seconds to hours. Thus, analytics can be categorized based on a latency hierarchy [Figure 33].<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 25


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 33 - Analytics Latency Hierarchy<br />

Classification of an analytic by its latency requirement is an important architectural consideration, as it<br />

may dictate where the analytic must be executed. It also strongly impacts two other <strong>Smart</strong> <strong>Grid</strong><br />

architectural elements: data persistence and communications. The distribution of intelligence in a <strong>Smart</strong><br />

<strong>Grid</strong> system is influenced by latency and scalability. Analytics can also be used to normalize data<br />

bandwidth requirements at various tiers in the network architecture by deploying their filtering<br />

capability in a distributed hierarchal form. The tradeoff between distributed intelligence (and<br />

distributed analytics in particular) and network requirements is a crucial <strong>Smart</strong> <strong>Grid</strong> design issue. Data<br />

persistence architecture must align with this tradeoff decision, which can lead to distributed hierarchal<br />

data persistence design issues.<br />

Scalability<br />

As <strong>Smart</strong> <strong>Grid</strong>s evolve, data volumes will increase and analytics consumers will demand increasingly<br />

more stringent delivery requirements. This evolution will require periodic review of analytic engine<br />

scalability and the sizing of associated architectural elements (persistence and communications). Some<br />

centralized analytics approaches don't scale well, caused either by the engine becoming a bottleneck, or<br />

because the network design prevents the embedded analytics engines to transition from handling<br />

dozens of inputs to thousands, or millions. As described above, the data reduction aspect of analytics,<br />

when coupled with appropriate network architecture, can address scalability in a general way. The<br />

same feature provides an incremental build-out capability compatible with typical utility roll-outs.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 26


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Availability and Failover<br />

Some <strong>Smart</strong> <strong>Grid</strong> analytics are crucial to real time operations. Such analytics may require a high<br />

availability (HA) implementation consistent with the critical operational processes supported. The<br />

<strong>Smart</strong> <strong>Grid</strong> architect must first classify analytics appropriately and then specify the necessary HA<br />

architectural elements.<br />

Analytics and Data Representation<br />

Analytics architecture is necessarily closely aligned with data architecture, with a focus on two areas:<br />

• Persistence models and data stores<br />

• Data representation<br />

The first is influenced by <strong>Smart</strong> <strong>Grid</strong> data classes and latency requirements. The second is part of a<br />

larger <strong>Smart</strong> <strong>Grid</strong> issue. At the lowest levels, <strong>Smart</strong> <strong>Grid</strong> devices will produce data in many different<br />

formats and protocols, especially legacy devices. However, even newer devices may use IEC 61850,<br />

IEEE C37.118, DNP 3, SEP 2.0, etc. As data and analytics move up the hierarchy from grid devices<br />

toward databases and application systems, these disparate formats should be converted to the IEC<br />

Common Information Model (CIM) representation. The CIM usage benefits of enhanced<br />

interoperability and architectural "future-proofing" are significant in any <strong>Smart</strong> <strong>Grid</strong> design, especially<br />

one based on an evolving System of Systems approach toward <strong>Smart</strong> <strong>Grid</strong> transformation. The location<br />

and timing for converting non-CIM representations to CIM are key architectural decisions.<br />

Management of Analytics Environments<br />

Like other complex systems, analytics require management functions for proper deployment, version<br />

control, etc. Analytics configuration issues are essentially the same as those for devices or applications.<br />

For complex event processing, CEP engines are generally rule-based, with the rules taking many forms<br />

(state transition models, extended SQL query sets, etc.). Managing CEP rule sets, including the proper<br />

distribution and synchronization in a distributed analytics environment, is a critical aspect of the<br />

overall analytics architecture. The architect may merge this with the cross-cutting issue of managing<br />

services, systems, and devices to evolve a unified solution for communication networks, grid devices,<br />

and analytics elements, including CEP rule sets.<br />

Centralized, Distributed, and Hybrid Analytics <strong>Architecture</strong>s<br />

Enterprise analytics architectures have traditionally been centralized, with business data repositories<br />

and warehouses, including analytics assets such as ordinary database queries, data cube engine<br />

(OLAP) tools, Key Performance Indicators (KPI's), executive dashboards, and data mining tools. For<br />

<strong>Smart</strong> <strong>Grid</strong>, all of the foregoing still applies, but the issues of real time control and operator decision<br />

support must also be addressed. Due to the data volumes and latency requirements supporting utility<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 27


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

operations, it is impossible for all analytics to reside at the enterprise back office. At a minimum,<br />

analytics are needed in the control centers, and likely beyond.<br />

Control center analytics may be viewed as centralized and therefore logical deployment sites for<br />

analytics engines. Since grid data are often streams, analytics engines must accept real-time data feed,<br />

with access to the meta-data providing context for grid data interpretation. This may require a<br />

combination of calculation engine, CEP engine and visualization package operating in real time. If any<br />

analytical results are used in an automatic fashion, the analytics engines must have network<br />

connectivity capable of delivering these outputs to the consuming systems. This connectivity will also<br />

be needed to allow periodic migration of some grid data and real-time analytics results to back office<br />

data repositories supporting various business analyses, reporting, and planning tools..<br />

In advanced <strong>Smart</strong> <strong>Grid</strong> architectures, intelligence and any supporting analytics may be moved outside<br />

of the control center to substations and beyond. One approach is to view key substations as grid data<br />

centers in their own right, with analytics treated in a manner analogous to the control center. Another<br />

approach is to make use of truly distributed models, where analytics elements at the substation interact<br />

and cooperate with analytics at the control center. Finally, a highly distributed “edge computing”<br />

architecture would push intelligence and analytics beyond the substations to locations near, or on, edge<br />

devices. In addition to edge grid devices, network devices are also logical homes for elements of grid<br />

intelligence and analytics.<br />

The distributed analytics model has compelling advantages in terms of latency minimization,<br />

robustness, incremental rollout, and flexibility. However, the model also raises several issues,<br />

including:<br />

Interaction models – distributed analytics may be implemented in embedded dedicated form or<br />

as agents in a multi-agent system. The nature of interactions among distributed analytics<br />

elements is a major architectural issue.<br />

Share models – if distributed analytics elements are to interact with each other and with utility<br />

devices and systems, then data sharing models become crucial. These models range from<br />

various kinds of memory sharing (shared RAM, distributed databases, shared-nothing, etc.) to<br />

hierarchal and lattice data flow models.<br />

Peer-to-peer messaging – an implication of using distributed approaches for analytics<br />

architecture is the necessity of peer-to-peer messaging for most models. This adds to the<br />

communications network and security design requirements.<br />

Regardless of how analytics are distributed, most models require a centralized mechanism to manage<br />

the distributed analytics. This must be included in the analytics architecture design.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 28


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Analytics Capability Maturity<br />

As with many other aspects of information system architecture, implementation, and operation,<br />

analytics architecture at any utility will progress through levels of capability maturity. A simplified<br />

model of capability maturity for analytics in <strong>Smart</strong> <strong>Grid</strong> systems follows:<br />

Table 16 – Analytics Capability Maturity Model<br />

Self-learning<br />

Optimizing<br />

Predictive<br />

Automated<br />

Operational<br />

Level Description Comments<br />

Business/ Operational<br />

Intelligence<br />

Measure/report<br />

Conclusion<br />

Analytics automatically learn from data<br />

and experience to modify themselves so as<br />

to improve accuracy and efficiency in<br />

information extraction and information<br />

discovery<br />

Analytics are used as the basis for<br />

optimization of operations, asset<br />

management, and prosumer interaction<br />

Analytics are advanced enough to make<br />

significant predictions and are routinely<br />

used in a forward-looking manner<br />

Analytics processes are fully integrated<br />

and run automatically; most analytics<br />

describe present and recent past<br />

Analytics are routinely used in operations<br />

and business processes<br />

Data acquisition is integrated to some<br />

business and operational processes<br />

Basic ability to make measurements,<br />

collect data, and generate batch reports<br />

Analytics tools include autonomous goal seeking<br />

capabilities aligned with the utility’s business goals<br />

and continually operate to improve their<br />

performance against the large scale goals of the<br />

business<br />

Analytics are deeply integrated with the higher<br />

levels of control and decision-making in the utility<br />

Utility processes make routine use of the predictive<br />

capabilities to plan alternatives and perform<br />

tradeoffs; predictive analytics are commonly used<br />

in decision support<br />

Integration of analytics with processes and systems<br />

is extensive; very little manual intervention is<br />

required for analytics to receive data or deliver<br />

results to consumers<br />

Some amount of data and analytics integration is<br />

present; some manual integration still being done<br />

Much of the integration is manual; processes are<br />

still fragile and siloed<br />

Elementary capability; most utilities are well past<br />

this stage<br />

Ultimately, the <strong>Smart</strong> <strong>Grid</strong> Architect must provide an analytics architecture consonant with the rest of<br />

the <strong>Smart</strong> <strong>Grid</strong> design, and consistent with the System of Systems approach as a set of services able to<br />

evolve with the <strong>Smart</strong> <strong>Grid</strong>. The analytics architecture must also be closely coordinated with data<br />

management services, communication services, and security architectures.<br />

Data Services<br />

Data Governance<br />

Data Governance is the discipline of treating data as an enterprise asset. Its goal is to optimize, secure<br />

and leverage data as an enterprise asset. Data Governance uses an organization’s people, process,<br />

technology and policy to derive optimal value from enterprise data. It also helps align disparate and<br />

often conflicting policies that are a contributing cause for many data anomalies.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 29


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Treating data as a strategic enterprise asset implies the need for organizations to complete data<br />

initiatives analogous to ones for physical assets. For example, utilities need to build an inventory of<br />

their existing data. The typical utility has an excessive amount of data on grid components, plants,<br />

customers, vendors and products, but has not formally documented where this data resides. A second<br />

data initiative for utilities is cyber security - business-critical data (Operational, Financial, Enterprise<br />

Resource Planning, and Human Resource) must be protected from unauthorized change or transmittal.<br />

Data is both an organization’s greatest source of value and its greatest source of risk. Poor data<br />

management often leads to bad business results and to greater exposure to compliance violations and<br />

data theft. To mitigate this risk, many companies attempt to strike a balance between easy data access<br />

and appropriate data use by using mandates (rules, policies and regulations). However, the business<br />

imperative to provide better customer service by quickly using trusted data can cause some to pay<br />

short shrift to these mandates. Similarly, effective use of disparate information can enhance innovation,<br />

but overly strict data security could make such innovative data correlations impossible. An appropriate<br />

balance among data access, data quality and cyber security must be struck by each utility.<br />

Organizations must also consider the business value of their unstructured data. Often referred to as<br />

“content,” this data needs governance similar to structured data. An example is the creation of a<br />

company-wide records management program. Many firms must retain electronic and paper records for<br />

specific time periods. A rigorous records management policy allows records to be produced during a<br />

legal discovery process in a timely and cost-effective manner, in compliance with established retention<br />

schedules for specific document types.<br />

The following are some benefits derived through data governance:<br />

• Improve the level of trust the users have in reports<br />

• Ensure data consistency across multiple reports from different parts of the organization<br />

• Ensure appropriate safeguards over corporate information for auditors and regulators<br />

• Improve the level of customer insight to drive innovation and marketing initiatives<br />

• Directly impact the three prime factors for any organization: increasing revenue,<br />

lowering costs and reducing risk<br />

Enterprise Information Management<br />

According to Gartner (White, Comport, & Schlier, 2005), Enterprise Information Management (EIM):<br />

1. represents an organizational commitment to structure,<br />

2. secures and improves the accuracy and integrity of information assets to solve semantic<br />

inconsistencies across all boundaries, and<br />

3. support the technical, operational and business objectives within the organization's enterprise<br />

architecture strategy<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 30


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

EIM encompasses not only traditional ICT systems, but all systems and devices for which the<br />

enterprise is responsible. Applied to a utility, grid management information is therefore considered<br />

within scope. Accordingly, a utility EIM encompasses information flowing to/from grid edge devices<br />

(distributed energy resources, plug-in electric vehicles, premises area networks, etc.). This ambitious<br />

scope is facilitated by the utility industry use of consistent models (IEC 61850, 61968, and 61970 series).<br />

During the early stages of <strong>Smart</strong> <strong>Grid</strong> “system of system” implementations, traditional utility data<br />

acquisition and control systems (for substations, feeders, and meter head-end) will manage edge device<br />

information. These systems use a mix of proprietary and industry standard protocols (DNP3) to bring<br />

telemetry to a server tasked to make the data available to other enterprise systems. In these cases, EIM<br />

will interact with edge device information representations, not the edge devices themselves. Over time,<br />

as more intelligence is pushed toward the grid edges, EIM will need to simultaneously extend further<br />

into the network. While physical implementations will necessarily vary considerably (due to hardware,<br />

media and computational capabilities functioning within security constraints), the data management<br />

service categories described in this section are expected to extend to all service enabled applications<br />

and devices in any utility <strong>Smart</strong> <strong>Grid</strong> system of systems.<br />

A commitment to EIM recognizes enterprise information is as important as process (application<br />

development) and infrastructure (technology). EIM enables raw data to be turned into information,<br />

intelligence, knowledge, and wisdom. As information systems become increasingly vital to business<br />

success, information management must be addressed holistically. In summary, EIM:<br />

Enables utilities to take ownership, responsibility and accountability for the improvement of<br />

data quality, information accuracy and consistency.<br />

Enables utilities to establish single version of truth for data over time.<br />

Improves utilities process and operational efficiency and effectiveness.<br />

Provides a strategy and technique to mitigate the risks as well as maximize the value of<br />

implementing commercial packaged applications.<br />

Reduces the number and size of data integration efforts over time.<br />

Enables the control of wasteful data duplication and proliferation.<br />

Enables process integrations to be more flexible and scalable.<br />

Improves data quality, integrity, consistency, availability, and accessibility.<br />

Maximizes the return on SOA technology investments.<br />

Establishes a critical component of the utility Enterprise <strong>Architecture</strong>.<br />

Provides guidance and services to information management efforts.<br />

Enables consistent implementations of SOA and information management for major programs.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 31


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Enterprise Information Management Strategy<br />

EIM frameworks [Figure 34] and strategies provide a roadmap to help utilities establish necessary<br />

information governance and technology solutions. EIM can also drive and enable the convergence of<br />

operational, communications and information technologies, key to a utility <strong>Smart</strong> <strong>Grid</strong> realization.<br />

Enterprise Vision &<br />

Strategy<br />

Enterprise<br />

<strong>Architecture</strong><br />

Enterprise Business<br />

& IT Core<br />

Processes<br />

Enterprise Business<br />

& IT Organizations<br />

Enterprise<br />

Infrastructure<br />

EIM Vision &<br />

Strategy<br />

EIM Governance<br />

EIM Core<br />

Processes<br />

EIM Organization<br />

EIM Infrastructure<br />

Vision<br />

Mission<br />

Strategy<br />

Goals &<br />

Objectives<br />

Value<br />

Propositions<br />

Sponsorship<br />

Stewardship<br />

Policies,<br />

Principles &<br />

Tenets<br />

Alignment<br />

Structure<br />

Data Quality<br />

Data Integrity<br />

Data Security &<br />

Protection<br />

Data Lifecycle<br />

Management<br />

Data Movement<br />

Semantics<br />

Management<br />

Database<br />

Management<br />

Master Data<br />

Management<br />

Information<br />

Services<br />

Services &<br />

Support<br />

CSFs & KPIs<br />

Structure<br />

(Virtual,<br />

Hybrid……)<br />

Roles &<br />

Responsibilities<br />

Functional<br />

Services<br />

Business Value<br />

and Relationship<br />

Management<br />

Information<br />

<strong>Architecture</strong><br />

Blueprint<br />

Management<br />

Technologies<br />

(DBMS, Content<br />

Mgmt, ETL, EAI,<br />

EII, Data<br />

Modeling, BI/DW,<br />

Collaboration…..)<br />

Knowledgebase<br />

and Repositories<br />

Standards & Best<br />

Practices<br />

Figure 34 - EIM Framework<br />

Since much public domain content describes aspects of EIM, the remainder of this section focuses on<br />

how semantic consistency can be improved by leveraging an Enterprise Semantic Model (ESM). The<br />

ESM provides the logical representation of enterprise information assets used to manage or facilitate<br />

business processes. Establishing EIM without an ESM life-cycle design provides little return on<br />

investment since it greatly lessens opportunities for the effective reuse of project artifacts.<br />

Systematic use of ESM supports the following attributes, collectively difficult to achieve otherwise:<br />

Enterprise Information Driven – The ESM should utilize internal models, metadata, and<br />

terminology already in use in the utility enterprise. Existing models and common vernacular,<br />

whether or not they are documented, are important sources for ESM development.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 32


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Enterprise Owned – the utility owns the ESM, including its terminology, semantics, and<br />

implementation. The utility decides if and when externally controlled semantics are introduced.<br />

Stable – The ESM must be stable, keeping established semantics clear and unambiguous.<br />

Non-Static – ESMs are non-static in nature, allowing semantics to evolve toward greater clarity<br />

as existing business information evolves or new information is introduced.<br />

Openly Accessible – The ESM must provide open access to business-critical information about<br />

semantics, data restrictions, entity refinement, and specific business constraints.<br />

Semantic Traceability – Semantic traceability and lineage are important correlations for internal<br />

information (non-ESM semantics).<br />

Industry Standards Aware – A robust ESM provides mechanisms to systematically allow input<br />

from applicable industry standard models (CIM, data types, and code lists) to incorporate<br />

standard and broadly-adopted semantics.<br />

Multiple Standards Capable – An ESM must be capable of incorporating multiple external<br />

reference models, even allowing for referencing more than one standard from a single business<br />

entity.<br />

Concise Enterprise Semantics – By benefiting from both internal sources and available industry<br />

standards, an ESM provides concise enterprise semantics appropriate for business information<br />

across the enterprise.<br />

Business Context Capable - The ESM must support data exchange and information sharing<br />

within a particular business context.<br />

Leverage Available Methodologies - When appropriate, any existing modeling methodologies<br />

should be used in order to avoid reinvention or introduction of proprietary concepts.<br />

Proprietary methods limit choices of service providers, which indirectly will drive up<br />

maintenance and enhancement costs.<br />

Data Management Services<br />

All <strong>Smart</strong> <strong>Grid</strong> domains require Data Management (DM) services, and most require more capability<br />

than they have today. The increase in data volume, combined with tightening timing requirements,<br />

will cause most <strong>Smart</strong> <strong>Grid</strong> enterprises to evaluate their legacy services for future suitability. Data<br />

services can be broken down into data acquisition, transformation, persistence and archiving. A list of<br />

data services and related functions and definitions may be found at .<br />

Control Services<br />

Control for electric utilities covers a considerable span of activities. All relate to the operation of control<br />

devices for power flow manipulation, but the scope ranges from consumer basic voltage regulation to<br />

grid interchange scheduling. This section’s focus is on transmission and distribution control.<br />

Types of Control<br />

<strong>Grid</strong> control is decomposed into three major categories, each with unique requirements.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 33


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Transmission and Substation (System) Control<br />

Transmission and substation level control involves control of transmission systems and substations.<br />

The primary elements are:<br />

Power flow – control of switchgear defining the power flow paths<br />

Balance – dispatch of generation to meet forecasted load, usually by continually driving a<br />

calculated error value toward zero. In the past this was viewed as generation control, but with<br />

the rise of Distributed Energy Resources (DER) and Demand Response (DR), balance authorities<br />

will also dispatch at the distribution and retail levels.<br />

Stabilization – control of ancillary services and devices such as generation and Flexible AC<br />

Transmission Systems (FACTS) to maintain rotor angle stability, voltage stability, and frequency<br />

stability; increasingly this includes control of new devices (e.g. flywheel storage) and dispatch of<br />

hydro power to compensate for the effects of some DERs (i.e. solar, wind). This also includes<br />

using FACTS and Phasor Measurement Units to dampen modal power oscillations.<br />

Volt/VAR – regulation at the transmission level. This can involve Static VAR Compensators and<br />

other FACTS devices, as well as shunt capacitors at the substation<br />

Distribution Level<br />

Distribution level control has expanded from simple SCADA-based control to advanced distribution<br />

automation, increasingly becoming more complex as the distribution grid becomes the focus for DER<br />

integration. Distribution level controls include:<br />

Volt-VAR regulation – regulation of voltage levels and reactive power flow control (and power<br />

factor) at the distribution feeder level. This involves load tap changes, voltage regulators, and<br />

control of capacitor banks. Control of DER-based DC-AC inverters to provide VAR regulation<br />

will also grow in importance as the grid evolves.<br />

Power flow control – operation of switchgear and sectionalizing devices to control power flow<br />

at the distribution feeder level<br />

Stabilization – control of devices at the distribution level, including use of distribution<br />

STATCOM in addition to more traditional distribution automation<br />

Secondary Load Control<br />

Some forms of secondary load control (load shed for demand side management) have existed for<br />

decades. However, recent requirements have emerged to support DR through the distribution-level<br />

control of ancillary devices. Managing secondary loads with distribution-level controls presents<br />

potentially thorny issues for utility control services and processes. Generally, this means non-utility<br />

control devices residing on customer premises are to be commanded by the utility or a third party (e.g.<br />

aggregator). The requirements on utility control processes are largely dependent on how well the<br />

DR/DER controls are integrated with the utility control systems. Full integration will necessitate close<br />

collaboration between the utility and its customers, probably governed by a formal agreement between<br />

the parties. Little or no integration will reduce the potential of secondary load DR for reducing the level<br />

of expensive daily peak power reserves the utility must provide. The extent of secondary load control<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 34


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

will likely be driven by economic incentives, which likely means the level of secondary load integration<br />

will gradually grow over time from a small starting point.<br />

Control Data Classes<br />

Several classes of data are important to control systems. The <strong>Smart</strong> <strong>Grid</strong> Architect must consider how<br />

to deliver each class to the appropriate destinations within the specified latency. The data classes are:<br />

Telemetry – most grid state measurement data (voltages, currents, real and reactive power) are<br />

in the form of telemetry, instrument data produced and collected on a regular basis. In some<br />

designs, sensor data is sent to the control system only upon significant change (i.e. RBE - “report<br />

by exception”), thus reducing average bandwidth requirements.<br />

Events – asynchronous event messages are generated by a myriad of grid devices, many of<br />

which require control actions to be taken. Therefore the control services architecture must<br />

support receipt and processing of such messages. RBE data can be viewed as event messaging.<br />

Forecasts – utility control processes make extensive use of various kinds of forecasts - load<br />

forecasts, weather forecasts, and solar/wind generation forecasts being prime examples.<br />

System models – utility control processes use system models extensively and the dependence on<br />

such models is increasing in the <strong>Smart</strong> <strong>Grid</strong> environment. Two major types of system models<br />

used in grid control processes are:<br />

o Power state – also known as grid state, the power state represents the instantaneous<br />

values of voltages, currents, and real and reactive power flows.<br />

o Topology – power grids have connectivity and the models that represent the circuit and<br />

substation connectivity are crucial context for grid control processes.<br />

<strong>Grid</strong> state is a powerful concept used extensively at the transmission level, where grid state estimation<br />

is a standard process used in system control. However, it has not been used as much at the distribution<br />

level. The main reasons for this are:<br />

1. Distribution level connectivity models are complex and relatively inaccurate, and<br />

2. Distribution circuits are treated as unbalanced, making grid state estimation costly<br />

As distribution grid observability increases, it becomes feasible to replace grid state estimation with<br />

grid state determination. This combines direct grid state measurement with a minimal amount of<br />

estimation. The availability of distribution grid state is a key factor in enabling sophisticated<br />

distribution level control processes.<br />

Control Properties and Issues<br />

Multi-Objective/Multi-Controller systems – as control processes become more complex in a<br />

<strong>Smart</strong> <strong>Grid</strong> environment, it becomes desirable or necessary to operate specific grid devices for<br />

multiple business purposes. This need raises architectural issues as to how potentially<br />

conflicting control commands are resolved. Several design patterns for multi-controller<br />

structures are shown in Figure 35.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 35


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 35 - Multi-Controller / Multi-Objective Design Patterns (van Breeman, 2001)<br />

Federation – multiple control sub-systems must co-exist in a <strong>Smart</strong> <strong>Grid</strong> environment, especially<br />

at the distribution level. Some control systems, as mentioned above, may not reside inside of the<br />

utility, but their grid effect can impact the utility. The federation of multiple, interacting control<br />

sub-systems or processes presents architectural issues unknown in siloed systems.<br />

Disaggregation – as more controllable devices are installed at the distribution level, high-level<br />

control commands will increasingly be decomposed to better fit control actions to specific<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 36


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

conditions on individual circuits or circuit sections. This disaggregation process is a key element<br />

the <strong>Smart</strong> <strong>Grid</strong> control services architecture must support.<br />

Context and representation – as mentioned above, the context for control actions (and analytics)<br />

is tied directly to the physical connectivity of the relevant grid segment. Consequently, the<br />

representation of grid structure and related information (grid state) are key issues for grid<br />

control services. The Common Information Model (IEC, 2003) schema is a core standard for such<br />

representation and is therefore crucial to the control services architecture.<br />

Control architecture considerations<br />

A number of factors affect control services architecture. Key is the utility’s long-term transition strategy<br />

on how to accommodate legacy control systems while integrating new <strong>Smart</strong> <strong>Grid</strong> control capabilities.<br />

Present utility control systems tend to exist in the form of siloed, tightly-bundled systems. Some<br />

examples are Energy Management Systems, SCADA, Distribution Automation, Outage Management<br />

Systems, and the presently evolving Distribution Automation Systems. A traditional control center<br />

functional architecture is shown in Figure 36 below.<br />

Figure 36 - Control Center Functional <strong>Architecture</strong> (IEC, 2005)<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 37


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

A transition to a layered, services-oriented system of systems architecture will cause these systems to<br />

evolve away from their siloed and monolithic current state. At present, interoperability efforts are<br />

helping to better integrate these systems, but modifying these products to a full services-oriented<br />

model will be a longer transition. It will probably pace the evolution of the entire <strong>Smart</strong> <strong>Grid</strong>. In the<br />

meantime, the system-of-systems philosophy can help the <strong>Smart</strong> <strong>Grid</strong> Architect develop large-scale<br />

control services architecture by integrating available control system elements (listed above).<br />

Utility control systems must deal with a range of latency requirements, and as the <strong>Smart</strong> <strong>Grid</strong> becomes<br />

more capable, the latencies are expected to decrease. SCADA cycles previously measured in seconds<br />

are being displaced by closed loop stabilization controls operating on the time scale of two cycles (1/30 th<br />

second). Some processes will continue to have relatively long latencies, but application requirements<br />

driving control services architecture hardest will be the ones with the tightest time limitations.<br />

The <strong>Smart</strong> <strong>Grid</strong> concept includes many more control points than the traditional grid, especially at the<br />

“edges” (distribution level). As controllable points are added, control architecture scalability becomes<br />

an increasingly important issue. Not only are more points being controlled, but the number of data<br />

points used to compute the control will grow dramatically.<br />

While control systems are vital to smart grid success, the power reliability and availability provided by<br />

the current control services remain of highest importance to power delivery. The smart grid migration<br />

plan must never degrade existing core grid attributes. <strong>Grid</strong> control services architecture must therefore<br />

have enough flexibility to ensure grid reliability is unaffected as new control features are implemented.<br />

The smart grid environment will involve increasing numbers of control devices as well as processes<br />

and applications. Management of the devices and applications will be complex. The control services<br />

architecture must closely integrate with the management services architecture to provide a unified<br />

approach toward managing settings, protection curves, code versions, exception events, etc.<br />

Control <strong>Architecture</strong>s<br />

Where legacy utility control system architectures were centralized (e.g. EMS, SCADA, OMS), many<br />

future smart grid control systems will be fully distributed or have distributed components. A few<br />

utility control systems are already distributed – an example is a fault isolation system using peer-topeer<br />

radio and pre-programmed logic on the sectionalizers to isolate faults in distribution circuits. The<br />

smart grid architect should expect control services architecture to transition from mostly centralized, to<br />

partially-centralized, to a final hybrid centralized/distributed state. There are various hierarchical<br />

alternatives for how to arrange the hybrid controls service. An example design pattern for hierarchical<br />

control architecture is shown in Figure 37 below. Such structures will raise implementation issues<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 38


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

while the utility begins to move away from the mostly centralized legacy control. Managing the hybrid<br />

control services architecture is expected to be complex and time-intensive.<br />

Figure 37 - Hierarchical Control Design Pattern<br />

Conclusion<br />

The control services architecture presents many challenges to the smart grid architect, especially the<br />

coordination of control services with other smart grid services architectures. The challenge is similar to<br />

that posed by the switchover from manual meter reading to AMI – any portion of the system is crucial<br />

to operations, cash flow, and customer satisfaction, leaving little or no margin for experimentation or<br />

error.<br />

Security Services<br />

<strong>Grid</strong> systems security has largely relied upon obscure proprietary protocols and lack of remote<br />

communications access (security by obscurity) to protect grid control devices. The smart grid is<br />

expected to provide a more secure and reliable grid infrastructure.<br />

Security Threats<br />

<strong>Smart</strong> <strong>Grid</strong> Cyber Security concerns dictate a multi-faceted approach to security. The system must<br />

provide security controls to address concerns unique to the implementation environment, and to<br />

interactions and interdependencies with other enterprise and business applications. The smart grid<br />

security architecture must address these concerns with a rich set of controls designed to facilitate<br />

tailored and highly granular supervision. Each control must be engineered for its environment,<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 39


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

mission, and user. The resulting solution must manage the full lifecycle security for every aspect of<br />

information and technology, from edge to back office devices and from engineering to implementation.<br />

Physical Security Threats<br />

Utilities need to respond to increased physical threats on their electrical assets with a greater number of<br />

physical security systems (e.g. video surveillance, biometric-based access controls, alarms, motion<br />

detection sensors, etc.), as well as other measures. Physical threat counter-measures demand<br />

coordination, management, and communication infrastructure to relay information to appropriate<br />

Security Control Centers and Emergency Centers (i.e. the Police, Fire Department and local Hospitals).<br />

Training must also be provided to utility personnel on a regular basis to ensure a high-level of security<br />

awareness in each employee. Each person needs to know how to identify potential physical threats and<br />

how to contact the appropriate resource to mitigate the potential risk.<br />

Cyber Security Threats<br />

The increased use of Information and Communications Technologies (ICT) in the smart grid also brings<br />

additional security threats potentially impacting electric power system reliability. Sophisticated cyberattacks<br />

could devastate this infrastructure, and the dependent economy. Cyber security threats have a<br />

broad sweep, from relatively minor (an attempt to bypass a meter), serious (an organized crime<br />

attempt to extort utility funds by threatening service disruptions), to existential (national adversaries<br />

seeking to destabilize the country’s critical infrastructure). Other potential threats include intentional<br />

attacks by disgruntled employees or unintentional errors made by well-meaning employees.<br />

Considering the millions of electronic devices (e.g. smart meters) being deployed with expected<br />

lifetimes exceeding 15 - 20 years means applying ex post facto security can no longer be tolerated. <strong>Smart</strong><br />

grid systems must be secure by design.<br />

Using Internet Protocol (IP) for smart grid communications and open standard protocols for grid<br />

control necessitates securing the grid at multiple points. The <strong>Smart</strong> <strong>Grid</strong> Security Services provides<br />

security enforcement at these points (e.g. SCADA Network systems, the Utility Communication Link,<br />

Advanced Metering Infrastructure, Substation Remote Monitoring Equipment, and Meters to Meter-<br />

Data Collection Points).<br />

In addition, utilities may need to enhance the protection applied to their public-facing portals (i.e. web<br />

pages). These will inevitably be attacked as Demand Response prosumer energy controls are activated<br />

by smart grid projects. Security architects will need to defend against these cyber-attacks while<br />

protecting sensitive customer data without disrupting any prosumer using utility internet tools<br />

provided to help manage electricity.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 40


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

This security perimeter expansion has both topological and identity-based elements. This allows<br />

Security architects to classify and prioritize security vulnerabilities for each communication<br />

infrastructure perimeter, as illustrated below by Figure 38:<br />

Figure 38 - Security Threats Classification<br />

With all the potential security threats to the smart grid, how can a Security architect ensure grid<br />

security and reliability? Simply complying with regulatory requirements is usually not sufficient to<br />

protect critical systems against determined adversaries. Security architecture must be pervasive. It<br />

requires considerable planning, analysis and design concurrent with other grid architecture designs.<br />

Security Assessment<br />

In order to address the diverse grid threats, the security architecture must perform an assessment to<br />

identify ICT security vulnerabilities and risks. To be successful, all utility business units and support<br />

organizations must participate, allowing access to their ICT infrastructure and providing the<br />

transparency needed to uncover all known and potential security attack vectors.<br />

Each security assessment must also consider evolving legal and regulatory security requirements. This<br />

helps the utility remain compliant with external mandates (i.e. NERC CIP, NISTIR, NIST 800-xx,<br />

various state and local directives).<br />

The Security Architect must clearly communicate the objectives of each assessment:<br />

Review existing security policies and identify potential gaps to reduce organizational risk<br />

Ensure necessary security controls are integrated into each project’s design<br />

Provide documentation outlining any security vulnerabilities and suggest solutions<br />

The following methodology outline is an effective means to conduct a security assessment:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 41


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Requirement Study and Situation Analysis<br />

Document Review<br />

Risk Identification<br />

Vulnerability Scan<br />

Data Analysis<br />

Report & Briefing<br />

As noted above, the Security Assessment identifies security vulnerabilities. It also helps define the<br />

security strategy for the smart grid system-of-systems. The huge number of interconnected points in<br />

smart grid makes its security very challenging. The Security Assessment helps the utility determine the<br />

assets to security-enhance and those with an acceptable risk level. The Levels of Criticality and Levels<br />

of Trust, described later in this section, are relevant tools for this assessment.<br />

The <strong>Smart</strong> <strong>Grid</strong> Cyber Security concerns dictate a multi-faceted approach to security. The system must<br />

provide security controls to address concerns unique to the implementation environment and<br />

interdependencies among enterprise and business applications. The smart grid security architecture<br />

must address these concerns with a rich set of controls designed to facilitate tailored supervision with a<br />

high degree of granularity. Each control must be engineered for its environment, mission, and user.<br />

The resulting solution will manage security from cradle to grave for every aspect of information and<br />

technology, from edge devices to Back Office; from engineer to implementation.<br />

The imperative to address emergent cyber security concerns as the smart grid matures requires a Risk<br />

Adaptive <strong>Architecture</strong>. This architecture combines risk management and principled systems<br />

engineering methods to produce a scalable, modular solution. This equips security architects with tools<br />

needed to respond as threats, technology, regulation, and usage independently change.<br />

The Security Architect must also study technology providing direct security capabilities, as well as<br />

functionality to simply enable secure policy, architecture, and configuration. The security architecture<br />

should use the best cryptography along with filtering, firewalls, segmentation, and virtualization.<br />

Physical security must be interwoven with cyber security to ensure controls are appropriate, effective,<br />

economical, and enduring. Finally, recognizing even the best of systems fail and no armor is perfect,<br />

the security architecture must develop a holistic approach to deter, prevent, detect, react, and recover.<br />

Security Context<br />

Central to the notion of security services for risk adaptive security architecture are the related concepts<br />

of security domains and levels of trust. The two broad smart grid service domains are described below.<br />

The trust level is derived from data quality and source trustworthiness.<br />

Since smart grid spans a complex trust environment, it must be capable of distinguishing, labeling, and<br />

segmenting data based on its origin and the system’s level of confidence in the data. <strong>Smart</strong> grid<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 42


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

functionality must have enough resilience to ensure essential functions remain available should data<br />

sources be suddenly deemed untrustworthy and dropped from analytics, displays, etc.<br />

Security Service Domains<br />

A security service domain is an area with a relatively consistent set of constraints and expectations.<br />

There are two security service domains:<br />

Levels of Criticality<br />

The Centralized Security Services domain drives the security scheme, providing automated<br />

security services to all elements of the system as well as management capability for each of the<br />

automated services.<br />

The Decentralized or Edge Security Services domain provides the field component counterparts<br />

for relevant services in the Central Security Services domain. Both domains leverage physical<br />

access controls to compliment electronic controls in creating a complete protection picture.<br />

NERC currently defines three levels of criticality when it comes to CIP: High, Medium, and Low:<br />

Levels of Trust<br />

Bulk Electric System (BES) Subsystems have High Impact if, when destroyed, degraded or<br />

otherwise rendered unavailable, they could directly cause, contribute or create an unacceptable<br />

risk of BES instability, separation or a cascading sequence of failures.<br />

BES has Medium Impact, if, when destroyed, degraded or otherwise rendered unavailable, they<br />

could directly affect the electrical state or the capability of the BES, directly affect the ability to<br />

effectively monitor and control the BES.<br />

BES has Low Impact if, when destroyed, degraded or otherwise rendered unavailable, they<br />

could not directly cause, contribute to, or create an unacceptable risk of BES instability,<br />

separation, or a cascading sequence of failures.<br />

The level of trust for a particular datum starts with an assessment provided by the data source and<br />

retained in the data header’s quality field. The system combines this value with a measure of the trust<br />

assigned to its source to define the data level of trust as one of the following:<br />

Trusted: The data meets all predetermined criteria and is displayed and/or incorporated<br />

normally. The operator retains the ability to manually override the decision.<br />

Questionable: The data meets some but not all criteria or falls within a designated window<br />

whereupon the system warns the operator of the condition and prompts for data inclusion.<br />

Untrusted: The data fails to meet predetermined criteria and is not displayed or incorporated in<br />

calculations. The operator retains the ability to manually override the decision, however the<br />

system will indicate it is in an override condition.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 43


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NISTIR 7826 Security Guidelines (NIST-ITL, 2010)<br />

In August 2010, the NIST Information Technology Laboratory (ITL) issued a three-volume NIST<br />

Interagency Report (NISTIR 7628) entitled Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security (NIST-ITL, 2010) to<br />

discuss “ITL’s research, guidance, and outreach efforts in computer security and its collaborative<br />

activities with industry, government, and academic organizations.” A month later, the <strong>Smart</strong> <strong>Grid</strong><br />

Interoperability Panel (SGIP) Cyber Security Working Group published the Introduction to NISTIR 7628.<br />

The following text is from a sidebar on page 3 of this introduction, At a Glance: Report Objectives:<br />

The transformation of today’s electricity system into a <strong>Smart</strong> <strong>Grid</strong> is both revolutionary and<br />

evolutionary. Persistence, diligence, and, most important, sustained public and private<br />

partnerships will be required to progress from today’s one-way, electromechanical power grid<br />

to a far more efficient digitized “system of systems” that is flexible in operations, responsive to<br />

consumers, and capable of integrating diverse energy resources and emerging technologies.<br />

This progression will unfold over the span of many years, during which several generations of<br />

technologies will compose the evolving <strong>Smart</strong> <strong>Grid</strong>. As a consequence, the cyber security<br />

strategy for the <strong>Smart</strong> <strong>Grid</strong> must also be a continuing work in progress so that new or changing<br />

requirements are anticipated and addressed.<br />

Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security is both a starting point and a foundation. As <strong>Smart</strong><br />

<strong>Grid</strong> technology progresses, the Cyber Security Working Group (CSWG) will continue to<br />

provide additional guidance as needed. This first installment of the guidelines is:<br />

An overview of the cyber security strategy used by the CSWG to develop the high-level<br />

cyber security <strong>Smart</strong> <strong>Grid</strong> requirements;<br />

A tool for organizations that are researching, designing, developing, implementing, and<br />

integrating <strong>Smart</strong> <strong>Grid</strong> technologies – established and emerging;<br />

An evaluative framework for assessing risks to <strong>Smart</strong> <strong>Grid</strong> components and systems during<br />

design, implementation, operation, and maintenance; and<br />

A guide to assist organizations as they craft a <strong>Smart</strong> <strong>Grid</strong> cyber security strategy that<br />

includes requirements to mitigate risks and privacy issues pertaining to <strong>Smart</strong> <strong>Grid</strong><br />

customers and uses of their data.<br />

The guidelines are not prescriptive, nor mandatory. Rather, they are advisory, intended to<br />

facilitate each organization’s efforts to develop a cyber security strategy effectively focused on<br />

prevention, detection, response, and recovery.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 44


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NISTIR 7628 should be studied closely by all smart grid security architects. The three volume report<br />

contains a myriad of methods and related information designed to help organizations assess risk and<br />

then to apply appropriate security requirements to mitigate the risks identified.<br />

Communication Services<br />

Communication services (comms) are fundamental to electric grid operations. They enable devices to<br />

be intelligent, information to flow, controls to execute, and people to manage utility functions and<br />

services. Large numbers of new smart devices will be deployed in a smarter grid, each needing some<br />

form of communications. Planning for this deployment is difficult since most devices don’t yet exist<br />

and initial functionalities will change as grid operators figure out innovative ways to leverage their<br />

intelligence. Thus, it is critical for the future grid communication architecture to be extraordinarily<br />

resilient and flexible.<br />

It is strategic to develop a clear understanding at the conceptual layer of the interplay between smart<br />

grid objects (endpoints), the information they communicate, and the channels across which that<br />

information flows. This will provide context for rationalizing the communication functions at the<br />

services layer.<br />

Figure 39 - Conceptual and Services Layers<br />

Every endpoint, all information types, and each communications channel are different. Their<br />

combinations are staggering and their capabilities continually change. The comms requirements to<br />

support smart grid use cases are proof of this diversity (see Table 25 – Communications Services). This<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 45


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

will remain true as new smart grid use cases emerge. Characterizing these requirements can be<br />

extremely challenging. For example, performance requirements can range from exceptionally stringent<br />

to relatively modest. Information flows could be streamed, polled, infrequent, message mode, file<br />

transfer mode, or asynchronous event-driven. Application architectures can vary from highly<br />

centralized, to distributed, and some could even be peer-to-peer. The quantity of actors in these use<br />

cases could range from dozens to millions. Most are stationary, but others require mobility. Some are<br />

critical to grid operation while others are of marginal operational importance. This diversity challenges<br />

the enterprise architect to devise flexible, scalable smart grid communications architecture.<br />

The Nature of <strong>Smart</strong> <strong>Grid</strong> Endpoints, Information and Channels<br />

A framework around which communication services might be considered should examine the nature<br />

of: (1) the actors (endpoints and their functional requirements), (2) smart grid information, and (3) the<br />

channels through which information will flow. Thoroughly understanding these drivers will help the<br />

smart grid architect put the supporting communication services in a proper context.<br />

<strong>Smart</strong> <strong>Grid</strong> Endpoints<br />

<strong>Grid</strong> endpoints include a range of devices. In general, they include field devices such as meters,<br />

reclosers, capacitor banks, and so on. There are a variety of devices in substations including IEDs,<br />

SCADA RTUs, teleprotection devices, measurement devices, security appliances, and so on. At data<br />

and operations centers there are head-end processors, data collection units, control systems, customer<br />

interface portals, etc.. In general, these endpoints provide the smart grid application functions. For<br />

purposes of this reference architecture, the communication nodes are not considered endpoints since<br />

they don’t provide application functions.<br />

Each of these endpoints has unique operating capabilities. The smart grid architect should consider a<br />

variety of aspects of these endpoints when planning comms solutions including:<br />

Diversity of purpose – Will the endpoint support a single purpose or is it a multipurpose<br />

device? For example, meters are typically thought of as devices providing usage data. But in<br />

smart grid, meter functions expand to include usage, remote connect/disconnect, outage alerting,<br />

and power quality data. Metering groups need the usage data but grid operations teams would<br />

be interested in outage and power quality data. How does this impact comms architecture? As<br />

an example, if a meter is placed in a virtual network designed for metering, then additional<br />

challenges need to be considered in the overall architecture in regards to security, performance,<br />

and operations in order to direct outage and performance data to the appropriate recipients.<br />

Diversity in scope — Will the endpoint communicate to just one (or redundant) other endpoint<br />

or will it communicate with a diverse set of other endpoints? Extending the example of<br />

metering, it may be necessary to regularly collect usage data from a centrally located meter<br />

collection engine. Outage information could be captured by distributed OMS pre-processors<br />

located at substations so event messages don't congest the backhaul networks. Power quality<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 46


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

data may need to be periodically collected by analytics systems. In this example, meter<br />

endpoints may communicate with three or more host system, each existing in different domains<br />

and at different locations. However, teleprotection devices may not have the same multi-domain<br />

requirement. For operational reasons it may also be necessary to restrict the devices able to send<br />

traffic to the teleprotection equipment.<br />

Criticality – Is the purpose of the endpoint to support: a critical real-time function, for billing or<br />

analytics purposes, or for informational but non-critical functions? Some devices are seen as<br />

more critical than others for a variety of reasons. For example, if a teleprotection device fails to<br />

operate in a timely manner it could result in the loss of electrical service to thousands of<br />

customers which could extend for weeks. Associated damage to grid equipment could cost<br />

many hundreds of thousands of dollars. Therefore communication solutions for teleprotection<br />

devices warrant significantly more investment for reliability and resiliency than communication<br />

solutions for a feeder-capacitor bank with a potential to affect far fewer customers if information<br />

cannot flow in a timely manner.<br />

Mobility – Is the device mobile, fixed, or transitional? Most smart grid devices do not need<br />

mobility protocol support since they will be mounted on homes, poles or in building facilities.<br />

However, there is increasing need to support mobile workers and mobile machine-to-machine<br />

solutions. Mobility introduces many architectural challenges (coverage, access methodology,<br />

roaming support, location awareness, etc.).<br />

Quantity – How many devices will exist in a mature implementation? How will their numbers<br />

be spread across the various communication domains? How will management systems support<br />

potentially millions of devices such as meters? What are the impacts to traffic capacities and<br />

congestion control?<br />

Geographic density – Where will devices be deployed? For the various kinds of devices, will<br />

they be widely dispersed, densely placed, adjacent or in close proximity to other grid devices?<br />

How does this impact communication media choice? Can proximity be leveraged or does it<br />

present challenges (interference, signal power constraints, etc.)?<br />

Degree of intelligence – How intelligent is the endpoint? Is it highly dependent on other<br />

systems for resources and functionality? If so, where do they exist and what is their criticality to<br />

other endpoints? Where does the application intelligence for this endpoint exist? Most legacy<br />

grid systems use centralized intelligence; therefore centralized communication architectures can<br />

support them (very common for SCADA and AMI systems). However, if intelligence becomes<br />

distributed, then the communications architecture must also be distributed. For example, if grid<br />

intelligence is distributed to the substation, could field-mounted devices effectively<br />

communicate to the substation?<br />

<strong>Smart</strong> <strong>Grid</strong> Information<br />

The information transmitted between smart grid endpoints varies widely. It comes in many forms,<br />

sizes, criticality, and regularity. For a variety of reasons, not all communication systems are conducive<br />

for handling the breadth of requirements from required smart grid information sources:<br />

Regularity of transferring information– Will information be a continuous stream, scheduled<br />

transactional, or event-driven? This issue concerns how to think about congestion management.<br />

Streaming information (like PMU data) and scheduled transactions (like AMI reads) are<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 47


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

predictable and easier to plan for. But event-driven information can be very challenging.<br />

Furthermore, how does information regularity impact communication session management and<br />

security mechanisms (for example key management, access control, and authentication)?<br />

Size – What is the size of the information? This issue concerns how to think about bandwidth<br />

requirements. Is it streaming and as such is continuous? Is it a predictable file size? Is it messageoriented<br />

and contained in predictable bytes or even bits?<br />

Form – Is the information structured (XML file), bit-oriented (on/off), or byte-oriented (DNP3,<br />

IEC) defined messages? Is the information unstructured (such as a continual tone)?<br />

Duration/longevity – Is the information archivable (meter and other forms of measurement),<br />

transactional with a short time-to-live (outage or state data), or potentially a repeatable<br />

transaction (control data with message acknowledgement)? How does this impact<br />

communication system choice and failover schemas?<br />

Criticality – Is the information critical, not critical, or somewhere in between? Does it warrant<br />

high availability or redundancy? If so, to what degree of reliability should the system be<br />

designed (is 99.999% reliability necessary or would marginally lower reliability suffice)? How<br />

does information criticality impact the failover schema at the application layer versus at the<br />

communication layer?<br />

Simulcast – Will information be broadcast for any “interested” device to receive (publishsubscribe<br />

systems), multicast to a defined set of multiple devices, or unicast to just one device?<br />

Broadcast and multicast information can challenge the communications solution.<br />

Ownership – Who owns the information? What policies govern access to the information? What<br />

are the implications at the application layer versus the communications layer?<br />

Diversity of usefulness – Is the information useful across multiple applications? Example: some<br />

AMI transactions combine usage and power quality information.<br />

<strong>Smart</strong> <strong>Grid</strong> Channels<br />

There are a wide variety of channels (media) over which smart grid information might travel. Most of<br />

the time, information will travel over a network of networks—each optimized for some collective need.<br />

Understanding why different networks are necessary and how they function is critical to achieve<br />

optimal communications architecture.<br />

Access mechanisms – How is the channel accessed? This issue is especially of concern for<br />

wireless systems where media sharing can be challenging. Some solutions use network-based<br />

synchronized time slots (polling) schemes to limit collisions but this can affect performance.<br />

Other solutions might use application layer polling that, if combined with network-based<br />

polling, could be unnecessarily redundant.<br />

Shared use – If the channel is shared, how will traffic utilization be handled? For example,<br />

expensive wide area networks will likely need to support high priority critical traffic and lower<br />

priority informational traffic. How will traffic priorities be administered? What happens if<br />

devices that share the same channel (meters for example) cannot effectively hear one another?<br />

Do data link layer capabilities exist to prevent genuine information from appearing as noise?<br />

Distance between devices – Does the distance between devices warrant powerful transmission<br />

signal levels (many miles)? If so, how would it affect system cost structure? Is the distance short<br />

enough to allow communications capabilities at one device to support other nearby devices?<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 48


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Diversity of function – Will channel use support a variety of applications with varying<br />

performance and security needs, or will the channel be purpose-built for a particular solution?<br />

Performance – What are the latency capabilities of the channel? Some media (fiber optics) can<br />

support extraordinary performance characteristics. However, due to contention and framing<br />

mechanisms, wireless systems generally support more moderate characteristics and their<br />

effective performance range can vary widely.<br />

Bandwidth – What is the bandwidth of the channel? Different media types support varying<br />

amounts. At the low end, some long-reach wireless systems might only support 10’s of kilobytes<br />

per second. At the upper end, some fiber solutions can support many gigabytes per second.<br />

Reliability – What reliability schemes are used on the channel? There is a wide spectrum of<br />

reliability mechanisms a communications system could deploy. Cost considerations must be<br />

applied to obtain the necessary degree of reliability and performance these schemes can deliver.<br />

For example, do applications on field area networks warrant 99.999% reliability? What is the cost<br />

for the desired reliability? Is a 50 millisecond failover scheme on a Synchronous Optical<br />

Network (SONET) based teleprotection circuit acceptable to application users? What would<br />

happen if the failover detection was only a few milliseconds but the reconvergence time for<br />

information flow measured in the hundreds of milliseconds?<br />

Media cost structure – What is the cost structure of the media? When it comes to<br />

communications, the balance between cost and performance must always be considered. Some<br />

wireless solutions may not require much channel costs (i.e. free space propagation, licenseexempt<br />

systems, and very limited path engineering). However other wireless solutions might<br />

require licensing and very diligent system engineering. Furthermore, fiber placement might<br />

require public right-of-way and construction costs. Costs must be reasonable for the set of<br />

applications supported by the media. For example, under what circumstances would fiber<br />

deployment be warranted for meter communications?<br />

Equipment cost structure – What is the cost structure of the equipment? Communication<br />

systems have a wide spectrum of features and capabilities (power consumption, interface<br />

redundancy, management, etc.). The architect must determine what is reasonable for the<br />

environment and the applications being addressed. While many capabilities are generally<br />

desirable, if unchecked they may encumber the solution cost structure. For example, is it rational<br />

to deploy communication devices with no power supply or interface redundancy at<br />

transmission substations?<br />

Environment – What is the nature of the channel environment? Does it require special<br />

hardening? Is the equipment location under the direct and exclusive control of the utility?<br />

Administration – How will the channel be administered? Will the channel be under the<br />

management and administration of the utility or will the utility obtain channel services from a<br />

provider? How will channel administration affect service assurance and restoration? How will<br />

periodic changes on communication system(s) be coordinated with utility business operations?<br />

Communication Services<br />

Understanding the conceptual layer of endpoints, information and channels helps frame the<br />

communication services necessary to support smart grid operation. Once identified, the<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 49


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

communication services can be mapped to the various network of networks comprising the overall<br />

communications architecture.<br />

The Communication Services layer [Figure 40] requires the following functions:<br />

Transport services to move information around the network,<br />

Virtualization services to help segregate and optimize transport services,<br />

Control services to help manage information flow and support endpoints needing network access,<br />

Gateway services to facilitate legacy applications to utilize next generation networks, and<br />

Mobility services to support roaming or mobile endpoints.<br />

Figure 40 - Communication Services Layer Functions<br />

Transport Services<br />

Transport services are the means to move information around the network. Transport services are<br />

derived when communication links are combined to form networks. Since smart grids can cover a wide<br />

expanse of territory, a network of networks must be developed and interconnected so endpoints can<br />

send and receive information across the networks’ transport services.<br />

When considering transport services for smart grid, the smart grid architect will make a series of<br />

choices—each time providing more and more detail. The highest level choice defines the type of<br />

transport service to deploy. Next, the architect must determine logical divisions for each network<br />

within the ‘network of networks’ (subnetworks). Only then can the architect establish each<br />

subnetwork’s operating characteristics. Figure 41 illustrates this process below:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 50


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 41 - Transport Services Consideration Process<br />

1. Type<br />

First, the architect must make the decision of what type of transport service to deploy. There are two<br />

fundamental types of transport networks: circuit switched and packet switched. In the general world of<br />

telecommunications, it has been long established that packet-based solutions provide the most ideal<br />

form of transport services. The primary value of packet-based solutions comes from their ability to<br />

support an extraordinary array of applications over a common infrastructure. This provides<br />

exceptional economic and operating benefits. Another key value is that packet solutions were a product<br />

from a methodology supporting a layered approach whereby applications could evolve independent of<br />

the network. Abstracting the applications from the network provides both versatility and stability for<br />

each environment. In the case of smart grid where innovation is expected and requirements will be so<br />

diverse, packet-based transport solutions are the only logical choice.<br />

Although virtually all new investments are packet-based, there are still large amounts of legacy<br />

applications and infrastructure that will co-exist for some time. Adapting these systems to packet<br />

transport services is necessary and will be covered below in the Gateway Services section.<br />

2. Logical Division<br />

The next decision that must be made is the logical division for each subnetwork making up the end-toend<br />

solution. Implied is that there isn’t a single ideal transport network for accommodating smart grid.<br />

Therefore some form of subnetworking must take place to achieve various transport service capabilities<br />

(described below). For example, some networks are optimized for ultra-high speed but its cost<br />

structure can be burdensome. Since not all applications warrant such costs, networks of lower<br />

capabilities may be needed. The same tradeoff can be made regarding other characteristics such as<br />

performance and security requirements. Network technologies have limits and thus the<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 51


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

implementation of subnetworks is necessary. For making subnetworking decisions, it is best to<br />

establish functional categorization.<br />

While it is tempting to categorize transport services according to media type (fiber, wireless, powerline<br />

carrier, etc), this leads to ambiguity. For example, the kind of fiber networks used in data centers is<br />

different from fiber systems used to reach extraordinarily long distances across a utility’s operating<br />

territory. And the variety of wireless systems includes solutions such as long-haul microwave,<br />

metropolitan-based WiMAX, local WiFi, and even Zigbee personal area networks.<br />

It is better to categorize transport services into functional subnetworks. It appears this is what NIST has<br />

done in their <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Reference</strong> Diagram [Figure 42] as they identify:<br />

Internet / e-Business<br />

Enterprise Bus<br />

Wide Area Networks<br />

Substation LANs<br />

Field Area Networks<br />

Premises Networks<br />

Figure 42 - Conceptual <strong>Reference</strong> Diagram for <strong>Smart</strong> <strong>Grid</strong> Information Networks (NIST, 2010)<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 52


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The NIST Conceptual <strong>Reference</strong> Diagram is a functional categorization, except for the use of the<br />

Operations domain term “Enterprise Bus” (usually a software-based mechanism for abstracting<br />

applications from transport services) instead of “Operations Center LANs”. The “Internet / e-Business”<br />

clouds in Figure 42 suggest communications to external entities such as trading partners, customers,<br />

and other market operators. The “Wide Area Networks” cloud reflects the communications required<br />

across expansive territories from information processing centers to moderately remote assets<br />

(substations, data concentrators). The “Field Area Networks” cloud represents connectivity from<br />

various points of concentration out to numerous, scattered, and small endpoints.<br />

Functional categorization of transport systems provides the architect a framework to evaluate<br />

subnetworks and to make business, economic and technical choices. For example, the architect may<br />

initially opt for a carrier-provided public wide area or field area network. As the system evolves certain<br />

critical or highly used links could be replaced with utility-owned infrastructure (fiber or some form of<br />

wireless media). There may be instances where the utility initially operates a wireless solution based on<br />

cost structure but the evolving smart grid eventually causes fiber links to supplant the wireless links.<br />

The functional transport service architecture also helps the architect make the decision when to<br />

converge or segregate subnetworks. For example, the wide area network domain provides connectivity<br />

between Operations or Control Centers and remote substations. From an electric grid standpoint, the<br />

wide area network is generally associated with covering the transmission grid and substations whereas<br />

the field area network covers the distribution grid beyond the substation (Figure 42). Applications and<br />

endpoints associated with the transmission grid require high performance capabilities and warrant the<br />

diversity and higher reliability associated with more costly network solutions. As a media choice, fiber<br />

offers the highest degree of performance and is therefore often preferred in the wide area network.<br />

Since it can be costly to operate multiple wide area networks over the same geographic footprint,<br />

converging traffic onto a single (virtualized) fiber-based wide area network can be advantageous. In<br />

any case, the unique properties for each network domain are important architectural considerations.<br />

3. Characteristics<br />

After choosing the type of transport service and the logical divisions for subnetworking, the architect<br />

must then make key business, operational, and technical decisions regarding each subnetwork’s<br />

operating characteristics. Each issue impacts architectural choices just as they influence design choice.<br />

Common domain issues to consider include:<br />

Bandwidth - How much is required and available? How is it consumed and/or allocated? How does<br />

bandwidth utilization impact architecture decision?<br />

Latency and jitter– How does the transport service architecture support and manage latency and<br />

jitter? How do protocols used across the transport service impact latency and jitter? How do latency<br />

and jitter influence network element architecture choice?<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 53


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Domains – How are transport services virtualized into segregated domains to support bandwidth,<br />

latency, privacy, and management? (Also covered in the Virtualization Services section below.)<br />

Resiliency – How do the failover mechanisms support the transport services within each of the<br />

subnetworks and from an end-to-end perspective? What are the performance capabilities of the<br />

resiliency mechanisms?<br />

Quality of Service – What quality of service capabilities exist for the transport services in each of the<br />

different subnetworks?<br />

Reliability – What is the reliability of the transport service at each of the subnetworks?<br />

Access – How will devices gain access to the transport service? Will there be many devices<br />

attempting to access the services simultaneously?<br />

Standards – What standards apply? Are there functional gaps not covered by standards?<br />

Management – How are transport services granted, restricted and controlled?<br />

Costs – What is the cost structure for various types of transport services?<br />

Differences among the domains begin to drive further architectural considerations. For each of the<br />

transport service domains, key issues have been identified:<br />

Internet / e-Business<br />

Purpose – provide connectivity to customers, suppliers, business partners, emergency services, and<br />

the public at large<br />

Design Issues – generally open access to public environments, security, accessible by millions of<br />

users, public infrastructure (carriers), Internet, data/voice/video/control services, performance,<br />

capacity seldom measured beyond a few Megabits, failover to alternative external<br />

networks/providers, infrastructure dependent on carrier preference, global reach<br />

Operational Issues – lack of autonomous control, lesser degree of monitoring/management,<br />

dependence on others for reliability and performance, recurring expenditure, service contracts,<br />

capacity driven<br />

Operations Center LANs<br />

Purpose – provide connectivity to control systems, operators, high-end applications, servers, and<br />

storage systems<br />

Design Issues – extremely tight controlled access, highest degree of security, highest degree of<br />

performance, multi-Gigabit support, high availability designs, thorough virtualization,<br />

data/voice/video/control services, primarily fiber infrastructure, building area reach<br />

Operational Issues – key location for grid intelligence, full autonomous control, highest degree of<br />

monitoring/management, highest reliability, highest performance, infrastructure can be capital<br />

intensive, project driven<br />

Wide Area Networks<br />

Purpose – provide high performance connectivity (a) between data/control centers, (b) from<br />

data/control centers to key remote facilities such as substations, (c) from data/control centers to<br />

points of data concentration (such as meter data concentrators)<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 54


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Design Issues –tightly controlled access, high security, high performance, range from tens of<br />

Megabits to multiple Gigabits, situational high reliability, failover mechanisms very responsive,<br />

virtualization and converged resources, data/voice/video/control services, primarily fiber and<br />

microwave, SONET, MPLS, IP, public or private infrastructure, regional geographic reach<br />

Operational Issues -- reach to places where grid logic has been distributed, situational control<br />

(public or private), high degree of monitoring/management, desired interaction between grid and<br />

telecom management systems, high reliability, high performance, capital or expense funding, project<br />

driven<br />

Substation Local Area Network<br />

Purpose – provide coverage to smart objects within and near by the substation<br />

Design Issues – controlled access, security, high performance commensurate with applications,<br />

range from tens of Megabits to Gigabits, high reliability, failover mechanisms including high<br />

availability, may require segregated overlay solutions for separating process bus traffic from other<br />

traffic, data/voice/control services, primarily fiber and wireless technologies, reach in the immediate<br />

vicinity of the substation<br />

Operational Issues – reach to dozens of endpoints which can support other devices through<br />

distributed grid intelligence, total control by utility (private), moderate monitoring/management,<br />

desired interaction between grid and telecom management systems, high reliability, high<br />

performance, capital funding, project driven<br />

Field Area Networks<br />

Purpose – provide broad coverage to remote field endpoints so that they can connect to (a)<br />

data/control centers, (b) distributed applications (perhaps at substations), and (c) to other remote<br />

endpoints<br />

Design Issues – controlled access, security, moderate performance commensurate with applications,<br />

range from one to tens of Megabits, moderate reliability, failover mechanisms often unavailable,<br />

may require segregated overlay solutions optimized for the applications, data/voice/control services,<br />

primarily wireless and powerline carrier technologies, reach may be similar to that of the serving<br />

substation<br />

Operational Issues – reach to thousands or millions of endpoints which have lesser degree of grid<br />

intelligence, situational control (public or private), moderate monitoring/management (desire selfdiscovery<br />

and auto-configuration), desired interaction between grid and telecom management<br />

systems, moderate reliability, moderate performance, capital or expense funding, project driven<br />

Premises Networks<br />

Purpose – provide coverage to smart objects within the home, business, and commercial enterprise<br />

Design Issues – controlled access, moderate security, moderate performance, range from tens of<br />

kilobits to a few Megabits, moderate reliability, seldom use of failover mechanisms, likely<br />

segregated overlay network, data/control services, reach within the customer premises,<br />

predominantly responsibility of customer rather than utility<br />

Operational Issues – reach several to many endpoints with emphasis on premises intelligence,<br />

virtually no control since under authority of premises owner, moderate to no<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 55


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

monitoring/management (desire self-discovery and auto-configuration), largely isolated from grid<br />

management systems, moderate reliability, moderate performance, capital expense by premises<br />

owner, service subscription driven<br />

Network Control-Plane Services<br />

There are many network control-plane services to be accommodated in smart grid—too numerous to<br />

go into detail in this work. A few control-plane services with smart grid interdependency warrant<br />

discussion. To adequately address future smart grid requirements, the architect must understand<br />

network addressing, name-address resolution, and subnetwork access management.<br />

1. Network Addressing<br />

The mature smart grid will see a dramatic increase in smart objects needing IP addresses. It is more<br />

strategic to deploy new smart objects using IPv6 (and its addressing) rather than currently dominant<br />

IPv4. Among the many benefits IPv6 offers, the avoidance of Network Address Translation (NAT)<br />

functionality is one of the more critical reasons to adopt IPv6. The use of NAT can be burdensome to<br />

control-based applications. When network anomalies require failover, the NAT function must rebuild<br />

the address translation mapping. This process can burden (or break) time-critical grid applications.<br />

IPv6 addressing can avoid this problem—at least for communication within the utility domain<br />

(extranet access could still have this problem if private IPv6 addresses are used).<br />

In the IPv4 era, private IP addressing and NAT were implemented to slow down consumption of the<br />

rapidly depleting pool of IPv4 addresses. In this time of transition, it is recommended that utilities<br />

rapidly move to adopt IPv6. There are several types of IPv6 addresses including: unicast, anycast and<br />

multicast. In addition, IPv6 addressing supports both public and private address spaces.<br />

From an addressing architecture perspective, it is recommended that private IPv6 addresses (called<br />

local unique addresses) be used behind company firewalls as an added security measure against<br />

unintended access to grid devices from outside parties. Careful attention should be given to prevent<br />

reuse of private addresses as this will result in problems tracking SYSLOG issues.<br />

Another addressing architecture consideration involves the use of static or dynamic IPv6 addresses.<br />

Many control functions will rely on static (unchanging) addresses. However, many grid applications<br />

(premises metering) could benefit from dynamic addressing. Part of the architecture development is to<br />

decide where to use dynamic addressing. For non-mobile devices, dynamic DHCPv6 addressing may<br />

be best enabled from the substation or where Field Area Network interfaces backhaul communications.<br />

And finally, address space allocation must be planned with the end-state in mind. As the smart grid<br />

evolves, more devices will be placed into the field. Address space allocation should accommodate the<br />

eventual conversion of remote grid devices (including substation devices, feeder devices, meters, and<br />

perhaps even premises devices) to IPv6 addressable devices.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 56


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

2. Unique local Addresses<br />

Domain Name Services (DNS) will be necessary in the smart grid. DNS permits the abstraction of a<br />

device’s IPv6 address from its name making application systems less vulnerable to periodic changes.<br />

While a common DNS solution could serve both the enterprise and operations environments, there are<br />

advantages for segregating these services. Due to the magnitude of most smart grids, the Operations<br />

DNS easily become more heavily populated and used than the enterprise DNS.<br />

One important architectural concern is how to sustain name services at remote locations when<br />

host/remote links are severed. It is preferable to operate DNS in an HA configuration with primary<br />

zone servers in redundant control centers. In the case where backhaul links are lost, name resolution<br />

for regional traffic can be sustained only as long as the Time To Live setting permits. Therefore, for<br />

critical applications, it might become necessary for secondary zone servers to be distributed regionally<br />

in key substations.<br />

3. Authentication, Authorization and Accounting function<br />

AAA servers are required in the grid to aid with the authentication, authorization and accounting<br />

function of devices connected to the network.<br />

From a communications architecture perspective, it is important to segregate AAA functionality<br />

serving the smart grid from enterprise AAA functionality. It will also be preferable to distribute AAA<br />

functionality operated with primary and secondary systems located at diverse control centers.<br />

In the event of the loss of backhaul connectivity, critical substations could benefit from having local<br />

AAA services. Other substations may lose accessibility except via local console access.<br />

Mobility Services<br />

Support for mobility is required for both smart grid devices (especially inside the FAN) and users (such<br />

as the linemen of the future). The mobility service needs to encompass:<br />

Life cycle management of mobile devices, including registration and provisioning of mobile<br />

devices on to the network, such as configuration through the wireless LAN controller, and<br />

Secure deployment and configuration services, such as forcing the mobile user/device into a DMZ,<br />

enforcing a profile examination etc before given access to the network<br />

Gateway Services<br />

The term “gateway” can be ambiguous for telecommunications. For this document, it refers to the set of<br />

services used to adapt legacy or otherwise non-conforming endpoints to packet-based transport<br />

services. In doing so, gateways translate traffic from one protocol to another. This presents a challenge<br />

for <strong>Smart</strong> <strong>Grid</strong> development for two reasons: complexity increases with each required adaptation and<br />

scalability is constrained due to the limited usefulness of proprietary devices. Although it is preferable<br />

all applications standardize on Ethernet- and IP-based transport services, it is also recognized it will<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 57


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

take some time for existing/embedded systems using proprietary protocols to be replaced. Therefore<br />

gateway services must be implemented in various parts of the network to adapt those devices.<br />

In the architectural context, gateways bridge the application and network domains. Therefore, when<br />

dealing with gateways, network architects and application architects should address gateway service<br />

concerns. Two key areas of interest include the appropriate location for gateways to reside and the<br />

feature sets they offer.<br />

Some common legacy gateways include the electric meter (bridging traffic into the home), AMI<br />

gateways (supporting ANSI C12.22 traffic across proprietary networks), DNP gateways (often used in<br />

recloser operations and for line sensors), and station managers (adapting legacy traffic in substations to<br />

use packet infrastructures). Very often, legacy systems integrate communication control and transport<br />

functions into the application rather than cleanly abstracting the two. Even though many such<br />

solutions may be standards based (ANSI, DNP, Zigbee, etc), they don’t inherently use the standard<br />

transport protocols common to packet (IP) solutions. Therefore the traffic must be adapted.<br />

Although it can be confusing, there are some “gateways” deployed for smart grid for reasons other<br />

than transport service adaptation. For example, XML gateways are deployed to offload some security<br />

and application layer functions from application systems. These are not considered network layer<br />

gateways. In addition, research and development occurring in the fields of distributed intelligence and<br />

complex event processing will necessitate systems deployment further out in the network.<br />

The first decision the architect must make is where gateways should reside in the smart grid ecosystem.<br />

The time-proven, primary end-to-end principle in IP networking requires application layer issues to<br />

reside at the endpoints and not within the network. Applying this principle to the necessity of smart<br />

grid gateways makes it preferable for gateways to be pushed as far as possible toward the network<br />

edge. Therefore meters would not have to adapt traffic and protocols between home devices and the<br />

utility’s network (in fact Zigbee supporters are adopting the use of IP transport systems eliminating the<br />

need for protocol translation at the meter). AMI gateways would be pushed to the edge of the Field<br />

Area Network. DNP gateways would be collocated with legacy devices, and substation managers<br />

would only serve legacy, non-IP-enabled devices within the substation.<br />

The second area of interest to smart grid architects is the breadth of functionality performed inside<br />

gateways. Some gateway suppliers are embedding more functionality into legacy devices. The result<br />

could be an increased dependence on gateways (rather than a transition to standards-compliant<br />

devices). In addition, it is also tempting to deploy low-level standards-based networking functions<br />

inside gateways rather than derive these functions from true network-layer equipment. Such practices<br />

only deepen the dependence on legacy gateways/protocols and restrict the adoption of open and<br />

standardized architectures.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 58


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Virtualization Services<br />

The smart grid will cover an expansive territory. The cost to create information networks covering such<br />

an area can be prohibitive especially considering the need to support the diverse array of smart grid<br />

systems and system users. Although carriers already offer multi-purpose networks, there will be a<br />

growing need to adopt network virtualization services to meet smart grid demands.<br />

Virtualization services abstract physical and functional elements for a variety of purposes. Without<br />

network-level virtualization services, transport services would become overly complex and expensive.<br />

However, virtualization is certainly not limited to the network domain; in fact virtualization has its<br />

roots in application layer systems. This section deals with network-layer virtualization, which offers<br />

more transport service flexibility, to the point of supporting dynamic virtualization.<br />

There are numerous reasons to converge multiple networks onto a common platform. First, networks<br />

are becoming increasingly powerful offering the ability to reduce their associated capital and operating<br />

costs. Second, networks needing to be converged and virtualized are increasingly relying on each other<br />

for smart grid capabilities; it is easier to manage the interactions between those networks at multiple<br />

layers when they are converged and virtualized on a single platform.<br />

The network architect must be concerned with how virtualization supports the needs of smart grid<br />

applications and how it impacts the network. First, virtualization should serve the business and<br />

technical requirements of the use cases. The virtualization architecture should address performance<br />

concerns including address bandwidth allocation, latency, collision avoidance, virtualized Layer 2<br />

domains, failover and so on. Second, virtualization must consider how to establish service boundaries,<br />

whether and what layers of the OSI stack can be virtualized sensibly. Finally, virtualization must<br />

support appropriate security on the virtual domains.<br />

Reasons to converge multiple networks onto a common platform are numerous. Networks are<br />

becoming increasingly powerful offering the ability to reduce their associated capital and operating<br />

costs. But while it is technically achievable to utilize a common physical platform, there is justification<br />

for making it function as if it were many virtual platforms. For example, suppose multiple operational<br />

owners need to allocate only their specific costs to their business unit—therefore it would be important<br />

to have a mechanism to support ownership virtualization to allocate traffic capacity and insure against<br />

cross-subsidies. Some devices on the common platform may require access by a small subset of users,<br />

thus requiring a logical separation of the network for security reasons. Another scenario could have<br />

subsets of devices in the network sharing a community of interest with other adjacent devices, making<br />

virtual network zones appropriate. Therefore, the architect has many options available to establish the<br />

logical virtualization architecture best aligned with the lines of business, security, and performance.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 59


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

The next step is to determine how network virtualization supports application performance within the<br />

various network domains. It is likely multiple technologies will be used in each domain. Therefore a<br />

plan to accommodate virtualization at the physical layer and the requisite mapping between network<br />

technologies is needed. Furthermore, most virtualization must be then extended across several<br />

domains to accommodate end-to-end support. The virtualization architecture should address<br />

performance concerns including address bandwidth allocation, latency, collision avoidance, virtualized<br />

Layer 2 domains, and failover.<br />

The architect must then consider how the virtualization architecture addresses security and traffic<br />

isolation. Virtualization is by no means the final answer to security but it can be an important<br />

contributor. Virtualization helps control who can access devices, what network they reside on at the<br />

logical layer, and the degree of exposure devices may have to undesirable conditions (whether<br />

purposeful or accidental). For example, a misbehaving device flooding the network in one virtual<br />

domain shouldn’t adversely affect other virtual domains on the same infrastructure.<br />

Management Services<br />

The smart grid requires increased interactions between the power systems, information systems and<br />

network systems; therefore a common management infrastructure across all the systems is warranted.<br />

Accordingly, this <strong>Smart</strong> <strong>Grid</strong> Management Services section will address the management aspects of the<br />

power and communications network connecting all power grid components, functions and services.<br />

The integration of the ICT architecture with energy management systems and domains provides a<br />

centralized way to manage the entire smart grid, including the communications network and power<br />

grid devices.<br />

Business Drivers<br />

The management vision for the utility smart grid architect should be to devise a path towards a<br />

common management platform for the various smart grid systems, functions and projects. The<br />

common management platform will ideally serve the management needs for all smart grid use cases.<br />

The following are the business drivers for the management services architecture:<br />

The number of use case actors warrants zero or one-touch management schemes across smart grid.<br />

The use cases complexity implies managing policies at a business level (not at the actor level).<br />

The variety of utility and third party entities involved in use cases requires good measurable metrics<br />

for each of the management schemes<br />

As new smart grid projects and corresponding systems emerge, the new functionality needs to be<br />

easily incorporated into the existing management infrastructure<br />

The scope for this chapter is any device which communicates and can be controlled through<br />

configuration, including communication networks, applications, servers, configurable IEDs, etc.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 60


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

This section first introduces existing management architecture literature for the smart grid architect to<br />

consider. Next, the layout and categorization of different management function types is covered.<br />

Finally, an example use case is presented covering how management functions can be categorized and<br />

organized.<br />

Existing Management <strong>Architecture</strong> Literature<br />

Existing industry standards include Telecommunications model (TMN), ITIL (Information Technology<br />

Infrastructure Library) and Open Systems Interconnect (OSI)<br />

TMN: The Telecommunications Management Network is a protocol model defined by ITU-T for<br />

managing open systems in a communications network. The TMN model consists of five layers,<br />

where Business Management is at the top, Service Management is the second layer, Network<br />

Management is the third layer, and Element Management the fourth layer with the physical network<br />

elements is represented in the bottom layer. We are proposing placing the <strong>Smart</strong> <strong>Grid</strong> Management<br />

Systems at the Business Management layer in order to enable future integration with these systems.<br />

The Open Systems Interconnect (OSI) group has defined management functionality in network<br />

operations as shown in the five categories listed in table below. This same model has also been<br />

adopted and supported by the standards body, ITU-T. This categorization is a functional view and<br />

does not attempt to describe business related roles within a telecom or data network. The FCAPS<br />

sub-functions within one of the five major groups are typically performed at differing levels within<br />

the TMN model described in the TMN section. For example, fault management at the element<br />

management level in TMN is detailed logging of all discrete alarms or other events. The element<br />

management level then filters and forwards alarms/events to the network management level where<br />

alarm correlation, corrective action and other actions take place. The FCAPS table below represents<br />

common examples of the sub-functions performed under the model definitions. Different<br />

applications of the model will typically contain sub-functions specific to the network operations<br />

management center involved.<br />

TMF eTOM: TM Forum's Business Process Framework (eTOM - Enhanced Telecom Operations<br />

Map) is a key element of the TM Forum Framework Integrated Business <strong>Architecture</strong>. It is the<br />

industry's common process architecture for both business and functional processes and has been<br />

implemented by hundreds of service providers around the world. During this phase we will be<br />

addressing all the Operations aspects of the data communications network enabling the smart grid.<br />

Within Operations, we will focus on Assurance and Resource Management (application, computing<br />

and network).<br />

ITIL: It is the most widely accepted approach to ICT service management in the world. ITIL<br />

provides a cohesive set of best practice, drawn from the public and private sectors internationally. It<br />

is supported by a comprehensive qualifications scheme, accredited training organizations, and<br />

implementation and assessment tools.<br />

While the smart grid architect needs to assess the present ICT management architecture and assess the<br />

integration of the smart grid management in the present architecture, the rest of this section will focus<br />

on the management functions in general and the application of the management functions to smart<br />

grid.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 61


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

<strong>Smart</strong> <strong>Grid</strong> Management Functions<br />

Management services for smart grid can be viewed in several different ways. First, smart grid consists<br />

of elements across multiple utility domains (consumer, distribution, transmission, generation, markets,<br />

etc) and technology domains (communications, applications, servers, wireless, video etc) that need to<br />

be managed. Second, from a “System-of-Systems” perspective, smart grid can be organized into<br />

systems, which need to be managed. Third, each of the systems interacts with each other for specific<br />

use cases, which also need to be orchestrated and managed. The following section will organize smart<br />

grid management services as layers accommodating the above-described functions.<br />

Organization of Management Functions<br />

The following is the organization of management functions for smart grid into the three areas<br />

described above - the management functions applicable for actors (which we call Element Management<br />

Layer), management functions applicable for systems (System Management Layer) and management<br />

functions applicable at the use case level (Services Management Layer). Each management function in<br />

the Services Management Layer will make use of various functions in System Management Layer and<br />

Element Management Layers.<br />

These different management schemes can be organized in the following way<br />

Each layer in Figure 43 is discussed below.<br />

Figure 43 - Management Layer Organization<br />

Element Management Layer<br />

The following are the different management functions and corresponding processes involved in<br />

element management:<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 62


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Lifecycle Management: Life cycle management is the service dealing with automatic device<br />

discovery, automatic update of firmware, and automatic provisioning into the system. The<br />

service also deals with secure decommissioning of devices. Life cycle management and its<br />

automation are critical to smart grid management due to the large number of relevant devices.<br />

System turn-up<br />

Auto-discovery<br />

Provisioning<br />

Change management<br />

Decommissioning<br />

Technology/control plane management: smart grid is comprised of various technologies,<br />

whose control plane needs to be managed. The technologies include the following:<br />

Routing and switching, including control plane and data plane services<br />

Wireless<br />

Mobile<br />

Systems Management Layer<br />

The smart grid architect must support the following common management functions across systems:<br />

Event Management: The following are the event management functions<br />

Collection of power/cyber events from all grid and communication assets<br />

Analyzing and correlating the events for actionable incidents<br />

Taking the corresponding action<br />

Security Management: The following are the security management functions that need to be<br />

managed across systems (example: key management when a DA system needs to talk to an<br />

AMI or a Transmission system)<br />

Access control management<br />

Security monitoring<br />

System audit<br />

Configuration Management: Configuration management includes any configuration changes<br />

on the end assets (network, data, information, application, electric) including settings, firmware<br />

upload and down load. The smart grid architect needs to plan for a common configuration<br />

management platform for different smart grid projects and different types of electrical and<br />

network assets involved<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 63


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Services Management Layer<br />

The above management functions apply for actors and systems The smart grid architect needs to<br />

analyze each use case in scale and analyze the management requirements. The following are the<br />

management functions that would apply at the use case level (Services/Business Management Level):<br />

Performance Management: This includes tuning the assets for the quality of experience that is<br />

required for the use case. Bandwidth and latency provisioning, quality of service provisioning will<br />

be part of the performance management.<br />

Policy management: this category is the management of business policies across the enterprise. This<br />

could be security policies such as NERC CIP or any business policies such as disaster recovery and<br />

management, change management, etc.<br />

The services management layer would use the systems management layer and element management<br />

layer functions for end device configuration.<br />

Figure 44 depicts the management layers, each management function inside the layers, and their<br />

applicability to the actors, systems and use cases.<br />

Figure 44 - <strong>Smart</strong> <strong>Grid</strong> Management Layers<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 64


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Conclusion<br />

The smart grid management architecture has to be constructed in a way supportive of a common<br />

management platform for the various smart grid systems. The architecture also has to strive towards<br />

the “services management layer” which can orchestrate the systems and corresponding elements<br />

involved to achieve the SLAs demanded by use cases non-functional requirements. The smart grid<br />

architect should also tactically choose standard protocols and local management policies whenever<br />

possible as explained below:<br />

Standard protocols: The EA needs to strive to adopt and encourage standard protocols for<br />

management such as SNMP, Syslog etc. IEC 61850 has features that could be used for configuration<br />

control and management. Standards based management functions will be easier to integrate for<br />

cross project management capabilities.<br />

Local and centralized management: The EA needs to strive for local management schemes in<br />

disaster recovery scenario.<br />

Structural Model Framework Template<br />

The SGRA Section 5, <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views, contains a structural model for each<br />

view (Application Services, Analytics Services, Data Services, Control Services, Security Services,<br />

Communications Services, and Management Services). Each is provided to help the smart grid architect<br />

consider how to best deploy the various services using a stylized representation of a typical utility<br />

network infrastructure. The template for these models is provided below [Figure 45] to help explain<br />

why services were distributed among the fourteen tiers in the template. The template graphical<br />

representation on the left side is identical across all seven structural models in Section 5. The right-hand<br />

table describes the devices and capabilities inherent in each tier.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 65


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 45 - Structural Model Template<br />

The smart grid architect, once all seven structural models are created for the utility, should consolidate<br />

the seven models into a single structural model for the entire smart grid. This consolidation exercise<br />

can strengthen the overall architecture. For example, since most analytics require communication and<br />

data support, any consolidated tier containing analytics, but missing these supporting services, should<br />

be studied more closely. All architectural weaknesses need to be directly addressed with impacted<br />

architectural views subsequently updated.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Services Classes Concepts<br />

Appendix • 66


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix C. <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project<br />

(SCAP)<br />

Background information on the <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project is provided on page ix.<br />

Business Requirements<br />

These top level business requirements are derived from the SCAP work done by the <strong>Smart</strong> <strong>Grid</strong><br />

Interoperability Panel (SGIP) <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee (SGAC). These 380 requirement<br />

families abstract over 8000 more detailed business requirements identified by the SCAP (SGIP SGAC).<br />

Customer Domain<br />

Service Level data shall be collected to ensure service level agreements are met<br />

Communications shall meet defined Quality of Services (QoS) requirements.<br />

Shall be configurable.<br />

Shall be able to operate at a sufficient granularity (e.g., individual customer).<br />

Shall support continuous evolution of smart grids.<br />

Shall support aggregated management of Customer domain assets.<br />

Shall support recovery from an electric grid cold-start.<br />

Shall support role-based authorization.<br />

Shall assure access by authorized entities to data.<br />

Shall employ non-intrusive load monitoring where appropriate.<br />

Power Quality monitoring shall be supported.<br />

Shall respond to dynamic incentive signals (e.g., price signals).<br />

Shall leverage common infrastructure with other services (e.g., water management).<br />

Shall provide outage restoration management.<br />

Shall manage reactive power in customer loads (e.g., building energy management systems).<br />

Shall support charging of electric vehicles.<br />

Shall process demand response pre-event notifications.<br />

Shall provide energy management.<br />

Quality of Service (QoS) requirements shall be defined.<br />

Shall support display of information.<br />

Shall support manual override of automated actions.<br />

Shall require permission to access Customer domain services from other domains.<br />

Shall collect localized weather data.<br />

Shall manage Service Level Agreements (SLAs).<br />

Shall minimize load sags and swells.<br />

Shall collect load characteristics.<br />

Shall provide information in support of operational needs.<br />

Shall collect energy production environmental impact data.<br />

Shall support energy trading transactions.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 67


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Generation Domain<br />

Transmission<br />

Shall control a plant's compliance to meet contractual obligations<br />

Require security<br />

Require a high availability of information flows<br />

Require a high accuracy of data<br />

Data shall be managed across organizational boundaries<br />

Require validation of the cost-benefit of the function<br />

Shall facilitate islanding of the power system<br />

Shall provide the ability to forecast<br />

Shall facilitate control of generator power<br />

Shall provide real time intelligence regarding equipment state<br />

Shall provide real time management of equipment<br />

Shall minimize impacts<br />

Shall facilitate scheduling<br />

Shall perform congestion management analysis on proposed energy schedules<br />

Shall support commitment activities<br />

Shall dispatch regulation units to provide voltage support based on emergency requirements<br />

Shall maintain the facilities in operating condition<br />

Shall facilitate the procedures particular to bringing a cold unit on line<br />

Shall provide advanced notice of scheduled outages<br />

Shall support minimum cost real time scheduling of generation units<br />

Shall ensure that the overall system remains intact despite severe challenges<br />

Shall facilitate monitoring of generator power<br />

Shall facilitate control of generator emissions<br />

Shall facilitate monitoring of generator emissions<br />

Shall monitor equipment contingencies<br />

Shall perform security analysis on proposed energy schedules<br />

Shall provide high quality power<br />

Shall provide ancillary services<br />

Shall provide rolling reserves<br />

Shall provide contingency<br />

Shall respond to changes in customer load<br />

Shall maintain the topology of the system including the ends of all segments<br />

Shall forecast alternatives for generation sources is to anticipate long term generation needs<br />

Shall maintain transmission system in operating condition<br />

Shall provide credible contingency information<br />

Shall determine long term future transmission system needs<br />

Shall have contingency plans for catastrophic events<br />

Shall optimize planned maintenance down-time<br />

Shall automatically collect information relating to system disturbances<br />

Shall automatically adjust voltage to optimize network efficiency<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 68


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Shall adjust power flow to optimize network efficiency<br />

Shall maintain the system within its limits of stability<br />

Shall monitor the status of measurement equipment<br />

Shall maintain load forecasts for all system equipment<br />

Shall recommended changes to correct limit violations<br />

Shall notify stakeholders of emergencies<br />

Shall detect equipment fault conditions<br />

Shall develop emergency response in case of catastrophic external events<br />

Shall provide operating guidelines for interfacing with distribution companies<br />

Shall provide short term forecasting for time frames of interest<br />

Shall provide short term forecasting for locations of interest<br />

Shall include DER in the balancing of demand<br />

Shall use activation of interruptible loads to balance the system<br />

Shall use rotating blackouts as a last resort to balance the system<br />

Shall manage substation voltages to manage the overall system<br />

Shall minimize transformer clipping conditions<br />

Shall maintain characteristic (nameplate) information on all system components<br />

Shall monitor equipment for equipment failures<br />

Shall track which actors had access to what system at what time and the changes they made<br />

Shall monitor the electrical flow characteristics at all major pieces of equipment in the system<br />

Shall simulate future configurations of the network<br />

Shall perform maintenance on the system to maintain the system in operational condition<br />

Shall manage the protection schemes to optimize the system protection<br />

Shall maintain the system within the frequency limits<br />

Shall shed load as required to maintain system stability<br />

Shall use wide area monitoring to prevent issues arising from incipient system instability<br />

Shall implement optimum control actions to maintain system stability<br />

Shall perform long term forecasting to support system reinforcement planning<br />

Shall do long term load forecasting to plan back-up generation<br />

Shall plan manual switching to prevent fault behavior<br />

Shall estimate the remaining capacity in the system<br />

Shall calculate system utilization to prevent overloads<br />

Shall predict failure of equipment<br />

Shall optimize usage of equipment<br />

Shall schedule equipment replacement is to prevent failure of equipment<br />

Shall dispatch field crews in an efficient manner<br />

Shall do 3-phase monitoring of the system<br />

Shall be able to do 3-phase unbalanced operation<br />

Shall optimize VAR control<br />

Shall support the integration of Storage<br />

Shall be able to handle sudden shifts in power flow<br />

Shall shed generation as required to maintain system stability<br />

Shall perform long term forecasting to support system extension planning<br />

Shall manage access to critical facilities<br />

Shall dynamically rate equipment capacity based on environmental factors<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 69


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Shall perform phase to phase balancing actions<br />

Service Provider<br />

Shall provide electrical service to its customers<br />

Shall provide electrical service to its customers that is of high power quality<br />

Shall be capable of detecting outages<br />

Shall employ techniques to minimize outage occurrences and duration<br />

Shall employ techniques to prevent damage resulting from malfunction of provider services<br />

Shall develop techniques to avoid permanent damage to the environment in the course of providing<br />

electrical service to its customers<br />

Shall provide information enabling the customers to make decisions on their DSM participation<br />

Shall provide a Demand Side Management function that is available<br />

Shall be capable of directly controlling customer loads.<br />

Shall provide a means of classifying information that allows for some data to be treated in a<br />

Confidential manner.<br />

Shall provide communication capability that is available.<br />

Shall provide a method of communications that provide 'rapid response' with a goal of maintaining<br />

load/generation equilibrium.<br />

Shall provide a communication capability that is accurate.<br />

Shall provide accurate individual meter readings to authorized parties.<br />

Shall provide a means of obtaining information from customers<br />

Shall establish two-way communication with customers.<br />

Shall be capable of obtaining readings from customer meters in a manner that minimizes reading<br />

errors.<br />

Shall provide a means of efficiently obtaining information from meters.<br />

Shall provide a means of obtaining accurate information from meters<br />

Shall read meters in a manner that is convenient to the customer.<br />

Shall implement accurate meter reading<br />

Shall provide means of communicating with customers<br />

Shall provide price of electricity information to their customers<br />

Shall provide individual meter readings to its customers at intervals that are aligned with customer<br />

needs<br />

Shall enable selling energy to customer<br />

Shall enable buying energy from customer<br />

Shall provide forecasts of demand for planning purposes<br />

Shall be capable of aggregating customers<br />

Shall bundle services<br />

Shall provide energy information services<br />

Shall provide power quality services<br />

Shall provide sub-metering service<br />

Shall provide technical support services<br />

Shall provide billing services<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 70


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Distribution<br />

Shall maintain a topological model of distribution circuits in near real-time<br />

Shall manage Intelligent alarm processing<br />

Optimizes Voltage in relation to Reactive Power<br />

Shall manage Voltage<br />

Shall support management of reactive power<br />

Shall manage work crews for authorized field work<br />

Provides distribution operation personnel with comprehensive training<br />

Shall monitor power quality on the distribution system<br />

Shall perform service restoration<br />

Shall support improvement of power quality<br />

Shall provide an audit trail<br />

Shall manage power quality information available from within customer sites<br />

Shall prepare for storm conditions<br />

Shall prepare for storm conditions<br />

Shall manage unbalanced current flows<br />

Shall manage unbalanced three-phase voltages<br />

Shall adjust feeder loads for optimal load flow<br />

Shall support Distribution Power Flow analyses<br />

Shall support Contingency Analysis<br />

Shall rank contingencies<br />

Shall perform Fault Level Analysis<br />

Shall support Short Circuit Analysis<br />

Shall support Contingency Load Transfer<br />

Shall support technical Loss Minimization<br />

Shall support state estimation<br />

Shall support monitoring of state<br />

Shall support planned outage management<br />

Shall support distribution planning<br />

Shall support field crew root cause analysis of distribution system problems<br />

Shall support transformer management<br />

Shall locate Faults<br />

Shall isolate Faults<br />

Shall manage system protection<br />

Shall manage system protection<br />

Shall support diagnostic analysis<br />

Shall support the management of Distributed Energy Resources (DER)<br />

Shall support real-time emergency operations<br />

Shall support outage management<br />

Shall support distribution asset management<br />

Shall support transmission operations<br />

Shall support updating field equipment<br />

Shall support system protection<br />

Shall support short term load forecasts<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 71


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Markets<br />

Shall support equipment level configuration management<br />

Shall support the development of the future distribution model<br />

Shall locate non-technical losses<br />

Shall support condition based maintenance<br />

Shall maintain an adequate operations platform<br />

Demand Response (DR) maintenance staff test Demand Response (DR) equipment is to validate the<br />

interconnecting infrastructure to allow the DR's to participate in the market operations<br />

Identical generation devices is to provide electrical power to residence while remaining in parallel<br />

with Energy Service Provider (ESP)<br />

Shall provide clear location based price signals that serve as a value benchmark for consumers to use<br />

as input in deciding when they use electricity<br />

Will enable customers aggregators to directly access the market<br />

Will enable demand-response aggregators to directly access the market<br />

Will provide location based price signals that reflect locational differences.<br />

Will correctly reflect the price of energy<br />

Will correctly reflect the price of renewable energy<br />

Will correctly reflect the price of emissions<br />

Will correctly reflect the price of transmission<br />

Will correctly reflect the price of reactive power<br />

Will correctly reflect the price of harmonics<br />

Will operate in a nodal fashion<br />

Will operate in a regional fashion<br />

Will provide forward pricing signals<br />

Will provide hedging contracts<br />

Will provide long term contracts<br />

Will provide historical pricing history<br />

Will provide historical demand<br />

Will provide forward demand curves<br />

Will coordinate cross market trading<br />

Will provide clearing of bi-lateral contracts<br />

Will provide registration of market participants<br />

Will provide direct access to the wholesale market for large enough end users<br />

Will provide access to trading analytics<br />

Will provide a safety valve for runaway trading<br />

Will verify the ability of a party to ability to cover their physical commitments.<br />

Will clear the market<br />

Will match counter parties to affect trades<br />

Will permit net open trades to the limits of the system<br />

Will net out trades<br />

Will encourage the emergence of a market maker in each area<br />

Will develop new trading vehicles<br />

Will encourage the development of a transparent market<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 72


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Operations<br />

Will encourage price discovery<br />

Will encourage counter party transparency<br />

Will register counter parties<br />

Will provide settlement information for the market<br />

Will encourage rapid settlement of the market<br />

Will provide a dispute registration mechanism<br />

Will provide a dispute resolution mechanism<br />

Will maintain a counter party history<br />

Will provide credit check capability<br />

Will provide background check capability<br />

Will create a framework of market rules<br />

Will be able to determine the impact of market changes from simulations<br />

Will provide location based grid state condition information<br />

Will communicate information to all interested parties<br />

Will retain a market history<br />

Will communicate abnormal conditions to all interested parties<br />

Will communicate all planned outages to interested parties<br />

Will run product auctions for all applicable products<br />

Will create long term demand forecasts by customer class<br />

Will provide demand forecast for multiple near term time periods<br />

Will provide demand response generation forecasts for multiple near term time blocks<br />

Will create market products that are capability based i.e. technology agnostic<br />

Will eliminate unnecessary barriers to entry<br />

Will develop new market products that account for advanced capabilities<br />

Will limit market exposure to the participant's credit limit<br />

Will make all markets and products available to DR and storage if capabilities can be met<br />

Will create products that encourage adequate capacity in the market<br />

Will create products that can be used to balance intermittency of renewable resources<br />

Will enable energy efficiency to participate in the market<br />

Will support participation by distributed energy resources<br />

Will create dynamic prices for all products and services<br />

Will provide intermittent generation forecasts for multiple near term time blocks<br />

Will develop new market products to price emissions<br />

Will develop new market products for voltage support<br />

Will develop new market products for VAR<br />

Will perform power flow simulations of the grid<br />

Will support exchange of network models with other stakeholders<br />

Provide the ability to manage direct load control programs<br />

Manage electrical frequency<br />

Report the health of the primary equipment to the control center<br />

Provide configuration management<br />

Provide performance management<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 73


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Shall be able to authenticate end-use customers<br />

Shall be able to communicate with end-use equipment<br />

Shall be able to communicate with measurement equipment<br />

Shall be able to communicate with mobile transportation loads<br />

Shall be able to manage end customers in load programs<br />

Shall communicate with end customers<br />

Shall control the flow of power to individual end customers<br />

Shall forecast resources<br />

Shall implement black start<br />

Manage restoration protocol<br />

Shall manage ancillary services<br />

Monitor DR/grid interaction<br />

Shall manage power quality<br />

Shall manage reserves<br />

Shall optimize asset utilization<br />

Shall provide intermittent generation forecast for multiple near-term time blocks<br />

Shall manage power interchange<br />

Shall manage the operation of the electrical grid<br />

Provide voltage regulation<br />

Shall be able to reconfigure (power) system<br />

Schedule generation<br />

Schedule transmission<br />

Shall actively manage demand response programs<br />

Shall be able to monitor micro-grids<br />

Shall be able to provide historical information for any specific time-frame<br />

Shall respond to abnormal conditions in a coordinated fashion<br />

Shall validate demand response operations<br />

Shall maintain emissions records for all operations<br />

Shall maintain the state of the systems managed<br />

Shall provide environmental monitoring<br />

Shall provide demand side management<br />

Assess the vulnerabilities of management systems<br />

Shall Maintain a secure environment for operations<br />

Shall maintain operations quality of service<br />

Shall manage communications between physical locations for all information<br />

Shall maintain load profiles of end customers<br />

Shall measure energy consumption of customers<br />

Shall provide information for Crew dispatching<br />

Shall provide control information to distributed resources<br />

Shall be able to access data from all distributed resources in a timely fashion<br />

Shall be able to forecast weather impacts for any reasonable time frame in the future<br />

Shall be able to manage the electrical protection of the system<br />

Shall be able to simulate future operations of the system<br />

Shall be able to minimize disruption of energy flow to end customers<br />

Shall maintain topology information for the power grid<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 74


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Shall be able to schedule maintenance at times of least impact<br />

Shall be able to support energy storage devices<br />

Shall be able to support distributed energy resources<br />

Shall manage voltage stability<br />

Shall be able to request procurement of additional market products<br />

Shall maximize available transmission capacity<br />

Shall review Remedial Action Schemes<br />

Shall perform contingency analysis<br />

Shall manage scheduled maintenance requests.<br />

Shall be able to analyze past grid events<br />

Shall be able to directly dispatch resources in exceptional circumstances<br />

Shall provide location based grid condition indicator<br />

Shall manage time synchronization of the grid<br />

Shall manage the variability of intermittent resources<br />

Shall provide demand forecast for multiple near term time periods<br />

Shall directly control end use devices<br />

Shall communicate with neighboring control areas<br />

Cross Cutting Domain<br />

Shall Manage Records for Auditing<br />

Shall Manage Records for Reporting<br />

Shall manage authentication<br />

Shall manage access control<br />

Shall manage discovery services<br />

Shall manage communities<br />

Shall manage firewall policies<br />

Shall Manage Privacy Policies<br />

Shall manage end devices<br />

Shall manage applications<br />

Shall manage security policies<br />

Shall manage distributed data<br />

Shall manage calibration of field equipment<br />

Shall manage non-repudiation<br />

Shall manage communications continuity<br />

Shall manage communications reliability<br />

Shall manage communications availability<br />

Shall manage personnel security credentials<br />

Shall manage risk assessments<br />

Shall manage services acquisition security policies<br />

Shall manage security engineering practices<br />

Shall manage Security Policy Exchange Service<br />

Shall provide security services against Denial-of-Service attacks<br />

Shall provide security assurance service<br />

Shall manage enforcement of security policies for field equipment<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 75


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Shall provide a Trust Establishment Security Service<br />

Shall provide secure mobility for field equipment communications<br />

Shall provide support for multi-cast communications<br />

Shall manage time synchronization of data<br />

Shall test equipment prior to use<br />

Shall manage underlying information support platforms<br />

Shall manage vulnerability assessments<br />

Shall manage network addressing<br />

Shall manage network multi-homing<br />

Shall manage transaction processing<br />

Shall manage physical security of smart grid operations<br />

Shall manage security of critical data<br />

Shall manage communication faults<br />

Shall manage communications performance<br />

Shall manage accounting for communications use<br />

Shall manage communications configuration<br />

Shall manage residual risk<br />

Distribution Automation (DA) critical data requires very high security<br />

<strong>Smart</strong> <strong>Grid</strong> Business Services<br />

Working from the requirements families listed above, the <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee (SGAC)<br />

developed a set of business services distributed across the seven <strong>Smart</strong> <strong>Grid</strong> domains. In addition, a set<br />

of cross-domain foundational business services was developed. In this section, the business services are<br />

presented by domain. The actual company performing the service may vary by area of the country. For<br />

instance, in California many of the market services belong to the California ISO; in Florida, there is no<br />

ISO, so these services belong to the state utilities.<br />

The SGAC team assigned to SCAP is developing additional use cases to define system requirements for<br />

two domains in need – the Customer and the Service Provider. For the Customer domain, the business<br />

cases are from a customer point of view. For the Service Provider, the cases are from a non-electric<br />

service provider point of view. Once this work is complete, it is expected the following Business<br />

Services listings will change to accommodate the additional requirements.<br />

Market Domain<br />

Table 17 lists the SCAP business services required to support the overall business in the Market<br />

domain. The actual operator of the business services will vary by geographic region.<br />

Table 17 – Market Domain Business Services<br />

Name<br />

Description<br />

Check Background<br />

Perform a background check on the participant<br />

Check Credit<br />

Confirm that the participant has enough credit to meet the requested transaction<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 76


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Clear Market<br />

Clear Trades<br />

Correlate Events<br />

Cross Market Trade<br />

Develop Balancing Products<br />

Develop Capacity Products<br />

Develop Distributed Energy<br />

Products<br />

Develop Energy Efficiency<br />

Products<br />

Develop GHG Emission<br />

Products<br />

Develop Market Products<br />

DR Forecast<br />

Exchange Network Models<br />

Facilitate Market Maker<br />

Facilitate Trades<br />

Forecast Intermittent<br />

Generation<br />

<strong>Grid</strong> Condition Indicator<br />

Long Term Demand Forecast<br />

Maintain History<br />

Maintain Market History<br />

Manage Aggregators<br />

Manage Direct Access<br />

Manage Dispute<br />

Manage Energy Contracts<br />

Manage Market Rules<br />

Manage Notification<br />

Manage Participation<br />

Market Transparency<br />

Monitor Markets<br />

Near Term Demand Forecast<br />

Net Trades<br />

Outage Notification<br />

Price Energy Products<br />

Protect Markets<br />

Description<br />

Identify the most economically optimal schedule of resources while maintaining the<br />

security of the grid.<br />

Provide the ability to financially clear bi-lateral trades<br />

Predict future events by analyzing current patterns<br />

Provide the ability to trade energy products between markets<br />

Develop market products that will provide the capabilities necessary to balance<br />

intermittent supply resources.<br />

Develop market products for capacity that encourages participation of various parties<br />

Develop market products for distributed energy resources that encourages participation<br />

of various resources<br />

Develop market products for energy efficiency that encourages participation of various<br />

parties<br />

Develop market products for GHG emissions that encourages participation of various<br />

parties<br />

Develop new market products<br />

Provide forecast of demand response capability over multiple near term time periods<br />

Provide a mechanism to exchange network models between entities<br />

Actively encourage the emergence of a market maker in new markets<br />

Facilitate bi-lateral trades between parties<br />

Provide intermittent generation forecasts for various timescales as needed for grid<br />

management<br />

Provide a location-based dynamic metric that illustrates the desired change in energy<br />

consumption.<br />

Maintain a long term demand forecast for various customer classes within the control<br />

area<br />

Maintain a history of market transactions<br />

Provide management of historical market information<br />

Determine mechanism for aggregators of energy resources to engagge in markets<br />

Provides the ability for end-customes to purchase power in the wholesale market<br />

Provide a mechanism to coordinate disputes on the market processes<br />

provide a mechanism to manage the operation of energy contracts between market<br />

participants<br />

Develop mechanisms to manage the evolution of market rules<br />

Provide notification of market events to interested parties<br />

develop guidelines for market participation<br />

Develop mechanisms to publish key market attributes to the public<br />

Analyze the effectiveness of market rules in maintaining an effective electric power<br />

market<br />

Provide forecast of demand over multiple near term time periods<br />

Will net trades across grid constraints up to the acceptable limit on that constraint<br />

Provide notification of planned outages to interested parties<br />

Provide time based prices for energy products for individual customers<br />

Provides a mechanism to protect the market from potentially damaging trading behavior<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 77


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Provide Communication<br />

Platform<br />

Provide Demand Forecast<br />

Provide Demand History<br />

Provide Operational Platform<br />

Reduce Settlement Timeline<br />

Register Dispute<br />

Register Participant<br />

Resolve Dispute<br />

Settle Market<br />

Simulate Market<br />

Simulate Power Flow<br />

Validate Commitment<br />

Validate DR Resource<br />

Interconnection<br />

Description<br />

Provide infrastructure for secure, accurate and timely communication<br />

Provide a forward looking schedule for energy requirements<br />

Provide history of demand at all tracked locations on the grid<br />

Provide infrastructure necessary to operate power market<br />

Develop mechanisms to settle market at the earliest possible time<br />

Provide a mechanism to register a dispute on the market processes<br />

Provides a customer the ability to engage in market activity<br />

Manages the progress of a registered dispute through resolution<br />

manage the settlement of market charges<br />

Provide mechanisms to simulate the power market<br />

Provide simulation mechanisms to analyze power flow of the electric grid<br />

Confirms the ability of a participant to provide their proposed commitments<br />

Validates that DR resources connection comply with relevant standards<br />

Operations Domain<br />

Table 18 lists SCAP business services required to support the overall business in the Operations<br />

domain. The actual operator of the business services will vary by geographic region.<br />

Table 18 – Operations Domain Business Services<br />

Name<br />

Description<br />

Analyze Event<br />

Reconstruct the dynamic values of grid attributes around the time of a past grid event<br />

Authenticate User<br />

Confirm the identity of the user<br />

Contingency Analysis<br />

Calculate the impact of failures on the electrical power system<br />

Control Energy Resources<br />

Provide direct control of energy resources<br />

Control Power Flow<br />

Dynamically configure electrical power system to manage power flow to end-customer<br />

Define Transmission Capacity Define the dynamic safe operating limits of the transmission system<br />

Demand Forecast<br />

Provide forecast of demand over multiple near term time periods<br />

Energy Measurement<br />

Provide measurement of end-customer consumption<br />

Forecast Resources<br />

Provide forecasts of system resources<br />

Forecast Supply Resources<br />

Provide forecasts of supply resources<br />

Forecast Weather Impacts<br />

Forecast the potential impact of weather events on the grid assets<br />

<strong>Grid</strong> Condition Indicator<br />

Provide a location-based dynamic metric that illustrates the desired change in energy<br />

consumption.<br />

Maintain Network Model<br />

Maintain a time based model that represents the topology of the electrical power<br />

network<br />

Manage Configuration<br />

Maintain configuration parameters of equipment<br />

Manage Contingency Event Provide pre-determined protocol instructions for responding to a contingency event<br />

Manage Customers<br />

Facilitate communication with end customers<br />

Manage Demand<br />

Provide a mechanism to reduce end-customer energy costs<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 78


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Manage Direct Load Control<br />

Program<br />

Manage Distributed Energy<br />

Resources<br />

Manage Dr Program<br />

Manage Emissions Audit<br />

Manage Energy Resources<br />

Manage Energy Storage<br />

Manage Frequency<br />

Manage <strong>Grid</strong> Operations<br />

Manage Load Control Participants<br />

Manage Performance<br />

Manage Power Interchange<br />

Manage Power Quality<br />

Manage Quality Of Service (QoS)<br />

Manage Reserves<br />

Manage System Protection<br />

Manage System Re-Start<br />

Manage Variability<br />

Manage Voltage<br />

Minimize Disruption<br />

Monitor Emissions<br />

Monitor Energy Resources<br />

Monitor Equipment<br />

Monitor Resources<br />

Optimize Asset Utilization<br />

Outage Analysis<br />

Physical Security<br />

Provide Black-Start<br />

Provide Connectivity<br />

Provide Demand Profile<br />

Provide Historical Data<br />

Request Market Products<br />

Review Protection Schemes<br />

Schedule Generation<br />

Schedule Outages<br />

Schedule Transmission<br />

Schedule Work Crew<br />

Simulate System<br />

Description<br />

Offer managed load reduction schemes using direct operation of devices<br />

Develop mechanisms to include distributed energy resources (DER) in the operation of<br />

the electrical grid<br />

Offer managed load reduction schemes<br />

Maintain emissions history for grid assets<br />

Facilitate management communications with energy sources attached to the grid<br />

Develop mechanisms to include energy storage in the operation of the electrical grid<br />

Maintain electrical frequency within applicable limits<br />

Balance supply with demand of the electrical grid<br />

Facilitate participant involvement in load control<br />

Maintain performance of equipment within applicable limits<br />

Ensure power flow with neighboring control areas is coordinated<br />

Maintain attributes of the power flow on the system<br />

Provide mechanism to ensure business services remain within predetermined metrics<br />

Manage an inventory of reserves to cover contingencies<br />

Provide protection schemes that ensure the security of the system under fault<br />

conditions<br />

Re-initiate stable operation of a power grid after a failure<br />

Provide reserves that can balance the variability of energy resources<br />

Maintain electrical voltage within applicable limits<br />

Develop mechanisms to minimize interruption of electrical service to customers<br />

Measure the environmental impact of grid assets<br />

Report the status of energy sources attached to the grid<br />

Report the health of equipment<br />

Measure the real-time status of grid resources<br />

Identify dynamic limits for grid assets<br />

Calculate the impact of maintenance requests on the electrical power system<br />

Provide secure locations<br />

Provide the ability to produce power without first requiring power from the grid<br />

Maintain communication to equipment<br />

Provide a time versus demand curve that represents the typical demand of a customer<br />

Provides information for requested time frame<br />

Provides the capability to request the procurement of energy market products<br />

Reviews proposed remedial action schemes (RAS)<br />

Identify economically optimal schedules for supply resources<br />

Schedules outages when they will have the least impact to the reliable operation of the<br />

grid<br />

Provide a mechanism to match supply schedules with transmission capacity<br />

Schedule the appropriate resources for outage resolution<br />

Provide simulation of the electrical power system<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 79


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Synchronize Time<br />

Validate Demand Response<br />

Vulnerability Assessment<br />

Description<br />

Manage frequency so that a clock connected to the grid is kept within tolerance of a<br />

reference clock<br />

Evaluate response of resource to a demand response dispatch<br />

Assess the resilience of grid management systems<br />

Service Provider Domain<br />

Table 19 lists SCAP business services required to support the overall business in the Service Provider<br />

domain. The actual operator of the business services will vary by geographic region.<br />

Table 19 – Service Provider Domain Business Services<br />

Name<br />

Aggregate Customers<br />

Bundle Services<br />

Buy Energy<br />

Classify Data<br />

Collect Meter Data<br />

Communicate Price<br />

Deliver Electrical Service<br />

Detect Outages<br />

Direct Load Control<br />

Forecast Demand<br />

Manage Accuracy Of<br />

Communication<br />

Manage Accuracy Of Information<br />

Manage Availability Of<br />

Communication<br />

Manage Communication<br />

Manage Customer<br />

Communication<br />

Manage Energy Balance<br />

Manage Meter Data Collection<br />

Manage On-Going Two-Way<br />

Communication<br />

Manage Outages<br />

Obtain Customer Device<br />

Information<br />

Prevent Demand Asset Damage<br />

Prevent Environmental Damage<br />

Provide Billing Services<br />

Description<br />

Provide mechanisms to aggregate customers for various electricity buying and selling<br />

options<br />

Provide mechanisms to bundle various services<br />

Maintain protocols that enable buying energy<br />

Provide predetermined protocols for classifying data<br />

Collect accurate meter data from end customer in a manner that is convenient to the<br />

customer<br />

Communicate customer specific price of electricity information to end customer<br />

Deliver high quality electrical service to customers with in applicable limits<br />

Ensure mechanisms to detect outages<br />

Control loads directly to respond to the reliability needs of the electric grid<br />

Determine protocols for forecasting demand<br />

Ensure communication of system parameters are accurate<br />

Ensure communication of system parameters are accurate<br />

Ensure communication of system parameters available to the customer within<br />

applicable limits<br />

Maintain communication of system parameters as they relate to customer decision<br />

making<br />

Maintain communication of system parameters as they relate to customer decision<br />

making<br />

Maintain communication of system parameters as they relate to customer decision<br />

making<br />

Collect accurate meter data with various levels of granularity from end customer<br />

using protocols to minimize cost<br />

Maintain communication channel with the end customer that allows two-way<br />

communication<br />

Maintain the distribution system to minimize outage occurrences<br />

Maintain communication channel with the end customer that allows two-way<br />

communication<br />

Ensure mechanisms to prevent damage to demand assets<br />

Ensure mechanisms to prevent environmental damage<br />

Provide accurate billing data to customers in a timely manner<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 80


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Provide Energy Information<br />

Services<br />

Provide Power Quality Services<br />

Provide Sub Metering Service<br />

Provide Technical Support<br />

Services<br />

Sell Energy<br />

Share Meter Data<br />

Description<br />

Maintain energy information services that allow the customer to manage their loads<br />

Manage the quality of electrical service by ensuring that it is within applicable limits<br />

Make accurate sub metering data of various loads available to various authorized<br />

parties<br />

Provide technical support services that allow the customer to manage their loads<br />

Maintain protocols that enable selling energy<br />

Ensure authorized parties have access to accurate meter data<br />

Bulk Generation Domain<br />

Table 20 lists SCAP business services required to support the overall business in the Generation<br />

domain. The actual operator of the business services will vary by geographic region.<br />

Table 20 – Generation Domain Business Services<br />

Name<br />

Analyze Schedules<br />

Balance System<br />

Discover Equipment Status<br />

Least Cost Dispatch<br />

Maintain Facilities<br />

Maintain System Integrity<br />

Manage Adverse Conditions<br />

Manage Ancillary Services<br />

Manage Cold Start<br />

Manage Contractual Compliance<br />

Manage Control Of Generation<br />

Manage Data Sharing Across<br />

Organizations<br />

Manage Emissions From Units<br />

Manage Equipment<br />

Manage Forecasting<br />

Manage Islanding<br />

Manage Past Incipient Failures<br />

Manage Power Quality<br />

Manage Scheduled Outages<br />

Description<br />

Provide analytics to determine issues with planned operations<br />

Provide a mechanism to respond to changes in the supply-load equation that will<br />

maintain the system within compliance limits<br />

Provide a mechanism to discover the current characteristics of equipment<br />

Provide a mechanism to allow for the lowest cost units to be called on first for<br />

providing energy<br />

Provide maintenance sufficient to maintain generation units in operational<br />

condition<br />

Provide the controls that will facilitate several scenarios for keeping the energy<br />

flowing through the system when issues occur<br />

Provide analytics to determine adverse impacts that can be managed before they<br />

become operational problems<br />

Provide a set of reserve resources that can be used to maintain the grid within<br />

compliance limits<br />

Bring an out of service unit on line as an independent source<br />

Units have contractual commitments on when to run at what rate<br />

Provide a mechanism to directly control the inputs and outputs of generation units<br />

Provide stakeholders in different organizations with required data<br />

Provide a mechanism that allows control of the emissions of a generation unit<br />

Provide a mechanism to control equipment operation in due time<br />

Provide a mechanism to create scenarios of future demand for supply capability<br />

Provide the ability to disconnect sections of the grid from each other to operate<br />

independently<br />

Provide a mechanism switch away from incipient failures to maintain the system<br />

within compliance limits<br />

Provide a mechanism to maintain energy quality within compliance limits<br />

Plan out of service time for maintenance on generation facilities<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 81


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Manage Scheduling Of Facilities<br />

Manage Unit Commitment<br />

Monitor Generator Emissions<br />

Monitor Generator Performance<br />

Provide Communications<br />

Provide Cost-Benefit Analysis<br />

Provide Fail Over Options<br />

Provide Security<br />

Description<br />

Provide analytics that will develop an operations plan for generation units based on<br />

known characteristics<br />

Provide a mechanism to confirm schedule operational compliance in generation<br />

units<br />

Provide a mechanism to measure emissions of a generation unit<br />

Provide a mechanism to measure generation unit operational characteristics<br />

Provide a way to coordinate different facilities operations regardless of outside<br />

interference<br />

Maintain business cases that provide traceability of project costs and benefits<br />

Provide a mechanism to maintain the system within compliance limits when a<br />

resource is lost<br />

The expectation is that the generation units will provide enough reserve to allow<br />

for the loss of part of the system<br />

Transmission Domain<br />

Table 21 lists SCAP business services required to support the overall business in the Transmission<br />

domain. The actual operator of the business services will vary by geographic region.<br />

Table 21 – Transmission Domain Business Services<br />

Name<br />

Balance Phases<br />

Communicate Emergencies<br />

Conduct <strong>Grid</strong> Planning<br />

Conduct Planning<br />

Conduct Short Term<br />

Forecasts<br />

Create Long Term Forecasts<br />

Detect Faults<br />

Dispatch Maintenance<br />

Teams<br />

Forecast Equipment Life<br />

Forecast Equipment Loading<br />

Maintain Contingency Plans<br />

Maintain Equipment<br />

Characteristics<br />

Maintain Physical Security<br />

Maintain Stability<br />

Maintain State Information<br />

Maintain System<br />

Maintain Topology<br />

Description<br />

Maintain the energy balance from one phase to another phase<br />

Maintain channel to stakeholders to for emergency information<br />

Create scenarios for future system sizing to support possible load changes<br />

Create scenarios for future system supply to support possible load changes<br />

Manage a set of near term projections for system use by location<br />

Maintain a set of simulations that can provide future loading projections on the system<br />

Monitor system for system faults (outages)<br />

Manage the available workforce<br />

Using the information gathered in monitor equipment determine the remaining life of<br />

electrical components installed in the grid<br />

Maintain equipment specific future load profiles<br />

Develop plans, including fail over, that allow the system to continue to operate when<br />

problems arise<br />

Maintain all characteristics of electrical components installed in the system<br />

Manage the physical facilities of the system to maintain control of physical access to the<br />

system<br />

Manage energy flow in the grid to ensure stable grid operation<br />

Using the information gathered in monitor equipment determine the remaining capacity of<br />

the system to handle more energy<br />

Manage the maintenance of the system equipment to maintain operational capability<br />

Manage the mapping of the logical connectivity possible in the overall system<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 82


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Maintain Voltage<br />

Manage Access<br />

Manage Blackouts<br />

Manage Demand Response<br />

Manage DER<br />

Manage Emergency<br />

Response<br />

Manage Equipment Rating<br />

Manage Interconnect<br />

Guidelines<br />

Manage Load Limits<br />

Manage Load Shed<br />

Manage Power Flow<br />

Manage Protection Scheme<br />

Manage Stability<br />

Manage Storage<br />

Manage Supply<br />

Manage Switching<br />

Manage Transformer Load<br />

Manage Var<br />

Manage Voltage<br />

Monitor All Phases<br />

Monitor Equipment<br />

Monitor Equipment<br />

Accuracy<br />

Monitor System Status<br />

Operate Unbalanced<br />

Optimize Equipment<br />

Optimize Planned Outage<br />

Optimize Power Flow<br />

Regulate Frequency<br />

Simulate System<br />

Description<br />

Manage embedded equipment in the grid to adjust voltage to stay within compliance limits<br />

Manage a mechanism to monitor who accessed what when<br />

Operate a mechanism to manage rolling blackouts as part of an overall balancing scheme<br />

Operate a mechanism to manage interruptible loads as part of an overall balancing scheme<br />

Manage DER as a part of the resource mix for balancing energy demands<br />

Maintain a plan for recovering from major system disruptions<br />

Using the information gathered in monitor equipment determine the current energy<br />

capacity of each electrical component of the system<br />

Maintain a mechanism for managing the exchange of energy with distribution<br />

Operate equipment in a manner that avoids overloads<br />

Manage the system balance by shedding load<br />

React to rapid changes in the energy flow to maintain system parameters within<br />

compliance limits<br />

Maintain a set of schemes for protecting the system from damage by electrical overload<br />

Manage energy flow in the grid to ensure stable grid operation<br />

Maintain the integrated operation of storage at any point in the system<br />

Manage the level of supply in the system to balance the system while maintaining the<br />

compliance limits<br />

Manage a set of protocols to switch load on the system<br />

Maintain the load on transformers to avoid distortion of the wave form<br />

Manage VAR for all customers within compliance limits<br />

Operate a mechanism to regulate voltage within compliance limits for all customers<br />

Monitor all three phases of the system for energy flow characteristics<br />

Operate a mechanism to maintain temporal characteristics on electrical components<br />

installed in the system<br />

Maintain status of accuracy for instrumentation in the field<br />

Manage instrumentation in the grid to maintain a picture of the grid situation<br />

Manage the system will different amounts of power flowing on each of the three phases<br />

Manage energy flow so that equipment usage is optimized<br />

Manage the optimization of equipment availability for maintenance<br />

Manage the flow of energy in the grid to minimize losses while supplying all demand<br />

Maintain system frequency within compliance limits<br />

Shall manage a mechanism to create on demand digital simulations of the system<br />

Distribution Domain<br />

Table 22 lists SCAP business services required to support the overall business in the Distribution<br />

domain. In most cases the distribution utility will operate all services. This is the only domain likely to<br />

be similar from region to region.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 83


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Table 22 – Distribution Domain Business Services<br />

Name<br />

Audit trail management<br />

Automated Service Restoration<br />

Condition Based Maintenance<br />

Contingency Load Transfer<br />

Contingency Ranking<br />

Customer Power Quality<br />

Information Management<br />

Development of Future<br />

Distribution Model<br />

Diagnostic Analysis of<br />

Distribution Systems<br />

Distributed Energy Resource<br />

Management<br />

Distribution Energy Loss<br />

Minimization<br />

Distribution operations training<br />

Distribution Planning<br />

Distribution Systems Asset<br />

Management<br />

Distribution Systems Field<br />

Equipment Configuration<br />

Management<br />

Distribution Systems Support of<br />

Transmission Operations<br />

Fault Isolation<br />

Fault Level Analysis<br />

Fault Location<br />

Field Equipment Upgrade<br />

Management<br />

Field work management<br />

Intelligent Alarm Processing<br />

Loss location management<br />

Manage System Protection<br />

Execution<br />

Manage unbalanced current<br />

Optimal Load Flow<br />

Description<br />

This service provides the documentation necessary to provide an audit trail for system<br />

event reporting.<br />

This service manages automated service restoration functions. Measurement of this<br />

service would follow accepted indices on system restoration performance.<br />

This service manages condition based maintenance for distribution field equipment.<br />

This service manages contingency load transfers.<br />

This service ranks contingencies for distribution system operators.<br />

This service manages power quality information available from within customer sites<br />

throughout the distribution system.<br />

This service manages the development of future distribution systems<br />

This service manages the diagnostic analysis of distribution system field equipment.<br />

This service provides management of Distributed Energy Resources (DER) across the<br />

distribution system.<br />

This service manages the technical loss of energy to minimize losses on the<br />

distribution system.<br />

This service provides a comprehensive program of training for distribution operations<br />

personnel.<br />

This service manages the distribution planning processes.<br />

This service manages distribution systems asset management processes.<br />

This service manages the configuration of field equipment. Metrics for this service are<br />

determined by emerging policies for maintaining field equipment documentation.<br />

This service manages the integration of distribution systems in support of transmission<br />

operations.<br />

This service manages the isolation of faults to minimize damage to utility and<br />

customer equipment.<br />

This service manages Fault Level Analysis on distribution systems<br />

This service manages the location of faults on the distribution system. Metrics for this<br />

service would follow industry indices of system performance<br />

This service manages the updating of field equipment<br />

This service manages the dispatch of work crews authorized for servicing field<br />

equipment<br />

This service manages all levels of alarms to maintain correct operator action priorities.<br />

The metric for this service is related to correctly handling the variety of alarms that<br />

may be faced by operators.<br />

This service manages the location of non-technical energy losses on the distribution<br />

system.<br />

This service manages system protection post event analysis; This service manages the<br />

analysis of protection actions following an event episode.<br />

This service manages unbalanced current flows to keep distribution systems within<br />

acceptable engineering tolerances to optimize efficiency.<br />

This service optimizes load flows on the distribution system<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 84


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Optimize Voltage to Reactive<br />

Power<br />

Outage Management<br />

Planned Outage Management<br />

Power Flow Analyses<br />

Power Quality Improvement<br />

Power Quality Monitoring<br />

Prepare Static Systems for<br />

Storm Conditions<br />

Reactive Power Management<br />

Real-Time Emergency<br />

Operations<br />

Root Cause Analysis<br />

Short Circuit Analysis<br />

Short Term Load Forecasts<br />

State Estimation Support<br />

System Protection<br />

System State Monitoring<br />

Topological model<br />

management<br />

Transformer Management<br />

Voltage Management<br />

Description<br />

This service manages voltage in relation to reactive power within the distribution<br />

system.<br />

This service manages outages on distribution systems. The metric for this service is<br />

related to system reliability indices.<br />

This service supports planned outage management for distribution systems.<br />

This service manages the Power Flow Analyses processes.<br />

This service manages the improvement of power quality within the distribution<br />

system.<br />

This service monitors power quality on the distribution system.<br />

This service includes the management of static preparations in anticipation of system<br />

disturbances due to impending storm conditions<br />

This service manages reactive power on the distribution system to maintain reactive<br />

power<br />

This service manages real-time emergency operations within the distribution system.<br />

This service manages the support of field crew investigations into root cause analysis<br />

of distribution system failures<br />

This service manages the analysis of short circuits within distribution systems<br />

This service manages short term load forecasting<br />

This service manages the state estimation process using available information<br />

available from field equipment.<br />

This service manages system protection functions<br />

This service manages the migration to state monitoring making use of increasing<br />

numbers of field devices that have monitoring capability. Metrics for this service<br />

would be the reduction in the band of error surrounding system state.<br />

This service maintains the topological model to maintain the system model in near<br />

real-time.<br />

This service manages the life-cycle of transformers in field operations<br />

This service manages customer service delivery voltages to stay within industry<br />

accepted tolerances<br />

Customer Domain<br />

Table 23 lists SCAP business services required to support the overall business in the Customer domain.<br />

The actual operator of the business services will vary by geographic region.<br />

Table 23 – Customer Domain Business Services<br />

Name<br />

Description<br />

Access Control Management Provide a mechanism to support role-based access control to services.<br />

Configuration Management Manage configuration of the system.<br />

Deployment Management Manage ongoing revision of the system.<br />

Energy Asset Aggregation Manages a group of devices in the customer domain<br />

Energy Management<br />

Provide a mechanism to influence operation of devices to meet business energy-usage goals.<br />

Energy Monitoring<br />

Provide a mechanism to monitor aspects of energy as required to meet business goals.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 85


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Environmental Monitoring<br />

Information Presentation<br />

Infrastructure Planning<br />

Manual Override<br />

Non-Intrusive Monitoring<br />

Outage Management<br />

Description<br />

Provide a mechanism to collect environmental data about the impact of energy supply<br />

sources in the system.<br />

Provide a mechanism to display information from the system.<br />

Building the <strong>Smart</strong> <strong>Grid</strong> System to support additional devices (e.g. Water, Gas)<br />

Provide a mechanism to override automated actions while assuring safety.<br />

Derive device load levels using non-intrusive measurements combined with analytic<br />

methods.<br />

Provide a mechanism to mitigate impact power failures through use of alternate energy<br />

supply sources.<br />

<strong>Smart</strong> <strong>Grid</strong> Cross-Domain Foundational Services<br />

Cross Domain Foundation services are relied upon by all business domains and are therefore required<br />

to be interoperable across domains to enable flexible and resilient grid architecture. For example, two<br />

domains utilizing disparate encryption mechanisms will require additional work to support their<br />

interaction and be indicative of architectural fragility.<br />

Cross domain services break down into three basic groups:<br />

Security<br />

Communication<br />

Data<br />

Each group is discussed below.<br />

Security Services<br />

Central Security Services are comprised of Automated Services as well as the Managed Services<br />

responsible for configuring the Automated Services. Automated Services require no human<br />

intervention once configured and are built for speed and efficiency, whereas Managed Services expect<br />

user input to set configurations, preferences, etc. for the particular characteristic being managed. The<br />

NISTIR 7826 Security Requirements have been translated into the security services in Table 24.<br />

Table 24 – Security Services<br />

Name<br />

Access Control<br />

Account Management<br />

Alarming<br />

Archive<br />

Audit<br />

Audit Qualification<br />

Authorization<br />

Backup<br />

Description<br />

Manages the secure admission. (see Central Security).<br />

Maintains actor security credentials<br />

Provides a mechanism to pass alerts to actors<br />

Providing an accurate long-term copy of information<br />

Provides a rigorous review of actor actions<br />

Provides a trusted method to determine that audit actors are competent<br />

Provides permission for an actor to take an action<br />

A process that provides an accurate alternate copy of information<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 86


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Camouflage<br />

Central Security<br />

Challenge Management<br />

Classification Management<br />

Compliance Management<br />

Configuration<br />

Continuity<br />

Control Management<br />

Corrective Action Management<br />

Disposal<br />

Distraction<br />

Encryption<br />

Entry Management<br />

Identification<br />

Identity Management<br />

Incident Reporting<br />

Information Release<br />

Management<br />

IPR management<br />

Key Management<br />

Life Cycle Management<br />

Log Protection<br />

Logging<br />

Non-Repudiation<br />

Parameter Monitoring<br />

Password Management<br />

Penetration<br />

Physical Security<br />

Privilege Management<br />

Reliability<br />

Response Management<br />

Retention<br />

Risk Assessment<br />

Risk Management<br />

Role Management<br />

Screening<br />

Hiding items from unauthorized actors<br />

Description<br />

The Central Security Service shall maintain a database of transaction permissions at<br />

the component level. Specifically, the Central Security Service explicitly defines which<br />

users and components have permission to perform what transactions in what context.<br />

All <strong>Smart</strong> <strong>Grid</strong> end-users and components must verify sufficient privileges prior to<br />

execution of any transaction instruction.<br />

Maintains a secure challenge process for actors<br />

Manages the labeling of sensitive information<br />

Maintains a process to ensure that actors have not violated security policy<br />

Arranges the pieces to provides an authorized whole<br />

Provides for actors to continue to securely function at an acceptable level<br />

Maintains a set of limits on an actor's access<br />

A process to ensure that any security issues are closed<br />

Provides a trusted process to remove information permanently<br />

A process of enticing unauthorized actors to interact with decoys<br />

Provides a mechanism to encode information in a secure fashion<br />

Provides a mechanism for allowing an authorized actor access<br />

A trusted process of determining the identity of an actor<br />

With the large number of end-users of <strong>Smart</strong> <strong>Grid</strong>, including the customers, utility<br />

employees, grid control operators, etc., the <strong>Smart</strong> <strong>Grid</strong> components must provide<br />

unique and traceable identification of each user as well as data with each message and<br />

transaction.<br />

provides a method to report security breaches to a trusted authority<br />

Allows control of information to be passed to other actors<br />

A process to manage rights to use intellectual property<br />

Provides a trusted process to maintain the security of a secret<br />

A process to manage the cradle to grave security<br />

Provides a mechanism that keeps logs from being tampered with<br />

Provides an auditable trail of actors access<br />

Provides a mechanism to prove that a specific actor took a specific action<br />

Watching the edges of a physical location for unauthorized actions<br />

Manages the process of dealing with all actor passwords<br />

Provides a mechanism to test the security environment for vulnerabilities<br />

Provides a process to ensure that physical items are secure from unauthorized access<br />

Maintains the privileges for actors<br />

Provides a process to monitor actors for unexpected changes in behavior<br />

Provides a mechanism to manage actor actions for alerts<br />

Provides a process to determine parameters for saving information<br />

Determines the risk associated with the security environment<br />

Maintains an assessment of the vulnerabilities in the security environment<br />

Manages actor roles<br />

Maintains a trusted process for reviewing actors for credentials<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 87


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Name<br />

Security Assessment<br />

Security Authority<br />

Security Management<br />

Security Monitoring<br />

Security Policy Management<br />

Security Reporting<br />

Security Test Development<br />

Security Training Management<br />

Separation Management<br />

Threshold Management<br />

Time Stamp<br />

Update Management<br />

Vulnerability Assessment<br />

Vulnerability Management<br />

Description<br />

Provides a mechanism to determine security needs<br />

Provides trusted resource that can authorize changes<br />

Maintains the overall security environment<br />

The analysis of collected information on the status of the security environment<br />

Creates an overall policy for security<br />

Provides a mechanism to inform trusted actors<br />

Provides a trusted process to develop test processes for security<br />

Provides actors with training required to maintain their credentials<br />

Provides a mechanism to ensure that an actor does not have multiple security roles<br />

Provides a mechanism to set parameters for generating an alert<br />

Provides an auditable mechanism for attaching accurate time to an action<br />

A process that updates to the security system navigate prior to being placed in service<br />

Determines what potential security holes exist<br />

Provides a mechanism to monitor the status of security holes<br />

Communication Services<br />

Communication services are fundamental to electric grid operations. They underpin the means by<br />

which devices become intelligent, for information to flow, controls to be executed, and for people to<br />

manage utility functions and services. Movement toward a smarter grid will necessitate vast quantities<br />

of new smart devices to be implemented—all needing some form of communications. The fact that<br />

many of these devices don’t yet exist adds to the challenge. As the devices are implemented, their<br />

functionality and value will expand as grid operators figure out innovative ways to leverage smart<br />

device intelligence. Thus, it is imperative for the <strong>Smart</strong> <strong>Grid</strong> communication architecture to be<br />

extraordinarily forward looking and accommodating.<br />

At the communication services layer, the following functions are required:<br />

1. Transport services to move information around the network,<br />

2. Virtualization services to help segregate and optimize transport services,<br />

3. Control services to help manage information flow and support endpoints wanting network access,<br />

4. Gateway services to facilitate legacy applications to utilize next generation networks, and<br />

5. Mobility services to support roaming or mobile endpoints.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 88


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 46 - Communication Services Layer Functions<br />

Table 25 lists the network and communication services required to support the smart grid.<br />

Table 25 – Communications Services<br />

Service<br />

Access Of Media<br />

Address Management<br />

Administration Service<br />

Alerts<br />

Application Caching<br />

Assured Delivery<br />

Asynchronous<br />

Messaging<br />

Atomic Multicasting<br />

Automated Messaging<br />

Automated Process<br />

Automatic Call Routing<br />

Backbone<br />

Backup<br />

Broker Support<br />

Description<br />

The capability for a user to view specific Library Mgmt System functions depending on the "Set-up<br />

and Control" for that user e.g. searching more than one repository.<br />

Assignment and maintenance of dynamic device addresses to ensure that there are no duplicate<br />

addresses on the network<br />

The maintenance and management of local policies, activities or procedures.<br />

Notification using some mechanism (e.g. SMTP message) that a message was delivered/notdelivered/dispatched/rejected/accepted.<br />

The capability of the system to provide the capability to cache objects, pages etc… to optimize<br />

access speeds. This includes caching for static and dynamic pages.<br />

The ability to know that when a message is sent thru or between systems that the message will<br />

either be received or that notification will happen to the originating system or a designated<br />

operator<br />

Fire and Forget messaging system that exists between source and target applications or/and<br />

databases.<br />

The capability to send a message to more than one target. The message can be atomic (fire and<br />

forget).<br />

Machine generated messages that are sent to specified addresses in pre-designed formats<br />

Event triggered machine operations with a pre-designed set of routines<br />

Using the header information of a telephone message to send the call to a specific hand set or<br />

one of a bank of handsets<br />

The high speed interconnect on the network that provides the location where multiple systems<br />

and users can exchange data. (NOTE: The backbone may be wholly contained in a single device<br />

such as an enterprise router)<br />

The processing of saving documents for storage to another storage medium e.g. disk for<br />

retrieval/restoration as needed. Backups are normally removed to another location for safe<br />

storage<br />

The ability to manage exchange of information between systems and processes through a central<br />

controller<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 89


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Call Groups<br />

Service<br />

Capacity Management<br />

Capacity Monitoring<br />

Chat Management<br />

Collaboration<br />

Computer Telephony<br />

Integration (CTI)<br />

Configuration<br />

Management<br />

Connection Pooling<br />

Connectors<br />

Content Delivery<br />

Data Acquisition<br />

Data Cleansing<br />

Data Distribution<br />

Datastream<br />

Conversion<br />

Delivery Assurance<br />

Delivery Mgmt Service<br />

Dial-In Management<br />

Services<br />

Directory Framework<br />

Management<br />

Directory Framework<br />

Parameter and Control<br />

Set-ups<br />

Dispatch<br />

Description<br />

Maintenance of an automated list of radio handsets that make up the radios attached to a<br />

specific transmitter on a specific frequency and the unique identifier of each handset, so that the<br />

radio call goes to the right transmitter and the right handset<br />

The ability to create and manage the rules required to determine how resources will be assigned<br />

to the available services<br />

The ability to monitor the loads and performance of the systems to determine when the system<br />

either needs additional resources assigned or should shed tasks or users<br />

The ability to set rules and define forums or private areas for on-line chat for collaboration or<br />

discussion<br />

Allows near real-time cooperation between two or more people in two or more locations to<br />

communicate, operate on the same data and see each other's operations and results in an<br />

interactive fashion as though they were in a meeting<br />

The ability to use a computer to answer the phone and/or to provide information automatically<br />

to the human on the answering end of the phone to support the processing of the call in a faster<br />

and more orderly fashion<br />

The ability to manage the system software, application, system settings, and user information on<br />

similar devices automatically and from a remote location<br />

Connection pooling allows the efficient use of data access services. The creation and ripping<br />

down of a connection to a database takes up valuable processing cycles – pooling allows a<br />

connection that is already existing to be used by many separate processes (by queuing requests).<br />

By managing a fixed number of connections (which can automatically be increased in multiples),<br />

the connection time overheads are largely removed, resulting in potentially significant<br />

performance benefits.<br />

Exposure of functionality (application or databases) that enables an application or database to<br />

conduct transactions (CRUD) with the target.<br />

Involves the delivery of content to a particular channel<br />

Collection of a stream of data from instrumentation and sensors that either constantly send data<br />

or are trigger driven, the acquisition has to collect the data and store it for each required reading,<br />

no unanticipated down time is acceptable<br />

An automated process of reviewing data for impurities and correcting these defects automatically<br />

if possible, based on a set of defined rules, logging all errors for manual review<br />

The ability to transport from a central master data set information to remote locations<br />

Translate incoming and outgoing data (or sets of transactions) into the required formats based on<br />

business rules supporting one or more clients/systems on the fly<br />

The ability to assure delivery of a message packet to another system or notify the sending system<br />

or a designated operator<br />

Management of delivery of services either by internal or external resources, ie collection of waste<br />

materials. Monitoring of inventory of items, ie bins.<br />

The ability to manage the occasionally connected data lines from various partners and customers,<br />

with regard to quality of connection, connection time and security<br />

The Management activates of the System Directory, includes distributed management.<br />

Configuration, Set-up of seed data, business rules , business defined criteria that govern the<br />

Directory. May actually call other services such as Users, Groups, Authorizations, etc.<br />

Firing of the message to the Messaging Service or Network Interface Service.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 90


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Domain Name<br />

Services<br />

Electronic Messaging<br />

Enterprise Storage<br />

Event Monitoring<br />

Event Notification<br />

Events Flow<br />

Exception<br />

Management<br />

External File Transfer<br />

Fault Monitoring<br />

Gateway Control<br />

Gateway Management<br />

Gateway Services<br />

Information Exchange<br />

Infrastructure<br />

Management<br />

Infrastructure<br />

Monitoring<br />

Infrastructure<br />

Prioritization<br />

Integrated Voice<br />

Response (IVR)<br />

Inter-Network<br />

Connections<br />

Interactive White<br />

Board<br />

Interconnection<br />

Services - Network<br />

Description<br />

Creation and maintenance of a cross-reference list of physical addresses, routes and aliases for<br />

devices on the network (internal and possibly external), so that humans can enter the alias to<br />

automatically communicate with the desired device using industry standard<br />

The use of digital distribution of information over a network that may or may not extend beyond<br />

the enterprise with a central distribution and addressing center<br />

The ability to share storage between services and applications within the enterprise to provide<br />

flexibility and management for the storage media and the content of the media<br />

Creation, monitoring and extraction an auditable log of events and using pattern matching to a<br />

set of pre-defined rules to alert an operator of an abnormal condition. May also feed alerts to a<br />

device for further processing or process control<br />

Notification to a user or device that an event has occurred, implemented thru a series of rules<br />

and devices, so that the system will keep escalating utilizing different methods or addresses until<br />

it is successful in delivering the alert<br />

the ability to orchestrate a cascading set of events in an automated fashion thru a broker or other<br />

central controller<br />

Provide reports of incidents in any service in the enterprise.<br />

The ability to send a digital package of information via a standard transfer service between<br />

locations (e.g. FTP)<br />

The ability to monitor the services for unexpected operations and determine the cause of the<br />

issue - then report the issues to an appropriate location based on rules<br />

The ability to control the flow of information thru either an internal or an external gateway based<br />

on the rules that have been installed in the gateway<br />

The ability to create and maintain the rules that will be used to determine how a gateway will<br />

react to specific messages, either from the addressing or the content of the message<br />

The ability to use a central director to determine how to route specific digital documents and<br />

information around the enterprise or to and from partners<br />

Automated transfer of data between two or more applications or two or more databases based<br />

on pre-defined keys, formats and rules<br />

The ability to remotely maintain the infrastructure in the organization including creating and<br />

maintaining rules about resource prioritization, allocation, administration authority, etc.<br />

The ability to monitor what is happening in the enterprise infrastructure, log any events that are<br />

not expected, and notify an administrator based on the notification rules<br />

The ability to determine which service or information should go first, when there is contention for<br />

the resources that comprise the infrastructure<br />

The ability to use technology to create and maintain call message hierarchies that are used to<br />

interact with inbound callers to provide information for standard queries without the<br />

intervention of a human operator and record the results of the query. The IVR normally has the<br />

ability to route the call and any information gathered to a human operator if the query cannot be<br />

successfully answered<br />

The ability to peer with or connect to foreign network for communication, both networks that are<br />

controlled by partners and those that are public networks<br />

A process and supporting software to allow two or more people at two or more physical<br />

terminals to view an electronic chalkboard and to add information to the chalkboard that is<br />

visible to everyone else in the session. Change ability can be controlled via security services<br />

The ability to connect (or peer) one or more networks together using standard industry protocols<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 91


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Interconnection<br />

Services - Wired<br />

Interconnection<br />

Services - Wireless<br />

Intermittent Services<br />

Internet Access<br />

Link Management<br />

Linking Services<br />

Log/Audit<br />

Logging<br />

Message<br />

Completeness<br />

Management<br />

Message<br />

Composition/<br />

Decomposition<br />

Message Filtering<br />

Message Logging<br />

Message Routing<br />

Message Translation<br />

Mobile<br />

Mobile Device<br />

Management<br />

Network &<br />

Connectivity<br />

Management<br />

Network Caching<br />

Network Device<br />

Maintenance<br />

Description<br />

The ability to physically connect devices so that they can use standard protocols to communicate<br />

both with other devices and with the enterprise<br />

The ability to connect devices so that they can use standard protocols to communicate both with<br />

other devices and with the enterprise over an Radio Frequency carrier<br />

Services which can be started and stopped, either by demand, or by rule or by administration<br />

which can be used to change the behavior of the rest of the environment (e.g. an intermittent<br />

service to re-route traffic because of a denial of services attack for a commercial web site)<br />

Provision to allow authorized users and devices productive access to the Internet using IP<br />

protocols<br />

Maintenance of specific legs in the network, providing health information on the link to the<br />

operator, so that adjustments can be made<br />

The Capability to access other modules functionality in the application e.g. accessing property<br />

module to associate people, rates or licenses.<br />

Record the master data management system and master data management service events,<br />

normal and abnormal. The full Audit service provides all the logging necessary to support a rich<br />

history of master data management processing events. In practice the Audit service may rarely be<br />

used to its full capacity, partly because the Audit service may have an impact on the performance<br />

of the master data management system.<br />

Audit trail of jobs processed, manual interventions and incidents<br />

The ability to detect when a message does not contain a complete payload and notify the sending<br />

systems<br />

Manages the copying of a message to different formats - utilizes the Transformation service, can<br />

be utilized by multicasting. Also can involve breaking the message up into components.<br />

The determination of where a message is allowed to be sent/received based on security and data<br />

protection requirements.<br />

Creation of a archival quality list of the header or header and body information of all the<br />

information being passed between a specified set of addresses or with specific header<br />

information<br />

The ability to route messages from one system to another automatically<br />

The Transformations from a source message to the requirements of the target.<br />

The ability to disconnect from the network and work on standalone applications, supports bidirectional<br />

synchronization when reconnected to the network<br />

The ability to create rules about how mobile devices connect to the enterprise and what<br />

requirements have to be met prior to allowing access (e.g. authentication, authorization, patch<br />

level, etc)<br />

The ability to create and maintain the rules by which a network can connect to another network<br />

either with a partner or a public network<br />

Caching is often used to improve performance of systems, by moving the data nearer the<br />

consumer. This can be by caching data in memory for database access, caching networked data<br />

on a local storage device for network access, caching pre-constructed Web pages and other<br />

information for use either externally (often referred to as reverse caching) or internally (reducing<br />

network usage).<br />

The ability to remotely manage the health of a network device and update any firmware or<br />

software installed in the device<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 92


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Network Device<br />

Security Management<br />

Network Interfaces<br />

Network Management<br />

Network Monitor<br />

Network Performance<br />

Tuning<br />

Network Traffic<br />

Simulation<br />

Node Management<br />

Non-Delivery<br />

Notification Services<br />

Monitoring<br />

Object Inspection<br />

Path Tracking<br />

Performance<br />

Modeling<br />

Portal<br />

Private Wireless<br />

Configuration<br />

Management (Talkgroups)<br />

Queue Management<br />

Radio<br />

Radio Frequency<br />

Management<br />

Real-time<br />

Reliable Multicasting<br />

Remote Access<br />

Remote access<br />

management<br />

Description<br />

The ability to remotely manage the rules, settings and permissions for the secure operation of the<br />

netowork<br />

Provide network access outside the Local Area network (other LANs in the Wide Area or external<br />

networks)<br />

Management of the network devices including: routers, hubs and switch monitoring and<br />

configuration control<br />

Logging, triggering (simple test) and analyzing (complex time delayed testing) the movement of<br />

traffic on the network to determine the health of the network and alerting devices or humans of<br />

problems with the health, based on a pre-defined set of rules.<br />

The ability to monitor and automatically adjust the performance of a network or a portion of a<br />

network<br />

the ability to create and maintain a model of the actual network and to create traffic scenarios for<br />

the network to determine when the network would run into contention and other operational<br />

issues<br />

The ability to allocate and manage the way services access nodes on a processing system<br />

The ability to recognize that a message that should have been delivered has not been delivered<br />

and make the appropriate re-tries or notifications<br />

The ability to monitor and report the health of the notification process<br />

The ability to review object for integrity and replace or sequester objects that do not pass the<br />

testing<br />

The ability to determine the route that traffic took during the trip between locations including all<br />

the devices that it crossed during the trip and time statistics<br />

The ability to model a service and its supporting infrastructure and understand how the service<br />

will perform based on scenarios of usage<br />

Providing an individual human readable front end to the information and systems that they are<br />

authorized to access, in a common format to hide the complexity of the underlying systems in a<br />

commercially standard format<br />

The ability to segment the user population by various parameters to efficiently use the limited<br />

radio bandwidth that is available from a transponder<br />

Handling of the incoming and outgoing queues of events, and messages -including the ability to<br />

recognize priority items in the queue and move them forward, ensuring that all items are<br />

released from the queue to the process that they are assigned to<br />

Supports use of specific frequencies to send information thru the air between handsets and fixed<br />

antennas using a known addressing scheme<br />

Maintaining control of the specific radio frequencies that are licensed to the facility to reduce<br />

non-productive messaging and optimize productive use<br />

The ability to interact with data in a short enough period of time to effect the next operation on<br />

the item reporting the data (e.g. acting on data that shows a broken drill bit in a tool, before it<br />

can eject the current part and start on the next one) so that the required actions are taken within<br />

the cycle of the device<br />

Multicasting that results in a response.<br />

Allowing users and devices to connect to the network from public or non-dedicated services such<br />

as the internet or dial in services<br />

The ability to limit who can use remote access and what they can do from a remote location<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 93


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Remote access<br />

security management<br />

Remote configuration<br />

management<br />

Remote multicast<br />

printing<br />

Remote print<br />

Remote systems<br />

administration<br />

Routing<br />

Routing modeling<br />

Sensor<br />

SMS<br />

SMS Channel<br />

Synchronization<br />

Synchronous Network<br />

Interfaces<br />

System Monitoring<br />

Telephony<br />

Text Chat<br />

Traffic Prioritization<br />

Transmission<br />

Trigger (Initiate)<br />

Tunneled<br />

Transmission<br />

User Directory<br />

Services<br />

User Monitoring<br />

Video Communication<br />

Video management<br />

Voice Channel<br />

Voice Management<br />

Description<br />

The ability to provide authentication and other security mechanisms for remote access<br />

The ability to maintain the configuration of clients that are remotely accessing services or assets.<br />

The ability to send a single print file to a number of remote locations for remote printing<br />

The ability to create hard copy documents in a geographic location that is not where the print file<br />

is generated<br />

The ability to securely manage servers and other assets when not sitting on the console that is<br />

directly attached to the device<br />

Sending traffic over only required network segments to a known address on the other end of the<br />

network links and preventing traffic without valid need from affecting the operation of and/or<br />

being visible to non-required network segments. Limiting the visibility of broadcast messages to<br />

specifically required network segments, based on the header of the broadcast<br />

Routing rules for transporting master data management occurences from master data<br />

management system to local application.<br />

Interrogates and reports real-time readings on a specific physical characteristic (ie temperature,<br />

or a chemical in the air)<br />

The ability to communicate with devices that use the industry standard for short messaging<br />

service in a bi-directional fashion<br />

SMS Channel Service (Short Message Service used for message event notification and simple<br />

interaction services. This is a specific type of Mobile Service).<br />

The capability to manage the synchronization of user authentication and other details to ensure<br />

that information across applications is updated. This is the "Join" Service that allows relationship<br />

management through synchronization and replication.<br />

The ability to do bi-directional handshaking between devices on the network where each step is<br />

acknowledged by the other device on the network<br />

System monitoring based on certain criteria e.g. KPIs.<br />

Support for the standard addressing scheme for telephone handsets to route voice conversations<br />

and other voice encoded traffic over the telephone network<br />

Alpha-numeric information for collaboration and discussion between devices in near real time<br />

Using the header information on IP traffic to determine whether to allow it unlimited, limited or<br />

delayed assess to slower network links<br />

Providing information for routing over an IP network with machine readable headers<br />

Signalize an event to an automated process in the course of the master data management<br />

process.<br />

Provides information for routing over an IP network with external headers, to a specific gateway<br />

address, while encrypting the real headers and information as data<br />

The facility to maintain constituent's name and address register, property registers, supplier<br />

information, etc.<br />

The ability to watch the behavior of any user on the system and determine any behavior that is<br />

outside of the expected or accepted operation of the systems.<br />

Use of moving pictures, normally in near real-time to communicate between two locations<br />

Video management (CRUD)<br />

Voice Channel Services (Delivery and receipt of information through a voice channel including<br />

touchtone, speech recognition, automatic voice response and text to speech services)<br />

Management of voice lines, PBX's, assignments, billing usage, CIT, VRU, etc.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 94


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Voice Recording<br />

Voicemail<br />

Web Services<br />

Description<br />

Recording all voice traffic between specific handsets or telephone instruments<br />

Storage of voice messages that can be played back by users who have access to specific<br />

telephone handset addresses<br />

Provide access to pre-formatted sets of messages and routines that use industry standards for the<br />

exchange of data between parties<br />

Data Management Services<br />

Data Management Services are required in all domains of the smart grid. All 7 domains require some<br />

level of data management services, and most required more capability than they have today. The<br />

increase in the volume of data and the tightening of the timing requirements means that most<br />

enterprises that will operate the smart grid will need to evaluate their legacy services for suitability the<br />

future. Data services can be broken down into data acquisition, transformation, persistence and<br />

archiving. Table 26 lists conceptual automation services that support data:<br />

Table 26 – Data Management Services<br />

Service<br />

Ad-Hoc Management<br />

Reports<br />

Adapter<br />

Adaptor Matching<br />

Adaptors<br />

Analyse Information<br />

Analysis And Strategy<br />

Application Certification -<br />

Ecosystem<br />

Application Hosting<br />

Archive Management<br />

Archive Rules<br />

Archiving<br />

Backup And Restoration<br />

Description<br />

This service includes the generation of ad-hoc reports in either electronic or hard copy (e.g.<br />

job log reporting or site statistical reporting.)<br />

Connecting the scheduler to processing nodes<br />

Defines a standard application for connecting to heterogeneous enterprise information<br />

systems, such as ERP, mainframe transaction processing and database systems. The<br />

architecture defines a set of scalable, secure, and transactional mechanisms that describe<br />

the integration of enterprise information systems to an application server and enterprise<br />

applications.<br />

Provides interfaces to Application for the exchange of data between applications.<br />

Analysis tools available for forecasting and analyzing historic data to find patterns etc.<br />

Includes OLAP; modeling.<br />

Analysis tools available for forecasting and analyzing historic data to find patterns etc.<br />

Includes OLAP; modeling.<br />

The ability to successfully complete the testing standards for information devices and<br />

computer systems with in a community of companies that have decided to exchange data<br />

and/or system access and have defined community standards (e.g. Wal-Mart Vendor<br />

Standards)<br />

The process required to run a commercial package for to support business requirements<br />

Manages the archiving of content to external storage. Use of schedule, filters, etc.. In order<br />

to target content for archiving.<br />

Rules for archiving of information, applications, settings, configurations, and system<br />

software for permanent storage.<br />

Permanent or very long-term back up of data on media that is designed to withstand the<br />

long-term storage<br />

Backup and Recovery are key aspects to any information system – and consist of both ICT<br />

services and supporting processes. Backup is the activity of copying information from a<br />

system so that it is preserved in case of equipment failure or other catastrophe. Restore is<br />

the activity of restoring a system using the backups of the information and/or systems<br />

applications.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 95


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Backup Management<br />

Business Continuity Pre-<br />

Disaster Services<br />

Calendar Service<br />

Calendaring - Job<br />

Management<br />

Capacity Planning<br />

Cleansing<br />

Cloning<br />

Cold-Starting<br />

Configuration<br />

Connectors<br />

Content Aggregation<br />

Content Guideline<br />

Management<br />

Content Import<br />

Content Load Management<br />

Content Management<br />

Content Publication<br />

Description<br />

The ability to create rules sets that drive the process of backup and restoration of data,<br />

configurations, applications and systems in an enterprise<br />

The operation of the services required to allow for business continuity to be available when<br />

a disaster happens<br />

A system that provides the ability to do timekeeping that defines the beginning and length<br />

and divisions of the year. Also to provide the basis for a scheduling service for activities<br />

The ability to manage a set of activities between a set of systems, such that the desired end<br />

result is achieved in an automated fashion on a regular schedule<br />

The ability to forecast the level of resources that needs to be assigned to a service to<br />

support the anticipated load of the service based on the rules for capacity management<br />

Data cleansing, also called data scrubbing, is the process of amending or removing data in a<br />

database that is incorrect, incomplete, improperly formatted, or duplicated.<br />

The process of saving transactions to a mirror system, as the transactions are processed to<br />

provide a "hot" recovery capability<br />

Whenever a system is being brought on-line for the first time, it must be initialized and<br />

synchronized with the integration infrastructure. The system may be designed to be event<br />

driven, but in order for it to be able to properly process a change to a data item, it must<br />

first be placed in a known initial state. This is true for its internal functions as well as for it<br />

to be able to properly perform its designated services within the context enterprise level<br />

business processes. In case for some reason the integration platform is unavailable,<br />

provisions need to be made for a subset of mission critical functions to be able to function<br />

in a minimally acceptable fashion. For example, it is possible to start up a process that is<br />

completely independent of the integration platform and have a temporary point-to-point<br />

interface. Then, when integration platform is available again, the point-to-point interface<br />

can be disabled. This should be considered only for certain mission critical and mission<br />

important services that rely on each other.<br />

From the integration infrastructure point of view (vs. the application point of view), to the<br />

maximum extent reasonable, a common approach is desired for configuring applications<br />

and data stores into the enterprise environment. When an application interface is initiated<br />

(adaptor or services), it needs to understand the context, environment, and basic<br />

configurations.<br />

Exposure of functionality (application or databases) that enables an application or database<br />

to conduct transactions (CRUD) with the target.<br />

The process of pulling content from a variety of sources and presents it to the user in a<br />

unified format<br />

The ability to create and maintain the rules for loading content and annotation of the<br />

content to maintain consistancy for delivery across channels<br />

The ability to bring content, both structured and unstructured into a document template<br />

Provides the services for loading content and descriptors into the content management<br />

system and documenting the content with additional information to support structured<br />

queries.<br />

The ability to create and maintain the information that is displayed in an interface or into a<br />

hard copy publication for use by customers, employees and other consumers of the<br />

information, and the ability to provide a consistent set of information across multiple<br />

communications channels<br />

The ability to create a packaged view on the content that is available to view by consumers<br />

in any channel (e.g. a printed catalog, a portal, or a sales flyer)<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 96


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Content Relationship<br />

Management<br />

Data Access<br />

Data Aggregation<br />

Data Analysis<br />

Data Consolidation<br />

Data Distribution<br />

Management<br />

Data Entry<br />

Data Exploration<br />

Data Export<br />

Data Filtering<br />

Data Flow Orchestration<br />

Data Import<br />

Data Landscape Modeling<br />

Data Life-Cycle Management<br />

Data Management<br />

(Structured)<br />

Data Management<br />

(Unstructured)<br />

Data Mapping Rules<br />

Data Mining<br />

Data Movement<br />

Data Notification<br />

Data Replication<br />

Data Replication<br />

Management<br />

Data Service Discovery<br />

Data Service Registration<br />

Data Store Integration<br />

Description<br />

Manage the rules that link rich content (text, video, image, …) to a product template<br />

The ability to reach into organized data repositories and retrieve the information that is<br />

useful to answer the query that is being asked<br />

The ability to move (or link) data from many systems into a meaningful single repository<br />

(physical or virtual) to allow data mining<br />

The ability to look at each piece of data in context and determine the quality of the data<br />

and the value of the data to the enterprise<br />

Bringing data from several databases instances together into a single instance using a key<br />

structure between the databases<br />

The ability to create and maintain rules about what data will be sent to which locations and<br />

what the restrictions are on the sending (or receiving) of the data<br />

The ability to enter data via an interface (e.g. keyboard, microphone, scanner, etc) into a<br />

digital format for storage in an information system<br />

The ability to create parameters for data mining. Data mining is the collection of large<br />

amounts of data from one or more repositories. Once a useful connection is developed, the<br />

resulting rules are moved to production data mining<br />

The ability to move data out of a structured data store<br />

Filter out certain data from the local applications during selection. The service will use role<br />

definitions to identify the receiver user of the data and to filter from the local application<br />

on this basis.<br />

To define and manage and monitor complex data flows across the system.<br />

The ability to bring data into a structured data store<br />

Modeling of local and master data management application and system landscape (logical<br />

and technical).<br />

Maintain and delete services with a private or public registry during the full lifecycle of the<br />

service (creation, maturation, aging, retirement).<br />

Storage of structured data is normally within a database management system (DBMS),<br />

often a Relational Database Management System.<br />

The ability to create and maintain document and image stores which are organized in a<br />

fashion to allow a user with some familiarity to retrieve the right documents<br />

Mapping rules between master data management object model and the local application<br />

obejcts models. Input for Inbound and Outbound Mapping.<br />

Data Mining is the specific investigation of data in a warehouse looking for new and useful<br />

connections that will provide insight into marketing and other activities.<br />

The ability to move data from one repository to another repository in an automated and<br />

scheduled fashion<br />

Signalize an event to a user in the course of the master data management process.<br />

The ability to replicate changes in data to various identical data stores either local and/or<br />

distributed<br />

Creation and maintenance of the rules that allow for orderly replication of data from both<br />

un-tethered systems and enterprise systems<br />

To discover existing data management services.<br />

To register in a private or public registry during the full lifecycle of the service.<br />

The ability to transform data at the transaction level for movement of the transactions or<br />

records between two or more structured data stores<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 97


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Data Transformation<br />

Data Update<br />

Data Validation<br />

Data Warehousing<br />

Database Management<br />

Decision Support<br />

Defined Management<br />

Reports<br />

Delay Notification<br />

Digital Media Production<br />

EDI<br />

EIS (Executive Information<br />

System)<br />

Electronic Publishing<br />

Encrypted Data For<br />

Communication<br />

Encrypted Data For Storage<br />

Description<br />

The ability to change the format of the data elements from one system to support the<br />

operation on those data elements by another system or for delivery to another system or a<br />

user (e.g. changing Euros to dollars, or English to Chinese, or taking a short integer and<br />

making it an integer)<br />

Services for creating, updating and deleting data, whether the data is retained by an<br />

application, persistent data store or some other means. These services are responsible for<br />

ensuring updates to this data are performed in accordance master data management<br />

services, including data replication performed for performance reasons. The quality of the<br />

data and confidence level of the accuracy of the data is indicated. The golden record will<br />

have a quality of data measure while an unsanctioned copy would be expected to have a<br />

much lower data quality rating. Regarding data currency, there is typically a metadata field<br />

that gives an indication of either when the data was updated (time stamp) or how long<br />

since the data has been updated (age indicator).<br />

Data Validation Services are both those services tht allow data validation within a database<br />

management system or with external services – for example reference data or external<br />

services such as Postal Address Files (PAF)<br />

The ability to combine disparate data from disparate systems into a single data store with<br />

valid relationships for the purposes of data mining and reporting. Normally done overnight<br />

or once a week to give a historical view<br />

Secure, structure, maintain, log and provide access to electronic data in support of<br />

distributed and or localized processing<br />

Maintenance and summarization of data using pre-determined rules to provide information<br />

supporting rapid decision making.<br />

This service includes the generation of defined reports in either electronic or hard copy<br />

(e.g. job log reporting or site statistical reporting.)<br />

This service is responsible to notify the consumer through a channel (might be a prefered<br />

channel) of delay in regards of one or multiple services he is "registered" to (like a flight<br />

delay for instance).<br />

The ability to create digital content for display to an audience (e.g. employee training, sales<br />

promotion, professional production) the content could be video, audio, textual, etc<br />

The ability to use exchanges standards for moving data between systems or enterprises in<br />

electronic form. The standards include but are not limited to OFX, UNEDIFACT, etc.<br />

Executive Information System (EIS) software component provides you with a powerful, yet<br />

simple tool that allows you to view and analyze key factors and performance trends in the<br />

areas of sales, purchasing, production, and finance. The executive information system<br />

allows you to see both summary and detail level data. You can display summarized data<br />

that reflects the overall status of your enterprise. EIS spotlights areas that need attention<br />

before situations become critical and costly by highlighting key performance indicators. You<br />

can use drill-down capabilities to trace problem areas to any level.<br />

The ability to create complex compound documents for distribution either in electronic<br />

form or in hard copy - document templates may be setup to be automatically completed<br />

with component data on a scheduled basis<br />

Encryption of data within the boundaries of a communication method. This would cover all<br />

of the transport methods including those that use a persistent data store such as the file<br />

storage mechanism found in many store and forward paradigms while still clearly<br />

delineating the boundaries between a persistent data store and the transport mechanism.<br />

Encryption of data within data repositories. This covers the encryption of data governed by<br />

applications using file system and database formats as well as other persistent data stores<br />

not associated with data transport mechanisms.<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 98


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Enterprise Rollback<br />

Event Scheduling Service<br />

Exception Handling<br />

Extract/Transform/Load<br />

Extraction<br />

Fee Management<br />

File Services<br />

File Sharing<br />

Global Setting Management<br />

Governance Services<br />

<strong>Grid</strong><br />

<strong>Grid</strong> Management<br />

Implementation And<br />

Controls Set-Up<br />

Inbound Data Mapping<br />

Indexing & Referencing<br />

Information Integration<br />

Information Management<br />

Description<br />

The ability to rollback an update or change to information contained in multiple systems<br />

and databases in a coordinated and automated fashions<br />

The ability to create and maintain a schedule of events that should be automatically<br />

intiated and terminated in the enterprise<br />

From an integration infrastructure point of view, it is helpful if exceptions are presented in<br />

a consistent manner. Exceptions can be divided into at least two categories: system and<br />

functional. Systems exceptions are those generated as the result of program and/or<br />

hardware system failure. Functional exceptions are those generated as the result of data,<br />

business process, or logic errors. Each category can be further classified as fatal, warning,<br />

and information only. This service is also often linked to the enterprise system<br />

management and monitoring service for process.<br />

Services to extract data from existing data sources, transform the data (into the required<br />

input format) and then load the data, in a highly efficient manner, into the destination<br />

database.<br />

Mechanisms for transferring relevant data from local systems to the master data<br />

management environment. Master data instances are retrieved from the local systems.<br />

Selection is based either on predefined rules or based on the authorization level of the<br />

user.<br />

Assessment of rates and fees required for an application<br />

Maintain and provide access to files in a file system<br />

The ability to allow and restrict users and systems access to specific unstructured<br />

documents with in the enterprise based on rules, permissions, and authorization<br />

The ability to create and maintain the overall setting for all users of a service or for how the<br />

service will behave<br />

To manage the life cycle of a data items; Define and track chain of custody, versioning, etc.<br />

This capability provides the necessary checks before a message is published, during system<br />

integration and also on a continuing basis for B2B situations. Validation rules on message<br />

syntax, data integrity, and business logic conformance can be developed and implemented<br />

as a service to be executed by the adaptor layer. Any exceptions raised by this service will<br />

determine whether the data can be published or not.<br />

The ability to create a virtualized server farm, where services run based on rules that<br />

determine how many resources are devoted to each service.<br />

The ability to create and maintain the rules for the prioritization of use of the resources by<br />

the rules<br />

Configuration, Set-up of seed data, business rules , business defined criteria that govern a<br />

service or application<br />

Association of meta data definitions and conversion rules between local application data<br />

models and the master data management data model.<br />

The Indexing & Referencing (I&R) service maps application specific identifiers to and from<br />

global identifiers at each interface. It generates unique identifiers for messages and/or<br />

objects for canonical message data and is responsible for storing the transformation<br />

mappings persistently. These identifiers establish a unique reference between an<br />

application message and its corresponding canonical message data, thus enabling the<br />

decoupling of sources of data from consumers of data.<br />

The ability to bring information into a single view for data mining or business analysis<br />

The ability to manage the information in the enterprise across all platforms and services to<br />

maintain the health of the data stores<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 99


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Job And Process Queue<br />

Management<br />

Job Restart<br />

Knowledge Indexing<br />

Knowledge Repository<br />

Knowledge Searching<br />

Management Reports<br />

Management & Monitoring<br />

Master Data Management<br />

Services<br />

Message Creation<br />

Message Execution<br />

Message Explosion<br />

Message Queue<br />

Messaging Persistence<br />

Metadata Management<br />

Modeling<br />

Description<br />

Job queue management functions - management of the machine assets that are assigned to<br />

a specific job or process, including launch and termination time, priority slices on hardware,<br />

prioritization of access to data stores, spawning additional copies of processes and<br />

trimming the resources that are allocated to the process as higher priority processes enter<br />

the queue<br />

Restart of an automated processing job after a failure has occurred. Either restart from the<br />

beginning of the job, or from an identified restart point.<br />

The ability to index the content of unstructured knowledge objects, both within the<br />

enterprise and in locations in the enterprise and the extended partner network for future<br />

query<br />

The ability to consolidate key unstructured documents from many sources, including<br />

individual user devices into an enterprise data store, to provide a higher level of availability<br />

and consistency to the queries of the authorized users<br />

The ability to query one or more knowledge indexes for information that is relevant to the<br />

query being performed, normally the service includes the ability to rank the results based<br />

on the match to the query<br />

This service includes the generation of defined and ad-hoc Management reports.<br />

A middleware platform is often linked to an enterprise system management tool, but now<br />

done using consistent semantics. Systems and/or functional exceptions that require the<br />

attention of appropriate people can be sent electronically. Related information is logged<br />

for auditing, diagnosing, processing, and manual interventions.<br />

A system of record is an information storage system which is the data source for particular<br />

data elements and information sharing sets (e.g., message payload). A service should only<br />

be allowed to modify items for which it is the system of record. To achieve the desired<br />

benefits of COTS, data replication will be unavoidable (vs. customizing off-the-shelf<br />

packages to obtain data from a central database). Therefore, the integration infrastructure<br />

must ensure that there is only one system of record for each piece of information at any<br />

given time. It is possible to dynamically change the system of record via chain of custody<br />

management, but this ability may not be worth the tradeoff of increased integration<br />

infrastructure design and implementation complexity.<br />

Creation of a machine readable header to wrap information in, so that it can be transmitted<br />

between devices on the network<br />

Identifies the message types and formats the incoming message. Common Service that<br />

passes managing the steps needed to get a message from source to destination. Uses<br />

Messaging, Transaction, Network and/or Process Management services.<br />

The ability to automatically route a message to more than one internal service or addressee<br />

A facility that ensures that a message is delivered to its target, includes message ordering<br />

and prioritization.<br />

This capability provides for archiving the messages for auditing, workflow, and business<br />

intelligence purposes. Typical integration solutions support the internal needs for message<br />

persistence for auditing and workflow, but may not have a way to provide business<br />

intelligence on top of messaging. Message persistence, in conjunction with the Indexing<br />

and Referencing service, are fundamental to establishing event histories and reporting<br />

capabilities that transcend individual systems.<br />

Mechanisms for the configuration and maintenance of predefined settings for the master<br />

data objects, application landscape, and master data object mappings/routing. It has<br />

services to model and define procedures and rules.<br />

Setup and utilization of complex analytics that will automatically review records, based on a<br />

set of rules to determine trends in the records that can be displayed to users<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 100


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Multi-Media<br />

Multi-Media Chat<br />

Multi-Tasking<br />

Multiprocessing<br />

OLAP (On-Line Analytical<br />

Processing)<br />

OLTP (On-Line Transaction<br />

Processing)<br />

Operational Data Store<br />

ORB (Object Request Broker)<br />

Platform Management<br />

Portal Management<br />

Portal Page Creation<br />

Portal Pages Framework<br />

Purging<br />

Query Management<br />

Recovery<br />

Replay<br />

Resource Adapter<br />

Restart Management<br />

RFID<br />

Roll Back<br />

Schedule<br />

Searching Directory<br />

Description<br />

Integrated graphics, audio, video, and text<br />

The ability to use text, video, audio and other media formats for on-line discussions and<br />

collaboration in near real time<br />

The ability to have a single device handle multiple services simultaneously thru a single<br />

physical pipeline<br />

The ability to break up a stream of work and have it handled across a number of physical<br />

devices<br />

Decision support software allowing the user to quickly scrutinize information summarized<br />

into multidimensional views and hierarchies. OLAP included the use of multidimensional<br />

models to represent complex data relationships, using “slice and dice” to look at<br />

information from different viewpoints.<br />

The ability to take records from users and services one record at a time, provide validation,<br />

route error condition messages back to the creator and store the valid transactions or<br />

invalid transactions with error messages in a structured data store<br />

The ability to create and maintain information across traditional applications and data<br />

stores in a single data store to support use of the data by multiple systems. An ODS is an<br />

operational version of a data warehouse and is normally up to date with the movement of<br />

data in the enterprise<br />

The ability to orchestrate the services request for information from other services or data<br />

stores and manage the process of the exchange<br />

The ability to monitor and manage the hardware platform the infrastructure is built upon<br />

The Management activities of the Portal Application, includes selection of standard alerts,<br />

indexing and monitoring of criteria (based on set-up). Also includes capabilities such as<br />

caching and pooling.<br />

The capability to build Portal Pages based on either Framework Templates or algorithm.<br />

These pages will be served to the various channels and may utilize common services.<br />

The templates provided within Portal Products to assist in the formulation of consistent<br />

look and feel for Portal Content Pages<br />

The process of verification of data on archival media and the subsequent removal of data<br />

from the primary storage media<br />

Handling all requests for information or data from a specific data store - requests can be<br />

handled on a priority basis and they can be interleaved with other processes based on<br />

assigned priorities<br />

Transfer of information from a backup media to a specific system with a specific<br />

configuration for operation then loading it with a specific set of data based on an agreed to<br />

time and date<br />

The reinstating of an event upon failure<br />

Prepackaged modules that provide connectivity and or transformation between<br />

applications and databases.<br />

The ability to determine the state of an ICT process and if it has stopped, return the process<br />

to operation from the point it stopped at, or at the beginning of the current step or record<br />

Locating and identifying packages by utilization of location device(s)<br />

Retraction database changes to a specific previous date and time or to the beginning of a<br />

logical transaction<br />

Time-based execution of a formalized chain of master data management events.<br />

The querying of Portal databases to find data (e.g. users, groups, authorizations) based on<br />

the search criteria, from the Directory<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 101


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Service<br />

Searching Other Databases<br />

Semantic Model<br />

Management Services<br />

Staging<br />

State Management<br />

System Directory Services<br />

System Management<br />

Tracking<br />

Transaction Controls<br />

Transaction Management<br />

Transaction Monitoring<br />

Transaction Rules<br />

Trigger Workflow<br />

Version Management<br />

Voice Input Processing<br />

Workflow Services<br />

Description<br />

The querying of other databases to find data (e.g. media, information) based on the search<br />

criteria, from the Portal Product<br />

To ensure semantic consistency across all interfaces independent of technologies employed<br />

and vendor products used, these services enable use of artifacts (e.g., schemas for<br />

messages, schemas for persistent data stores, etc.), derived from the semantic model<br />

across all nodes and all layers.<br />

Store & forward master data instances across its entire life-cycle.<br />

Determine the status of an master data instance being processed and initiate and<br />

determine the workflow based on this status.<br />

The ability to provide system to system addressing in the network to allow users and<br />

services to connect to authorized services and authenticate<br />

Management of the computing platforms including: load monitoring, capacity, software<br />

distribution, and configuration control of the desktop systems and servers<br />

Service to analyze the audit trail in order to reconstruct past events.<br />

Configuration, Set-up of seed data, business rules, business defined criteria that govern the<br />

ERP General Ledger Module.<br />

Processing of data across multiple databases.<br />

Monitoring of the transaction to determine if it is successful or not (passes message back to<br />

Message Execution Service). Includes the use of two phased commits, multiple targets and<br />

distributed transactions.<br />

Rules specific to the target databases e.g. cascade update, two phase commit.<br />

A call to a workflow component when user intervention is required for an event (within an<br />

event flow).<br />

Manages the various version of rich content, check-in, check-out, etc.<br />

Conversion of audio information to digital information that can either be recorded as<br />

textual data, records, or machine commands<br />

The set-up and running of processes to control document flows including escalation, email<br />

notification, task management, prompts and reminders<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />

Appendix • 102


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix D. Roadmap & Maturity Model<br />

Policy Timeline<br />

Figure 47 depicts a typical policy timeline for a California utility. Each utility should employ a similar<br />

diagram to identify deadlines set by federal, state and local regulatory and legislative bodies. This<br />

timeline provides high level input to the utility <strong>Smart</strong> <strong>Grid</strong> development roadmap.<br />

Figure 47 - California <strong>Smart</strong> <strong>Grid</strong> Policy Timeline (Southern California Edison, 2010)<br />

Pursuing the <strong>Smart</strong> <strong>Grid</strong> Vision<br />

A high-level development roadmap for the smart grid identifies the technologies a utility should plan<br />

to pursue over the course of the next two decades in order to make its smart grid vision a reality. The<br />

smart grid will evolve in complexity and scale over time as the richness of systems functionality<br />

increases and the reach extends to greater numbers of intelligent devices.<br />

Most utilities will create and follow development roadmaps, which tend to have several major stages.<br />

Within each development roadmap stage, there are two activity portfolios to be managed<br />

simultaneously. The smart grid deployment project portfolio consists of smart grid technologies<br />

commercially ready for deployment. The technology evaluation portfolio includes initiatives to<br />

identify, evaluate, and test emerging technologies expected to be deployed at a later stage. Figure 48<br />

illustrates the distinction between these two portfolios in terms of technology maturity over time.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 103


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 48 - <strong>Smart</strong> <strong>Grid</strong> Project Portfolios as a Function of Maturity (Southern California Edison, 2010)<br />

Technology evaluation portfolio projects fall into the Leading Edge areas of the maturity curve. These<br />

projects require further evaluation of emerging technologies to better understand the capabilities such<br />

technologies could contribute to the smart grid vision, their progress towards technical maturity, and<br />

the corresponding value that they might unlock.<br />

<strong>Smart</strong> grid deployment portfolio projects, on the other hand, involve the planning and execution of<br />

deployment plans for commercially available smart grid technologies. Although these technologies<br />

have crossed the chasm of the maturity curve, given the urgency of state and national policy goals they<br />

increasingly fall within the Early Majority or later areas of curve. Historically, most utilities have<br />

preferred to adopt technology later in the maturity lifecycle, allowing for greater confidence in<br />

implementation and operation. Earlier adoption and adaption indicates that significant project risks<br />

could be substantially mitigated through an effective technology evaluation process<br />

A four stage roadmap structure is recommended for smart grid transformations. In this model, the four<br />

stages of the smart grid development roadmap and high level plans for deployment and technology<br />

evaluation projects to be included within each stage are:<br />

Stage 1: Foundation (past work)<br />

Comprised of already completed foundational work for the deployment of advanced measurement and<br />

control systems, this is a preliminary period where many utilities get early experience with new<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 104


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

technologies such as wide-area measurement and control systems - smart meter deployments were<br />

initiated by a number of utilities during this stage.<br />

Stage 2: Inform and Automate (near-term)<br />

In this stage most utilities focus on the following areas:<br />

Evaluation of energy storage<br />

Integration of renewable and distributed energy resources<br />

Development and interoperability testing of home area network devices and vehicle charging<br />

equipment<br />

Ongoing development of interoperability and cyber-security standards<br />

Electric system studies and engineering analysis regarding operational impacts from dynamic<br />

resources, bi-directional distribution flows and new operating paradigms<br />

Workforce safety and productivity technologies<br />

A number of North American <strong>Smart</strong> <strong>Grid</strong> pilot projects, many funded by the American Recovery and<br />

Reinvestment Act (ARRA), will commence during this period. Efforts to educate the general public on<br />

<strong>Smart</strong> <strong>Grid</strong> topics should also gain traction during this time.<br />

Stage 3: Interactive (mid-term)<br />

This stage focuses on technologies that leverage prior investments and involves retrofit work. The aim<br />

is to begin the process of building <strong>Grid</strong> 2.0. The anticipated evolution from <strong>Grid</strong> 1.0 to <strong>Grid</strong> 2.0 is<br />

depicted in Figure 49 for a variety of grid characteristics. <strong>Grid</strong> 2.0 fully automates the energy delivery<br />

system across the entire value chain with increased interactions among smart grid devices, the utility,<br />

and customers. It has both “hard grid” assets (advanced energy storage, super-conducting equipment),<br />

and “soft grid” assets (next-generation computing and analytics systems) to glean the full value of the<br />

new grid for utility customers. Several documents, including <strong>Grid</strong> 2.0: The Next Generation (Willis,<br />

2006), suggest <strong>Grid</strong> 2.0 will be fully decentralized. By 2030, a highly interactive and hybrid grid will<br />

include large central resources and substantial decentralized supply and demand resources. This is<br />

analogous to 2011 hybrid information networks linking large centralized data centers, cloud<br />

computing, highly distributed personal computing, and smart phones.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 105


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Figure 49 - <strong>Grid</strong> 1.0 Evolution to <strong>Grid</strong> 2.0<br />

This renewed electric system will enable seamless integration of large renewable and distributed<br />

generation resources. It will also facilitate the integration of energy storage technologies to support<br />

state and federal legislation and policy goals such as greenhouse gas reductions, Renewable Portfolio<br />

Standard (RPS) and electric transportation initiatives. <strong>Grid</strong> 2.0 incorporates the next generation of<br />

broadband wireless and field area telecommunications technologies to support high speed, low latency<br />

information exchange among highly distributed devices. <strong>Smart</strong> grid efforts will merge advanced data<br />

analytics and intelligent systems into existing grid control systems, resulting in a complex system-ofsystems<br />

to provide integrated grid control and ubiquitous, real-time grid-state information. As a result,<br />

opportunities will emerge to reliably link customer demand response and other smaller distributed<br />

resources into wholesale market operations with the requisite ability to coordinate operational dispatch<br />

between wholesale market objectives and distribution grid objectives.<br />

Stage 4: The Intuitive and Transactive <strong>Grid</strong> (long-range)<br />

The 2030 decade will see continued deployment of <strong>Grid</strong> 2.0 capabilities across most utility systems and<br />

the introduction of highly distributed intelligent controls involving machine-to-machine transactions.<br />

This stage of the smart grid development roadmap assumes full convergence of information and<br />

energy systems, as well as continued breakthroughs in computing architectures, cyber-security,<br />

internet technologies, autonomous multi-agent control systems, artificial intelligence applied to electric<br />

system operations, wireless telecommunications, energy storage, power electronics, energy-smart<br />

consumer devices, consumer information technology and sensing technologies. Results should include<br />

wider deployments of distributed computing technologies for faster system response times, the<br />

integration of many more sensory and control nodes at the distribution and customer levels, and the<br />

ability to manage and precisely react to supply and demand imbalances at the micro level or through<br />

aggregation at any level or nodal point across the transmission and distribution grids.<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 106


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Maturity Model<br />

To move forward with a smart grid transformation, a utility should assess its current state and then<br />

define its own roadmap and strategy for achieving the desired functionalities. This section presents an<br />

industry-standard methodology to help utilities plan smart grid implementation, prioritize options,<br />

and measure progress.<br />

The <strong>Smart</strong> <strong>Grid</strong> Maturity Model (SGMM) was developed by electric power utilities for use by electric<br />

power utilities. It is under the stewardship of the Software Engineering Institute at Carnegie Mellon<br />

University. The SGMM is a framework for understanding the current state of smart grid deployment<br />

capabilities within an electric utility. It also serves as a context for establishing future strategies and<br />

work plans pertinent to smart grid implementations. The model is comprised of eight domains, each<br />

containing six levels of maturity.<br />

Implementation of a <strong>Smart</strong> <strong>Grid</strong> involves major technological transformations to enable seamless<br />

communications among grid components and systems to fulfill the required capabilities. Electric<br />

utilities’ executives and senior leaders must understand the potential impacts these technological<br />

transformations will have on their existing organizational structure. This is critical because:<br />

1. A typical utility ICT infrastructure is currently somewhere between The Silo <strong>Architecture</strong> and the<br />

Integration using Enterprise Services Buses in the range of System-of-Systems Design patterns<br />

(Appendix A),<br />

2. To satisfy long-term <strong>Smart</strong> <strong>Grid</strong> capabilities, a utility must move to an architecture allowing any<br />

system to interact with any other system, and<br />

3. Fundamental changes to how a utility operates are necessarily disruptive.<br />

Utilities can use their SGMM level assessment to start discussions among their functional domains on<br />

the potential organizational transformations needed to ensure <strong>Smart</strong> <strong>Grid</strong> success. It also provides a<br />

context for the new technologies in terms of prosumer energy control, and utility grid efficiency<br />

improvements for cost containment.<br />

For more information about the <strong>Smart</strong> <strong>Grid</strong> Maturity Model, the reader is encouraged to visit the<br />

Software Engineering Institute website: http://www.sei.cmu.edu/smartgrid<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 107


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NOTES<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Roadmap & Maturity Model<br />

Appendix • 108


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix E. Glossary of Terms<br />

The <strong>Smart</strong> <strong>Grid</strong> Today glossary (<strong>Smart</strong><strong>Grid</strong>Today) is an additional source for the quizzical reader,<br />

should any desired acronym or term not be in Table 27.<br />

Table 27 - Glossary<br />

Term<br />

Meaning<br />

1 GigE Gigabit Ethernet – see BEC<br />

AAA<br />

Authentication, Authorization, Accounting - acronym used in computer/information security to describe<br />

protocols supporting these attributes (RADIUS, Diameter, TACACS, etc.)<br />

AC<br />

Alternating Current – electric power in which the movement of electric charge periodically reverses<br />

direction. See DC.<br />

ACL<br />

Access Control List - typically a list of permissions attached to an object in a computer file system<br />

ADR<br />

Automated Demand Response - the ability to manage customer consumption of electricity in response to<br />

supply conditions<br />

AMI<br />

Advanced Metering Infrastructure - electric utility equipment needed to install, use, and manage <strong>Smart</strong><br />

Meter with real-time sensors, power outage notification, and power quality monitoring<br />

BAAM<br />

Behavioral Awareness and Monitoring - heuristics used to detect abnormal or threatening human<br />

behavior patterns<br />

BEC<br />

Gigabit Ethernet Channel – a communications channel for Gigabit Ethernet (GbE or 1 GigE) technologies<br />

for transmitting Ethernet frames at a rate of a gigabit per second<br />

BP<br />

Basic Profile - see WS-I BP<br />

BPEL<br />

Business Process Execution Language - an OASIS standard for specifying business process actions via web<br />

services. BPEL processes export and import information exclusively through web service interfaces (also<br />

known as WS-BPEL)<br />

BRE<br />

Business Rules Engine - a software system executing one or more business rules in an ICT production<br />

environment.<br />

CDM<br />

Canonical Data Model - a design pattern used to communicate between different data formats<br />

CEA<br />

Customer Experience Analytics - software used to identify and analyze customer behavior patterns within<br />

and across multiple access points.<br />

CEP<br />

Complex Event Processing - a computing technique used to process action messages from all<br />

organizational layers by identifying those most meaningful, analyzing their impact, and taking subsequent<br />

action in real time<br />

Choreography See Process Choreography<br />

CIM<br />

Common Information Model - an electric power industry standard officially adopted by the IEC to allow<br />

application software information exchange<br />

CIP<br />

Critical Infrastructure Protection - the preparedness and serious incident response involving the critical<br />

infrastructure of a region or nation<br />

CLI<br />

Command-line interface - provides interaction with software by typing commands to perform specific<br />

tasks (instead of WIMP - see GUI)<br />

Comms Communications – this substitution is widespread in casual conversation and technical writing<br />

COMTRADE COMmon format for TRAnsient Data Exchange for power systems - an IEEE file format for oscilloscope<br />

data.<br />

COTS<br />

Commercial Off-The-Shelf - computer systems developed and marketed by commercial software vendors<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 109


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

Meaning<br />

DA<br />

Distribution Automation – a broad set of capabilities in the utility distribution system, including control<br />

center-based SCADA, distribution management system, substation automation, primary and secondary<br />

network automation, associated smart controls, etc.<br />

DC<br />

Direct Current – electric power in which the electric charge flows in one direction. See AC.<br />

DER<br />

Distributed Energy Resource – a small energy source, typically producing power near where the power is<br />

used (very little power transmission or distribution between generator and power consumer)<br />

DMS<br />

Distribution Management System - a system used by electric utility grid operators to manage distribution<br />

system performance<br />

DNP3<br />

Distributed Network Protocol - communications protocol used between process automation components<br />

(used by SCADA systems)<br />

DoE<br />

U.S. Department of Energy - a Cabinet-level U.S. government department with executive authority on<br />

energy and nuclear material handling policies<br />

DR<br />

Distributed Resource – see DER<br />

DSM<br />

Demand Side Management - the modification of consumer demand for energy through financial<br />

incentives, education, electronic devices, and other means (also known as Energy Demand Management)<br />

EDI<br />

Electronic Data Interchange - the structured transmission of data between organizations by electronic<br />

means.<br />

EDM<br />

Energy Demand Management - see DSM<br />

EIM<br />

Enterprise Information Management - optimizes use of information within organizations, for instance to<br />

support decision-making or day-to-day operational processes requiring availability of knowledge by<br />

managing information on an enterprise level.<br />

EIS<br />

Executive Information System - a type of information system used to facilitate and support the decisionmaking<br />

needs of senior executives<br />

EMS<br />

Energy Management System - a system of computer-aided tools used by electric utility grid operators to<br />

manage generation/transmission system performance<br />

ESB<br />

Enterprise Service Bus - a software architecture construct with fundamental services for complex<br />

architectures via an event-driven and standards-based messaging engine<br />

ESM<br />

Enterprise Semantic Model - the logical representation of enterprise information assets used to manage<br />

or facilitate business processes.<br />

FACTS<br />

Flexible AC Transmission Systems – application of solid-state switches, coupled with capacitors, used to<br />

simultaneously regulate transmission voltages, fine-tune reactive power and remove noise from the AC<br />

signals. FACTS are important enablers of variable energy generators (wind, solar).<br />

FAN<br />

Field Area Network – a communications network typically with wide geographical coverage and low to<br />

medium bandwidth, depending on the needs of specific use cases<br />

FIPA<br />

Foundation for Intelligent Physical Agents - an IEEE standards organization developing and setting<br />

computer software standards for heterogeneous, interacting agents and agent-based systems<br />

FIPS<br />

Federal Information Processing Standards (FIPS) Publications - a series of documents for the U.S. Federal<br />

Publications government issued by NIST<br />

Firewall Device or set of devices controlling propagation of network transmissions based upon a rule set.<br />

FISMA Federal Information Security Management Act of 2002<br />

FLISR<br />

Fault Location, Isolation and Services Restoration<br />

GbE<br />

Gigabit Ethernet – see BEC<br />

GDA<br />

Generic Data Access - an IEC 61970-40X GID interface used for model management, access, and update<br />

distribution<br />

GES<br />

Generic Events and Subscriptions - an IEC 61970-40X GID interface used for pub/sub of generic XML<br />

messages<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 110


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

GID<br />

GOOSE<br />

<strong>Grid</strong> 2.0<br />

GSE<br />

GSSE<br />

GUI<br />

HAN<br />

HEC<br />

HSDA<br />

HVDC<br />

ICT<br />

IEC<br />

IED<br />

IEEE<br />

Internet<br />

IP<br />

IPS<br />

IRM<br />

IRM<br />

IT<br />

ITU-T<br />

IVR<br />

JPA<br />

JSON<br />

MAC<br />

Meaning<br />

Generic Interface Definition - a set of common services used for enterprise integration by utilities; part of<br />

IEC 61970 standard<br />

Generic Object Oriented Substation Events - control model mechanism to package any data format into a<br />

data set and transmit within 4 millisecond - one of two subdivisions of GSE<br />

See <strong>Smart</strong> <strong>Grid</strong><br />

Generic Substation Events - a control model defined by IEC 61850 providing a fast and reliable mechanism<br />

to transfer event data over entire substation networks<br />

Generic Substation State Events - an extension of event transfer mechanism exchanging only status data<br />

using a status list (string of bits) rather than a GOOSE dataset<br />

Graphical User Interface - allows interaction with an electronic device through the use of images (utilizes<br />

WIMP instead of CLI)<br />

Home Area Network - communications network for customer's home - see PAN<br />

HDMI Ethernet Channel – technology consolidating video, audio and data streams into a single HDMI<br />

cable<br />

High Speed Data Access - an IEC 61970-40X GID interface used for access to real-time measurement data<br />

High Voltage Direct Current – an electric transmission system using direct current for the bulk<br />

transmission of electrical power. Over long distances, HVDC is expected to be less expensive, with lower<br />

electrical losses compared to a similar alternating current system.<br />

Information and Communications Technology - an extended synonym for ICT stressing the role of unified<br />

communications in modern information technology<br />

International Electrotechnical Commission - a non-profit, non-governmental international standards<br />

organization which publishes International Standards for electrical and electronic technologies<br />

Intelligent Electronic Device - a microprocessor-based controller of power system equipment, such as<br />

circuit breakers, transformers, and capacitor banks.<br />

Institute of Electrical and Electronics Engineers - a non-profit professional association dedicated to<br />

advancing technological innovation related to electricity<br />

A global system of interconnected computer networks using IPS<br />

Internet Protocol - the principal communications protocol used for relaying packets across a network<br />

using the Internet Protocol Suite<br />

Internet Protocol Suite - the set of communications protocols used for the Internet and similar networks.<br />

Also known as TCP/IP, from two of the most important IPS protocols: the Transmission Control Protocol<br />

(TCP) and the Internet Protocol (IP)<br />

Interface <strong>Reference</strong> Model (IEC 61968-1) provides the framework for identifying information exchange<br />

requirements among utility business functions<br />

Institute of Risk Management - a leading international professional education and training body for risk<br />

management<br />

Information Technology - any microelectronics-based collection of computing and telecommunications<br />

capabilities designed to acquire, process and disseminate textual, numerical, and non-structured<br />

information. See ICT.<br />

Telecommunication Standardization Sector, part of the International Telecommunication Union (ITU)<br />

based in Geneva, Switzerland.<br />

Interactive Voice Response – technology allowing computer-human interaction through the use of voice<br />

and keypad inputs.<br />

Java Persistence API - a Java programming language framework managing relational data in applications<br />

JavaScript Object Notation – a lightweight data-interchange format<br />

Media Access Control Layer<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 111


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

Mashup<br />

ML<br />

MoM<br />

MOM<br />

MultiSpeak<br />

NERC<br />

NERC-CIP<br />

NETL<br />

NIST<br />

NISTIR 7628<br />

NRECA<br />

OASIS<br />

OFX<br />

OLAP<br />

OLTP<br />

OMG<br />

OMS<br />

OPC<br />

Orchestration<br />

OSGi<br />

OSI model<br />

P&C<br />

PAN<br />

PCC<br />

PHY<br />

PKI<br />

PLC<br />

PMI<br />

Meaning<br />

A web application that combines data and/or functionality from more than one source, sometimes called<br />

a web application hybrid<br />

Management Layer – one of four smart grid management types (Element, System, Services, <strong>Smart</strong> <strong>Grid</strong>)<br />

Manager of Managers – a smart grid construct to support distributed grid management services<br />

coordinated by a single component, called the Manager of Managers<br />

Message-Oriented Middleware – infrastructure used to send and receive messages between distributed<br />

systems.<br />

A specification defining standardized interfaces between software applications commonly used by electric<br />

utilities<br />

North American Electric Reliability Corporation - a nonprofit corporation promoting the reliability and<br />

adequacy of North American bulk power transmission<br />

See CIP<br />

National Energy Technology Laboratory - a science, technology, and energy laboratory operated by DoE<br />

National Institute of Standards and Technology - a measurement standards laboratory operated as a nonregulatory<br />

agency of the United States Department of Commerce<br />

Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security issued in August 2010 as an Interagency report (NISTIR) by the<br />

United States Department of Commerce, National Institute of Standards and Technology (NIST)<br />

National Rural Electric Cooperative Association - an organization representing over 900 electric<br />

cooperatives in the United States<br />

Organization for the Advancement of Structured Information Standards - a global consortium supporting<br />

the adoption of e-business and web service standards<br />

Open Financial Exchange - a data-stream format for exchanging financial information<br />

On-Line Analytical Processing - a business intelligence approach used to swiftly answer multi-dimensional<br />

analytical queries<br />

On-Line Transaction Processing - a class of systems used to facilitate and manage transaction-oriented<br />

applications<br />

Object Management Group - a consortium focused on modeling programs, systems and business<br />

processes<br />

Outage Management System - a computer system used to restore power by operators of electric<br />

distribution systems<br />

OLE for Process Control - an open standard used by GID<br />

See Process Orchestration<br />

Open Services Gateway initiative - a Java service platform implementing a complete and dynamic<br />

component model, characterized by "bundles" of functionality<br />

Open Systems Interconnection model - a sub-division of network communications into seven smaller<br />

parts - each layer is a collection of similar functions providing services to the layer above it and receives<br />

services from the layer below it<br />

Production and Control<br />

Premises Area Network - communications network for grid customer, more generic than HAN<br />

Point of Common Coupling – see PoCC<br />

Physical Layer - the first and lowest layer in the seven-layer OSI model of computer networking.<br />

Public Key Infrastructure - the set of assets needed to create, use and manage digital certificates<br />

Programmable Logic Controller – a small industrial computer used to replace relay logic. A PLC is similar<br />

to RTU, but is typically easier to program. RTU and PLC technology are slowly merging. See RTU for detail.<br />

Privilege Management Infrastructure - supports a strong authorization system via the management and<br />

use of privileges<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 112


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

PMU<br />

PoCC<br />

PQ<br />

PQDIF<br />

Process<br />

Choreography<br />

Process<br />

Orchestration<br />

PubsFIPS<br />

QoS<br />

RBE<br />

RDF<br />

RMS<br />

RPC<br />

RPS<br />

RTU<br />

SAML<br />

SCA<br />

SCADA<br />

SCAP<br />

SDO<br />

SDO<br />

SED<br />

SEP-2<br />

Service<br />

Choreography<br />

Service<br />

Orchestration<br />

SGAC<br />

Meaning<br />

Phasor Measurement Unit - a device designed to measure the electrical waves on an electricity grid to<br />

determine the health of the system<br />

Point of Common Coupling – the place to which a collection of DER (DR) connects to the<br />

Power Quality - the set of electrical property limits allowing electrical systems to function in their<br />

intended manner without significant loss of performance or life.<br />

Power Quality Data Interchange Format - a binary file format (specified in IEEE Std 1159.3-2003) used to<br />

exchange voltage, current, power, and energy measurements between software applications<br />

A form of service composition in which interactions between partner services are defined globally. At runtime<br />

each participant executes according to other participant behaviors with no central control<br />

The process of coordinating an exchange of information through web service interaction. Orchestration<br />

typically is guided at runtime by a central control mechanism.<br />

See FIPS Publications<br />

Quality of Service - a computing mechanism providing different execution priority rankings to different<br />

computing objects (e.g. users, destinations, applications, data types, data flows). It also can be used to<br />

guarantee a certain level of performance to a data flow<br />

Report By Exception – information is transmitted only when a pre-defined threshold or condition is<br />

reached. RBE reduces communication traffic and subsequent data handling.<br />

Resource Description Framework - a general-purpose language for representing information in the Web.<br />

Root Mean Square - a measure of the magnitude of a varying signal<br />

Remote Procedure Call - an inter-process communication allowing software to cause the execution of a<br />

procedure in another address space without coding the remote interaction<br />

Renewable Portfolio Standard – a regulatory mandate to increase energy production from renewable<br />

energy sources (wind, solar, biomass, geothermal).<br />

Remote Terminal Unit or Remote Telemetry Unit – an electronic device interfacing field devices to a<br />

distributed control system (i.e. SCADA). Similar to PLC, but typically preferred where communications are<br />

difficult. RTU and PLC technology are slowly merging. See PCL for more detail.<br />

Security Assertion Markup Language - an XML-based open standard for exchanging authentication and<br />

authorization data between security domains<br />

Service Component <strong>Architecture</strong> - a programming model for building applications and solutions based on<br />

a Service Oriented <strong>Architecture</strong><br />

Supervisory Control And Data Acquisition - industrial control systems, computerized to monitor and<br />

control commercial and infrastructure processes<br />

<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project - the <strong>Smart</strong> <strong>Grid</strong> conceptual reference model for which the<br />

SGAC is responsible<br />

Service Data Objects - a technology allowing heterogeneous data to be accessed in a uniform way.<br />

Standard Developing Organization - an organization with the scope of establishing national, regional or<br />

international engineering standards<br />

<strong>Smart</strong> Electronic Device – used interchangeably with IED (Intelligent Electronic Device)<br />

<strong>Smart</strong> Energy Profile 2.0 - an open standard for implementing secure, easy-to-use wireless home area<br />

networks to manage energy consumption<br />

See Process Choreography<br />

See Process Orchestration<br />

<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee - responsible to the SGIP for creating and refining a <strong>Smart</strong> <strong>Grid</strong><br />

conceptual reference model, including lists of the standards and profiles necessary to implement the<br />

vision of the <strong>Smart</strong> <strong>Grid</strong><br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 113


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

SGIP<br />

SGMM<br />

SIP<br />

SLA<br />

<strong>Smart</strong> <strong>Grid</strong><br />

SOA<br />

SOAP<br />

SoS<br />

SQL<br />

SSL<br />

SSO<br />

SSO<br />

STATCOM<br />

THD<br />

TLS<br />

TSDA<br />

UDDI<br />

UN/EDIFACT<br />

VAR<br />

VOIP<br />

Volt/VAR<br />

VPN<br />

VPP<br />

W3C<br />

WAN<br />

Web<br />

Web 2.0<br />

Web Service<br />

Meaning<br />

<strong>Smart</strong> <strong>Grid</strong> Interoperability Panel - a stakeholder organization administered under a NIST contract to<br />

identify, prioritize and address new and emerging requirements for <strong>Smart</strong> <strong>Grid</strong> standards<br />

<strong>Smart</strong> <strong>Grid</strong> Maturity Model – a management tool used to help plan a smart grid implementation,<br />

prioritize options, and measure progress (maintained by the Software Engineering Institute at Carnegie<br />

Mellon University)<br />

Session Initiation Protocol - an IETF-defined signaling protocol used to control multimedia communication<br />

sessions (VOIP, etc.)<br />

Service Level Agreement – a service contract formally defining expectations, usually based on response<br />

times, between a customer and a service provider.<br />

A utility power distribution grid enabled with computer technology and two-way digital communications<br />

networking.<br />

Service-oriented architecture - a set of design principles aimed toward packaging functionality as a suite<br />

of interoperable services, residing in multiple systems, and usable by many business domains<br />

Simple Object Access Protocol - a protocol specification for exchanging structured information via web<br />

services<br />

System of Systems - a collection of task-oriented or dedicated systems with pooled resources and<br />

capabilities to create a more complex 'meta-system' offering more functionality and performance than<br />

the sum of the constituent systems<br />

Structured Query Language - a database computer language designed for managing data in relational<br />

database management systems (RDBMS), and originally based upon relational algebra and calculus<br />

Secure Sockets Layer - a network protocol succeeded by Transport Layer Security (TLS)<br />

Single Sign On - a property of access control of multiple related, but independent software systems<br />

allowing a user to log in once and gain access to all systems without additional log in prompts<br />

Standards Setting Organization - an organization promulgating or maintaining standards<br />

Static Synchronous Compensator – a regulating device on AC electricity transmission networks, acting as a<br />

source or sink of reactive AC power on the electrical network. See FACTS.<br />

Total Harmonic Distortion - an inverse measurement of the fidelity of a signal to its source<br />

Transport Layer Security - a network protocol and successor to Secure Sockets Layer (SSL)<br />

Time Series Data Access - an IEC 61970-40X GID interface used for access to historical measurement data<br />

Universal Description, Discovery and Integration - a platform-independent, XML-based registry for<br />

businesses to be listed on the Internet, including a mechanism to register and locate web service<br />

applications<br />

United Nations/Electronic Data Interchange For Administration, Commerce and Transport - an<br />

international EDI standard<br />

Volt-Ampere Reactive - a unit used to measure reactive power in an AC electric power system<br />

Voice Over Internet Protocol - technology used for the delivery of voice communications and multimedia<br />

sessions over an Internet Protocol network<br />

Used to express the need for careful management of the interaction between voltage and VAR control.<br />

Virtual Private Network<br />

Virtual Power Plant – a collection of distributed generation managed by a central entity (aggregator)<br />

World Wide Web Consortium - an international standards organization for the World Wide Web<br />

Wide Area Network<br />

See WWW<br />

A loosely defined set of web applications characterized by collaboration, user-defined design,<br />

participatory information sharing, and standards-based interoperability<br />

Software designed to support interoperable machine-to-machine interaction over a network<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 114


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Term<br />

WIMP<br />

WS-BPEL<br />

WSDL<br />

WS-I BP<br />

WWW<br />

XML<br />

XSD<br />

Meaning<br />

Window, Icon, Menu, Pointing device - see GUI<br />

Web Services Business Process Execution Language - see BPEL<br />

Web Services Description Language - an XML-based construct used to characterize web services T<br />

Web Services Interoperability Basic Profile - a specification providing interoperability guidance for core<br />

Web Services specifications such as SOAP, WSDL, and UDDI.<br />

World Wide Web - a system of interlinked hypertext documents accessed via the Internet<br />

eXtensible Markup Language - a set of rules for encoding documents in machine-readable form<br />

XML Schema Definition - a set of rules to which a valid XML document must conform<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 115


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

NOTES<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Glossary of Terms<br />

Appendix • 116


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

Appendix F. Bibliography<br />

ARRA. (n.d.). American Recovery and Reinvestment Act of 2009. Retrieved March 2011, from Recovery.gov -<br />

Track the Money: http://www.recovery.gov/About/Pages/The_Act.aspx<br />

GWAC. (2008, March). Publications. Retrieved March 2011, from <strong>Grid</strong>Wise® <strong>Architecture</strong> Council:<br />

http://www.gridwiseac.org/about/publications.aspx<br />

IEC. (2003). IEC 61968-1 - Application integration at electric utilities - System Interfaces for distribution<br />

management - Part 1: Interface architecture and general requirements (Preview). Retrieved 2011, from<br />

International Electrotechnical Commission Webstore: http://webstore.iec.ch/preview/info_iec61968-<br />

1%7Bed1.0%7Den.pdf<br />

IEC. (2005). 61970-1 - Energy management system application program interface (EMS-API) - Part 1: Guidelines<br />

and general requirements (Preview). Retrieved March 2011, from International Electrotechnical<br />

Commission Webstore: http://webstore.iec.ch/preview/info_iec61970-1%7Bed1.0%7Db.pdf<br />

IEEE. (n.d.). 2030 <strong>Smart</strong> <strong>Grid</strong> Interoperability Series of Standards. Retrieved March 2011, from IEEE Standards<br />

Association: http://grouper.ieee.org/groups/scc21/dr_shared/2030/<br />

NAE. (2011). Electrification. Retrieved March 2011, from Greatest Engineering Achievements of the 20th<br />

Century: http://www.greatachievements.org/?id=2949<br />

NETL. (2007, January). <strong>Smart</strong> <strong>Grid</strong> Implementation Strategy (SGIS) - <strong>Reference</strong> Shelf. Retrieved March 2011, from<br />

NETL - the Energy lab - Where energy challenges converge and energy solutions emerge:<br />

http://www.netl.doe.gov/smartgrid/refshelf.html#White%20Papers<br />

NIST. (2010, January). NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards, Release 1.0.<br />

Retrieved March 2011, from National Institute of Standards and Technology:<br />

http://www.nist.gov/public_affairs/releases/upload/smartgrid_interoperability_final.pdf<br />

NIST. (2010, January). <strong>Smart</strong> <strong>Grid</strong>. Retrieved March 2011, from National Institute of Standards and Technology:<br />

http://www.nist.gov/smartgrid/index.cfm<br />

NIST-ITL. (2010, September). NIST - Computer Security Division - Computer Security Resource Center. Retrieved<br />

March 2011, from National Institute of Standards and Technology:<br />

http://csrc.nist.gov/publications/PubsNISTIRs.html<br />

SGIP SGAC. (n.d.). SGAC Conceptual <strong>Architecture</strong> Working Party. Retrieved March 2011, from SGiP - NIST <strong>Smart</strong><br />

<strong>Grid</strong> Collaboration Site: http://collaborate.nist.gov/twikisggrid/bin/view/<strong>Smart</strong><strong>Grid</strong>/SGIPConceptual<strong>Architecture</strong>DevelopmentSGAC<br />

SGMM. (n.d.). <strong>Smart</strong> <strong>Grid</strong> Maturity Model. Retrieved March 2011, from Software Engineering Institute |<br />

Carnegie Mellon: http://www.sei.cmu.edu/smartgrid/<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Bibliography<br />

Appendix • 117


<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />

<strong>Smart</strong><strong>Grid</strong>Today. (n.d.). Glossary of Terms and Abbreviations. Retrieved March 2011, from <strong>Smart</strong> <strong>Grid</strong> Today |<br />

The Worldwide Daily Journal of the Modern Utility Industry:<br />

http://www.smartgridtoday.com/public/department40.cfm<br />

Southern California Edison. (2010). <strong>Smart</strong> <strong>Grid</strong> Strategy and Roadmap. Retrieved March 2011, from Southern<br />

California Edison: http://asset.sce.com/Documents/Environment%20-<br />

%20<strong>Smart</strong>%20<strong>Grid</strong>/100712_SCE_<strong>Smart</strong><strong>Grid</strong>StrategyandRoadmap.pdf<br />

van Breeman, A. J. (2001). Agent-Based Multi-Controller Systems. Retrieved March 2011, from University of<br />

Twente: http://www.ub.utwente.nl/webdocs/el/1/t000001c.pdf<br />

White, A., Comport, J., & Schlier, F. W. (2005, January 17). Enterprise Information Management Is a Core<br />

Element of Your IT <strong>Architecture</strong>.<br />

Willis, R. (2006). <strong>Grid</strong> 2.0: The next generation. Retrieved March 2011, from Rebecca Willis:<br />

http://www.rebeccawillis.co.uk/downloads/<strong>Grid</strong>20TheNextGeneration.pdf<br />

© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />

Bibliography<br />

Appendix • 118

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!