Smart Grid Reference Architecture - PointView
Smart Grid Reference Architecture - PointView
Smart Grid Reference Architecture - PointView
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Smart</strong> <strong>Grid</strong><br />
<strong>Reference</strong><br />
<strong>Architecture</strong><br />
Volume 1<br />
Using Information and Communication Services to<br />
Support a <strong>Smart</strong>er <strong>Grid</strong><br />
<strong>Smart</strong> <strong>Grid</strong> realization is a utility’s journey through a series of architectures. It starts with the<br />
predominant business‐silo model with point‐to‐point interfaces, to one best described as a<br />
systems‐of‐systems integrated by shared services and infrastructure.<br />
SCE‐Cisco‐IBM SGRA Team<br />
July 14, 2011<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NOTES<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
ii
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Contents<br />
1. Executive Summary ...................................................................................................................................1<br />
2. Introduction .................................................................................................................................................2<br />
The <strong>Smart</strong> <strong>Grid</strong> Architectural Challenge ................................................................................................2<br />
3. <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> ............................................................................................................................3<br />
<strong>Smart</strong> <strong>Grid</strong> Architectural Goals and Principles ......................................................................................3<br />
From a Siloed <strong>Architecture</strong> to a Layered Services <strong>Architecture</strong> ..........................................................7<br />
4. <strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services ...................................................... 13<br />
5. <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views ............................................................................................ 14<br />
Application Services ................................................................................................................................. 16<br />
Analytics Services ..................................................................................................................................... 23<br />
Data Services ............................................................................................................................................. 29<br />
Control Services ........................................................................................................................................ 34<br />
Security Services ....................................................................................................................................... 40<br />
Communications Services ....................................................................................................................... 44<br />
Management .............................................................................................................................................. 53<br />
6. Summary .................................................................................................................................................... 59<br />
Appendix A. System of Systems Design Patterns ...................................................................... Appendix 1<br />
Appendix B. Services Classes Concepts .................................................................................... Appendix 11<br />
Applications Services ............................................................................................................ Appendix 11<br />
Analytic Services .................................................................................................................... Appendix 19<br />
Data Services .......................................................................................................................... Appendix 29<br />
Control Services ..................................................................................................................... Appendix 33<br />
Security Services .................................................................................................................... Appendix 39<br />
Communication Services ...................................................................................................... Appendix 45<br />
Management Services ........................................................................................................... Appendix 60<br />
Structural Model Framework Template ............................................................................. Appendix 65<br />
Appendix C. <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)....................................... Appendix 67<br />
Business Requirements ......................................................................................................... Appendix 67<br />
<strong>Smart</strong> <strong>Grid</strong> Business Services ............................................................................................... Appendix 76<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
iii
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
<strong>Smart</strong> <strong>Grid</strong> Cross‐Domain Foundational Services ............................................................ Appendix 86<br />
Appendix D. Roadmap & Maturity Model .............................................................................. Appendix 103<br />
Policy Timeline .................................................................................................................... Appendix 103<br />
Pursuing the <strong>Smart</strong> <strong>Grid</strong> Vision ........................................................................................ Appendix 103<br />
Maturity Model .................................................................................................................... Appendix 107<br />
Appendix E. Glossary of Terms ................................................................................................ Appendix 109<br />
Appendix F. Bibliography ......................................................................................................... Appendix 115<br />
Tables<br />
Table 1 ‐ Typical Application Specifications ...................................................................................................... 20<br />
Table 2 ‐ Applicable Application Standards ...................................................................................................... 21<br />
Table 3 ‐ Application Technology Recommendations ..................................................................................... 22<br />
Table 4 ‐ Typical Analytics Specifications .......................................................................................................... 26<br />
Table 5 ‐ Recommended Analytics Standards ................................................................................................... 28<br />
Table 6 ‐ Recommended Analytics Technology ................................................................................................ 28<br />
Table 7 ‐ Typical Data Services Specifications ................................................................................................... 31<br />
Table 8 ‐ Data Standards and Technology Recommendations ....................................................................... 32<br />
Table 9 ‐ Typical Control Specifications ............................................................................................................. 37<br />
Table 10 ‐ Recommended Control Standards and Technology ....................................................................... 38<br />
Table 11‐ Advanced Control Elements and Technologies ............................................................................... 39<br />
Table 12 ‐ Security Standards and Technology Recommendations ............................................................... 43<br />
Table 13 ‐ Typical Communications Specifications .......................................................................................... 47<br />
Table 14 ‐ Recommended Communications Standards and Technology ...................................................... 52<br />
Table 15 ‐ Recommended Management Standards and Technology ............................................................. 58<br />
Table 16 – Analytics Capability Maturity Model ........................................................................... Appendix 29<br />
Table 17 – Market Domain Business Services ................................................................................. Appendix 77<br />
Table 18 – Operations Domain Business Services .......................................................................... Appendix 78<br />
Table 19 – Service Provider Domain Business Services ................................................................ Appendix 80<br />
Table 20 – Generation Domain Business Services .......................................................................... Appendix 81<br />
Table 21 – Transmission Domain Business Services ...................................................................... Appendix 82<br />
Table 22 – Distribution Domain Business Services ........................................................................ Appendix 84<br />
Table 23 – Customer Domain Business Services ............................................................................ Appendix 86<br />
Table 24 – Security Services............................................................................................................... Appendix 87<br />
Table 25 – Communications Services ............................................................................................... Appendix 89<br />
Table 26 – Data Management Services ............................................................................................ Appendix 95<br />
Table 27 ‐ Glossary ........................................................................................................................... Appendix 109<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
iv
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figures<br />
Figure 1 ‐ GWAC Interoperability Context Setting Framework Diagram (GWAC Stack) ....................... viii<br />
Figure 2 ‐ NIST <strong>Smart</strong> <strong>Grid</strong> Framework 1.0 ....................................................................................................... ix<br />
Figure 3 – SCAP Requirements by NIST Domain ............................................................................................. ix<br />
Figure 4 ‐ Silo <strong>Architecture</strong> for EMS/SCADA and Metering/Billing Functions..............................................7<br />
Figure 5 ‐ Enterprise Service Bus <strong>Architecture</strong> ....................................................................................................8<br />
Figure 6 ‐ Converged Communication <strong>Architecture</strong> ..........................................................................................9<br />
Figure 7 – System‐of‐Systems <strong>Architecture</strong> Based on Open Standard Services ........................................... 10<br />
Figure 8 ‐ <strong>Smart</strong> <strong>Grid</strong> Conceptual Model ........................................................................................................... 14<br />
Figure 9 ‐ Layered Services Tier View ................................................................................................................ 15<br />
Figure 10 ‐ Application Services Logical Model ................................................................................................ 16<br />
Figure 11 ‐ Application Services Structural Model ........................................................................................... 19<br />
Figure 12 ‐ Analytics Logical Model ................................................................................................................... 23<br />
Figure 13 ‐ Analytics Structural Model .............................................................................................................. 25<br />
Figure 14 – Data Services Logical Model ........................................................................................................... 29<br />
Figure 15 ‐ Data Services Structural Model ....................................................................................................... 31<br />
Figure 16 ‐ Control Services Logical Model ....................................................................................................... 34<br />
Figure 17 ‐ Control Services Structural Model .................................................................................................. 36<br />
Figure 18 ‐ Security Logical Model ..................................................................................................................... 40<br />
Figure 19 ‐ Security Structural Model ................................................................................................................. 42<br />
Figure 20 – Communications Services Logical Model ..................................................................................... 44<br />
Figure 21 ‐ Communications Services Structural Model.................................................................................. 46<br />
Figure 22 ‐ Management Framework ................................................................................................................. 53<br />
Figure 23 ‐ Management Logical Model ............................................................................................................. 54<br />
Figure 24 ‐ Management Services Structural Model ......................................................................................... 56<br />
Figure 25 ‐ Silo <strong>Architecture</strong> ............................................................................................................... Appendix 4<br />
Figure 26 ‐ ESB <strong>Architecture</strong> ............................................................................................................... Appendix 5<br />
Figure 27 ‐ Adapter <strong>Architecture</strong> ....................................................................................................... Appendix 6<br />
Figure 28 ‐ Service‐Centric <strong>Architecture</strong> ........................................................................................... Appendix 9<br />
Figure 29 ‐ Dis‐aggregation of a Monolithic System ..................................................................... Appendix 12<br />
Figure 30 ‐ Functional Services Organization ................................................................................. Appendix 13<br />
Figure 31 ‐ Network Operations planning and optimization ...................................................... Appendix 14<br />
Figure 32 ‐ <strong>Smart</strong> <strong>Grid</strong> Analytics Taxonomy .................................................................................. Appendix 20<br />
Figure 33 ‐ Analytics Latency Hierarchy ......................................................................................... Appendix 26<br />
Figure 34 ‐ EIM Framework .............................................................................................................. Appendix 32<br />
Figure 35 ‐ Multi‐Controller / Multi‐Objective Design Patterns (van Breeman, 2001) ............. Appendix 36<br />
Figure 36 ‐ Control Center Functional <strong>Architecture</strong> (IEC, 2005) .................................................. Appendix 37<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
v
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 37 ‐ Hierarchical Control Design Pattern ............................................................................ Appendix 39<br />
Figure 38 ‐ Security Threats Classification ...................................................................................... Appendix 41<br />
Figure 39 ‐ Conceptual and Services Layers ................................................................................... Appendix 45<br />
Figure 40 ‐ Communication Services Layer Functions .................................................................. Appendix 50<br />
Figure 41 ‐ Transport Services Consideration Process .................................................................. Appendix 51<br />
Figure 42 ‐ Conceptual <strong>Reference</strong> Diagram for <strong>Smart</strong> <strong>Grid</strong> Information Networks ................. Appendix 52<br />
Figure 43 ‐ Management Layer Organization ................................................................................ Appendix 62<br />
Figure 44 ‐ <strong>Smart</strong> <strong>Grid</strong> Management Layers .................................................................................. Appendix 64<br />
Figure 45 ‐ Structural Model Template ............................................................................................ Appendix 66<br />
Figure 46 ‐ Communication Services Layer Functions .................................................................. Appendix 89<br />
Figure 47 ‐ California <strong>Smart</strong> <strong>Grid</strong> Policy Timeline ...................................................................... Appendix 103<br />
Figure 48 ‐ <strong>Smart</strong> <strong>Grid</strong> Project Portfolios as a Function of Maturity ......................................... Appendix 104<br />
Figure 49 ‐ <strong>Grid</strong> 1.0 Evolution to <strong>Grid</strong> 2.0 ..................................................................................... Appendix 106<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
vi
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong><br />
<strong>Architecture</strong><br />
Using Information and Communication Services to<br />
Support a <strong>Smart</strong>er <strong>Grid</strong><br />
About this document<br />
This <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> document is designed to<br />
address the challenges, concerns and questions facing smart grid<br />
architects implementing smart grid solutions for their utility. As<br />
with any reference architecture, it aims to provide a foundation<br />
for utilities in the development of their particular smart grid<br />
architectures and to serve as a guide for implementing specific<br />
features designed to make their electric grid smarter.<br />
The architects using this document most likely work within utility<br />
organizations in the areas of operations, generation, transmission<br />
and distribution, customer services, information technology, and<br />
research and development.<br />
<strong>Reference</strong><br />
<strong>Architecture</strong><br />
Wikipedia definition:<br />
A reference architecture<br />
provides a proven template<br />
solution for an architecture<br />
for a particular domain.<br />
A proven architecture is<br />
problematic due to the<br />
scale and immaturity of<br />
the smart grid domain.<br />
The reader should judge<br />
the viability of this<br />
document based upon the<br />
considerable real world<br />
experience of the SCE‐<br />
Cisco‐IBM SGRA Team.<br />
Additional audiences may include:<br />
Utility executives needing clarification on developing a coherent investment roadmap to request and<br />
secure funding to achieve their enterprise’s vision for a smarter grid.<br />
Utilities trying to transition from the specialized, targeted architectures developed for individual<br />
business units toward a more seamless, transparent architecture to be used across all business units.<br />
This architecture is to meet the requirements for optimal smart grid benefits while managing the<br />
complexities inevitably introduced by the requirements for a smarter grid.<br />
Standards organizations (SDOs, SSOs) and policy makers needing to clearly convey a smart grid<br />
vision with enough detail to be actionable by utilities, regardless of size. As utilities transition to the<br />
system‐of‐systems architectural model a number of challenges and issues will arise requiring<br />
assistance from SDOs, SSOs and state/federal policy making bodies.<br />
Vendors providing equipment and services to electric utilities, especially those companies whose<br />
products become more widely used.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
vii
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Foundation Frameworks<br />
A number of informative smart grid documents, white papers, and frameworks are available on the<br />
Internet. The following are especially relevant to this reference architecture and worthy of study:<br />
A Systems View of the Modern <strong>Grid</strong> by the National Engineering Technology Laboratory (NETL, 2007)<br />
‐ this white paper inspired many of the concepts expanded upon in subsequent publications. It<br />
identifies five primary interdependent elements desirable for a modern grid and defines those concepts<br />
including the seven smart grid principal characteristics listed in section 2.<br />
The <strong>Grid</strong>Wise® Interoperability Context‐Setting Framework by the <strong>Grid</strong>Wise® <strong>Architecture</strong> Council<br />
(GWAC, 2008) – a work that focuses on the interface between two or more interacting parties and<br />
provides a framework for discussing the integration of collaborative processes and independent<br />
automation components. It identifies eight interoperability categories defined by the framework and 10<br />
crosscutting issues applicable in every category. The categories are tagged as technical, informational<br />
or organizational, and are stacked according to their increasing level of abstraction [Figure 1].<br />
Figure 1 ‐ GWAC Interoperability Context Setting Framework Diagram (GWAC Stack)<br />
While this structure is not used to organize the reference architecture described in this document, it<br />
provides the basis for the structural models presented in the reference architectural views in section 5.<br />
The NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards by the National<br />
Institute for Standards and Technology (NIST, 2010) ‐ a conceptual model created to support the<br />
planning and organization of the interconnected networks expected in the <strong>Smart</strong> <strong>Grid</strong>. The NIST<br />
approach divided the <strong>Smart</strong> <strong>Grid</strong> into the seven domains shown in Figure 2.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
viii
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 2 ‐ NIST <strong>Smart</strong> <strong>Grid</strong> Framework 1.0<br />
In 2010 NIST commissioned the <strong>Smart</strong> <strong>Grid</strong> Interoperability Panel’s (SGIP) <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong><br />
Committee (SGAC) to lead its <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP). The SCAP working<br />
group took top‐down and bottom‐up approaches to establish a foundation for the development of<br />
smart grid business requirements.<br />
The SGAC ‘s top‐down approach involved a review of all major federal energy legislation signed into<br />
law since 2000, more than 9,500 pages. Review of these documents resulted in the identification of 400<br />
goals. The bottom‐up efforts reviewed more than 600 use cases written by a variety of industry<br />
organizations, including more than 20 systems requirement documents produced by industry working<br />
groups. The bottom‐up review produced more than 8000 business requirements for the <strong>Smart</strong> <strong>Grid</strong>.<br />
Figure 3 illustrates the distribution of the smart grid business requirements by domain. (SGIP SGAC)<br />
Figure 3 – SCAP Requirements by NIST Domain<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
ix
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
This preliminary work created 400 families of requirements covering the seven NIST domains. These<br />
high‐level business requirements (available on the NIST website) encompass the entire <strong>Smart</strong> <strong>Grid</strong><br />
from market to customer – from bulk generation to distribution. They form the basis of what the <strong>Smart</strong><br />
<strong>Grid</strong> requires from a business standpoint and to meet federal government’s energy goals. 0 provides a<br />
list of the SCAP Business Requirements and Services.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> by the P2030 Working Group (IEEE) ‐ this document, expected in<br />
the third quarter of 2011 (draft published in March 2011), will provide guidelines for smart grid<br />
interoperability, including a discussion of best practices. The P2030 guide will also provide a<br />
knowledge base addressing terminology, characteristics, functional performance and evaluation<br />
criteria, and the application of engineering principles for grid interoperability with end‐use<br />
applications and loads. At first the SCE‐Cisco‐IBM reference architecture team expressed concern on<br />
the potential overlap between the P2030 guide and this document, but after a thorough comparison of<br />
the two drafts, the consensus is that this reference architecture merely complements the P2030 guide.<br />
Whereas the P2030 Guide documents a catalog of interfaces, this document addresses the architecture<br />
and foundational services necessary to develop <strong>Smart</strong> <strong>Grid</strong> systems, interfaces, and processes.<br />
The alert reader will notice this document is entitled Volume 1. It includes a set of views on smart grid<br />
architecture largely written from the point of view of system integration. It is expected to be a useful<br />
companion to IEEE P2030. As IEEE P2030 catalogues smart grid system interfaces, the SGRA Volume 1<br />
catalogues smart grid system services. Similarly, the NIST SGCA lists elemental smart grid functions<br />
(unit operations); the NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards<br />
identifies relevant smart grid interface standards; and the GWAC Interoperability Context‐Setting<br />
Framework, as a companion to the NIST Framework, provides rigor around the concept of<br />
interoperability. Each contains more than described above, as their authors will attest, but these<br />
characterizations are helpful in framing each document in the context of the entire set.<br />
Each one of these documents is a valuable contribution to the field of smart grid architecture, and<br />
smart grid architects are strongly urged to study each of them. However, after this document was<br />
completed, the team sensed a set of architectural views was needed to tie these contributions into a<br />
unified whole that would make the SGRA actionable in both the near term and throughout the general<br />
smart grid utility transformation journey. That is why this document was labeled Volume 1, to be<br />
followed shortly by Volume 2. The Volume 2 document will synthesize the various expositions on<br />
interfaces, standards, and services, as well as measurement, data management, control,<br />
communications, and security from the above mentioned <strong>Smart</strong> <strong>Grid</strong> documents into a practical<br />
consolidated architectural guide representing how best to implement smart grids. Volume 2 will also<br />
tie together energy delivery elements of particular importance as the smart grid scales up, resulting in<br />
interactions of increasing complexity with simultaneous impact to once‐independent utility tiers.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
x
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
1. Executive Summary<br />
The <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> is intended as a template for <strong>Smart</strong> <strong>Grid</strong> architects to follow as<br />
they build <strong>Smart</strong> <strong>Grid</strong> Information and Communications Technologies (ICT) architecture for their<br />
utility, regardless of the architect’s specialty (transmission, distribution, metering, IT, communications).<br />
The goal of this document is to accelerate the construction of a utility’s <strong>Smart</strong> <strong>Grid</strong> architecture and<br />
implementation strategy by leveraging the reference architecture constructs contained therein.<br />
This reference architecture recognizes the need to logically transition from the existing, largely ad hoc<br />
nature of the typical utility grid architecture to one based on open interoperability standards, and<br />
designed to manage complex solutions while facilitating the integration of emergent smart grid<br />
capabilities. It explores three migrations across four transition states and takes into consideration the<br />
many years required to develop sound recommendations for smart grid architecture.<br />
Security is an integral element of the grid ICT architecture and a multi-layered approach is advocated,<br />
including both physical and ICT-based security mechanisms. Layering smart grid services using the<br />
proposed system-of-systems architecture should minimize the stranded costs utilities invest in one-off<br />
solutions. A layered service-centric architecture also minimizes the expense, configuration headaches,<br />
and management complexity a utility faces pursuing a point-to-point interoperability architecture.<br />
Another aspect emphasized in this reference architecture that could lead to considerable cost and time<br />
savings for utilities are the implementation of data services and data management. Greater access to<br />
and use of data is critical to the realization of a grid’s ability to accommodate new capabilities while<br />
improving security, reliability and quality.<br />
A significant portion of this reference architecture is dedicated to discussing common foundational<br />
services and the corresponding architectural views, important for maintaining the high levels of<br />
performance and efficiency required by a modern grid ICT. Recognizing that some services are best<br />
centralized while others must reside primarily within grid-state aware edge components, this<br />
discussion also explores the best central-versus-edge mix for deploying various domain components.<br />
This <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> was produced by a team of architects from Southern California<br />
Edison (SCE), Cisco Systems, and IBM. Its development spanned a period of nine months (July 2010<br />
through March 2011) and involved a number of face-to-face team workshops and web-based meetings.<br />
An external review by EnerNex added additional insight and content.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Executive Summary • 1
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
2. Introduction<br />
The <strong>Smart</strong> <strong>Grid</strong> Architectural Challenge<br />
The January 2007 white paper, A Systems View of the Modern <strong>Grid</strong>, by the U. S. Department of Energy’s<br />
(DOE) National Energy Technology Laboratory (NETL) identifies seven smart grid characteristics:<br />
self-healing<br />
able to motivate and engage the customer<br />
resistant to attacks<br />
provides power quality suitable for 21st century needs<br />
accommodates all generation and storage options<br />
enables markets<br />
optimizes assets and operates efficiently<br />
There are a number of <strong>Smart</strong> <strong>Grid</strong> definitions, but no matter which is used, there is little dispute over<br />
the vastness of program scopes faced by smart grid architects. Incorporating information and<br />
communications technologies into what the National Academy of Engineering calls "the greatest<br />
engineering achievement of the last century" (NAE, 2011) will be the one of the most complex human<br />
endeavors ever undertaken. This robust engineering achievement must be extended to support<br />
enhanced situational awareness (via synchrophasors), industrial-scale energy storage, distributed<br />
(dispersed) energy resources, improved field worker effectiveness (via wireless communications and<br />
automated asset management), remedial action scheme expansion, substation automation, volt/VAR<br />
optimization, fine-grained demand response, distribution automation, improved power quality, power<br />
disturbance self-healing, micro-grids, personal and fleet electric vehicles, automated metering,<br />
premises area networks, enhanced customer energy management, power grid congestion-management,<br />
advanced integrated command and control, transmission/distribution smart sensor deployment, very<br />
low-latency protection communications, and not yet identified technologies that are certain to emerge<br />
as the <strong>Smart</strong> <strong>Grid</strong> matures. All this must be accomplished as the world's largest machine, the electric<br />
grid, continues to operate unabated, while maintaining present or improving reliability. In addition,<br />
embedded security measures must be built concurrently to marginalize the possibility of successful<br />
cyber and physical attacks from an ever-growing number of threats, and prevent unauthorized use of<br />
customer personal data and energy usage information. Finally, there are demands from regulators,<br />
political leaders, and social groups to make the grid smarter quickly, while addressing environmental<br />
objectives and keeping electric rates low.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Introduction • 2
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
3. <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong><br />
The <strong>Smart</strong> <strong>Grid</strong> architectural challenge is a daunting one. This is especially true for those within the<br />
electric utility industry known for their conservative approach toward incorporation of ICT-based<br />
systems to help run and manage the electric grid. Most automated grid systems in use today were built<br />
to address narrowly targeted requirement sets. As a result, a typical utility has a plethora of purchased<br />
and homegrown systems stitched together over the last three decades with point-to-point interfaces.<br />
This approach is unsustainable for a utility to efficiently and effectively implement smart grid<br />
capabilities over the next two decades. This document presents a different approach to utility system<br />
design and integration, using newer paradigms to deal with complex and legacy system integration.<br />
<strong>Smart</strong> <strong>Grid</strong> Architectural Goals and Principles<br />
The next two decades will see the “Old <strong>Grid</strong>” evolve into a “<strong>Smart</strong> <strong>Grid</strong>” as legacy grid infrastructure<br />
is merged with the latest ICT. This will put extraordinary demands on the ICT architecture; therefore,<br />
high-level goals and principles are needed to guide the smart grid architects tasked with developing<br />
any aspect of an organization’s grid architecture. Additionally, a highly flexible, adaptive Enterprise<br />
<strong>Smart</strong> <strong>Grid</strong> architecture is critical for this transition to be successful. The architecture must support<br />
existing ICT infrastructure operations and be able to keep infrastructure complexity manageable as<br />
new smart grid capabilities are added.<br />
How a utility defines its smart grid architecture will vary according to their organizations particular<br />
needs. Some possible goals are:<br />
Facilitate bridging new and emerging information and communications technology to legacy<br />
architecture over extended time periods (technology roadmap).<br />
Manage the increasing complexity of ICT needed to support smart grid implementation.<br />
Align technology usage with the utility’s smart grid strategic objectives.<br />
Provide guidance on how packaged solutions can support the smart grid architectural vision.<br />
Facilitate the communication of the utility’s smart grid strategy and plans across the enterprise<br />
Help sell the utility’s smart grid vision to business unit leadership, IT management, suppliers,<br />
regulatory agencies, contractors, etc.<br />
Help stakeholders (application developers, IT managers, and end users) plan, budget, implement<br />
and use smart grid information and communication technologies.<br />
Make the utility smart grid architecture easily accessible and transparent.<br />
Support the interactions of processes, tools, technology and people to achieve business ICT goals.<br />
Once a utility has defined its smart grid architecture goals it should develop a set of written principles<br />
to provide high-level direction during architecture development. Some principles a utility may<br />
consider important are:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 3
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
1. Design for simplification by exploiting strategic assets<br />
Motivations:<br />
Reduce complexity and cost<br />
Let the enterprise’s employees focus on customer, not on internal processes<br />
Implications:<br />
Establish single architecture control point for requests to expand the portfolio<br />
Finish what is started to enable legacy sunsets<br />
Reduce complexity and low value work steering investment & effort to high value activities<br />
2. Reuse process, data, and ICT assets whenever appropriate<br />
Motivations:<br />
Accelerate business capability delivery<br />
Reduce cost<br />
Increase enterprise consistent use of best practice designs<br />
Increase responsiveness to regulatory requirements<br />
Implications:<br />
Must identify, adopt and reuse process, data and ICT assets for enterprise wide use<br />
Must promote business modularity from strategy through deployment<br />
Must direct funding to develop and adopt best practice assets<br />
3. Use off-the-shelf rather than build solutions<br />
Motivations:<br />
Reduce cost and time to market<br />
Improve time to market<br />
Implications:<br />
Understand what off-the-shelf solutions exist and what processes they support<br />
Re-engineer the business process or model to use off-the-shelf products and services<br />
4. Use Business Process Driven development to move toward a process-centric organization<br />
Motivations:<br />
ICT development will be driven by Enterprise Business Process<br />
Process will drive continual improvement across the enterprise<br />
Use business priorities to drive technology adoption<br />
Continually improve ICT effectiveness and efficiency<br />
Facilitate cross enterprise integration<br />
Implications:<br />
Align enterprise processes with enterprise strategy<br />
Close business-IT partnership with IT engaged early in the solution development process<br />
Ongoing maintenance/management of enterprise business processes<br />
5. Base architecture on total cost of ownership (TCO)<br />
Motivations:<br />
Provide a common approach for dealing with applications<br />
Optimize operational manageability while making key business and technology decisions<br />
Minimize cost of complexity while making these decisions<br />
Free up resources from low value to higher business value application through optimization<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 4
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Implications:<br />
Elimination of low value applications at every possible opportunity<br />
Avoid introduction of new low-value applications for short lived business requirements<br />
TCO based approach to be used for major technology decisions<br />
6. Ensure business decisions are based on information from appropriate trusted data sources<br />
Motivations:<br />
Achieve highest degree of integrity and validity for business decisions<br />
Minimize IT costs for managing and maintaining data<br />
Enhance ease of doing business by eliminating manual data integration, normalization, etc<br />
Implications:<br />
Practitioners more likely to know what trusted sources exist, and which ones to use<br />
Solution teams realize reduced cost benefits using appropriate trusted sources<br />
7. Develop data models and a data dictionary for the entire portfolio<br />
Motivations:<br />
Improve operational excellence<br />
Reduce unnecessary transformations of data and related re-work<br />
Enable meta data sharing for exchange and integration purposes<br />
Improve future system design and programming projects<br />
Improved documentation and control mechanisms<br />
Implications:<br />
Project teams bound by data model/dictionary governance processes<br />
Close collaboration between business and IT stakeholders<br />
Easy access to data model/dictionary given to designers and programmers<br />
8. Master data – element created from one trusted source<br />
Motivations:<br />
Increased data integrity and reliability<br />
Cost reduction for managing information and data quality<br />
Implications:<br />
Consistently invest in, and comply with, the trusted sources architecture<br />
Processes engineered to maintain consistent master data management and consumption<br />
9. Only store copies of data within approved trusted sources<br />
Motivations:<br />
Achieve highest degree of integrity and validity for business decisions<br />
Minimize ICT costs for managing and maintaining data<br />
Enhance ease of doing business by eliminating manual data integration, normalization, etc<br />
Implications:<br />
Practitioners more likely to know what trusted sources exist, and which ones to use<br />
Solution teams realize reduced cost benefits using appropriate trusted sources<br />
Data currency is in line with business expectations.<br />
10. Implement data quality plans for all business solutions<br />
Motivations:<br />
Maximize data integrity and validity for business operations and decision making<br />
Avoid operational disruption due to data errors<br />
Reduce cost and complexity<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 5
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Implications:<br />
Real cost implications associated with avoidance of data quality plans<br />
Data quality easier to implement and sustain<br />
11. Design solutions that provide measurable business performance and value<br />
Motivations:<br />
Maximize ICT ROI<br />
Focus design and development teams on business success goals<br />
Validate the ICT governance model<br />
Achieve measurable performance gains<br />
Implications:<br />
Link strategy to business case and customer requirements to metrics<br />
Enable collection, analysis and reporting of metrics, actual to plan<br />
Design generation of metric data into solutions<br />
Establish process-level Key Performance Indicators<br />
12. Enable applications for reuse and portability as services<br />
Motivations:<br />
Ability to quickly add, modify, remove or replace service functions<br />
Reduction of integration expense and partner boarding costs<br />
Facilitate the reuse of strategic applications and business functions<br />
Enable application and function relocation for process or cost effectiveness<br />
Improve support of acquisitions and divestitures<br />
Reduce point-to-point integration solutions<br />
Implications:<br />
High return investment hotspots emphasized<br />
Centralized support for design enablement<br />
Enterprise group assigned to enhance competency on standards and references<br />
Portability design based upon being agnostic on platform, location and virtualization<br />
Adoption of service modeling methodology<br />
13. Design and test solutions to satisfy non-functional requirements<br />
Motivations:<br />
Stabile platforms supporting the enterprise business<br />
Ensured Return On Investment<br />
Implications:<br />
Need to understand the target audience and expected workload of new solutions<br />
Infrastructure impact of new solutions known early in the design cycle<br />
Infrastructure constraints considered in analysis of growth markets<br />
14. Design solutions to make use of infrastructure common services<br />
Motivations:<br />
Reduction of infrastructure duplication and cost<br />
Less complexity for the end user<br />
Improvement of system interoperability<br />
Implications:<br />
Re-use of existing common services, reduction of new service construction<br />
Need for common services to be robust and user-friendly<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 6
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
From a Siloed <strong>Architecture</strong> to a Layered Services <strong>Architecture</strong><br />
Architectural evolution can be defined as how a typical utility implements its smart grid<br />
transformation in stages. A white paper discussing this evolutionary process in depth can be found in<br />
Appendix A. For the purposes of this paper the process has been divided into four stages.<br />
Stage One: The predominate architecture of grid systems is a collection of silos. Figure 4 is an example<br />
of silo architecture for EMS/SCADA and metering/billing functions. Different functions (SCADA, EMS,<br />
DMS, OMS, Billing, and Metering) use disparate information with minimal interaction.<br />
Figure 4 - Silo <strong>Architecture</strong> for EMS/SCADA and Metering/Billing Functions<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 7
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The silo architecture worked well for utilities for decades - each silo served the needs of a business unit,<br />
each having very different needs. Utilities operated efficiently with little integration across silos. The<br />
silo solution, however, is not sustainable to support the <strong>Smart</strong> <strong>Grid</strong>. The number of stakeholders<br />
needing real-time data from every silo cannot be support long-term point-to-point interfaces.<br />
Stage Two: Some utilities have taken the next step in smart grid evolution – the integration of the back<br />
office and applications via a common service bus, such as the enterprise service bus architecture shown<br />
in Figure 5 . This is often a difficult and costly process. In addition, service-bus integration requires<br />
enforcement of standards on data models and ICT services. Without the enforcement of standards, the<br />
service bus is simply a shared communication device with little resolution of silo weaknesses.<br />
Figure 5 - Enterprise Service Bus <strong>Architecture</strong><br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 8
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Stage Three: The next step towards a unified, shared infrastructure is realized by moving away from a<br />
series of single-purpose networks to a converged communication infrastructure [Figure 6]. This shared<br />
infrastructure enables as-needed data transfer from end points to consuming applications in<br />
accordance with stated requirements (quality of service, criticality, bandwidth, latency, etc.).<br />
Figure 6 - Converged Communication <strong>Architecture</strong><br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 9
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Stage Four: The ultimate <strong>Smart</strong> <strong>Grid</strong> ICT architecture is converging on layered, open standard services<br />
architecture. It provides capabilities across functional and organizational boundaries; from a<br />
data/control center to edge devices and data consumers (applications and end users).<br />
Figure 7 – System-of-Systems <strong>Architecture</strong> Based on Open Standard Services<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 10
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The system-of-system architecture shown in Figure 7 supports the following capabilities:<br />
Components can be added, replaced or modified without affecting the remainder of the system<br />
Components are distributable (can run on arbitrary servers)<br />
Components communicate with each other by messages or service invocations<br />
Component interfaces are defined using standard metadata<br />
Component interfaces are discoverable by application developers<br />
One component can replace another with the same interface<br />
Services can be used multiple times by disparate applications or the same application.<br />
Achieving such smart grid capabilities requires a great amount of interaction among systems. For<br />
instance, most utilities rely on customers to report an outage; in the future, the advanced metering<br />
infrastructure (AMI) will interact with the outage management system (OMS) to predict and confirm<br />
outages. Once OMS confirms an outage, the distribution management system (DMS) calculates the<br />
necessary switching steps needed to isolate the fault area and restore service in a timely manner. The<br />
field workforce will directly interact with the OMS and DMS, responding to automatically issued work<br />
orders and providing a detailed estimate of restoration time. Meanwhile, the customer can be notified<br />
of the outage status in real-time via user-defined means (cell phone, web, etc.). As the capabilities of the<br />
communication infrastructure advances, additional intelligence will be deployed closer to the<br />
customers’ premises, allowing pro-active decisions to be made locally to avoid or minimize outages,<br />
while informing the utility systems and operators of the locally implemented actions for potential<br />
adjustment and optimization of energy resources.<br />
The <strong>Smart</strong> <strong>Grid</strong>’s capabilities will need to be facilitated by an architecture that enables the connected<br />
devices and systems to securely interact and exchange information and control. Field devices and<br />
electrical equipment should not only publish data to help improve real-time monitoring of the electrical<br />
grid, they will need to subscribe to other devices' information as well, allowing the devices to respond<br />
to control signals and data requests issued by applications and systems responsible for grid monitoring<br />
and control. This dispersion of data across the grid poses a significant challenge to utility data<br />
management. The quality of the data is also a concern, requiring intelligent devices to be properly<br />
configured and maintained. Device configuration control is best performed by a common management<br />
tool tasked with component provisioning and de-provisioning. Even though the future communication<br />
infrastructure is expected to be more robust and feature high performance communication channels,<br />
the large amount of data, data sources and data consumers requires grid intelligence to have<br />
decentralized and centralized aspects:<br />
Decentralized embedded systems and applications will be responsible for analysis, filtering and<br />
taking particular actions based on the data provided by local field devices.<br />
Centralized systems will be responsible for coordinating the decentralized systems, ensuring the<br />
overall reliability and stability of network.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 11
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
With applications and systems physically dispersed into the network to lower the cost of deployment<br />
and maintenance, each component of the <strong>Smart</strong> <strong>Grid</strong> system-of-systems will be required to satisfy four<br />
key principles of layered services architecture:<br />
1. Individual components can be added, replaced or modified without impact to other systems.<br />
2. Components are distributable, communicating by messages or service invocations.<br />
3. Interfaces between components are discoverable and leverage standard metadata<br />
4. Component services can be easily reused by different applications.<br />
While reusable and shared services reduce costs and minimize complexity, they also enable faster<br />
deployment of new applications. This will be crucial for the utility to efficiently adapt to evolving<br />
regulatory mandates.<br />
To transition from a Stage 1 silo architecture, or a Stage 2 partially integrated architecture to a Stage 3<br />
or Stage 4 layered services architecture, the utility must define and plan for strategic investments in<br />
modernizing its infrastructure and systems. To be successful, each planned investment must be<br />
reviewed and assessed from an enterprise standpoint to ensure investments help the organization<br />
transition toward the future <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong>. Adoption of shared services, standards and a<br />
unified infrastructure need to be understood as intrinsic requirements for each planned investment.<br />
A transition plan some companies have adopted is to first move from a siloed architecture to<br />
middleware integration architecture. This is followed by a gradual migration to an open-standards<br />
based architecture, incrementally developing and adopting standards and common services. Each<br />
increment helps move the enterprise toward the vision of this <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong>. The<br />
timing of the transitions is often documented by a smart grid roadmap. Appendix D presents one<br />
technique for constructing a roadmap. It also provides a brief discussion on the <strong>Smart</strong> <strong>Grid</strong> Maturity<br />
Model (SGMM) sponsored by Carnegie Mellon University.<br />
The smart grid architect should apply the system-of-systems architecture patterns described to first<br />
develop use cases and a comprehensive set of requirements. These can then be used to develop the<br />
shared services and target physical architectures needed to support the desired capabilities across the<br />
utility’s smart grid.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> • 12
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
4. <strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services<br />
Seven domains comprise the conceptual model described in NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong><br />
Interoperability Standards, Release 1.0 (NIST, 2010). A smart grid has inherent power flow and grid state<br />
complexity embedded primarily within this model’s Operations domain. This SGRA recommends two<br />
additional domains should an architect wish to explicitly address these complexities. In addition, the<br />
SGRA supports the concept of foundation-level services used by multiple domains.<br />
The NIST smart grid conceptual model domains are:<br />
Customer: the functional needs within the customers’ premises, including the ability to generate,<br />
store, monitor and control the electricity usage of customers (both residential and commercial).<br />
Market: the functional and operational need for operators and participants in the electricity market.<br />
This is where efficient matching of energy production and consumption is performed.<br />
Service Provider: the functional needs of organizations offering or leveraging utility services. These<br />
include power producers, distributors, regulatory agencies, banks, credit bureaus, etc.<br />
Operations: managers of electricity movement, responsible for the smooth operation of the grid<br />
Bulk Generation: the needs of power generation entities producing more than 300 megawatts.<br />
Transmission: the applications and tools to deliver bulk electricity over long distances, such as a<br />
Regional Transmission Operator or Independent System Operator (RTO/ISO).<br />
Distribution: often considered the primary focus of smart grid changes, offers all the required<br />
functional services to electricity distributors to and from customers, as well as the services to<br />
manage distributed energy resources, including energy storage and plug-in electric vehicles.<br />
Supplementing the NIST-defined domains, the following are potential expansions to the architect’s<br />
smart grid conceptual model:<br />
Balance – required for the dispatch of distributed energy resources and demand response due to<br />
their roles in balancing supply vs. demand on the grid; increasingly data interaction between the<br />
utility, the consumer and the balance authority will be needed in the <strong>Smart</strong> <strong>Grid</strong> environment.<br />
Interchange – the visibility onto grid state required to address increased power flow complexity,<br />
placing requirements on smart grid systems for data communications and management.<br />
Cross domain foundational services are those that two or more domains rely upon and therefore need to<br />
be interoperable across domains. For example, a system having one form of encryption in one domain<br />
and a different one in another will lead to problems when the two exchange information, thus causing<br />
additional work to correct the problem in the final implementation. This could be avoided by a single<br />
encryption method used by all systems as a cross domain foundational service.<br />
Cross domain services are broken down into six groups: Analytics, Data, Control, Security,<br />
Communication, and Management. Discussions on each service group can be found in Appendix B.<br />
Architects and others interested are encouraged to study this appendix for more detail.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> Domains and Cross Domain Foundational Services • 13
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
5. <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views<br />
The comprehensive, end-to-end, high-level architecture needed to support the utility business domains<br />
and common enabling services discussed in Section 4, uses a model that assumes a service-oriented<br />
governance process exists supporting the intrinsic characteristics of layered services architecture. The<br />
model’s seven business domains are each logical groupings of business capabilities providing related<br />
business functions while requiring similar skills and expertise. These match the domains identified by<br />
NIST in Special Publication 1108, NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards,<br />
Release 1.0 (NIST, 2010).<br />
These functional areas form the basis for defining the boundaries of ICT capabilities and systems, and<br />
provide a means to classify components and services. Common enabling services provide a variety of<br />
services for systems and subsystems to accomplish business functions. Governance provides a<br />
framework to define the relationships and processes used to direct and control grid activities, as well as<br />
the actions, authority and metrics used to realize business benefits while balancing risk versus reward.<br />
The left side of Figure 8 shows the seven NIST utility domains as distinct logical groupings of common<br />
capabilities. A utility may elect to combine some domains (i.e. distribution and transmission) and plan<br />
a single logical infrastructure to support the <strong>Smart</strong> <strong>Grid</strong>. In addition, utilities opting for interactions of<br />
<strong>Smart</strong> <strong>Grid</strong> elements with the Balance and Interchange domains will need to extend this model.<br />
Figure 8 - <strong>Smart</strong> <strong>Grid</strong> Conceptual Model<br />
The top of Figure 9 names five smart grid end-state architecture tiers (user/device, channel,<br />
presentation/edge, integration, services). In this tiered architecture, data flows from left to right (and<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 14
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
back) through the various tiers, each with layered service groups or capabilities. The large box at the<br />
bottom of the figure (spanning the three right tiers) represents the cross domain foundational services<br />
discussed in section 4 above.<br />
Figure 9 - Layered Services Tier View<br />
Each services group discussed in the following subsections provides a:<br />
Logical architecture diagram<br />
Structural architecture diagram<br />
Table of typical architectural specifications for the service group<br />
Table of relevant standards for the service group<br />
Table of relevant technologies for the service group<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 15
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Application Services<br />
<strong>Smart</strong> grid applications services provide functionalities for the presentation tier, the services tier, and a<br />
mechanism to integrate various applications through the integration tier as depicted in Figure 9.<br />
Applications consume services to present secure, timely, relevant, and understandable information in<br />
response to a validated stakeholder request.<br />
Applications Services Logical Model<br />
The Application Services Logical Model [Figure 10] is made up of three views, (1) application component,<br />
(2) application services stack and (3) application synergy.<br />
Figure 10 - Application Services Logical Model<br />
The application component view depicts in block format the primary functional components used to<br />
build the architecture being described. This model follows the IEC 61968 and 61970 specifications, most<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 16
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
notably the Interface <strong>Reference</strong> Model (IRM) categorization of functional components necessary for<br />
smart grid transformation within a utility.<br />
The application services stack view defines the services required by smart grid applications. Due to the<br />
number and broad range of services consumed by applications, the list is best understood by grouping<br />
the services into broad service types. The stack services are therefore divided into four categories:<br />
Foundation services –many key technical foundational services are required by the application<br />
architecture tier. Used throughout the architecture, these services are leveraged to varying<br />
degrees by other technical and functional services. For example, the enterprise service bus is one<br />
of the foundation services used throughout the architecture.<br />
Core services – the primary service stack for the application architecture are service governance<br />
through a services registry and repository, a message gateway, web Integration services, a state<br />
machine, and a business process execution language (BPEL) engine and workflow. These core<br />
services provide baseline capability in the application tier.<br />
Integration services – services such as enterprise services bus, rule engine, the Common<br />
Information Model (CIM) binding, service orchestration, security agents, and policy cache<br />
provide the integration needed between the functional services and other architectural tiers.<br />
Support services – the application architecture utilizes common support services for security,<br />
communication, data management, smart grid management, analytics, and control. Support<br />
services underpin application architecture and are re-used extensively in each services group.<br />
The application synergy view [Figure 10, upper left] depicts some of the key issues faced by an<br />
enterprise architect while architecting the <strong>Smart</strong> <strong>Grid</strong> application architecture. The data generated by a<br />
device or end point may serve multiple consumers in a format specific to each consumer’s needs. The<br />
application architect can use the model to identify re-use opportunities for data and integration<br />
services as smart grid application functionalities are built. Potential synergy prospects are those with<br />
similar paths through the various tiers.<br />
The tiers and how they relate to the <strong>Smart</strong> <strong>Grid</strong> are:<br />
Source Tier: Different data generation sources (sensors, feeder devices, etc.) in the <strong>Smart</strong> <strong>Grid</strong><br />
produce the four different data classes (telemetry, waveforms, events, user data) shown in the<br />
application synergy model portion of Figure 10. This tier is comprised of the various parameters<br />
used to differentiate sources. There are important architectural considerations when selecting the<br />
(1) components to process the data, (2) communication infrastructure to transport the data, and<br />
(3) security services needed to protect the data. The frequency at which a source generates data<br />
is dependent on the purpose of the data. For example, if data is expected to be used for<br />
calculating grid state, the data generation frequency will be high. If the data represents<br />
consumer usage data, the frequency is much less – perhaps once every several minutes. Thus the<br />
purpose of each datum and source needs to be analyzed, and only then should relevant<br />
architectural components be selected to implement the requirements.<br />
Data Classes: There are four high-level data class types supported in <strong>Smart</strong> <strong>Grid</strong> architecture.<br />
Waveforms data represent values of electrical measurements such as current, voltage, phase, etc.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 17
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Telemetry data represent readings generated by field sensors. Event messages can be generated<br />
by field crew, distributed energy resources (DER), automated demand response (ADR), etc.<br />
Usage data is generated by consumer smart meters. These data classes are presented to ensure<br />
the application architecture supports all data classes, and to help the architect choose the best<br />
integration pattern.<br />
Application Services: This tier represents how different components must interact to provide<br />
desired business functionality. Different data classes connect to the <strong>Smart</strong> <strong>Grid</strong> infrastructure<br />
through the enterprise services bus (ESB). This provides multiple capabilities, such as handling<br />
request/response, publish/subscribe (event) processing, event interception, gateway<br />
communication, business rules, CIM binding, policy caching, etc. The core ESB features<br />
provided (protocol transformation, routing, etc.) allows the service bus to act as a mediator<br />
between the data source and consumer. Web integration services can consume usage data and<br />
provide data to customer service hosted by a third party or utility partner. Similarly, third party<br />
consumers may connect to smart grid applications through gateway services. Applications often<br />
require workflow, CIM binding, access to an external rules engine, and service discovery for<br />
building functional capabilities. Refer to Appendix B for more detail on application services.<br />
Consumers/Processes: These are the high level business functions identified in the IEC IRM.<br />
These business functions are developed using application services to collect and process source<br />
data for end-user consumption. Edge presentation services may be used for some consumers<br />
while others are supported by application servers via the ESB. Functional components<br />
developed on application servers make use of rules engines, workflow, process services, BPEL<br />
engines, state machines, complex event processing, gateway services, etc. Web integration<br />
services are used to develop support services and user-generated content, including derivative<br />
applications from pre-existing sources (mashups).<br />
Application Services Structural Model<br />
The application services structural model [Figure 11] is provided to help the smart grid architect<br />
consider how to best deploy the various application services using a stylized representation of a typical<br />
utility network infrastructure. At the top of the model are elements needed to support external agencies<br />
(regulators, interchange and balancing authorities, etc.). At the bottom are the application services<br />
needed by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In<br />
between are a dozen other tiers where application services may be located to support residing devices<br />
and functionality. A self-describing template used for this model is on the last page of Appendix B,<br />
Services Classes Concepts. Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 18
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 11 - Application Services Structural Model<br />
Applications <strong>Architecture</strong> Specifications<br />
Each smart grid application will have a list of specifications for the application architecture to support.<br />
This topic is, however, does not address every specific smart grid application. It is instead intended to<br />
be a discussion of common specifications for an abstracted collection of smart grid applications.<br />
Table 1 is therefore a list of general specifications with potential relevance to a smart grid application.<br />
The justification for each is provided to enhance the reader’s understanding of each specification.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 19
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The table does not include detailed business or technical requirements a specific application would<br />
fulfill. Each utility will build a detailed application requirements list as part of any smart grid project.<br />
Table 1 - Typical Application Specifications<br />
Specification<br />
Application access shall be tightly controlled.<br />
The application architecture shall use common<br />
services instead of building redundant services.<br />
The application infrastructure shall leverage<br />
virtualization at the data center.<br />
The application shall be deployable in a distributed<br />
fashion. Places in the grid for application<br />
deployment are illustrated in an hierarchical model.<br />
Application infrastructure must be rugged for<br />
applications that are deployed on substation,<br />
feeder, and premises area.<br />
The application shall use common auditing/logging<br />
capabilities to support comprehensive management<br />
architecture.<br />
Applications architecture shall promote open<br />
standards and avoid vendor lock-in.<br />
Whenever possible, management of systems shall<br />
be centrally and uniformly managed.<br />
Business rules (i.e., implementations of the policies<br />
and practices of a business organization)<br />
externalization shall be supported.<br />
Any commercial-off-the-shelf (COTS) application<br />
package used shall be minimally customized.<br />
A comprehensive design, build and run platform<br />
shall be used to support implementation of the<br />
<strong>Smart</strong> <strong>Grid</strong> application architecture.<br />
All information shall have defined authoritative<br />
sources (information stewards).<br />
A comprehensive architecture governance<br />
mechanism shall be used during application<br />
architecture development.<br />
As needed, common services shall be developed for<br />
communication, security, and data architecture as a<br />
precursor to the development of the application<br />
services architecture. (similar to second spec listed)<br />
Enterprise business service definitions shall be<br />
managed and enabled for automatic discovery.<br />
Justification<br />
Applications must be protected from unauthorized access.<br />
Common services such as authentication and authorization,<br />
communication, and management services, if reused properly can<br />
drastically cut costs.<br />
Reducing the consumption of key resources such as energy and<br />
personnel while improving the utilization of IT hardware and<br />
software can yield environmental as well as financial benefits.<br />
Each location where data is generated or information is consumed is<br />
a location candidate for the appropriate application. Communication<br />
network elements hosting additional software are also good<br />
candidates, since communications elements generally exist where<br />
data sources and consumers reside. By making use of such elements<br />
to host applications, it is possible to provide the benefits of<br />
distributed architecture while minimizing the number of devices to<br />
be managed and maintained. Zero-touch deployment is crucial.<br />
Event logging is necessary to support post mortem analyses of<br />
various kinds. With the volume of events generated by a <strong>Smart</strong> <strong>Grid</strong>,<br />
management of the event logs is a large issue; therefore, care must<br />
be taken for selecting consistent mechanisms across the enterprise.<br />
Proprietary applications are difficult to integrate and generally<br />
defeats system-of-systems primary design principles.<br />
Integration with the management services architecture is necessary<br />
to make distributed application architecture operations feasible.<br />
Decoupling and externalizing business rules can provide a number of<br />
advantages: variable logic can easily be changed, duplication of logic<br />
at multiple places can be avoided, and discovery of and fixing<br />
miscreant rules can be simplified.<br />
Minimum customization of COTS allows version upgrades and<br />
enhancements.<br />
Application development lifecycle management through integrated<br />
development platform enables disciplined application development.<br />
Data needs to be made available in a timely and accurate form, and<br />
must be captured and validated.<br />
<strong>Architecture</strong> governance enables fundamental aspects of service<br />
oriented architecture, which provides inputs vital to the development<br />
of the application architecture.<br />
This is vital to the development of the application architecture, since<br />
common services are significant providers of support functions.<br />
Sometimes a “chicken or egg” conundrum, however, for enterprises<br />
with an immature SOA infrastructure.<br />
Basic service repository mechanisms can reduce integration cost and<br />
help in business flexibility.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 20
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Specification<br />
Enterprise class service: development of services<br />
used across the enterprise shall trump the<br />
development of similar or duplicative services<br />
provided solely to a particular organization.<br />
For low latency applications, implementation shall<br />
be located at or very near the data source(s) and<br />
the primary outputs destination(s),<br />
Software and hardware shall conform to defined<br />
standards that promote interoperability for data,<br />
applications, and technology.<br />
Unique version namespaces shall be used for<br />
service versioning.<br />
Modular design shall be used wherever possible<br />
(moving away from monolithic systems).<br />
Multiple channels supporting client application<br />
delivery shall be available, with an ability to tailor<br />
the delivery mechanism to the client.<br />
ICT shall plan, design, and construct for growth and<br />
expansion of services across the <strong>Smart</strong> <strong>Grid</strong>.<br />
The federated architecture shall promote reduced<br />
complexity and enable integration to the maximum<br />
extent possible through adoption of standards.<br />
The architecture shall be based on a design of<br />
services mirroring real-world business activities<br />
managed by the enterprise business processes.<br />
Justification<br />
Duplicate capability is expensive to build and maintain. It also poses<br />
challenges in maintaining data integrity.<br />
This is a direct consequence of the distributed nature of power grids<br />
and their control systems. The requirement avoids hops to and from<br />
remote processing centers. Embedded processing is used, but the<br />
actual application is downloadable.<br />
Standards help ensure consistency, thus improving the ability to<br />
manage systems, improve user satisfaction, protect existing IT<br />
investments, maximize return on investment and reduce costs.<br />
Standards for interoperability help ensure support from multiple<br />
vendors for an asset, and facilitate supply chain integration.<br />
Application programming interface versioning is a common problem<br />
in the design of any distributed system, and services are no<br />
exception, they must be versioned for correctness and manageability.<br />
Modular design provides flexibility in design and helps in scaling a<br />
solution. A solution's overall functionality can be decomposed into<br />
smaller functional building blocks and, ideally, perform only one<br />
conceptual function.<br />
Consumers, partners and field force want channel of service delivery<br />
to fit their individual preferences and circumstances. Having multichannel<br />
access protects against single point of access failure.<br />
Application architecture and design must plan for growth to provide<br />
business flexibility.<br />
Complex application systems with many data and transactional<br />
functions are difficult to manage and risky to change. Applications<br />
with tightly coupled modules risk creating a dependency failure.<br />
Service orientation delivers enterprise agility and boundary-less<br />
Information Flow.<br />
<strong>Architecture</strong> Standards and Technology Recommendations<br />
The following tables of architecture standards and technology recommendations are provided to the<br />
smart grid architect as references. Over time, however, innovations will inevitably diminish their<br />
completeness. The architect should always research the latest information on these topics, but these<br />
should provide a good starting point. Table 2 lists the most important 2011 standards, while Table 3<br />
lists technology recommendations, with brief explanations of their purpose or relevance.<br />
Table 2 - Applicable Application Standards<br />
Standards<br />
Distributed<br />
Network Protocol<br />
(DNP3)<br />
IEC 60870-6<br />
Purpose/Relevance/Comments<br />
Defines a set of communications protocols used between components in process automation systems.<br />
This protocol facilitates communications between various types of data acquisition and control<br />
equipment and plays a crucial role in SCADA systems.<br />
Describe the Inter-Control Center Protocol (ICCP) for data exchange between control centers.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 21
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Standards<br />
COMTRADE<br />
IEC 61850<br />
IEC 61968, 61970<br />
IEC CIM GID<br />
Interface Services<br />
(GDA, HSDA,<br />
TSDA, GSE)<br />
IEC Common<br />
Information<br />
Model<br />
IEEE 37.118<br />
NRECA<br />
Multispeak<br />
Web Services<br />
Standards (SOAP,<br />
WSDL, WS-*<br />
specification)<br />
XML<br />
ZigBee <strong>Smart</strong><br />
Energy Profile<br />
Purpose/Relevance/Comments<br />
Common Format for Transient Data Exchange. It is intended for use by digital-computer-based devices<br />
which generate or collect transient data from electric power systems. This standard facilitates<br />
exchange of the transient data for the purpose of simulation, testing, validation, or archival storage.<br />
For designing electrical substation automation.<br />
Describe the business functions, business sub-functions and abstract components for distribution<br />
management and set of applications for energy management system.<br />
Four services associated with IEC CIM for data interchange in four classes: generic data, high speed<br />
data, time series, and events<br />
Primary schema for data representation; should also be applied to analytics outputs, which in<br />
themselves are treated as data for purposes of transport, persistence, and interface to various<br />
consuming systems.<br />
Define Phasor Measurement data<br />
Defines what data need to be exchanged between software applications in order to support the<br />
business processes commonly applied at utilities. This leverages definitions of common data semantics,<br />
definitions of message structure and definition of which messages are required to support specific<br />
business process steps.<br />
For defining interfaces and standards for interoperable system integration and service oriented<br />
architecture.<br />
For message oriented integration.<br />
It enables wireless communication and control between utility companies and common household<br />
devices such as smart thermostats and appliances.<br />
Table 3 - Application Technology Recommendations<br />
Application Technology<br />
Application/transaction<br />
processing server<br />
Business Process Engine<br />
Business process<br />
integrator<br />
Business rules engine<br />
Connector framework<br />
Enterprise Service Bus<br />
(ESB)<br />
Event processing<br />
Integration middleware<br />
Load balancers<br />
Message gateway<br />
Message queue<br />
SOA governance tool<br />
Web portal<br />
Web servers<br />
Purpose/Relevance/Comments<br />
A middleware software component dedicated to efficient execution of programs supporting<br />
application construction.<br />
Implements Business Process Execution Language (WS-BPEL) for process choreography.<br />
Automates and optimizes business processes, within the organization and across the customers,<br />
partners, and supply chains.<br />
Software executing one or more business rules in a runtime production environment.<br />
Allows data access from diverse sources.<br />
Software providing complex architectures with fundamental services via an event-driven and<br />
standards-based messaging engine. Foundational capabilities include invocation, routing,<br />
mediation, protocol transformation, process choreography, service orchestration, complex<br />
event processing, and QOS measures (reliable delivery, transaction management, & security)<br />
Handles messaging resulting from pre-defined circumstances occurring across the enterprise.<br />
Allows data contained in one database to be accessed through another.<br />
Provides techniques for distributing workload evenly across two or more servers.<br />
An integrated suite of components for an easy-to-use entry point to all enterprise business info<br />
Allows independent and potentially non-concurrent applications on a distributed system to<br />
communicate with each other.<br />
SOA control and management tools (service interface management & discovery, monitoring)<br />
Integrates and presents information from diverse sources in a unified way.<br />
Delivers content (web pages) using the Hypertext Transfer Protocol (HTTP), over the web<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 22
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Analytics Services<br />
<strong>Smart</strong> grid analytics generally reside within the cross domain foundational services box in the lower<br />
right area of Figure 9 - Layered Services Tier View. Analytics provide the services needed to make<br />
sense out of the data being created by smart grid sensors (smart meters, grid components, energy<br />
management devices, etc.). Analytic tools are designed to turn large amounts of structured and<br />
unstructured data into information useful to humans (consumers, utility operators, regulators) and<br />
smart grid control mechanisms (demand response, outage management, advanced load controls).<br />
Analytics Logical Model<br />
The Analytics Logical Model [Figure 12] consists of three views: (1) analytics synergy, (2) analytics<br />
services stack, and (3) analytics component.<br />
Figure 12 - Analytics Logical Model<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 23
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The synergy model illustrates a key concept of <strong>Smart</strong> <strong>Grid</strong> architecture: the manner in which data<br />
sources from the grid produce data which, when processed in multiple ways through multiple<br />
analytics, can support multiple business outcomes. Therefore, data sources (sensors) and analytics<br />
processing tools and components can and should be shared over multiple capabilities. By arranging the<br />
architecture to take advantage of the synergy, the <strong>Smart</strong> <strong>Grid</strong> architect can minimize infrastructure cost<br />
while maximizing realized business value of the sensing and analytics elements of the <strong>Smart</strong> <strong>Grid</strong>.<br />
While the synergy model is complex and can be difficult to understand, it has the potential for high<br />
payback. In this synergy model diagram, data sources are arrayed at the bottom. Data from these<br />
sources falls into one or more of four data classes as shown in the second tier. In the third tier, six<br />
classes of analytics (process data from the data sources according to data class. In the top tier, analytics<br />
support one or more utility business processes. Line coloring does not have a special meaning except to<br />
make line groupings somewhat easier to follow on a crowded diagram. Finally, because visualization is<br />
pervasive, it is shown as a blue box in the synergy model third tier, essentially underlying all of the<br />
analytics classes, signifying their use in GUI-based decision support.<br />
Analytics Structural Model<br />
The analytics services structural model [Figure 13] is provided to help the smart grid architect consider<br />
how to best deploy the various analytics services using a stylized representation of a typical utility<br />
network infrastructure. At the top of the model are elements needed to support external agencies<br />
(regulators, interchange and balancing authorities, etc.). At the bottom are the analytics services needed<br />
by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a<br />
dozen other tiers where analytics services may be located to support residing devices and functionality.<br />
A self-describing template used for this model is on the last page of Appendix B, Services Classes<br />
Concepts. Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 24
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 13 - Analytics Structural Model<br />
The Analytics Structural Model illustrates how analytics functionality can be distributed across a <strong>Smart</strong><br />
<strong>Grid</strong>. This is important to the smart grid architect because a distributed architecture can address issues<br />
of latency, scale, and robustness. There are many places on the grid where analytics elements may<br />
reside, and a key aspect of smart grid architecture is to develop a proper combination of distributed<br />
and centralized analytics elements. There are significant tradeoffs between the degree to which<br />
analytics are distributed and the resulting requirements for communications services, as well as data<br />
services. Furthermore, the distribution of analytics must be coordinated with the control architecture,<br />
since some analytics are consumed by controls systems which are also distributed and require the<br />
analytics as inputs on a low-latency basis.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 25
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Analytics <strong>Architecture</strong> Specifications<br />
Table 4 is a list of general analytics specifications. The justification for each is provided to enhance the<br />
reader’s understanding of each specification.<br />
The table does not include detailed business or technical requirements a specific analytics tool would<br />
fulfill. Each utility must include requirements for analytics services in every relevant smart grid project.<br />
Table 4 - Typical Analytics Specifications<br />
Specification<br />
Analytics shall be dynamically re-distributable – a service to<br />
manage the re-distribution must be included in the analytics<br />
architecture.<br />
Analytics services shall be centrally and uniformly managed. The<br />
management mechanism should be integrated with the general<br />
network and grid device management services.<br />
Analytics services shall be deployable in a distributed fashion.<br />
Places on the grid for analytics deployment include:<br />
Data centers<br />
Control centers<br />
Substations<br />
Mobile devices<br />
Edge devices, including meters, gateways<br />
Communications devices<br />
Cloud services (private and third party)<br />
Distribution feeder power system devices<br />
Analytics shall be distributed according to a latency hierarchy.<br />
Some analytics will be implemented close to data sources and<br />
consumers, while others can be implemented at control centers<br />
or data centers. Analytics associated with protection and control<br />
should be distributed; analytics for asset health and stress<br />
accumulation can be centralized. Analytics for grid state should be<br />
distributed. Analytics for consumer behavior can be centralized.<br />
<strong>Smart</strong> grid analytics services architecture shall include analytics<br />
tool management. Such tools include those that enable the<br />
development and deployment of rules for event processing<br />
engines, configuration tools for computational analytics, and<br />
workbenches for tools highly interactive in nature.<br />
Data quality monitoring for low latency analytics shall be<br />
incorporated into the analytics service at the point of deployment<br />
for immediate detection of data channel failures.<br />
The control systems architecture shall be developed as a<br />
Justification<br />
Analytics change as the <strong>Smart</strong> <strong>Grid</strong> evolves and it is<br />
impractical to physically visit distributed analytics<br />
elements to make changes.<br />
It is impractical to use a distributed architecture that<br />
requires field frequent visits to devices, in fact, Zero<br />
Touch deployment is necessary for <strong>Smart</strong> <strong>Grid</strong>s at<br />
scale. Integration with the management services<br />
architecture for distributed architecture operations to<br />
be feasible.<br />
Wherever data is generated or information consumed<br />
is a location candidate for appropriate analytics.<br />
Communication network elements hosting additional<br />
software are also good candidates, since generally<br />
these elements are where data sources and consumers<br />
reside. Use of these to host analytics makes it possible<br />
to provide the benefits of distributed architecture<br />
while minimizing the number of devices to be managed<br />
and maintained. Zero-touch deployment is crucial.<br />
The tradeoff between degree of distributed<br />
intelligence and communications requirements is one<br />
of the most significant decisions smart grid architects<br />
must make. This tradeoff must be made early in the<br />
design process and revisited periodically as the grid<br />
transformation proceeds.<br />
As the utility transforms its grid, forms and uses of<br />
analytics will change. In addition, new analytics are<br />
being developed as grid data becomes available. The<br />
utility must not expect analytics deployment to remain<br />
static. Thus, having access to the appropriate tools to<br />
manage the analytics transformation is crucial.<br />
Many data acquisition devices suffer data channel<br />
failures with the device not generating a fault alarm.<br />
Since the data may be used in a real-time mode, it is<br />
necessary to have ways to detect faulty data in realtime.<br />
This must be done at or near the source since<br />
much of this data will never reside in a database. In<br />
addition, real-time control may depend on the<br />
correctness of this data and the consequent analytics.<br />
Since controls consume analytics widely, the control<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 26
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
precursor to the analytics services architecture development.<br />
Comprehensive data access strategy, grid observability strategy<br />
and sensor architecture shall be developed to support the<br />
development of the analytics services architecture.<br />
Distributed analytics in hierarchical analytics services architecture<br />
shall be designed to reduce data volumes for data moving from<br />
edge devices up through successive layers of data management<br />
and analytics to the points of data persistence. This is one of the<br />
points of intersection between analytics services architecture and<br />
communications services and data services architectures. Note<br />
that this type of volume reduction does not apply to usage<br />
(meter) data. Aggregation of non-usage analytics should generally<br />
be homologous with the disaggregation of control signals (see<br />
Control section).<br />
Distributed analytics shall provide logging capabilities for<br />
evaluating analytics operation. This includes event processing, and<br />
the management of analytics logs is a significant data services<br />
architecture issue.<br />
Multiple deployment models to implement analytics shall be used<br />
for distributed analytics including standalone, hierarchical, and<br />
peer models. Event analytics may be broken into event stream<br />
processing at endpoints, feeding higher level complex event<br />
processing at substations, control centers, and data centers.<br />
For low latency analytics, implementations shall be located at or<br />
very near the source(s) of data and the primary outputs<br />
destination(s), without sending data to and from remote<br />
processing centers. Embedded processing shall be used, but the<br />
actual analytics must be downloadable.<br />
Information-sharing among distributed analytics is often<br />
necessary; <strong>Smart</strong> <strong>Grid</strong> analytics services architecture shall include<br />
a real-time distributed data sharing mechanism. This is essential<br />
for access to a global grid state, which is needed not only by<br />
analytics, but also by control and other applications.<br />
Interface of distributed analytics services at the system level<br />
requires that analytics be treated in two ways: as data bound for<br />
data persistence (data stores) and as streams (synchronous or<br />
asynchronous) bound for consumption by applications in realtime.<br />
In some cases, the analytics outputs will be treated both<br />
ways simultaneously, leading to implications for data and<br />
communications services architecture.<br />
As-operated grid connectivity shall be made available to analytics<br />
requiring grid context (grid state), each analytic sensitive to grid<br />
topology must have the correct grid state time-aligned with the<br />
formation of the data or event upon which the analytic depends.<br />
Security shall be part of analytics services design. This includes:<br />
Permissions for source and target data sources<br />
Permissions to execute on centralized and distributed locations<br />
systems architecture is a vital analytics design input.<br />
Provides inputs vital to the development of the<br />
analytics architecture, due to the infrastructure<br />
optimization problem discussed in the section for the<br />
analytics structural model.<br />
The point is that analytics extract key information,<br />
generally resulting in a data volume reduction while<br />
maintaining essential information. In some cases, raw<br />
data may be retained and persisted for later analysis<br />
based on application-specific trigger conditions, but<br />
generally lower latency analytics will consume raw data<br />
and pass along information to either consuming<br />
applications, or higher level analytics. This may not be<br />
feasible in non-hierarchical analytics services<br />
architectures (tier-based data volume management).<br />
Event logging is necessary to support post mortem<br />
analyses of various kinds. With the volume of events<br />
that can be generated in a <strong>Smart</strong> <strong>Grid</strong>, management of<br />
the event logs is a large issue.<br />
It is important to recognize that distributed analytics<br />
elements do not have to be functionally complete in<br />
themselves; it is often more useful for elements to<br />
compute partial results and the either forward them<br />
upward into a hierarchy or exchange partial results<br />
with other distributed elements.<br />
This is a direct consequence of the distributed nature<br />
of power grids and their control systems.<br />
Electrical effects propagate across the grid at very high<br />
speeds and with wide reach. Effects at the distribution<br />
level can affect transmission and vice versa. <strong>Grid</strong> state<br />
and other data may be needed almost anywhere to<br />
support analytics and control.<br />
Some analytics operate on telemetry, but are not used<br />
for real-time operations. They may be monitored by<br />
agents or simply archived for batch processing to<br />
support various business processes. Consequently,<br />
there are both communications and data services<br />
implications that must be coordinated by the smart<br />
grid architect.<br />
This problem is fundamental due to the frequent<br />
topology changes to distribution grids. It is also an<br />
issue for wide area measurement systems. For many<br />
processes it is possible for the grid topology to change<br />
before a prior event or datum is processed, so past<br />
values of grid topology must remain available.<br />
This set of security and management features must be<br />
integrated with the overall security and management<br />
architectures. For implementations of distributed<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 27
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Permissions for analytics to communication to other analytics<br />
Permissions for users to access the dashboards or KPI<br />
Permissions on who can modify/start/stop/deploy analytics<br />
Tools for tracking changes in the actual analytical algorithms<br />
Visualizations are analytics for the eye/brain; therefore,<br />
visualization shall be a part of analytics services architecture.<br />
analytics such as multi-agent systems and others<br />
providing downloadable, zero-touch capability, it is<br />
crucial that the downloadable elements be verifiably<br />
legitimate via certificates, etc.<br />
The smart grid architect should treat visualization as an<br />
integral part of the analytics architecture. Visualization<br />
is needed at many grid levels and locations; treating it<br />
as a separate centralized function can lead to difficulty<br />
in uniformly providing the service.<br />
<strong>Architecture</strong> Standards and Technology Recommendations<br />
Technologies will evolve as a utility’s <strong>Smart</strong> <strong>Grid</strong> transformation takes place over a period of many<br />
years. Changes in analytics services technologies are inevitable. As of this writing, a number of<br />
technologies and standards are appropriate for implementing analytics services. Table 5 lists these<br />
standards with their purpose or relevance; Table 6 similarly lists the in-place or emerging technologies.<br />
Table 5 - Recommended Analytics Standards<br />
Standards<br />
IEC 61850 GOOSE messaging<br />
IEC CIM GID Interface Services<br />
(GDA, HSDA, TSDA, GSE)<br />
IEC Common Information Model<br />
IEEE Computer Society FIPA<br />
(Foundation for Intelligent Physical Agents)<br />
Purpose/Relevance/Comments<br />
For use in low latency protection and control messaging, where analytics<br />
outputs are being used in applications such as adaptive protection and real<br />
time grid stabilization<br />
Four services associated with IEC CIM for data interchange in four classes:<br />
generic data, high speed data, time series, and events<br />
Primary schema for data representation; should also be applied to analytics<br />
outputs, which in themselves are treated as data for purposes of transport,<br />
persistence, and interface to various consuming systems.<br />
For analytics implementations using multi-agent systems<br />
Table 6 - Recommended Analytics Technology<br />
Analytics Technology<br />
Data mining<br />
Digital signal processing<br />
Event stream/complex<br />
event processing<br />
OLAP/Cubing/Dashboard<br />
s<br />
Phasor/power system<br />
calculation processing<br />
Statistical analyses<br />
Visualization<br />
Purpose/Relevance/Comments<br />
Needed to analyze vast volumes of grid data to detect and extract underlying patterns and<br />
models<br />
Needed to extract information from low level grid data such as waveforms and sensor telemetry<br />
Needed to filter, throttle, correlate, and extract situational understanding from multiple<br />
asynchronous event streams from up to millions of grid devices; management of event stream<br />
bursts.<br />
These are visualization tools for data trending and status indication. Such tools should be<br />
connected via appropriate security services to data and analytics output feeds from the control<br />
center, as well as data residing in enterprise databases.<br />
Necessary to support a wide range of real time analytics involving grid state, device utilization,<br />
power flow and load control, and fault analysis<br />
a variety of statistical analysis tools may be applied to problems such as demand and variable<br />
energy resources modeling, as well as customer behavior modeling.<br />
Crucial to translate both data and numerical analytics into forms readily comprehended by<br />
humans for decision support; typically coupled with geospatial and grid topology information<br />
for context; also includes graphics for trending and forecasting on sensor telemetry<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 28
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Data Services<br />
<strong>Smart</strong> grid data services generally reside within the cross domain foundational services box in the<br />
lower right area of Figure 9 - Layered Services Tier View (labeled Data Management Services).<br />
Data Services Logical Model<br />
The Data Services Logical Model [Figure 14] consists of three views: (1) data services synergy, (2) data<br />
services stack, and (3) data management component.<br />
Consumers/<br />
Processes<br />
Data Management Services<br />
Data Classes<br />
Sources<br />
Analytics<br />
SCADA<br />
Data Discovery<br />
System Mgmt<br />
Data<br />
Data Indexing and<br />
<strong>Reference</strong><br />
Data Collection<br />
MDM<br />
Data Services Synergy Model<br />
Protection<br />
Equipment<br />
Unstructured<br />
Content<br />
Data Registration and Life<br />
Cycle Management<br />
Customer<br />
Interface<br />
Enterprise Application<br />
Third<br />
Parties<br />
Data Access & Update<br />
External<br />
Data Feeds<br />
B2B<br />
Field<br />
crews<br />
Consumer Service<br />
Content Management<br />
Master Data Management Data Transformation Data Flow Orchestration<br />
Data Quality and Integrity<br />
Data Storage<br />
IVR/Call<br />
Center<br />
Data Manipulation<br />
Data Security<br />
Operational Data Time Series Data Event Data Records Meta Data<br />
Enterprise<br />
Application<br />
Data Services Stack Model<br />
Foundation<br />
Core<br />
Integration<br />
Visualization<br />
Analysis<br />
Reporting<br />
Network state estimation<br />
Electrical Network model<br />
Measurement model<br />
CIM/61850 interface<br />
Customer information<br />
Premises information<br />
messaging<br />
transformation<br />
encryption<br />
Support Services<br />
governance<br />
transport<br />
storage<br />
Network measurements<br />
Geospatial information<br />
Manually entered information<br />
(inspections, readings, etc.)<br />
Market operations signals<br />
Market operations model<br />
Asset catalogue<br />
Compatible units<br />
Asset data<br />
Edge device model<br />
data access<br />
data synchronization<br />
master data management<br />
access control services<br />
semantic model management<br />
message & service definition<br />
Data Management Component Model<br />
Meta Data<br />
Management<br />
Semantic Model<br />
Management<br />
ETL ESB EII<br />
Persistent Data<br />
Storage<br />
Archive<br />
Figure 14 – Data Services Logical Model<br />
The synergy model (upper left area of Figure 14) shows how <strong>Smart</strong> <strong>Grid</strong> ICT must simultaneously<br />
manage data from many sources to support multiple business outcomes. Data must therefore be<br />
decoupled from data sources to allow sharing of both the data and the components used for moving,<br />
manipulating and storing it. By arranging the architecture to leverage this synergy, the <strong>Smart</strong> <strong>Grid</strong><br />
architect can minimize infrastructure cost while maximizing the realized business value of enterprise<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 29
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
<strong>Smart</strong> <strong>Grid</strong> information management. The Synergy Model has the primary data sources arrayed at the<br />
bottom. Data from these sources fall into one or more of the five data classes depicted in the second<br />
tier. In the third tier, key data management services of the Utility Services Layer and the Core Business<br />
Services Layer process data from the data sources according to data class. In the top tier, various<br />
business processes and consumers leverage the data management services to accomplish higher level<br />
business functions. Line coloring does not have a special meaning except to make line groupings easier<br />
to follow on the crowded diagram. Pervasive security is represented as a blue box in the model’s third<br />
tier, underlying all data management services.<br />
In the data service stack model (upper right area of Figure 14), the core grouping is an abstraction of<br />
capability services types (refer to the discussion of services in Appendix B). These services focus on<br />
business capabilities and are intended to be independent of any particular business process. The stack<br />
model also contains services from the process service and solution service layers used to accomplish<br />
higher level services within the foundation grouping. These foundational services, as well as lower<br />
service layers, are used by the consumers/processes tier of the synergy model to accomplish needed<br />
business functionality.<br />
Data Services Structural Model<br />
The data services structural model [Figure 15] illustrates how data services can be distributed across a<br />
smart grid. This is important to the smart grid architect because distributed data architecture can<br />
address issues of data access, storage, transformation, latency, encryption, and synchronization within<br />
and across layers in the physical grid. While traditionally these services have been concentrated in data<br />
and control centers, in a smart grid these distributed data services will reside in substations, field<br />
devices, and in various network locations from the end use premises to the control center. A selfdescribing<br />
template used for this model is on the last page of Appendix B, Services Classes Concepts.<br />
Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 30
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 15 - Data Services Structural Model<br />
Data <strong>Architecture</strong> Specifications<br />
Table 7 is a list of general data specifications. The justification for each is provided to enhance the<br />
reader’s understanding of each specification.<br />
Table 7 - Typical Data Services Specifications<br />
Specification<br />
A semantic model shall be built to create and<br />
maintain common business definitions,<br />
business rules (requirements), and metadata.<br />
Data classification shall be performed.<br />
Justification<br />
The creation of common business definitions will facilitate<br />
communications in all directions within the organization. This should be<br />
accomplished as an integral part of incrementally building the enterprise<br />
semantic model.<br />
Classify data for security and management purposes.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 31
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Specification<br />
Data Enrichment shall be provided where<br />
necessary.<br />
Data integration shall be provided.<br />
Data movement shall be provided.<br />
Data quality and integrity shall be source<br />
guaranteed.<br />
Appropriate security shall be applied to data.<br />
Data shall not be tied to applications<br />
Appropriate access shall be provided to data<br />
sources<br />
Data synchronization shall be supported<br />
where necessary.<br />
Data transformation shall be provided where<br />
necessary.<br />
Data shall be validated as appropriate.<br />
Data Object Indexing and referencing shall be<br />
provided.<br />
Data growth shall be managed.<br />
Master data management shall be provided.<br />
Methods shall be provided for understanding<br />
and removing data duplication<br />
Justification<br />
Enrich the data by supplementing it with other sources as needed and per<br />
the understood the business process that is implemented<br />
Integration data for process automation and business transactions.<br />
Enable data to move from one source to another.<br />
Ensure that the data is guaranteed by the source to be of primary source<br />
quality and not derived or distorted by secondary views.<br />
Provide security for data in accordance with its classifications. Security<br />
activities include authentication and authorization, logging, and control.<br />
Data should be made available as master data. A single view of data<br />
should exist across the enterprise – shared, complete, and accurate.<br />
Provide access to data sources, either through application or directly,<br />
while maintaining appropriate security.<br />
Synchronize data instance and content for multiple systems of same data.<br />
Transform data from one semantic and syntax to another.<br />
Validate data in accordance with defined business rules.<br />
Centralize a robust means of translating data object identifications<br />
between disparate systems.<br />
Adhering to EIM practices will avoid having the same data expressed in<br />
multiple ways, each with the same or similar meaning. Data growth is also<br />
managed by understanding what data must be retained for what periods<br />
of time and within which physical data stores and systems.<br />
Ensure consistent master information across transactional and analytical<br />
systems.<br />
Have repeatable rules definition for guaranteeing data quality.<br />
Data <strong>Architecture</strong> Standards and Technology Recommendations<br />
The following table of data standards and technology recommendations is provided to the smart grid<br />
architect for reference. Over time, however, innovations will inevitably diminish its completeness. The<br />
architect should always research the latest information on these topics, but this table is a good starting<br />
point. Table 8 lists important 2011 standards and technology recommendations applicable to data<br />
services, each with a brief explanation of their purpose or relevance.<br />
Table 8 - Data Standards and Technology Recommendations<br />
Standards<br />
Applicable functional<br />
standards of the IEC<br />
61968 and 61970 series<br />
of standards<br />
IEC 61850<br />
IEC 61968-11<br />
Purpose/Relevance/Comments<br />
Industry standard message payloads are defined using XSD and RDF. Canonical Data Models<br />
(CDMs) of a utility may be compliant with, or based of (if extensions are required) these industry<br />
standard message payloads.<br />
Object oriented protocol for retrieving data and controlling devices at substations and along<br />
feeder networks.<br />
System Interfaces For Distribution Management Part 1 Interface <strong>Architecture</strong> and General<br />
Requirements<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 32
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Standards<br />
Purpose/Relevance/Comments<br />
IEC 61968-11 and IEC IEC Common Information Model. Information model for data representation which is used as a<br />
61970-301<br />
basis for defining industry standard application interfaces.<br />
MultiSpeak<br />
The MultiSpeak project is funded by National Rural Electric Cooperative Association (NRECA). It<br />
defines standardized interfaces among software applications commonly used by electric utilities.<br />
It defines details of data that need to be exchanged between software applications in order to<br />
support different processes commonly applied at utilities.<br />
OASIS UDDI<br />
Universal Description, Discovery and Integration (UDDI) is a platform-independent, Extensible<br />
Specification<br />
Markup Language (XML)-based registry is a mechanism to register and locate web service<br />
applications.<br />
Simple Object Access SOAP, originally defined as Simple Object Access Protocol, is a protocol specification for<br />
Protocol (SOAP) exchanging structured information in the implementation of Web Services in computer networks.<br />
It relies on Extensible Markup Language (XML) for its message format, and usually relies on other<br />
Application Layer protocols, most notably Remote Procedure Call (RPC) and Hypertext Transfer<br />
Protocol (HTTP), for message negotiation and transmission. SOAP can form the foundation layer<br />
of a web services protocol stack, providing a basic messaging framework upon which web services<br />
can be built. This XML based protocol consists of three parts: an envelope, which defines what is<br />
in the message and how to process it, a set of encoding rules for expressing instances of<br />
application-defined data types, and a convention for representing procedure calls and responses.<br />
W3C XML Specification Extensible Markup Language (XML) is a set of rules for encoding documents in ... in the XML 1.0<br />
Specification produced by the W3C.<br />
WSDL<br />
WSDL is an XML-based language for describing Web services and how to access them.<br />
WS-I Basic Profile The WS-I Basic Profile (official abbreviation is BP), a specification from the Web Services<br />
Interoperability industry consortium (WS-I), provides interoperability guidance for core Web<br />
Services specifications such as SOAP, WSDL, and UDDI. The profile uses WSDL to enable the<br />
description of services as sets of endpoints operating on messages.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 33
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Control Services<br />
<strong>Smart</strong> grid control services generally reside within the cross domain foundational services box in the<br />
lower right area of Figure 9 - Layered Services Tier View.<br />
Control Services Logical Model<br />
The Control Services Logical Model [Figure 16] has three views: control synergy, control services stack,<br />
and control component.<br />
Figure 16 - Control Services Logical Model<br />
The synergy model diagram (upper left area of Figure 16) is the most complex, containing four tiers.<br />
The bottom two tiers match the analytics synergy model described previously. The third tier consists of<br />
key smart grid control services. The top tier shows control-oriented business processes. At the bottom<br />
of the second tier, connectors illustrate how various grid devices create data for use in control. Line<br />
color is only for the purpose of visual clarification – the colors do not signify any special property or<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 34
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
characteristic. The synergy model diagram highlights several crucial issues for the smart grid architect<br />
to analyze:<br />
Need for grid state aggregation and publication.<br />
Use of multi-controller, multi-objective control inherent in smart grid design using grid data<br />
sources to support multiple business processes via processing of multiple analytics.<br />
Federation of control systems as a consequence of multi-controller, multi-objective control.<br />
Disaggregation of control command at the device level. This must take into account the<br />
actual grid topology at the time of control actuation, as well as various grid state variables.<br />
These significantly impact the design of controls, communications, sensor, and analytics architectures.<br />
Control Services Structural Model<br />
The control services structural model [Figure 17] is provided to help the smart grid architect consider<br />
how to best deploy the various control services using a stylized representation of a typical utility<br />
network infrastructure. At the top of the model are elements needed to support external agencies<br />
(regulators, interchange and balancing authorities, etc.). At the bottom are the control services needed<br />
by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a<br />
dozen other tiers where control services may be located to support residing devices and functionality.<br />
A self-describing template used for this model is on the last page of Appendix B, Services Classes<br />
Concepts. Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 35
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 17 - Control Services Structural Model<br />
Control <strong>Architecture</strong> Specifications<br />
Table 9 is a list of general control specifications. The justification for each is provided to enhance the<br />
reader’s understanding of each specification.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 36
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Table 9 - Typical Control Specifications<br />
Specification<br />
Control signals must be disaggregated in a hierarchical manner<br />
in parallel to both the general structure of the power grid and<br />
the aggregation of analytics and grid state (see Analytics<br />
section).<br />
Control system architecture must provide means to control<br />
systems not part of the grid itself.<br />
Control system must integrate adaptive protection at both<br />
transmission and distribution levels.<br />
Control systems for demand response and DER control must<br />
provide for dispatch from the balancing authority; control<br />
signals must be disaggregated to the distribution substation<br />
level, and from there to the feeder device and premises level.<br />
IVVC must be coordinated with DR at the distribution feeder<br />
level, so the control architecture must provide for control<br />
disaggregation and recalculation at multiple levels in the grid.<br />
Control systems must have access to grid state determined by<br />
both wide area measurement as well as deep measurement;<br />
deep measurement means grid state at the distribution and<br />
premises levels must be part of extended grid state; the control<br />
system architecture must provide for wide distribution of grid<br />
state across control elements.<br />
Control systems must support both event-driven functions and<br />
closed loop servo functions. Close loop servo control<br />
architecture must accommodate multiple time scale operation,<br />
so control architectures must provide means for complex<br />
feedback and feed forward.<br />
For grids where stabilization or compensation is required at the<br />
distribution level, the control system shall be capable of<br />
operating with a complete closed loop path execution in less<br />
than two power cycles.<br />
<strong>Grid</strong> state determination for wide area measurement and wide<br />
area control shall depend to the maximum degree possible on<br />
actual measurement, with the minimum estimation necessary<br />
to complete the grid state view. Control system architecture<br />
must distribute grid state across control systems elements in<br />
real time in a secure manner.<br />
Justification<br />
All grid systems are interconnected through the analog<br />
power grid with many interactions. To provide the means<br />
to reconcile control commands and eliminate<br />
undesirable interactions, the grid structure must guide<br />
control signal disaggregation. Control system<br />
architecture not providing for disaggregation at the<br />
various levels of the grid hierarchy will limit the ability of<br />
control system designers to solve interaction problems.<br />
Secondary load control for Demand Response and<br />
integration of DER, microgrids, and PEV charging<br />
stations/networks requires utility interface due to<br />
interactions resulting in grid management issues.<br />
The increasing penetration of secondary load control<br />
systems causes interactions, including non-outage cold<br />
load pickups requiring dynamic modification of<br />
protection settings based on both grid state and control<br />
actions.<br />
Without the proper disaggregation, interaction between<br />
DR and IVVC can cause grid violations, and can cause DR<br />
to be significantly less effective than expected. Other<br />
interactions of grid controls and secondary load controls<br />
can occur, up to and including wide area blackout.<br />
Extended grid state is the essence of deep situational<br />
awareness and is the primary set of observations driving<br />
control systems. As multiple control sub-systems share<br />
common elements, ubiquitous access to grid state<br />
becomes crucial.<br />
Some control functions can be event based, but other<br />
highly dynamic processes such as stabilization require<br />
continual closed loop control update. With multi-time<br />
scale systems, control loops must be more complex than<br />
simple feedback, so control architecture must support<br />
multi-feedback, multi-time scale operation.<br />
Dynamics of close loop stabilization require much faster<br />
response and much lower latencies than traditional<br />
distribution automation. New control devices are<br />
capable of acting at these speeds (see Control<br />
Technology table below).<br />
Advanced grid controls need access to actual grid state;,<br />
especially at the distribution level where estimation is<br />
effectively impossible. In addition, extended grid state<br />
contains elements not susceptible to estimation, such as<br />
quality state.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 37
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Specification<br />
Multiple control systems must be federated before control<br />
signals are sent to individual devices. The control service<br />
environment shall be a multi-controller, multi-objective<br />
environment.<br />
Power grid control must be a hybrid of centralized and<br />
distributed control elements, with distributed control extending<br />
into substations and to distribution grid elements; control<br />
elements shall be able to use peer-to-peer communication to<br />
cooperate on control tasks and shall be capable of autonomous<br />
operation when communication with higher level controls is not<br />
possible.<br />
<strong>Smart</strong> grid control systems can require cross tier integration;<br />
this may be accomplished in a hierarchical fashion normally or<br />
via “tier-jumping” where very low latency is required. Control<br />
system architecture must allow for cross-tier control solutions.<br />
System models (connectivity models) for transmission,<br />
substations, and distribution are context for control - control<br />
systems must have a means to receive the relevant portions of<br />
connectivity models from the master sources in a secure and<br />
timely manner. Timeliness is dependent on the rate at which<br />
connectivity changes can occur relative to the essential time<br />
constants of the relevant control subsystems.<br />
Teleprotection must be done via packet switching (Ethernetbased)<br />
networks rather than circuit switching networks<br />
Justification<br />
As smart grid functionality increases in sophistication,<br />
more control processes have reasons to access the same<br />
control elements in the grid. Such sharing is important<br />
for economic reasons but the controls must not collide at<br />
the control elements; hence the need for federation in<br />
the architecture to provide resolution mechanisms.<br />
Centralized control is not adequate for fully built out<br />
smart grids; using a combination of centralize and<br />
distributed control elements provides scalability and<br />
robustness while maintaining central supervision and<br />
management of the grid.<br />
<strong>Smart</strong> grid controls are increasingly required to deal with<br />
effects propagating through the grid, including from<br />
distribution to transmission. In addition, some business<br />
models allow for secondary control systems external to<br />
the utility control system and operating across tiers.<br />
System models are context for both analytics and<br />
control; without this context proper control action<br />
cannot be determined.<br />
Tele-protection in a smart grid environment needs<br />
flexibility not available via circuit switching<br />
Control <strong>Architecture</strong> Standards and Technology Recommendations<br />
The following table of control standards and technology recommendations is provided to the smart<br />
grid architect for reference. Over time, however, innovations will inevitably diminish its completeness.<br />
The architect should always research the latest information on these topics, but this table is a good<br />
starting point. Table 10 lists important 2011 standards and technology recommendations applicable to<br />
control services, each with a brief explanation of their purpose or relevance.<br />
Table 10 - Recommended Control Standards and Technology<br />
DNP3<br />
Standards<br />
IEC 60870-5-101,104<br />
IEC 61850 GOOSE messaging<br />
IEC 61850-90-5<br />
IEC CIM GID Interface Services<br />
(GDA, HSDA, TSDA, GSE)<br />
Purpose/Relevance/Comments<br />
Commonly used for communication with grid control devices. May be<br />
operated in native serial fashion, or over IP.<br />
Serial communication for control devices.<br />
For use in low latency protection and control messaging<br />
Draft standard for PMU communications –support for multi-cast<br />
Four services associated with IEC CIM for data interchange in four classes:<br />
generic data, high speed data, time series, and events<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 38
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Standards<br />
IEC Common Information Model<br />
IEEE C37.118<br />
IEEE Computer Society FIPA<br />
(Foundation for Intelligent Physical Agents)<br />
Purpose/Relevance/Comments<br />
Primary schema for data representation; should also be applied to<br />
analytics outputs, which in themselves are treated as data for purposes of<br />
transport, persistence, and interface to various consuming systems.<br />
PMU communications<br />
For control implementations using multi-agent systems<br />
Most grid control devices and control systems are well known. The section below discusses some<br />
advanced control elements and technologies.<br />
Table 11- Advanced Control Elements and Technologies<br />
Control Technology<br />
Distribution level PMU<br />
networks<br />
DSTATCOM<br />
Multi-agent systems<br />
STATCOM / SVC /<br />
FACTS / fast ancillary<br />
storage<br />
VAR-controllable AC-<br />
DC inverters<br />
WAMS/PMU networks<br />
Purpose/Relevance/Comments<br />
Can provide distribution grid state, fault intelligence, asset utilization measurement and outage<br />
intelligence inputs for the relevant control sub-systems.<br />
Distribution STATCOM provides electronic stabilization and dynamic power quality compensation<br />
at the distribution level.<br />
Software technology for implementation of distributed intelligence; can be used to implement<br />
distributed control agents.<br />
Increasingly important for electronic stabilization as grid rotational inertia is decreased through<br />
the displacement of traditional generation with VER. Includes such applications as model power<br />
oscillation damping and frequency compensation.<br />
When used as grid interfaces from DG and microgrids, and when controlled by the utility, these<br />
can provide fast VAR compensation (much faster than capacitors) and can provide much finer<br />
granularity in VAR control.<br />
Provide necessary state measurement for transmission control.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 39
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Security Services<br />
<strong>Smart</strong> grid security services generally reside within the cross domain foundational services box in the<br />
lower right area of Figure 9 - Layered Services Tier View.<br />
Security Logical Model<br />
The Security Logical Model [Figure 18] has three views: the security component, the security services<br />
stack, and security synergy.<br />
Figure 18 - Security Logical Model<br />
The Security Component Model depicts in block format the primary security components used.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 40
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The Security Services Stack Model has several parts:<br />
• Support services – services that may come from another portion or tier of the architecture but<br />
are necessary to support the services in the tier being described<br />
• Foundation services – key security services, generally needed throughout the architecture which<br />
other services depend or expand upon<br />
• Core services – the primary security architecture service stack<br />
• Integration services – services specifically providing integration between security and other<br />
architectural tiers or business systems<br />
The Security Synergy Model illustrates how security services can be shared to meet various <strong>Smart</strong> <strong>Grid</strong><br />
security requirements. If the architecture can take advantage of this synergy, the utility can build cost<br />
effective security infrastructure services, reused across multiple <strong>Smart</strong> <strong>Grid</strong> systems.<br />
Security Structural Model<br />
The security structural model [Figure 19] is provided to help the smart grid architect consider how to<br />
best deploy the various security services using a stylized representation of a typical utility network<br />
infrastructure. At the top of the model are elements needed to support external agencies (regulators,<br />
interchange and balancing authorities, etc.). At the bottom are the security services needed by premise<br />
devices (smart appliances, PEV chargers, building energy managers, etc.). In between are a dozen other<br />
tiers where security services may be located to support residing devices and functionality. A selfdescribing<br />
template used for this model is on the last page of Appendix B, Services Classes Concepts.<br />
Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 41
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 19 - Security Structural Model<br />
The structural model illustrates how security functionality may be distributed across a <strong>Smart</strong> <strong>Grid</strong>. The<br />
<strong>Smart</strong> <strong>Grid</strong> architect needs to work closely with security experts to ensure appropriate security<br />
principles are applied at every level of the <strong>Smart</strong> <strong>Grid</strong> structure. As the grid evolves, millions of new<br />
components will be introduced; each is expected to ensure power systems operations maintain cyber<br />
confidentiality, integrity, and availability. The NIST Interagency Report 7628 (NISTIR 7628), Guidelines<br />
for <strong>Smart</strong> <strong>Grid</strong> Cyber Security: Vol. 1 (NIST-ITL, 2010) provides a <strong>Smart</strong> <strong>Grid</strong> Logical <strong>Reference</strong> Model<br />
with dozens of logical interfaces identified. Chapter 2 and Appendix G of NISTIR 7628 should be<br />
studied to ensure appropriate security attributes are addressed for each logical interface category.<br />
NISTIR 7628 is freely available on the NIST <strong>Smart</strong> <strong>Grid</strong> website: www.nist.gov/smartgrid<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 42
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Security <strong>Architecture</strong> Specifications<br />
NISTIR 7628, Chapter 3, has an extensive listing of high level <strong>Smart</strong> <strong>Grid</strong> security requirements.<br />
Security Standards and Technology Recommendations<br />
The following table of security standards and technology recommendations is provided to the smart<br />
grid architect for reference. Over time, however, innovations will inevitably diminish its completeness.<br />
The architect should always research the latest information on these topics, but this table is a good<br />
starting point. Table 12 lists important 2011 standards and technology recommendations applicable to<br />
security, each with a brief explanation of their purpose or relevance.<br />
Table 12 - Security Standards and Technology Recommendations<br />
Standards<br />
Purpose, Relevance or Comments<br />
Digital Signature (DSS, DSA, RSA, etc.)<br />
Cryptography and network security<br />
DNP3 Secure Authentication<br />
User & device authentication, data integrity protection<br />
Encryption (AES, RSA, etc.)<br />
Facilitates secure (secret) communication<br />
Hash (SHA-1, SHA-256, HMAC, etc.)<br />
Cryptographic hash functions employed in several widely used security<br />
applications<br />
IEC 62351 Utility Communication Security Developed to handle the security of IEC Technical Committee 57<br />
protocols (IEC 61850, 61968, etc.)<br />
IEEE 1686 IED Security<br />
Minimum requirement set for intelligence electronic device security<br />
compliance with NERC CIP requirements<br />
IEEE 1711 Trial Use Standard for a SCADA Serial Cyber Security of substation serial links<br />
Link Cryptographic Modules and Protocol<br />
IPSec<br />
Internet Protocol Security secures IP communications by authenticating<br />
and encrypting each session’s IP packets<br />
NERC Critical Infrastructure Protection (CIP) The NERC Critical Infrastructure Protection program aims to improve<br />
Standards<br />
physical and cyber security for the bulk power system of North America<br />
as it relates to reliability.<br />
Public Key Infrastructure (X.509)<br />
A cryptographic ITU-T standard for a public key infrastructure (PKI) for<br />
single sign-on (SSO) and Privilege Management Infrastructure (PMI)<br />
PubsFIPS<br />
Federal Information Processing Standards (FIPS) Publications - a series<br />
of documents for the U.S. Federal government issued by NIST<br />
TLS<br />
Transport Layer Security, a network protocol and successor to Secure<br />
Sockets Layer (SSL)<br />
Wireless Security (WEP, WPA, etc.)<br />
IEEE 802.1X encryption standards designed to prevent unauthorized<br />
access or damage to computers using wireless networks<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 43
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Communications Services<br />
<strong>Smart</strong> grid communications services generally reside within the cross domain foundational services<br />
box in the lower right area of Figure 9 - Layered Services Tier View.<br />
Communications Services Logical Model<br />
The Communications Services Logical Model [Figure 20] has three views: the communications services<br />
component, communications services stack, and communications services synergy.<br />
Figure 20 – Communications Services Logical Model<br />
The Communications Services Component Model depicts in block format the primary communications<br />
components used in the architecture.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 44
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The Communications Services Stack Model has several parts:<br />
• Support services – services that may come from another portion or tier of the architecture but<br />
are necessary to support the services in the tier being described<br />
• Foundation services – key security services, generally needed throughout the architecture which<br />
other services depend or expand upon<br />
• Core services – the primary communications architecture service stack<br />
• Integration services – services specifically providing integration between communications and<br />
other architectural tiers or business systems<br />
The Communications Synergy Model illustrates how communications services can be shared to meet<br />
various <strong>Smart</strong> <strong>Grid</strong> communications requirements. If the architecture can take advantage of this<br />
synergy, the utility can build a cost effective communications infrastructure services, reused across<br />
multiple <strong>Smart</strong> <strong>Grid</strong> systems.<br />
Communications Services Structural Model<br />
The communications services structural model [Figure 21] is provided to help the smart grid architect<br />
consider how to best deploy the various communications services using a stylized representation of a<br />
typical utility network infrastructure. At the top of the model are elements needed to support external<br />
agencies (regulators, interchange and balancing authorities, etc.). At the bottom are the<br />
communications services needed by premise devices (smart appliances, PEV chargers, building energy<br />
managers, etc.). In between are a dozen other tiers where communications services may be located to<br />
support residing devices and functionality. A self-describing template used for this model is on the last<br />
page of Appendix B, Services Classes Concepts. Included are descriptions of all fourteen tiers used in the<br />
model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 45
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 21 - Communications Services Structural Model<br />
Communications <strong>Architecture</strong> Specifications<br />
Table 13 is a list of general control specifications. The justification for each is provided to enhance the<br />
reader’s understanding of each specification.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 46
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Table 13 - Typical Communications Specifications<br />
Specification<br />
<strong>Architecture</strong> for end-to-end communications shall be divided into functional<br />
subnetworks including the following:<br />
Extranet<br />
Data/Control Center Networks<br />
Two Tier Wide Area Network<br />
Core Network<br />
Backhaul Network<br />
Substation Network<br />
Two Tier Field Area Network<br />
Tier 1 Multipurpose FAN<br />
Tier 2 Purpose-Built FAN<br />
Premises Network<br />
Backhaul Wide-Area Networks Deployment<br />
Design specs shall:<br />
Accommodate tightly controlled access from remote networks<br />
Provide a high degree of security<br />
Provide high network performance primarily using fiber, microwave and<br />
other infrastructures<br />
Provide flexible network segmentation/virtualization capabilities, in support<br />
of a variety of application, security, and geographical domains<br />
Support data, voice, video, and control services<br />
Be based on IPv6 technologies<br />
Support convergence such that, if desired, traffic from one does not harm or<br />
adversely impact traffic from other environments<br />
Operational specs should:<br />
Support key remote locations where grid logic is employed<br />
Be under autonomous control by utility (if private) or accompanied by strict<br />
service-level agreements (if public)<br />
Provide a high degree of network monitoring and system management<br />
Communication architecture shall anticipate and support highly distributed data<br />
collection, control, and analytics environments.<br />
Communication networks shall be based on standardized packet transport<br />
services and utilize IPv6 technology.<br />
Justification<br />
Each of the sub-network domains<br />
has unique functional<br />
characteristics regardless of<br />
communications technology<br />
considered.<br />
Provides high performance and<br />
resilient connectivity between<br />
core wide-area networks and key<br />
remote facilities (such as outlying<br />
substations) or to points of<br />
network concentration (such as<br />
remote communications huts).<br />
High performance attributes:<br />
from hundreds of Megabits to<br />
multi-Gigabit, extremely low<br />
latency, deterministic traffic<br />
support, very high reliability.<br />
Data collection, control and<br />
analytics are evolving from<br />
centralized to distributed<br />
environments and the<br />
communication architecture must<br />
support this evolution.<br />
IPv6 offers superior networking<br />
functionality and can scale to<br />
meet the needs of <strong>Smart</strong> <strong>Grid</strong>.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 47
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Specification<br />
Communication services must be centrally and uniformly managed. The<br />
management mechanism should be integrated with grid device management.<br />
Completion of a comprehensive set of anticipated use cases is a critical<br />
foundation for the development of the communication services architecture<br />
Core Wide-Area Networks Deployment<br />
Design specs should:<br />
Accommodate tightly controlled access from remote networks<br />
Provide the highest degree of security<br />
Provide high network performance (multi-Gigabit, extremely low latency,<br />
deterministic traffic support, very high reliability, rapid failover, extensive<br />
redundancy) primarily using fiber and other infrastructures<br />
Provide flexible network segmentation/virtualization capabilities, in support<br />
of a variety of application, security and geographical domains<br />
Support data, voice, video, and control services<br />
Be based on IPv6 technologies<br />
Utilize diversely connected, redundant connectivity architectures (such as<br />
ring or mesh topologies)<br />
Support convergence such that, if desired, traffic from one environment<br />
does not harm or adversely impact traffic from other environments<br />
Operational specs should<br />
Directly support key remote locations where grid logic has been employed<br />
Be under autonomous control by utility (if private) or be accompanied by<br />
strict Service Level Agreements (if public)<br />
Provide a high degree of network monitoring and system management<br />
Development of holistic end-to-end communication architecture is critical to<br />
support entire application, control and analytics environments.<br />
Justification<br />
Communication systems entail<br />
many diverse, interconnected and<br />
interdependent communication<br />
links. These systems are also<br />
interdependent with grid devices<br />
and each management system<br />
should inform the other for<br />
service impacts.<br />
Provides comprehensive inputs<br />
and requirements vital to the<br />
development of the<br />
communications architecture.<br />
Prevents silo view that can lead<br />
to duplicate infrastructure and<br />
expenses.<br />
Provides high performance and<br />
resilient connectivity within the<br />
same organization’s data/control<br />
centers, from data/control<br />
centers to key remote facilities<br />
(such as substations), and from<br />
data/control centers to points of<br />
backhaul network<br />
interconnection<br />
Application, control and analytics<br />
endpoints span multiple domains<br />
of the communications<br />
architecture.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 48
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Extranet Network Deployment<br />
Design specs should:<br />
Specification<br />
Provide network security suitable for a plethora of access scenarios<br />
Support access for thousands to millions of users (based on the number of<br />
customers served by the utility)<br />
Interconnect to several public infrastructures (carriers) and offer various<br />
networking services (Internet, data, voice, video, control)<br />
Provide performance and capacity commensurate to normal business needs<br />
as well as sufficient additional capacity to accommodate emergency<br />
situations<br />
Include link and service failover mechanisms to alternative external<br />
networks and/or service providers<br />
Operational specs should:<br />
Assume that extranet connectivity may not allow utility autonomous control<br />
over service<br />
Assume that extranet connectivity offers lesser degree of monitoring and<br />
management to remote devices than private networking<br />
Consider extranet connectivity is dependent on others for reliability and<br />
performance<br />
Consider extranet connectivity cost structure is largely capacity driven<br />
Local Area Networks within Operations/Data Centers Deployment<br />
Design specs should:<br />
Provide extremely tight access controls<br />
Provide the highest degree of security<br />
Provide highest degree of network performance (multi-Gigabit, extremely<br />
low latency, highest reliability, rapid failover, extensive redundancy) using<br />
fiber and other infrastructures<br />
Provide complete virtualization capabilities, including server, network,<br />
storage, security, and application services<br />
Support data, voice, video, and control services<br />
Minimize power consumption and provide redundant/backup power<br />
Operational specs should:<br />
Serve as a key location for grid intelligence<br />
Serve as termination facility for redundant extranet communications<br />
Serve as termination facility for redundant internal core networks<br />
Be under full autonomous control by utility or their designee<br />
Provide the highest degree of monitoring and system management<br />
Justification<br />
Provides connectivity outside the<br />
utility (to customers, suppliers,<br />
business partners, emergency<br />
services, the public at large, and<br />
to off-site utility employees) with<br />
appropriate access and isolation<br />
For high-performance hosting of<br />
centralized data collection,<br />
control and analytics applications;<br />
hosting storage systems and<br />
enabling operator/worker access,<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 49
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Premises Networks Deployment<br />
Design specs:<br />
Specification<br />
Provide controlled access to premises-located devices<br />
Provide the highest degree of security<br />
Provide network performance commensurate with applications (from tens<br />
to several hundred kilobits, application specific latency, sufficient reliability,<br />
and redundancy where appropriate)<br />
Support data and control services<br />
Be based on IPv6 technologies<br />
Operational Specs should:<br />
Aggregate and deliver traffic from premises devices to energy controllers,<br />
displays, or gateways<br />
Use unlicensed spectrum under control of premises owner/operator<br />
Support self-discovery and auto-configuration of endpoint devices<br />
Substation Local Area Network Deployment<br />
Design Specs should:<br />
Accommodate very tightly controlled access from intra-station devices or<br />
from field area networks<br />
Provide the highest degree of security<br />
Provide high network performance primarily using fiber and other high<br />
performance infrastructures<br />
Support virtualization capabilities internal to the station as well as to the<br />
Backhaul WAN<br />
Require segregated overlay solutions for separating process bus traffic from<br />
other traffic<br />
Support data, voice, video, and control services<br />
Be based on IPv6 technologies<br />
Be capable (if desired) of supporting diversely connected WAN uplinks<br />
Support convergence such that, if desired, traffic from one environment<br />
does not harm or adversely impact traffic from other environments<br />
Provide autonomous support for low-level networking functions (such as<br />
DHCP, distributed DNS, and gateway services)<br />
Operational Specs should:<br />
Directly support devices and systems where grid logic is collected, executed,<br />
and stored<br />
Be under autonomous control by utility<br />
Provide the highest degree of network monitoring and system management<br />
Support interconnection of Field Area Networks<br />
Justification<br />
To provide connectivity to<br />
premises devices (such as inhome<br />
displays, programmable<br />
communicating thermostats, etc)<br />
and premises energy controllers<br />
or a gateway,<br />
To provide coverage to smart<br />
devices within and nearby the<br />
substation. High performance<br />
attributes: several hundred<br />
Megabit or even multi-Gigabit,<br />
extremely low latency,<br />
deterministic traffic support, very<br />
high reliability rapid failover,<br />
redundancy<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 50
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Tier 1 Field Area Networks Deployment<br />
Design Specs should:<br />
Specification<br />
Provide controlled access from field-located devices or from subtending<br />
Tier 2 Field Area Networks<br />
Provide the highest degree of security<br />
Provide high network performance commensurate with applications<br />
(from one to tens of Megabits, low latency, sufficient reliability, and<br />
redundancy where appropriate)<br />
Support virtualization capabilities to maintain traffic segmentation<br />
Support data, voice, video, and control services<br />
Be based on IPv6 technologies<br />
Operational Specs should:<br />
Aggregate and deliver traffic to places where grid intelligence has been<br />
distributed<br />
Require the spectrum to be under autonomous control by the utility<br />
when wireless networking technologies are deployed<br />
Provide the highest degree of network monitoring and system<br />
management<br />
Support self-discovery and auto-configuration of endpoint devices<br />
Support interconnection of Tier 2 Field Area Networks<br />
Tier 2 Field Area Networks Deployment<br />
Design Specs should:<br />
Provide controlled access from field-located devices<br />
Provide the highest degree of security<br />
Provide network performance commensurate with applications (from tens<br />
to several hundred kilobits, application specific latency, sufficient reliability,<br />
and redundancy where appropriate)<br />
Support data and control services<br />
Be based on IPv6 technologies<br />
Operational Specs should:<br />
Aggregate and deliver traffic to places where grid intelligence has been<br />
distributed<br />
Require the spectrum to be under autonomous control by the utility when<br />
wireless networking technologies are deployed<br />
Provide the highest degree of network monitoring and system management<br />
Support self-discovery and auto-configuration of endpoint devices<br />
Justification<br />
To provide general multi-purpose<br />
connectivity and access services<br />
to field devices so that they can<br />
connect to data/control centers,<br />
distributed applications (perhaps<br />
at substations), and to other fieldlocated<br />
endpoints (for peer-topeer<br />
communications)<br />
To provide purpose-built<br />
coverage and access services to<br />
field devices designed to connect<br />
to data/control centers,<br />
distributed applications (perhaps<br />
at substations), and to other fieldlocated<br />
endpoints (for peer-topeer<br />
communications)<br />
Communications <strong>Architecture</strong> Standards and Technology Recommendations<br />
Table 14 lists key standards for the <strong>Smart</strong> <strong>Grid</strong> communications architecture view. Standards<br />
continually change as technologies evolve; therefore this list should not be considered a comprehensive<br />
or exhaustive list of standards and technology recommendations.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 51
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Table 14 - Recommended Communications Standards and Technology<br />
Standards<br />
Purpose/Relevance/Comments<br />
IEC 61850 family of standards<br />
IEEE 1613<br />
IPv6<br />
Multi-Protocol Label Switching (MPLS)<br />
OSI <strong>Reference</strong> Model<br />
PHY - MAC standards typical to the various<br />
communication sub-networks:<br />
Extranet – PSTN technologies (ITU-T), SONET/SDH<br />
technologies, Metro-Ethernet<br />
Data/Control Center – Ethernet (IEEE 802.3<br />
family), Fiber Channel Protocol (INCITS T11)<br />
WAN – SONET/SDH technologies, Metro-Ethernet<br />
Field Area Networks – LTE (carrier-provided), IEEE<br />
802.16 (WiMAX), IEEE 802.11 (WiFi), IEEE<br />
802.15.4 (<strong>Smart</strong> Utility Networks), IEEE 802.3<br />
(Ethernet)<br />
Premises Area Networks – IEEE 802.11 (WiFi),<br />
IEEE 802.15.4 (Zigbee), IEEE P1901 (Power Line<br />
Communications)<br />
Describes communication principles, models, and capabilities used to<br />
support applications in electric power systems.<br />
Deals with environmental requirements for communication networks<br />
supporting electric power substations.<br />
The latest version of the Internet Protocol which has significantly more<br />
address space and enhanced networking features<br />
A hybrid data-link/network-layer packet-based transport service used<br />
in Wide Area Networks. Can support circuit-oriented or packetoriented<br />
communications. Capable of supporting deterministic traffic.<br />
Offers high degree of network virtualization.<br />
<strong>Reference</strong> model for describing communication systems using seven<br />
layers of functionality (physical, data link, network, transport, session,<br />
presentation, application). Each layer provides a common set of<br />
services to other adjacent layers.<br />
Each communication sub-network has functional requirements<br />
commonly addressed by using certain types of communication<br />
technologies. While standardization at the network layer and above<br />
helps support end-to-end interoperability, choices must be made at the<br />
physical layer (PHY) and media access control layer (MAC) largely based<br />
on geographic and environmental issues.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 52
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Management<br />
<strong>Smart</strong> grid management services generally reside within the cross domain foundational services box in<br />
the lower right area of Figure 9 - Layered Services Tier View.<br />
Management Framework<br />
The Management Framework [Figure 22] presents smart grid management services as a stack of layers<br />
reaching from electrical devices at the bottom to systems management at the top. This should help the<br />
reader visualize the pervasive nature of management services and the resulting architectural scope..<br />
Figure 22 - Management Framework<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 53
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The architecture is a model with four management layers (MLs). Element ML is at the bottom, the<br />
System ML and Services ML in the middle and <strong>Smart</strong> <strong>Grid</strong> ML at the top. Lifecycle and Technology<br />
Management Services are on the Element ML. Event, Asset and Security Management comprise the<br />
System ML. Performance and Policy Management is on Services ML. The Manager of Managers,<br />
performing all services orchestration, is on the <strong>Smart</strong> <strong>Grid</strong> ML. The System ML manages <strong>Smart</strong> <strong>Grid</strong><br />
Systems. The Element ML interacts with <strong>Smart</strong> <strong>Grid</strong> Communications Elements.<br />
Management Logical Model<br />
The Management Logical Model [Figure 23] contains three views: management component, management<br />
services stack, and management synergy.<br />
Figure 23 - Management Logical Model<br />
In the Management Synergy model (upper left portion of Figure 23), the data sources are at the bottom<br />
and data consumers at the top. The Management Services (middle layer) depict the shared<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 54
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
management services across systems and is divided into three sub-layers. The Lifecycle and<br />
Technology Management Services deal with end devices. The Configuration, Event, Security and<br />
Performance Management Services take data from the layer below, and process the data for<br />
consumption by the Policy Management Layer at the top.<br />
Various utility operations are end-consumers of management services. Operational functions request<br />
Management Services by SLAs and policies. Policy Management orchestrates all management services<br />
per the policies and the SLA. Two broad types are depicted. Data exchanged between end devices are<br />
based on raw standards. The higher data classes are exchanged between Consumers-Processes and<br />
Policy Management to ensure correct SLA and policy rules are being followed.<br />
Management Structural Model<br />
The management structural model [Figure 21] is provided to help the smart grid architect consider<br />
how to best deploy the various management services using a stylized representation of a typical utility<br />
network infrastructure. At the top of the model are elements needed to support external agencies<br />
(regulators, interchange and balancing authorities, etc.). At the bottom are the management services<br />
needed by premise devices (smart appliances, PEV chargers, building energy managers, etc.). In<br />
between are a dozen other tiers where management services may be located to support residing devices<br />
and functionality. A self-describing template used for this model is on the last page of Appendix B,<br />
Services Classes Concepts. Included are descriptions of all fourteen tiers used in the model.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 55
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 24 - Management Services Structural Model<br />
Management <strong>Architecture</strong> Principles<br />
The following are architecture principles recommended for developing management architecture:<br />
• Management across Systems: The management architecture should support management across<br />
systems. For example, if an urgent (security) need is being addressed to push new firmware to<br />
all meters, the performance management will address contextual needs and inputs from other<br />
systems (such as Volt/VAR, fault management etc.) before the push is performed.<br />
• Ease of deployment independent of scale: management architecture deployment should be<br />
ambivalent to the size of the existing systems and the new systems to be deployed.<br />
• Support for legacy and emerging systems: management infrastructure must support legacy<br />
(protocols, technologies, devices) and emerging systems<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 56
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
• Exhaustive support for management services: management infrastructure shall support all<br />
<strong>Smart</strong> <strong>Grid</strong> management services (discussed in Appendix B).<br />
• Management operations interface at policy level: The default operations interface of the<br />
management architecture should be at the policy level (giving policies as inputs to the<br />
management architecture), as opposed to configuration level. For example, security<br />
configuration at the element level might be ACL configuration and at a policy level. Multiple<br />
such ACL configurations along with privacy and authentication configurations can be part of a<br />
“remote access policy”. The security operator must deploy the management architecture to<br />
interface with the architecture giving it the remote access policy as the input as opposed to<br />
dealing with multiple configurations at multiple devices.<br />
• Support for input from internal and external entities: The management architecture should<br />
support taking inputs from utility actors (such as actors from generation, transmission,<br />
distribution and consumer functions) and actors external to an utility (such as NERC, weather<br />
systems, etc)<br />
• Support for disaster recovery scenarios: The management architecture should support<br />
management services for disaster recovery scenarios such as local management (with out access<br />
to central management resources) and out-of-band management<br />
<strong>Architecture</strong> Choices<br />
The following are the architecture choices made in support of the above principles:<br />
Hierarchical architecture for ease of operations: a hierarchical architecture is optimal for ease of<br />
operations (policy level management at the top and the element level management at the bottom).<br />
Distributed architecture for support of deployment: data, software (such as firmware and<br />
configuration settings) and intelligence required for <strong>Smart</strong> <strong>Grid</strong> elements must be close to end<br />
devices to avoid network bottlenecks during firmware update distributions. Therefore, a distributed<br />
architecture is optimal for Management <strong>Architecture</strong>.<br />
Modular architecture for support of scale: Management architecture (policy management at the top<br />
and element management at the bottom) requires policy management to remain stable to changes,<br />
and to element additions (Element Management Layer) to the <strong>Smart</strong> <strong>Grid</strong> infrastructure. Therefore,<br />
the management architecture should be a modular architecture with support for multiple types of<br />
management at the element management layer would fit into the policy management layer<br />
<strong>Architecture</strong> Standard and Technology Recommendations<br />
The following table of management standards and technology recommendations is provided to the<br />
smart grid architect for reference. Over time, however, innovations will inevitably diminish its<br />
completeness. The architect should always research the latest information on these topics, but this table<br />
is a good starting point. Table 15 lists important 2011 standards and technology recommendations<br />
applicable to management, each with a brief explanation of their purpose or relevance.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 57
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Table 15 - Recommended Management Standards and Technology<br />
Technology<br />
SNMP V3 for get/set configurations of smart<br />
grid elements<br />
Syslog for logging capabilities of smart grid<br />
elements<br />
IEC 61850 suite for common configuration<br />
across electric and communication devices<br />
Netflow for event and behavior analysis<br />
XML based standards for complex device<br />
management<br />
NETCONF<br />
SSL and SSH for device-level configuration<br />
Justification<br />
SNMP V3 has embedded security and provisions for encryption<br />
SNMP is widely deployed across network devices of various technologies.<br />
Syslog standard can be exported securely.<br />
Many parsing functions are available for syslog.<br />
IEC 61850 is well-defined and becoming the standard for electrical and the<br />
communication devices that interface with those electric devices.<br />
Netflow is a simple protocol.<br />
Netflow is suitable for behavior analysis.<br />
XML is becoming the standard for:<br />
Substation Configuration Language:<br />
CIM: CIM is based on XML<br />
SOAP for configuration<br />
NETCONF<br />
XML is slow because of the parsing involved,<br />
NETCONF is the IETF protocol for manipulating and installing configuration<br />
files base<br />
CLI-based configuration should be done through secure versions of<br />
management protocols such as SSL and SSH.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views • 58
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
6. Summary<br />
Introduced less than 50 years ago, Information and Communications Technology (ICT) <strong>Architecture</strong><br />
remains a relatively new discipline. Unlike architectural disciplines dating back to ancient times, those<br />
that produced the many human artifacts we use and tend to take for granted today, ICT has relatively<br />
limited experience with the materials it employs. While many classes of information and<br />
communications materials are now stable and well understood, some ICT aspects continue to evolve<br />
quickly. Thus, it is not surprising that <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong>, being even more recent than ICT, must<br />
proceed while its building blocks remain untested in large-scale utility deployments.<br />
This document is one of the first end-to-end <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> descriptions developed<br />
in North America. Unlike many existing technology-dependent smart grid frameworks, the intent of<br />
this work was to develop technology-neutral smart grid architecture, and to document methods and<br />
recommendations for utilities’ continued reference as smart grid technologies and applications mature.<br />
Several conclusions became evident while this document was being debated and written:<br />
1. The architecture and resulting infrastructure must be based on layered services architecture<br />
principles. As new ideas and applications emerge, it is critical for the architecture to not only<br />
evolve with them, but to support them with little or no re-working.<br />
2. Interoperability is key. Many vendors will develop pieces of equipment, software and other<br />
items to be integrated with the grid. True interoperability is critical to reducing the cost of<br />
adding each item to the mix. It also lowers the threshold for testing innovative ideas – if the<br />
interoperability testing setup cost is too high, new ideas die on the drawing board.<br />
3. Data flows from many sources to many applications. This data interweaving requires an ability<br />
to move massive volumes of data quickly. Data exchange between applications must also be<br />
segregated based on operational needs. An infrastructure with robust data networks, adaptors,<br />
and service busses is critical for a utility to have a fully functional smart grid.<br />
4. A utility based on silo-optimized business functions is incompatible with grid renewal. As<br />
smart grid systems must interoperate seamlessly, so must the underlying business functions.<br />
This architecture document can help the “Old <strong>Grid</strong>” evolve into a “<strong>Smart</strong> <strong>Grid</strong>” as legacy grid<br />
infrastructure is merged with the latest ICT. It recommends high-level goals and principles to guide<br />
those tasked with developing smart grid architecture. Additionally, it describes a highly flexible,<br />
adaptive architecture critical for grid transformation. If properly planned, existing ICT infrastructure<br />
operations will continue while infrastructure complexity remains manageable as capabilities are added.<br />
Demands on each utility’s smart grid will change as results from experiments and demonstration<br />
projects become available. <strong>Smart</strong> grid architectural demands will also change as new applications<br />
evolve. Finally, many unknown factors will impact the <strong>Smart</strong> <strong>Grid</strong> ICT architecture over time. For all<br />
these reasons, this document must be revised periodically to remain useful.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Summary • 59
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NOTES<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Summary • 60
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix A. System of Systems Design Patterns<br />
<strong>Smart</strong> <strong>Grid</strong><br />
System-of-Systems <strong>Architecture</strong>s<br />
System Evolution to Guide Strategic Investments in Modernizing the Electric <strong>Grid</strong><br />
K. Mani Chandy, California Institute of Technology<br />
Jeff Gooding, Southern California Edison<br />
Jeremy McDonald, Saker Systems<br />
Introduction<br />
The electrical power system which has served humanity efficiently for a century must now evolve to<br />
meet changing requirements: increasing renewable energy sources, decreasing fossil fuel usage,<br />
managing greater total demand, using electricity to fuel transportation, enabling more customer control<br />
of both demand and supply, dealing with security threats, and adapting to disruptive technologies. An<br />
established industry must adapt to rapid, unaccustomed rates of change.<br />
System of Systems <strong>Architecture</strong>s<br />
<strong>Smart</strong> <strong>Grid</strong> designers face the challenge of planning the evolution of the grid’s architecture from its<br />
current instantiation to meet the needs of a changing uncertain future. This challenge can be met by<br />
managing the evolution of the grid as a System of Systems (SoS). A plan for the systematic evolution of<br />
<strong>Smart</strong> <strong>Grid</strong> architecture, as a System of Systems, should be the basis for: developing requirements and<br />
standards, making design decisions, procuring solutions, and managing the <strong>Smart</strong> <strong>Grid</strong> over the<br />
coming decades.<br />
A SoS is defined as a collaborative set of systems in which its components: 1) Fulfill valid purposes in<br />
their own right, and continue to operate to fulfill those purposes if disassembled from the overall<br />
system and 2) are managed (at least in part) for their own purposes rather than the purposes of the<br />
whole. The components systems are separately acquired and integrated to form a single system but the<br />
components maintain a continuing operational existence independent of the collaborative system.<br />
Consequently properties, which do not belong to any of the constituent parts, will emerge from the<br />
combined system of systems. Moreover, the system of systems evolves as constituent systems are<br />
replaced.<br />
System of Systems Design Patterns<br />
Appendix • 1
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Central Principles of System of Systems <strong>Architecture</strong><br />
Architects must enforce the following two central principles of SoS to ensure that the <strong>Smart</strong> <strong>Grid</strong> is not<br />
overwhelmed by change:<br />
The complexity of the SoS framework does not grow as constituent systems are modified, and SoS<br />
concepts for integrating constituents remain unchanged even as components are added and removed.<br />
The constituent systems do not need to be re-engineered as other constituent systems are added,<br />
removed, or replaced.<br />
These ideas are not new and form the basis of engineering design in many domains including software.<br />
We show how to evolve the architecture of the <strong>Smart</strong> <strong>Grid</strong> in a systematic, evolutionary manner, by<br />
adhering to these well-tested principles.<br />
This paper describes four <strong>Smart</strong> <strong>Grid</strong> SoS architecture patterns and their benefits and risks. In this<br />
paper we propose a specific evolutionary trajectory for the architecture of the grid as it takes on<br />
characteristics of these four patterns. Tradeoffs between different evolutionary trajectories are<br />
discussed, and the risks in the specific plan we propose are described in detail.<br />
Trends that Impact Evolution of <strong>Grid</strong> <strong>Architecture</strong><br />
We next list trends in technology that impact the <strong>Smart</strong> <strong>Grid</strong> and show how these trends impact the<br />
systematic evolution of grid’s architecture.<br />
A System of Everything: The <strong>Smart</strong> <strong>Grid</strong> is evolving to include control of many devices that were not<br />
considered in designs of the current grid; these devices include distributed energy sources and storage,<br />
electric vehicles, and appliances. <strong>Smart</strong> <strong>Grid</strong> architecture must consider integration – at some level – of<br />
widely different kinds of systems that deal with all aspects of life from transportation to healthcare. We<br />
use the hyperbole, “system of everything,” to make the point that the grid is one of the focal points by<br />
which individuals and organizations monitor and control their lives.<br />
The Penetration of the Internet and the Web: Large segments of the public use the Internet as a core<br />
technology for their work, social networking and recreation. Widespread access to broadband and<br />
increasing use of smart phones and tablets has resulted in large segments of the public, especially the<br />
young, viewing the Internet as a “system of everything.” This view is likely to strengthen as today’s<br />
young enter the workforce. Worldwide penetration of Internet and cellular data technologies will<br />
continue to make these technologies more powerful and affordable.<br />
The evolution of the <strong>Smart</strong> <strong>Grid</strong> architecture will reflect evolution of Internet architecture because the<br />
public will not want two competing “systems of everything.” Moreover, consumers and organizations<br />
System of Systems Design Patterns<br />
Appendix • 2
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
will want tighter control of their electrical devices as energy tariffs based on time of day become<br />
common and they will expect to manage their devices using the same Internet protocols that they use<br />
for other activities.<br />
Continuous Evolution of a Heterogeneous <strong>Smart</strong> <strong>Grid</strong>: The information infrastructure supporting the<br />
grid will remain highly heterogeneous for several reasons. Different grid functions have widely<br />
different systems characteristics such as requirements for security, timeliness, and bandwidth; for<br />
example these requirements are very different for fault protection and metering, and for demand<br />
response in homes and data centers.<br />
The <strong>Smart</strong> <strong>Grid</strong> will evolve continuously over decades; there will not be a single massive replacement<br />
of the current grid. Information technologies for sensing, metering, actuation, communication, and<br />
computation are developing continuously and rapidly. So, there is no ideal single point in time for a<br />
wholesale replacement of all devices. The architecture must be designed for continuous adaptation.<br />
Next we discuss the costs and benefits of using different SoS architectures at different points in the<br />
evolution of the <strong>Smart</strong> <strong>Grid</strong><br />
<strong>Smart</strong> <strong>Grid</strong> SoS <strong>Architecture</strong> Patterns<br />
The Silo <strong>Architecture</strong><br />
The current SoS architecture of the electric grid can be characterized as a collection of silos. Different<br />
functions of the grid such as billing and energy distribution use different information silos that are<br />
integrated by a thin IT layer. The silo architecture worked well for utilities for decades because each<br />
silo served the needs of a business unit, and different business units in a utility had very different<br />
needs. Utilities operated efficiently with little integration across silos.<br />
System of Systems Design Patterns<br />
Appendix • 3
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 25 - Silo <strong>Architecture</strong><br />
The silo architecture, though adequate in the past, will be inefficient for the future for several reasons.<br />
One reason is the increasing demand by a number of stakeholders for a greater control of energy usage.<br />
From the 1960s to 2010, utilities and ISOs controlled generation and distribution, and they specified<br />
well-defined interfaces to consumers: Customers turned switches on and off, paid bills, and called<br />
utilities when power failed. In the future utilities will coordinate activities by multiple stakeholders<br />
across multiple interfaces. For example, integrating distributed generation requires new interfaces. If<br />
the silo architecture is retained then separate interfaces will have to be developed between each type of<br />
stakeholder and each type of silo. Moreover, these separate interfaces will have to evolve separately as<br />
requirements evolve. Our challenge is to design an evolutionary path from today’s silo architecture to<br />
an evolving SoS architecture.<br />
System of Systems Design Patterns<br />
Appendix • 4
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Integration using Enterprise Services Buses<br />
Figure 26 - ESB <strong>Architecture</strong><br />
A step in the evolution is to integrate the back office using an ESB. Some utilities are taking this step.<br />
Though the step appears simple, it requires considerable cost, time and effort from IT staff and<br />
business units. Most importantly, integration using an ESB requires discipline that enforces enterprisewide<br />
standards on data models and IT services. If this discipline is not enforced, the ESB merely serves<br />
as an integrated physical communication opportunity, but all the problems of the silo architecture<br />
remain.<br />
Integration of the back office results in considerable efficiencies in utility operation. Back office<br />
integration does not, however, solve problems of multiple interfaces between different types of agents<br />
System of Systems Design Patterns<br />
Appendix • 5
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
who will participate actively in consuming and producing electrical energy. Moreover, the ESB<br />
architecture doesn’t move towards the utility customer’s need for an integrated system of everything.<br />
Thus, the ESB architecture is a good step, but not the final step, in the evolution of <strong>Smart</strong> <strong>Grid</strong><br />
architecture.<br />
Adapter <strong>Architecture</strong><br />
Figure 27 - Adapter <strong>Architecture</strong><br />
A possible next step in the evolution of the <strong>Smart</strong> <strong>Grid</strong> SoS architecture is that proposed for networkcentric<br />
warfare by the Department of Defense. A central feature of this architecture is that it provides<br />
each participant a user-defined operational picture (UDOP) for situational awareness. As a battlefield<br />
situation unfolds, possibly in unpredicted ways, UDOP provides each warfighter with the information<br />
that he or she needs, while ensuring that warfighters are not overloaded with data irrelevant to their<br />
System of Systems Design Patterns<br />
Appendix • 6
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
operations. DoD is using network-centric architectures to integrate army, navy, marine and air force<br />
operations to help provide overall situation awareness.<br />
Major benefits of this architecture are the enforcement of protocols that guarantee:<br />
Security throughout the system and<br />
Rapid delivery of high-priority information.<br />
The DoD enforces standards on its vendors: New IT components are designed and tested to guarantee<br />
system-wide security and performance.<br />
The challenge for utilities is to derive the benefits of DoD’s network-centric architecture while dealing<br />
with a marketplace that is very different from DoD’s operational environment. The <strong>Smart</strong> <strong>Grid</strong> consists<br />
of a collaboration of multiple utilities and ISOs. As the electricity grid gets increasingly integrated<br />
across states and even countries, the number of collaborating utilities and ISOs will increase. New<br />
types of stakeholders, such as manufacturers of electric cars, distributed energy generators, and energy<br />
storage devices participate in designing new interfaces to the grid. Control by a single agency of multistate,<br />
multi-national, multi-vendor integration, while possibly desirable, is more difficult to implement<br />
in the <strong>Smart</strong> <strong>Grid</strong> than in the DoD.<br />
The adapter architecture has critically important features; notably it supports the continuous evolution<br />
of a heterogeneous system of systems. The architecture does not, however, adequately meet the<br />
public’s needs for a system that integrates all devices. Nor does the adapter architecture sufficiently<br />
exploit the huge opportunities provided by open Internet technologies. Protocols layered on top of the<br />
Internet are not ideal for all applications; however, these protocols will evolve over time to meet needs<br />
for security, performance and other features required by many applications including the <strong>Smart</strong> <strong>Grid</strong>.<br />
Though the adapter architecture goes a long way towards meeting <strong>Smart</strong> <strong>Grid</strong> requirements, the<br />
architecture doesn’t go far enough to meet the technological or societal needs of a utility’s customers.<br />
<strong>Architecture</strong> Based on Open Standard Service Mechanisms<br />
A great deal has been written about Service-Oriented <strong>Architecture</strong> (SOA). A definition of SOA, offered<br />
by Roy Schulte of Gartner who coined the term, is that an SOA system satisfies the following five<br />
principles.<br />
1. Components can be added, replaced or modified individually without affecting the remainder of the<br />
system.<br />
2. Components must be distributable, i.e., run on arbitrary servers and communicate with each other<br />
by messages or service invocations.<br />
3. Component interfaces must be defined using standard metadata and the interfaces must be<br />
discoverable by application developers.<br />
4. A component can replace another with the same interface.<br />
System of Systems Design Patterns<br />
Appendix • 7
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
5. Services can be used multiple times by disparate applications or the same application.<br />
These characteristics also satisfy the two main principles of System of Systems architecture.<br />
Services may be organized in business domains so that some services are only available to others<br />
within the same domain; however, a central point of standard services is common metadata for service<br />
interfaces regardless of the business domain in which the service lies.<br />
The Adapter <strong>Architecture</strong> is a service-oriented architecture. The central differences between adapter<br />
architectures and one based on standard open services are the protocols by which services are invoked.<br />
Since the IT infrastructure for the <strong>Smart</strong> <strong>Grid</strong> will need to take steps towards satisfying customers’<br />
needs for a “System of Everything,” we are faced with two options.<br />
Ensure that the mechanisms for specifying, invoking and maintaining services for the <strong>Smart</strong> <strong>Grid</strong> are<br />
the same as, or consistent with, mechanisms for invoking other services.<br />
Have two mechanisms for managing services, one for the <strong>Smart</strong> <strong>Grid</strong> and the other for everything<br />
else, and build bridges between <strong>Smart</strong> <strong>Grid</strong> and everything else.<br />
There are advantages and disadvantages for both approaches. An advantage for the two-mechanism<br />
approach is that a <strong>Smart</strong> <strong>Grid</strong> IT infrastructure is designed specifically for the particular needs of the<br />
<strong>Smart</strong> <strong>Grid</strong>. A disadvantage of this approach is that all the thousands of utilities and other agents<br />
participating in the <strong>Smart</strong> <strong>Grid</strong> will have to adopt either a single standard (or a very small number of<br />
standards) designed specifically for the <strong>Smart</strong> <strong>Grid</strong>, and build integration layers between the <strong>Smart</strong><br />
<strong>Grid</strong> standard and protocols to manage both business and personal needs in other domains.<br />
System of Systems Design Patterns<br />
Appendix • 8
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 28 - Service-Centric <strong>Architecture</strong><br />
The development of a <strong>Smart</strong> <strong>Grid</strong> system of systems based on Internet (e.g. REST) or Web-services<br />
protocols requires an understanding of the key points of interoperability across the entire <strong>Smart</strong> <strong>Grid</strong>.<br />
The silos in the current infrastructure can be architected in layers, with layers across different silos<br />
having the same interface. The new architecture must specify standard interfaces at each layer so that<br />
different business functions are architected in the same way and reuse components. The architecture<br />
must also specify common services such as network management, security, and diagnostics, and these<br />
common services should be accessible to all systems and devices used to execute different business<br />
functions.<br />
System of Systems Design Patterns<br />
Appendix • 9
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Summary<br />
Strategic investments in modernizing the grid must be based on a plan for transitioning today’s silo<br />
architecture to a system of systems architecture based on widely adopted standards, common services,<br />
and loosely coupled systems. Strategic investments will pay off only if they designed for a carefully<br />
planned trajectory of grid architecture.<br />
Successful execution of a transition plan requires early and continuing investments in <strong>Smart</strong> <strong>Grid</strong><br />
standards, unified infrastructure and the co-evolution of processes to support migration from<br />
centralized to distributed operation. Massive changes in architecture, operations, and training will be<br />
required over the transition period. So, a utility should adopt an evolutionary approach that doesn’t<br />
exceed the utility’s capacity in these domains.<br />
A transition plan that some companies have adopted is to first move from a silo architecture to an<br />
enterprise service bus (ESB) architecture and then move incrementally to an open-standards based<br />
architecture, developing and adopting standards and common services in steps. The utility should,<br />
however, have an overall architecture transition plan, including designs for system-wide security and<br />
system-wide timeliness at every step of the plan, before making incremental changes.<br />
Each of the four architectural patterns discussed in this paper has benefits and risks. Each transition<br />
from one architectural pattern to another has substantial costs, takes time, and requires expertise in<br />
both the grid and IT architecture. Utilities must, however, develop architecture plans before making<br />
strategic investments in the grid.<br />
System of Systems Design Patterns<br />
Appendix • 10
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix B. Services Classes Concepts<br />
Applications Services<br />
As discussed previously, the utility industry is being transformed by <strong>Smart</strong> <strong>Grid</strong> initiatives.. This<br />
transformation affects functional business processes, as well as associated technology and applications.<br />
These changes will lead to a re-engineering of how these applications are used and interact with other<br />
domains. Applications will be transformed to leverage shared services to better allow the utility<br />
business domains to interchange available information. Interoperability and loose coupling between<br />
application functionalities is best assured if the application services interact through well-defined<br />
interfaces based upon standards, e.g. IEC 61968 and IEC 61970.<br />
<strong>Smart</strong> <strong>Grid</strong> architects, over time, will disaggregate monolithic systems into smaller atomic functional<br />
components. These will be used to aggregate, compose, choreograph and orchestrate business<br />
processes leveraging smaller atomic functional components. The “optimizes assets and operates efficiently”<br />
baseline <strong>Smart</strong> <strong>Grid</strong> goal requires applications to be designed for maximum flexibility and reusability.<br />
If applications are adequately service enabled, the design of flexible, smart grid processes can leverage<br />
industry standards such as BPEL (Business Process Execution Language). For example, suppose a giant<br />
distribution management system is decomposed into many smaller functional components, each with<br />
small functions implemented as self-contained services. A utility functional section can, through BPEL,<br />
rapidly devise business processes by orchestrating a set of services to perform a business process. Since<br />
the services are designed for re-use, another business group could devise a similar process using the<br />
same services orchestrated in a way to best meet its particular business needs. Business analysts can<br />
design a multitude of different business processes by assembling the same functional components into<br />
different combinations. This approach provides analytics needed to measure process efficiency since<br />
properly designed services include introspection and self-testing. Analytics to tune process efficiency<br />
can be implemented with each process piece, and re-used by every business process using the services.<br />
P1<br />
Service A<br />
Service E<br />
P1<br />
P2<br />
P3<br />
P4<br />
Monolithic<br />
Application<br />
P2<br />
P3<br />
Service B<br />
Service C<br />
Service F<br />
Service G<br />
Service I<br />
Service J<br />
Service K<br />
P4<br />
Service D<br />
Service H<br />
Figure 29 - Dis-aggregation of a Monolithic System<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 11
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Functional Aspects of Application Services<br />
The Operations functional domain manages the movement of electricity through the efficient operation<br />
of the power system. It therefore impacts many other business domains:<br />
a. Network Operations: includes supervision of substation topology and control equipment status,<br />
network connectivity, loading conditions, fault management, outage management and location<br />
of field crews.<br />
b. Network Extension Planning: develops long-term plans for the adequacy and reliability of the<br />
electrical networks needed to fulfill evolving energy usage needs.<br />
c. Operations Planning and Optimization: includes the definition, preparation and optimization<br />
of workflows, plus the operational sequences required for the maintenance, monitoring and<br />
control of networks.<br />
d. Metering: performs reading of the information recorded at customers’ service points; sends<br />
alerts and notifications; controls customer equipment interfaces.<br />
e. Record and Asset Management: includes electrical substation and network assets either owned<br />
by the utility or having legal responsibility for.<br />
f. Maintenance and Construction: addresses functional needs for equipment to perform better<br />
and extend its service life.<br />
g. Customer Support: manages operational aspects of customer interfaces such as trouble calls,<br />
point of sale, account management, etc.<br />
h. Enterprise Systems: supports the overall utility businesses, including, but not limited to, human<br />
resources, corporate finances, and supply chain management.<br />
i. Bulk Energy Management: serves Generation and Transmission Control, Topology Processing,<br />
Account Settlement, Market Operations, Load Management, Energy and Transmission<br />
Scheduling, Dispatcher Training Simulation, SCADA (Supervisory Control And Data<br />
Acquisition), Alarm Processing, etc.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 12
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 30 - Functional Services Organization<br />
As discussed above, the Operations domain boundary includes an edge to most utility domains and<br />
thereby can provide a large set of application services.<br />
As an illustrative example, consider the application services offered by the Network Operations<br />
Planning and Optimization. The related services can be classified into three sub-categories, which can<br />
be further decomposed into various functional, modular and reusable components or services:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 13
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 31 - Network Operations planning and optimization<br />
The Network Operations and Optimization Application Services are:<br />
Load Forecast Service: The Load Forecasting function predicts short-term, mid-term and long-term<br />
system loads and maintains a real-time forecast and a study forecast. The real-time forecast is based<br />
on actual historical load and weather data and generates a load forecast for the current minutes,<br />
hour and day. The study forecast uses a completely independent set of historical and predicted data<br />
the operator may configure to evaluate hypothetical situations in the future.<br />
Power Flows Service: This service provides the calculation engine for external systems to estimate<br />
the network conditions based on provided network status and measurements. This service is used in<br />
real-time to provide dispatchers with an accurate and precise estimation of current network state.<br />
This service is also leveraged by advanced network features requiring real-time base power flow<br />
results for further analysis, (e.g. Contingency Analysis, Volt/VAR Control, or FLISR – Fault Location,<br />
Isolation and Services Restoration). This service can also be leveraged by Network Planning<br />
engineers to determine the effects of control actions (breaker switching, tap changing, and<br />
interchange adjustments).<br />
Contingency Analysis Service: This service enables the real-time study of the effects from a system<br />
component failure. Contingency analysis relies on the Incident Simulation Service to model the<br />
effects of identified contingencies. Once all relevant contingencies have been simulated, the<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 14
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Contingency Analysis Service ranks the results based on the current network conditions to inform<br />
the grid operators of areas of possible risks or congestions. The Contingency Analysis Service can<br />
also be in used in an engineering exploration or training environment.<br />
Short-Circuit Analysis service: This service is responsible for analyzing short circuits in<br />
transmission and distribution networks. These include single line to ground, line to line, double line<br />
to ground, three lines to ground, single line open, double line open, etc.<br />
Optimal Power Flow service: This function allows dispatchers or network planning engineers to<br />
optimize power system control actions based on given criteria (flows of real or reactive power,<br />
switching of compensation devices, optimal settings for voltage control, etc.). In optimal power flow,<br />
the control actions are automatically predetermined within the limitations of the power system.<br />
Supply Restoration Assessment Service: This service analyzes the switching options after a<br />
network fault is identified in order to restore the power for as many customers as possible in the<br />
shortest time possible. In distribution systems, this service is generally invoked by the Fault<br />
Location, Isolation and Services Restoration service to provide alternate switching plans for the<br />
operators to manually or automatically select for restoring power to customers when the normal<br />
feeder configuration does not allow the supplying power to affected customers.<br />
Switching Simulation Service: This service enables the simulation of switching operations. This<br />
service is leveraged by many other services, in both real-time or study environments. For example,<br />
the real-time Supply Restoration Assessment Service calls it to simulate the switching steps<br />
necessary to isolate faulty devices or restore power to customer. Another example, in the training<br />
environment settings, when the trainee operators issues a supervisory control, the Operator Training<br />
Simulator calls the Switching Simulation Service to operate the selected devices.<br />
Incident Simulation Service: This service provides the ability to simulate and recreate an incident<br />
on the network for analysis or training purposes. This service leverages the Switching Simulation<br />
Service to perform switching steps on the network and on the Power Flow Service to compute the<br />
resulting network conditions. The Incident Simulation Service is leveraged in both real-time and<br />
study mode environments. For example, the Operator Training Simulator heavily relies on this<br />
service to drive the simulated network state and conditions.<br />
Weather forecast analysis service: Weather is monitored to predict impacts on the electrical<br />
networks, especially where outages are likely to occur due to heavy storm activity. Temperature and<br />
wind speed are sometimes used to calculate dynamic load limits on electrical network assets.<br />
Fire risk analysis service: It analyzes the risk of fire in the network. For example, thermal rating of<br />
network equipment. There is a certain temperature for which transformers may be at risks of<br />
malfunctioning, failing or worst, exploding.<br />
Define operational limits service: It defines operating limits for monitoring operations of the<br />
transmission and distribution facilities.<br />
Thermal ratings of network equipment and lines: Changes in electrical asset performance limits<br />
based on temperature and wind speed and current season. This is distinguished from Asset<br />
Investment Planning (AIP) counterpart, which includes new construction and re-conductoring.<br />
For all these services to properly interact and fulfill the utility objectives, an integration layer is<br />
required to ensure the orchestration and communication of these services. The next section describes<br />
these integration services.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 15
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Integration Services<br />
Integration services and patterns are very important in reducing ICT complexity while allowing it to<br />
quickly and easily deliver on business needs while enabling continued innovation. Integration services<br />
leveraging the enterprise service bus pattern (1) offer ways to cut down point-to-point connectivity; (2)<br />
maintain a higher level of reliability; and (3) improve flexibility in the architecture. The presence of an<br />
ESB is fundamental to simplifying the task of invoking services – services can be used wherever needed<br />
from wherever they reside within the enterprise; used without specific knowledge of where the<br />
services reside or how to transport requests across the network to invoke those services. Some of<br />
common capabilities needed in integration services are routing and brokerage, mediation, protocol<br />
conversion, namespace translation, service virtualization, and aggregation.<br />
Business Process Orchestration and Choreography Service<br />
Business process choreography and orchestration capabilities, associated with the composition and<br />
coordinated execution of services, provide flexibility in building new processes and managing process<br />
change. Business process execution language (BPEL) is one of the standards used for building<br />
orchestrated ICT-enabled business processes. Once developed, the process is deployed on servers<br />
running a BPEL engine and utilized by business systems shepherding the processes for the enterprise.<br />
Choreography is used when more complex behavior is needed, with each atomic-process reacting to<br />
the actions of other processes using pre-established heuristics, without central coordination.<br />
Business Rules Services<br />
As ICT Systems began supporting ever increasing, ever changing business processes, events and<br />
decisions, the need to identify and manage business rules became obvious. The rules needed to reflect<br />
business policy in a form comprehensible to business users and executable by a business rules engine.<br />
Separating the business rules from application code simplifies system changes, allows re-use of the<br />
rules across applications/processes, and supports rapid rules selection and execution.<br />
Registry and Repository Services<br />
The registry functions provide publication of metadata about the function, requirements, and semantics<br />
of services allowing service consumers to find services or to analyze relationships between services.<br />
The repository function provides the ability to store, manage, and version service metadata.<br />
Business application services<br />
Business application services provide ability to deploy and manage robust, agile and reusable SOA<br />
business applications and services of all types. These are service components designed specifically as<br />
services within a business model and represent the basic building blocks of the utility’s business design<br />
– services not decomposable within the business model, but composable to form higher level services.<br />
This allows creation of new services and service enablement of legacy packages and applications. These<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 16
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
services allow the user to develop innovative applications through their support of open standards and<br />
programming models, including: OSGi, CEA, JPA, SAML, SCA, SDO, SIP, Web 2.0, and XML.<br />
Gateway Services<br />
Gateway services provide filtering and data stream processing, receive all events from the device and<br />
send control commands to device. They also act as interaction services for machine to machine<br />
interaction, control access to applications, services and data based on customizable roles and rights<br />
thereby enable consistent enforcement of security and governance policies. These services also enables<br />
web integration services through the support of Web 2.0 technologies with JSON filtering and<br />
validation<br />
Complex Event Processing (CEP) Services<br />
Complex Event Processing services provide the ability to simultaneously access and analyze thousands<br />
of data streams from both inside and outside the corporate firewall and delivering the result directly to<br />
business application services. It supports events conformant to the Common Base Event specification<br />
and other messaging formats. It extends the one message at a time paradigm by detecting complex<br />
situations involving composition of messages/events sensitive to context (i.e. semantic, temporal,<br />
spatial, spatio-temporal, or scope).<br />
Workflow services<br />
A workflow service provides automation of a series of tasks assigned to application users based on<br />
their roles. When the application containing the workflow is instantiated, a user is assigned a task<br />
based on his or her role. This service is used for developing simple service composition. When<br />
complex, parallel service composition is required, workflow is best served by choreography services.<br />
CIM Binding Services<br />
The Common Information Model (IEC, 2003) is a key standard in the utility business domain. To<br />
expose a business service, this binding service maps the CIM model with backend data attributes. This<br />
service provides a CIM data model to handle the large portfolio of existing and extensible CIM classes.<br />
Visualization Services<br />
Visualization services include presentations of grid topology, alarms, switching state, and business<br />
capabilities. Presentation often is tailored to role-sensitive contexts –system behavior and visual cues<br />
adjust based on user job role and, perhaps, user location. To address the risk of data overload,<br />
presentation services can help transform the flood of smart grid data into nuggets of information<br />
presented in an optimal format for grid operators to make appropriate decisions. Thus, visualization<br />
services are essential to <strong>Smart</strong> <strong>Grid</strong> decision support systems.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 17
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Web Integration Services<br />
There are many characteristics of Web Integration (i.e. Web 2.0) services such as web as a platform,<br />
harnessing collective intelligence, lightweight programming model, software above the single device,<br />
light weight user interface apply to smart applications. There are multiple applications of concepts of<br />
these services within utility domain (i.e., mashups) to build visualization and situational services,<br />
aggregation of usage, including PEV charging usage and customer information etc.<br />
Cloud Services<br />
The cloud computing architecture is a flexible computing platform implemented with a highly<br />
virtualized, automated and service-oriented design. Utility companies can leverage cloud computing<br />
for rapid, real-time access to considerable computing power, immense storage and numerous<br />
applications. By using cloud computing, utilities can improve new application development and<br />
deployment and quality of service. It also enables prompt response to evolving consumer priorities and<br />
market challenges on a utility’s core products. As agility is key to future business success, and cloud<br />
computing provides ICT agility, cloud services may fit well in utility System of Systems architectures.<br />
Cloud computing’s inherent reliance on standardization will increase operational efficiency. Public<br />
clouds drive process standardization by identifying scalable workloads able to be managed in mass.<br />
Private clouds leverage the scale inherent in existing utility hardware by dramatically improving asset<br />
utilization. Rather than deploying and maintaining multiple application instances, cloud computing<br />
enables standardization on a single instance. Standardization on this scale significantly reduces labor<br />
and other ICT operating expenses while increasing availability. Similarly, highly virtualized<br />
infrastructure reduces ICT capital expenses, consolidates data center resources and reduces<br />
investments in hardware and facilities.<br />
Non Functional Aspects of Application Services<br />
The issues of High Availability, Performance and Scalability are key architectural concerns for all<br />
enterprise architects, particularly for <strong>Smart</strong> <strong>Grid</strong> architects. As enterprise ICT architectural approaches<br />
are increasingly applied to the grid, solution resiliency increases in importance. These issues are highly<br />
interrelated and often impacted by technological, temporal, spatial and budget constraints.<br />
Additionally, there is limited precedence for the <strong>Smart</strong> <strong>Grid</strong> architect to rely upon, and the domain is<br />
rapidly evolving. This section addresses these aspects by defining terms and their inevitable trade-offs.<br />
Performance and Scalability<br />
Performance has two facets. The first is the speed the system supports a single request. The second,<br />
system throughput, is the number of simultaneous requests supported with acceptable response times.<br />
Scalability is a measure of how well the system accepts higher volumes with acceptable performance<br />
and availability. A scalable architecture allows a system to grow with reasonable hardware and<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 18
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
software accommodations. In contrast, growth of a non-scalable architecture requires major changes to<br />
subsystems, hardware configurations, or new processor types.<br />
Performance and Scalability approaches are highly interdependent. High availability and performance<br />
goals can be achieved by paralleling system components, resulting in load reduction and response<br />
improvement for any element. Generally, additional units can be easily added if the architecture has<br />
the units paralleled. At the same time, improved availability is enabled by the presence of redundant<br />
hardware in this architecture. An architecture using parallel elements can also apply dynamic Quality<br />
of Service rules to ensure critical transaction completion when components are compromised.<br />
Analytic Services<br />
Analytics are data transformations used to extract information actionable by systems and people. As<br />
such, some analytics are cyber (machine-to-machine), while others are used for decision support after<br />
appropriate presentation (machine-to-human). The scope of analytics includes:<br />
Basic database queries for routine operational and business process issues<br />
Real time streaming data transformations used in closed-loop control systems<br />
Large scale data visualizations used for operator decision support<br />
KPI’s and dashboards used for executive review<br />
Reports for submission to regulators<br />
Data mining for system planning and asset management<br />
Many <strong>Smart</strong> <strong>Grid</strong> analytics are used to transform raw grid-derived data into a high-level depiction of<br />
grid state, supporting total situational awareness. <strong>Grid</strong> state includes knowledge of operational<br />
electrical parameters, device/system status, power quality, stress factors, and loading conditions. This<br />
grid state information is embedded in low-level data too voluminous and detailed to be<br />
comprehensible or actionable. Analytics extract the essential meaning from the data at the numerous<br />
grid intelligence tiers, from Protection & Control to System Planning & Optimization.<br />
As information and system complexity increase, presentation sophistication must necessarily increase.<br />
For some target audiences, reports or dashboards are inadequate. Advanced visualization capabilities<br />
are often needed to present analytics derived from sets of large, complex and dynamic data.<br />
Types of Analytics<br />
A wide variety of <strong>Smart</strong> <strong>Grid</strong> analytics exist, and more are constantly being developed. These analytics<br />
can be categorized in multiple ways, but one in particular is helpful. Figure 32 below depicts a<br />
taxonomy of <strong>Smart</strong> <strong>Grid</strong> analytics.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 19
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 32 - <strong>Smart</strong> <strong>Grid</strong> Analytics Taxonomy<br />
The taxonomy has six major classes of grid analytics, all driven by data from grid devices and systems.<br />
The classes support three high-level intelligence categories: Technical and Engineering, Operational,<br />
and Business.<br />
Signal Analytics<br />
Signals are the lowest level data coming from grid sensors. Therefore, Signal Analytics are often the<br />
"earliest" analytics (the ones first applied to raw data) and generally take the form of digital signal<br />
processing functions. The Signal Analytics profile follows:<br />
Example Usage: transform voltage and current waveform samples into Root Mean Square (RMS)<br />
values, along with real and reactive power, Total Harmonic Distortion (THD), and other relevant<br />
characterizations<br />
Data Frequency: real-time, may be hundreds of waveform samples per cycle over multiple channels<br />
for three phase voltages and currents.<br />
Data Types: integer digitized values, later converted to float engineering units<br />
Analytic Processing Frequency: ranges from per sample up to typical SCADA data rates (e.g. four<br />
second cycle time)<br />
Event Analytics<br />
Events are discrete, real-time messages from grid components caused by temporal or value limits being<br />
reached (logs, alarms, alerts). The Event Analytics profile follows:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 20
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Example Usage: processing power outage notification message bursts from smart meters during an<br />
outage or voltage sag<br />
Inbound Data Frequency: real-time, can be thousands of events within a few seconds<br />
Data Types: numerous event message formats<br />
Analytic Processing Frequency: real-time to manage bursts with low (millisecond to second) latency<br />
without message loss<br />
Result Set Publish Frequency: per event, asynchronous<br />
State Analytics<br />
State data from the grid supports real-time utility network analysis, monitoring, and control. The State<br />
Analytics profile follows:<br />
Example Usage: monitoring and control of grid power flows<br />
Inbound Data Frequency: real-time, from per cycle up to typical SCADA data rates (e.g. four second<br />
cycle time)<br />
Data Types: various SCADA and sensor formats<br />
Analytic Processing Frequency: real-time as per control system requirements; can be SCADA cycle<br />
time or as fast as GOOSE message times (4 msec max latency)<br />
Result Set Publish Frequency: SCADA rates to minutes for most processes; milliseconds for<br />
protection and control functions<br />
Engineering Analytics<br />
Engineers need analytics to perform long-term planning and operational analysis. The Engineering<br />
Analytics profile follows:<br />
Example Usage: circuit and substation planning<br />
Inbound Data Frequency: real-time - mostly SCADA data rates<br />
Data Types: usually floating point values from circuits, customer usage data records, maintenance<br />
event logs, waveform files<br />
Analytic Processing Frequency: quarterly, yearly, multi-year<br />
Result Set Publish Frequency: on demand as planning and analysis processes are performed<br />
Operations Analytics<br />
Operations depends on analytics for short-term optimization of asset effectiveness. The Operations<br />
Analytics profile follows:<br />
Example Usage: all aspects of asset management for utilities, including asset health assessment via<br />
remote monitoring, asset stress accumulation monitoring for support of condition-based and<br />
predictive maintenance, and asset utilization, both in real-time and for system planning.<br />
Inbound Data Frequency: real-time at SCADA data rates or slower; directed mostly to historian<br />
databases, except for data used in load balancing and optimization.<br />
Data Types: floating point sensor readings and integer operations counts<br />
Analytic Processing Frequency: SCADA rates for real-time control functions; as needed for analysis<br />
reports<br />
Result Set Publish Frequency: same as Analytic Processing Frequency<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 21
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Consumer Analytics<br />
Utilities better serve their customers by analyzing data on electric producers and consumers<br />
(prosumers). The Consumer Analytics profile follows:<br />
Example Usage: all aspects of prosumer interaction with the utility, from billing and complaint<br />
management to interface for distributed energy resources, demand response (DR), and pluggable<br />
electric vehicle charge management.<br />
Inbound Data Frequency: rates for meter reading, DR feedback and prosumer interactions are slow<br />
compared to grid operations; may be minutes to months<br />
Data Types: meter usage data, DR data (<strong>Smart</strong> Energy Profile), event log messages<br />
Analytic Processing Frequency: on demand, mostly monthly or longer; some analytics for DR may<br />
be from minutes to hours<br />
Result Set Publish Frequency: on demand<br />
<strong>Smart</strong> <strong>Grid</strong> Data Classes<br />
Given the many potential sources of power grid data, for analytics and data management purposes it is<br />
helpful to classify them into seven categories. These categories aid the proper implementation of<br />
analytics, the design and placement of data persistence elements, and the sizing of communication<br />
network elements.<br />
Operational data<br />
Operational data is mostly real-time state measurements of circuits and devices. As this data changes<br />
from moment to moment, most analytics are concerned only with present data values. This data is<br />
persisted in various ways, primarily by overwriting old values. A log may be kept by placing snapshots<br />
of operational data in a time series (historian) database.<br />
Non-operational data<br />
This data category has telemetry used to monitor remote assets: equipment condition, environmental<br />
monitoring, stress indicators, etc. Most of this data is collected on a regular basis and persisted in a time<br />
series database.<br />
Meter usage data<br />
Besides its obvious use for meter-to-cash, meter data is often input to various technical and business<br />
analytics. While some analytics could use the default meter data repository, this approach may not<br />
scale well for more advanced, real-time analysis. Alternate data services could therefore be necessary<br />
for some metering analytics.<br />
Event streams<br />
Many <strong>Smart</strong> <strong>Grid</strong> devices produce asynchronous event messages. Analytics for such data streams may<br />
need special processing tools (Complex Event Processing engines) to quickly respond to periodic data<br />
bursts from grid devices. Event messages may also be logged for post-mortem analytics.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 22
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Waveform data<br />
Waveforms are often produced by grid devices based on some event or condition. This data are<br />
generally collected into files (COMTRADE or PQDIF formats) for post-event analysis. The files are<br />
typically batch transferred into a waveform repository for later use by analytics tools.<br />
Analytics as data<br />
Many analytics are real-time data streams, especially those used for line sensing and remote asset<br />
monitoring. These low-level output streams can be inputs to other analytics. They can also be stored in<br />
a time series data store for later analysis.<br />
Meta-data<br />
A wide variety of grid environmental data give context to actionable information. The architecture<br />
must provide, persist and distribute pertinent meta-data for use by analytics.<br />
Analytics Properties and Issues<br />
Architects should understand fundamental analytics properties and usage issues to properly align<br />
analytics into <strong>Smart</strong> <strong>Grid</strong> architecture. This understanding will reveal analytics as more than simply a<br />
set of services provided to the <strong>Smart</strong> <strong>Grid</strong> System of Systems.<br />
Analytics as filters<br />
Analytics may be viewed as both filters and data reduction mechanisms. Raw data from grid devices<br />
can be too voluminous for centralized processing. Low-level analytics services effect a data reduction<br />
by extracting useful information to characterize larger data sets while preserving essential content.<br />
Event processing as analytics<br />
Many grid devices generate asynchronous event messages based on a variety of physical and virtual<br />
events. Such event streams contain valuable information but typically arrive in large bursts needing<br />
low latency handling. As most utility systems cannot deal directly with such data, a complex event<br />
processing (CEP) analytics tool is used to simultaneously extract core information while throttling or<br />
filtering event message bursts. An example is the processing of power outage notification message<br />
bursts from smart meters; CEP is used to reduce the burst of raw messages to a single informative<br />
event message representing the underlying physical event. In addition, grid sensor event data streams<br />
can also be marshaled by CEP, such as Phasor Measurement Unit (PMU) data frames. When processed<br />
through CEP, PMU information can be used to detect, characterize and locate fault and pre-fault<br />
transient phenomena in real-time.<br />
Real time analytics for protection/control<br />
Many grid analytics support real-time protection and control operations. Since these analytics are often<br />
characterized by very low latency (as fast as sub-cycle), the data must be processed faster than any<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 23
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
database persistence can be applied. The data source is therefore connected directly to the analytic, and<br />
the analytics output routes directly to a machine consumer.<br />
Telemetry monitoring<br />
Much of <strong>Smart</strong> <strong>Grid</strong> data consists of remote asset and grid state monitoring telemetry. These produce<br />
high data volume with a steady and relentless delivery. Under normal operating conditions, the data is<br />
unremarkable. As monitored parameters trend away from nominal, actions should be taken, but the<br />
large data volume makes it impractical for people to constantly watch the data. A solution is to have<br />
analytics agents continually scan the data for specific conditions or trends, then issue appropriate alerts<br />
and notifications. Defining all possible alert analytics rules is impossible, therefore the analytics agents<br />
should be configurable, with subscriptions made or dropped as needed. End users of the analytics<br />
should also be allowed to perform some configuration. The <strong>Smart</strong> <strong>Grid</strong> Architect will need to secure<br />
this flexibility by providing appropriate access control via role-based identity management.<br />
Visualization<br />
Many <strong>Smart</strong> <strong>Grid</strong> analytics involve extensive numerical data used in making operational decisions. The<br />
need to present information in an operations-optimized format makes visualization a crucial element of<br />
the analytics architecture. While its overall usefulness to analytics makes visualization is a core<br />
analytical tool, it is also useful to other grid services (data synchronization, workforce enablement,<br />
customer empowerment). This therefore places visualization as a cross-cutting asset in the <strong>Smart</strong> <strong>Grid</strong><br />
architecture.<br />
Concatenated analytics<br />
Many analytics are best structured in concatenated form, where output from one analytic becomes the<br />
input to another. For <strong>Smart</strong> <strong>Grid</strong>, this can occur in one of two ways. In a distributed architecture,<br />
individual analytic agents may cooperate in a calculation, with each agent contributing a portion of the<br />
result. Alternately, analytics may be structured in tiers. An example would be the low-level analytics<br />
converting power quality (PQ) information into measures of grid asset stress. The stress analytic output<br />
are inputs to a second tier of analytics converting stress to abstract measures such as Loss of Life,<br />
Expected Time to Failure, and Asset Failure System Risk. These abstract measures are then made<br />
available to an asset management application incapable of processing the original low-level PQ data.<br />
Sourcing of data for analytics<br />
A key issue for analytics architecture is how to best minimize the number of new sensors. Properly<br />
chosen and located sensors can produce grid data capable of supporting many separate business needs<br />
when processed through multiple analytics. This multi-faceted aspect makes necessary a sensing<br />
strategy to accommodate business requirements while minimizing investment in new sensing<br />
infrastructure.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 24
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Delivery of analytics results<br />
In good grid architecture, analytics results will be distributed in various ways. Many analytics can be<br />
used by more than one business process (1:N delivery model). Some business processes require the<br />
combined results of many analytics (N:1 delivery model). Finally, should both situations fit, the N:N<br />
delivery model could be employed. These delivery models need to influence the modeling of any<br />
business process reliant on analytics.<br />
Persistence of analytics<br />
Analytics output, if treated as data, may need some type of persistence. One simple approach is to store<br />
analytics outputs in a time series database (historian). Not all analytical results need to be kept for long<br />
periods of time. For example, analytics used for converting raw grid data to grid state information will<br />
persist until over-written with fresh grid state; the persistence may be in a distributed or shared<br />
database, with individual values lasting only seconds before being refreshed.<br />
Analytics <strong>Architecture</strong> Considerations<br />
The <strong>Smart</strong> <strong>Grid</strong> Architect must consider many factors while developing the analytics services<br />
architecture. This section outlines several key issues for analytics architecture.<br />
Analytics Latency Hierarchy<br />
How analytics outputs are consumed is an important consideration for a <strong>Smart</strong> <strong>Grid</strong> system. Some<br />
applications must perform with very low latency in response to events or conditions, whereas others<br />
may respond over days or months. The vast majority fall in the middle, with latency ranging from<br />
seconds to hours. Thus, analytics can be categorized based on a latency hierarchy [Figure 33].<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 25
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 33 - Analytics Latency Hierarchy<br />
Classification of an analytic by its latency requirement is an important architectural consideration, as it<br />
may dictate where the analytic must be executed. It also strongly impacts two other <strong>Smart</strong> <strong>Grid</strong><br />
architectural elements: data persistence and communications. The distribution of intelligence in a <strong>Smart</strong><br />
<strong>Grid</strong> system is influenced by latency and scalability. Analytics can also be used to normalize data<br />
bandwidth requirements at various tiers in the network architecture by deploying their filtering<br />
capability in a distributed hierarchal form. The tradeoff between distributed intelligence (and<br />
distributed analytics in particular) and network requirements is a crucial <strong>Smart</strong> <strong>Grid</strong> design issue. Data<br />
persistence architecture must align with this tradeoff decision, which can lead to distributed hierarchal<br />
data persistence design issues.<br />
Scalability<br />
As <strong>Smart</strong> <strong>Grid</strong>s evolve, data volumes will increase and analytics consumers will demand increasingly<br />
more stringent delivery requirements. This evolution will require periodic review of analytic engine<br />
scalability and the sizing of associated architectural elements (persistence and communications). Some<br />
centralized analytics approaches don't scale well, caused either by the engine becoming a bottleneck, or<br />
because the network design prevents the embedded analytics engines to transition from handling<br />
dozens of inputs to thousands, or millions. As described above, the data reduction aspect of analytics,<br />
when coupled with appropriate network architecture, can address scalability in a general way. The<br />
same feature provides an incremental build-out capability compatible with typical utility roll-outs.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 26
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Availability and Failover<br />
Some <strong>Smart</strong> <strong>Grid</strong> analytics are crucial to real time operations. Such analytics may require a high<br />
availability (HA) implementation consistent with the critical operational processes supported. The<br />
<strong>Smart</strong> <strong>Grid</strong> architect must first classify analytics appropriately and then specify the necessary HA<br />
architectural elements.<br />
Analytics and Data Representation<br />
Analytics architecture is necessarily closely aligned with data architecture, with a focus on two areas:<br />
• Persistence models and data stores<br />
• Data representation<br />
The first is influenced by <strong>Smart</strong> <strong>Grid</strong> data classes and latency requirements. The second is part of a<br />
larger <strong>Smart</strong> <strong>Grid</strong> issue. At the lowest levels, <strong>Smart</strong> <strong>Grid</strong> devices will produce data in many different<br />
formats and protocols, especially legacy devices. However, even newer devices may use IEC 61850,<br />
IEEE C37.118, DNP 3, SEP 2.0, etc. As data and analytics move up the hierarchy from grid devices<br />
toward databases and application systems, these disparate formats should be converted to the IEC<br />
Common Information Model (CIM) representation. The CIM usage benefits of enhanced<br />
interoperability and architectural "future-proofing" are significant in any <strong>Smart</strong> <strong>Grid</strong> design, especially<br />
one based on an evolving System of Systems approach toward <strong>Smart</strong> <strong>Grid</strong> transformation. The location<br />
and timing for converting non-CIM representations to CIM are key architectural decisions.<br />
Management of Analytics Environments<br />
Like other complex systems, analytics require management functions for proper deployment, version<br />
control, etc. Analytics configuration issues are essentially the same as those for devices or applications.<br />
For complex event processing, CEP engines are generally rule-based, with the rules taking many forms<br />
(state transition models, extended SQL query sets, etc.). Managing CEP rule sets, including the proper<br />
distribution and synchronization in a distributed analytics environment, is a critical aspect of the<br />
overall analytics architecture. The architect may merge this with the cross-cutting issue of managing<br />
services, systems, and devices to evolve a unified solution for communication networks, grid devices,<br />
and analytics elements, including CEP rule sets.<br />
Centralized, Distributed, and Hybrid Analytics <strong>Architecture</strong>s<br />
Enterprise analytics architectures have traditionally been centralized, with business data repositories<br />
and warehouses, including analytics assets such as ordinary database queries, data cube engine<br />
(OLAP) tools, Key Performance Indicators (KPI's), executive dashboards, and data mining tools. For<br />
<strong>Smart</strong> <strong>Grid</strong>, all of the foregoing still applies, but the issues of real time control and operator decision<br />
support must also be addressed. Due to the data volumes and latency requirements supporting utility<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 27
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
operations, it is impossible for all analytics to reside at the enterprise back office. At a minimum,<br />
analytics are needed in the control centers, and likely beyond.<br />
Control center analytics may be viewed as centralized and therefore logical deployment sites for<br />
analytics engines. Since grid data are often streams, analytics engines must accept real-time data feed,<br />
with access to the meta-data providing context for grid data interpretation. This may require a<br />
combination of calculation engine, CEP engine and visualization package operating in real time. If any<br />
analytical results are used in an automatic fashion, the analytics engines must have network<br />
connectivity capable of delivering these outputs to the consuming systems. This connectivity will also<br />
be needed to allow periodic migration of some grid data and real-time analytics results to back office<br />
data repositories supporting various business analyses, reporting, and planning tools..<br />
In advanced <strong>Smart</strong> <strong>Grid</strong> architectures, intelligence and any supporting analytics may be moved outside<br />
of the control center to substations and beyond. One approach is to view key substations as grid data<br />
centers in their own right, with analytics treated in a manner analogous to the control center. Another<br />
approach is to make use of truly distributed models, where analytics elements at the substation interact<br />
and cooperate with analytics at the control center. Finally, a highly distributed “edge computing”<br />
architecture would push intelligence and analytics beyond the substations to locations near, or on, edge<br />
devices. In addition to edge grid devices, network devices are also logical homes for elements of grid<br />
intelligence and analytics.<br />
The distributed analytics model has compelling advantages in terms of latency minimization,<br />
robustness, incremental rollout, and flexibility. However, the model also raises several issues,<br />
including:<br />
Interaction models – distributed analytics may be implemented in embedded dedicated form or<br />
as agents in a multi-agent system. The nature of interactions among distributed analytics<br />
elements is a major architectural issue.<br />
Share models – if distributed analytics elements are to interact with each other and with utility<br />
devices and systems, then data sharing models become crucial. These models range from<br />
various kinds of memory sharing (shared RAM, distributed databases, shared-nothing, etc.) to<br />
hierarchal and lattice data flow models.<br />
Peer-to-peer messaging – an implication of using distributed approaches for analytics<br />
architecture is the necessity of peer-to-peer messaging for most models. This adds to the<br />
communications network and security design requirements.<br />
Regardless of how analytics are distributed, most models require a centralized mechanism to manage<br />
the distributed analytics. This must be included in the analytics architecture design.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 28
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Analytics Capability Maturity<br />
As with many other aspects of information system architecture, implementation, and operation,<br />
analytics architecture at any utility will progress through levels of capability maturity. A simplified<br />
model of capability maturity for analytics in <strong>Smart</strong> <strong>Grid</strong> systems follows:<br />
Table 16 – Analytics Capability Maturity Model<br />
Self-learning<br />
Optimizing<br />
Predictive<br />
Automated<br />
Operational<br />
Level Description Comments<br />
Business/ Operational<br />
Intelligence<br />
Measure/report<br />
Conclusion<br />
Analytics automatically learn from data<br />
and experience to modify themselves so as<br />
to improve accuracy and efficiency in<br />
information extraction and information<br />
discovery<br />
Analytics are used as the basis for<br />
optimization of operations, asset<br />
management, and prosumer interaction<br />
Analytics are advanced enough to make<br />
significant predictions and are routinely<br />
used in a forward-looking manner<br />
Analytics processes are fully integrated<br />
and run automatically; most analytics<br />
describe present and recent past<br />
Analytics are routinely used in operations<br />
and business processes<br />
Data acquisition is integrated to some<br />
business and operational processes<br />
Basic ability to make measurements,<br />
collect data, and generate batch reports<br />
Analytics tools include autonomous goal seeking<br />
capabilities aligned with the utility’s business goals<br />
and continually operate to improve their<br />
performance against the large scale goals of the<br />
business<br />
Analytics are deeply integrated with the higher<br />
levels of control and decision-making in the utility<br />
Utility processes make routine use of the predictive<br />
capabilities to plan alternatives and perform<br />
tradeoffs; predictive analytics are commonly used<br />
in decision support<br />
Integration of analytics with processes and systems<br />
is extensive; very little manual intervention is<br />
required for analytics to receive data or deliver<br />
results to consumers<br />
Some amount of data and analytics integration is<br />
present; some manual integration still being done<br />
Much of the integration is manual; processes are<br />
still fragile and siloed<br />
Elementary capability; most utilities are well past<br />
this stage<br />
Ultimately, the <strong>Smart</strong> <strong>Grid</strong> Architect must provide an analytics architecture consonant with the rest of<br />
the <strong>Smart</strong> <strong>Grid</strong> design, and consistent with the System of Systems approach as a set of services able to<br />
evolve with the <strong>Smart</strong> <strong>Grid</strong>. The analytics architecture must also be closely coordinated with data<br />
management services, communication services, and security architectures.<br />
Data Services<br />
Data Governance<br />
Data Governance is the discipline of treating data as an enterprise asset. Its goal is to optimize, secure<br />
and leverage data as an enterprise asset. Data Governance uses an organization’s people, process,<br />
technology and policy to derive optimal value from enterprise data. It also helps align disparate and<br />
often conflicting policies that are a contributing cause for many data anomalies.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 29
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Treating data as a strategic enterprise asset implies the need for organizations to complete data<br />
initiatives analogous to ones for physical assets. For example, utilities need to build an inventory of<br />
their existing data. The typical utility has an excessive amount of data on grid components, plants,<br />
customers, vendors and products, but has not formally documented where this data resides. A second<br />
data initiative for utilities is cyber security - business-critical data (Operational, Financial, Enterprise<br />
Resource Planning, and Human Resource) must be protected from unauthorized change or transmittal.<br />
Data is both an organization’s greatest source of value and its greatest source of risk. Poor data<br />
management often leads to bad business results and to greater exposure to compliance violations and<br />
data theft. To mitigate this risk, many companies attempt to strike a balance between easy data access<br />
and appropriate data use by using mandates (rules, policies and regulations). However, the business<br />
imperative to provide better customer service by quickly using trusted data can cause some to pay<br />
short shrift to these mandates. Similarly, effective use of disparate information can enhance innovation,<br />
but overly strict data security could make such innovative data correlations impossible. An appropriate<br />
balance among data access, data quality and cyber security must be struck by each utility.<br />
Organizations must also consider the business value of their unstructured data. Often referred to as<br />
“content,” this data needs governance similar to structured data. An example is the creation of a<br />
company-wide records management program. Many firms must retain electronic and paper records for<br />
specific time periods. A rigorous records management policy allows records to be produced during a<br />
legal discovery process in a timely and cost-effective manner, in compliance with established retention<br />
schedules for specific document types.<br />
The following are some benefits derived through data governance:<br />
• Improve the level of trust the users have in reports<br />
• Ensure data consistency across multiple reports from different parts of the organization<br />
• Ensure appropriate safeguards over corporate information for auditors and regulators<br />
• Improve the level of customer insight to drive innovation and marketing initiatives<br />
• Directly impact the three prime factors for any organization: increasing revenue,<br />
lowering costs and reducing risk<br />
Enterprise Information Management<br />
According to Gartner (White, Comport, & Schlier, 2005), Enterprise Information Management (EIM):<br />
1. represents an organizational commitment to structure,<br />
2. secures and improves the accuracy and integrity of information assets to solve semantic<br />
inconsistencies across all boundaries, and<br />
3. support the technical, operational and business objectives within the organization's enterprise<br />
architecture strategy<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 30
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
EIM encompasses not only traditional ICT systems, but all systems and devices for which the<br />
enterprise is responsible. Applied to a utility, grid management information is therefore considered<br />
within scope. Accordingly, a utility EIM encompasses information flowing to/from grid edge devices<br />
(distributed energy resources, plug-in electric vehicles, premises area networks, etc.). This ambitious<br />
scope is facilitated by the utility industry use of consistent models (IEC 61850, 61968, and 61970 series).<br />
During the early stages of <strong>Smart</strong> <strong>Grid</strong> “system of system” implementations, traditional utility data<br />
acquisition and control systems (for substations, feeders, and meter head-end) will manage edge device<br />
information. These systems use a mix of proprietary and industry standard protocols (DNP3) to bring<br />
telemetry to a server tasked to make the data available to other enterprise systems. In these cases, EIM<br />
will interact with edge device information representations, not the edge devices themselves. Over time,<br />
as more intelligence is pushed toward the grid edges, EIM will need to simultaneously extend further<br />
into the network. While physical implementations will necessarily vary considerably (due to hardware,<br />
media and computational capabilities functioning within security constraints), the data management<br />
service categories described in this section are expected to extend to all service enabled applications<br />
and devices in any utility <strong>Smart</strong> <strong>Grid</strong> system of systems.<br />
A commitment to EIM recognizes enterprise information is as important as process (application<br />
development) and infrastructure (technology). EIM enables raw data to be turned into information,<br />
intelligence, knowledge, and wisdom. As information systems become increasingly vital to business<br />
success, information management must be addressed holistically. In summary, EIM:<br />
Enables utilities to take ownership, responsibility and accountability for the improvement of<br />
data quality, information accuracy and consistency.<br />
Enables utilities to establish single version of truth for data over time.<br />
Improves utilities process and operational efficiency and effectiveness.<br />
Provides a strategy and technique to mitigate the risks as well as maximize the value of<br />
implementing commercial packaged applications.<br />
Reduces the number and size of data integration efforts over time.<br />
Enables the control of wasteful data duplication and proliferation.<br />
Enables process integrations to be more flexible and scalable.<br />
Improves data quality, integrity, consistency, availability, and accessibility.<br />
Maximizes the return on SOA technology investments.<br />
Establishes a critical component of the utility Enterprise <strong>Architecture</strong>.<br />
Provides guidance and services to information management efforts.<br />
Enables consistent implementations of SOA and information management for major programs.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 31
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Enterprise Information Management Strategy<br />
EIM frameworks [Figure 34] and strategies provide a roadmap to help utilities establish necessary<br />
information governance and technology solutions. EIM can also drive and enable the convergence of<br />
operational, communications and information technologies, key to a utility <strong>Smart</strong> <strong>Grid</strong> realization.<br />
Enterprise Vision &<br />
Strategy<br />
Enterprise<br />
<strong>Architecture</strong><br />
Enterprise Business<br />
& IT Core<br />
Processes<br />
Enterprise Business<br />
& IT Organizations<br />
Enterprise<br />
Infrastructure<br />
EIM Vision &<br />
Strategy<br />
EIM Governance<br />
EIM Core<br />
Processes<br />
EIM Organization<br />
EIM Infrastructure<br />
Vision<br />
Mission<br />
Strategy<br />
Goals &<br />
Objectives<br />
Value<br />
Propositions<br />
Sponsorship<br />
Stewardship<br />
Policies,<br />
Principles &<br />
Tenets<br />
Alignment<br />
Structure<br />
Data Quality<br />
Data Integrity<br />
Data Security &<br />
Protection<br />
Data Lifecycle<br />
Management<br />
Data Movement<br />
Semantics<br />
Management<br />
Database<br />
Management<br />
Master Data<br />
Management<br />
Information<br />
Services<br />
Services &<br />
Support<br />
CSFs & KPIs<br />
Structure<br />
(Virtual,<br />
Hybrid……)<br />
Roles &<br />
Responsibilities<br />
Functional<br />
Services<br />
Business Value<br />
and Relationship<br />
Management<br />
Information<br />
<strong>Architecture</strong><br />
Blueprint<br />
Management<br />
Technologies<br />
(DBMS, Content<br />
Mgmt, ETL, EAI,<br />
EII, Data<br />
Modeling, BI/DW,<br />
Collaboration…..)<br />
Knowledgebase<br />
and Repositories<br />
Standards & Best<br />
Practices<br />
Figure 34 - EIM Framework<br />
Since much public domain content describes aspects of EIM, the remainder of this section focuses on<br />
how semantic consistency can be improved by leveraging an Enterprise Semantic Model (ESM). The<br />
ESM provides the logical representation of enterprise information assets used to manage or facilitate<br />
business processes. Establishing EIM without an ESM life-cycle design provides little return on<br />
investment since it greatly lessens opportunities for the effective reuse of project artifacts.<br />
Systematic use of ESM supports the following attributes, collectively difficult to achieve otherwise:<br />
Enterprise Information Driven – The ESM should utilize internal models, metadata, and<br />
terminology already in use in the utility enterprise. Existing models and common vernacular,<br />
whether or not they are documented, are important sources for ESM development.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 32
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Enterprise Owned – the utility owns the ESM, including its terminology, semantics, and<br />
implementation. The utility decides if and when externally controlled semantics are introduced.<br />
Stable – The ESM must be stable, keeping established semantics clear and unambiguous.<br />
Non-Static – ESMs are non-static in nature, allowing semantics to evolve toward greater clarity<br />
as existing business information evolves or new information is introduced.<br />
Openly Accessible – The ESM must provide open access to business-critical information about<br />
semantics, data restrictions, entity refinement, and specific business constraints.<br />
Semantic Traceability – Semantic traceability and lineage are important correlations for internal<br />
information (non-ESM semantics).<br />
Industry Standards Aware – A robust ESM provides mechanisms to systematically allow input<br />
from applicable industry standard models (CIM, data types, and code lists) to incorporate<br />
standard and broadly-adopted semantics.<br />
Multiple Standards Capable – An ESM must be capable of incorporating multiple external<br />
reference models, even allowing for referencing more than one standard from a single business<br />
entity.<br />
Concise Enterprise Semantics – By benefiting from both internal sources and available industry<br />
standards, an ESM provides concise enterprise semantics appropriate for business information<br />
across the enterprise.<br />
Business Context Capable - The ESM must support data exchange and information sharing<br />
within a particular business context.<br />
Leverage Available Methodologies - When appropriate, any existing modeling methodologies<br />
should be used in order to avoid reinvention or introduction of proprietary concepts.<br />
Proprietary methods limit choices of service providers, which indirectly will drive up<br />
maintenance and enhancement costs.<br />
Data Management Services<br />
All <strong>Smart</strong> <strong>Grid</strong> domains require Data Management (DM) services, and most require more capability<br />
than they have today. The increase in data volume, combined with tightening timing requirements,<br />
will cause most <strong>Smart</strong> <strong>Grid</strong> enterprises to evaluate their legacy services for future suitability. Data<br />
services can be broken down into data acquisition, transformation, persistence and archiving. A list of<br />
data services and related functions and definitions may be found at .<br />
Control Services<br />
Control for electric utilities covers a considerable span of activities. All relate to the operation of control<br />
devices for power flow manipulation, but the scope ranges from consumer basic voltage regulation to<br />
grid interchange scheduling. This section’s focus is on transmission and distribution control.<br />
Types of Control<br />
<strong>Grid</strong> control is decomposed into three major categories, each with unique requirements.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 33
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Transmission and Substation (System) Control<br />
Transmission and substation level control involves control of transmission systems and substations.<br />
The primary elements are:<br />
Power flow – control of switchgear defining the power flow paths<br />
Balance – dispatch of generation to meet forecasted load, usually by continually driving a<br />
calculated error value toward zero. In the past this was viewed as generation control, but with<br />
the rise of Distributed Energy Resources (DER) and Demand Response (DR), balance authorities<br />
will also dispatch at the distribution and retail levels.<br />
Stabilization – control of ancillary services and devices such as generation and Flexible AC<br />
Transmission Systems (FACTS) to maintain rotor angle stability, voltage stability, and frequency<br />
stability; increasingly this includes control of new devices (e.g. flywheel storage) and dispatch of<br />
hydro power to compensate for the effects of some DERs (i.e. solar, wind). This also includes<br />
using FACTS and Phasor Measurement Units to dampen modal power oscillations.<br />
Volt/VAR – regulation at the transmission level. This can involve Static VAR Compensators and<br />
other FACTS devices, as well as shunt capacitors at the substation<br />
Distribution Level<br />
Distribution level control has expanded from simple SCADA-based control to advanced distribution<br />
automation, increasingly becoming more complex as the distribution grid becomes the focus for DER<br />
integration. Distribution level controls include:<br />
Volt-VAR regulation – regulation of voltage levels and reactive power flow control (and power<br />
factor) at the distribution feeder level. This involves load tap changes, voltage regulators, and<br />
control of capacitor banks. Control of DER-based DC-AC inverters to provide VAR regulation<br />
will also grow in importance as the grid evolves.<br />
Power flow control – operation of switchgear and sectionalizing devices to control power flow<br />
at the distribution feeder level<br />
Stabilization – control of devices at the distribution level, including use of distribution<br />
STATCOM in addition to more traditional distribution automation<br />
Secondary Load Control<br />
Some forms of secondary load control (load shed for demand side management) have existed for<br />
decades. However, recent requirements have emerged to support DR through the distribution-level<br />
control of ancillary devices. Managing secondary loads with distribution-level controls presents<br />
potentially thorny issues for utility control services and processes. Generally, this means non-utility<br />
control devices residing on customer premises are to be commanded by the utility or a third party (e.g.<br />
aggregator). The requirements on utility control processes are largely dependent on how well the<br />
DR/DER controls are integrated with the utility control systems. Full integration will necessitate close<br />
collaboration between the utility and its customers, probably governed by a formal agreement between<br />
the parties. Little or no integration will reduce the potential of secondary load DR for reducing the level<br />
of expensive daily peak power reserves the utility must provide. The extent of secondary load control<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 34
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
will likely be driven by economic incentives, which likely means the level of secondary load integration<br />
will gradually grow over time from a small starting point.<br />
Control Data Classes<br />
Several classes of data are important to control systems. The <strong>Smart</strong> <strong>Grid</strong> Architect must consider how<br />
to deliver each class to the appropriate destinations within the specified latency. The data classes are:<br />
Telemetry – most grid state measurement data (voltages, currents, real and reactive power) are<br />
in the form of telemetry, instrument data produced and collected on a regular basis. In some<br />
designs, sensor data is sent to the control system only upon significant change (i.e. RBE - “report<br />
by exception”), thus reducing average bandwidth requirements.<br />
Events – asynchronous event messages are generated by a myriad of grid devices, many of<br />
which require control actions to be taken. Therefore the control services architecture must<br />
support receipt and processing of such messages. RBE data can be viewed as event messaging.<br />
Forecasts – utility control processes make extensive use of various kinds of forecasts - load<br />
forecasts, weather forecasts, and solar/wind generation forecasts being prime examples.<br />
System models – utility control processes use system models extensively and the dependence on<br />
such models is increasing in the <strong>Smart</strong> <strong>Grid</strong> environment. Two major types of system models<br />
used in grid control processes are:<br />
o Power state – also known as grid state, the power state represents the instantaneous<br />
values of voltages, currents, and real and reactive power flows.<br />
o Topology – power grids have connectivity and the models that represent the circuit and<br />
substation connectivity are crucial context for grid control processes.<br />
<strong>Grid</strong> state is a powerful concept used extensively at the transmission level, where grid state estimation<br />
is a standard process used in system control. However, it has not been used as much at the distribution<br />
level. The main reasons for this are:<br />
1. Distribution level connectivity models are complex and relatively inaccurate, and<br />
2. Distribution circuits are treated as unbalanced, making grid state estimation costly<br />
As distribution grid observability increases, it becomes feasible to replace grid state estimation with<br />
grid state determination. This combines direct grid state measurement with a minimal amount of<br />
estimation. The availability of distribution grid state is a key factor in enabling sophisticated<br />
distribution level control processes.<br />
Control Properties and Issues<br />
Multi-Objective/Multi-Controller systems – as control processes become more complex in a<br />
<strong>Smart</strong> <strong>Grid</strong> environment, it becomes desirable or necessary to operate specific grid devices for<br />
multiple business purposes. This need raises architectural issues as to how potentially<br />
conflicting control commands are resolved. Several design patterns for multi-controller<br />
structures are shown in Figure 35.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 35
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 35 - Multi-Controller / Multi-Objective Design Patterns (van Breeman, 2001)<br />
Federation – multiple control sub-systems must co-exist in a <strong>Smart</strong> <strong>Grid</strong> environment, especially<br />
at the distribution level. Some control systems, as mentioned above, may not reside inside of the<br />
utility, but their grid effect can impact the utility. The federation of multiple, interacting control<br />
sub-systems or processes presents architectural issues unknown in siloed systems.<br />
Disaggregation – as more controllable devices are installed at the distribution level, high-level<br />
control commands will increasingly be decomposed to better fit control actions to specific<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 36
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
conditions on individual circuits or circuit sections. This disaggregation process is a key element<br />
the <strong>Smart</strong> <strong>Grid</strong> control services architecture must support.<br />
Context and representation – as mentioned above, the context for control actions (and analytics)<br />
is tied directly to the physical connectivity of the relevant grid segment. Consequently, the<br />
representation of grid structure and related information (grid state) are key issues for grid<br />
control services. The Common Information Model (IEC, 2003) schema is a core standard for such<br />
representation and is therefore crucial to the control services architecture.<br />
Control architecture considerations<br />
A number of factors affect control services architecture. Key is the utility’s long-term transition strategy<br />
on how to accommodate legacy control systems while integrating new <strong>Smart</strong> <strong>Grid</strong> control capabilities.<br />
Present utility control systems tend to exist in the form of siloed, tightly-bundled systems. Some<br />
examples are Energy Management Systems, SCADA, Distribution Automation, Outage Management<br />
Systems, and the presently evolving Distribution Automation Systems. A traditional control center<br />
functional architecture is shown in Figure 36 below.<br />
Figure 36 - Control Center Functional <strong>Architecture</strong> (IEC, 2005)<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 37
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
A transition to a layered, services-oriented system of systems architecture will cause these systems to<br />
evolve away from their siloed and monolithic current state. At present, interoperability efforts are<br />
helping to better integrate these systems, but modifying these products to a full services-oriented<br />
model will be a longer transition. It will probably pace the evolution of the entire <strong>Smart</strong> <strong>Grid</strong>. In the<br />
meantime, the system-of-systems philosophy can help the <strong>Smart</strong> <strong>Grid</strong> Architect develop large-scale<br />
control services architecture by integrating available control system elements (listed above).<br />
Utility control systems must deal with a range of latency requirements, and as the <strong>Smart</strong> <strong>Grid</strong> becomes<br />
more capable, the latencies are expected to decrease. SCADA cycles previously measured in seconds<br />
are being displaced by closed loop stabilization controls operating on the time scale of two cycles (1/30 th<br />
second). Some processes will continue to have relatively long latencies, but application requirements<br />
driving control services architecture hardest will be the ones with the tightest time limitations.<br />
The <strong>Smart</strong> <strong>Grid</strong> concept includes many more control points than the traditional grid, especially at the<br />
“edges” (distribution level). As controllable points are added, control architecture scalability becomes<br />
an increasingly important issue. Not only are more points being controlled, but the number of data<br />
points used to compute the control will grow dramatically.<br />
While control systems are vital to smart grid success, the power reliability and availability provided by<br />
the current control services remain of highest importance to power delivery. The smart grid migration<br />
plan must never degrade existing core grid attributes. <strong>Grid</strong> control services architecture must therefore<br />
have enough flexibility to ensure grid reliability is unaffected as new control features are implemented.<br />
The smart grid environment will involve increasing numbers of control devices as well as processes<br />
and applications. Management of the devices and applications will be complex. The control services<br />
architecture must closely integrate with the management services architecture to provide a unified<br />
approach toward managing settings, protection curves, code versions, exception events, etc.<br />
Control <strong>Architecture</strong>s<br />
Where legacy utility control system architectures were centralized (e.g. EMS, SCADA, OMS), many<br />
future smart grid control systems will be fully distributed or have distributed components. A few<br />
utility control systems are already distributed – an example is a fault isolation system using peer-topeer<br />
radio and pre-programmed logic on the sectionalizers to isolate faults in distribution circuits. The<br />
smart grid architect should expect control services architecture to transition from mostly centralized, to<br />
partially-centralized, to a final hybrid centralized/distributed state. There are various hierarchical<br />
alternatives for how to arrange the hybrid controls service. An example design pattern for hierarchical<br />
control architecture is shown in Figure 37 below. Such structures will raise implementation issues<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 38
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
while the utility begins to move away from the mostly centralized legacy control. Managing the hybrid<br />
control services architecture is expected to be complex and time-intensive.<br />
Figure 37 - Hierarchical Control Design Pattern<br />
Conclusion<br />
The control services architecture presents many challenges to the smart grid architect, especially the<br />
coordination of control services with other smart grid services architectures. The challenge is similar to<br />
that posed by the switchover from manual meter reading to AMI – any portion of the system is crucial<br />
to operations, cash flow, and customer satisfaction, leaving little or no margin for experimentation or<br />
error.<br />
Security Services<br />
<strong>Grid</strong> systems security has largely relied upon obscure proprietary protocols and lack of remote<br />
communications access (security by obscurity) to protect grid control devices. The smart grid is<br />
expected to provide a more secure and reliable grid infrastructure.<br />
Security Threats<br />
<strong>Smart</strong> <strong>Grid</strong> Cyber Security concerns dictate a multi-faceted approach to security. The system must<br />
provide security controls to address concerns unique to the implementation environment, and to<br />
interactions and interdependencies with other enterprise and business applications. The smart grid<br />
security architecture must address these concerns with a rich set of controls designed to facilitate<br />
tailored and highly granular supervision. Each control must be engineered for its environment,<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 39
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
mission, and user. The resulting solution must manage the full lifecycle security for every aspect of<br />
information and technology, from edge to back office devices and from engineering to implementation.<br />
Physical Security Threats<br />
Utilities need to respond to increased physical threats on their electrical assets with a greater number of<br />
physical security systems (e.g. video surveillance, biometric-based access controls, alarms, motion<br />
detection sensors, etc.), as well as other measures. Physical threat counter-measures demand<br />
coordination, management, and communication infrastructure to relay information to appropriate<br />
Security Control Centers and Emergency Centers (i.e. the Police, Fire Department and local Hospitals).<br />
Training must also be provided to utility personnel on a regular basis to ensure a high-level of security<br />
awareness in each employee. Each person needs to know how to identify potential physical threats and<br />
how to contact the appropriate resource to mitigate the potential risk.<br />
Cyber Security Threats<br />
The increased use of Information and Communications Technologies (ICT) in the smart grid also brings<br />
additional security threats potentially impacting electric power system reliability. Sophisticated cyberattacks<br />
could devastate this infrastructure, and the dependent economy. Cyber security threats have a<br />
broad sweep, from relatively minor (an attempt to bypass a meter), serious (an organized crime<br />
attempt to extort utility funds by threatening service disruptions), to existential (national adversaries<br />
seeking to destabilize the country’s critical infrastructure). Other potential threats include intentional<br />
attacks by disgruntled employees or unintentional errors made by well-meaning employees.<br />
Considering the millions of electronic devices (e.g. smart meters) being deployed with expected<br />
lifetimes exceeding 15 - 20 years means applying ex post facto security can no longer be tolerated. <strong>Smart</strong><br />
grid systems must be secure by design.<br />
Using Internet Protocol (IP) for smart grid communications and open standard protocols for grid<br />
control necessitates securing the grid at multiple points. The <strong>Smart</strong> <strong>Grid</strong> Security Services provides<br />
security enforcement at these points (e.g. SCADA Network systems, the Utility Communication Link,<br />
Advanced Metering Infrastructure, Substation Remote Monitoring Equipment, and Meters to Meter-<br />
Data Collection Points).<br />
In addition, utilities may need to enhance the protection applied to their public-facing portals (i.e. web<br />
pages). These will inevitably be attacked as Demand Response prosumer energy controls are activated<br />
by smart grid projects. Security architects will need to defend against these cyber-attacks while<br />
protecting sensitive customer data without disrupting any prosumer using utility internet tools<br />
provided to help manage electricity.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 40
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
This security perimeter expansion has both topological and identity-based elements. This allows<br />
Security architects to classify and prioritize security vulnerabilities for each communication<br />
infrastructure perimeter, as illustrated below by Figure 38:<br />
Figure 38 - Security Threats Classification<br />
With all the potential security threats to the smart grid, how can a Security architect ensure grid<br />
security and reliability? Simply complying with regulatory requirements is usually not sufficient to<br />
protect critical systems against determined adversaries. Security architecture must be pervasive. It<br />
requires considerable planning, analysis and design concurrent with other grid architecture designs.<br />
Security Assessment<br />
In order to address the diverse grid threats, the security architecture must perform an assessment to<br />
identify ICT security vulnerabilities and risks. To be successful, all utility business units and support<br />
organizations must participate, allowing access to their ICT infrastructure and providing the<br />
transparency needed to uncover all known and potential security attack vectors.<br />
Each security assessment must also consider evolving legal and regulatory security requirements. This<br />
helps the utility remain compliant with external mandates (i.e. NERC CIP, NISTIR, NIST 800-xx,<br />
various state and local directives).<br />
The Security Architect must clearly communicate the objectives of each assessment:<br />
Review existing security policies and identify potential gaps to reduce organizational risk<br />
Ensure necessary security controls are integrated into each project’s design<br />
Provide documentation outlining any security vulnerabilities and suggest solutions<br />
The following methodology outline is an effective means to conduct a security assessment:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 41
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Requirement Study and Situation Analysis<br />
Document Review<br />
Risk Identification<br />
Vulnerability Scan<br />
Data Analysis<br />
Report & Briefing<br />
As noted above, the Security Assessment identifies security vulnerabilities. It also helps define the<br />
security strategy for the smart grid system-of-systems. The huge number of interconnected points in<br />
smart grid makes its security very challenging. The Security Assessment helps the utility determine the<br />
assets to security-enhance and those with an acceptable risk level. The Levels of Criticality and Levels<br />
of Trust, described later in this section, are relevant tools for this assessment.<br />
The <strong>Smart</strong> <strong>Grid</strong> Cyber Security concerns dictate a multi-faceted approach to security. The system must<br />
provide security controls to address concerns unique to the implementation environment and<br />
interdependencies among enterprise and business applications. The smart grid security architecture<br />
must address these concerns with a rich set of controls designed to facilitate tailored supervision with a<br />
high degree of granularity. Each control must be engineered for its environment, mission, and user.<br />
The resulting solution will manage security from cradle to grave for every aspect of information and<br />
technology, from edge devices to Back Office; from engineer to implementation.<br />
The imperative to address emergent cyber security concerns as the smart grid matures requires a Risk<br />
Adaptive <strong>Architecture</strong>. This architecture combines risk management and principled systems<br />
engineering methods to produce a scalable, modular solution. This equips security architects with tools<br />
needed to respond as threats, technology, regulation, and usage independently change.<br />
The Security Architect must also study technology providing direct security capabilities, as well as<br />
functionality to simply enable secure policy, architecture, and configuration. The security architecture<br />
should use the best cryptography along with filtering, firewalls, segmentation, and virtualization.<br />
Physical security must be interwoven with cyber security to ensure controls are appropriate, effective,<br />
economical, and enduring. Finally, recognizing even the best of systems fail and no armor is perfect,<br />
the security architecture must develop a holistic approach to deter, prevent, detect, react, and recover.<br />
Security Context<br />
Central to the notion of security services for risk adaptive security architecture are the related concepts<br />
of security domains and levels of trust. The two broad smart grid service domains are described below.<br />
The trust level is derived from data quality and source trustworthiness.<br />
Since smart grid spans a complex trust environment, it must be capable of distinguishing, labeling, and<br />
segmenting data based on its origin and the system’s level of confidence in the data. <strong>Smart</strong> grid<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 42
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
functionality must have enough resilience to ensure essential functions remain available should data<br />
sources be suddenly deemed untrustworthy and dropped from analytics, displays, etc.<br />
Security Service Domains<br />
A security service domain is an area with a relatively consistent set of constraints and expectations.<br />
There are two security service domains:<br />
Levels of Criticality<br />
The Centralized Security Services domain drives the security scheme, providing automated<br />
security services to all elements of the system as well as management capability for each of the<br />
automated services.<br />
The Decentralized or Edge Security Services domain provides the field component counterparts<br />
for relevant services in the Central Security Services domain. Both domains leverage physical<br />
access controls to compliment electronic controls in creating a complete protection picture.<br />
NERC currently defines three levels of criticality when it comes to CIP: High, Medium, and Low:<br />
Levels of Trust<br />
Bulk Electric System (BES) Subsystems have High Impact if, when destroyed, degraded or<br />
otherwise rendered unavailable, they could directly cause, contribute or create an unacceptable<br />
risk of BES instability, separation or a cascading sequence of failures.<br />
BES has Medium Impact, if, when destroyed, degraded or otherwise rendered unavailable, they<br />
could directly affect the electrical state or the capability of the BES, directly affect the ability to<br />
effectively monitor and control the BES.<br />
BES has Low Impact if, when destroyed, degraded or otherwise rendered unavailable, they<br />
could not directly cause, contribute to, or create an unacceptable risk of BES instability,<br />
separation, or a cascading sequence of failures.<br />
The level of trust for a particular datum starts with an assessment provided by the data source and<br />
retained in the data header’s quality field. The system combines this value with a measure of the trust<br />
assigned to its source to define the data level of trust as one of the following:<br />
Trusted: The data meets all predetermined criteria and is displayed and/or incorporated<br />
normally. The operator retains the ability to manually override the decision.<br />
Questionable: The data meets some but not all criteria or falls within a designated window<br />
whereupon the system warns the operator of the condition and prompts for data inclusion.<br />
Untrusted: The data fails to meet predetermined criteria and is not displayed or incorporated in<br />
calculations. The operator retains the ability to manually override the decision, however the<br />
system will indicate it is in an override condition.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 43
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NISTIR 7826 Security Guidelines (NIST-ITL, 2010)<br />
In August 2010, the NIST Information Technology Laboratory (ITL) issued a three-volume NIST<br />
Interagency Report (NISTIR 7628) entitled Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security (NIST-ITL, 2010) to<br />
discuss “ITL’s research, guidance, and outreach efforts in computer security and its collaborative<br />
activities with industry, government, and academic organizations.” A month later, the <strong>Smart</strong> <strong>Grid</strong><br />
Interoperability Panel (SGIP) Cyber Security Working Group published the Introduction to NISTIR 7628.<br />
The following text is from a sidebar on page 3 of this introduction, At a Glance: Report Objectives:<br />
The transformation of today’s electricity system into a <strong>Smart</strong> <strong>Grid</strong> is both revolutionary and<br />
evolutionary. Persistence, diligence, and, most important, sustained public and private<br />
partnerships will be required to progress from today’s one-way, electromechanical power grid<br />
to a far more efficient digitized “system of systems” that is flexible in operations, responsive to<br />
consumers, and capable of integrating diverse energy resources and emerging technologies.<br />
This progression will unfold over the span of many years, during which several generations of<br />
technologies will compose the evolving <strong>Smart</strong> <strong>Grid</strong>. As a consequence, the cyber security<br />
strategy for the <strong>Smart</strong> <strong>Grid</strong> must also be a continuing work in progress so that new or changing<br />
requirements are anticipated and addressed.<br />
Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security is both a starting point and a foundation. As <strong>Smart</strong><br />
<strong>Grid</strong> technology progresses, the Cyber Security Working Group (CSWG) will continue to<br />
provide additional guidance as needed. This first installment of the guidelines is:<br />
An overview of the cyber security strategy used by the CSWG to develop the high-level<br />
cyber security <strong>Smart</strong> <strong>Grid</strong> requirements;<br />
A tool for organizations that are researching, designing, developing, implementing, and<br />
integrating <strong>Smart</strong> <strong>Grid</strong> technologies – established and emerging;<br />
An evaluative framework for assessing risks to <strong>Smart</strong> <strong>Grid</strong> components and systems during<br />
design, implementation, operation, and maintenance; and<br />
A guide to assist organizations as they craft a <strong>Smart</strong> <strong>Grid</strong> cyber security strategy that<br />
includes requirements to mitigate risks and privacy issues pertaining to <strong>Smart</strong> <strong>Grid</strong><br />
customers and uses of their data.<br />
The guidelines are not prescriptive, nor mandatory. Rather, they are advisory, intended to<br />
facilitate each organization’s efforts to develop a cyber security strategy effectively focused on<br />
prevention, detection, response, and recovery.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 44
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NISTIR 7628 should be studied closely by all smart grid security architects. The three volume report<br />
contains a myriad of methods and related information designed to help organizations assess risk and<br />
then to apply appropriate security requirements to mitigate the risks identified.<br />
Communication Services<br />
Communication services (comms) are fundamental to electric grid operations. They enable devices to<br />
be intelligent, information to flow, controls to execute, and people to manage utility functions and<br />
services. Large numbers of new smart devices will be deployed in a smarter grid, each needing some<br />
form of communications. Planning for this deployment is difficult since most devices don’t yet exist<br />
and initial functionalities will change as grid operators figure out innovative ways to leverage their<br />
intelligence. Thus, it is critical for the future grid communication architecture to be extraordinarily<br />
resilient and flexible.<br />
It is strategic to develop a clear understanding at the conceptual layer of the interplay between smart<br />
grid objects (endpoints), the information they communicate, and the channels across which that<br />
information flows. This will provide context for rationalizing the communication functions at the<br />
services layer.<br />
Figure 39 - Conceptual and Services Layers<br />
Every endpoint, all information types, and each communications channel are different. Their<br />
combinations are staggering and their capabilities continually change. The comms requirements to<br />
support smart grid use cases are proof of this diversity (see Table 25 – Communications Services). This<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 45
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
will remain true as new smart grid use cases emerge. Characterizing these requirements can be<br />
extremely challenging. For example, performance requirements can range from exceptionally stringent<br />
to relatively modest. Information flows could be streamed, polled, infrequent, message mode, file<br />
transfer mode, or asynchronous event-driven. Application architectures can vary from highly<br />
centralized, to distributed, and some could even be peer-to-peer. The quantity of actors in these use<br />
cases could range from dozens to millions. Most are stationary, but others require mobility. Some are<br />
critical to grid operation while others are of marginal operational importance. This diversity challenges<br />
the enterprise architect to devise flexible, scalable smart grid communications architecture.<br />
The Nature of <strong>Smart</strong> <strong>Grid</strong> Endpoints, Information and Channels<br />
A framework around which communication services might be considered should examine the nature<br />
of: (1) the actors (endpoints and their functional requirements), (2) smart grid information, and (3) the<br />
channels through which information will flow. Thoroughly understanding these drivers will help the<br />
smart grid architect put the supporting communication services in a proper context.<br />
<strong>Smart</strong> <strong>Grid</strong> Endpoints<br />
<strong>Grid</strong> endpoints include a range of devices. In general, they include field devices such as meters,<br />
reclosers, capacitor banks, and so on. There are a variety of devices in substations including IEDs,<br />
SCADA RTUs, teleprotection devices, measurement devices, security appliances, and so on. At data<br />
and operations centers there are head-end processors, data collection units, control systems, customer<br />
interface portals, etc.. In general, these endpoints provide the smart grid application functions. For<br />
purposes of this reference architecture, the communication nodes are not considered endpoints since<br />
they don’t provide application functions.<br />
Each of these endpoints has unique operating capabilities. The smart grid architect should consider a<br />
variety of aspects of these endpoints when planning comms solutions including:<br />
Diversity of purpose – Will the endpoint support a single purpose or is it a multipurpose<br />
device? For example, meters are typically thought of as devices providing usage data. But in<br />
smart grid, meter functions expand to include usage, remote connect/disconnect, outage alerting,<br />
and power quality data. Metering groups need the usage data but grid operations teams would<br />
be interested in outage and power quality data. How does this impact comms architecture? As<br />
an example, if a meter is placed in a virtual network designed for metering, then additional<br />
challenges need to be considered in the overall architecture in regards to security, performance,<br />
and operations in order to direct outage and performance data to the appropriate recipients.<br />
Diversity in scope — Will the endpoint communicate to just one (or redundant) other endpoint<br />
or will it communicate with a diverse set of other endpoints? Extending the example of<br />
metering, it may be necessary to regularly collect usage data from a centrally located meter<br />
collection engine. Outage information could be captured by distributed OMS pre-processors<br />
located at substations so event messages don't congest the backhaul networks. Power quality<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 46
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
data may need to be periodically collected by analytics systems. In this example, meter<br />
endpoints may communicate with three or more host system, each existing in different domains<br />
and at different locations. However, teleprotection devices may not have the same multi-domain<br />
requirement. For operational reasons it may also be necessary to restrict the devices able to send<br />
traffic to the teleprotection equipment.<br />
Criticality – Is the purpose of the endpoint to support: a critical real-time function, for billing or<br />
analytics purposes, or for informational but non-critical functions? Some devices are seen as<br />
more critical than others for a variety of reasons. For example, if a teleprotection device fails to<br />
operate in a timely manner it could result in the loss of electrical service to thousands of<br />
customers which could extend for weeks. Associated damage to grid equipment could cost<br />
many hundreds of thousands of dollars. Therefore communication solutions for teleprotection<br />
devices warrant significantly more investment for reliability and resiliency than communication<br />
solutions for a feeder-capacitor bank with a potential to affect far fewer customers if information<br />
cannot flow in a timely manner.<br />
Mobility – Is the device mobile, fixed, or transitional? Most smart grid devices do not need<br />
mobility protocol support since they will be mounted on homes, poles or in building facilities.<br />
However, there is increasing need to support mobile workers and mobile machine-to-machine<br />
solutions. Mobility introduces many architectural challenges (coverage, access methodology,<br />
roaming support, location awareness, etc.).<br />
Quantity – How many devices will exist in a mature implementation? How will their numbers<br />
be spread across the various communication domains? How will management systems support<br />
potentially millions of devices such as meters? What are the impacts to traffic capacities and<br />
congestion control?<br />
Geographic density – Where will devices be deployed? For the various kinds of devices, will<br />
they be widely dispersed, densely placed, adjacent or in close proximity to other grid devices?<br />
How does this impact communication media choice? Can proximity be leveraged or does it<br />
present challenges (interference, signal power constraints, etc.)?<br />
Degree of intelligence – How intelligent is the endpoint? Is it highly dependent on other<br />
systems for resources and functionality? If so, where do they exist and what is their criticality to<br />
other endpoints? Where does the application intelligence for this endpoint exist? Most legacy<br />
grid systems use centralized intelligence; therefore centralized communication architectures can<br />
support them (very common for SCADA and AMI systems). However, if intelligence becomes<br />
distributed, then the communications architecture must also be distributed. For example, if grid<br />
intelligence is distributed to the substation, could field-mounted devices effectively<br />
communicate to the substation?<br />
<strong>Smart</strong> <strong>Grid</strong> Information<br />
The information transmitted between smart grid endpoints varies widely. It comes in many forms,<br />
sizes, criticality, and regularity. For a variety of reasons, not all communication systems are conducive<br />
for handling the breadth of requirements from required smart grid information sources:<br />
Regularity of transferring information– Will information be a continuous stream, scheduled<br />
transactional, or event-driven? This issue concerns how to think about congestion management.<br />
Streaming information (like PMU data) and scheduled transactions (like AMI reads) are<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 47
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
predictable and easier to plan for. But event-driven information can be very challenging.<br />
Furthermore, how does information regularity impact communication session management and<br />
security mechanisms (for example key management, access control, and authentication)?<br />
Size – What is the size of the information? This issue concerns how to think about bandwidth<br />
requirements. Is it streaming and as such is continuous? Is it a predictable file size? Is it messageoriented<br />
and contained in predictable bytes or even bits?<br />
Form – Is the information structured (XML file), bit-oriented (on/off), or byte-oriented (DNP3,<br />
IEC) defined messages? Is the information unstructured (such as a continual tone)?<br />
Duration/longevity – Is the information archivable (meter and other forms of measurement),<br />
transactional with a short time-to-live (outage or state data), or potentially a repeatable<br />
transaction (control data with message acknowledgement)? How does this impact<br />
communication system choice and failover schemas?<br />
Criticality – Is the information critical, not critical, or somewhere in between? Does it warrant<br />
high availability or redundancy? If so, to what degree of reliability should the system be<br />
designed (is 99.999% reliability necessary or would marginally lower reliability suffice)? How<br />
does information criticality impact the failover schema at the application layer versus at the<br />
communication layer?<br />
Simulcast – Will information be broadcast for any “interested” device to receive (publishsubscribe<br />
systems), multicast to a defined set of multiple devices, or unicast to just one device?<br />
Broadcast and multicast information can challenge the communications solution.<br />
Ownership – Who owns the information? What policies govern access to the information? What<br />
are the implications at the application layer versus the communications layer?<br />
Diversity of usefulness – Is the information useful across multiple applications? Example: some<br />
AMI transactions combine usage and power quality information.<br />
<strong>Smart</strong> <strong>Grid</strong> Channels<br />
There are a wide variety of channels (media) over which smart grid information might travel. Most of<br />
the time, information will travel over a network of networks—each optimized for some collective need.<br />
Understanding why different networks are necessary and how they function is critical to achieve<br />
optimal communications architecture.<br />
Access mechanisms – How is the channel accessed? This issue is especially of concern for<br />
wireless systems where media sharing can be challenging. Some solutions use network-based<br />
synchronized time slots (polling) schemes to limit collisions but this can affect performance.<br />
Other solutions might use application layer polling that, if combined with network-based<br />
polling, could be unnecessarily redundant.<br />
Shared use – If the channel is shared, how will traffic utilization be handled? For example,<br />
expensive wide area networks will likely need to support high priority critical traffic and lower<br />
priority informational traffic. How will traffic priorities be administered? What happens if<br />
devices that share the same channel (meters for example) cannot effectively hear one another?<br />
Do data link layer capabilities exist to prevent genuine information from appearing as noise?<br />
Distance between devices – Does the distance between devices warrant powerful transmission<br />
signal levels (many miles)? If so, how would it affect system cost structure? Is the distance short<br />
enough to allow communications capabilities at one device to support other nearby devices?<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 48
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Diversity of function – Will channel use support a variety of applications with varying<br />
performance and security needs, or will the channel be purpose-built for a particular solution?<br />
Performance – What are the latency capabilities of the channel? Some media (fiber optics) can<br />
support extraordinary performance characteristics. However, due to contention and framing<br />
mechanisms, wireless systems generally support more moderate characteristics and their<br />
effective performance range can vary widely.<br />
Bandwidth – What is the bandwidth of the channel? Different media types support varying<br />
amounts. At the low end, some long-reach wireless systems might only support 10’s of kilobytes<br />
per second. At the upper end, some fiber solutions can support many gigabytes per second.<br />
Reliability – What reliability schemes are used on the channel? There is a wide spectrum of<br />
reliability mechanisms a communications system could deploy. Cost considerations must be<br />
applied to obtain the necessary degree of reliability and performance these schemes can deliver.<br />
For example, do applications on field area networks warrant 99.999% reliability? What is the cost<br />
for the desired reliability? Is a 50 millisecond failover scheme on a Synchronous Optical<br />
Network (SONET) based teleprotection circuit acceptable to application users? What would<br />
happen if the failover detection was only a few milliseconds but the reconvergence time for<br />
information flow measured in the hundreds of milliseconds?<br />
Media cost structure – What is the cost structure of the media? When it comes to<br />
communications, the balance between cost and performance must always be considered. Some<br />
wireless solutions may not require much channel costs (i.e. free space propagation, licenseexempt<br />
systems, and very limited path engineering). However other wireless solutions might<br />
require licensing and very diligent system engineering. Furthermore, fiber placement might<br />
require public right-of-way and construction costs. Costs must be reasonable for the set of<br />
applications supported by the media. For example, under what circumstances would fiber<br />
deployment be warranted for meter communications?<br />
Equipment cost structure – What is the cost structure of the equipment? Communication<br />
systems have a wide spectrum of features and capabilities (power consumption, interface<br />
redundancy, management, etc.). The architect must determine what is reasonable for the<br />
environment and the applications being addressed. While many capabilities are generally<br />
desirable, if unchecked they may encumber the solution cost structure. For example, is it rational<br />
to deploy communication devices with no power supply or interface redundancy at<br />
transmission substations?<br />
Environment – What is the nature of the channel environment? Does it require special<br />
hardening? Is the equipment location under the direct and exclusive control of the utility?<br />
Administration – How will the channel be administered? Will the channel be under the<br />
management and administration of the utility or will the utility obtain channel services from a<br />
provider? How will channel administration affect service assurance and restoration? How will<br />
periodic changes on communication system(s) be coordinated with utility business operations?<br />
Communication Services<br />
Understanding the conceptual layer of endpoints, information and channels helps frame the<br />
communication services necessary to support smart grid operation. Once identified, the<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 49
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
communication services can be mapped to the various network of networks comprising the overall<br />
communications architecture.<br />
The Communication Services layer [Figure 40] requires the following functions:<br />
Transport services to move information around the network,<br />
Virtualization services to help segregate and optimize transport services,<br />
Control services to help manage information flow and support endpoints needing network access,<br />
Gateway services to facilitate legacy applications to utilize next generation networks, and<br />
Mobility services to support roaming or mobile endpoints.<br />
Figure 40 - Communication Services Layer Functions<br />
Transport Services<br />
Transport services are the means to move information around the network. Transport services are<br />
derived when communication links are combined to form networks. Since smart grids can cover a wide<br />
expanse of territory, a network of networks must be developed and interconnected so endpoints can<br />
send and receive information across the networks’ transport services.<br />
When considering transport services for smart grid, the smart grid architect will make a series of<br />
choices—each time providing more and more detail. The highest level choice defines the type of<br />
transport service to deploy. Next, the architect must determine logical divisions for each network<br />
within the ‘network of networks’ (subnetworks). Only then can the architect establish each<br />
subnetwork’s operating characteristics. Figure 41 illustrates this process below:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 50
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 41 - Transport Services Consideration Process<br />
1. Type<br />
First, the architect must make the decision of what type of transport service to deploy. There are two<br />
fundamental types of transport networks: circuit switched and packet switched. In the general world of<br />
telecommunications, it has been long established that packet-based solutions provide the most ideal<br />
form of transport services. The primary value of packet-based solutions comes from their ability to<br />
support an extraordinary array of applications over a common infrastructure. This provides<br />
exceptional economic and operating benefits. Another key value is that packet solutions were a product<br />
from a methodology supporting a layered approach whereby applications could evolve independent of<br />
the network. Abstracting the applications from the network provides both versatility and stability for<br />
each environment. In the case of smart grid where innovation is expected and requirements will be so<br />
diverse, packet-based transport solutions are the only logical choice.<br />
Although virtually all new investments are packet-based, there are still large amounts of legacy<br />
applications and infrastructure that will co-exist for some time. Adapting these systems to packet<br />
transport services is necessary and will be covered below in the Gateway Services section.<br />
2. Logical Division<br />
The next decision that must be made is the logical division for each subnetwork making up the end-toend<br />
solution. Implied is that there isn’t a single ideal transport network for accommodating smart grid.<br />
Therefore some form of subnetworking must take place to achieve various transport service capabilities<br />
(described below). For example, some networks are optimized for ultra-high speed but its cost<br />
structure can be burdensome. Since not all applications warrant such costs, networks of lower<br />
capabilities may be needed. The same tradeoff can be made regarding other characteristics such as<br />
performance and security requirements. Network technologies have limits and thus the<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 51
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
implementation of subnetworks is necessary. For making subnetworking decisions, it is best to<br />
establish functional categorization.<br />
While it is tempting to categorize transport services according to media type (fiber, wireless, powerline<br />
carrier, etc), this leads to ambiguity. For example, the kind of fiber networks used in data centers is<br />
different from fiber systems used to reach extraordinarily long distances across a utility’s operating<br />
territory. And the variety of wireless systems includes solutions such as long-haul microwave,<br />
metropolitan-based WiMAX, local WiFi, and even Zigbee personal area networks.<br />
It is better to categorize transport services into functional subnetworks. It appears this is what NIST has<br />
done in their <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Reference</strong> Diagram [Figure 42] as they identify:<br />
Internet / e-Business<br />
Enterprise Bus<br />
Wide Area Networks<br />
Substation LANs<br />
Field Area Networks<br />
Premises Networks<br />
Figure 42 - Conceptual <strong>Reference</strong> Diagram for <strong>Smart</strong> <strong>Grid</strong> Information Networks (NIST, 2010)<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 52
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The NIST Conceptual <strong>Reference</strong> Diagram is a functional categorization, except for the use of the<br />
Operations domain term “Enterprise Bus” (usually a software-based mechanism for abstracting<br />
applications from transport services) instead of “Operations Center LANs”. The “Internet / e-Business”<br />
clouds in Figure 42 suggest communications to external entities such as trading partners, customers,<br />
and other market operators. The “Wide Area Networks” cloud reflects the communications required<br />
across expansive territories from information processing centers to moderately remote assets<br />
(substations, data concentrators). The “Field Area Networks” cloud represents connectivity from<br />
various points of concentration out to numerous, scattered, and small endpoints.<br />
Functional categorization of transport systems provides the architect a framework to evaluate<br />
subnetworks and to make business, economic and technical choices. For example, the architect may<br />
initially opt for a carrier-provided public wide area or field area network. As the system evolves certain<br />
critical or highly used links could be replaced with utility-owned infrastructure (fiber or some form of<br />
wireless media). There may be instances where the utility initially operates a wireless solution based on<br />
cost structure but the evolving smart grid eventually causes fiber links to supplant the wireless links.<br />
The functional transport service architecture also helps the architect make the decision when to<br />
converge or segregate subnetworks. For example, the wide area network domain provides connectivity<br />
between Operations or Control Centers and remote substations. From an electric grid standpoint, the<br />
wide area network is generally associated with covering the transmission grid and substations whereas<br />
the field area network covers the distribution grid beyond the substation (Figure 42). Applications and<br />
endpoints associated with the transmission grid require high performance capabilities and warrant the<br />
diversity and higher reliability associated with more costly network solutions. As a media choice, fiber<br />
offers the highest degree of performance and is therefore often preferred in the wide area network.<br />
Since it can be costly to operate multiple wide area networks over the same geographic footprint,<br />
converging traffic onto a single (virtualized) fiber-based wide area network can be advantageous. In<br />
any case, the unique properties for each network domain are important architectural considerations.<br />
3. Characteristics<br />
After choosing the type of transport service and the logical divisions for subnetworking, the architect<br />
must then make key business, operational, and technical decisions regarding each subnetwork’s<br />
operating characteristics. Each issue impacts architectural choices just as they influence design choice.<br />
Common domain issues to consider include:<br />
Bandwidth - How much is required and available? How is it consumed and/or allocated? How does<br />
bandwidth utilization impact architecture decision?<br />
Latency and jitter– How does the transport service architecture support and manage latency and<br />
jitter? How do protocols used across the transport service impact latency and jitter? How do latency<br />
and jitter influence network element architecture choice?<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 53
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Domains – How are transport services virtualized into segregated domains to support bandwidth,<br />
latency, privacy, and management? (Also covered in the Virtualization Services section below.)<br />
Resiliency – How do the failover mechanisms support the transport services within each of the<br />
subnetworks and from an end-to-end perspective? What are the performance capabilities of the<br />
resiliency mechanisms?<br />
Quality of Service – What quality of service capabilities exist for the transport services in each of the<br />
different subnetworks?<br />
Reliability – What is the reliability of the transport service at each of the subnetworks?<br />
Access – How will devices gain access to the transport service? Will there be many devices<br />
attempting to access the services simultaneously?<br />
Standards – What standards apply? Are there functional gaps not covered by standards?<br />
Management – How are transport services granted, restricted and controlled?<br />
Costs – What is the cost structure for various types of transport services?<br />
Differences among the domains begin to drive further architectural considerations. For each of the<br />
transport service domains, key issues have been identified:<br />
Internet / e-Business<br />
Purpose – provide connectivity to customers, suppliers, business partners, emergency services, and<br />
the public at large<br />
Design Issues – generally open access to public environments, security, accessible by millions of<br />
users, public infrastructure (carriers), Internet, data/voice/video/control services, performance,<br />
capacity seldom measured beyond a few Megabits, failover to alternative external<br />
networks/providers, infrastructure dependent on carrier preference, global reach<br />
Operational Issues – lack of autonomous control, lesser degree of monitoring/management,<br />
dependence on others for reliability and performance, recurring expenditure, service contracts,<br />
capacity driven<br />
Operations Center LANs<br />
Purpose – provide connectivity to control systems, operators, high-end applications, servers, and<br />
storage systems<br />
Design Issues – extremely tight controlled access, highest degree of security, highest degree of<br />
performance, multi-Gigabit support, high availability designs, thorough virtualization,<br />
data/voice/video/control services, primarily fiber infrastructure, building area reach<br />
Operational Issues – key location for grid intelligence, full autonomous control, highest degree of<br />
monitoring/management, highest reliability, highest performance, infrastructure can be capital<br />
intensive, project driven<br />
Wide Area Networks<br />
Purpose – provide high performance connectivity (a) between data/control centers, (b) from<br />
data/control centers to key remote facilities such as substations, (c) from data/control centers to<br />
points of data concentration (such as meter data concentrators)<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 54
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Design Issues –tightly controlled access, high security, high performance, range from tens of<br />
Megabits to multiple Gigabits, situational high reliability, failover mechanisms very responsive,<br />
virtualization and converged resources, data/voice/video/control services, primarily fiber and<br />
microwave, SONET, MPLS, IP, public or private infrastructure, regional geographic reach<br />
Operational Issues -- reach to places where grid logic has been distributed, situational control<br />
(public or private), high degree of monitoring/management, desired interaction between grid and<br />
telecom management systems, high reliability, high performance, capital or expense funding, project<br />
driven<br />
Substation Local Area Network<br />
Purpose – provide coverage to smart objects within and near by the substation<br />
Design Issues – controlled access, security, high performance commensurate with applications,<br />
range from tens of Megabits to Gigabits, high reliability, failover mechanisms including high<br />
availability, may require segregated overlay solutions for separating process bus traffic from other<br />
traffic, data/voice/control services, primarily fiber and wireless technologies, reach in the immediate<br />
vicinity of the substation<br />
Operational Issues – reach to dozens of endpoints which can support other devices through<br />
distributed grid intelligence, total control by utility (private), moderate monitoring/management,<br />
desired interaction between grid and telecom management systems, high reliability, high<br />
performance, capital funding, project driven<br />
Field Area Networks<br />
Purpose – provide broad coverage to remote field endpoints so that they can connect to (a)<br />
data/control centers, (b) distributed applications (perhaps at substations), and (c) to other remote<br />
endpoints<br />
Design Issues – controlled access, security, moderate performance commensurate with applications,<br />
range from one to tens of Megabits, moderate reliability, failover mechanisms often unavailable,<br />
may require segregated overlay solutions optimized for the applications, data/voice/control services,<br />
primarily wireless and powerline carrier technologies, reach may be similar to that of the serving<br />
substation<br />
Operational Issues – reach to thousands or millions of endpoints which have lesser degree of grid<br />
intelligence, situational control (public or private), moderate monitoring/management (desire selfdiscovery<br />
and auto-configuration), desired interaction between grid and telecom management<br />
systems, moderate reliability, moderate performance, capital or expense funding, project driven<br />
Premises Networks<br />
Purpose – provide coverage to smart objects within the home, business, and commercial enterprise<br />
Design Issues – controlled access, moderate security, moderate performance, range from tens of<br />
kilobits to a few Megabits, moderate reliability, seldom use of failover mechanisms, likely<br />
segregated overlay network, data/control services, reach within the customer premises,<br />
predominantly responsibility of customer rather than utility<br />
Operational Issues – reach several to many endpoints with emphasis on premises intelligence,<br />
virtually no control since under authority of premises owner, moderate to no<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 55
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
monitoring/management (desire self-discovery and auto-configuration), largely isolated from grid<br />
management systems, moderate reliability, moderate performance, capital expense by premises<br />
owner, service subscription driven<br />
Network Control-Plane Services<br />
There are many network control-plane services to be accommodated in smart grid—too numerous to<br />
go into detail in this work. A few control-plane services with smart grid interdependency warrant<br />
discussion. To adequately address future smart grid requirements, the architect must understand<br />
network addressing, name-address resolution, and subnetwork access management.<br />
1. Network Addressing<br />
The mature smart grid will see a dramatic increase in smart objects needing IP addresses. It is more<br />
strategic to deploy new smart objects using IPv6 (and its addressing) rather than currently dominant<br />
IPv4. Among the many benefits IPv6 offers, the avoidance of Network Address Translation (NAT)<br />
functionality is one of the more critical reasons to adopt IPv6. The use of NAT can be burdensome to<br />
control-based applications. When network anomalies require failover, the NAT function must rebuild<br />
the address translation mapping. This process can burden (or break) time-critical grid applications.<br />
IPv6 addressing can avoid this problem—at least for communication within the utility domain<br />
(extranet access could still have this problem if private IPv6 addresses are used).<br />
In the IPv4 era, private IP addressing and NAT were implemented to slow down consumption of the<br />
rapidly depleting pool of IPv4 addresses. In this time of transition, it is recommended that utilities<br />
rapidly move to adopt IPv6. There are several types of IPv6 addresses including: unicast, anycast and<br />
multicast. In addition, IPv6 addressing supports both public and private address spaces.<br />
From an addressing architecture perspective, it is recommended that private IPv6 addresses (called<br />
local unique addresses) be used behind company firewalls as an added security measure against<br />
unintended access to grid devices from outside parties. Careful attention should be given to prevent<br />
reuse of private addresses as this will result in problems tracking SYSLOG issues.<br />
Another addressing architecture consideration involves the use of static or dynamic IPv6 addresses.<br />
Many control functions will rely on static (unchanging) addresses. However, many grid applications<br />
(premises metering) could benefit from dynamic addressing. Part of the architecture development is to<br />
decide where to use dynamic addressing. For non-mobile devices, dynamic DHCPv6 addressing may<br />
be best enabled from the substation or where Field Area Network interfaces backhaul communications.<br />
And finally, address space allocation must be planned with the end-state in mind. As the smart grid<br />
evolves, more devices will be placed into the field. Address space allocation should accommodate the<br />
eventual conversion of remote grid devices (including substation devices, feeder devices, meters, and<br />
perhaps even premises devices) to IPv6 addressable devices.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 56
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
2. Unique local Addresses<br />
Domain Name Services (DNS) will be necessary in the smart grid. DNS permits the abstraction of a<br />
device’s IPv6 address from its name making application systems less vulnerable to periodic changes.<br />
While a common DNS solution could serve both the enterprise and operations environments, there are<br />
advantages for segregating these services. Due to the magnitude of most smart grids, the Operations<br />
DNS easily become more heavily populated and used than the enterprise DNS.<br />
One important architectural concern is how to sustain name services at remote locations when<br />
host/remote links are severed. It is preferable to operate DNS in an HA configuration with primary<br />
zone servers in redundant control centers. In the case where backhaul links are lost, name resolution<br />
for regional traffic can be sustained only as long as the Time To Live setting permits. Therefore, for<br />
critical applications, it might become necessary for secondary zone servers to be distributed regionally<br />
in key substations.<br />
3. Authentication, Authorization and Accounting function<br />
AAA servers are required in the grid to aid with the authentication, authorization and accounting<br />
function of devices connected to the network.<br />
From a communications architecture perspective, it is important to segregate AAA functionality<br />
serving the smart grid from enterprise AAA functionality. It will also be preferable to distribute AAA<br />
functionality operated with primary and secondary systems located at diverse control centers.<br />
In the event of the loss of backhaul connectivity, critical substations could benefit from having local<br />
AAA services. Other substations may lose accessibility except via local console access.<br />
Mobility Services<br />
Support for mobility is required for both smart grid devices (especially inside the FAN) and users (such<br />
as the linemen of the future). The mobility service needs to encompass:<br />
Life cycle management of mobile devices, including registration and provisioning of mobile<br />
devices on to the network, such as configuration through the wireless LAN controller, and<br />
Secure deployment and configuration services, such as forcing the mobile user/device into a DMZ,<br />
enforcing a profile examination etc before given access to the network<br />
Gateway Services<br />
The term “gateway” can be ambiguous for telecommunications. For this document, it refers to the set of<br />
services used to adapt legacy or otherwise non-conforming endpoints to packet-based transport<br />
services. In doing so, gateways translate traffic from one protocol to another. This presents a challenge<br />
for <strong>Smart</strong> <strong>Grid</strong> development for two reasons: complexity increases with each required adaptation and<br />
scalability is constrained due to the limited usefulness of proprietary devices. Although it is preferable<br />
all applications standardize on Ethernet- and IP-based transport services, it is also recognized it will<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 57
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
take some time for existing/embedded systems using proprietary protocols to be replaced. Therefore<br />
gateway services must be implemented in various parts of the network to adapt those devices.<br />
In the architectural context, gateways bridge the application and network domains. Therefore, when<br />
dealing with gateways, network architects and application architects should address gateway service<br />
concerns. Two key areas of interest include the appropriate location for gateways to reside and the<br />
feature sets they offer.<br />
Some common legacy gateways include the electric meter (bridging traffic into the home), AMI<br />
gateways (supporting ANSI C12.22 traffic across proprietary networks), DNP gateways (often used in<br />
recloser operations and for line sensors), and station managers (adapting legacy traffic in substations to<br />
use packet infrastructures). Very often, legacy systems integrate communication control and transport<br />
functions into the application rather than cleanly abstracting the two. Even though many such<br />
solutions may be standards based (ANSI, DNP, Zigbee, etc), they don’t inherently use the standard<br />
transport protocols common to packet (IP) solutions. Therefore the traffic must be adapted.<br />
Although it can be confusing, there are some “gateways” deployed for smart grid for reasons other<br />
than transport service adaptation. For example, XML gateways are deployed to offload some security<br />
and application layer functions from application systems. These are not considered network layer<br />
gateways. In addition, research and development occurring in the fields of distributed intelligence and<br />
complex event processing will necessitate systems deployment further out in the network.<br />
The first decision the architect must make is where gateways should reside in the smart grid ecosystem.<br />
The time-proven, primary end-to-end principle in IP networking requires application layer issues to<br />
reside at the endpoints and not within the network. Applying this principle to the necessity of smart<br />
grid gateways makes it preferable for gateways to be pushed as far as possible toward the network<br />
edge. Therefore meters would not have to adapt traffic and protocols between home devices and the<br />
utility’s network (in fact Zigbee supporters are adopting the use of IP transport systems eliminating the<br />
need for protocol translation at the meter). AMI gateways would be pushed to the edge of the Field<br />
Area Network. DNP gateways would be collocated with legacy devices, and substation managers<br />
would only serve legacy, non-IP-enabled devices within the substation.<br />
The second area of interest to smart grid architects is the breadth of functionality performed inside<br />
gateways. Some gateway suppliers are embedding more functionality into legacy devices. The result<br />
could be an increased dependence on gateways (rather than a transition to standards-compliant<br />
devices). In addition, it is also tempting to deploy low-level standards-based networking functions<br />
inside gateways rather than derive these functions from true network-layer equipment. Such practices<br />
only deepen the dependence on legacy gateways/protocols and restrict the adoption of open and<br />
standardized architectures.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 58
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Virtualization Services<br />
The smart grid will cover an expansive territory. The cost to create information networks covering such<br />
an area can be prohibitive especially considering the need to support the diverse array of smart grid<br />
systems and system users. Although carriers already offer multi-purpose networks, there will be a<br />
growing need to adopt network virtualization services to meet smart grid demands.<br />
Virtualization services abstract physical and functional elements for a variety of purposes. Without<br />
network-level virtualization services, transport services would become overly complex and expensive.<br />
However, virtualization is certainly not limited to the network domain; in fact virtualization has its<br />
roots in application layer systems. This section deals with network-layer virtualization, which offers<br />
more transport service flexibility, to the point of supporting dynamic virtualization.<br />
There are numerous reasons to converge multiple networks onto a common platform. First, networks<br />
are becoming increasingly powerful offering the ability to reduce their associated capital and operating<br />
costs. Second, networks needing to be converged and virtualized are increasingly relying on each other<br />
for smart grid capabilities; it is easier to manage the interactions between those networks at multiple<br />
layers when they are converged and virtualized on a single platform.<br />
The network architect must be concerned with how virtualization supports the needs of smart grid<br />
applications and how it impacts the network. First, virtualization should serve the business and<br />
technical requirements of the use cases. The virtualization architecture should address performance<br />
concerns including address bandwidth allocation, latency, collision avoidance, virtualized Layer 2<br />
domains, failover and so on. Second, virtualization must consider how to establish service boundaries,<br />
whether and what layers of the OSI stack can be virtualized sensibly. Finally, virtualization must<br />
support appropriate security on the virtual domains.<br />
Reasons to converge multiple networks onto a common platform are numerous. Networks are<br />
becoming increasingly powerful offering the ability to reduce their associated capital and operating<br />
costs. But while it is technically achievable to utilize a common physical platform, there is justification<br />
for making it function as if it were many virtual platforms. For example, suppose multiple operational<br />
owners need to allocate only their specific costs to their business unit—therefore it would be important<br />
to have a mechanism to support ownership virtualization to allocate traffic capacity and insure against<br />
cross-subsidies. Some devices on the common platform may require access by a small subset of users,<br />
thus requiring a logical separation of the network for security reasons. Another scenario could have<br />
subsets of devices in the network sharing a community of interest with other adjacent devices, making<br />
virtual network zones appropriate. Therefore, the architect has many options available to establish the<br />
logical virtualization architecture best aligned with the lines of business, security, and performance.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 59
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
The next step is to determine how network virtualization supports application performance within the<br />
various network domains. It is likely multiple technologies will be used in each domain. Therefore a<br />
plan to accommodate virtualization at the physical layer and the requisite mapping between network<br />
technologies is needed. Furthermore, most virtualization must be then extended across several<br />
domains to accommodate end-to-end support. The virtualization architecture should address<br />
performance concerns including address bandwidth allocation, latency, collision avoidance, virtualized<br />
Layer 2 domains, and failover.<br />
The architect must then consider how the virtualization architecture addresses security and traffic<br />
isolation. Virtualization is by no means the final answer to security but it can be an important<br />
contributor. Virtualization helps control who can access devices, what network they reside on at the<br />
logical layer, and the degree of exposure devices may have to undesirable conditions (whether<br />
purposeful or accidental). For example, a misbehaving device flooding the network in one virtual<br />
domain shouldn’t adversely affect other virtual domains on the same infrastructure.<br />
Management Services<br />
The smart grid requires increased interactions between the power systems, information systems and<br />
network systems; therefore a common management infrastructure across all the systems is warranted.<br />
Accordingly, this <strong>Smart</strong> <strong>Grid</strong> Management Services section will address the management aspects of the<br />
power and communications network connecting all power grid components, functions and services.<br />
The integration of the ICT architecture with energy management systems and domains provides a<br />
centralized way to manage the entire smart grid, including the communications network and power<br />
grid devices.<br />
Business Drivers<br />
The management vision for the utility smart grid architect should be to devise a path towards a<br />
common management platform for the various smart grid systems, functions and projects. The<br />
common management platform will ideally serve the management needs for all smart grid use cases.<br />
The following are the business drivers for the management services architecture:<br />
The number of use case actors warrants zero or one-touch management schemes across smart grid.<br />
The use cases complexity implies managing policies at a business level (not at the actor level).<br />
The variety of utility and third party entities involved in use cases requires good measurable metrics<br />
for each of the management schemes<br />
As new smart grid projects and corresponding systems emerge, the new functionality needs to be<br />
easily incorporated into the existing management infrastructure<br />
The scope for this chapter is any device which communicates and can be controlled through<br />
configuration, including communication networks, applications, servers, configurable IEDs, etc.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 60
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
This section first introduces existing management architecture literature for the smart grid architect to<br />
consider. Next, the layout and categorization of different management function types is covered.<br />
Finally, an example use case is presented covering how management functions can be categorized and<br />
organized.<br />
Existing Management <strong>Architecture</strong> Literature<br />
Existing industry standards include Telecommunications model (TMN), ITIL (Information Technology<br />
Infrastructure Library) and Open Systems Interconnect (OSI)<br />
TMN: The Telecommunications Management Network is a protocol model defined by ITU-T for<br />
managing open systems in a communications network. The TMN model consists of five layers,<br />
where Business Management is at the top, Service Management is the second layer, Network<br />
Management is the third layer, and Element Management the fourth layer with the physical network<br />
elements is represented in the bottom layer. We are proposing placing the <strong>Smart</strong> <strong>Grid</strong> Management<br />
Systems at the Business Management layer in order to enable future integration with these systems.<br />
The Open Systems Interconnect (OSI) group has defined management functionality in network<br />
operations as shown in the five categories listed in table below. This same model has also been<br />
adopted and supported by the standards body, ITU-T. This categorization is a functional view and<br />
does not attempt to describe business related roles within a telecom or data network. The FCAPS<br />
sub-functions within one of the five major groups are typically performed at differing levels within<br />
the TMN model described in the TMN section. For example, fault management at the element<br />
management level in TMN is detailed logging of all discrete alarms or other events. The element<br />
management level then filters and forwards alarms/events to the network management level where<br />
alarm correlation, corrective action and other actions take place. The FCAPS table below represents<br />
common examples of the sub-functions performed under the model definitions. Different<br />
applications of the model will typically contain sub-functions specific to the network operations<br />
management center involved.<br />
TMF eTOM: TM Forum's Business Process Framework (eTOM - Enhanced Telecom Operations<br />
Map) is a key element of the TM Forum Framework Integrated Business <strong>Architecture</strong>. It is the<br />
industry's common process architecture for both business and functional processes and has been<br />
implemented by hundreds of service providers around the world. During this phase we will be<br />
addressing all the Operations aspects of the data communications network enabling the smart grid.<br />
Within Operations, we will focus on Assurance and Resource Management (application, computing<br />
and network).<br />
ITIL: It is the most widely accepted approach to ICT service management in the world. ITIL<br />
provides a cohesive set of best practice, drawn from the public and private sectors internationally. It<br />
is supported by a comprehensive qualifications scheme, accredited training organizations, and<br />
implementation and assessment tools.<br />
While the smart grid architect needs to assess the present ICT management architecture and assess the<br />
integration of the smart grid management in the present architecture, the rest of this section will focus<br />
on the management functions in general and the application of the management functions to smart<br />
grid.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 61
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
<strong>Smart</strong> <strong>Grid</strong> Management Functions<br />
Management services for smart grid can be viewed in several different ways. First, smart grid consists<br />
of elements across multiple utility domains (consumer, distribution, transmission, generation, markets,<br />
etc) and technology domains (communications, applications, servers, wireless, video etc) that need to<br />
be managed. Second, from a “System-of-Systems” perspective, smart grid can be organized into<br />
systems, which need to be managed. Third, each of the systems interacts with each other for specific<br />
use cases, which also need to be orchestrated and managed. The following section will organize smart<br />
grid management services as layers accommodating the above-described functions.<br />
Organization of Management Functions<br />
The following is the organization of management functions for smart grid into the three areas<br />
described above - the management functions applicable for actors (which we call Element Management<br />
Layer), management functions applicable for systems (System Management Layer) and management<br />
functions applicable at the use case level (Services Management Layer). Each management function in<br />
the Services Management Layer will make use of various functions in System Management Layer and<br />
Element Management Layers.<br />
These different management schemes can be organized in the following way<br />
Each layer in Figure 43 is discussed below.<br />
Figure 43 - Management Layer Organization<br />
Element Management Layer<br />
The following are the different management functions and corresponding processes involved in<br />
element management:<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 62
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Lifecycle Management: Life cycle management is the service dealing with automatic device<br />
discovery, automatic update of firmware, and automatic provisioning into the system. The<br />
service also deals with secure decommissioning of devices. Life cycle management and its<br />
automation are critical to smart grid management due to the large number of relevant devices.<br />
System turn-up<br />
Auto-discovery<br />
Provisioning<br />
Change management<br />
Decommissioning<br />
Technology/control plane management: smart grid is comprised of various technologies,<br />
whose control plane needs to be managed. The technologies include the following:<br />
Routing and switching, including control plane and data plane services<br />
Wireless<br />
Mobile<br />
Systems Management Layer<br />
The smart grid architect must support the following common management functions across systems:<br />
Event Management: The following are the event management functions<br />
Collection of power/cyber events from all grid and communication assets<br />
Analyzing and correlating the events for actionable incidents<br />
Taking the corresponding action<br />
Security Management: The following are the security management functions that need to be<br />
managed across systems (example: key management when a DA system needs to talk to an<br />
AMI or a Transmission system)<br />
Access control management<br />
Security monitoring<br />
System audit<br />
Configuration Management: Configuration management includes any configuration changes<br />
on the end assets (network, data, information, application, electric) including settings, firmware<br />
upload and down load. The smart grid architect needs to plan for a common configuration<br />
management platform for different smart grid projects and different types of electrical and<br />
network assets involved<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 63
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Services Management Layer<br />
The above management functions apply for actors and systems The smart grid architect needs to<br />
analyze each use case in scale and analyze the management requirements. The following are the<br />
management functions that would apply at the use case level (Services/Business Management Level):<br />
Performance Management: This includes tuning the assets for the quality of experience that is<br />
required for the use case. Bandwidth and latency provisioning, quality of service provisioning will<br />
be part of the performance management.<br />
Policy management: this category is the management of business policies across the enterprise. This<br />
could be security policies such as NERC CIP or any business policies such as disaster recovery and<br />
management, change management, etc.<br />
The services management layer would use the systems management layer and element management<br />
layer functions for end device configuration.<br />
Figure 44 depicts the management layers, each management function inside the layers, and their<br />
applicability to the actors, systems and use cases.<br />
Figure 44 - <strong>Smart</strong> <strong>Grid</strong> Management Layers<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 64
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Conclusion<br />
The smart grid management architecture has to be constructed in a way supportive of a common<br />
management platform for the various smart grid systems. The architecture also has to strive towards<br />
the “services management layer” which can orchestrate the systems and corresponding elements<br />
involved to achieve the SLAs demanded by use cases non-functional requirements. The smart grid<br />
architect should also tactically choose standard protocols and local management policies whenever<br />
possible as explained below:<br />
Standard protocols: The EA needs to strive to adopt and encourage standard protocols for<br />
management such as SNMP, Syslog etc. IEC 61850 has features that could be used for configuration<br />
control and management. Standards based management functions will be easier to integrate for<br />
cross project management capabilities.<br />
Local and centralized management: The EA needs to strive for local management schemes in<br />
disaster recovery scenario.<br />
Structural Model Framework Template<br />
The SGRA Section 5, <strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong> Views, contains a structural model for each<br />
view (Application Services, Analytics Services, Data Services, Control Services, Security Services,<br />
Communications Services, and Management Services). Each is provided to help the smart grid architect<br />
consider how to best deploy the various services using a stylized representation of a typical utility<br />
network infrastructure. The template for these models is provided below [Figure 45] to help explain<br />
why services were distributed among the fourteen tiers in the template. The template graphical<br />
representation on the left side is identical across all seven structural models in Section 5. The right-hand<br />
table describes the devices and capabilities inherent in each tier.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 65
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 45 - Structural Model Template<br />
The smart grid architect, once all seven structural models are created for the utility, should consolidate<br />
the seven models into a single structural model for the entire smart grid. This consolidation exercise<br />
can strengthen the overall architecture. For example, since most analytics require communication and<br />
data support, any consolidated tier containing analytics, but missing these supporting services, should<br />
be studied more closely. All architectural weaknesses need to be directly addressed with impacted<br />
architectural views subsequently updated.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Services Classes Concepts<br />
Appendix • 66
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix C. <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project<br />
(SCAP)<br />
Background information on the <strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project is provided on page ix.<br />
Business Requirements<br />
These top level business requirements are derived from the SCAP work done by the <strong>Smart</strong> <strong>Grid</strong><br />
Interoperability Panel (SGIP) <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee (SGAC). These 380 requirement<br />
families abstract over 8000 more detailed business requirements identified by the SCAP (SGIP SGAC).<br />
Customer Domain<br />
Service Level data shall be collected to ensure service level agreements are met<br />
Communications shall meet defined Quality of Services (QoS) requirements.<br />
Shall be configurable.<br />
Shall be able to operate at a sufficient granularity (e.g., individual customer).<br />
Shall support continuous evolution of smart grids.<br />
Shall support aggregated management of Customer domain assets.<br />
Shall support recovery from an electric grid cold-start.<br />
Shall support role-based authorization.<br />
Shall assure access by authorized entities to data.<br />
Shall employ non-intrusive load monitoring where appropriate.<br />
Power Quality monitoring shall be supported.<br />
Shall respond to dynamic incentive signals (e.g., price signals).<br />
Shall leverage common infrastructure with other services (e.g., water management).<br />
Shall provide outage restoration management.<br />
Shall manage reactive power in customer loads (e.g., building energy management systems).<br />
Shall support charging of electric vehicles.<br />
Shall process demand response pre-event notifications.<br />
Shall provide energy management.<br />
Quality of Service (QoS) requirements shall be defined.<br />
Shall support display of information.<br />
Shall support manual override of automated actions.<br />
Shall require permission to access Customer domain services from other domains.<br />
Shall collect localized weather data.<br />
Shall manage Service Level Agreements (SLAs).<br />
Shall minimize load sags and swells.<br />
Shall collect load characteristics.<br />
Shall provide information in support of operational needs.<br />
Shall collect energy production environmental impact data.<br />
Shall support energy trading transactions.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 67
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Generation Domain<br />
Transmission<br />
Shall control a plant's compliance to meet contractual obligations<br />
Require security<br />
Require a high availability of information flows<br />
Require a high accuracy of data<br />
Data shall be managed across organizational boundaries<br />
Require validation of the cost-benefit of the function<br />
Shall facilitate islanding of the power system<br />
Shall provide the ability to forecast<br />
Shall facilitate control of generator power<br />
Shall provide real time intelligence regarding equipment state<br />
Shall provide real time management of equipment<br />
Shall minimize impacts<br />
Shall facilitate scheduling<br />
Shall perform congestion management analysis on proposed energy schedules<br />
Shall support commitment activities<br />
Shall dispatch regulation units to provide voltage support based on emergency requirements<br />
Shall maintain the facilities in operating condition<br />
Shall facilitate the procedures particular to bringing a cold unit on line<br />
Shall provide advanced notice of scheduled outages<br />
Shall support minimum cost real time scheduling of generation units<br />
Shall ensure that the overall system remains intact despite severe challenges<br />
Shall facilitate monitoring of generator power<br />
Shall facilitate control of generator emissions<br />
Shall facilitate monitoring of generator emissions<br />
Shall monitor equipment contingencies<br />
Shall perform security analysis on proposed energy schedules<br />
Shall provide high quality power<br />
Shall provide ancillary services<br />
Shall provide rolling reserves<br />
Shall provide contingency<br />
Shall respond to changes in customer load<br />
Shall maintain the topology of the system including the ends of all segments<br />
Shall forecast alternatives for generation sources is to anticipate long term generation needs<br />
Shall maintain transmission system in operating condition<br />
Shall provide credible contingency information<br />
Shall determine long term future transmission system needs<br />
Shall have contingency plans for catastrophic events<br />
Shall optimize planned maintenance down-time<br />
Shall automatically collect information relating to system disturbances<br />
Shall automatically adjust voltage to optimize network efficiency<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 68
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Shall adjust power flow to optimize network efficiency<br />
Shall maintain the system within its limits of stability<br />
Shall monitor the status of measurement equipment<br />
Shall maintain load forecasts for all system equipment<br />
Shall recommended changes to correct limit violations<br />
Shall notify stakeholders of emergencies<br />
Shall detect equipment fault conditions<br />
Shall develop emergency response in case of catastrophic external events<br />
Shall provide operating guidelines for interfacing with distribution companies<br />
Shall provide short term forecasting for time frames of interest<br />
Shall provide short term forecasting for locations of interest<br />
Shall include DER in the balancing of demand<br />
Shall use activation of interruptible loads to balance the system<br />
Shall use rotating blackouts as a last resort to balance the system<br />
Shall manage substation voltages to manage the overall system<br />
Shall minimize transformer clipping conditions<br />
Shall maintain characteristic (nameplate) information on all system components<br />
Shall monitor equipment for equipment failures<br />
Shall track which actors had access to what system at what time and the changes they made<br />
Shall monitor the electrical flow characteristics at all major pieces of equipment in the system<br />
Shall simulate future configurations of the network<br />
Shall perform maintenance on the system to maintain the system in operational condition<br />
Shall manage the protection schemes to optimize the system protection<br />
Shall maintain the system within the frequency limits<br />
Shall shed load as required to maintain system stability<br />
Shall use wide area monitoring to prevent issues arising from incipient system instability<br />
Shall implement optimum control actions to maintain system stability<br />
Shall perform long term forecasting to support system reinforcement planning<br />
Shall do long term load forecasting to plan back-up generation<br />
Shall plan manual switching to prevent fault behavior<br />
Shall estimate the remaining capacity in the system<br />
Shall calculate system utilization to prevent overloads<br />
Shall predict failure of equipment<br />
Shall optimize usage of equipment<br />
Shall schedule equipment replacement is to prevent failure of equipment<br />
Shall dispatch field crews in an efficient manner<br />
Shall do 3-phase monitoring of the system<br />
Shall be able to do 3-phase unbalanced operation<br />
Shall optimize VAR control<br />
Shall support the integration of Storage<br />
Shall be able to handle sudden shifts in power flow<br />
Shall shed generation as required to maintain system stability<br />
Shall perform long term forecasting to support system extension planning<br />
Shall manage access to critical facilities<br />
Shall dynamically rate equipment capacity based on environmental factors<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 69
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Shall perform phase to phase balancing actions<br />
Service Provider<br />
Shall provide electrical service to its customers<br />
Shall provide electrical service to its customers that is of high power quality<br />
Shall be capable of detecting outages<br />
Shall employ techniques to minimize outage occurrences and duration<br />
Shall employ techniques to prevent damage resulting from malfunction of provider services<br />
Shall develop techniques to avoid permanent damage to the environment in the course of providing<br />
electrical service to its customers<br />
Shall provide information enabling the customers to make decisions on their DSM participation<br />
Shall provide a Demand Side Management function that is available<br />
Shall be capable of directly controlling customer loads.<br />
Shall provide a means of classifying information that allows for some data to be treated in a<br />
Confidential manner.<br />
Shall provide communication capability that is available.<br />
Shall provide a method of communications that provide 'rapid response' with a goal of maintaining<br />
load/generation equilibrium.<br />
Shall provide a communication capability that is accurate.<br />
Shall provide accurate individual meter readings to authorized parties.<br />
Shall provide a means of obtaining information from customers<br />
Shall establish two-way communication with customers.<br />
Shall be capable of obtaining readings from customer meters in a manner that minimizes reading<br />
errors.<br />
Shall provide a means of efficiently obtaining information from meters.<br />
Shall provide a means of obtaining accurate information from meters<br />
Shall read meters in a manner that is convenient to the customer.<br />
Shall implement accurate meter reading<br />
Shall provide means of communicating with customers<br />
Shall provide price of electricity information to their customers<br />
Shall provide individual meter readings to its customers at intervals that are aligned with customer<br />
needs<br />
Shall enable selling energy to customer<br />
Shall enable buying energy from customer<br />
Shall provide forecasts of demand for planning purposes<br />
Shall be capable of aggregating customers<br />
Shall bundle services<br />
Shall provide energy information services<br />
Shall provide power quality services<br />
Shall provide sub-metering service<br />
Shall provide technical support services<br />
Shall provide billing services<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 70
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Distribution<br />
Shall maintain a topological model of distribution circuits in near real-time<br />
Shall manage Intelligent alarm processing<br />
Optimizes Voltage in relation to Reactive Power<br />
Shall manage Voltage<br />
Shall support management of reactive power<br />
Shall manage work crews for authorized field work<br />
Provides distribution operation personnel with comprehensive training<br />
Shall monitor power quality on the distribution system<br />
Shall perform service restoration<br />
Shall support improvement of power quality<br />
Shall provide an audit trail<br />
Shall manage power quality information available from within customer sites<br />
Shall prepare for storm conditions<br />
Shall prepare for storm conditions<br />
Shall manage unbalanced current flows<br />
Shall manage unbalanced three-phase voltages<br />
Shall adjust feeder loads for optimal load flow<br />
Shall support Distribution Power Flow analyses<br />
Shall support Contingency Analysis<br />
Shall rank contingencies<br />
Shall perform Fault Level Analysis<br />
Shall support Short Circuit Analysis<br />
Shall support Contingency Load Transfer<br />
Shall support technical Loss Minimization<br />
Shall support state estimation<br />
Shall support monitoring of state<br />
Shall support planned outage management<br />
Shall support distribution planning<br />
Shall support field crew root cause analysis of distribution system problems<br />
Shall support transformer management<br />
Shall locate Faults<br />
Shall isolate Faults<br />
Shall manage system protection<br />
Shall manage system protection<br />
Shall support diagnostic analysis<br />
Shall support the management of Distributed Energy Resources (DER)<br />
Shall support real-time emergency operations<br />
Shall support outage management<br />
Shall support distribution asset management<br />
Shall support transmission operations<br />
Shall support updating field equipment<br />
Shall support system protection<br />
Shall support short term load forecasts<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 71
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Markets<br />
Shall support equipment level configuration management<br />
Shall support the development of the future distribution model<br />
Shall locate non-technical losses<br />
Shall support condition based maintenance<br />
Shall maintain an adequate operations platform<br />
Demand Response (DR) maintenance staff test Demand Response (DR) equipment is to validate the<br />
interconnecting infrastructure to allow the DR's to participate in the market operations<br />
Identical generation devices is to provide electrical power to residence while remaining in parallel<br />
with Energy Service Provider (ESP)<br />
Shall provide clear location based price signals that serve as a value benchmark for consumers to use<br />
as input in deciding when they use electricity<br />
Will enable customers aggregators to directly access the market<br />
Will enable demand-response aggregators to directly access the market<br />
Will provide location based price signals that reflect locational differences.<br />
Will correctly reflect the price of energy<br />
Will correctly reflect the price of renewable energy<br />
Will correctly reflect the price of emissions<br />
Will correctly reflect the price of transmission<br />
Will correctly reflect the price of reactive power<br />
Will correctly reflect the price of harmonics<br />
Will operate in a nodal fashion<br />
Will operate in a regional fashion<br />
Will provide forward pricing signals<br />
Will provide hedging contracts<br />
Will provide long term contracts<br />
Will provide historical pricing history<br />
Will provide historical demand<br />
Will provide forward demand curves<br />
Will coordinate cross market trading<br />
Will provide clearing of bi-lateral contracts<br />
Will provide registration of market participants<br />
Will provide direct access to the wholesale market for large enough end users<br />
Will provide access to trading analytics<br />
Will provide a safety valve for runaway trading<br />
Will verify the ability of a party to ability to cover their physical commitments.<br />
Will clear the market<br />
Will match counter parties to affect trades<br />
Will permit net open trades to the limits of the system<br />
Will net out trades<br />
Will encourage the emergence of a market maker in each area<br />
Will develop new trading vehicles<br />
Will encourage the development of a transparent market<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 72
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Operations<br />
Will encourage price discovery<br />
Will encourage counter party transparency<br />
Will register counter parties<br />
Will provide settlement information for the market<br />
Will encourage rapid settlement of the market<br />
Will provide a dispute registration mechanism<br />
Will provide a dispute resolution mechanism<br />
Will maintain a counter party history<br />
Will provide credit check capability<br />
Will provide background check capability<br />
Will create a framework of market rules<br />
Will be able to determine the impact of market changes from simulations<br />
Will provide location based grid state condition information<br />
Will communicate information to all interested parties<br />
Will retain a market history<br />
Will communicate abnormal conditions to all interested parties<br />
Will communicate all planned outages to interested parties<br />
Will run product auctions for all applicable products<br />
Will create long term demand forecasts by customer class<br />
Will provide demand forecast for multiple near term time periods<br />
Will provide demand response generation forecasts for multiple near term time blocks<br />
Will create market products that are capability based i.e. technology agnostic<br />
Will eliminate unnecessary barriers to entry<br />
Will develop new market products that account for advanced capabilities<br />
Will limit market exposure to the participant's credit limit<br />
Will make all markets and products available to DR and storage if capabilities can be met<br />
Will create products that encourage adequate capacity in the market<br />
Will create products that can be used to balance intermittency of renewable resources<br />
Will enable energy efficiency to participate in the market<br />
Will support participation by distributed energy resources<br />
Will create dynamic prices for all products and services<br />
Will provide intermittent generation forecasts for multiple near term time blocks<br />
Will develop new market products to price emissions<br />
Will develop new market products for voltage support<br />
Will develop new market products for VAR<br />
Will perform power flow simulations of the grid<br />
Will support exchange of network models with other stakeholders<br />
Provide the ability to manage direct load control programs<br />
Manage electrical frequency<br />
Report the health of the primary equipment to the control center<br />
Provide configuration management<br />
Provide performance management<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 73
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Shall be able to authenticate end-use customers<br />
Shall be able to communicate with end-use equipment<br />
Shall be able to communicate with measurement equipment<br />
Shall be able to communicate with mobile transportation loads<br />
Shall be able to manage end customers in load programs<br />
Shall communicate with end customers<br />
Shall control the flow of power to individual end customers<br />
Shall forecast resources<br />
Shall implement black start<br />
Manage restoration protocol<br />
Shall manage ancillary services<br />
Monitor DR/grid interaction<br />
Shall manage power quality<br />
Shall manage reserves<br />
Shall optimize asset utilization<br />
Shall provide intermittent generation forecast for multiple near-term time blocks<br />
Shall manage power interchange<br />
Shall manage the operation of the electrical grid<br />
Provide voltage regulation<br />
Shall be able to reconfigure (power) system<br />
Schedule generation<br />
Schedule transmission<br />
Shall actively manage demand response programs<br />
Shall be able to monitor micro-grids<br />
Shall be able to provide historical information for any specific time-frame<br />
Shall respond to abnormal conditions in a coordinated fashion<br />
Shall validate demand response operations<br />
Shall maintain emissions records for all operations<br />
Shall maintain the state of the systems managed<br />
Shall provide environmental monitoring<br />
Shall provide demand side management<br />
Assess the vulnerabilities of management systems<br />
Shall Maintain a secure environment for operations<br />
Shall maintain operations quality of service<br />
Shall manage communications between physical locations for all information<br />
Shall maintain load profiles of end customers<br />
Shall measure energy consumption of customers<br />
Shall provide information for Crew dispatching<br />
Shall provide control information to distributed resources<br />
Shall be able to access data from all distributed resources in a timely fashion<br />
Shall be able to forecast weather impacts for any reasonable time frame in the future<br />
Shall be able to manage the electrical protection of the system<br />
Shall be able to simulate future operations of the system<br />
Shall be able to minimize disruption of energy flow to end customers<br />
Shall maintain topology information for the power grid<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 74
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Shall be able to schedule maintenance at times of least impact<br />
Shall be able to support energy storage devices<br />
Shall be able to support distributed energy resources<br />
Shall manage voltage stability<br />
Shall be able to request procurement of additional market products<br />
Shall maximize available transmission capacity<br />
Shall review Remedial Action Schemes<br />
Shall perform contingency analysis<br />
Shall manage scheduled maintenance requests.<br />
Shall be able to analyze past grid events<br />
Shall be able to directly dispatch resources in exceptional circumstances<br />
Shall provide location based grid condition indicator<br />
Shall manage time synchronization of the grid<br />
Shall manage the variability of intermittent resources<br />
Shall provide demand forecast for multiple near term time periods<br />
Shall directly control end use devices<br />
Shall communicate with neighboring control areas<br />
Cross Cutting Domain<br />
Shall Manage Records for Auditing<br />
Shall Manage Records for Reporting<br />
Shall manage authentication<br />
Shall manage access control<br />
Shall manage discovery services<br />
Shall manage communities<br />
Shall manage firewall policies<br />
Shall Manage Privacy Policies<br />
Shall manage end devices<br />
Shall manage applications<br />
Shall manage security policies<br />
Shall manage distributed data<br />
Shall manage calibration of field equipment<br />
Shall manage non-repudiation<br />
Shall manage communications continuity<br />
Shall manage communications reliability<br />
Shall manage communications availability<br />
Shall manage personnel security credentials<br />
Shall manage risk assessments<br />
Shall manage services acquisition security policies<br />
Shall manage security engineering practices<br />
Shall manage Security Policy Exchange Service<br />
Shall provide security services against Denial-of-Service attacks<br />
Shall provide security assurance service<br />
Shall manage enforcement of security policies for field equipment<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 75
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Shall provide a Trust Establishment Security Service<br />
Shall provide secure mobility for field equipment communications<br />
Shall provide support for multi-cast communications<br />
Shall manage time synchronization of data<br />
Shall test equipment prior to use<br />
Shall manage underlying information support platforms<br />
Shall manage vulnerability assessments<br />
Shall manage network addressing<br />
Shall manage network multi-homing<br />
Shall manage transaction processing<br />
Shall manage physical security of smart grid operations<br />
Shall manage security of critical data<br />
Shall manage communication faults<br />
Shall manage communications performance<br />
Shall manage accounting for communications use<br />
Shall manage communications configuration<br />
Shall manage residual risk<br />
Distribution Automation (DA) critical data requires very high security<br />
<strong>Smart</strong> <strong>Grid</strong> Business Services<br />
Working from the requirements families listed above, the <strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee (SGAC)<br />
developed a set of business services distributed across the seven <strong>Smart</strong> <strong>Grid</strong> domains. In addition, a set<br />
of cross-domain foundational business services was developed. In this section, the business services are<br />
presented by domain. The actual company performing the service may vary by area of the country. For<br />
instance, in California many of the market services belong to the California ISO; in Florida, there is no<br />
ISO, so these services belong to the state utilities.<br />
The SGAC team assigned to SCAP is developing additional use cases to define system requirements for<br />
two domains in need – the Customer and the Service Provider. For the Customer domain, the business<br />
cases are from a customer point of view. For the Service Provider, the cases are from a non-electric<br />
service provider point of view. Once this work is complete, it is expected the following Business<br />
Services listings will change to accommodate the additional requirements.<br />
Market Domain<br />
Table 17 lists the SCAP business services required to support the overall business in the Market<br />
domain. The actual operator of the business services will vary by geographic region.<br />
Table 17 – Market Domain Business Services<br />
Name<br />
Description<br />
Check Background<br />
Perform a background check on the participant<br />
Check Credit<br />
Confirm that the participant has enough credit to meet the requested transaction<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 76
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Clear Market<br />
Clear Trades<br />
Correlate Events<br />
Cross Market Trade<br />
Develop Balancing Products<br />
Develop Capacity Products<br />
Develop Distributed Energy<br />
Products<br />
Develop Energy Efficiency<br />
Products<br />
Develop GHG Emission<br />
Products<br />
Develop Market Products<br />
DR Forecast<br />
Exchange Network Models<br />
Facilitate Market Maker<br />
Facilitate Trades<br />
Forecast Intermittent<br />
Generation<br />
<strong>Grid</strong> Condition Indicator<br />
Long Term Demand Forecast<br />
Maintain History<br />
Maintain Market History<br />
Manage Aggregators<br />
Manage Direct Access<br />
Manage Dispute<br />
Manage Energy Contracts<br />
Manage Market Rules<br />
Manage Notification<br />
Manage Participation<br />
Market Transparency<br />
Monitor Markets<br />
Near Term Demand Forecast<br />
Net Trades<br />
Outage Notification<br />
Price Energy Products<br />
Protect Markets<br />
Description<br />
Identify the most economically optimal schedule of resources while maintaining the<br />
security of the grid.<br />
Provide the ability to financially clear bi-lateral trades<br />
Predict future events by analyzing current patterns<br />
Provide the ability to trade energy products between markets<br />
Develop market products that will provide the capabilities necessary to balance<br />
intermittent supply resources.<br />
Develop market products for capacity that encourages participation of various parties<br />
Develop market products for distributed energy resources that encourages participation<br />
of various resources<br />
Develop market products for energy efficiency that encourages participation of various<br />
parties<br />
Develop market products for GHG emissions that encourages participation of various<br />
parties<br />
Develop new market products<br />
Provide forecast of demand response capability over multiple near term time periods<br />
Provide a mechanism to exchange network models between entities<br />
Actively encourage the emergence of a market maker in new markets<br />
Facilitate bi-lateral trades between parties<br />
Provide intermittent generation forecasts for various timescales as needed for grid<br />
management<br />
Provide a location-based dynamic metric that illustrates the desired change in energy<br />
consumption.<br />
Maintain a long term demand forecast for various customer classes within the control<br />
area<br />
Maintain a history of market transactions<br />
Provide management of historical market information<br />
Determine mechanism for aggregators of energy resources to engagge in markets<br />
Provides the ability for end-customes to purchase power in the wholesale market<br />
Provide a mechanism to coordinate disputes on the market processes<br />
provide a mechanism to manage the operation of energy contracts between market<br />
participants<br />
Develop mechanisms to manage the evolution of market rules<br />
Provide notification of market events to interested parties<br />
develop guidelines for market participation<br />
Develop mechanisms to publish key market attributes to the public<br />
Analyze the effectiveness of market rules in maintaining an effective electric power<br />
market<br />
Provide forecast of demand over multiple near term time periods<br />
Will net trades across grid constraints up to the acceptable limit on that constraint<br />
Provide notification of planned outages to interested parties<br />
Provide time based prices for energy products for individual customers<br />
Provides a mechanism to protect the market from potentially damaging trading behavior<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 77
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Provide Communication<br />
Platform<br />
Provide Demand Forecast<br />
Provide Demand History<br />
Provide Operational Platform<br />
Reduce Settlement Timeline<br />
Register Dispute<br />
Register Participant<br />
Resolve Dispute<br />
Settle Market<br />
Simulate Market<br />
Simulate Power Flow<br />
Validate Commitment<br />
Validate DR Resource<br />
Interconnection<br />
Description<br />
Provide infrastructure for secure, accurate and timely communication<br />
Provide a forward looking schedule for energy requirements<br />
Provide history of demand at all tracked locations on the grid<br />
Provide infrastructure necessary to operate power market<br />
Develop mechanisms to settle market at the earliest possible time<br />
Provide a mechanism to register a dispute on the market processes<br />
Provides a customer the ability to engage in market activity<br />
Manages the progress of a registered dispute through resolution<br />
manage the settlement of market charges<br />
Provide mechanisms to simulate the power market<br />
Provide simulation mechanisms to analyze power flow of the electric grid<br />
Confirms the ability of a participant to provide their proposed commitments<br />
Validates that DR resources connection comply with relevant standards<br />
Operations Domain<br />
Table 18 lists SCAP business services required to support the overall business in the Operations<br />
domain. The actual operator of the business services will vary by geographic region.<br />
Table 18 – Operations Domain Business Services<br />
Name<br />
Description<br />
Analyze Event<br />
Reconstruct the dynamic values of grid attributes around the time of a past grid event<br />
Authenticate User<br />
Confirm the identity of the user<br />
Contingency Analysis<br />
Calculate the impact of failures on the electrical power system<br />
Control Energy Resources<br />
Provide direct control of energy resources<br />
Control Power Flow<br />
Dynamically configure electrical power system to manage power flow to end-customer<br />
Define Transmission Capacity Define the dynamic safe operating limits of the transmission system<br />
Demand Forecast<br />
Provide forecast of demand over multiple near term time periods<br />
Energy Measurement<br />
Provide measurement of end-customer consumption<br />
Forecast Resources<br />
Provide forecasts of system resources<br />
Forecast Supply Resources<br />
Provide forecasts of supply resources<br />
Forecast Weather Impacts<br />
Forecast the potential impact of weather events on the grid assets<br />
<strong>Grid</strong> Condition Indicator<br />
Provide a location-based dynamic metric that illustrates the desired change in energy<br />
consumption.<br />
Maintain Network Model<br />
Maintain a time based model that represents the topology of the electrical power<br />
network<br />
Manage Configuration<br />
Maintain configuration parameters of equipment<br />
Manage Contingency Event Provide pre-determined protocol instructions for responding to a contingency event<br />
Manage Customers<br />
Facilitate communication with end customers<br />
Manage Demand<br />
Provide a mechanism to reduce end-customer energy costs<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 78
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Manage Direct Load Control<br />
Program<br />
Manage Distributed Energy<br />
Resources<br />
Manage Dr Program<br />
Manage Emissions Audit<br />
Manage Energy Resources<br />
Manage Energy Storage<br />
Manage Frequency<br />
Manage <strong>Grid</strong> Operations<br />
Manage Load Control Participants<br />
Manage Performance<br />
Manage Power Interchange<br />
Manage Power Quality<br />
Manage Quality Of Service (QoS)<br />
Manage Reserves<br />
Manage System Protection<br />
Manage System Re-Start<br />
Manage Variability<br />
Manage Voltage<br />
Minimize Disruption<br />
Monitor Emissions<br />
Monitor Energy Resources<br />
Monitor Equipment<br />
Monitor Resources<br />
Optimize Asset Utilization<br />
Outage Analysis<br />
Physical Security<br />
Provide Black-Start<br />
Provide Connectivity<br />
Provide Demand Profile<br />
Provide Historical Data<br />
Request Market Products<br />
Review Protection Schemes<br />
Schedule Generation<br />
Schedule Outages<br />
Schedule Transmission<br />
Schedule Work Crew<br />
Simulate System<br />
Description<br />
Offer managed load reduction schemes using direct operation of devices<br />
Develop mechanisms to include distributed energy resources (DER) in the operation of<br />
the electrical grid<br />
Offer managed load reduction schemes<br />
Maintain emissions history for grid assets<br />
Facilitate management communications with energy sources attached to the grid<br />
Develop mechanisms to include energy storage in the operation of the electrical grid<br />
Maintain electrical frequency within applicable limits<br />
Balance supply with demand of the electrical grid<br />
Facilitate participant involvement in load control<br />
Maintain performance of equipment within applicable limits<br />
Ensure power flow with neighboring control areas is coordinated<br />
Maintain attributes of the power flow on the system<br />
Provide mechanism to ensure business services remain within predetermined metrics<br />
Manage an inventory of reserves to cover contingencies<br />
Provide protection schemes that ensure the security of the system under fault<br />
conditions<br />
Re-initiate stable operation of a power grid after a failure<br />
Provide reserves that can balance the variability of energy resources<br />
Maintain electrical voltage within applicable limits<br />
Develop mechanisms to minimize interruption of electrical service to customers<br />
Measure the environmental impact of grid assets<br />
Report the status of energy sources attached to the grid<br />
Report the health of equipment<br />
Measure the real-time status of grid resources<br />
Identify dynamic limits for grid assets<br />
Calculate the impact of maintenance requests on the electrical power system<br />
Provide secure locations<br />
Provide the ability to produce power without first requiring power from the grid<br />
Maintain communication to equipment<br />
Provide a time versus demand curve that represents the typical demand of a customer<br />
Provides information for requested time frame<br />
Provides the capability to request the procurement of energy market products<br />
Reviews proposed remedial action schemes (RAS)<br />
Identify economically optimal schedules for supply resources<br />
Schedules outages when they will have the least impact to the reliable operation of the<br />
grid<br />
Provide a mechanism to match supply schedules with transmission capacity<br />
Schedule the appropriate resources for outage resolution<br />
Provide simulation of the electrical power system<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 79
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Synchronize Time<br />
Validate Demand Response<br />
Vulnerability Assessment<br />
Description<br />
Manage frequency so that a clock connected to the grid is kept within tolerance of a<br />
reference clock<br />
Evaluate response of resource to a demand response dispatch<br />
Assess the resilience of grid management systems<br />
Service Provider Domain<br />
Table 19 lists SCAP business services required to support the overall business in the Service Provider<br />
domain. The actual operator of the business services will vary by geographic region.<br />
Table 19 – Service Provider Domain Business Services<br />
Name<br />
Aggregate Customers<br />
Bundle Services<br />
Buy Energy<br />
Classify Data<br />
Collect Meter Data<br />
Communicate Price<br />
Deliver Electrical Service<br />
Detect Outages<br />
Direct Load Control<br />
Forecast Demand<br />
Manage Accuracy Of<br />
Communication<br />
Manage Accuracy Of Information<br />
Manage Availability Of<br />
Communication<br />
Manage Communication<br />
Manage Customer<br />
Communication<br />
Manage Energy Balance<br />
Manage Meter Data Collection<br />
Manage On-Going Two-Way<br />
Communication<br />
Manage Outages<br />
Obtain Customer Device<br />
Information<br />
Prevent Demand Asset Damage<br />
Prevent Environmental Damage<br />
Provide Billing Services<br />
Description<br />
Provide mechanisms to aggregate customers for various electricity buying and selling<br />
options<br />
Provide mechanisms to bundle various services<br />
Maintain protocols that enable buying energy<br />
Provide predetermined protocols for classifying data<br />
Collect accurate meter data from end customer in a manner that is convenient to the<br />
customer<br />
Communicate customer specific price of electricity information to end customer<br />
Deliver high quality electrical service to customers with in applicable limits<br />
Ensure mechanisms to detect outages<br />
Control loads directly to respond to the reliability needs of the electric grid<br />
Determine protocols for forecasting demand<br />
Ensure communication of system parameters are accurate<br />
Ensure communication of system parameters are accurate<br />
Ensure communication of system parameters available to the customer within<br />
applicable limits<br />
Maintain communication of system parameters as they relate to customer decision<br />
making<br />
Maintain communication of system parameters as they relate to customer decision<br />
making<br />
Maintain communication of system parameters as they relate to customer decision<br />
making<br />
Collect accurate meter data with various levels of granularity from end customer<br />
using protocols to minimize cost<br />
Maintain communication channel with the end customer that allows two-way<br />
communication<br />
Maintain the distribution system to minimize outage occurrences<br />
Maintain communication channel with the end customer that allows two-way<br />
communication<br />
Ensure mechanisms to prevent damage to demand assets<br />
Ensure mechanisms to prevent environmental damage<br />
Provide accurate billing data to customers in a timely manner<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 80
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Provide Energy Information<br />
Services<br />
Provide Power Quality Services<br />
Provide Sub Metering Service<br />
Provide Technical Support<br />
Services<br />
Sell Energy<br />
Share Meter Data<br />
Description<br />
Maintain energy information services that allow the customer to manage their loads<br />
Manage the quality of electrical service by ensuring that it is within applicable limits<br />
Make accurate sub metering data of various loads available to various authorized<br />
parties<br />
Provide technical support services that allow the customer to manage their loads<br />
Maintain protocols that enable selling energy<br />
Ensure authorized parties have access to accurate meter data<br />
Bulk Generation Domain<br />
Table 20 lists SCAP business services required to support the overall business in the Generation<br />
domain. The actual operator of the business services will vary by geographic region.<br />
Table 20 – Generation Domain Business Services<br />
Name<br />
Analyze Schedules<br />
Balance System<br />
Discover Equipment Status<br />
Least Cost Dispatch<br />
Maintain Facilities<br />
Maintain System Integrity<br />
Manage Adverse Conditions<br />
Manage Ancillary Services<br />
Manage Cold Start<br />
Manage Contractual Compliance<br />
Manage Control Of Generation<br />
Manage Data Sharing Across<br />
Organizations<br />
Manage Emissions From Units<br />
Manage Equipment<br />
Manage Forecasting<br />
Manage Islanding<br />
Manage Past Incipient Failures<br />
Manage Power Quality<br />
Manage Scheduled Outages<br />
Description<br />
Provide analytics to determine issues with planned operations<br />
Provide a mechanism to respond to changes in the supply-load equation that will<br />
maintain the system within compliance limits<br />
Provide a mechanism to discover the current characteristics of equipment<br />
Provide a mechanism to allow for the lowest cost units to be called on first for<br />
providing energy<br />
Provide maintenance sufficient to maintain generation units in operational<br />
condition<br />
Provide the controls that will facilitate several scenarios for keeping the energy<br />
flowing through the system when issues occur<br />
Provide analytics to determine adverse impacts that can be managed before they<br />
become operational problems<br />
Provide a set of reserve resources that can be used to maintain the grid within<br />
compliance limits<br />
Bring an out of service unit on line as an independent source<br />
Units have contractual commitments on when to run at what rate<br />
Provide a mechanism to directly control the inputs and outputs of generation units<br />
Provide stakeholders in different organizations with required data<br />
Provide a mechanism that allows control of the emissions of a generation unit<br />
Provide a mechanism to control equipment operation in due time<br />
Provide a mechanism to create scenarios of future demand for supply capability<br />
Provide the ability to disconnect sections of the grid from each other to operate<br />
independently<br />
Provide a mechanism switch away from incipient failures to maintain the system<br />
within compliance limits<br />
Provide a mechanism to maintain energy quality within compliance limits<br />
Plan out of service time for maintenance on generation facilities<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 81
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Manage Scheduling Of Facilities<br />
Manage Unit Commitment<br />
Monitor Generator Emissions<br />
Monitor Generator Performance<br />
Provide Communications<br />
Provide Cost-Benefit Analysis<br />
Provide Fail Over Options<br />
Provide Security<br />
Description<br />
Provide analytics that will develop an operations plan for generation units based on<br />
known characteristics<br />
Provide a mechanism to confirm schedule operational compliance in generation<br />
units<br />
Provide a mechanism to measure emissions of a generation unit<br />
Provide a mechanism to measure generation unit operational characteristics<br />
Provide a way to coordinate different facilities operations regardless of outside<br />
interference<br />
Maintain business cases that provide traceability of project costs and benefits<br />
Provide a mechanism to maintain the system within compliance limits when a<br />
resource is lost<br />
The expectation is that the generation units will provide enough reserve to allow<br />
for the loss of part of the system<br />
Transmission Domain<br />
Table 21 lists SCAP business services required to support the overall business in the Transmission<br />
domain. The actual operator of the business services will vary by geographic region.<br />
Table 21 – Transmission Domain Business Services<br />
Name<br />
Balance Phases<br />
Communicate Emergencies<br />
Conduct <strong>Grid</strong> Planning<br />
Conduct Planning<br />
Conduct Short Term<br />
Forecasts<br />
Create Long Term Forecasts<br />
Detect Faults<br />
Dispatch Maintenance<br />
Teams<br />
Forecast Equipment Life<br />
Forecast Equipment Loading<br />
Maintain Contingency Plans<br />
Maintain Equipment<br />
Characteristics<br />
Maintain Physical Security<br />
Maintain Stability<br />
Maintain State Information<br />
Maintain System<br />
Maintain Topology<br />
Description<br />
Maintain the energy balance from one phase to another phase<br />
Maintain channel to stakeholders to for emergency information<br />
Create scenarios for future system sizing to support possible load changes<br />
Create scenarios for future system supply to support possible load changes<br />
Manage a set of near term projections for system use by location<br />
Maintain a set of simulations that can provide future loading projections on the system<br />
Monitor system for system faults (outages)<br />
Manage the available workforce<br />
Using the information gathered in monitor equipment determine the remaining life of<br />
electrical components installed in the grid<br />
Maintain equipment specific future load profiles<br />
Develop plans, including fail over, that allow the system to continue to operate when<br />
problems arise<br />
Maintain all characteristics of electrical components installed in the system<br />
Manage the physical facilities of the system to maintain control of physical access to the<br />
system<br />
Manage energy flow in the grid to ensure stable grid operation<br />
Using the information gathered in monitor equipment determine the remaining capacity of<br />
the system to handle more energy<br />
Manage the maintenance of the system equipment to maintain operational capability<br />
Manage the mapping of the logical connectivity possible in the overall system<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 82
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Maintain Voltage<br />
Manage Access<br />
Manage Blackouts<br />
Manage Demand Response<br />
Manage DER<br />
Manage Emergency<br />
Response<br />
Manage Equipment Rating<br />
Manage Interconnect<br />
Guidelines<br />
Manage Load Limits<br />
Manage Load Shed<br />
Manage Power Flow<br />
Manage Protection Scheme<br />
Manage Stability<br />
Manage Storage<br />
Manage Supply<br />
Manage Switching<br />
Manage Transformer Load<br />
Manage Var<br />
Manage Voltage<br />
Monitor All Phases<br />
Monitor Equipment<br />
Monitor Equipment<br />
Accuracy<br />
Monitor System Status<br />
Operate Unbalanced<br />
Optimize Equipment<br />
Optimize Planned Outage<br />
Optimize Power Flow<br />
Regulate Frequency<br />
Simulate System<br />
Description<br />
Manage embedded equipment in the grid to adjust voltage to stay within compliance limits<br />
Manage a mechanism to monitor who accessed what when<br />
Operate a mechanism to manage rolling blackouts as part of an overall balancing scheme<br />
Operate a mechanism to manage interruptible loads as part of an overall balancing scheme<br />
Manage DER as a part of the resource mix for balancing energy demands<br />
Maintain a plan for recovering from major system disruptions<br />
Using the information gathered in monitor equipment determine the current energy<br />
capacity of each electrical component of the system<br />
Maintain a mechanism for managing the exchange of energy with distribution<br />
Operate equipment in a manner that avoids overloads<br />
Manage the system balance by shedding load<br />
React to rapid changes in the energy flow to maintain system parameters within<br />
compliance limits<br />
Maintain a set of schemes for protecting the system from damage by electrical overload<br />
Manage energy flow in the grid to ensure stable grid operation<br />
Maintain the integrated operation of storage at any point in the system<br />
Manage the level of supply in the system to balance the system while maintaining the<br />
compliance limits<br />
Manage a set of protocols to switch load on the system<br />
Maintain the load on transformers to avoid distortion of the wave form<br />
Manage VAR for all customers within compliance limits<br />
Operate a mechanism to regulate voltage within compliance limits for all customers<br />
Monitor all three phases of the system for energy flow characteristics<br />
Operate a mechanism to maintain temporal characteristics on electrical components<br />
installed in the system<br />
Maintain status of accuracy for instrumentation in the field<br />
Manage instrumentation in the grid to maintain a picture of the grid situation<br />
Manage the system will different amounts of power flowing on each of the three phases<br />
Manage energy flow so that equipment usage is optimized<br />
Manage the optimization of equipment availability for maintenance<br />
Manage the flow of energy in the grid to minimize losses while supplying all demand<br />
Maintain system frequency within compliance limits<br />
Shall manage a mechanism to create on demand digital simulations of the system<br />
Distribution Domain<br />
Table 22 lists SCAP business services required to support the overall business in the Distribution<br />
domain. In most cases the distribution utility will operate all services. This is the only domain likely to<br />
be similar from region to region.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 83
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Table 22 – Distribution Domain Business Services<br />
Name<br />
Audit trail management<br />
Automated Service Restoration<br />
Condition Based Maintenance<br />
Contingency Load Transfer<br />
Contingency Ranking<br />
Customer Power Quality<br />
Information Management<br />
Development of Future<br />
Distribution Model<br />
Diagnostic Analysis of<br />
Distribution Systems<br />
Distributed Energy Resource<br />
Management<br />
Distribution Energy Loss<br />
Minimization<br />
Distribution operations training<br />
Distribution Planning<br />
Distribution Systems Asset<br />
Management<br />
Distribution Systems Field<br />
Equipment Configuration<br />
Management<br />
Distribution Systems Support of<br />
Transmission Operations<br />
Fault Isolation<br />
Fault Level Analysis<br />
Fault Location<br />
Field Equipment Upgrade<br />
Management<br />
Field work management<br />
Intelligent Alarm Processing<br />
Loss location management<br />
Manage System Protection<br />
Execution<br />
Manage unbalanced current<br />
Optimal Load Flow<br />
Description<br />
This service provides the documentation necessary to provide an audit trail for system<br />
event reporting.<br />
This service manages automated service restoration functions. Measurement of this<br />
service would follow accepted indices on system restoration performance.<br />
This service manages condition based maintenance for distribution field equipment.<br />
This service manages contingency load transfers.<br />
This service ranks contingencies for distribution system operators.<br />
This service manages power quality information available from within customer sites<br />
throughout the distribution system.<br />
This service manages the development of future distribution systems<br />
This service manages the diagnostic analysis of distribution system field equipment.<br />
This service provides management of Distributed Energy Resources (DER) across the<br />
distribution system.<br />
This service manages the technical loss of energy to minimize losses on the<br />
distribution system.<br />
This service provides a comprehensive program of training for distribution operations<br />
personnel.<br />
This service manages the distribution planning processes.<br />
This service manages distribution systems asset management processes.<br />
This service manages the configuration of field equipment. Metrics for this service are<br />
determined by emerging policies for maintaining field equipment documentation.<br />
This service manages the integration of distribution systems in support of transmission<br />
operations.<br />
This service manages the isolation of faults to minimize damage to utility and<br />
customer equipment.<br />
This service manages Fault Level Analysis on distribution systems<br />
This service manages the location of faults on the distribution system. Metrics for this<br />
service would follow industry indices of system performance<br />
This service manages the updating of field equipment<br />
This service manages the dispatch of work crews authorized for servicing field<br />
equipment<br />
This service manages all levels of alarms to maintain correct operator action priorities.<br />
The metric for this service is related to correctly handling the variety of alarms that<br />
may be faced by operators.<br />
This service manages the location of non-technical energy losses on the distribution<br />
system.<br />
This service manages system protection post event analysis; This service manages the<br />
analysis of protection actions following an event episode.<br />
This service manages unbalanced current flows to keep distribution systems within<br />
acceptable engineering tolerances to optimize efficiency.<br />
This service optimizes load flows on the distribution system<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 84
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Optimize Voltage to Reactive<br />
Power<br />
Outage Management<br />
Planned Outage Management<br />
Power Flow Analyses<br />
Power Quality Improvement<br />
Power Quality Monitoring<br />
Prepare Static Systems for<br />
Storm Conditions<br />
Reactive Power Management<br />
Real-Time Emergency<br />
Operations<br />
Root Cause Analysis<br />
Short Circuit Analysis<br />
Short Term Load Forecasts<br />
State Estimation Support<br />
System Protection<br />
System State Monitoring<br />
Topological model<br />
management<br />
Transformer Management<br />
Voltage Management<br />
Description<br />
This service manages voltage in relation to reactive power within the distribution<br />
system.<br />
This service manages outages on distribution systems. The metric for this service is<br />
related to system reliability indices.<br />
This service supports planned outage management for distribution systems.<br />
This service manages the Power Flow Analyses processes.<br />
This service manages the improvement of power quality within the distribution<br />
system.<br />
This service monitors power quality on the distribution system.<br />
This service includes the management of static preparations in anticipation of system<br />
disturbances due to impending storm conditions<br />
This service manages reactive power on the distribution system to maintain reactive<br />
power<br />
This service manages real-time emergency operations within the distribution system.<br />
This service manages the support of field crew investigations into root cause analysis<br />
of distribution system failures<br />
This service manages the analysis of short circuits within distribution systems<br />
This service manages short term load forecasting<br />
This service manages the state estimation process using available information<br />
available from field equipment.<br />
This service manages system protection functions<br />
This service manages the migration to state monitoring making use of increasing<br />
numbers of field devices that have monitoring capability. Metrics for this service<br />
would be the reduction in the band of error surrounding system state.<br />
This service maintains the topological model to maintain the system model in near<br />
real-time.<br />
This service manages the life-cycle of transformers in field operations<br />
This service manages customer service delivery voltages to stay within industry<br />
accepted tolerances<br />
Customer Domain<br />
Table 23 lists SCAP business services required to support the overall business in the Customer domain.<br />
The actual operator of the business services will vary by geographic region.<br />
Table 23 – Customer Domain Business Services<br />
Name<br />
Description<br />
Access Control Management Provide a mechanism to support role-based access control to services.<br />
Configuration Management Manage configuration of the system.<br />
Deployment Management Manage ongoing revision of the system.<br />
Energy Asset Aggregation Manages a group of devices in the customer domain<br />
Energy Management<br />
Provide a mechanism to influence operation of devices to meet business energy-usage goals.<br />
Energy Monitoring<br />
Provide a mechanism to monitor aspects of energy as required to meet business goals.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 85
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Environmental Monitoring<br />
Information Presentation<br />
Infrastructure Planning<br />
Manual Override<br />
Non-Intrusive Monitoring<br />
Outage Management<br />
Description<br />
Provide a mechanism to collect environmental data about the impact of energy supply<br />
sources in the system.<br />
Provide a mechanism to display information from the system.<br />
Building the <strong>Smart</strong> <strong>Grid</strong> System to support additional devices (e.g. Water, Gas)<br />
Provide a mechanism to override automated actions while assuring safety.<br />
Derive device load levels using non-intrusive measurements combined with analytic<br />
methods.<br />
Provide a mechanism to mitigate impact power failures through use of alternate energy<br />
supply sources.<br />
<strong>Smart</strong> <strong>Grid</strong> Cross-Domain Foundational Services<br />
Cross Domain Foundation services are relied upon by all business domains and are therefore required<br />
to be interoperable across domains to enable flexible and resilient grid architecture. For example, two<br />
domains utilizing disparate encryption mechanisms will require additional work to support their<br />
interaction and be indicative of architectural fragility.<br />
Cross domain services break down into three basic groups:<br />
Security<br />
Communication<br />
Data<br />
Each group is discussed below.<br />
Security Services<br />
Central Security Services are comprised of Automated Services as well as the Managed Services<br />
responsible for configuring the Automated Services. Automated Services require no human<br />
intervention once configured and are built for speed and efficiency, whereas Managed Services expect<br />
user input to set configurations, preferences, etc. for the particular characteristic being managed. The<br />
NISTIR 7826 Security Requirements have been translated into the security services in Table 24.<br />
Table 24 – Security Services<br />
Name<br />
Access Control<br />
Account Management<br />
Alarming<br />
Archive<br />
Audit<br />
Audit Qualification<br />
Authorization<br />
Backup<br />
Description<br />
Manages the secure admission. (see Central Security).<br />
Maintains actor security credentials<br />
Provides a mechanism to pass alerts to actors<br />
Providing an accurate long-term copy of information<br />
Provides a rigorous review of actor actions<br />
Provides a trusted method to determine that audit actors are competent<br />
Provides permission for an actor to take an action<br />
A process that provides an accurate alternate copy of information<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 86
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Camouflage<br />
Central Security<br />
Challenge Management<br />
Classification Management<br />
Compliance Management<br />
Configuration<br />
Continuity<br />
Control Management<br />
Corrective Action Management<br />
Disposal<br />
Distraction<br />
Encryption<br />
Entry Management<br />
Identification<br />
Identity Management<br />
Incident Reporting<br />
Information Release<br />
Management<br />
IPR management<br />
Key Management<br />
Life Cycle Management<br />
Log Protection<br />
Logging<br />
Non-Repudiation<br />
Parameter Monitoring<br />
Password Management<br />
Penetration<br />
Physical Security<br />
Privilege Management<br />
Reliability<br />
Response Management<br />
Retention<br />
Risk Assessment<br />
Risk Management<br />
Role Management<br />
Screening<br />
Hiding items from unauthorized actors<br />
Description<br />
The Central Security Service shall maintain a database of transaction permissions at<br />
the component level. Specifically, the Central Security Service explicitly defines which<br />
users and components have permission to perform what transactions in what context.<br />
All <strong>Smart</strong> <strong>Grid</strong> end-users and components must verify sufficient privileges prior to<br />
execution of any transaction instruction.<br />
Maintains a secure challenge process for actors<br />
Manages the labeling of sensitive information<br />
Maintains a process to ensure that actors have not violated security policy<br />
Arranges the pieces to provides an authorized whole<br />
Provides for actors to continue to securely function at an acceptable level<br />
Maintains a set of limits on an actor's access<br />
A process to ensure that any security issues are closed<br />
Provides a trusted process to remove information permanently<br />
A process of enticing unauthorized actors to interact with decoys<br />
Provides a mechanism to encode information in a secure fashion<br />
Provides a mechanism for allowing an authorized actor access<br />
A trusted process of determining the identity of an actor<br />
With the large number of end-users of <strong>Smart</strong> <strong>Grid</strong>, including the customers, utility<br />
employees, grid control operators, etc., the <strong>Smart</strong> <strong>Grid</strong> components must provide<br />
unique and traceable identification of each user as well as data with each message and<br />
transaction.<br />
provides a method to report security breaches to a trusted authority<br />
Allows control of information to be passed to other actors<br />
A process to manage rights to use intellectual property<br />
Provides a trusted process to maintain the security of a secret<br />
A process to manage the cradle to grave security<br />
Provides a mechanism that keeps logs from being tampered with<br />
Provides an auditable trail of actors access<br />
Provides a mechanism to prove that a specific actor took a specific action<br />
Watching the edges of a physical location for unauthorized actions<br />
Manages the process of dealing with all actor passwords<br />
Provides a mechanism to test the security environment for vulnerabilities<br />
Provides a process to ensure that physical items are secure from unauthorized access<br />
Maintains the privileges for actors<br />
Provides a process to monitor actors for unexpected changes in behavior<br />
Provides a mechanism to manage actor actions for alerts<br />
Provides a process to determine parameters for saving information<br />
Determines the risk associated with the security environment<br />
Maintains an assessment of the vulnerabilities in the security environment<br />
Manages actor roles<br />
Maintains a trusted process for reviewing actors for credentials<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 87
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Name<br />
Security Assessment<br />
Security Authority<br />
Security Management<br />
Security Monitoring<br />
Security Policy Management<br />
Security Reporting<br />
Security Test Development<br />
Security Training Management<br />
Separation Management<br />
Threshold Management<br />
Time Stamp<br />
Update Management<br />
Vulnerability Assessment<br />
Vulnerability Management<br />
Description<br />
Provides a mechanism to determine security needs<br />
Provides trusted resource that can authorize changes<br />
Maintains the overall security environment<br />
The analysis of collected information on the status of the security environment<br />
Creates an overall policy for security<br />
Provides a mechanism to inform trusted actors<br />
Provides a trusted process to develop test processes for security<br />
Provides actors with training required to maintain their credentials<br />
Provides a mechanism to ensure that an actor does not have multiple security roles<br />
Provides a mechanism to set parameters for generating an alert<br />
Provides an auditable mechanism for attaching accurate time to an action<br />
A process that updates to the security system navigate prior to being placed in service<br />
Determines what potential security holes exist<br />
Provides a mechanism to monitor the status of security holes<br />
Communication Services<br />
Communication services are fundamental to electric grid operations. They underpin the means by<br />
which devices become intelligent, for information to flow, controls to be executed, and for people to<br />
manage utility functions and services. Movement toward a smarter grid will necessitate vast quantities<br />
of new smart devices to be implemented—all needing some form of communications. The fact that<br />
many of these devices don’t yet exist adds to the challenge. As the devices are implemented, their<br />
functionality and value will expand as grid operators figure out innovative ways to leverage smart<br />
device intelligence. Thus, it is imperative for the <strong>Smart</strong> <strong>Grid</strong> communication architecture to be<br />
extraordinarily forward looking and accommodating.<br />
At the communication services layer, the following functions are required:<br />
1. Transport services to move information around the network,<br />
2. Virtualization services to help segregate and optimize transport services,<br />
3. Control services to help manage information flow and support endpoints wanting network access,<br />
4. Gateway services to facilitate legacy applications to utilize next generation networks, and<br />
5. Mobility services to support roaming or mobile endpoints.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 88
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 46 - Communication Services Layer Functions<br />
Table 25 lists the network and communication services required to support the smart grid.<br />
Table 25 – Communications Services<br />
Service<br />
Access Of Media<br />
Address Management<br />
Administration Service<br />
Alerts<br />
Application Caching<br />
Assured Delivery<br />
Asynchronous<br />
Messaging<br />
Atomic Multicasting<br />
Automated Messaging<br />
Automated Process<br />
Automatic Call Routing<br />
Backbone<br />
Backup<br />
Broker Support<br />
Description<br />
The capability for a user to view specific Library Mgmt System functions depending on the "Set-up<br />
and Control" for that user e.g. searching more than one repository.<br />
Assignment and maintenance of dynamic device addresses to ensure that there are no duplicate<br />
addresses on the network<br />
The maintenance and management of local policies, activities or procedures.<br />
Notification using some mechanism (e.g. SMTP message) that a message was delivered/notdelivered/dispatched/rejected/accepted.<br />
The capability of the system to provide the capability to cache objects, pages etc… to optimize<br />
access speeds. This includes caching for static and dynamic pages.<br />
The ability to know that when a message is sent thru or between systems that the message will<br />
either be received or that notification will happen to the originating system or a designated<br />
operator<br />
Fire and Forget messaging system that exists between source and target applications or/and<br />
databases.<br />
The capability to send a message to more than one target. The message can be atomic (fire and<br />
forget).<br />
Machine generated messages that are sent to specified addresses in pre-designed formats<br />
Event triggered machine operations with a pre-designed set of routines<br />
Using the header information of a telephone message to send the call to a specific hand set or<br />
one of a bank of handsets<br />
The high speed interconnect on the network that provides the location where multiple systems<br />
and users can exchange data. (NOTE: The backbone may be wholly contained in a single device<br />
such as an enterprise router)<br />
The processing of saving documents for storage to another storage medium e.g. disk for<br />
retrieval/restoration as needed. Backups are normally removed to another location for safe<br />
storage<br />
The ability to manage exchange of information between systems and processes through a central<br />
controller<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 89
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Call Groups<br />
Service<br />
Capacity Management<br />
Capacity Monitoring<br />
Chat Management<br />
Collaboration<br />
Computer Telephony<br />
Integration (CTI)<br />
Configuration<br />
Management<br />
Connection Pooling<br />
Connectors<br />
Content Delivery<br />
Data Acquisition<br />
Data Cleansing<br />
Data Distribution<br />
Datastream<br />
Conversion<br />
Delivery Assurance<br />
Delivery Mgmt Service<br />
Dial-In Management<br />
Services<br />
Directory Framework<br />
Management<br />
Directory Framework<br />
Parameter and Control<br />
Set-ups<br />
Dispatch<br />
Description<br />
Maintenance of an automated list of radio handsets that make up the radios attached to a<br />
specific transmitter on a specific frequency and the unique identifier of each handset, so that the<br />
radio call goes to the right transmitter and the right handset<br />
The ability to create and manage the rules required to determine how resources will be assigned<br />
to the available services<br />
The ability to monitor the loads and performance of the systems to determine when the system<br />
either needs additional resources assigned or should shed tasks or users<br />
The ability to set rules and define forums or private areas for on-line chat for collaboration or<br />
discussion<br />
Allows near real-time cooperation between two or more people in two or more locations to<br />
communicate, operate on the same data and see each other's operations and results in an<br />
interactive fashion as though they were in a meeting<br />
The ability to use a computer to answer the phone and/or to provide information automatically<br />
to the human on the answering end of the phone to support the processing of the call in a faster<br />
and more orderly fashion<br />
The ability to manage the system software, application, system settings, and user information on<br />
similar devices automatically and from a remote location<br />
Connection pooling allows the efficient use of data access services. The creation and ripping<br />
down of a connection to a database takes up valuable processing cycles – pooling allows a<br />
connection that is already existing to be used by many separate processes (by queuing requests).<br />
By managing a fixed number of connections (which can automatically be increased in multiples),<br />
the connection time overheads are largely removed, resulting in potentially significant<br />
performance benefits.<br />
Exposure of functionality (application or databases) that enables an application or database to<br />
conduct transactions (CRUD) with the target.<br />
Involves the delivery of content to a particular channel<br />
Collection of a stream of data from instrumentation and sensors that either constantly send data<br />
or are trigger driven, the acquisition has to collect the data and store it for each required reading,<br />
no unanticipated down time is acceptable<br />
An automated process of reviewing data for impurities and correcting these defects automatically<br />
if possible, based on a set of defined rules, logging all errors for manual review<br />
The ability to transport from a central master data set information to remote locations<br />
Translate incoming and outgoing data (or sets of transactions) into the required formats based on<br />
business rules supporting one or more clients/systems on the fly<br />
The ability to assure delivery of a message packet to another system or notify the sending system<br />
or a designated operator<br />
Management of delivery of services either by internal or external resources, ie collection of waste<br />
materials. Monitoring of inventory of items, ie bins.<br />
The ability to manage the occasionally connected data lines from various partners and customers,<br />
with regard to quality of connection, connection time and security<br />
The Management activates of the System Directory, includes distributed management.<br />
Configuration, Set-up of seed data, business rules , business defined criteria that govern the<br />
Directory. May actually call other services such as Users, Groups, Authorizations, etc.<br />
Firing of the message to the Messaging Service or Network Interface Service.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 90
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Domain Name<br />
Services<br />
Electronic Messaging<br />
Enterprise Storage<br />
Event Monitoring<br />
Event Notification<br />
Events Flow<br />
Exception<br />
Management<br />
External File Transfer<br />
Fault Monitoring<br />
Gateway Control<br />
Gateway Management<br />
Gateway Services<br />
Information Exchange<br />
Infrastructure<br />
Management<br />
Infrastructure<br />
Monitoring<br />
Infrastructure<br />
Prioritization<br />
Integrated Voice<br />
Response (IVR)<br />
Inter-Network<br />
Connections<br />
Interactive White<br />
Board<br />
Interconnection<br />
Services - Network<br />
Description<br />
Creation and maintenance of a cross-reference list of physical addresses, routes and aliases for<br />
devices on the network (internal and possibly external), so that humans can enter the alias to<br />
automatically communicate with the desired device using industry standard<br />
The use of digital distribution of information over a network that may or may not extend beyond<br />
the enterprise with a central distribution and addressing center<br />
The ability to share storage between services and applications within the enterprise to provide<br />
flexibility and management for the storage media and the content of the media<br />
Creation, monitoring and extraction an auditable log of events and using pattern matching to a<br />
set of pre-defined rules to alert an operator of an abnormal condition. May also feed alerts to a<br />
device for further processing or process control<br />
Notification to a user or device that an event has occurred, implemented thru a series of rules<br />
and devices, so that the system will keep escalating utilizing different methods or addresses until<br />
it is successful in delivering the alert<br />
the ability to orchestrate a cascading set of events in an automated fashion thru a broker or other<br />
central controller<br />
Provide reports of incidents in any service in the enterprise.<br />
The ability to send a digital package of information via a standard transfer service between<br />
locations (e.g. FTP)<br />
The ability to monitor the services for unexpected operations and determine the cause of the<br />
issue - then report the issues to an appropriate location based on rules<br />
The ability to control the flow of information thru either an internal or an external gateway based<br />
on the rules that have been installed in the gateway<br />
The ability to create and maintain the rules that will be used to determine how a gateway will<br />
react to specific messages, either from the addressing or the content of the message<br />
The ability to use a central director to determine how to route specific digital documents and<br />
information around the enterprise or to and from partners<br />
Automated transfer of data between two or more applications or two or more databases based<br />
on pre-defined keys, formats and rules<br />
The ability to remotely maintain the infrastructure in the organization including creating and<br />
maintaining rules about resource prioritization, allocation, administration authority, etc.<br />
The ability to monitor what is happening in the enterprise infrastructure, log any events that are<br />
not expected, and notify an administrator based on the notification rules<br />
The ability to determine which service or information should go first, when there is contention for<br />
the resources that comprise the infrastructure<br />
The ability to use technology to create and maintain call message hierarchies that are used to<br />
interact with inbound callers to provide information for standard queries without the<br />
intervention of a human operator and record the results of the query. The IVR normally has the<br />
ability to route the call and any information gathered to a human operator if the query cannot be<br />
successfully answered<br />
The ability to peer with or connect to foreign network for communication, both networks that are<br />
controlled by partners and those that are public networks<br />
A process and supporting software to allow two or more people at two or more physical<br />
terminals to view an electronic chalkboard and to add information to the chalkboard that is<br />
visible to everyone else in the session. Change ability can be controlled via security services<br />
The ability to connect (or peer) one or more networks together using standard industry protocols<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 91
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Interconnection<br />
Services - Wired<br />
Interconnection<br />
Services - Wireless<br />
Intermittent Services<br />
Internet Access<br />
Link Management<br />
Linking Services<br />
Log/Audit<br />
Logging<br />
Message<br />
Completeness<br />
Management<br />
Message<br />
Composition/<br />
Decomposition<br />
Message Filtering<br />
Message Logging<br />
Message Routing<br />
Message Translation<br />
Mobile<br />
Mobile Device<br />
Management<br />
Network &<br />
Connectivity<br />
Management<br />
Network Caching<br />
Network Device<br />
Maintenance<br />
Description<br />
The ability to physically connect devices so that they can use standard protocols to communicate<br />
both with other devices and with the enterprise<br />
The ability to connect devices so that they can use standard protocols to communicate both with<br />
other devices and with the enterprise over an Radio Frequency carrier<br />
Services which can be started and stopped, either by demand, or by rule or by administration<br />
which can be used to change the behavior of the rest of the environment (e.g. an intermittent<br />
service to re-route traffic because of a denial of services attack for a commercial web site)<br />
Provision to allow authorized users and devices productive access to the Internet using IP<br />
protocols<br />
Maintenance of specific legs in the network, providing health information on the link to the<br />
operator, so that adjustments can be made<br />
The Capability to access other modules functionality in the application e.g. accessing property<br />
module to associate people, rates or licenses.<br />
Record the master data management system and master data management service events,<br />
normal and abnormal. The full Audit service provides all the logging necessary to support a rich<br />
history of master data management processing events. In practice the Audit service may rarely be<br />
used to its full capacity, partly because the Audit service may have an impact on the performance<br />
of the master data management system.<br />
Audit trail of jobs processed, manual interventions and incidents<br />
The ability to detect when a message does not contain a complete payload and notify the sending<br />
systems<br />
Manages the copying of a message to different formats - utilizes the Transformation service, can<br />
be utilized by multicasting. Also can involve breaking the message up into components.<br />
The determination of where a message is allowed to be sent/received based on security and data<br />
protection requirements.<br />
Creation of a archival quality list of the header or header and body information of all the<br />
information being passed between a specified set of addresses or with specific header<br />
information<br />
The ability to route messages from one system to another automatically<br />
The Transformations from a source message to the requirements of the target.<br />
The ability to disconnect from the network and work on standalone applications, supports bidirectional<br />
synchronization when reconnected to the network<br />
The ability to create rules about how mobile devices connect to the enterprise and what<br />
requirements have to be met prior to allowing access (e.g. authentication, authorization, patch<br />
level, etc)<br />
The ability to create and maintain the rules by which a network can connect to another network<br />
either with a partner or a public network<br />
Caching is often used to improve performance of systems, by moving the data nearer the<br />
consumer. This can be by caching data in memory for database access, caching networked data<br />
on a local storage device for network access, caching pre-constructed Web pages and other<br />
information for use either externally (often referred to as reverse caching) or internally (reducing<br />
network usage).<br />
The ability to remotely manage the health of a network device and update any firmware or<br />
software installed in the device<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 92
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Network Device<br />
Security Management<br />
Network Interfaces<br />
Network Management<br />
Network Monitor<br />
Network Performance<br />
Tuning<br />
Network Traffic<br />
Simulation<br />
Node Management<br />
Non-Delivery<br />
Notification Services<br />
Monitoring<br />
Object Inspection<br />
Path Tracking<br />
Performance<br />
Modeling<br />
Portal<br />
Private Wireless<br />
Configuration<br />
Management (Talkgroups)<br />
Queue Management<br />
Radio<br />
Radio Frequency<br />
Management<br />
Real-time<br />
Reliable Multicasting<br />
Remote Access<br />
Remote access<br />
management<br />
Description<br />
The ability to remotely manage the rules, settings and permissions for the secure operation of the<br />
netowork<br />
Provide network access outside the Local Area network (other LANs in the Wide Area or external<br />
networks)<br />
Management of the network devices including: routers, hubs and switch monitoring and<br />
configuration control<br />
Logging, triggering (simple test) and analyzing (complex time delayed testing) the movement of<br />
traffic on the network to determine the health of the network and alerting devices or humans of<br />
problems with the health, based on a pre-defined set of rules.<br />
The ability to monitor and automatically adjust the performance of a network or a portion of a<br />
network<br />
the ability to create and maintain a model of the actual network and to create traffic scenarios for<br />
the network to determine when the network would run into contention and other operational<br />
issues<br />
The ability to allocate and manage the way services access nodes on a processing system<br />
The ability to recognize that a message that should have been delivered has not been delivered<br />
and make the appropriate re-tries or notifications<br />
The ability to monitor and report the health of the notification process<br />
The ability to review object for integrity and replace or sequester objects that do not pass the<br />
testing<br />
The ability to determine the route that traffic took during the trip between locations including all<br />
the devices that it crossed during the trip and time statistics<br />
The ability to model a service and its supporting infrastructure and understand how the service<br />
will perform based on scenarios of usage<br />
Providing an individual human readable front end to the information and systems that they are<br />
authorized to access, in a common format to hide the complexity of the underlying systems in a<br />
commercially standard format<br />
The ability to segment the user population by various parameters to efficiently use the limited<br />
radio bandwidth that is available from a transponder<br />
Handling of the incoming and outgoing queues of events, and messages -including the ability to<br />
recognize priority items in the queue and move them forward, ensuring that all items are<br />
released from the queue to the process that they are assigned to<br />
Supports use of specific frequencies to send information thru the air between handsets and fixed<br />
antennas using a known addressing scheme<br />
Maintaining control of the specific radio frequencies that are licensed to the facility to reduce<br />
non-productive messaging and optimize productive use<br />
The ability to interact with data in a short enough period of time to effect the next operation on<br />
the item reporting the data (e.g. acting on data that shows a broken drill bit in a tool, before it<br />
can eject the current part and start on the next one) so that the required actions are taken within<br />
the cycle of the device<br />
Multicasting that results in a response.<br />
Allowing users and devices to connect to the network from public or non-dedicated services such<br />
as the internet or dial in services<br />
The ability to limit who can use remote access and what they can do from a remote location<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 93
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Remote access<br />
security management<br />
Remote configuration<br />
management<br />
Remote multicast<br />
printing<br />
Remote print<br />
Remote systems<br />
administration<br />
Routing<br />
Routing modeling<br />
Sensor<br />
SMS<br />
SMS Channel<br />
Synchronization<br />
Synchronous Network<br />
Interfaces<br />
System Monitoring<br />
Telephony<br />
Text Chat<br />
Traffic Prioritization<br />
Transmission<br />
Trigger (Initiate)<br />
Tunneled<br />
Transmission<br />
User Directory<br />
Services<br />
User Monitoring<br />
Video Communication<br />
Video management<br />
Voice Channel<br />
Voice Management<br />
Description<br />
The ability to provide authentication and other security mechanisms for remote access<br />
The ability to maintain the configuration of clients that are remotely accessing services or assets.<br />
The ability to send a single print file to a number of remote locations for remote printing<br />
The ability to create hard copy documents in a geographic location that is not where the print file<br />
is generated<br />
The ability to securely manage servers and other assets when not sitting on the console that is<br />
directly attached to the device<br />
Sending traffic over only required network segments to a known address on the other end of the<br />
network links and preventing traffic without valid need from affecting the operation of and/or<br />
being visible to non-required network segments. Limiting the visibility of broadcast messages to<br />
specifically required network segments, based on the header of the broadcast<br />
Routing rules for transporting master data management occurences from master data<br />
management system to local application.<br />
Interrogates and reports real-time readings on a specific physical characteristic (ie temperature,<br />
or a chemical in the air)<br />
The ability to communicate with devices that use the industry standard for short messaging<br />
service in a bi-directional fashion<br />
SMS Channel Service (Short Message Service used for message event notification and simple<br />
interaction services. This is a specific type of Mobile Service).<br />
The capability to manage the synchronization of user authentication and other details to ensure<br />
that information across applications is updated. This is the "Join" Service that allows relationship<br />
management through synchronization and replication.<br />
The ability to do bi-directional handshaking between devices on the network where each step is<br />
acknowledged by the other device on the network<br />
System monitoring based on certain criteria e.g. KPIs.<br />
Support for the standard addressing scheme for telephone handsets to route voice conversations<br />
and other voice encoded traffic over the telephone network<br />
Alpha-numeric information for collaboration and discussion between devices in near real time<br />
Using the header information on IP traffic to determine whether to allow it unlimited, limited or<br />
delayed assess to slower network links<br />
Providing information for routing over an IP network with machine readable headers<br />
Signalize an event to an automated process in the course of the master data management<br />
process.<br />
Provides information for routing over an IP network with external headers, to a specific gateway<br />
address, while encrypting the real headers and information as data<br />
The facility to maintain constituent's name and address register, property registers, supplier<br />
information, etc.<br />
The ability to watch the behavior of any user on the system and determine any behavior that is<br />
outside of the expected or accepted operation of the systems.<br />
Use of moving pictures, normally in near real-time to communicate between two locations<br />
Video management (CRUD)<br />
Voice Channel Services (Delivery and receipt of information through a voice channel including<br />
touchtone, speech recognition, automatic voice response and text to speech services)<br />
Management of voice lines, PBX's, assignments, billing usage, CIT, VRU, etc.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 94
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Voice Recording<br />
Voicemail<br />
Web Services<br />
Description<br />
Recording all voice traffic between specific handsets or telephone instruments<br />
Storage of voice messages that can be played back by users who have access to specific<br />
telephone handset addresses<br />
Provide access to pre-formatted sets of messages and routines that use industry standards for the<br />
exchange of data between parties<br />
Data Management Services<br />
Data Management Services are required in all domains of the smart grid. All 7 domains require some<br />
level of data management services, and most required more capability than they have today. The<br />
increase in the volume of data and the tightening of the timing requirements means that most<br />
enterprises that will operate the smart grid will need to evaluate their legacy services for suitability the<br />
future. Data services can be broken down into data acquisition, transformation, persistence and<br />
archiving. Table 26 lists conceptual automation services that support data:<br />
Table 26 – Data Management Services<br />
Service<br />
Ad-Hoc Management<br />
Reports<br />
Adapter<br />
Adaptor Matching<br />
Adaptors<br />
Analyse Information<br />
Analysis And Strategy<br />
Application Certification -<br />
Ecosystem<br />
Application Hosting<br />
Archive Management<br />
Archive Rules<br />
Archiving<br />
Backup And Restoration<br />
Description<br />
This service includes the generation of ad-hoc reports in either electronic or hard copy (e.g.<br />
job log reporting or site statistical reporting.)<br />
Connecting the scheduler to processing nodes<br />
Defines a standard application for connecting to heterogeneous enterprise information<br />
systems, such as ERP, mainframe transaction processing and database systems. The<br />
architecture defines a set of scalable, secure, and transactional mechanisms that describe<br />
the integration of enterprise information systems to an application server and enterprise<br />
applications.<br />
Provides interfaces to Application for the exchange of data between applications.<br />
Analysis tools available for forecasting and analyzing historic data to find patterns etc.<br />
Includes OLAP; modeling.<br />
Analysis tools available for forecasting and analyzing historic data to find patterns etc.<br />
Includes OLAP; modeling.<br />
The ability to successfully complete the testing standards for information devices and<br />
computer systems with in a community of companies that have decided to exchange data<br />
and/or system access and have defined community standards (e.g. Wal-Mart Vendor<br />
Standards)<br />
The process required to run a commercial package for to support business requirements<br />
Manages the archiving of content to external storage. Use of schedule, filters, etc.. In order<br />
to target content for archiving.<br />
Rules for archiving of information, applications, settings, configurations, and system<br />
software for permanent storage.<br />
Permanent or very long-term back up of data on media that is designed to withstand the<br />
long-term storage<br />
Backup and Recovery are key aspects to any information system – and consist of both ICT<br />
services and supporting processes. Backup is the activity of copying information from a<br />
system so that it is preserved in case of equipment failure or other catastrophe. Restore is<br />
the activity of restoring a system using the backups of the information and/or systems<br />
applications.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 95
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Backup Management<br />
Business Continuity Pre-<br />
Disaster Services<br />
Calendar Service<br />
Calendaring - Job<br />
Management<br />
Capacity Planning<br />
Cleansing<br />
Cloning<br />
Cold-Starting<br />
Configuration<br />
Connectors<br />
Content Aggregation<br />
Content Guideline<br />
Management<br />
Content Import<br />
Content Load Management<br />
Content Management<br />
Content Publication<br />
Description<br />
The ability to create rules sets that drive the process of backup and restoration of data,<br />
configurations, applications and systems in an enterprise<br />
The operation of the services required to allow for business continuity to be available when<br />
a disaster happens<br />
A system that provides the ability to do timekeeping that defines the beginning and length<br />
and divisions of the year. Also to provide the basis for a scheduling service for activities<br />
The ability to manage a set of activities between a set of systems, such that the desired end<br />
result is achieved in an automated fashion on a regular schedule<br />
The ability to forecast the level of resources that needs to be assigned to a service to<br />
support the anticipated load of the service based on the rules for capacity management<br />
Data cleansing, also called data scrubbing, is the process of amending or removing data in a<br />
database that is incorrect, incomplete, improperly formatted, or duplicated.<br />
The process of saving transactions to a mirror system, as the transactions are processed to<br />
provide a "hot" recovery capability<br />
Whenever a system is being brought on-line for the first time, it must be initialized and<br />
synchronized with the integration infrastructure. The system may be designed to be event<br />
driven, but in order for it to be able to properly process a change to a data item, it must<br />
first be placed in a known initial state. This is true for its internal functions as well as for it<br />
to be able to properly perform its designated services within the context enterprise level<br />
business processes. In case for some reason the integration platform is unavailable,<br />
provisions need to be made for a subset of mission critical functions to be able to function<br />
in a minimally acceptable fashion. For example, it is possible to start up a process that is<br />
completely independent of the integration platform and have a temporary point-to-point<br />
interface. Then, when integration platform is available again, the point-to-point interface<br />
can be disabled. This should be considered only for certain mission critical and mission<br />
important services that rely on each other.<br />
From the integration infrastructure point of view (vs. the application point of view), to the<br />
maximum extent reasonable, a common approach is desired for configuring applications<br />
and data stores into the enterprise environment. When an application interface is initiated<br />
(adaptor or services), it needs to understand the context, environment, and basic<br />
configurations.<br />
Exposure of functionality (application or databases) that enables an application or database<br />
to conduct transactions (CRUD) with the target.<br />
The process of pulling content from a variety of sources and presents it to the user in a<br />
unified format<br />
The ability to create and maintain the rules for loading content and annotation of the<br />
content to maintain consistancy for delivery across channels<br />
The ability to bring content, both structured and unstructured into a document template<br />
Provides the services for loading content and descriptors into the content management<br />
system and documenting the content with additional information to support structured<br />
queries.<br />
The ability to create and maintain the information that is displayed in an interface or into a<br />
hard copy publication for use by customers, employees and other consumers of the<br />
information, and the ability to provide a consistent set of information across multiple<br />
communications channels<br />
The ability to create a packaged view on the content that is available to view by consumers<br />
in any channel (e.g. a printed catalog, a portal, or a sales flyer)<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 96
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Content Relationship<br />
Management<br />
Data Access<br />
Data Aggregation<br />
Data Analysis<br />
Data Consolidation<br />
Data Distribution<br />
Management<br />
Data Entry<br />
Data Exploration<br />
Data Export<br />
Data Filtering<br />
Data Flow Orchestration<br />
Data Import<br />
Data Landscape Modeling<br />
Data Life-Cycle Management<br />
Data Management<br />
(Structured)<br />
Data Management<br />
(Unstructured)<br />
Data Mapping Rules<br />
Data Mining<br />
Data Movement<br />
Data Notification<br />
Data Replication<br />
Data Replication<br />
Management<br />
Data Service Discovery<br />
Data Service Registration<br />
Data Store Integration<br />
Description<br />
Manage the rules that link rich content (text, video, image, …) to a product template<br />
The ability to reach into organized data repositories and retrieve the information that is<br />
useful to answer the query that is being asked<br />
The ability to move (or link) data from many systems into a meaningful single repository<br />
(physical or virtual) to allow data mining<br />
The ability to look at each piece of data in context and determine the quality of the data<br />
and the value of the data to the enterprise<br />
Bringing data from several databases instances together into a single instance using a key<br />
structure between the databases<br />
The ability to create and maintain rules about what data will be sent to which locations and<br />
what the restrictions are on the sending (or receiving) of the data<br />
The ability to enter data via an interface (e.g. keyboard, microphone, scanner, etc) into a<br />
digital format for storage in an information system<br />
The ability to create parameters for data mining. Data mining is the collection of large<br />
amounts of data from one or more repositories. Once a useful connection is developed, the<br />
resulting rules are moved to production data mining<br />
The ability to move data out of a structured data store<br />
Filter out certain data from the local applications during selection. The service will use role<br />
definitions to identify the receiver user of the data and to filter from the local application<br />
on this basis.<br />
To define and manage and monitor complex data flows across the system.<br />
The ability to bring data into a structured data store<br />
Modeling of local and master data management application and system landscape (logical<br />
and technical).<br />
Maintain and delete services with a private or public registry during the full lifecycle of the<br />
service (creation, maturation, aging, retirement).<br />
Storage of structured data is normally within a database management system (DBMS),<br />
often a Relational Database Management System.<br />
The ability to create and maintain document and image stores which are organized in a<br />
fashion to allow a user with some familiarity to retrieve the right documents<br />
Mapping rules between master data management object model and the local application<br />
obejcts models. Input for Inbound and Outbound Mapping.<br />
Data Mining is the specific investigation of data in a warehouse looking for new and useful<br />
connections that will provide insight into marketing and other activities.<br />
The ability to move data from one repository to another repository in an automated and<br />
scheduled fashion<br />
Signalize an event to a user in the course of the master data management process.<br />
The ability to replicate changes in data to various identical data stores either local and/or<br />
distributed<br />
Creation and maintenance of the rules that allow for orderly replication of data from both<br />
un-tethered systems and enterprise systems<br />
To discover existing data management services.<br />
To register in a private or public registry during the full lifecycle of the service.<br />
The ability to transform data at the transaction level for movement of the transactions or<br />
records between two or more structured data stores<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 97
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Data Transformation<br />
Data Update<br />
Data Validation<br />
Data Warehousing<br />
Database Management<br />
Decision Support<br />
Defined Management<br />
Reports<br />
Delay Notification<br />
Digital Media Production<br />
EDI<br />
EIS (Executive Information<br />
System)<br />
Electronic Publishing<br />
Encrypted Data For<br />
Communication<br />
Encrypted Data For Storage<br />
Description<br />
The ability to change the format of the data elements from one system to support the<br />
operation on those data elements by another system or for delivery to another system or a<br />
user (e.g. changing Euros to dollars, or English to Chinese, or taking a short integer and<br />
making it an integer)<br />
Services for creating, updating and deleting data, whether the data is retained by an<br />
application, persistent data store or some other means. These services are responsible for<br />
ensuring updates to this data are performed in accordance master data management<br />
services, including data replication performed for performance reasons. The quality of the<br />
data and confidence level of the accuracy of the data is indicated. The golden record will<br />
have a quality of data measure while an unsanctioned copy would be expected to have a<br />
much lower data quality rating. Regarding data currency, there is typically a metadata field<br />
that gives an indication of either when the data was updated (time stamp) or how long<br />
since the data has been updated (age indicator).<br />
Data Validation Services are both those services tht allow data validation within a database<br />
management system or with external services – for example reference data or external<br />
services such as Postal Address Files (PAF)<br />
The ability to combine disparate data from disparate systems into a single data store with<br />
valid relationships for the purposes of data mining and reporting. Normally done overnight<br />
or once a week to give a historical view<br />
Secure, structure, maintain, log and provide access to electronic data in support of<br />
distributed and or localized processing<br />
Maintenance and summarization of data using pre-determined rules to provide information<br />
supporting rapid decision making.<br />
This service includes the generation of defined reports in either electronic or hard copy<br />
(e.g. job log reporting or site statistical reporting.)<br />
This service is responsible to notify the consumer through a channel (might be a prefered<br />
channel) of delay in regards of one or multiple services he is "registered" to (like a flight<br />
delay for instance).<br />
The ability to create digital content for display to an audience (e.g. employee training, sales<br />
promotion, professional production) the content could be video, audio, textual, etc<br />
The ability to use exchanges standards for moving data between systems or enterprises in<br />
electronic form. The standards include but are not limited to OFX, UNEDIFACT, etc.<br />
Executive Information System (EIS) software component provides you with a powerful, yet<br />
simple tool that allows you to view and analyze key factors and performance trends in the<br />
areas of sales, purchasing, production, and finance. The executive information system<br />
allows you to see both summary and detail level data. You can display summarized data<br />
that reflects the overall status of your enterprise. EIS spotlights areas that need attention<br />
before situations become critical and costly by highlighting key performance indicators. You<br />
can use drill-down capabilities to trace problem areas to any level.<br />
The ability to create complex compound documents for distribution either in electronic<br />
form or in hard copy - document templates may be setup to be automatically completed<br />
with component data on a scheduled basis<br />
Encryption of data within the boundaries of a communication method. This would cover all<br />
of the transport methods including those that use a persistent data store such as the file<br />
storage mechanism found in many store and forward paradigms while still clearly<br />
delineating the boundaries between a persistent data store and the transport mechanism.<br />
Encryption of data within data repositories. This covers the encryption of data governed by<br />
applications using file system and database formats as well as other persistent data stores<br />
not associated with data transport mechanisms.<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 98
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Enterprise Rollback<br />
Event Scheduling Service<br />
Exception Handling<br />
Extract/Transform/Load<br />
Extraction<br />
Fee Management<br />
File Services<br />
File Sharing<br />
Global Setting Management<br />
Governance Services<br />
<strong>Grid</strong><br />
<strong>Grid</strong> Management<br />
Implementation And<br />
Controls Set-Up<br />
Inbound Data Mapping<br />
Indexing & Referencing<br />
Information Integration<br />
Information Management<br />
Description<br />
The ability to rollback an update or change to information contained in multiple systems<br />
and databases in a coordinated and automated fashions<br />
The ability to create and maintain a schedule of events that should be automatically<br />
intiated and terminated in the enterprise<br />
From an integration infrastructure point of view, it is helpful if exceptions are presented in<br />
a consistent manner. Exceptions can be divided into at least two categories: system and<br />
functional. Systems exceptions are those generated as the result of program and/or<br />
hardware system failure. Functional exceptions are those generated as the result of data,<br />
business process, or logic errors. Each category can be further classified as fatal, warning,<br />
and information only. This service is also often linked to the enterprise system<br />
management and monitoring service for process.<br />
Services to extract data from existing data sources, transform the data (into the required<br />
input format) and then load the data, in a highly efficient manner, into the destination<br />
database.<br />
Mechanisms for transferring relevant data from local systems to the master data<br />
management environment. Master data instances are retrieved from the local systems.<br />
Selection is based either on predefined rules or based on the authorization level of the<br />
user.<br />
Assessment of rates and fees required for an application<br />
Maintain and provide access to files in a file system<br />
The ability to allow and restrict users and systems access to specific unstructured<br />
documents with in the enterprise based on rules, permissions, and authorization<br />
The ability to create and maintain the overall setting for all users of a service or for how the<br />
service will behave<br />
To manage the life cycle of a data items; Define and track chain of custody, versioning, etc.<br />
This capability provides the necessary checks before a message is published, during system<br />
integration and also on a continuing basis for B2B situations. Validation rules on message<br />
syntax, data integrity, and business logic conformance can be developed and implemented<br />
as a service to be executed by the adaptor layer. Any exceptions raised by this service will<br />
determine whether the data can be published or not.<br />
The ability to create a virtualized server farm, where services run based on rules that<br />
determine how many resources are devoted to each service.<br />
The ability to create and maintain the rules for the prioritization of use of the resources by<br />
the rules<br />
Configuration, Set-up of seed data, business rules , business defined criteria that govern a<br />
service or application<br />
Association of meta data definitions and conversion rules between local application data<br />
models and the master data management data model.<br />
The Indexing & Referencing (I&R) service maps application specific identifiers to and from<br />
global identifiers at each interface. It generates unique identifiers for messages and/or<br />
objects for canonical message data and is responsible for storing the transformation<br />
mappings persistently. These identifiers establish a unique reference between an<br />
application message and its corresponding canonical message data, thus enabling the<br />
decoupling of sources of data from consumers of data.<br />
The ability to bring information into a single view for data mining or business analysis<br />
The ability to manage the information in the enterprise across all platforms and services to<br />
maintain the health of the data stores<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 99
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Job And Process Queue<br />
Management<br />
Job Restart<br />
Knowledge Indexing<br />
Knowledge Repository<br />
Knowledge Searching<br />
Management Reports<br />
Management & Monitoring<br />
Master Data Management<br />
Services<br />
Message Creation<br />
Message Execution<br />
Message Explosion<br />
Message Queue<br />
Messaging Persistence<br />
Metadata Management<br />
Modeling<br />
Description<br />
Job queue management functions - management of the machine assets that are assigned to<br />
a specific job or process, including launch and termination time, priority slices on hardware,<br />
prioritization of access to data stores, spawning additional copies of processes and<br />
trimming the resources that are allocated to the process as higher priority processes enter<br />
the queue<br />
Restart of an automated processing job after a failure has occurred. Either restart from the<br />
beginning of the job, or from an identified restart point.<br />
The ability to index the content of unstructured knowledge objects, both within the<br />
enterprise and in locations in the enterprise and the extended partner network for future<br />
query<br />
The ability to consolidate key unstructured documents from many sources, including<br />
individual user devices into an enterprise data store, to provide a higher level of availability<br />
and consistency to the queries of the authorized users<br />
The ability to query one or more knowledge indexes for information that is relevant to the<br />
query being performed, normally the service includes the ability to rank the results based<br />
on the match to the query<br />
This service includes the generation of defined and ad-hoc Management reports.<br />
A middleware platform is often linked to an enterprise system management tool, but now<br />
done using consistent semantics. Systems and/or functional exceptions that require the<br />
attention of appropriate people can be sent electronically. Related information is logged<br />
for auditing, diagnosing, processing, and manual interventions.<br />
A system of record is an information storage system which is the data source for particular<br />
data elements and information sharing sets (e.g., message payload). A service should only<br />
be allowed to modify items for which it is the system of record. To achieve the desired<br />
benefits of COTS, data replication will be unavoidable (vs. customizing off-the-shelf<br />
packages to obtain data from a central database). Therefore, the integration infrastructure<br />
must ensure that there is only one system of record for each piece of information at any<br />
given time. It is possible to dynamically change the system of record via chain of custody<br />
management, but this ability may not be worth the tradeoff of increased integration<br />
infrastructure design and implementation complexity.<br />
Creation of a machine readable header to wrap information in, so that it can be transmitted<br />
between devices on the network<br />
Identifies the message types and formats the incoming message. Common Service that<br />
passes managing the steps needed to get a message from source to destination. Uses<br />
Messaging, Transaction, Network and/or Process Management services.<br />
The ability to automatically route a message to more than one internal service or addressee<br />
A facility that ensures that a message is delivered to its target, includes message ordering<br />
and prioritization.<br />
This capability provides for archiving the messages for auditing, workflow, and business<br />
intelligence purposes. Typical integration solutions support the internal needs for message<br />
persistence for auditing and workflow, but may not have a way to provide business<br />
intelligence on top of messaging. Message persistence, in conjunction with the Indexing<br />
and Referencing service, are fundamental to establishing event histories and reporting<br />
capabilities that transcend individual systems.<br />
Mechanisms for the configuration and maintenance of predefined settings for the master<br />
data objects, application landscape, and master data object mappings/routing. It has<br />
services to model and define procedures and rules.<br />
Setup and utilization of complex analytics that will automatically review records, based on a<br />
set of rules to determine trends in the records that can be displayed to users<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 100
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Multi-Media<br />
Multi-Media Chat<br />
Multi-Tasking<br />
Multiprocessing<br />
OLAP (On-Line Analytical<br />
Processing)<br />
OLTP (On-Line Transaction<br />
Processing)<br />
Operational Data Store<br />
ORB (Object Request Broker)<br />
Platform Management<br />
Portal Management<br />
Portal Page Creation<br />
Portal Pages Framework<br />
Purging<br />
Query Management<br />
Recovery<br />
Replay<br />
Resource Adapter<br />
Restart Management<br />
RFID<br />
Roll Back<br />
Schedule<br />
Searching Directory<br />
Description<br />
Integrated graphics, audio, video, and text<br />
The ability to use text, video, audio and other media formats for on-line discussions and<br />
collaboration in near real time<br />
The ability to have a single device handle multiple services simultaneously thru a single<br />
physical pipeline<br />
The ability to break up a stream of work and have it handled across a number of physical<br />
devices<br />
Decision support software allowing the user to quickly scrutinize information summarized<br />
into multidimensional views and hierarchies. OLAP included the use of multidimensional<br />
models to represent complex data relationships, using “slice and dice” to look at<br />
information from different viewpoints.<br />
The ability to take records from users and services one record at a time, provide validation,<br />
route error condition messages back to the creator and store the valid transactions or<br />
invalid transactions with error messages in a structured data store<br />
The ability to create and maintain information across traditional applications and data<br />
stores in a single data store to support use of the data by multiple systems. An ODS is an<br />
operational version of a data warehouse and is normally up to date with the movement of<br />
data in the enterprise<br />
The ability to orchestrate the services request for information from other services or data<br />
stores and manage the process of the exchange<br />
The ability to monitor and manage the hardware platform the infrastructure is built upon<br />
The Management activities of the Portal Application, includes selection of standard alerts,<br />
indexing and monitoring of criteria (based on set-up). Also includes capabilities such as<br />
caching and pooling.<br />
The capability to build Portal Pages based on either Framework Templates or algorithm.<br />
These pages will be served to the various channels and may utilize common services.<br />
The templates provided within Portal Products to assist in the formulation of consistent<br />
look and feel for Portal Content Pages<br />
The process of verification of data on archival media and the subsequent removal of data<br />
from the primary storage media<br />
Handling all requests for information or data from a specific data store - requests can be<br />
handled on a priority basis and they can be interleaved with other processes based on<br />
assigned priorities<br />
Transfer of information from a backup media to a specific system with a specific<br />
configuration for operation then loading it with a specific set of data based on an agreed to<br />
time and date<br />
The reinstating of an event upon failure<br />
Prepackaged modules that provide connectivity and or transformation between<br />
applications and databases.<br />
The ability to determine the state of an ICT process and if it has stopped, return the process<br />
to operation from the point it stopped at, or at the beginning of the current step or record<br />
Locating and identifying packages by utilization of location device(s)<br />
Retraction database changes to a specific previous date and time or to the beginning of a<br />
logical transaction<br />
Time-based execution of a formalized chain of master data management events.<br />
The querying of Portal databases to find data (e.g. users, groups, authorizations) based on<br />
the search criteria, from the Directory<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 101
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Service<br />
Searching Other Databases<br />
Semantic Model<br />
Management Services<br />
Staging<br />
State Management<br />
System Directory Services<br />
System Management<br />
Tracking<br />
Transaction Controls<br />
Transaction Management<br />
Transaction Monitoring<br />
Transaction Rules<br />
Trigger Workflow<br />
Version Management<br />
Voice Input Processing<br />
Workflow Services<br />
Description<br />
The querying of other databases to find data (e.g. media, information) based on the search<br />
criteria, from the Portal Product<br />
To ensure semantic consistency across all interfaces independent of technologies employed<br />
and vendor products used, these services enable use of artifacts (e.g., schemas for<br />
messages, schemas for persistent data stores, etc.), derived from the semantic model<br />
across all nodes and all layers.<br />
Store & forward master data instances across its entire life-cycle.<br />
Determine the status of an master data instance being processed and initiate and<br />
determine the workflow based on this status.<br />
The ability to provide system to system addressing in the network to allow users and<br />
services to connect to authorized services and authenticate<br />
Management of the computing platforms including: load monitoring, capacity, software<br />
distribution, and configuration control of the desktop systems and servers<br />
Service to analyze the audit trail in order to reconstruct past events.<br />
Configuration, Set-up of seed data, business rules, business defined criteria that govern the<br />
ERP General Ledger Module.<br />
Processing of data across multiple databases.<br />
Monitoring of the transaction to determine if it is successful or not (passes message back to<br />
Message Execution Service). Includes the use of two phased commits, multiple targets and<br />
distributed transactions.<br />
Rules specific to the target databases e.g. cascade update, two phase commit.<br />
A call to a workflow component when user intervention is required for an event (within an<br />
event flow).<br />
Manages the various version of rich content, check-in, check-out, etc.<br />
Conversion of audio information to digital information that can either be recorded as<br />
textual data, records, or machine commands<br />
The set-up and running of processes to control document flows including escalation, email<br />
notification, task management, prompts and reminders<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project (SCAP)<br />
Appendix • 102
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix D. Roadmap & Maturity Model<br />
Policy Timeline<br />
Figure 47 depicts a typical policy timeline for a California utility. Each utility should employ a similar<br />
diagram to identify deadlines set by federal, state and local regulatory and legislative bodies. This<br />
timeline provides high level input to the utility <strong>Smart</strong> <strong>Grid</strong> development roadmap.<br />
Figure 47 - California <strong>Smart</strong> <strong>Grid</strong> Policy Timeline (Southern California Edison, 2010)<br />
Pursuing the <strong>Smart</strong> <strong>Grid</strong> Vision<br />
A high-level development roadmap for the smart grid identifies the technologies a utility should plan<br />
to pursue over the course of the next two decades in order to make its smart grid vision a reality. The<br />
smart grid will evolve in complexity and scale over time as the richness of systems functionality<br />
increases and the reach extends to greater numbers of intelligent devices.<br />
Most utilities will create and follow development roadmaps, which tend to have several major stages.<br />
Within each development roadmap stage, there are two activity portfolios to be managed<br />
simultaneously. The smart grid deployment project portfolio consists of smart grid technologies<br />
commercially ready for deployment. The technology evaluation portfolio includes initiatives to<br />
identify, evaluate, and test emerging technologies expected to be deployed at a later stage. Figure 48<br />
illustrates the distinction between these two portfolios in terms of technology maturity over time.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 103
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 48 - <strong>Smart</strong> <strong>Grid</strong> Project Portfolios as a Function of Maturity (Southern California Edison, 2010)<br />
Technology evaluation portfolio projects fall into the Leading Edge areas of the maturity curve. These<br />
projects require further evaluation of emerging technologies to better understand the capabilities such<br />
technologies could contribute to the smart grid vision, their progress towards technical maturity, and<br />
the corresponding value that they might unlock.<br />
<strong>Smart</strong> grid deployment portfolio projects, on the other hand, involve the planning and execution of<br />
deployment plans for commercially available smart grid technologies. Although these technologies<br />
have crossed the chasm of the maturity curve, given the urgency of state and national policy goals they<br />
increasingly fall within the Early Majority or later areas of curve. Historically, most utilities have<br />
preferred to adopt technology later in the maturity lifecycle, allowing for greater confidence in<br />
implementation and operation. Earlier adoption and adaption indicates that significant project risks<br />
could be substantially mitigated through an effective technology evaluation process<br />
A four stage roadmap structure is recommended for smart grid transformations. In this model, the four<br />
stages of the smart grid development roadmap and high level plans for deployment and technology<br />
evaluation projects to be included within each stage are:<br />
Stage 1: Foundation (past work)<br />
Comprised of already completed foundational work for the deployment of advanced measurement and<br />
control systems, this is a preliminary period where many utilities get early experience with new<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 104
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
technologies such as wide-area measurement and control systems - smart meter deployments were<br />
initiated by a number of utilities during this stage.<br />
Stage 2: Inform and Automate (near-term)<br />
In this stage most utilities focus on the following areas:<br />
Evaluation of energy storage<br />
Integration of renewable and distributed energy resources<br />
Development and interoperability testing of home area network devices and vehicle charging<br />
equipment<br />
Ongoing development of interoperability and cyber-security standards<br />
Electric system studies and engineering analysis regarding operational impacts from dynamic<br />
resources, bi-directional distribution flows and new operating paradigms<br />
Workforce safety and productivity technologies<br />
A number of North American <strong>Smart</strong> <strong>Grid</strong> pilot projects, many funded by the American Recovery and<br />
Reinvestment Act (ARRA), will commence during this period. Efforts to educate the general public on<br />
<strong>Smart</strong> <strong>Grid</strong> topics should also gain traction during this time.<br />
Stage 3: Interactive (mid-term)<br />
This stage focuses on technologies that leverage prior investments and involves retrofit work. The aim<br />
is to begin the process of building <strong>Grid</strong> 2.0. The anticipated evolution from <strong>Grid</strong> 1.0 to <strong>Grid</strong> 2.0 is<br />
depicted in Figure 49 for a variety of grid characteristics. <strong>Grid</strong> 2.0 fully automates the energy delivery<br />
system across the entire value chain with increased interactions among smart grid devices, the utility,<br />
and customers. It has both “hard grid” assets (advanced energy storage, super-conducting equipment),<br />
and “soft grid” assets (next-generation computing and analytics systems) to glean the full value of the<br />
new grid for utility customers. Several documents, including <strong>Grid</strong> 2.0: The Next Generation (Willis,<br />
2006), suggest <strong>Grid</strong> 2.0 will be fully decentralized. By 2030, a highly interactive and hybrid grid will<br />
include large central resources and substantial decentralized supply and demand resources. This is<br />
analogous to 2011 hybrid information networks linking large centralized data centers, cloud<br />
computing, highly distributed personal computing, and smart phones.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 105
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Figure 49 - <strong>Grid</strong> 1.0 Evolution to <strong>Grid</strong> 2.0<br />
This renewed electric system will enable seamless integration of large renewable and distributed<br />
generation resources. It will also facilitate the integration of energy storage technologies to support<br />
state and federal legislation and policy goals such as greenhouse gas reductions, Renewable Portfolio<br />
Standard (RPS) and electric transportation initiatives. <strong>Grid</strong> 2.0 incorporates the next generation of<br />
broadband wireless and field area telecommunications technologies to support high speed, low latency<br />
information exchange among highly distributed devices. <strong>Smart</strong> grid efforts will merge advanced data<br />
analytics and intelligent systems into existing grid control systems, resulting in a complex system-ofsystems<br />
to provide integrated grid control and ubiquitous, real-time grid-state information. As a result,<br />
opportunities will emerge to reliably link customer demand response and other smaller distributed<br />
resources into wholesale market operations with the requisite ability to coordinate operational dispatch<br />
between wholesale market objectives and distribution grid objectives.<br />
Stage 4: The Intuitive and Transactive <strong>Grid</strong> (long-range)<br />
The 2030 decade will see continued deployment of <strong>Grid</strong> 2.0 capabilities across most utility systems and<br />
the introduction of highly distributed intelligent controls involving machine-to-machine transactions.<br />
This stage of the smart grid development roadmap assumes full convergence of information and<br />
energy systems, as well as continued breakthroughs in computing architectures, cyber-security,<br />
internet technologies, autonomous multi-agent control systems, artificial intelligence applied to electric<br />
system operations, wireless telecommunications, energy storage, power electronics, energy-smart<br />
consumer devices, consumer information technology and sensing technologies. Results should include<br />
wider deployments of distributed computing technologies for faster system response times, the<br />
integration of many more sensory and control nodes at the distribution and customer levels, and the<br />
ability to manage and precisely react to supply and demand imbalances at the micro level or through<br />
aggregation at any level or nodal point across the transmission and distribution grids.<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 106
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Maturity Model<br />
To move forward with a smart grid transformation, a utility should assess its current state and then<br />
define its own roadmap and strategy for achieving the desired functionalities. This section presents an<br />
industry-standard methodology to help utilities plan smart grid implementation, prioritize options,<br />
and measure progress.<br />
The <strong>Smart</strong> <strong>Grid</strong> Maturity Model (SGMM) was developed by electric power utilities for use by electric<br />
power utilities. It is under the stewardship of the Software Engineering Institute at Carnegie Mellon<br />
University. The SGMM is a framework for understanding the current state of smart grid deployment<br />
capabilities within an electric utility. It also serves as a context for establishing future strategies and<br />
work plans pertinent to smart grid implementations. The model is comprised of eight domains, each<br />
containing six levels of maturity.<br />
Implementation of a <strong>Smart</strong> <strong>Grid</strong> involves major technological transformations to enable seamless<br />
communications among grid components and systems to fulfill the required capabilities. Electric<br />
utilities’ executives and senior leaders must understand the potential impacts these technological<br />
transformations will have on their existing organizational structure. This is critical because:<br />
1. A typical utility ICT infrastructure is currently somewhere between The Silo <strong>Architecture</strong> and the<br />
Integration using Enterprise Services Buses in the range of System-of-Systems Design patterns<br />
(Appendix A),<br />
2. To satisfy long-term <strong>Smart</strong> <strong>Grid</strong> capabilities, a utility must move to an architecture allowing any<br />
system to interact with any other system, and<br />
3. Fundamental changes to how a utility operates are necessarily disruptive.<br />
Utilities can use their SGMM level assessment to start discussions among their functional domains on<br />
the potential organizational transformations needed to ensure <strong>Smart</strong> <strong>Grid</strong> success. It also provides a<br />
context for the new technologies in terms of prosumer energy control, and utility grid efficiency<br />
improvements for cost containment.<br />
For more information about the <strong>Smart</strong> <strong>Grid</strong> Maturity Model, the reader is encouraged to visit the<br />
Software Engineering Institute website: http://www.sei.cmu.edu/smartgrid<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 107
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NOTES<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Roadmap & Maturity Model<br />
Appendix • 108
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix E. Glossary of Terms<br />
The <strong>Smart</strong> <strong>Grid</strong> Today glossary (<strong>Smart</strong><strong>Grid</strong>Today) is an additional source for the quizzical reader,<br />
should any desired acronym or term not be in Table 27.<br />
Table 27 - Glossary<br />
Term<br />
Meaning<br />
1 GigE Gigabit Ethernet – see BEC<br />
AAA<br />
Authentication, Authorization, Accounting - acronym used in computer/information security to describe<br />
protocols supporting these attributes (RADIUS, Diameter, TACACS, etc.)<br />
AC<br />
Alternating Current – electric power in which the movement of electric charge periodically reverses<br />
direction. See DC.<br />
ACL<br />
Access Control List - typically a list of permissions attached to an object in a computer file system<br />
ADR<br />
Automated Demand Response - the ability to manage customer consumption of electricity in response to<br />
supply conditions<br />
AMI<br />
Advanced Metering Infrastructure - electric utility equipment needed to install, use, and manage <strong>Smart</strong><br />
Meter with real-time sensors, power outage notification, and power quality monitoring<br />
BAAM<br />
Behavioral Awareness and Monitoring - heuristics used to detect abnormal or threatening human<br />
behavior patterns<br />
BEC<br />
Gigabit Ethernet Channel – a communications channel for Gigabit Ethernet (GbE or 1 GigE) technologies<br />
for transmitting Ethernet frames at a rate of a gigabit per second<br />
BP<br />
Basic Profile - see WS-I BP<br />
BPEL<br />
Business Process Execution Language - an OASIS standard for specifying business process actions via web<br />
services. BPEL processes export and import information exclusively through web service interfaces (also<br />
known as WS-BPEL)<br />
BRE<br />
Business Rules Engine - a software system executing one or more business rules in an ICT production<br />
environment.<br />
CDM<br />
Canonical Data Model - a design pattern used to communicate between different data formats<br />
CEA<br />
Customer Experience Analytics - software used to identify and analyze customer behavior patterns within<br />
and across multiple access points.<br />
CEP<br />
Complex Event Processing - a computing technique used to process action messages from all<br />
organizational layers by identifying those most meaningful, analyzing their impact, and taking subsequent<br />
action in real time<br />
Choreography See Process Choreography<br />
CIM<br />
Common Information Model - an electric power industry standard officially adopted by the IEC to allow<br />
application software information exchange<br />
CIP<br />
Critical Infrastructure Protection - the preparedness and serious incident response involving the critical<br />
infrastructure of a region or nation<br />
CLI<br />
Command-line interface - provides interaction with software by typing commands to perform specific<br />
tasks (instead of WIMP - see GUI)<br />
Comms Communications – this substitution is widespread in casual conversation and technical writing<br />
COMTRADE COMmon format for TRAnsient Data Exchange for power systems - an IEEE file format for oscilloscope<br />
data.<br />
COTS<br />
Commercial Off-The-Shelf - computer systems developed and marketed by commercial software vendors<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 109
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
Meaning<br />
DA<br />
Distribution Automation – a broad set of capabilities in the utility distribution system, including control<br />
center-based SCADA, distribution management system, substation automation, primary and secondary<br />
network automation, associated smart controls, etc.<br />
DC<br />
Direct Current – electric power in which the electric charge flows in one direction. See AC.<br />
DER<br />
Distributed Energy Resource – a small energy source, typically producing power near where the power is<br />
used (very little power transmission or distribution between generator and power consumer)<br />
DMS<br />
Distribution Management System - a system used by electric utility grid operators to manage distribution<br />
system performance<br />
DNP3<br />
Distributed Network Protocol - communications protocol used between process automation components<br />
(used by SCADA systems)<br />
DoE<br />
U.S. Department of Energy - a Cabinet-level U.S. government department with executive authority on<br />
energy and nuclear material handling policies<br />
DR<br />
Distributed Resource – see DER<br />
DSM<br />
Demand Side Management - the modification of consumer demand for energy through financial<br />
incentives, education, electronic devices, and other means (also known as Energy Demand Management)<br />
EDI<br />
Electronic Data Interchange - the structured transmission of data between organizations by electronic<br />
means.<br />
EDM<br />
Energy Demand Management - see DSM<br />
EIM<br />
Enterprise Information Management - optimizes use of information within organizations, for instance to<br />
support decision-making or day-to-day operational processes requiring availability of knowledge by<br />
managing information on an enterprise level.<br />
EIS<br />
Executive Information System - a type of information system used to facilitate and support the decisionmaking<br />
needs of senior executives<br />
EMS<br />
Energy Management System - a system of computer-aided tools used by electric utility grid operators to<br />
manage generation/transmission system performance<br />
ESB<br />
Enterprise Service Bus - a software architecture construct with fundamental services for complex<br />
architectures via an event-driven and standards-based messaging engine<br />
ESM<br />
Enterprise Semantic Model - the logical representation of enterprise information assets used to manage<br />
or facilitate business processes.<br />
FACTS<br />
Flexible AC Transmission Systems – application of solid-state switches, coupled with capacitors, used to<br />
simultaneously regulate transmission voltages, fine-tune reactive power and remove noise from the AC<br />
signals. FACTS are important enablers of variable energy generators (wind, solar).<br />
FAN<br />
Field Area Network – a communications network typically with wide geographical coverage and low to<br />
medium bandwidth, depending on the needs of specific use cases<br />
FIPA<br />
Foundation for Intelligent Physical Agents - an IEEE standards organization developing and setting<br />
computer software standards for heterogeneous, interacting agents and agent-based systems<br />
FIPS<br />
Federal Information Processing Standards (FIPS) Publications - a series of documents for the U.S. Federal<br />
Publications government issued by NIST<br />
Firewall Device or set of devices controlling propagation of network transmissions based upon a rule set.<br />
FISMA Federal Information Security Management Act of 2002<br />
FLISR<br />
Fault Location, Isolation and Services Restoration<br />
GbE<br />
Gigabit Ethernet – see BEC<br />
GDA<br />
Generic Data Access - an IEC 61970-40X GID interface used for model management, access, and update<br />
distribution<br />
GES<br />
Generic Events and Subscriptions - an IEC 61970-40X GID interface used for pub/sub of generic XML<br />
messages<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 110
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
GID<br />
GOOSE<br />
<strong>Grid</strong> 2.0<br />
GSE<br />
GSSE<br />
GUI<br />
HAN<br />
HEC<br />
HSDA<br />
HVDC<br />
ICT<br />
IEC<br />
IED<br />
IEEE<br />
Internet<br />
IP<br />
IPS<br />
IRM<br />
IRM<br />
IT<br />
ITU-T<br />
IVR<br />
JPA<br />
JSON<br />
MAC<br />
Meaning<br />
Generic Interface Definition - a set of common services used for enterprise integration by utilities; part of<br />
IEC 61970 standard<br />
Generic Object Oriented Substation Events - control model mechanism to package any data format into a<br />
data set and transmit within 4 millisecond - one of two subdivisions of GSE<br />
See <strong>Smart</strong> <strong>Grid</strong><br />
Generic Substation Events - a control model defined by IEC 61850 providing a fast and reliable mechanism<br />
to transfer event data over entire substation networks<br />
Generic Substation State Events - an extension of event transfer mechanism exchanging only status data<br />
using a status list (string of bits) rather than a GOOSE dataset<br />
Graphical User Interface - allows interaction with an electronic device through the use of images (utilizes<br />
WIMP instead of CLI)<br />
Home Area Network - communications network for customer's home - see PAN<br />
HDMI Ethernet Channel – technology consolidating video, audio and data streams into a single HDMI<br />
cable<br />
High Speed Data Access - an IEC 61970-40X GID interface used for access to real-time measurement data<br />
High Voltage Direct Current – an electric transmission system using direct current for the bulk<br />
transmission of electrical power. Over long distances, HVDC is expected to be less expensive, with lower<br />
electrical losses compared to a similar alternating current system.<br />
Information and Communications Technology - an extended synonym for ICT stressing the role of unified<br />
communications in modern information technology<br />
International Electrotechnical Commission - a non-profit, non-governmental international standards<br />
organization which publishes International Standards for electrical and electronic technologies<br />
Intelligent Electronic Device - a microprocessor-based controller of power system equipment, such as<br />
circuit breakers, transformers, and capacitor banks.<br />
Institute of Electrical and Electronics Engineers - a non-profit professional association dedicated to<br />
advancing technological innovation related to electricity<br />
A global system of interconnected computer networks using IPS<br />
Internet Protocol - the principal communications protocol used for relaying packets across a network<br />
using the Internet Protocol Suite<br />
Internet Protocol Suite - the set of communications protocols used for the Internet and similar networks.<br />
Also known as TCP/IP, from two of the most important IPS protocols: the Transmission Control Protocol<br />
(TCP) and the Internet Protocol (IP)<br />
Interface <strong>Reference</strong> Model (IEC 61968-1) provides the framework for identifying information exchange<br />
requirements among utility business functions<br />
Institute of Risk Management - a leading international professional education and training body for risk<br />
management<br />
Information Technology - any microelectronics-based collection of computing and telecommunications<br />
capabilities designed to acquire, process and disseminate textual, numerical, and non-structured<br />
information. See ICT.<br />
Telecommunication Standardization Sector, part of the International Telecommunication Union (ITU)<br />
based in Geneva, Switzerland.<br />
Interactive Voice Response – technology allowing computer-human interaction through the use of voice<br />
and keypad inputs.<br />
Java Persistence API - a Java programming language framework managing relational data in applications<br />
JavaScript Object Notation – a lightweight data-interchange format<br />
Media Access Control Layer<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 111
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
Mashup<br />
ML<br />
MoM<br />
MOM<br />
MultiSpeak<br />
NERC<br />
NERC-CIP<br />
NETL<br />
NIST<br />
NISTIR 7628<br />
NRECA<br />
OASIS<br />
OFX<br />
OLAP<br />
OLTP<br />
OMG<br />
OMS<br />
OPC<br />
Orchestration<br />
OSGi<br />
OSI model<br />
P&C<br />
PAN<br />
PCC<br />
PHY<br />
PKI<br />
PLC<br />
PMI<br />
Meaning<br />
A web application that combines data and/or functionality from more than one source, sometimes called<br />
a web application hybrid<br />
Management Layer – one of four smart grid management types (Element, System, Services, <strong>Smart</strong> <strong>Grid</strong>)<br />
Manager of Managers – a smart grid construct to support distributed grid management services<br />
coordinated by a single component, called the Manager of Managers<br />
Message-Oriented Middleware – infrastructure used to send and receive messages between distributed<br />
systems.<br />
A specification defining standardized interfaces between software applications commonly used by electric<br />
utilities<br />
North American Electric Reliability Corporation - a nonprofit corporation promoting the reliability and<br />
adequacy of North American bulk power transmission<br />
See CIP<br />
National Energy Technology Laboratory - a science, technology, and energy laboratory operated by DoE<br />
National Institute of Standards and Technology - a measurement standards laboratory operated as a nonregulatory<br />
agency of the United States Department of Commerce<br />
Guidelines for <strong>Smart</strong> <strong>Grid</strong> Cyber Security issued in August 2010 as an Interagency report (NISTIR) by the<br />
United States Department of Commerce, National Institute of Standards and Technology (NIST)<br />
National Rural Electric Cooperative Association - an organization representing over 900 electric<br />
cooperatives in the United States<br />
Organization for the Advancement of Structured Information Standards - a global consortium supporting<br />
the adoption of e-business and web service standards<br />
Open Financial Exchange - a data-stream format for exchanging financial information<br />
On-Line Analytical Processing - a business intelligence approach used to swiftly answer multi-dimensional<br />
analytical queries<br />
On-Line Transaction Processing - a class of systems used to facilitate and manage transaction-oriented<br />
applications<br />
Object Management Group - a consortium focused on modeling programs, systems and business<br />
processes<br />
Outage Management System - a computer system used to restore power by operators of electric<br />
distribution systems<br />
OLE for Process Control - an open standard used by GID<br />
See Process Orchestration<br />
Open Services Gateway initiative - a Java service platform implementing a complete and dynamic<br />
component model, characterized by "bundles" of functionality<br />
Open Systems Interconnection model - a sub-division of network communications into seven smaller<br />
parts - each layer is a collection of similar functions providing services to the layer above it and receives<br />
services from the layer below it<br />
Production and Control<br />
Premises Area Network - communications network for grid customer, more generic than HAN<br />
Point of Common Coupling – see PoCC<br />
Physical Layer - the first and lowest layer in the seven-layer OSI model of computer networking.<br />
Public Key Infrastructure - the set of assets needed to create, use and manage digital certificates<br />
Programmable Logic Controller – a small industrial computer used to replace relay logic. A PLC is similar<br />
to RTU, but is typically easier to program. RTU and PLC technology are slowly merging. See RTU for detail.<br />
Privilege Management Infrastructure - supports a strong authorization system via the management and<br />
use of privileges<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 112
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
PMU<br />
PoCC<br />
PQ<br />
PQDIF<br />
Process<br />
Choreography<br />
Process<br />
Orchestration<br />
PubsFIPS<br />
QoS<br />
RBE<br />
RDF<br />
RMS<br />
RPC<br />
RPS<br />
RTU<br />
SAML<br />
SCA<br />
SCADA<br />
SCAP<br />
SDO<br />
SDO<br />
SED<br />
SEP-2<br />
Service<br />
Choreography<br />
Service<br />
Orchestration<br />
SGAC<br />
Meaning<br />
Phasor Measurement Unit - a device designed to measure the electrical waves on an electricity grid to<br />
determine the health of the system<br />
Point of Common Coupling – the place to which a collection of DER (DR) connects to the<br />
Power Quality - the set of electrical property limits allowing electrical systems to function in their<br />
intended manner without significant loss of performance or life.<br />
Power Quality Data Interchange Format - a binary file format (specified in IEEE Std 1159.3-2003) used to<br />
exchange voltage, current, power, and energy measurements between software applications<br />
A form of service composition in which interactions between partner services are defined globally. At runtime<br />
each participant executes according to other participant behaviors with no central control<br />
The process of coordinating an exchange of information through web service interaction. Orchestration<br />
typically is guided at runtime by a central control mechanism.<br />
See FIPS Publications<br />
Quality of Service - a computing mechanism providing different execution priority rankings to different<br />
computing objects (e.g. users, destinations, applications, data types, data flows). It also can be used to<br />
guarantee a certain level of performance to a data flow<br />
Report By Exception – information is transmitted only when a pre-defined threshold or condition is<br />
reached. RBE reduces communication traffic and subsequent data handling.<br />
Resource Description Framework - a general-purpose language for representing information in the Web.<br />
Root Mean Square - a measure of the magnitude of a varying signal<br />
Remote Procedure Call - an inter-process communication allowing software to cause the execution of a<br />
procedure in another address space without coding the remote interaction<br />
Renewable Portfolio Standard – a regulatory mandate to increase energy production from renewable<br />
energy sources (wind, solar, biomass, geothermal).<br />
Remote Terminal Unit or Remote Telemetry Unit – an electronic device interfacing field devices to a<br />
distributed control system (i.e. SCADA). Similar to PLC, but typically preferred where communications are<br />
difficult. RTU and PLC technology are slowly merging. See PCL for more detail.<br />
Security Assertion Markup Language - an XML-based open standard for exchanging authentication and<br />
authorization data between security domains<br />
Service Component <strong>Architecture</strong> - a programming model for building applications and solutions based on<br />
a Service Oriented <strong>Architecture</strong><br />
Supervisory Control And Data Acquisition - industrial control systems, computerized to monitor and<br />
control commercial and infrastructure processes<br />
<strong>Smart</strong> <strong>Grid</strong> Conceptual <strong>Architecture</strong> Project - the <strong>Smart</strong> <strong>Grid</strong> conceptual reference model for which the<br />
SGAC is responsible<br />
Service Data Objects - a technology allowing heterogeneous data to be accessed in a uniform way.<br />
Standard Developing Organization - an organization with the scope of establishing national, regional or<br />
international engineering standards<br />
<strong>Smart</strong> Electronic Device – used interchangeably with IED (Intelligent Electronic Device)<br />
<strong>Smart</strong> Energy Profile 2.0 - an open standard for implementing secure, easy-to-use wireless home area<br />
networks to manage energy consumption<br />
See Process Choreography<br />
See Process Orchestration<br />
<strong>Smart</strong> <strong>Grid</strong> <strong>Architecture</strong> Committee - responsible to the SGIP for creating and refining a <strong>Smart</strong> <strong>Grid</strong><br />
conceptual reference model, including lists of the standards and profiles necessary to implement the<br />
vision of the <strong>Smart</strong> <strong>Grid</strong><br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 113
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
SGIP<br />
SGMM<br />
SIP<br />
SLA<br />
<strong>Smart</strong> <strong>Grid</strong><br />
SOA<br />
SOAP<br />
SoS<br />
SQL<br />
SSL<br />
SSO<br />
SSO<br />
STATCOM<br />
THD<br />
TLS<br />
TSDA<br />
UDDI<br />
UN/EDIFACT<br />
VAR<br />
VOIP<br />
Volt/VAR<br />
VPN<br />
VPP<br />
W3C<br />
WAN<br />
Web<br />
Web 2.0<br />
Web Service<br />
Meaning<br />
<strong>Smart</strong> <strong>Grid</strong> Interoperability Panel - a stakeholder organization administered under a NIST contract to<br />
identify, prioritize and address new and emerging requirements for <strong>Smart</strong> <strong>Grid</strong> standards<br />
<strong>Smart</strong> <strong>Grid</strong> Maturity Model – a management tool used to help plan a smart grid implementation,<br />
prioritize options, and measure progress (maintained by the Software Engineering Institute at Carnegie<br />
Mellon University)<br />
Session Initiation Protocol - an IETF-defined signaling protocol used to control multimedia communication<br />
sessions (VOIP, etc.)<br />
Service Level Agreement – a service contract formally defining expectations, usually based on response<br />
times, between a customer and a service provider.<br />
A utility power distribution grid enabled with computer technology and two-way digital communications<br />
networking.<br />
Service-oriented architecture - a set of design principles aimed toward packaging functionality as a suite<br />
of interoperable services, residing in multiple systems, and usable by many business domains<br />
Simple Object Access Protocol - a protocol specification for exchanging structured information via web<br />
services<br />
System of Systems - a collection of task-oriented or dedicated systems with pooled resources and<br />
capabilities to create a more complex 'meta-system' offering more functionality and performance than<br />
the sum of the constituent systems<br />
Structured Query Language - a database computer language designed for managing data in relational<br />
database management systems (RDBMS), and originally based upon relational algebra and calculus<br />
Secure Sockets Layer - a network protocol succeeded by Transport Layer Security (TLS)<br />
Single Sign On - a property of access control of multiple related, but independent software systems<br />
allowing a user to log in once and gain access to all systems without additional log in prompts<br />
Standards Setting Organization - an organization promulgating or maintaining standards<br />
Static Synchronous Compensator – a regulating device on AC electricity transmission networks, acting as a<br />
source or sink of reactive AC power on the electrical network. See FACTS.<br />
Total Harmonic Distortion - an inverse measurement of the fidelity of a signal to its source<br />
Transport Layer Security - a network protocol and successor to Secure Sockets Layer (SSL)<br />
Time Series Data Access - an IEC 61970-40X GID interface used for access to historical measurement data<br />
Universal Description, Discovery and Integration - a platform-independent, XML-based registry for<br />
businesses to be listed on the Internet, including a mechanism to register and locate web service<br />
applications<br />
United Nations/Electronic Data Interchange For Administration, Commerce and Transport - an<br />
international EDI standard<br />
Volt-Ampere Reactive - a unit used to measure reactive power in an AC electric power system<br />
Voice Over Internet Protocol - technology used for the delivery of voice communications and multimedia<br />
sessions over an Internet Protocol network<br />
Used to express the need for careful management of the interaction between voltage and VAR control.<br />
Virtual Private Network<br />
Virtual Power Plant – a collection of distributed generation managed by a central entity (aggregator)<br />
World Wide Web Consortium - an international standards organization for the World Wide Web<br />
Wide Area Network<br />
See WWW<br />
A loosely defined set of web applications characterized by collaboration, user-defined design,<br />
participatory information sharing, and standards-based interoperability<br />
Software designed to support interoperable machine-to-machine interaction over a network<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 114
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Term<br />
WIMP<br />
WS-BPEL<br />
WSDL<br />
WS-I BP<br />
WWW<br />
XML<br />
XSD<br />
Meaning<br />
Window, Icon, Menu, Pointing device - see GUI<br />
Web Services Business Process Execution Language - see BPEL<br />
Web Services Description Language - an XML-based construct used to characterize web services T<br />
Web Services Interoperability Basic Profile - a specification providing interoperability guidance for core<br />
Web Services specifications such as SOAP, WSDL, and UDDI.<br />
World Wide Web - a system of interlinked hypertext documents accessed via the Internet<br />
eXtensible Markup Language - a set of rules for encoding documents in machine-readable form<br />
XML Schema Definition - a set of rules to which a valid XML document must conform<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 115
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
NOTES<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Glossary of Terms<br />
Appendix • 116
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
Appendix F. Bibliography<br />
ARRA. (n.d.). American Recovery and Reinvestment Act of 2009. Retrieved March 2011, from Recovery.gov -<br />
Track the Money: http://www.recovery.gov/About/Pages/The_Act.aspx<br />
GWAC. (2008, March). Publications. Retrieved March 2011, from <strong>Grid</strong>Wise® <strong>Architecture</strong> Council:<br />
http://www.gridwiseac.org/about/publications.aspx<br />
IEC. (2003). IEC 61968-1 - Application integration at electric utilities - System Interfaces for distribution<br />
management - Part 1: Interface architecture and general requirements (Preview). Retrieved 2011, from<br />
International Electrotechnical Commission Webstore: http://webstore.iec.ch/preview/info_iec61968-<br />
1%7Bed1.0%7Den.pdf<br />
IEC. (2005). 61970-1 - Energy management system application program interface (EMS-API) - Part 1: Guidelines<br />
and general requirements (Preview). Retrieved March 2011, from International Electrotechnical<br />
Commission Webstore: http://webstore.iec.ch/preview/info_iec61970-1%7Bed1.0%7Db.pdf<br />
IEEE. (n.d.). 2030 <strong>Smart</strong> <strong>Grid</strong> Interoperability Series of Standards. Retrieved March 2011, from IEEE Standards<br />
Association: http://grouper.ieee.org/groups/scc21/dr_shared/2030/<br />
NAE. (2011). Electrification. Retrieved March 2011, from Greatest Engineering Achievements of the 20th<br />
Century: http://www.greatachievements.org/?id=2949<br />
NETL. (2007, January). <strong>Smart</strong> <strong>Grid</strong> Implementation Strategy (SGIS) - <strong>Reference</strong> Shelf. Retrieved March 2011, from<br />
NETL - the Energy lab - Where energy challenges converge and energy solutions emerge:<br />
http://www.netl.doe.gov/smartgrid/refshelf.html#White%20Papers<br />
NIST. (2010, January). NIST Framework and Roadmap for <strong>Smart</strong> <strong>Grid</strong> Interoperability Standards, Release 1.0.<br />
Retrieved March 2011, from National Institute of Standards and Technology:<br />
http://www.nist.gov/public_affairs/releases/upload/smartgrid_interoperability_final.pdf<br />
NIST. (2010, January). <strong>Smart</strong> <strong>Grid</strong>. Retrieved March 2011, from National Institute of Standards and Technology:<br />
http://www.nist.gov/smartgrid/index.cfm<br />
NIST-ITL. (2010, September). NIST - Computer Security Division - Computer Security Resource Center. Retrieved<br />
March 2011, from National Institute of Standards and Technology:<br />
http://csrc.nist.gov/publications/PubsNISTIRs.html<br />
SGIP SGAC. (n.d.). SGAC Conceptual <strong>Architecture</strong> Working Party. Retrieved March 2011, from SGiP - NIST <strong>Smart</strong><br />
<strong>Grid</strong> Collaboration Site: http://collaborate.nist.gov/twikisggrid/bin/view/<strong>Smart</strong><strong>Grid</strong>/SGIPConceptual<strong>Architecture</strong>DevelopmentSGAC<br />
SGMM. (n.d.). <strong>Smart</strong> <strong>Grid</strong> Maturity Model. Retrieved March 2011, from Software Engineering Institute |<br />
Carnegie Mellon: http://www.sei.cmu.edu/smartgrid/<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Bibliography<br />
Appendix • 117
<strong>Smart</strong> <strong>Grid</strong> <strong>Reference</strong> <strong>Architecture</strong><br />
<strong>Smart</strong><strong>Grid</strong>Today. (n.d.). Glossary of Terms and Abbreviations. Retrieved March 2011, from <strong>Smart</strong> <strong>Grid</strong> Today |<br />
The Worldwide Daily Journal of the Modern Utility Industry:<br />
http://www.smartgridtoday.com/public/department40.cfm<br />
Southern California Edison. (2010). <strong>Smart</strong> <strong>Grid</strong> Strategy and Roadmap. Retrieved March 2011, from Southern<br />
California Edison: http://asset.sce.com/Documents/Environment%20-<br />
%20<strong>Smart</strong>%20<strong>Grid</strong>/100712_SCE_<strong>Smart</strong><strong>Grid</strong>StrategyandRoadmap.pdf<br />
van Breeman, A. J. (2001). Agent-Based Multi-Controller Systems. Retrieved March 2011, from University of<br />
Twente: http://www.ub.utwente.nl/webdocs/el/1/t000001c.pdf<br />
White, A., Comport, J., & Schlier, F. W. (2005, January 17). Enterprise Information Management Is a Core<br />
Element of Your IT <strong>Architecture</strong>.<br />
Willis, R. (2006). <strong>Grid</strong> 2.0: The next generation. Retrieved March 2011, from Rebecca Willis:<br />
http://www.rebeccawillis.co.uk/downloads/<strong>Grid</strong>20TheNextGeneration.pdf<br />
© Copyright Cisco Systems, Inc., International Business Machines Corporation, Southern California Edison Company 2011 - All rights reserved.<br />
Bibliography<br />
Appendix • 118