IntelliGrid Architecture

Intra-Control Center Environment - #7

This environment represents communications between modules of a single control center, typically over a local area network within a single physical building.

Typical Applications: Updating databases and human-machine interfaces with data gathered from the “front-end processors” within Energy Management Systems (EMSs) or Distribution Management Systems (DMSs).

Characteristics:  Located in a very secure and reliable physical environment, but with a huge amount of data to manage and distribute between a variety of platforms and database technologies.  Updates must happen in at least human response times for some data.

Similar Environments: This environment carries ALL the data brought in via High Security DAC or Low Security DAC, but need not be transmitted in as reliable a format.  Carries similar types of data as when the control center communicates with other businesses (CC/ESP, CC/Customer Equipment, or CC/corporations).  However, the real-time requirements are tighter, security is nowhere near as important, and data formats tend to be proprietary for performance reasons. 

Definition:  This environment is defined by the following requirements:

.

Communication and Information Requirements that Define this Environment

Configuration Requirements

• Support peer to peer interactions
• Support interactions within a contained environment (e.g. substation or control center)

Quality of Service Requirements

• Support high availability of information flows of 99.9+ (~9 hours)
• Support time synchronization of data for age and time-skew information

Security Requirements

• Provide Authorization Service for Access Control (resolving a policy-based access control decision to ensure authorized entities have appropriate access rights and authorized access is not denied)
• Provide Audit Service (responsible for producing records, which track security relevant events)
• Provide Security Policy Service (concerned with the management of security policies)
• Provide User Profile and User Management (combination of several other security services)

Network and System Management Requirements

• Provide Network Management (management of media, transport, and communication nodes)
• Provide System Management (management of end devices and applications)

Data Management Requirements

• Support the management of large volumes of data flows
• Support keeping the data up-to-date
• Support extensive data validation procedures
• Support keeping data consistent and synchronized across systems and/or databases
• Support timely access to data by multiple different users
• Support frequent changes in types of data exchanged
• Support management of data whose types can vary significantly in different implementations
• Support specific standardized or de facto object models of data
• Support the exchange of unstructured or special-format data (e.g. text, documents, oscillographic data)
• Provide discovery service (discovering available services and their characteristics)
• Provide conversion and protocol mapping

Recommended Technologies

Energy Industry-Specific Technologies

    Utility Field Device Related Data Exchange Technologies

• IEC61850 Part 6 - Substation Configuration Language - Network Management, Data Management

    Utility Control Center Related Data Management Technologies

• IEC 60870-6 (ICCP) - Configuration,
• IEC 61970 Part 3 - Common Information Model (CIM) - Data Management
• CIM Extensions for Market Operations - Data Management
• IEC 61970 Part 4 - Generic Interface Definition (GID) - Configuration, Quality of Service, Data Management
• IEC61968 SIDM System Interfaces for Distribution Management - Data Management
• OPEN GIS - Data Management

Communications Industry Technologies

    Access Technologies

• Private Intranet - Configuration,

    Networking Technologies

• Internet Protocol Version V4 (IPV4) - Configuration,

    IP-based Transport Protocols

• Transmission Control Protocol (TCP) - Configuration,

    Application Layer Protocols

• SNTP (Network Time Protocol) - Quality of Service, Data Management

    Link Layer and Physical Technologies

• IEEE 802 MAC Addresses - Configuration,
• Asynchronous Transfer Mode (ATM) - Configuration,

    Wireless Technologies

• Global Positioning System (GPS) - Quality of Service, Data Management

    Computer Systems Related Technologies

• CORBA and CORBA Services - Data Management
• Web Services - Data Management
• Universal Description, Discovery, and Integration (UDDI) - Data Management
• XML Protocol/Simple Object Access Protocol (SOAP) - Data Management
• Enterprise Java Beans (EJB) - Data Management
• IEEE 1588 Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems - Quality of Service,
• GUID - Data Management

    General Internet and De Facto Data Management Technologies

• ANSI/ISO/IEC 8632-1, 2, 3, 4 - Computer Graphics Metafile (CGM) - Data Management
• ISO/IEC 11179 Parts 1 - 6 Metadata Registries - Data Management
• Meta Object Facility (MOF) - Data Management
• XML Metadata Interchange (XMI) - Data Management
• eXtensible Markup Language (XML) - Data Management
• XML Schema (xls) - Data Management
• XSLT - Data Management
• XQuery - Data Management
• ANSI/ISO/IEC 9075 - Structured Query Language (SQL) - Data Management

Security Technologies

    Policy and Framework Related Technologies

• ISO/IEC 10164-8:1993 Security Audit Trail Function - Information technology - Open Systems Interconnection - Systems Management - Security,
• ISO/IEC 18014-1:2002 Time-Stamping Services - Information technology - Security Techniques - Part 1: Framework - Quality of Service, Security, Data Management
• ISO/IEC 10181-7:1996 Security Audit and Alarms Framework - Information technology - Open Systems Interconnection -- Security Frameworks for Open Systems - Security,
• FIPS PUB 112 Password Usage - Security,
• FIPS PUB 113 Computer Data Authentication - Security,
• RFC 2196 Site Security Handbook - Security,
• RFC 2401 Security Architecture for the Internet Protocol - Security,
• RFC 2527 Internet X.509 Public Key Infrastructure Certificate Policy and Certification Practices Framework - Security,

    General Security Technologies

• Role-Based Access Control - Security,
• Intrusion Detection Technologies - Security, Network Management,
• Intrusion Prevention Systems (IPS) - Security, Network Management,
• Service Level Agreements (SLA) - Security,

    Media and Network Layer Technologies

• Secure IP Architecture (IPSec) - Security,
• IEEE 802.11i Security for Wireless Networks - Security,
• Remote Authentication Dial In User Service (RADIUS) - Security,
• AGA-12 Cryptographic Protection of SCADA Communications General Recommendations - Security,

    Transport Layer Security Technologies

• Transport Layer Security (TLS)/Secure Sockets Layer (SSL) - Security,

    Application Layer Security Technologies

• SNMP Security - Security, Network Management,
• RFC 1305 Network Time Protocol (Version 3) Specification, Implementation - Quality of Service, Security, Data Management
• IEC 62351-4 Security for Profiles including MMS (ISO-9506) - Security,
• IEC 62351-5 Security for IEC 60870-5 and Derivatives - Security,
• IEC 62351-6 Security for IEC 61850 GOOSE, GSSE, and SMV Profiles - Security,

    XML Related Technologies

• OASIS Security Assertion Markup Language (SAML) - Security,
• Secure XML - Security,

Network and Enterprise Management Technologies

    Network Management Technologies

• Simple Network Management Protocol (SNMP) - Network Management,

    Web-based Network Management

• Web-based Enterprise Management (WBEM) - Network Management,

 

---

Recommended Common Services

Security Services

    Common Security Services

• Audit Common Service - Security,
• Authorization for Access Control - Security,
• Security Policies - Security,
• User and Group Management - Security,

Network and System Management Services

    Enterprise Management Services

• Inventory Management - Network Management,
• Communication System/Network Discovery - Network Management,
• Routing Management - Network Management,
• Traffic Management - Network Management,
• Traffic Engineering - Network Management,
• System/Network Health-Check Analysis - Network Management,
• System/Network Fault Diagnosis - Network Management,
• System/Network Fault Correcting - Network Management,
• Service Level Agreement (SLA) Determination and Maintenance - Network Management,
• System/Network Performance Analysis - Network Management,
• System/Network Performance Diagnosis - Network Management,
• Performance Tuning/Correction - Network Management,
• Accounting and/or Billing - Network Management,

Data Management Common Services

    Data Management Common Services

• Distributed Data Management Service - Data Management
• Object Management Service - Data Management
• Address and Naming Management - Network Management, Data Management
• Generic Eventing And Subscription - Network Management, Data Management
• Alarm Detection/Reporting - Network Management, Data Management
• Instrumentation and Monitoring Service - Network Management, Data Management
• Measurement Data Logging Service - Security, Network Management,
• Remote Control - Network Management,
• Network Time - Data Management
• File Transfer - Data Management

Common Platform Services

    Common Platform Services

• Component Registry Service - Data Management
• Component Lookup Service - Data Management
• Component Discovery Service - Data Management
• Component Initialization and Termination - Network Management,
• Resource Management - Network Management,
• Checkpoint and Recovery - Network Management,
• Workflow Service - Network Management,

 

---

Recommended Best Practices

Data Management Best Practices

    Data Management

• Backup Data Sources - Quality of Service,
• Backup Databases - Quality of Service,
• Metadata Files and Databases - Network Management, Data Management
• Object Modeling Techniques - Data Management
• Quality Flagging - Quality of Service, Network Management, Data Management
• Time Stamping - Quality of Service, Security, Network Management, Data Management
• Validation of Source Data and Data Exchanges - Data Management
• Data Update Management - Data Management
• Management of Time-Sensitive Data Flows and Timely Access to Data by Multiple Different Users - Quality of Service, Data Management
• Management of Data Consistency and Synchronization across Systems - Data Management
• Management of Data and Object Naming - Data Management
• Management of Data Formats in Data Exchanges - Data Management
• Management of Data Accuracy - Data Management
• Management of Data Acquisition - Data Management
• Management of Manual Data Entry - Data Management
• Data Storage and Access Management - Data Management
• Data Consistency across Multiple Systems - Data Management
• Database Maintenance Management - Data Management
• Data Backup and Logging - Quality of Service, Security, Data Management
• Application Management - Network Management,

Security Best Practices

    Security Frameworks and Policy Documents

• ISO/IEC Security Best Practices - Security,
• ISO/IEC 10164-8:1993 Information technology -- Open Systems Interconnection -- Systems Management: Security audit trail function - Quality of Service, Data Management
• ISO/IEC 18014-1:2002 Information technology -- Security techniques -- Time-stamping services -- Part 1: Framework - Quality of Service,
• ISO/IEC 18014-2:2002 Information technology -- Security techniques -- Time-stamping services -- Part 2: Mechanisms producing independent tokens - Quality of Service,
• ISO/IEC 18014-3:2004 Information technology -- Security techniques -- Time-stamping services -- Part 3: Mechanisms producing linked tokens - Security,
• Federal Security Best Practices - Security,
• CICSI 6731.01 Global Command and Control System Security Policy - Security,
• IETF Security Best Practices Internet Requests for Comments (RFCs) - Network Management,
• RFC 1102 Policy routing in Internet protocols - Network Management,
• RFC 1322 A Unified Approach to Inter-Domain Routing - Network Management,
• RFC 1351 SNMP Administrative Model - Network Management,
• RFC 2008 Implications of Various Address Allocation Policies for Internet Routing - Network Management,
• RFC 2196 Site Security Handbook - Network Management,
• RFC 2276 Architectural Principles of Uniform Resource Name Resolution - Security,
• RFC 2386 A Framework for QoS-based Routing in the Internet - Network Management,
• RFC 2518 HTTP Extensions for Distributed Authoring - WEBDAV - Network Management,
• RFC 2527 Internet X.509 Public Key Infrastructure Certificate Policy and Certification Practices Framework - Network Management,

Security Technology Documents

Alternative Technologies

    Utility Field Device Related Data Exchange Technologies

• C37.111-1999 IEEE COMTRADE Standard (Common Format for Transient Data Exchange) for Power Systems - Data Management
• IEEE 1159.3 - Power Quality Data Interchange Format (PQDIF) - Data Management

    Utility Control Center Related Data Management Technologies

• MultiSpeak - Data Management

    Networking Technologies

• Internet Protocol Version 6 (IPV6) - Configuration,
• Open Shortest Path First (OSPF) Routing Protocol - Configuration,
• Border Gateway Protocol (BGP) - Configuration,
• Internet Group Management Protocol (IGMP) - Configuration,
• Distance Vector Multicast Routing Protocol (DVMRP) - Configuration,
• Multicast Open Shortest Path (MOSPF) routing protocol - Configuration,
• Protocol Independent Multicast-Sparse Mode (PIM-SM) - Configuration,
• Core-Based Tree (CBT) multicast routing - Configuration,

    Application Layer Protocols

• Microsoft COM+ - Data Management

    Link Layer and Physical Technologies

• IEEE 802.1d Spanning Tree Protocol (STP) - Network Management,
• IEEE 802.1w Rapid Spanning Tree Protocol (RSTP) - Network Management,
• Hubs/Repeaters - Configuration,
• Bridges/Switches - Configuration,
• Routers - Configuration,

    Wireless Technologies

• IEEE 802.11 Wireless Local Area Network (WLAN) - Configuration,
• IEEE 802.15 Wireless Personal Area Network (PAN) - Configuration,
• Bluetooth Special - Configuration,
• Radio Frequency Identification (RFID) - Data Management

    Computer Systems Related Technologies

• Web Services Description Language (WSDL) - Data Management

    General Internet and De Facto Data Management Technologies

• Common Warehouse Model (CWM) - Data Management
• American Standard Code for Information Interchange (ASCII) - Data Management
• Hypertext Markup Language (HTML) - Data Management
• RDF - Data Management

    eCommerce Related Data Management Technologies

• EAN.UCC Identification Numbers - Data Management
• EAN.UCC Universal Bar Codes - Data Management
• 10303 Standard Exchange for Product Data (STEP) - Data Management

    Network Management Technologies

• Remote Network Monitor (RMON) - Network Management,
• OSI Network Management Model - Network Management,

    Web-based Network Management

• Policy-based Management Technologies - Network Management,

Alternative Best Practices

    Data Management

• Backup Sites - Quality of Service,

    ISO/IEC Documents on Security Technologies

• ISO/IEC 7816-9:2000 Identification cards -- Integrated circuit(s) cards with contacts -- Part 9: Additional - Security,
• ISO 9735-5:2002 Electronic data interchange for administration, commerce and transport (EDIFACT) -- Application level syntax rules (Syntax version number: 4, Syntax release number: 1) -- Part 5: Security rul - Security,
• ISO/IEC 10164-9:1995 Information technology -- Open Systems Interconnection -- Systems Management: Objects and attributes for access control - Security,
• ISO/IEC 10181-1:1996 Information technology -- Open Systems Interconnection -- Security frameworks for open systems: Overview - Security,
• ISO/IEC 10181-3:1996 Information technology -- Open Systems Interconnection -- Security frameworks for open systems: Access control framework - Security,
• ISO/IEC TR 13335-1:1996 Information technology -- Guidelines for the management of IT Security -- Part 1: Concepts and models for IT Security - Security,
• ISO/IEC TR 13335-2:1997 Information technology -- Guidelines for the management of IT Security -- Part 2: Managing and planning IT Security - Security,
• ISO/IEC TR 13335-5 Information technology - Guidelines for the management of IT Security - Part 5: Management guidance on network security - Security,
• ISO/IEC 15408-1:1999 Information technology -- Security techniques -- Evaluation criteria for IT security -- Part 1: Introduction and general mode - Security,
• ISO/IEC 15408-2:1999 Information technology -- Security techniques -- Evaluation criteria for IT security -- Part 2: Security functional requirements - Security,
• ISO/IEC 17799:2000 Information technology -- Code of practice for information security management - Security,

    IETF Internet Requests for Comments (RFCs) on Security Technologies

• RFC 1305 Network Time Protocol (Version 3) Specification, Implementation - Quality of Service,
• RFC 1352 SNMP Security Protocols - Network Management,
• RFC 1940 Source Demand Routing: Packet Format and Forwarding Specification (Version 1) - Network Management,
• RFC 2086 IMAP4 ACL extension - Security,
• RFC 2093 Group Key Management Protocol (GKMP) Specification - Security,
• RFC 2230 Key Exchange Delegation Record for the DNS - Security,
• RFC 2244 ACAP -- Application Configuration Access Protocol - Security,
• RFC 2246 The TLS Protocol Version 1.0 - Security,
• RFC 2547 BGP/MPLS VPNs - Network Management,
• RFC 2764 A Framework for IP Based Virtual Private Networks - Network Management,
• RFC 2753 A Framework for Policy-based Admission Control - Security,
• RFC 2797 Certificate Management Messages over CMS - Security,
• RFC 2898 PKCS #5: Password-Based Cryptography Specification Version 2.0 - Security,
• RFC 2977 Mobile IP Authentication, Authorization, and Accounting Requirements - Security,
• RFC 3053 IPv6 Tunnel Broker - Network Management,
• RFC 3280 Algorithms and Identifiers for the Internet X.509 Public Key Infrastructure Certificate and Certificate Revocation List (CRL) Profile - Security,
• RFC 3414 User-based Security Model (USM) for version 3 of the Simple Network Management Protocol (SNMPv3) - Network Management,
• RFC 3647 Internet X.509 Public Key Infrastructure Certificate Policy and Certification Practices Framework - Security,

    Other Security Technolog

• IEEE 802.11b Web Encryption Protocol - Security,
• IEEE 802.11i Security for Wireless Networks - Security,
• RSA PKCS #12 Personal Information Exchange Syntax Standard, version 1.0. - Security,
• OASIS Documents on Security Technologies - Security,
• WC3 XML Key Management Specification (XKMS 2.0) Bindings - Security,
• ANSI INCITS 359-2004 Role Based Access Control (RBAC) - Security,
• EPRI 1002596 ICCP TASE.2 Security Enhancements - Security,
• NERC Certificate Policy for the Energy Market Access and Reliability Certificate (e MARC) Program Version 2.4 - Security,
• WebDAV Access Control Extensions to WebDAV - Security,
• WPA WI-FI Protected Access - Security,
• WPA2 WI-FI Protected Access Version 2 - Security,

Possible Technologies

    Networking Technologies

• Intermediate System to Intermediate System (ISIS) Routing Protocol - Configuration,
• Routing Information Protocol (RIP) - Configuration,

    Application Layer Protocols

• CSV files - Data Management