download as a pdf - Southern California Coastal Ocean Observing ...

More documents

Recommendations

Info

Part III. Appendix 2: Data TransportContentsIntroduction ....................................................................................................................................141Interoperability, Flexibility, and Urgency .....................................................................................141The Layered (or Modular) Approach ............................................................................................142A Process for Designing and Implementing the IOOS Data Transport System .........................144Charge to the Working Group/Bounds of theProblem to be Addressed .................................................................................................148General Charge to the Group ........................................................................................................148Basic assumptions ..........................................................................................................................148General Description of IOOS Data Transport System Needs andImplementation Considerations .....................................................................................150Basic Requirements ........................................................................................................................150Implementation Considerations ...................................................................................................152Functional Requirements ..............................................................................................................153Implementing the IOOS Data Transport System .........................................................159The Data Access Protocol ..............................................................................................................159Development Efforts and Pilot Projects .......................................................................................160Annex A: The Intersection of Data Transport and Metadata ...............................167The Three-Tiered Data System ......................................................................................................167Syntactic Metadata and the Data/Metadata Transport Protocol .................................................169Semantic Metadata .........................................................................................................................170Annex B: Overview of Existing Systems ........................................................................170OPeNDAP/NVODS .......................................................................................................................170OBIS (Ocean Biogeographic Information System) ......................................................................173OGC/OGIS .....................................................................................................................................175Data Exchange Infrastructure (DEI) and the Field Spatial Data Model (FSDM) ......................176SRB .................................................................................................................................................178Contributions of Existing Systems to the Mature IOOS Data Transport System ......................179Annex C: OPeNDAP/NVODS .................................................................................................185The OPeNDAP data model ...........................................................................................................185Queries to a Server .........................................................................................................................186Functionalities of OPeNDAP/NVODS .........................................................................................189Annex D: OpenGIS Basic Service Model Review ........................................................192Introduction ...................................................................................................................................192OpenGIS Organizational Structure ..............................................................................................192OGC Basic Services Model (0.0.8) ................................................................................................193Interoperability Approach .............................................................................................................194140
Part III. Appendix 2: Data TransportIntroductionThe fundamental objective of the IOOS Data Transport System is machine-to-machine interoperabilitywith semantic meaning in a highly distributed environment of heterogeneous data sets.IOOS users will be able to summon and analyze fresh and archived data using both familiar andnew tools when the data transport component operates in concert with other elements of IOOS.INTEROPERABILITY, FLEXIBILITY, AND URGENCYMachine-to-machine interoperability with semantic meaning allows data to be exchanged betweencomputers without human intervention. For example, consider a would-be user of the envisionedinteroperable IOOS data system who is interested in the relationship between red tide occurrenceand wind speeds above a given threshold. Such a user, working within a computing environmentfamiliar to him or her, would request all red tide data for which there is a wind observation bothexceeding the given threshold and located within a specified distance and time of a red tide observation;the system would return observation pairs to the user’s environment without further inputfrom the user.For this to occur, all computers involved in such a transaction must be capable of determining boththe syntax and the semantics of the exchanged data. Thus, in order to fulfill the request for red tidedata, certain basic information has to be associated with each observation—variable name, units,location, and time. With this information, plus knowledge of the organization of the data and adirectory of data sets, all the syntactic 1 and semantic 2 information necessary to meet the request isavailable.This suite of syntactic and semantic information might not be sufficient to fulfill a more intricaterequest, however. For example, if a user were to ask for the averages of all red tide observationstouching, say, one degree squares, then additional semantic information might be required to properlyaverage data from different sources: it might be necessary to know the uncertainty of an observationor the size of the area over which it was made. The point here is that while the syntacticinformation needed to satisfy a variety of requests in a distributed system of heterogeneous data remainsthe same, the semantic information needed to meet different requests is quite likely to vary.The foregoing example illustrates some of the functionality of a data management and communicationsystem that exhibits machine-to-machine interoperability with semantic meaning.1Syntactic metadata is information about the data types and structures at the computer level, the syntax of the data, for example,variable T represents a floating point array measuring 20 by 40 elements.2Semantic metadata are what one normally thinks of as metadata—information about the contents of the data set.141
Page 1 and 2:
Data Management and Communications
Page 3 and 4:
Data Management and Communications
Page 8 and 9:
Table of Contents
Page 10 and 11:
GlossaryLAS ..................Live
Page 12 and 13:
Executive Summary2
Page 14 and 15:
Executive SummaryTECHNICAL ANALYSIS
Page 16 and 17:
Executive SummaryDMAC Metadata will
Page 18 and 19:
Executive SummaryCOSTSThe cost esti
Page 20 and 21:
Part I. OverviewContentsPreface ...
Page 22 and 23:
Part I. OverviewIOOS - Enhancements
Page 24 and 25:
Part I. Overviewing processes descr
Page 26 and 27:
Part I. OverviewTHE VISIONIOOS is e
Page 28 and 29:
Part I. Overview3. Heterogeneous da
Page 30 and 31:
Part I. OverviewOne of these coordi
Page 32 and 33:
Part I. OverviewIOOS Data Communica
Page 34 and 35:
Part I. OverviewTHE DMAC SUBSYSTEM
Page 36 and 37:
Part I. OverviewData Transport(see
Page 38 and 39:
Part I. OverviewTable 1. Near-term
Page 40 and 41:
Part I. Overviewdata and taxonomies
Page 42 and 43:
Part I. OverviewFigure 2. The Archi
Page 44 and 45:
Part I. Overview• All data collec
Page 46 and 47:
Part I. OverviewSection 3. Manageme
Page 48 and 49:
Part I. Overviewthough documented a
Page 50 and 51:
Part I. Overviewthis “spiral” u
Page 52 and 53:
Part I. OverviewTable 3. DMAC Overa
Page 54 and 55:
Part I. Overview• Program Initial
Page 56 and 57:
Part I. OverviewOutcome 3: Agreemen
Page 58 and 59:
Part I. OverviewCONCRETE GUIDANCE T
Page 60 and 61:
Part I. Overview- Notify the Nation
Page 62 and 63:
Part II. Phased Implementation Plan
Page 64 and 65:
Page 66 and 67:
Page 68 and 69:
Page 70 and 71:
Page 72 and 73:
Page 74 and 75:
Page 76 and 77:
Page 78 and 79:
Page 80 and 81:
Page 82 and 83:
Page 84 and 85:
Page 86 and 87:
Page 88 and 89:
Page 90 and 91:
Page 92 and 93:
Page 94 and 95:
Page 96 and 97:
Page 98 and 99:
Page 100 and 101: Part II. Phased Implementation Plan
Page 124 and 125: Part III. Appendix 1: Metadata and
Page 152 and 153: Part III. Appendix 2: Data Transpor
Page 200 and 201:
Part III. Appendix 2: Data Transpor
Page 202 and 203:
Page 204 and 205:
Page 206 and 207:
Part III. Appendix 3: Data Archive
Page 208 and 209:
Page 210 and 211:
Page 212 and 213:
Page 214 and 215:
Page 216 and 217:
Page 218 and 219:
Page 220 and 221:
Page 222 and 223:
Page 224 and 225:
Page 226 and 227:
Page 228 and 229:
Page 230 and 231:
Page 232 and 233:
Part III. Appendix 4: User Outreach
Page 234 and 235:
Page 236 and 237:
Page 238 and 239:
Page 240 and 241:
Page 242 and 243:
Page 244 and 245:
Page 246 and 247:
Page 248 and 249:
Page 250 and 251:
Page 252 and 253:
Page 254 and 255:
Page 256 and 257:
Page 258 and 259:
Page 260 and 261:
Page 262 and 263:
Page 264 and 265:
Page 266 and 267:
Page 268 and 269:
Page 270 and 271:
Page 272 and 273:
Page 274 and 275:
Page 276 and 277:
Page 278 and 279:
Page 280 and 281:
Page 282 and 283:
Page 284 and 285:
Page 286 and 287:
Part III. Appendix 5: System Engine
Page 288 and 289:
Page 290 and 291:
Page 292 and 293:
Part III. Appendix 6: Technology Ma
Page 294 and 295:
Part III. Appendix 6: Technology Ma
Page 296 and 297:
Part III. Appendix 7: Biological Da
Page 298 and 299:
Page 300 and 301:
Page 302 and 303:
Page 304:
Executive Summary - Draft2300 Clare
show all

download as a pdf - Southern California Coastal Ocean Observing ...

Create successful ePaper yourself

Delete template?

Save as template?