download as a pdf - Southern California Coastal Ocean Observing ...

More documents

Recommendations

Info

Part III. Appendix 3: Data Archive and Accessdata centers, and data service catalogs (see description in the Data Provision and Access section)will identify where the data are available and how they can be accessed. Some Discovery metadataelements that are particularly important for managing the Archive System are:• Data set lineage history (e.g., which irreplaceable data set was used to create this current dataset),• Data category specification, which determines the storage requirements,• Release date, which is the date to remove temporary restricted access,• Version number and description of the version number,• Description of the file naming convention,• Unique IOOS-wide data set name or identification,• Mechanisms for correct publication citation and reference tracking.Because some archived data sets go through numerous incremental updates, modifications, corrections,and occasionally, full replacements, the metadata strategy must be dynamic so the centerscan easily maintain accurate information and so the users have complete ancillary information.Furthermore, as data are referenced in publications it is desirable to have bibliography tracking capability.This would provide an end-to-end lineage record, starting with the measurements or computationthrough the change and modification history and eventually to established scientific orpublic knowledge. Consequently, the data set could be properly cited in the literature and the IOOSprogram would gain another metric to measure success.A lapse in data security could quickly result in the loss of irreplaceable data. The Archive Systemwill guard against unrecoverable data loss by making data integrity (or security) a primary objective.As with data received from each provider, byte counts and checksums will be calculated andused to verify that the data are uncorrupted when transmitted between data centers. These quantitieswill again be calculated after every internal process at the archive centers, and then recalculatedperiodically on all archived data to protect against such problems as hard disk failures, media degeneration,incomplete file transfers, and malicious hacking. Virus checks will be performed on thedata before archiving, then periodically on all data kept online.Long-term preservation requires that all archive centers have a plan to address evolving mass storagetechnology. The plan must include strategies for storage media migration. Current systemsare based on magnetic tape cartridges, which typically have a three- to five-year life cycle, and areapproaching a petabyte in size. Under IOOS these systems will grow and the rate of increase willaccelerate. This growth can be accommodated in the Archive System, but will require increases infacilities infrastructure and support.206
Part III. Appendix 3: Data Archive and AccessThe Archive System will be a cohesive set of centers that interoperate by using metadata standardsand data transport methods in a system of computers, software, and networks.Undoubtedly, the future will bring new technologies in networks, computing systems, and evolutionsin software. In order to take advantage of the new technologies and software, and not disruptthe interoperability, a coordinated plan is required for handling system-wide technology infusion.IOOS will instantiate new and parallel data sets that will augment the extant digital historical collectionsnow at the archive centers. Focused efforts at the archive centers will be necessary to maintaincontinuity across related data sets while IOOS evolves. The goal is to have the broadest referencedata sets possible through smooth integration of historical digital data and the new IOOS datasets.207
Page 1 and 2:
Data Management and Communications
Page 3 and 4:
Data Management and Communications
Page 8 and 9:
Table of Contents
Page 10 and 11:
GlossaryLAS ..................Live
Page 12 and 13:
Executive Summary2
Page 14 and 15:
Executive SummaryTECHNICAL ANALYSIS
Page 16 and 17:
Executive SummaryDMAC Metadata will
Page 18 and 19:
Executive SummaryCOSTSThe cost esti
Page 20 and 21:
Part I. OverviewContentsPreface ...
Page 22 and 23:
Part I. OverviewIOOS - Enhancements
Page 24 and 25:
Part I. Overviewing processes descr
Page 26 and 27:
Part I. OverviewTHE VISIONIOOS is e
Page 28 and 29:
Part I. Overview3. Heterogeneous da
Page 30 and 31:
Part I. OverviewOne of these coordi
Page 32 and 33:
Part I. OverviewIOOS Data Communica
Page 34 and 35:
Part I. OverviewTHE DMAC SUBSYSTEM
Page 36 and 37:
Part I. OverviewData Transport(see
Page 38 and 39:
Part I. OverviewTable 1. Near-term
Page 40 and 41:
Part I. Overviewdata and taxonomies
Page 42 and 43:
Part I. OverviewFigure 2. The Archi
Page 44 and 45:
Part I. Overview• All data collec
Page 46 and 47:
Part I. OverviewSection 3. Manageme
Page 48 and 49:
Part I. Overviewthough documented a
Page 50 and 51:
Part I. Overviewthis “spiral” u
Page 52 and 53:
Part I. OverviewTable 3. DMAC Overa
Page 54 and 55:
Part I. Overview• Program Initial
Page 56 and 57:
Part I. OverviewOutcome 3: Agreemen
Page 58 and 59:
Part I. OverviewCONCRETE GUIDANCE T
Page 60 and 61:
Part I. Overview- Notify the Nation
Page 62 and 63:
Part II. Phased Implementation Plan
Page 64 and 65:
Page 66 and 67:
Page 68 and 69:
Page 70 and 71:
Page 72 and 73:
Page 74 and 75:
Page 76 and 77:
Page 78 and 79:
Page 80 and 81:
Page 82 and 83:
Page 84 and 85:
Page 86 and 87:
Page 88 and 89:
Page 90 and 91:
Page 92 and 93:
Page 94 and 95:
Page 96 and 97:
Page 98 and 99:
Page 100 and 101:
Page 102 and 103:
Page 104 and 105:
Page 106 and 107:
Page 108 and 109:
Page 110 and 111:
Page 112 and 113:
Page 114 and 115:
Page 116 and 117:
Page 118 and 119:
Page 120 and 121:
Page 122 and 123:
Page 124 and 125:
Part III. Appendix 1: Metadata and
Page 126 and 127:
Page 128 and 129:
Page 130 and 131:
Page 132 and 133:
Page 134 and 135:
Page 136 and 137:
Page 138 and 139:
Page 140 and 141:
Page 142 and 143:
Page 144 and 145:
Page 146 and 147:
Page 148 and 149:
Page 150 and 151:
Part III. Appendix 2: Data Transpor
Page 152 and 153:
Page 154 and 155:
Page 156 and 157:
Page 158 and 159:
Page 160 and 161:
Page 162 and 163:
Page 164 and 165:
Page 166 and 167: Part III. Appendix 2: Data Transpor
Page 206 and 207: Part III. Appendix 3: Data Archive
Page 232 and 233: Part III. Appendix 4: User Outreach
Page 266 and 267:
Part III. Appendix 4: User Outreach
Page 268 and 269:
Page 270 and 271:
Page 272 and 273:
Page 274 and 275:
Page 276 and 277:
Page 278 and 279:
Page 280 and 281:
Page 282 and 283:
Page 284 and 285:
Page 286 and 287:
Part III. Appendix 5: System Engine
Page 288 and 289:
Page 290 and 291:
Page 292 and 293:
Part III. Appendix 6: Technology Ma
Page 294 and 295:
Part III. Appendix 6: Technology Ma
Page 296 and 297:
Part III. Appendix 7: Biological Da
Page 298 and 299:
Page 300 and 301:
Page 302 and 303:
Page 304:
Executive Summary - Draft2300 Clare
show all

download as a pdf - Southern California Coastal Ocean Observing ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?