Matching Application Access Patterns to Storage Device ...

More documents

Recommendations

Info

x · Matching Application Access Patterns to Storage Device Characteristics 3 Explicit Performance Characteristics 23 3.1 Storage model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 3.1.1 Storage manager . . . . . . . . . . . . . . . . . . . . . . . . 24 3.1.2 Storage devices . . . . . . . . . . . . . . . . . . . . . . . . . 26 3.1.3 Division of labor . . . . . . . . . . . . . . . . . . . . . . . . 27 3.1.4 LBN address space annotations . . . . . . . . . . . . . . . . 28 3.1.5 Storage interface . . . . . . . . . . . . . . . . . . . . . . . . 29 3.1.6 Making storage contract more explicit . . . . . . . . . . . . 30 3.2 Disk drive characteristics . . . . . . . . . . . . . . . . . . . . . . . 30 3.2.1 Physical organization . . . . . . . . . . . . . . . . . . . . . 31 3.2.2 Logical block mappings . . . . . . . . . . . . . . . . . . . . 32 3.2.3 Mechanical characteristics . . . . . . . . . . . . . . . . . . . 33 3.2.4 Firmware features . . . . . . . . . . . . . . . . . . . . . . . 35 3.3 MEMS-based storage devices . . . . . . . . . . . . . . . . . . . . . 39 3.3.1 Physical characteristics . . . . . . . . . . . . . . . . . . . . 39 3.3.2 Parallelism in MEMS-based storage . . . . . . . . . . . . . 42 3.3.3 Firmware features . . . . . . . . . . . . . . . . . . . . . . . 44 3.4 Disk arrays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 3.4.1 Physical organization . . . . . . . . . . . . . . . . . . . . . 45 3.4.2 Data striping . . . . . . . . . . . . . . . . . . . . . . . . . . 45 3.4.3 Parallel access . . . . . . . . . . . . . . . . . . . . . . . . . 46 4 Discovery of Disk Drive Characteristics 47 4.1 Characterizing disk drives with DIXtrac . . . . . . . . . . . . . . . 48 4.2 Characterization algorithms . . . . . . . . . . . . . . . . . . . . . . 49 4.2.1 Layout extraction . . . . . . . . . . . . . . . . . . . . . . . 49 4.2.2 Disk mechanics parameters . . . . . . . . . . . . . . . . . . 52 4.2.3 Cache parameters . . . . . . . . . . . . . . . . . . . . . . . 54 4.2.4 Command processing overheads . . . . . . . . . . . . . . . . 58 4.2.5 Scheduling algorithms . . . . . . . . . . . . . . . . . . . . . 59 4.3 DIXtrac implementation . . . . . . . . . . . . . . . . . . . . . . . . 59 4.4 Results and performance . . . . . . . . . . . . . . . . . . . . . . . . 61 4.4.1 Extraction times . . . . . . . . . . . . . . . . . . . . . . . . 61 4.4.2 Validation of extracted values . . . . . . . . . . . . . . . . . 62 5 The Access Delay Boundaries Attribute 67 5.1 Encapsulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 5.1.1 Disk drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 5.1.2 Disk array . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Contents · xi 5.1.3 MEMStore . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 5.2 System design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 5.2.1 Explicit contract . . . . . . . . . . . . . . . . . . . . . . . . 69 5.2.2 Data allocation and access . . . . . . . . . . . . . . . . . . . 69 5.2.3 Interface implementation . . . . . . . . . . . . . . . . . . . 70 5.3 Evaluating ensembles for disk drives . . . . . . . . . . . . . . . . . 71 5.3.1 Measuring disk performance . . . . . . . . . . . . . . . . . . 71 5.3.2 System-level benefits . . . . . . . . . . . . . . . . . . . . . . 78 5.3.3 Predicting improvements in response time . . . . . . . . . . 79 5.4 Block-based file system . . . . . . . . . . . . . . . . . . . . . . . . . 80 5.4.1 FreeBSD FFS overview . . . . . . . . . . . . . . . . . . . . 81 5.4.2 FreeBSD FFS modifications . . . . . . . . . . . . . . . . . . 82 5.4.3 FFS experiments . . . . . . . . . . . . . . . . . . . . . . . . 83 5.5 Log-structured file system . . . . . . . . . . . . . . . . . . . . . . . 86 5.5.1 Performance tradeoff . . . . . . . . . . . . . . . . . . . . . . 86 5.5.2 Variable segment size . . . . . . . . . . . . . . . . . . . . . 88 5.6 Video servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 5.6.1 Soft real-time . . . . . . . . . . . . . . . . . . . . . . . . . . 89 5.6.2 Hard real-time . . . . . . . . . . . . . . . . . . . . . . . . . 90 5.7 Database storage manager . . . . . . . . . . . . . . . . . . . . . . . 90 5.7.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 5.7.2 Robust storage management . . . . . . . . . . . . . . . . . 93 5.7.3 Implementation . . . . . . . . . . . . . . . . . . . . . . . . . 96 5.7.4 Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 5.7.5 DB2 experiments . . . . . . . . . . . . . . . . . . . . . . . . 98 5.7.6 RAID experiments . . . . . . . . . . . . . . . . . . . . . . . 102 5.7.7 Shore experiments . . . . . . . . . . . . . . . . . . . . . . . 103 6 The Parallelism Attribute 109 6.1 Encapsulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 6.1.1 Access to two-dimensional data structures . . . . . . . . . . 110 6.1.2 Equivalence class abstraction . . . . . . . . . . . . . . . . . 112 6.1.3 Disk array . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 6.1.4 MEMStore . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 6.2 System design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 6.2.1 Explicit contract . . . . . . . . . . . . . . . . . . . . . . . . 115 6.2.2 Data allocation and access . . . . . . . . . . . . . . . . . . . 115 6.2.3 Interface implementation . . . . . . . . . . . . . . . . . . . 116 6.3 Atropos logical volume manager . . . . . . . . . . . . . . . . . . . 118
Page 1 and 2: Matching Application Access Pattern
Page 3 and 4: To Katrina.
Page 5 and 6: Abstract Conventional computer syst
Page 7 and 8: Acknowledgements The work presented
Page 9: Contents 1 Introduction 1 1.1 Probl
Page 13 and 14: Figures 3.1 Two approaches to conve
Page 15 and 16: Tables 3.1 Representative SCSI disk
Page 17 and 18: 1 Introduction 1.1 Problem definiti
Page 19 and 20: 1.3 Overview · 3 fixed-size blocks
Page 21 and 22: 1.3 Overview · 5 performance avail
Page 23 and 24: 1.4 Contributions · 7 provide up t
Page 25 and 26: 2 Background and Related Work 2.1 S
Page 27 and 28: 2.2 Implicit storage contract · 11
Page 29 and 30: 2.3 Exploiting device characteristi
Page 35 and 36: 2.5 Accesses to multidimensional da
Page 41 and 42: 3 Explicit Performance Characterist
Page 43 and 44: 3.1 Storage model · 27 VFS read()
Page 45 and 46: 3.1 Storage model · 29 The archite
Page 47 and 48: 3.1 Storage model · 31 that has n
Page 49 and 50: 3.2 Disk drive characteristics · 3
Page 57 and 58: 3.3 MEMS-based storage devices · 4
Page 59 and 60: 3.3 MEMS-based storage devices · 4
Page 61 and 62:
3.3 MEMS-based storage devices · 4
Page 63 and 64:
3.4 Disk arrays · 47 3.4.1 Physica
Page 65 and 66:
4 Discovery of Disk Drive Character
Page 67 and 68:
4.2 Characterization algorithms ·
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
4.4 Results and performance · 63 d
Page 81 and 82:
4.4 Results and performance · 65 V
Page 83 and 84:
4.4 Results and performance · 67 Q
Page 85 and 86:
5 The Access Delay Boundaries Attri
Page 87 and 88:
5.2 System design · 71 5.2 System
Page 89 and 90:
5.3 Evaluating ensembles for disk d
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
5.4 Block-based file system · 83 1
Page 101 and 102:
5.4 Block-based file system · 85 E
Page 103 and 104:
5.4 Block-based file system · 87 p
Page 105 and 106:
5.5 Log-structured file system · 8
Page 107 and 108:
5.6 Video servers · 91 Startup lat
Page 109 and 110:
5.7 Database storage manager · 93
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
6 The Parallelism Attribute Several
Page 129 and 130:
6.1 Encapsulation · 113 row a row
Page 131 and 132:
6.1 Encapsulation · 115 that can i
Page 133 and 134:
6.2 System design · 117 6.2 System
Page 135 and 136:
6.2 System design · 119 that do no
Page 137 and 138:
6.3 Atropos logical volume manager
Page 139 and 140:
Page 141 and 142:
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
6.4 Database storage manager exploi
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
Page 163 and 164:
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
7 Conclusions and Future Work 7.1 C
Page 173 and 174:
7.2 Directions for future research
Page 175 and 176:
Bibliography Ailamaki, A., DeWitt,
Page 177 and 178:
Bibliography · 161 Chang, E. and G
Page 179 and 180:
Bibliography · 163 Gibson, G. A.,
Page 181 and 182:
Bibliography · 165 McKusick, M. K.
Page 183 and 184:
Bibliography · 167 Schindler, J.,
Page 185 and 186:
Bibliography · 169 VanMeter, R. 19
Page 187 and 188:
A Modeling disk drive media access
Page 189 and 190:
A.3 Zero-latency disk · 173 A.3 Ze
Page 191 and 192:
A.3 Zero-latency disk · 175 (I) S1
Page 193 and 194:
B Storage interface functions This
show all

Matching Application Access Patterns to Storage Device ...

Create successful ePaper yourself

Delete template?

Save as template?