Performance Analysis and Optimization of the Hurricane File System ...

More documents

Recommendations

Info

Abstract Performance Analysis and Optimization of the Hurricane File System on the K42 Operating System David Tam Master of Applied Science Graduate Department of Electrical and Computer Engineering University of Toronto 2003 The performance scalability of the Hurricane File System (HFS) is studied under the context of the K42 Operating System. Both systems were designed for scalability on large-scale, shared-memory, non-uniform memory access multiprocessors. However, scalability of HFS was never studied extensively. Microbenchmarks for reading, writing, creating, obtaining file attributes, and name lookup were used to measure scalability. As well, a macrobenchmark in the form of a simulated Web server was used. The unoptimized version of HFS scaled poorly. Optimizations to the meta-data cache in the form of (1) finer grain locks, (2) larger hash tables, (3) modified hash functions, (4) padded hash list headers and cache entries, and (5) a modified block cache free list, resulted in significant scalability improvements. ii
Acknowledgements This thesis has been made possible by the generous support of many individuals. I would like to thank my supervisor, Professor Michael Stumm, for his academic guidance; Jonathan Appavoo for his academic advice and technical support; Orran Krieger and the K42 group at the IBM Thomas J. Watson Research Center for their technical support; and Jennie Fan for her emotional support. Finally, I would like to acknowledge my sources of financial support: Professor Michael Stumm, the University of Toronto, IBM, and my parents. iii
Page 1: Performance Analysis and Optimizati
Page 5 and 6: 4.6 Measurements Taken and Graph In
Page 7 and 8: List of Tables 3.1 File system inte
Page 9 and 10: 6.1 Create. . . . . . . . . . . . .
Page 11 and 12: CHAPTER 1. INTRODUCTION AND MOTIVAT
Page 13 and 14: CHAPTER 1. INTRODUCTION AND MOTIVAT
Page 15 and 16: CHAPTER 2. BACKGROUND AND RELATED W
Page 23 and 24: Chapter 3 HFS Architecture This cha
Page 25 and 26: CHAPTER 3. HFS ARCHITECTURE 16 3.1.
Page 27 and 28: CHAPTER 3. HFS ARCHITECTURE 18 ORS
Page 29 and 30: CHAPTER 3. HFS ARCHITECTURE 20 dirt
Page 31 and 32: CHAPTER 3. HFS ARCHITECTURE 22 dire
Page 33 and 34: CHAPTER 3. HFS ARCHITECTURE 24 1. 2
Page 35 and 36: CHAPTER 3. HFS ARCHITECTURE 26 curr
Page 37 and 38: CHAPTER 4. EXPERIMENTAL SETUP 28 1
Page 39 and 40: CHAPTER 4. EXPERIMENTAL SETUP 30 de
Page 41 and 42: CHAPTER 4. EXPERIMENTAL SETUP 32 av
Page 43 and 44: Chapter 5 Microbenchmarks - Read Op
Page 45 and 46: CHAPTER 5. MICROBENCHMARKS - READ O
Page 53 and 54:
CHAPTER 5. MICROBENCHMARKS - READ O
Page 55 and 56:
Page 57 and 58:
Page 59 and 60:
Page 61 and 62:
Chapter 6 Microbenchmarks - Other F
Page 63 and 64:
CHAPTER 6. MICROBENCHMARKS - OTHER
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Chapter 7 Macrobenchmark 7.1 Purpos
Page 77 and 78:
CHAPTER 7. MACROBENCHMARK 68 server
Page 79 and 80:
CHAPTER 7. MACROBENCHMARK 70 avg #
Page 81 and 82:
CHAPTER 7. MACROBENCHMARK 72 Logica
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
CHAPTER 7. MACROBENCHMARK 78 7.5 Ot
Page 89 and 90:
CHAPTER 7. MACROBENCHMARK 80 to deq
Page 91 and 92:
CHAPTER 8. CONCLUSIONS 82 8.1 Gener
Page 93 and 94:
CHAPTER 8. CONCLUSIONS 84 read-only
Page 95 and 96:
Bibliography [1] Gene M. Amdahl. Va
Page 97 and 98:
BIBLIOGRAPHY 88 [33] David Kotz, So
Page 99:
BIBLIOGRAPHY 90 [71] Keith A. Smith
show all

Performance Analysis and Optimization of the Hurricane File System ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?