Performance Analysis and Optimization of the Hurricane File System ...

More documents

Recommendations

Info

CHAPTER 8. CONCLUSIONS 85 writing to a single shared disk may experience scalability problems. Tasks to further increase parallelism include the following. 1. Completing the redesign of HFS meta-data organization. 2. Implementing per disk queues in the disk interface objects (Figure 3.1), as found in the original version of HFS, to enable more capabilities and control of disks, leading to disk-based optimizations such as prefetching and scheduling. 3. Porting the HFS user-level library (Figure 3.1) to enable the flexibility of HFS to be fully exploited. Now that the core of the file system has been optimized, we need to focus on the interaction between the file system and the operating system. It is currently an open research issue of finding the optimal way for the K42 operating system to interact with various file systems. How do we design a single file system interface that contains enough flexibility to fully exploit the capabilities of a variety of file systems and fully exploit the capabilities of K42? HFS was designed for micro-kernel operating systems and therefore, its operating behavior is very compatible with the K42 operating system. Other file systems may not integrate as smoothly. This thesis represents an initial step in file system research on K42. Hopefully, it will provide guidance on further improving file system scalability.
Bibliography [1] Gene M. Amdahl. Validity of the single-processor approach to achieving large scale computing capabilities. In AFIPS Conference Proceedings, volume 30, pages 483–485, Atlantic City, New Jersey, April 1967. AFIPS. [2] Thomas E. Anderson, Michael D. Dahlin, Jeanna M. Neefe, David A. Patterson, Drew S. Roselli, and Randolph Y. Wang. Serverless network file systems. In 15th ACM Symposium on Operating Systems Principles. ACM Press, December 1995. [3] Thomas E. Anderson, Henry M. Levy, Brian N. Bershad, and Edward D. Lazowska. The interaction of architecture and operating system design. In Proceedings of the Fourth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-IV), pages 108– 120, Santa Clara, California, April 1991. ACM Press. [4] Jonathan Appavoo. Clustered objects: Initial design, implementation, and evaluation. Master’s thesis, University of Toronto, Department of Computer Science, Toronto, Ontario, Canada, 1998. [5] Martin Arlitt and Tai Jin. 1998 World Cup Web site access logs. Available at http://www.acm.org/ sigcomm/ITA/., August 1998. [6] Martin Arlitt and Tai Jin. Workload characterization of the 1998 World Cup Web site. Technical Report HPL-1999-35R1 991006 External, Hewlett-Packard Laboratories, Palo Alto, California, September 1999. [7] Mary G. Baker, John H. Hartman, Michael D. Kupfer, Ken W. Shirriff, and John K. Ousterhout. Measurements of a distributed file system. In Proceedings of 13th ACM Symposium on Operating Systems Principles, pages 198–212. ACM Press, 1991. [8] Steve Best. JFS log: How the journaled file system performs logging. In 4th Annual Linux Showcase & Conference, pages 163–168, Atlanta, Georgia, October 2000. [9] Steve Best and Dave Kleikamp. JFS Layout: How the Journaled File System Handles the On-Disk Layout. IBM Linux Technology Center, May 2000. [10] Rajesh Bordawekar, Alok Choudhary, and Juan Miguel Del Rosario. An experimental performance evaluation of Touchstone Delta Concurrent File System. In Proceedings of the 7th ACM International Conference on Supercomputing, pages 367–376. ACM Press, 1993. [11] Rajesh Bordawekar, Steven Landherr, Don Capps, and Mark Davis. Experimental evaluation of the Hewlett-Packard Exemplar File-System. ACM SIGMETRICS Performance Evaluation Review, 25(3):21–28, December 1997. [12] Ray Bryant, Ruth Forester, and John Hawkes. Filesystem performance and scalability in Linux 2.4.17. In Proceedings of the FREENIX Track: 2002 USENIX Annual Technical Conference, Monterey, California, June 2002. USENIX Association. [13] Philip H. Carns, Walter B. Ligon III, Robert B. Ross, and Rajeev Thakur. PVFS: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317–327, Atlanta, Georgia, October 2000. [14] Miguel Castro and Barbara Liskov. Proactive recovery in a byzantine-fault-tolerant system. In Fourth Symposium on Operating Systems Design and Implementation. USENIX Association, October 2000. 86
Page 1 and 2:
Performance Analysis and Optimizati
Page 3 and 4:
Acknowledgements This thesis has be
Page 5 and 6:
4.6 Measurements Taken and Graph In
Page 7 and 8:
List of Tables 3.1 File system inte
Page 9 and 10:
6.1 Create. . . . . . . . . . . . .
Page 11 and 12:
CHAPTER 1. INTRODUCTION AND MOTIVAT
Page 13 and 14:
CHAPTER 1. INTRODUCTION AND MOTIVAT
Page 15 and 16:
CHAPTER 2. BACKGROUND AND RELATED W
Page 17 and 18:
Page 19 and 20:
Page 21 and 22:
Page 23 and 24:
Chapter 3 HFS Architecture This cha
Page 25 and 26:
CHAPTER 3. HFS ARCHITECTURE 16 3.1.
Page 27 and 28:
CHAPTER 3. HFS ARCHITECTURE 18 ORS
Page 29 and 30:
CHAPTER 3. HFS ARCHITECTURE 20 dirt
Page 31 and 32:
CHAPTER 3. HFS ARCHITECTURE 22 dire
Page 33 and 34:
CHAPTER 3. HFS ARCHITECTURE 24 1. 2
Page 35 and 36:
CHAPTER 3. HFS ARCHITECTURE 26 curr
Page 37 and 38:
CHAPTER 4. EXPERIMENTAL SETUP 28 1
Page 39 and 40:
CHAPTER 4. EXPERIMENTAL SETUP 30 de
Page 41 and 42:
CHAPTER 4. EXPERIMENTAL SETUP 32 av
Page 43 and 44: Chapter 5 Microbenchmarks - Read Op
Page 45 and 46: CHAPTER 5. MICROBENCHMARKS - READ O
Page 61 and 62: Chapter 6 Microbenchmarks - Other F
Page 63 and 64: CHAPTER 6. MICROBENCHMARKS - OTHER
Page 75 and 76: Chapter 7 Macrobenchmark 7.1 Purpos
Page 77 and 78: CHAPTER 7. MACROBENCHMARK 68 server
Page 79 and 80: CHAPTER 7. MACROBENCHMARK 70 avg #
Page 81 and 82: CHAPTER 7. MACROBENCHMARK 72 Logica
Page 87 and 88: CHAPTER 7. MACROBENCHMARK 78 7.5 Ot
Page 89 and 90: CHAPTER 7. MACROBENCHMARK 80 to deq
Page 91 and 92: CHAPTER 8. CONCLUSIONS 82 8.1 Gener
Page 93: CHAPTER 8. CONCLUSIONS 84 read-only
Page 97 and 98: BIBLIOGRAPHY 88 [33] David Kotz, So
Page 99: BIBLIOGRAPHY 90 [71] Keith A. Smith
show all

Performance Analysis and Optimization of the Hurricane File System ...

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?