Magellan Final Report - Office of Science - U.S. Department of Energy
Magellan Final Report - Office of Science - U.S. Department of Energy
Magellan Final Report - Office of Science - U.S. Department of Energy
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Magellan</strong> <strong>Final</strong> <strong>Report</strong><br />
Processing time (s)<br />
0 200 400 600 800<br />
HDFS<br />
GPFS<br />
Processing time (s)<br />
0 5000 10000 15000 20000 25000<br />
HDFS<br />
GPFS<br />
Processing time (s)<br />
0 20000 40000 60000 80000<br />
HDFS<br />
GPFS<br />
0.0 0.5 1.0 1.5 2.0 2.5 3.0<br />
0.0 0.5 1.0 1.5 2.0 2.5 3.0<br />
0.0 0.5 1.0 1.5 2.0 2.5 3.0<br />
Size (TB)<br />
Size (TB)<br />
Size (TB)<br />
(a) Filter<br />
(b) Reorder<br />
(c) Merge<br />
Figure 10.6: File System Comparison with varying file sizes.<br />
Processing time (s)<br />
0 5000 10000 15000<br />
Read Time<br />
Processing Time<br />
Write Time<br />
HDFS−Filter<br />
GPFS−Filter<br />
GPFS−Reorder<br />
HDFS−Reorder<br />
GPFS−Merge<br />
HDFS−Merge<br />
Size (a) (TB)<br />
Figure 10.7: File System Comparison<br />
Processing time (s)<br />
0 100 200 300 400<br />
HDFS<br />
GPFS<br />
2000 4000 6000 8000<br />
Number <strong>of</strong> mappers<br />
(a)<br />
Figure 10.8: Effect <strong>of</strong> changing the number <strong>of</strong> maps for a Filter operation.<br />
90
Change language