2010 Best Practices Competition IT & Informatics HPC

Figure 3 Scientific data workflow (Feb. 2010)
Scalable storage
The dedicated storage capacity for NextGen projects has increased from ~80TB to over 200TB with a
new scalable Isilon storage system with a single name space file system. This system provides robust
performance, redundancy and scalability. Being able to manage the very large amounts of storage
required to support biomedical research using the minimal of IT support allows researchers to
concentrate on their research and IT to concentrate on building better IT infrastructure in support of
scientific programs. The Isilon system uses a modular architecture and symmetric clustered file system so
that tasks such as adding additional storage to the storage cluster is as simple as plugging in additional
storage arrays. This helps to minimize costs while providing a solution that can grow as the data storage
requirements continue to increase.
Backup optimization
In addition to the Isilon storage system, TGen used Ocarina storage optimization appliances to compress
data before backup, saving considerable overhead on the backup systems. This makes it feasible to
backup more of the sequencing data.
File sharing
File sharing with external collaborators and other partners is accomplished using the Aspera FASP file
transfer technology. This technology allows optimal use of the network bandwidth to achieve high
throughput file transfer across the Internet.