TGQR 2010Q2 Report.pdf - Teragridforum.org

Deepwater Horizon oil spill related research activities at the Center for Space Research (CSR) at
The University of Texas at Austin have resulted in a significant increase in the size of the TG data
collection managed by CSR. The CSR MAGIC group now manages approximately 23.4
terabytes of data on Corral using the data management system. All CSR MAGIC data is
accessible over the web, with over 15,000 web requests for data from the collection during the
reporting period (from over 2500 separate systems.)
Researcher Scott Michael was offered compute cycles at Mississippi State University to begin his
analysis of the data generated on Pople at PSC and Cobalt at NCSA. To avoid him having to
move 30 TB of simulation data to MSU, IU's Data Capacitor Wide Area File system was used to
bridge campuses. The file system was mounted on compute nodes at MSU. In doing this,
Michael was able to begin his analyses right away without the time consuming step of bundling
his data and moving it from the TeraGrid to a non-TeraGrid institution. Michael has written a
paper about this experience to be presented at the TeraGrid '10 conference.
SDSC continued work on preparing Lustre-WAN for production. DC-WAN (IU Lustre) and
GPFS-WAN (SDSC GPFS) have been mounted on our Dash cluster.
In Q1 Purdue RP migrated existing its TG data collections from the old SRB system to the new
iRODS system. In Q2 Purdue RP modified the Purdue environmental data portal to connect with
the new data management system. The new site is currently being tested.
The ORNL RP continued the active interaction with the REDDnet collaboration and its new
initiative, the Data Logistics Toolkit (DLT). REDDnet was recognized at the Spring Internet2
meeting (http://events.internet2.edu/2010/spring-mm/) with an IDEA award
(http://www.internet2.edu/idea/2010/) for providing distributed working storage in assistance of
projects with large data movement needs.
7.2 Data
7.2.1 Data Movement
Data movement infrastructure based on GridFTP remains stable within the TeraGrid, with
monitoring performed by Inca and the Speedpage. Interactions with the REDDnet collaborators
are expected to result in development of additional mechanisms to facilitate data movement into
and out of TeraGrid resources.
7.2.2 Wide-Area Filesystems
Work continued to deploy the new distributed Lustre-WAN file system using storage at 6 sites.
Indiana, NCSA, NICS, PSC, and TACC all received new hardware to deploy storage servers, and
SDSC began work on repurposing over 200TB of existing storage for use in the new Lustre-
WAN file system. During the quarter the new hardware was deployed and mostly integrated into
the network and power infrastructures of the various RPs, and efforts to prepare for software and
network testing were underway.
In addition to adding MSU as a non-TeraGrid site mounting DC-WAN, IU began work on the
TeraGrid wide area filesystem. IU has written and worked with system administrators at PSC the
UID mapping code that will permit a unified UID space for the TeraGrid. By the end of Q2,
hardware had been delivered, racked, and the disk array had been zoned for production.
PSC continues to operate Lustre 2.0-based test infrastructure to investigate future mechanisms to
enhance wide-area file system security and compatibility. Developments in the quarter include
70