23.07.2014 Views

Lustre 1.6 Operations Manual

Lustre 1.6 Operations Manual

Lustre 1.6 Operations Manual

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

3. If you have a separate MGS (that you do not want to reformat), then add the<br />

"writeconf" flag to mkfs.lustre on the MDT, run:<br />

$ mkfs.lustre --reformat --writeconf –fsname spfs --mdt \<br />

--mgs /dev/sda<br />

Note – If you have a combined MGS/MDT, reformatting the MDT reformats the<br />

MGS as well, causing all configuration information to be lost; you can start building<br />

your new filesystem. Nothing needs to be done with old disks that will not be part<br />

of the new filesystem, just do not mount them.<br />

22.3.10 Reclaiming Reserved Disk Space<br />

All current <strong>Lustre</strong> installations run the ext3 filesystem internally on service nodes.<br />

By default, the ext3 reserves 5% of the disk space for the root user. In order to<br />

reclaim this space, run the following command on your OSSs:<br />

tune2fs [-m reserved_blocks_percent] [device]<br />

You do not need to shut down <strong>Lustre</strong> before running this command or restart it<br />

afterwards.<br />

22.3.11 Considerations in Connecting a SAN with <strong>Lustre</strong><br />

Depending on your cluster size and workload, you may want to connect a SAN with<br />

<strong>Lustre</strong>. Before making this connection, consider the following:<br />

■ In many SAN filesystems without <strong>Lustre</strong>, clients allocate and lock blocks or<br />

inodes individually as they are updated. The <strong>Lustre</strong> design avoids the high<br />

contention that some of these blocks and inodes may have.<br />

■<br />

■<br />

<strong>Lustre</strong> is highly scalable and can have a very large number of clients. SAN<br />

switches do not scale to a large number of nodes, and the cost per port of a SAN<br />

is generally higher than other networking.<br />

Filesystems that allow direct-to-SAN access from the clients have a security risk<br />

because clients can potentially read any data on the SAN disks, and misbehaving<br />

clients can corrupt the filesystem for many reasons like improper filesystem,<br />

network, or other kernel software, bad cabling, bad memory, and so on. The risk<br />

increases with increase in the number of clients directly accessing the storage.<br />

Chapter 22 <strong>Lustre</strong> Troubleshooting Tips 22-11

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!