23.07.2014 Views

Lustre 1.6 Operations Manual

Lustre 1.6 Operations Manual

Lustre 1.6 Operations Manual

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

9.1.5 Known Issues with Quotas<br />

Using quotas in <strong>Lustre</strong> can be complex and there are several known issues.<br />

9.1.5.1 Granted Cache and Quota Limits<br />

In <strong>Lustre</strong>, granted cache does not respect quota limits. In this situation, OSTs grant<br />

cache to <strong>Lustre</strong> client to accelerate I/O. Granting cache causes writes to be successful<br />

in OSTs, even if they exceed the quota limits, and will overwrite them.<br />

The sequence is:<br />

1. A user writes files to <strong>Lustre</strong>.<br />

2. If the <strong>Lustre</strong> client has enough granted cache, then it returns ‘success’ to users<br />

and arranges the writes to the OSTs.<br />

3. Because <strong>Lustre</strong> clients have delivered success to users, the OSTs cannot fail<br />

these writes.<br />

Because of granted cache, writes always overwrite quota limitations. For example, if<br />

you set a 400 GB quota on user A and use IOR to write for userA from a bundle of<br />

clients, you will write much more data than 400 GB, and cause an out-of-quota error<br />

(-EDQUOT).<br />

Note – The effect of granted cache on quota limits can be mitigated, but not<br />

eradicated. Reduce the max_dirty_buffer in the clients (just like echo XXXX ><br />

/proc/fs/lustre/osc/lustre-OST*/max_dirty_mb).<br />

9-10 <strong>Lustre</strong> <strong>1.6</strong> <strong>Operations</strong> <strong>Manual</strong> • September 2008

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!