25.06.2015 Views

Administering Platform LSF - SAS

Administering Platform LSF - SAS

Administering Platform LSF - SAS

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Controlling Processor Allocation Across Hosts<br />

Chapter 34<br />

Running Parallel Jobs<br />

Sometimes you need to control how the selected processors for a parallel job<br />

are distributed across the hosts in the cluster.<br />

You can control this at the job level or at the queue level. The queue<br />

specification is ignored if your job specifies its own locality.<br />

Specifying parallel job locality at the job level<br />

Syntax<br />

By default, <strong>LSF</strong> will allocate the required processors for the job from the<br />

available set of processors.<br />

A parallel job may span multiple hosts, with a specifiable number of processes<br />

allocated to each host. A job may be scheduled on to a single multiprocessor<br />

host to take advantage of its efficient shared memory, or spread out on to<br />

multiple hosts to take advantage of their aggregate memory and swap space.<br />

Flexible spanning may also be used to achieve parallel I/O.<br />

You are able to specify “select all the processors for this parallel batch job on<br />

the same host”, or “do not choose more than n processors on one host” by<br />

using the span section in the resource requirement string (bsub -R or<br />

RES_REQ in the queue definition in lsb.queues).<br />

Two kinds of span string are supported:<br />

◆ span[hosts=1]<br />

Indicates that all the processors allocated to this job must be on the same<br />

host.<br />

◆ span[ptile=value]<br />

Indicates the number of processors (value) on each host that should be<br />

allocated to the job.<br />

where value is:<br />

❖<br />

❖<br />

Default ptile value, specified by n processors. For example:<br />

span[ptile=4]<br />

<strong>LSF</strong> allocates 4 processors on each available host, regardless of how<br />

many processors the host has.<br />

Predefined ptile value, specified by ’!’. For example:<br />

span[ptile='!']<br />

uses the predefined maximum job slot limit in lsb.hosts (MXJ per<br />

host type/model) as its value.<br />

If the host or host type/model does not define MXJ, the default predefined<br />

ptile value is 1.<br />

❖<br />

Predefined ptile value with optional multiple ptile values, per host<br />

type or host model.<br />

<strong>Administering</strong> <strong>Platform</strong> <strong>LSF</strong> 441

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!