Ticket 1671

Hi,
   the sbatch and srun commands have the option to specify the amount of
/tmp space. 

  --tmp=<MB>
         Specify a minimum amount of temporary disk space.

You can use the job submission plugin to test if the user has specified --tmp
at submission and if not set it to be 1GB.

It is also possible what you ask about prolog generating files under /tmp and epilog cleaning them, this is actually one of their use cases. Both prolog
and epilog have access to the jobid and the username. As an example these
are the Slurm environment variables in the prolog:

SLURMD_NODENAME=prometeo
SLURM_CLUSTER_NAME=canis_major
SLURM_CONF=/home/david/clusters/1411/linux/etc/slurm.conf
SLURM_JOBID=461
SLURM_JOB_ID=461
SLURM_JOB_PARTITION=markab
SLURM_JOB_UID=500
SLURM_JOB_USER=david
SLURM_NODELIST=prometeo
SLURM_STEP_ID=0
SLURM_UID=500

and in epilog:

SLURMD_NODENAME=prometeo
SLURM_CLUSTER_NAME=canis_major
SLURM_CONF=/home/david/clusters/1411/linux/etc/slurm.conf
SLURM_JOBID=461
SLURM_JOB_ID=461
SLURM_JOB_UID=500
SLURM_JOB_USER=david
SLURM_NODELIST=prometeo
SLURM_UID=500

David

Hi, 
   let me add that currently Slurm does not have the functionality to constrain the use of tmp space, the same way it does for memory for example.
It is possible in theory but it is not implemented.

David

Hi again,

thank you for your answer. 

However i am not sure i understand you when you talk about the job submission plugin, which plugin are you referring to and how do i set the --tmp to be 1G by default if the user does not specify it?

So if i understanding you correctly.

It is not possible to limit/constrain the usage of tmp space?

It is possible to set the default tmp usage to 1GB if not specified? 

Do these first two not conflict with each other?

It is possible to use epilog and prolog to create sub-directory with the job-id under /tmp like this Directory = /tmp/$JOB_ID and have the epilog clean up the directory on finish?

regards,
Hjalti Sveinsson

Hi,
   Slurm implements the job submission plugin which allows you to intercept and
modify any job submission parameter check the paragraph JobSubmitPlugins in
http://slurm.schedmd.com/slurm.conf.html. 
Examples of submission plugins are in the source tree:
slurm/src/plugins/job_submit 

Using the --tmp option it is possible to specify the amount of tmp space the job needs so that it gets dispatched to a host with enough tmp space, but currently 
there is no enforcement to make sure the job is not using more than requested. 

Yes it is definitely possible to create directories indexed by the jobid and then remove them in the epilog.

David

There are additional examples of job_submit plugins written using LUA scripts in the Slurm distribution in the "contribs/lua" subdirectory:

$ pwd
/home/jette/Desktop/SLURM/slurm.git/contribs/lua
$ ls
job_submit.license.lua  job_submit.lua  ...

Information provided.

David