Ticket 5504

Summary: slurmstepd: error
Product: Slurm Reporter: Sathish <sathish.sathishkumar>
Component: slurmstepdAssignee: Felip Moll <fmoll>
Status: RESOLVED DUPLICATE QA Contact:
Severity: 4 - Minor Issue    
Priority: --- CC: fmoll
Version: 17.11.7   
Hardware: Linux   
OS: Linux   
See Also: https://bugs.schedmd.com/show_bug.cgi?id=3890
Site: AstraZeneca Slinky Site: ---
Alineos Sites: --- Atos/Eviden Sites: ---
Confidential Site: --- Coreweave sites: ---
Cray Sites: --- DS9 clusters: ---
Google sites: --- HPCnow Sites: ---
HPE Sites: --- IBM Sites: ---
NOAA SIte: --- NoveTech Sites: ---
Nvidia HWinf-CS Sites: --- OCF Sites: ---
Recursion Pharma Sites: --- SFW Sites: ---
SNIC sites: --- Tzag Elita Sites: ---
Linux Distro: --- Machine Name:
CLE Version: Version Fixed:
Target Release: --- DevPrio: ---
Emory-Cloud Sites: ---

Description Sathish 2018-07-31 03:25:12 MDT
Hi Team, 

We are seeing the below error message when ever we invoke srun, could you please assist on the same ? 


$srun hostname
srun: job 357102 queued and waiting for resources
srun: error: Lookup failed: Unknown host
srun: job 357102 has been allocated resources
seskscpn084.prim.scp
slurmstepd: error: task/cgroup: unable to add task[pid=85894] to memory cg '(null)'
slurmstepd: error: xcgroup_instantiate: unable to create cgroup '/sys/fs/cgroup/memory/slurm/uid_684277182' : No space left on device
slurmstepd: error: jobacct_gather/cgroup: unable to instanciate user 684277182 memory cgroup


Please do let me know if you need anything from my end to take this further.

Thanks
Sathish
Comment 1 Felip Moll 2018-07-31 06:46:40 MDT
(In reply to Sathish from comment #0)
> Hi Team, 
> 
> We are seeing the below error message when ever we invoke srun, could you
> please assist on the same ? 


Hi Sathish,

Can you show me your kernel version and OS version in the node?
Also, can you attach your latest slurm.conf and cgroup.conf ?
Comment 2 Sathish 2018-07-31 08:58:34 MDT
We can track the same request with 5507

*** This ticket has been marked as a duplicate of ticket 5507 ***