Ticket 2941

Summary: intel_knl doc indicates asymmetric core layout for quadrant
Product: Slurm Reporter: Doug Jacobsen <dmjacobsen>
Component: DocumentationAssignee: Moe Jette <jette>
Status: RESOLVED FIXED QA Contact:
Severity: 4 - Minor Issue    
Priority: ---    
Version: 16.05.2   
Hardware: Cray XC   
OS: Linux   
Site: NERSC Slinky Site: ---
Alineos Sites: --- Atos/Eviden Sites: ---
Confidential Site: --- Coreweave sites: ---
Cray Sites: --- DS9 clusters: ---
Google sites: --- HPCnow Sites: ---
HPE Sites: --- IBM Sites: ---
NOAA SIte: --- NoveTech Sites: ---
Nvidia HWinf-CS Sites: --- OCF Sites: ---
Recursion Pharma Sites: --- SFW Sites: ---
SNIC sites: --- Tzag Elita Sites: ---
Linux Distro: --- Machine Name:
CLE Version: Version Fixed: 16.05.3
Target Release: --- DevPrio: ---
Emory-Cloud Sites: ---

Description Doug Jacobsen 2016-07-26 12:04:51 MDT
Hello,

There is a special note in the intel_knl documentation that indicated that quadrant mode has asymmetric core layouts and that slurm would be limited to 256 threads in snc4 and quadrant modes.

It appears that quadrant does have symmetric numa modes and that all threads are accessible.  (e.g., slurm detects all 272 and each of 272 mpi tasks are locked to different cpus).

Thanks,
Doug
Comment 2 Moe Jette 2016-07-26 12:24:42 MDT
That is old documentation based upon early KNL prototypes with 68 cores (which caused all sorts of problems). Thanks for pointing this out. I'll update the documentation.
Comment 3 Moe Jette 2016-07-26 13:02:27 MDT
Thanks for pointing this out. The documentation has been updated in this commit: 
https://github.com/SchedMD/slurm/commit/3766b05e22cb87e4e81b9ca4076b81804db3ad39