Ticket 6700 - Large submit scripts
Summary: Large submit scripts
Status: RESOLVED INFOGIVEN
Alias: None
Product: Slurm
Classification: Unclassified
Component: Configuration (show other tickets)
Version: - Unsupported Older Versions
Hardware: Linux Linux
: 4 - Minor Issue
Assignee: Marshall Garey
QA Contact:
URL:
Depends on:
Blocks:
 
Reported: 2019-03-14 15:43 MDT by Doug Meyer
Modified: 2019-03-18 14:13 MDT (History)
0 users

See Also:
Site: Raytheon Missile, Space and Airborne
Alineos Sites: ---
Atos/Eviden Sites: ---
Confidential Site: ---
Coreweave sites: ---
Cray Sites: ---
DS9 clusters: ---
HPCnow Sites: ---
HPE Sites: ---
IBM Sites: ---
NOAA SIte: ---
OCF Sites: ---
Recursion Pharma Sites: ---
SFW Sites: ---
SNIC sites: ---
Linux Distro: ---
Machine Name:
CLE Version:
Version Fixed:
Target Release: ---
DevPrio: ---
Emory-Cloud Sites: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this ticket.
Description Doug Meyer 2019-03-14 15:43:24 MDT 
Education regarding Bug 2198
The man page states increasing the max_script_size "Larger values may adversely impact system performance."  Anticipating my fine users, why is that?  

Thank you,
Doug Meyer
Comment 1 Marshall Garey 2019-03-14 16:11:15 MDT 
Upon batch job submission, the job script is sent from the login node to the slurmctld across the network, then saved to the StateSaveLocation. When the batch job starts, the batch script has to be read from the StateSaveLocation and sent across the network to the batch host compute node. As you can imagine, very large batch scripts and slow filesystem and/or network i/o could be a bad combination.

Does that answer your question?
Comment 2 Marshall Garey 2019-03-18 11:49:20 MDT 
Closing as infogiven. Please re-open if you have further questions.
Comment 3 Doug Meyer 2019-03-18 14:13:48 MDT 
You rock!

Doug Meyer
HPC Service
dameyer@raytheon.com<mailto:dameyer@raytheon.com>
O: (520)665-5883
C: (520)481-7896

“Continuous improvement is better than delayed perfection.”  Mark Twain

From: bugs@schedmd.com <bugs@schedmd.com>
Sent: Monday, March 18, 2019 10:49 AM
To: Doug Meyer <dameyer@raytheon.com>
Subject: [External] [Bug 6700] Large submit scripts

Marshall Garey<mailto:marshall@schedmd.com> changed bug 6700<https://bugs.schedmd.com/show_bug.cgi?id=6700>
What

Removed

Added

Resolution

---

INFOGIVEN

Status

OPEN

RESOLVED

Comment # 2<https://bugs.schedmd.com/show_bug.cgi?id=6700#c2> on bug 6700<https://bugs.schedmd.com/show_bug.cgi?id=6700> from Marshall Garey<mailto:marshall@schedmd.com>

Closing as infogiven. Please re-open if you have further questions.

________________________________
You are receiving this mail because:

  *   You reported the bug.