Ticket 3207 - Append post-job statistics and other messages to job output
Summary: Append post-job statistics and other messages to job output
Status: OPEN
Alias: None
Product: Slurm
Classification: Unclassified
Component: Profiling (show other tickets)
Version: 17.02.x
Hardware: Linux Linux
: 5 - Enhancement
Assignee: Unassigned Developer
QA Contact:
URL:
Depends on:
Blocks:
 
Reported: 2016-10-25 10:20 MDT by Tim Wickberg
Modified: 2021-02-10 04:50 MST (History)
2 users (show)

See Also:
Site: Vanderbilt
Alineos Sites: ---
Atos/Eviden Sites: ---
Confidential Site: ---
Coreweave sites: ---
Cray Sites: ---
DS9 clusters: ---
HPCnow Sites: ---
HPE Sites: ---
IBM Sites: ---
NOAA SIte: ---
NoveTech Sites: ---
Nvidia HWinf-CS Sites: ---
OCF Sites: ---
Recursion Pharma Sites: ---
SFW Sites: ---
SNIC sites: ---
Tzag Elita Sites: ---
Linux Distro: ---
Machine Name:
CLE Version:
Version Fixed:
Target Release: ---
DevPrio: ---
Emory-Cloud Sites: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this ticket.
Description Tim Wickberg 2016-10-25 10:20:17 MDT 
Add a mechanism for returning job statistics (and/or other admin-generated messages) back to the user immediately following job completion. Ideally these would be appended to the user output file itself.

The epilog executes while the job is still running, and by definition cannot include final statistics for the job.

SlurmctldEpilog has no access to the job output.
Comment 2 Hermann Schwärzler 2021-02-10 04:50:08 MST 
Hi Tim, 

this is one of the things we definitely would like to have. :-)

What's the state of this request? What are the chances of this being implemented any time soon?

Or could this be done by writing a SPANK plugin? Probably one running in the slurmd-context (slurmd_exit callback) or in the job_script context (job_epilog context - but that's too early, isn't it?)?