Ticket 16954 - PurgeJobEnvAfter PurgeJobScriptAfter needed - to selectively purge transient jobs
Summary: PurgeJobEnvAfter PurgeJobScriptAfter needed - to selectively purge transient ...
Status: OPEN
Alias: None
Product: Slurm
Classification: Unclassified
Component: Accounting (show other tickets)
Version: 23.02.2
Hardware: Linux Linux
: 5 - Enhancement
Assignee: Unassigned Developer
QA Contact:
URL:
: 16746 (view as ticket list)
Depends on:
Blocks:
 
Reported: 2023-06-13 11:47 MDT by S Senator
Modified: 2025-04-01 13:54 MDT (History)
3 users (show)

See Also:
Site: LANL
Alineos Sites: ---
Atos/Eviden Sites: ---
Confidential Site: ---
Coreweave sites: ---
Cray Sites: ---
DS9 clusters: ---
HPCnow Sites: ---
HPE Sites: ---
IBM Sites: ---
NOAA SIte: ---
NoveTech Sites: ---
Nvidia HWinf-CS Sites: ---
OCF Sites: ---
Recursion Pharma Sites: ---
SFW Sites: ---
SNIC sites: ---
Tzag Elita Sites: ---
Linux Distro: SUSE
Machine Name: chicoma, tycho, crossroads, rocinante
CLE Version:
Version Fixed:
Target Release: ---
DevPrio: ---
Emory-Cloud Sites: ---

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this ticket.
Description S Senator 2023-06-13 11:47:21 MDT 
In our environment we need to keep job accounting history indefinitely. However, the job environment and script need only be kept accessible for the duration of time typical for support personnel. This is typically 2-4 weeks, or for some projects up to 8 weeks. However, we would always want to purge the job scripts and environment after the project activity diminishes.

Please consider adding PurgeJobEnvAfter and PurgeJobScriptAfter functionality to the slurmdbd logic. We have done direct MariaDB SQL hacks (as suggested by SchedMD personnel) to address table growth, but would strongly prefer a supported slurmdbd-level fix.

Thank you.
Comment 1 Tim Wickberg 2023-06-13 13:20:37 MDT 
Thanks for filing this, I'm moving it into the enhancement queue.

I'll discuss internally and get back to you with a timeframe, but this should be relatively straightforward of an NRE project.

- Tim
Comment 2 S Senator 2024-08-05 16:30:59 MDT 
Hello,
There is renewed interest in this feature as it is manifesting on more of our clusters. Would you please generate an SOW proposal to implement this feature?
Thank you.
Comment 3 Tim Wickberg 2024-08-08 09:45:00 MDT 
SoW should be on it's way.

(Updating some of the metadata on the ticket while here.)
Comment 4 S Senator 2025-04-01 13:54:12 MDT 
*** Ticket 16746 has been marked as a duplicate of this ticket. ***