Ticket 16954

Summary:	PurgeJobEnvAfter PurgeJobScriptAfter needed - to selectively purge transient jobs
Product:	Slurm	Reporter:	S Senator <sts>
Component:	Accounting	Assignee:	Unassigned Developer <dev-unassigned>
Status:	OPEN ---	QA Contact:
Severity:	5 - Enhancement
Priority:	---	CC:	heasterday, kauffman, mcoyne
Version:	23.02.2
Hardware:	Linux
OS:	Linux
See Also:	https://bugs.schedmd.com/show_bug.cgi?id=16746 https://support.schedmd.com/show_bug.cgi?id=21698
Site:	LANL	Alineos Sites:	---
Atos/Eviden Sites:	---	Confidential Site:	---
Coreweave sites:	---	Cray Sites:	---
DS9 clusters:	---	HPCnow Sites:	---
HPE Sites:	---	IBM Sites:	---
NOAA SIte:	---	NoveTech Sites:	---
Nvidia HWinf-CS Sites:	---	OCF Sites:	---
Recursion Pharma Sites:	---	SFW Sites:	---
SNIC sites:	---	Tzag Elita Sites:	---
Linux Distro:	SUSE	Machine Name:	chicoma, tycho, crossroads, rocinante
CLE Version:		Version Fixed:
Target Release:	---	DevPrio:	---
Emory-Cloud Sites:	---

Description S Senator 2023-06-13 11:47:21 MDT

In our environment we need to keep job accounting history indefinitely. However, the job environment and script need only be kept accessible for the duration of time typical for support personnel. This is typically 2-4 weeks, or for some projects up to 8 weeks. However, we would always want to purge the job scripts and environment after the project activity diminishes.

Please consider adding PurgeJobEnvAfter and PurgeJobScriptAfter functionality to the slurmdbd logic. We have done direct MariaDB SQL hacks (as suggested by SchedMD personnel) to address table growth, but would strongly prefer a supported slurmdbd-level fix.

Thank you.

Comment 1 Tim Wickberg 2023-06-13 13:20:37 MDT

Thanks for filing this, I'm moving it into the enhancement queue.

I'll discuss internally and get back to you with a timeframe, but this should be relatively straightforward of an NRE project.

- Tim

Comment 2 S Senator 2024-08-05 16:30:59 MDT

Hello,
There is renewed interest in this feature as it is manifesting on more of our clusters. Would you please generate an SOW proposal to implement this feature?
Thank you.

Comment 3 Tim Wickberg 2024-08-08 09:45:00 MDT

SoW should be on it's way.

(Updating some of the metadata on the ticket while here.)

Comment 4 S Senator 2025-04-01 13:54:12 MDT

*** Ticket 16746 has been marked as a duplicate of this ticket. ***