Ticket 8884

Summary: Burst Buffers scripts
Product: Slurm Reporter: Sathishkumar <sathishkumar.ranganathan>
Component: Burst BuffersAssignee: Marshall Garey <marshall>
Status: RESOLVED INFOGIVEN QA Contact:
Severity: 4 - Minor Issue    
Priority: --- CC: justin.lecher
Version: - Unsupported Older Versions   
Hardware: Linux   
OS: Linux   
Site: AstraZeneca Alineos Sites: ---
Atos/Eviden Sites: --- Confidential Site: ---
Coreweave sites: --- Cray Sites: ---
DS9 clusters: --- HPCnow Sites: ---
HPE Sites: --- IBM Sites: ---
NOAA SIte: --- OCF Sites: ---
Recursion Pharma Sites: --- SFW Sites: ---
SNIC sites: --- Linux Distro: ---
Machine Name: CLE Version:
Version Fixed: Target Release: ---
DevPrio: --- Emory-Cloud Sites: ---

Description Sathishkumar 2020-04-17 06:23:01 MDT
Hello Support, 

We are testing up the Burst Buffers generic plugin on our development setup. I am not able to find the scripts for the below stuffs, document says it is available as part of the distribution but I could not find them with the distributions, could you please point to the scripts ? 

CreateBuffer
DestroyBuffer
GetSysState
StartStageIn
StartStageIn
StopStageIn

Thanks
Sathish
Comment 1 Sathishkumar 2020-04-17 08:53:22 MDT
Hi Team, 

I found the following script under plugins/burst_buffer/generic/ 

bb_get_state.example
bb_start_stage_in.example
bb_start_stage_out.example
bb_stop_stage_out.example

is that what I should be using ? 

still the scripts for the below parameters are missing. 

GetSysStatus
CreateBuffer
DestroyBuffer

Also on the https://slurm.schedmd.com/burst_buffer.conf.html, i dont see any definition of the following parameters CreateBuffer, DestroyBuffer,StartStageIn,StartStageOut,StopStageIn and StopStageIn. 

And also on https://slurm.schedmd.com/slurm.conf.html
There is no generic option specified for BurstBufferType 

Is that intentional or missing from the document ?

Thanks
Sathish

Please a
Comment 2 Marshall Garey 2020-04-17 16:00:26 MDT
Slurm currently doesn't support a burstbuffer/generic plugin. The current burstbuffer/generic plugin is currently just a stub - it contains function prototypes that return success. It doesn't actually do anything.

The scripts you found all have an important note in the comment at the top:

# NOTE: Sample script used for burst buffer management. Used for development
# purposes and is not intended for production use.

These scripts were added in 2014 by Moe, who developed the burst_buffer/cray plugin (now it's called burst_buffer/datawarp).

Does this answer your question?
Comment 3 Sathishkumar 2020-04-19 23:36:01 MDT
Hi Marshall, 

Thanks for the update,yes that answers my question. 
Could you also share the generic plugin road map, this will help us to plan the stuffs accordingly. 

Regards
Sathish
Comment 5 Marshall Garey 2020-04-20 11:07:26 MDT
(In reply to Sathishkumar from comment #3)
> Hi Marshall, 
> 
> Thanks for the update,yes that answers my question. 
> Could you also share the generic plugin road map, this will help us to plan
> the stuffs accordingly. 

Just that it's not supported right now. Unfortunately there's nothing more at the moment.
Comment 6 Marshall Garey 2020-04-27 10:25:28 MDT
Closing as infogiven. Please re-open this ticket if you have more questions.