Ticket 9052

Summary:	Cloud Bursting - (almost) multi cloud
Product:	Slurm	Reporter:	Will Shanks <shanks>
Component:	Cloud	Assignee:	Tim Wickberg <tim>
Status:	OPEN ---	QA Contact:
Severity:	C - Contributions
Priority:	---	CC:	brian
Version:	20.11.x
Hardware:	All
OS:	All
Site:	UCAR	Alineos Sites:	---
Atos/Eviden Sites:	---	Confidential Site:	---
Coreweave sites:	---	Cray Sites:	---
DS9 clusters:	---	HPCnow Sites:	---
HPE Sites:	---	IBM Sites:	---
NOAA SIte:	---	OCF Sites:	---
Recursion Pharma Sites:	---	SFW Sites:	---
SNIC sites:	---	Linux Distro:	---
Machine Name:		CLE Version:
Version Fixed:		Target Release:	---
DevPrio:	---	Emory-Cloud Sites:	---

Description Will Shanks 2020-05-14 13:53:43 MDT

We have been developing tooling for testing out Slurm's cloud bursting ability and think it may be helpful for the greater Slurm community. Currently we are only able to burst out to AWS EC2 instances, but it should be simple to add support for additional clouds to our solution.

This tooling can be found on github at https://github.com/NCAR/HPCFL_CloudBursting

Comment 1 Tim Wickberg 2020-05-15 12:35:45 MDT

Hi Will -

Thank you for the link, but it's unclear to me what you're proposing here as a contribution...

If you'd like to add this to the https://slurm.schedmd.com/download.html please feel free to propose a patch to add a link. (See docs/html/download.shtml in our source tree.) :)

cheers,
- Tim

Comment 2 Will Shanks 2020-05-15 14:14:33 MDT

Tim,

Scripts to provision EC2 instances is listed as remaining work in the elastic computing documentation (https://slurm.schedmd.com/elastic_computing.html) which our repo does.

We also noticed SchedMD's slurm-gcp repo https://github.com/SchedMD/slurm-gcp does something similar, but is intended for use only with gcp, where as ours tries to not be tightly coupled to a specific cloud provider.

Both of these things made us think our repo could be of interest to you, and creating a ticket appeared to be the best way to make you aware of it.

Would it make more sense to add this to https://slurm.schedmd.com/documentation.html under the Slurm Administrators Cloud section, instead of the downloads page, to be consistent with the way the slurm-gcp repo is referenced?

Thanks,
  Will

Comment 3 Tim Wickberg 2020-05-26 18:26:54 MDT

> Both of these things made us think our repo could be of interest to you, and
> creating a ticket appeared to be the best way to make you aware of it.

Yep, it's certainly of interest, thank you for pinging us.

> Would it make more sense to add this to
> https://slurm.schedmd.com/documentation.html under the Slurm Administrators
> Cloud section, instead of the downloads page, to be consistent with the way
> the slurm-gcp repo is referenced?

The main doc page is reserved for "first-line" functionality that SchedMD supports; the downloads page would be more appropriate for community packages such as this. I'm happy to go in and add that link if you'd like.

- Tim