Ticket 9052 - Cloud Bursting - (almost) multi cloud
Summary: Cloud Bursting - (almost) multi cloud
Status: OPEN
Alias: None
Product: Slurm
Classification: Unclassified
Component: Cloud (show other tickets)
Version: 20.11.x
Hardware: All All
: C - Contributions
Assignee: Tim Wickberg
QA Contact:
URL:
Depends on:
Blocks:
 
Reported: 2020-05-14 13:53 MDT by Will Shanks
Modified: 2020-05-26 18:26 MDT (History)
1 user (show)

See Also:
Site: UCAR
Slinky Site: ---
Alineos Sites: ---
Atos/Eviden Sites: ---
Confidential Site: ---
Coreweave sites: ---
Cray Sites: ---
DS9 clusters: ---
Google sites: ---
HPCnow Sites: ---
HPE Sites: ---
IBM Sites: ---
NOAA SIte: ---
NoveTech Sites: ---
Nvidia HWinf-CS Sites: ---
OCF Sites: ---
Recursion Pharma Sites: ---
SFW Sites: ---
SNIC sites: ---
Tzag Elita Sites: ---
Linux Distro: ---
Machine Name:
CLE Version:
Version Fixed:
Target Release: ---
DevPrio: ---
Emory-Cloud Sites: ---


Attachments

Note You need to log in before you can comment on or make changes to this ticket.
Description Will Shanks 2020-05-14 13:53:43 MDT
We have been developing tooling for testing out Slurm's cloud bursting ability and think it may be helpful for the greater Slurm community. Currently we are only able to burst out to AWS EC2 instances, but it should be simple to add support for additional clouds to our solution.

This tooling can be found on github at https://github.com/NCAR/HPCFL_CloudBursting
Comment 1 Tim Wickberg 2020-05-15 12:35:45 MDT
Hi Will -

Thank you for the link, but it's unclear to me what you're proposing here as a contribution...

If you'd like to add this to the https://slurm.schedmd.com/download.html please feel free to propose a patch to add a link. (See docs/html/download.shtml in our source tree.) :)

cheers,
- Tim
Comment 2 Will Shanks 2020-05-15 14:14:33 MDT
Tim,

Scripts to provision EC2 instances is listed as remaining work in the elastic computing documentation (https://slurm.schedmd.com/elastic_computing.html) which our repo does.

We also noticed SchedMD's slurm-gcp repo https://github.com/SchedMD/slurm-gcp does something similar, but is intended for use only with gcp, where as ours tries to not be tightly coupled to a specific cloud provider.

Both of these things made us think our repo could be of interest to you, and creating a ticket appeared to be the best way to make you aware of it.

Would it make more sense to add this to https://slurm.schedmd.com/documentation.html under the Slurm Administrators Cloud section, instead of the downloads page, to be consistent with the way the slurm-gcp repo is referenced?

Thanks,
  Will
Comment 3 Tim Wickberg 2020-05-26 18:26:54 MDT
> Both of these things made us think our repo could be of interest to you, and
> creating a ticket appeared to be the best way to make you aware of it.

Yep, it's certainly of interest, thank you for pinging us.

> Would it make more sense to add this to
> https://slurm.schedmd.com/documentation.html under the Slurm Administrators
> Cloud section, instead of the downloads page, to be consistent with the way
> the slurm-gcp repo is referenced?

The main doc page is reserved for "first-line" functionality that SchedMD supports; the downloads page would be more appropriate for community packages such as this. I'm happy to go in and add that link if you'd like.

- Tim