Is there any way to get profiling of the batch script itself? We have lots of sequential jobs and we could benefit from this feature. If it is not currently there, can we get this with the next major release (15.08)?
Do you mean hdf5? David
Yes, We want to be able to profile the script as if it were another step of the job. Regards, Carlos On Fri, Jun 5, 2015 at 12:54 AM, <bugs@schedmd.com> wrote: > *Comment # 1 <http://bugs.schedmd.com/show_bug.cgi?id=1721#c1> on bug > 1721 <http://bugs.schedmd.com/show_bug.cgi?id=1721> from David Bigagli > <david@schedmd.com> * > > Do you mean hdf5? > > David > > ------------------------------ > You are receiving this mail because: > > - You reported the bug. > >
Can you run your batch script as a step? David
Hi David, We do not want the users to wrap their scripts inside another script and running srun. On Fri, Jun 5, 2015 at 11:33 PM, <bugs@schedmd.com> wrote: > *Comment # 3 <http://bugs.schedmd.com/show_bug.cgi?id=1721#c3> on bug > 1721 <http://bugs.schedmd.com/show_bug.cgi?id=1721> from David Bigagli > <david@schedmd.com> * > > Can you run your batch script as a step? > > David > > ------------------------------ > You are receiving this mail because: > > - You reported the bug. > >
Created attachment 1965 [details] patch
The attached patch solves this problem. Since the profile plugin is being restructured I wait till #971 is closed before commit this in 15.08. You can back port it to 14.11 locally. David
Thanks for the patch. It generates the h5 file if ProfileHDF5Default is set to Task in the acct_gather.conf file. Otherwise even if the parameter --profile=Task is passed to the sbatch command no h5 file is created. Also the file is not recognized by the sh5util so it can not be easily extracted into a csv file
Hi, a patch for this was committed to the master branch since this is a new feature. The batch step can now be profiles and the step file is merged together with the other steps of the job and can be then viewed with the hdf commands like hdfview. Currently batch steps are profiled only if the ProfileHDF5Default is set, the reason is that this need modification of the batch data structure and the protocol between the controller, the slurmd and the stepd. This will be addressed in a upcoming patch. David
