Batch Systems

All of the Nevis particle-physics research groups have to work with “batch systems” as part of their analysis chain. You probably won’t be asked to use a batch system as part of a summer project.

However, if you continue your work beyond that, and/or join a larger project, almost certainly there will be a batch system in your future. This section will help you understand what the term “batch system” means, and give you some insight into the planning you’ll need to do in order to use one.

If you’re using the Nevis particle-physics systems, this same material is covered on the Nevis particle-physics wiki (though without the cartoons and jokes):

As you work your way through these sections, your initial reaction may be, “Why does this have to be so complicated?”

I have a horrifying answer for you: At Nevis, batch systems and job submissions are relatively simple. At the large national labs, or if you’re using the Open Science Grid, the available resources are more powerful but it’s more complex to manage them.

A description of the Nevis particle-physics batch set-up, even if you don’t have access to it, may help bridge your understanding towards the more advanced environments.

https://imgs.xkcd.com/comics/complex_numbers.png

Figure 127: https://xkcd.com/2028/ by Randall Munroe. This is another reason for the complexity of batch systems.