Managing large batches of jobs [online, CIP202]
Note: all times are shown in the timezone in which each event occurs.
Date: 19 November 2025 @ 13:30 - 16:30
Timezone: Eastern Daylight Time
Language of instruction: English
Registration:: https://www.eventbrite.ca/e/1635684880509
Efficiently manage the execution of numerous computations on supercomputers!
Need to run hundreds of variations of your analysis? Do you need to repeat the same computation with different datasets? This workshop shows you how to structure and submit numerous jobs without overwhelming the scheduler. You'll learn grouping and parallelization techniques to launch your analyses.
Plan:
- Introduction to data parallelism
- Job arrays
- Parameter sweeps with GNU Parallel
- Other tools - META-Farm and GLOST
Activity log
