Topic: "Concurrent File I/O by Multiple Processes"

Speaker: Ge Baolai, SHARCNET

Registration link

Webinar link: SN-Seminars Vidyo room

When writing a parallel code, e.g. using MPI, we often have such a workflow: one process loads data from disk, then distributes the data to other processes to perform computational tasks and then collects the results. This model poses a potential challenge: the input data can be too large to fit into memory of a single process. Moreover, such jobs are likely to wait longer because they require more resources (RAM) to run, and as a result "cost" more on systems where both the number of cores and the amount of memory required by a job are factored in the cost (e.g. on Graham and Cedar.) In this seminar we will introduce the techniques that can be used to address these issues.

The audience is expected to know C/C++ programming language and have basic knowledge of MPI.

SHARCNET account is not required to attend the webinar. If you don't have a SHARCNET account, you don't need to register for the webinar - just follow the webinar link right before the webinar.

Need help attending a webinar? See the SHARCNET Help Wiki.