This course is a part of SHARCNET's ongoing "Introduction to Advanced Research Computing" series of online courses for 2021-2022. Compute Canada account is required to enroll.To register for any of the courses:

• Follow this link: https://training.sharcnet.ca

• Click the Log in link at the top right-hand side

• Log in with your Compute Canada login and password

• Click Site Home in the left-hand side menu

• Click 2021-2022 Introduction to Advanced Research Computing (ARC)

• Browse the list of (currently available) courses and enroll in the ones you are interested in

• To enroll in a course click on the course name and then click on that course’s enroll button

Course Syllabus:

Writing a concurrent or parallel program that can run on multiple cores or on multiple nodes/computers in a cluster is not the same as writing a sequential program for a single CPU core. Typically sequential programs are only concerned with some aspects of how information is stored in RAM and the step-by-step (sequential) correctness of its code. A concurrent program is concerned with the non-sequential reasoning of how code executes and how it can see (or not) values in RAM from other streams of execution, how it orders reads and writes on those streams of execution, and the time it takes for data in to be transferred across busses (e.g., CPU to GPU RAM, CPU to machine RAM, etc.).

This course will provide a practical overview of important concepts and details involved with concurrent programming in order to further understanding of the benefits, costs, and issues involved with exploiting and writing parallel computing programs.