CS3210 Parallel computing

Home

❯

Tutorials

❯

GPU and distributed computing

❯

Tutorial 9: Introduction to distributed-memory programming using MPI

Tutorial 9: Introduction to distributed-memory programming using MPI

CS3210 Site Preview Version
Unpublished Page

Have feedback?Share it anonymously↗

Graph View

  • Tutorial code
  • Learning outcomes
  • MPI standards and implementations
  • Part 1: exercise questions
  • Question 1
  • Part 2: writing MPI programs with point-to-point communication
  • Compiling and running MPI programs locally
  • Exercise 1
  • Exercise 2
  • Running MPI programs across multiple nodes using Slurm
  • Exercise 3
  • Mapping MPI processes to nodes / cores
  • Exercise 4
  • Exercise 5
  • Process-to-process communication
  • Exercise 6
  • Exercise 7
  • Exercise 8
  • Non-blocking communication
  • Exercise 9
  • For submission (exercises 10-12)
  • Exercise 10
  • Exercise 11
  • Exercise 12

Backlinks

  • Message passing

CS3210 · AY2026/27 Semester 2

Built with Quartz