COMP 790-033 Topics in Parallel Computing http://www.cs.unc.edu/~prins/Classes/790-033/ Fall 2022 Wed 2:45 - 5:15PM SN011 Aug 17 - Nov 30 in-person classroom instruction Instructor: Jan Prins (prins@cs.unc.edu) FB 334 office hours by appt or via zoom

Overview and Syllabus

• be able to design and analyze parallel algorithms for a variety of problems and computational models,
• be familiar with the hardware and software organization of high-performance parallel computing systems, and
• have experience with the implementation of parallel applications on high-performance computing systems, and be able to measure, tune, and report on their performance.

Details can be found in the course Syllabus.

Readings

1. Review PRAM overview for more examples of PRAM algorithms and complexity
2. Memory hierarchy in shared memory processors
3. OpenMP-4.5
4. Memory Consistency Models Tutorial
5. Hardware view of Synchronization and Consistency
6. BSP: QandA
7. Basic Communication Operations
8. Message Passing Interface

Lecture Materials

1. 01-Intro.pdf
2. 02-pram1.pdf
3. 03-smm1.pdf
4. 04-smm2.pdf
5. 05-smm3.pdf
6. 06-ccnuma1.pdf
7. 07-ccnuma2.pdf
8. 08-ccnuma3.pdf
9. Guest lecture on GPU computing by Lars Nyland, Nvidia
10. 10-bsp1.pdf
11. 11-bsp2.pdf
12. 12-mpi.pdf

Last update 11/2/2022