n

Textbooks

• Greg Andrews, "Foundation of Multithreaded, Parallel and Distributed Programming", Addison Wesley, 2000.
• C. Hughes, T. Hughes, "Professional Multicore Programming", Wiley Publishing Inc., 2008.

---

Lecture Notes

• Session 1: About this course
• Session 2: Introduction
• Session 3: Fundamentals of Concurrent Programming
  • Have a look at the sections 1.1, 1.2, 1.3, 1.4, 1.5 and 2.1 of the "Parallel and Distributed Computing Handbook", which is available both in Google Books and at the department's library.
  • Also take a look at the Parallel Computing Page at Wiki.
• Session 4: Parallel Programming Styles
  • See this resource for more details.
• Session 5: Shared Variable Programming
  • Please take a look at this document.
• Session 6: Thread Programming on Win32 platforms
  • For a detailed overview of thread programming on Win32 platform, see here.
• Session 7: POSIX Thread Programming
  • See this introductory slides first.
  • For a detailed programming guide using POSIX Threads, try this link.
  • An open source implementation of POSIX Threads for Win32 can be found here.
  • See this tutorial for pThread programming with C/C++.
• Session 7-1: Parallel Algorithms
• Session 8: Multicore Programming
  • Take a look at the first chapter of the second reference of the course, namely, "Professional Multicore Programming". The preferred material could be found here.
  • Take a look at this free e-book which is available at Cilk Arts website.
• Session 9: Fundamentals of Cilk++
• Session 10: More examples and tools for Cilk++
  • You can find a set of Cilk++ and Multicore course materials at Cilk Arts website.
  • To download an academic version of Cilk++, fill the form here and get your desired version.
  • Development guides can be found here for Cilk++ developers.
• Session 11: Simple Problems and Tips
• Session 12,13: OpenMP
  • Take a look at the official website of OpenMP at OpenMP.org.
  • Sample chapters of an MIT press book on OpenMP can be found here.
  • Take a look at this tutorial on OpenMP at Boston University.
  • Also take a look at external links of OpenMP page on Wikipedia.
• Session 14: Intel Threading Building Blocks (TBB)
  • Official website for Intel TBB can be found here.
  • Other tutorials and documentations could be found here.
• Session 15: Principles of Distributed Programming
• Session 16: Sockets & RPC
• Session 17: Message Passing Interface (MPI)
  • Useful documents and tutorials can be found here.
  • See also this link for other introductory materials. Take a look at this one as well.
  • Read more about two implementations of MPI, namely, LAM/MPI and OpenMPI.
• Session 18: Introduction to GPUs and CUDA
• Session 19: CUDA Programming Model
• Session 20: CUDA Threading Model
  • University of Illinois Nvidia CUDA course
  • See CUDA page at Wiki for more references.

---

Assignments

Please send me your assignments according the the rules defined here.

• Assignment 1 - Multithreaded Matrix Multiplication
• Assignment 2 - Cilk-ified Matrix Multiplication
  • See some exercises and solutions on Cilk++ here.
• Assignment 3 - Finding Prime Numbers Using OpenMP