Introduction to Parallel Computing/High Performance Computing

Weekly outline

• 

  General

  This course contains some of the lecture videos of the undergraduate introduction to parallel computing (CENG478) at METU Department of Computer Engineering in Spring 2021. Videos are not complete since some discussions were conducted live during the online lectures, however they could still serve well as an introduction to High Performance Computing (HPC).  

  Instructor: Murat Manguoğlu

  Acknowledgement:  These video  lectures are mostly based on the book "Introduction to Parallel Computing" by Kumar, V., Grama, A., Gupta, A., & Karypis, G.  

  • Introduction File
  • Architectures File
  • Applications File
  • Software Ecosystem File
  • Introduction to MPI File
  • Performance metrics File
  • Network performance and topologies File
  • One to all broadcast/all to one reduction File
  • All to all broadcast/all to all reduction File
  • All reduce File
  • Scatter/Gather File
  • Prefix sum File
  • Graph embeddings File
  • Computational intensity performance model and BLAS File
  • BLAS Library File
  • Roofline performance model File
  • Matrix storage schemes File
  • Vector-vector operations File
  • Dense matrix-vector multiplication File
  • Tridiagonal and banded matrix-vector multiplication File
  • Triangular matrix-vector multiplication File
  • Sparse matrix-vector multiplication File
  • Sorting File
  • FFT File
  • Graph partitioning File
  • Search algorithms for discrete optimization File
  • Principles of parallel algorithm design File
  • Announcements Forum