Overview

• This course provides an introduction to parallel and distributed computing and practical experiences in writing parallel programs on a cluster of computers.
• You will learn about the following topics:
  • Parallel Computers,
  • Message Passing Computing,
  • Embarrassingly Parallel Computations,
  • Partitioning and Divide-and-Conquer Strategies,
  • Pipelined Computations,
  • Synchronous Computations,
  • Load Balancing,
  • Programming with Shared Memory
• Topics might be classified into two main parts as;
  1. Parallel computers: architectural types, shared memory, message passing, interconnection networks, potential for increased speed.
  2. Basic techniques: embarrassingly parallel computations, partitioning and divide and conquer, pipelined computations, synchronous computations, load balancing, shared memory programming.