next up previous contents
Next: Communicating with other processes Up: Introduction to MPI Previous: Parallel Computing   Contents

Types of parallel computing

All use different data for each worker
Data-parallel
Same operations on different data. Also called SIMD.
SPMD
Same program, different data.
MIMD
Different programs, different data.
SPMD and MIMD are essentially the same because any MIMD can be made SPMD.
SIMD is also equivalent, but in a less practical sense. MPI is primarily for SPMD/MIMD.

Cem Ozdogan 2006-12-27