Lecture 8: GPU Computing Intro. The CUDA Programming Model. CUDA Execution Configuration.

Lecture Summary

• Flynn's Taxonomy

• Amdahl's Law

• Start GPU computing

Flynn's Taxonomy

• SISD: Single Instruction/Single Data

• SIMD: Single Instruction/Multiple Data

• MISD: Multiple Instruction/Single Data

• MIMD: Multiple Instruction/Multiple Data

Amdahl's Law (Law of Diminishing Returns)

The overall speedup relies on the worst-performing sections the most (see more explanations here).

GPU Computing with CUDA

Fermi

Volta

Ampere