Rui's Blog
Search
⌃K

Lecture 8: GPU Computing Intro. The CUDA Programming Model. CUDA Execution Configuration.

Lecture Summary

  • Flynn's Taxonomy
  • Amdahl's Law
  • Start GPU computing

Flynn's Taxonomy

  • SISD: Single Instruction/Single Data
  • SIMD: Single Instruction/Multiple Data
  • MISD: Multiple Instruction/Single Data
  • MIMD: Multiple Instruction/Multiple Data

Amdahl's Law (Law of Diminishing Returns)

The overall speedup relies on the worst-performing sections the most (see more explanations here).

GPU Computing with CUDA

Fermi
Volta
Ampere