Programming massively parallel processors : a hands-on approach /
David B. Kirk, Wen-mei W. Hwu.
- Third edition.
- xxii, 550 pages : illustrations, charts ; 24 cm.
Previous edition: 2013.
Includes bibliographical references and index.
Introduction -- Data parallel computing -- Scalable parallel execution -- Memory and data locality - Performance considerations -- Numerical considerations -- Parallel patterns: concolution -- Parallel patterns: prefix sum -- Parallel patterns: parallel histogram computation -- Parallel patterns: sparse matrix computation -- Parallel patterns: merge sort -- Parallel patterns: graph search -- CUDA dynamic parallelism -- Application case study: non-cartesian magnetic resonance imaging -- Application case study: molecular visualization and analysis -- Application case study: machine learning -- Parallel programming and computational thinking -- Programming a heterogeneous computing cluster -- Parallel programming with OpenACC -- More on CUDA and graphics processing unit computing -- Conclusion and outlook.
This book shows both student and professional alike the basic concepts of parallel programming and GPU architecture, exploring, in detail, various techniques for constructing parallel programs. Case studies demonstrate the development process, detailing computational thinking and ending with effective and efficient parallel programs. Topics of performance, floating-point format, parallel patterns, and dynamic parallelism are covered in-depth. This edition contains updated coverage of CUDA, including coverage of newer libraries, such as CuDNN, moved content that has become less important to appendices, added two new chapters on parallel patterns, and updated case studies to reflect current industry practices.