Programming in Parallel with CUDA
A Practical Guide

A handy guide to speeding up scientific calculations with real-world examples including simulation, image processing and image registration.

Richard Ansorge (Author)

9781108479530, Cambridge University Press

Hardback, published 2 June 2022

395 pages
26 x 18.1 x 2.5 cm, 1.15 kg

CUDA is now the dominant language used for programming GPUs, one of the most exciting hardware developments of recent decades. With CUDA, you can use a desktop PC for work that would have previously required a large cluster of PCs or access to a HPC facility. As a result, CUDA is increasingly important in scientific and technical computing across the whole STEM community, from medical physics and financial modelling to big data applications and beyond. This unique book on CUDA draws on the author's passion for and long experience of developing and using computers to acquire and analyse scientific data. The result is an innovative text featuring a much richer set of examples than found in any other comparable book on GPU computing. Much attention has been paid to the C++ coding style, which is compact, elegant and efficient. A code base of examples and supporting material is available online, which readers can build on for their own projects.

1. Introduction to GPU kernels and hardware
2. Thinking and coding in parallel
3. Warps and cooperative groups
4. Parallel stencils
5. Textures
6. Monte Carlo applications
7. Concurrency using CUDA streams and events
8. Application to PET scanners
9. Scaling up
10. Tools for profiling and debugging
11. Tensor cores
A. A brief history of CUDA
B. Atomic operations
C. The NVCC complier
D. AVX and the Intel complier
E. Number formats
F. CUDA documentation and libraries
G. The CX header files
H. AI and Python
I. Topics in C++
Index.

Subject Areas: Mathematical theory of computation [UYA], Computer programming / software development [UM], Mathematical & statistical software [UFM], Information technology: general issues [UB], Engineering graphics & technical drawing [TBG]