Introduction to Parallel Computing

A comprehensive guide for students and practitioners to parallel computing models, processes, metrics, and implementation in MPI and OpenMP.

Zbigniew J. Czech (Author)

9781107174399, Cambridge University Press

Hardback, published 11 January 2017

378 pages
26 x 18.5 x 2 cm, 0.9 kg

The constantly increasing demand for more computing power can seem impossible to keep up with. However, multicore processors capable of performing computations in parallel allow computers to tackle ever larger problems in a wide variety of applications. This book provides a comprehensive introduction to parallel computing, discussing theoretical issues such as the fundamentals of concurrent processes, models of parallel and distributed computing, and metrics for evaluating and comparing parallel algorithms, as well as practical issues, including methods of designing and implementing shared- and distributed-memory programs, and standards for parallel program implementation, in particular MPI and OpenMP interfaces. Each chapter presents the basics in one place followed by advanced topics, allowing novices and experienced practitioners to quickly find what they need. A glossary and more than 80 exercises with selected solutions aid comprehension. The book is recommended as a text for advanced undergraduate or graduate students and as a reference for practitioners.

1. Concurrent processes
2. Basic models of parallel computation
3. Elementary parallel algorithms
4. Designing parallel algorithms
5. Architectures of parallel computers
6. Message-passing programming
7. Shared-memory programming
Solutions to selected exercises
Glossary.

Subject Areas: Computer architecture & logic design [UYF], Distributed systems [UTR], Computer hardware [UK]