دانلود کتاب برنامه نویسی چند هسته ای و GPU

Parallel computing has been given a fresh breath of life since the emergence of multicore architectures in the first decade of the new century. The new platforms demand a new approach to software development; one that blends the tools and established practices of the network of workstations (NoW) era with emerging software platforms such as CUDA. This book tries to address this need by covering the dominant contemporary tools and techniques, both in isolation and, most importantly, in combination with each other. We strive to provide examples where multiple platforms and programming paradigms (e.g., message passing and threads) are effectively combined. “Hybrid” computation, as it is usually called, is a new trend in high-performance computing, one that could possibly allow software to scale to the “millions of threads” required for exascale performance. All chapters are accompanied by extensive examples and practice problems. Whenever possible multiple design alternatives are pursued and compared. All the little details that can make the difference between productive software development and a futile exercise are presented in an orderly fashion. The book covers the latest advances in tools that have been inherited from the 1990s (e.g., the OpenMP and MPI standards), but also more cutting-edge platforms, such as the C++11 thread support, the Qt library with its sophisticated thread management, and the Thrust template library with its capability to deploy the same software over diverse multicore architectures, including both CPUs and GPUs. We could never accomplish the feat of covering all the tools available for multicore development today. Even some of the industry standard ones, like POSIX threads, are omitted. Our goal is to sample the dominant paradigms (ranging from OpenMP’s semiautomatic parallelization of sequential code to the explicit communication “plumping” that underpins MPI), while at the same time explaining the rationale and how-to behind efficient multicore program development.