Foundations of High-Performance Computing

Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming offers a comprehensive reference on high-performance computing (HPC). Laying the groundwork for the companion text, High-Performance Computing: Applications and Frontiers, this book serves as a comprehensive introduction to the fundamental concepts, systems, and introductory programming techniques. It focuses on infrastructure, programming basics, and practical access to HPC systems, covering the evolution of HPC and offering an architectural overview of HPC systems. In addition, it explores resource management and performance metrics in parallel systems, discussing practical access to HPC and considering the concepts behind distributed and shared memory. Other sections focuses on OpenMP for multithreading, MPI programming, GPU computing, OpenACC, and CUDA, and parallel I/O, data management, filesystems, cloud based HPC, and virtualization. The book concludes with a reference and glossary, equipping the reader with a thorough grounding in the basics of HPC and providing a comprehensive, multidisciplinary guide on the principles and concepts that underpin high performance computing. It is designed for graduate students, early-career professionals, and researchers seeking to build a solid foundation in HPC. - Offers comprehensive coverage of modern high performance computing topics, including hybrid cloud HPC, quantum computing, and GPU optimization - Focuses on infrastructure, programming basics, and practical access to HPC systems - Provides hands-on examples, exercises, and access to code repositories to solidify practical understanding - Sits alongside its companion book, High-Performance Computing: Applications and Frontiers, to develop the reader's understanding and skills from introduction to advance level