Computer Architecture for Scientists: Principles and Performance

Description

The dramatic increase in computer performance has been extraordinary, but not for all computations: it has key limits and structure. Software architects, developers, and even data scientists need to understand how exploit the fundamental structure of computer performance to harness it for future applications. Ideal for upper level undergraduates, Computer Architecture for Scientists covers four key pillars of computer performance and imparts a high-level basis for reasoning with and understanding these concepts: Small is fast - how size scaling drives performance; Implicit parallelism - how a sequential program can be executed faster with parallelism; Dynamic locality - skirting physical limits, by arranging data in a smaller space; Parallelism - increasing performance with teams of workers. These principles and models provide approachable high-level insights and quantitative modelling without distracting low-level detail. Finally, the text covers the GPU and machine-learning accelerators that have become increasingly important for mainstream applications.

Andrew A. Chien is William Eckhardt Professor at the University of Chicago, Director of the CERES Center for Unstoppable Computing, and a Senior Scientist at Argonne National Laboratory. Since 2017, he has served as Editor-in-Chief of the Communications of the ACM. He is currently a member of the National Science Foundation's CISE Directorate Advisory Board. Chien is a global research leader in parallel computing, computer architecture, clusters, and cloud computing, and has received numerous awards for his research. In 1994 he was named a National Science Foundation Young Investigator. Dr. Chien served as Vice President of Research at Intel Corporation from 2005-2010, and on advisory boards for the National Science Foundation, Department of Energy, Japan RWCP, and distinguished universities such as Stanford, UC Berkeley, EPFL, and the University of Washington. From 1998-2005, he was SAIC Chair Professor at UCSD, and prior to that, a professor at the University of Illinois. Dr. Chien is a Fellow of the ACM, Fellow of the IEEE, and Fellow of the AAAS, and earned his PhD, MS, and BS from the Massachusetts Institute of Technology.

'Andrew Chien's Computer Architecture for Scientists: Principles and Practice is a timely and much-needed treatment of how computer architecture impacts the scalability and performance of the computing systems and the data-driven processes that operate at the upper levels of the software stack. Aimed at software engineers and data scientists, this book provides a holistic and principled coverage of technology-agnostic concepts that govern the interplay between hardware capabilities and software performance. Understanding this interplay is crucial as it allows practitioners not only to reason about the performance of the systems they develop, but in fact to design these systems in a way that leverages the architectural features of the hardware systems on which they are built.' Azer Bestavros, Associate Provost for Computing and Data Sciences, Boston University 'This is a very timely book on computer architecture aimed at the new generation of computational scientists and data scientists. The end of Dennard Scaling, coupled with the breakthrough of Deep Neural Networks in Machine Learning, has led to the need for a radical re-think in the teaching of computer architecture. Andrew Chien's book addresses this need and gives scientific software developers a high-level understanding of the emerging computer architectures and the design principles they require to obtain maximum computer performance from their programs.' Tony Hey, Chief Data Scientist, Rutherford Appleton Lab, U.K. 'Hurray for Computer Architecture for Scientists! Finally, a book aimed squarely at the rising complexities at the intersection of Moore's Law scaling of technology and the dizzying array of diverse computer architectures that have resulted. General versus special-purpose, programmable versus configurable, and a growing basket of colors and flavors of parallelism. While these make sense to working computer architects and chip designers - what of scientists and engineers just trying to get stuff done? Chien does a splendid job of translating and demystifying why and how computer architectures matter, how users can understand them, and use these insights to wrestle them into submission to do good science.' Rob A. Rutenbar, Distinguished Professor of Computer Science and Electrical and Computer Engineering, University of Pittsburgh 'Andrew Chien's book connects the dots from interdependent architectural choices to underlying calculus of performance and in the process strikes a balance between high-level view of the machine and its realizations. It is essential that users of these tools have an intimate understanding of the principles and mechanisms that make computing machines deliver efficient and high performance without becoming hardware designers themselves. The book provides such insights through its succinctly stated principles that both educate and enlighten about fundamental abstractions in computing.' Rajesh Gupta, Professor of Computer Science and Engineering, University of California, San Diego