Question

I’m looking for books or online resources that go in detail over programming techniques for high performance computing using C++.

Answer 1

practically all HPC code I’ve heard of is either for solving sytems of linear equations or FFT’s. Heres some links to start you off at least in the libraries used:

• BLAS – standard set of routines for linear algebra – stuff like matrix multiplication
• LAPACK – standard set of higher level linear algebra routines – stuff like LU decomp.
• ATLAS – Optimized BLAS implementation
• FFTW – Optimized FFT implementation
• PBLAS – BLAS for distributed processors
• SCALAPACK – distributed LAPACK implementation
• MPI – Communications library for distributed systems.
• PETSc – Scalable nonlinear and linear solvers (user-extensible, interface to much above)