Ardhendu Mandal
| | | | |

M.Sc (Sem-iV)-PXVII: Parallel Programming

M.Sc (Semester-IV), Paper-XVII: Parallel Programming
Syllabus

Processes and processors, shared memory, fork join constructs, basic parallel programming techniques loop spliting, spin locks, contention barriers and row conditions.
Variations in splitting, self and indirect scheduling, data dependency forward and backward block scheduling.
Linear recurrence relations, backward dependency, performance tuning overhead with number of processes, effective use of cache.
Parallel programming examples: Average, mean squared deviation, curve fitting, numerical integration, travelling salesman problem, Guassian elimination, and discrete event time simulation.
Parallel programming constructs in HPF, Fortran 95,parallel programming under Unix.

References

Brawer, S.,"Introduction to parallel processing", Academic press, New York, 1989.

 

Parallel Programming E-Books Download Centre
Professional and Standards Organizations
eBook_High Performence Computing for Dummies(Click to Download)
MPI Tutorial(Click to Download)
An Introduction to MPI(Click to Download)

1. An Introduction to Parallel Programming by Tobias Wittwer
2. HOW TO WRITE PARALLEL PROGRAMS by David Gelernter
3. Parallel Programming IGNOU Study Material
4. Tutorial_Developing Parallel Programs By Ranjan Sen
5. Practical MPI Programming Yukiya Aoyama
6. Using MPI: Portable Parallel Programming with the Message-Passing Interface
7. Software Optimization for High Performance Computing: Creating Faster Applications
8. Using OpenMP: Portable Shared Memory Parallel Programming
9. Concurrent Scientific Computing

10. Recommended especially for high-performance (serial) computing:
10.1 Performance Optimization of Numerically Intensive Codes (Software, Environments and Tools)
10.2 High Performance Computing (RISC Architectures, Optimization & Benchmarks)
10.3 Computer Architecture: A Quantitative Approach
10.4 Write Great Code: Volume 1: Understanding the Machine

11. Recommended as excellent for a more general scientific computing perspective:
11.1 Writing Scientific Software: A Guide to Good Style
11.2 Expert C Programming
11.3 Programming Massively Parallel Processors: A Hands-on Approach
11.4 The Software Optimization Cookbook: Second Edition High-Performance Recipes for IA-32 Platforms
11.5 Numerical Linear Algebra for High Performance Computers

12. Old and new MPI standards as PDF documents:
13. Petascale Computing (Chapman & Hall/Crc Computational Science Series)
14. Sourcebook of Parallel Computing
15. Introduction to Parallel Computing, 2nd edition
16 Chapman, B., Jost, G., and Pas, R. 2007 Using Openmp: Portable Shared Memory Parallel Programming
17. Rauber, Thomas, Rünger, Gudula, Parallel Programming : for Multicore and Cluster Systems
18. PDC's HPC Book List

IEEE
ACM
SEI
Federation of American Scientists
International Council on Systems Engineering
International Organization for Standardization
Interoperability Clearinghouse
National Information Standards
The Project Management Institute
Software Engineering Research Laboratory
System of Systems Engineering Center of Excellence

 

Parallel Programming Resources Links
Parallel Programming Journals, Magazines
List of Parallel ProgrammingConferences

MPI_PllProg(PPT)

NCCS HPC Systems
OpenMP Org
Nan's Parallel Computing Page
Parallel Computing-Rasid Bin Muhammad's Web Page



| | | | |
Last update Mar 03, 2012. Copyright © Ardhendu Mandal.