mca Syllabus

Parallel Programming
Code: CS 704C
Credits : 3
Module I [10]

Introduction : Computational demands on modern science, advent of practical parallel processing, parallel processing terminology.
PRAM algorithms : model of serial computation, PRAM model of parallel computation, PRAM algorithms, reducing the number of processors.

Module II [10]
Processes and processors. Processor organizations, Processor arrays, Multiprocessors, Multicomputers, FLYNN’s taxonomy, Shared memory. Fork. Join constructs. Basic parallel programming techniques- loop splitting, spin locks, contention barriers and row conditions.

Module III [10]
Variations in splitting, self and indirect scheduling. Data dependency-forward and backward block scheduling. Linear recurrence relations. Backward dependency. Performance tuning overhead with number of processes, effective use of cache.

Module IV [15]
Parallel programming examples: Average, mean squared deviation, curve fitting, numerical integration, Matrix multiplication, sorting, travelling salesman problem, Gaussian elimination. Discrete event time simulation.

Parallel Programming Languages :Fortran 90, C*,Sequent C, OCCAM,C- Linda,
Parallel programming under Unix.

Books:
1.Parallel Computing, Quinn,TMH
2.Introduction to Parallel Processing ,Sashi Kumar,PHI
3.Parallel Programming, Wilkinson, Pearson
4.Elements of Parallel Computing, Rajaraman,PHI
5.Fundamentals of Parallel Processing, Jordan, PHI
6. Advanced Computer Architecture, Hwang, TMH