Introduction: Scope and issues of parallel and distributed computing.


Models Of Parallel Computing: Taxonomy of parallel structures, Control mechanism, Address-Space Organization, Interconnection connection networks: Static and Dynamic interconnection networks, evaluating static interconnection networks, embedding other networks (Linear Array, Mesh, Binary Tree) into a hypercube; Routing mechanisms for static interconnection networks: Store and Forward (SF) Routing; Cut - Theory (CT) Routing; Cost-Performance trade-off; Architectural Models for Parallel Algorithm design.

Basic Communication Operation: Simple message transfer between two processors; One-to-all broadcast; All-to-all broadcast; Reduction and prefix sums; One-to-all personalized communication; All-to-all personalized communication; circular shift.

Performance And Scalability Of Parallel Systems: Performance matrices for Parallel systems: Run time, Speed up, Efficiency and Cost; The effect of granularity and data mapping on performance; Scalability of parallel systems; Iso-efficiency metric of scalability;

Models Of Distributed Computing: Mini computer model; Workstation pool model; Client-server model; Pool of processors model; Hybrid model.

Networking And Internetworking: Network technologies and Protocols.

Inter process Communication And Remote Procedure Calling: Building blocks; Client-server communication; group communication; Case study: Inter processor communication in UNIX; Design issues in Remote procedure calling; Implementation; Case Studies: SUN and ANSA;

Parallel Computing Algorithms: Various sorting and searching algorithms, performance metrics for parallel algorithm implementations.



Recommended Books

  1. Vipin Kumar, Ananth Grama, Anshul Gupta and George Karypis Introduction to Parallel Computing, Addison Wesley (2003) 2nd ed.
  2. George Coulouris, Jean Dollimore and Tim Kindberg; Distributed Systems Concepts and Design, Addison-Wesley (2000) 3rd ed.
  3. S G Akl, The Decision and Analysis of Parallel Algorithms, Prentice Hall (1989).
  4. Hwang, Kai, Advanced Computer Architecture: Parallelism, Scalability, Programmability, McGraw Hill (1992).
  5. J Jaja, An Introduction to Parallel Algorithms, Addison Wesley (1992).
  6. T G Lewis and H El Rewini; Introduction to Parallel Computing, Prentice-Hall (1992).
  7. M J Quinn,Parallel Computing: Theory and Practice, McGraw Hill (1994) 2nd ed.