Parallel programming - Definition and Overview

Parallel programming (also concurrent programming), is a computer programming technique that provides for the execution of operations concurrently, either within a single computer, or across a number of systems. In the latter case, the term distributed computing is used. Multiprocessor machines achieve better performance by taking advantage of this kind of programming.

In parallel programming, single tasks are split into a number of subtasks that can be computed relatively independently and then aggregated to form a single coherent solution. Parallel programming is most effective for tasks that can easily broken down into independent tasks such as purely mathematical problems, e.g. factorisation.

One way to achieve parallel programming is through distributed computing, which is a method of information processing in which work is performed by separate computers linked through a communications network.

Pioneers in the field of concurrent programming include Edsger Dijkstra and C. A. R. Hoare.

See also

• Concurrent programming language
• Critical sections
• Mutual exclusion
• Synchronization
• Computer multitasking
• Multithreading
• Concurrency control
• Coroutines
• Parallel processor
• Completion ports

External links

• Article "Multiprocessor Optimizations: Fine-Tuning Concurrent Access to Large Data Collections (http://msdn.microsoft.com/msdnmag/issues/01/08/concur/default.aspx)" by Ian Emmons
• Article "The Free Lunch Is Over: A Fundamental Turn Toward Concurrency in Software (http://gotw.ca/publications/concurrency-ddj.htm)" by Herb Sutter
• Citations from CiteSeer (http://citeseer.ist.psu.edu/cis?q=parallel+and+programming)