book chapter · 2025
Parallel computing architecture
Cited by 0Abstract and details only
Abstract
Flynn’s classification of computer organization for fast computers according to the number of simultaneously manipulated instructions/data items, consists of categories named as single stream of instruction with single stream of data (SISD), single stream of instruction with multiple streams of data (SIMD), multiple streams of instructions with single stream of data (MISD) and multiple streams of instructions with multiple streams of data (MIMD). Distinctive problems facing processing units for artificial intelligence (AI) are outlined. AI computing lays a heavy burden on the processor of a computer, which can be appreciably relieved by adopting a parallel computing architecture. Parallel programming patterns include the master–slave pattern, divide-and-conquer pattern, pipelining and speculative multithreading. Among the types of parallelism, mention may be made of bit-level parallelism; data parallelism including vector processing; task parallelism including the pipelining scheme; and instruction-level parallelism (ILP) including the superscalar processor architecture, out-of-order execution, speculative execution, and multiple issue processors. Advantages and disadvantages of ILP are enumerated. Parallelism in software engineering is done by application checkpointing, automatic parallelization and through parallel programming languages. Several types of parallel processors are discussed, notably the pipelined, vector, SIMD array and attached array processors. Multicore and multiprocessor processors are demarcated. Asynchronous operation of an array processor is described.
Cite this paper
Khanna, V. K. (2025). Parallel computing architecture. https://doi.org/10.1088/978-0-7503-6259-7ch4
Khanna, Vinod Kumar. “Parallel computing architecture.” 2025, pp. 4–1, https://doi.org/10.1088/978-0-7503-6259-7ch4.
Khanna, Vinod Kumar. 2025. “Parallel computing architecture.” https://doi.org/10.1088/978-0-7503-6259-7ch4.
Khanna, V.K. (2025) ‘Parallel computing architecture’. Available at: https://doi.org/10.1088/978-0-7503-6259-7ch4.
@incollection{khanna2025parallel,
title = {{Parallel computing architecture}},
author = {Khanna, Vinod Kumar},
pages = {4--1},
year = {2025},
doi = {10.1088/978-0-7503-6259-7ch4}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.