Network-Theoretic Classification of Parallel Computation Patterns

Citation

S. Whalen, S. Engle, S. Peisert, and M. Bishop, “Network-Theoretic Classification of Parallel Computation Patterns,” International Journal of High Performance Computing 26(2) pp. 159–169 (May 2012).

Paper

Published version web page, paywalled at Sage Journals web site: [DOI] [URL]

Abstract

Parallel computation in a high-performance computing environment can be characterized by the distributed memory access patterns of the underlying algorithm. During execution, networks of compute nodes exchange messages that indirectly exhibit these access patterns. Identifying the algorithm underlying these observable messages is the problem of latent class analysis over information flows in a computational network. Towards this end, our work applies methods from graph and network theory to classify parallel computations solely from network communication patterns. Pattern classification has applications to several areas including anomaly detection, performance analysis, and automated algorithm replacement. We discuss the difficulties encountered by previous efforts, introduce two new approximate matching techniques, and compare these approaches using massive datasets collected at Lawrence Berkeley National Laboratory.

Bibliographic Information: [BibTeX] [EndNote] [RIS]
DOI: 10.1177/1094342012436618