Learning-Based Dynamic Pinning of Parallelized Applications in Many-Core Systems

Georgios C. Chasparis, Vladimir Janjic, Michael Rossbory, Kevin Hammond

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper introduces a learning-based framework for dynamic placement of threads of parallel applications to the cores of Non-Uniform Memory Access (NUMA) architectures. Adaptation takes place in two levels, where at the first level each thread independently decides on which group of cores (NUMA node) it will execute, and on the second level it decides to which particular core from the group it will be pinned. Naturally, these two adaptation levels run on different time-scales: a low-frequency switching for the NUMA-node adaptation, and a high-frequency switching for the CPU-node level adaptation. In addition, the learning dynamics have been designed to handle measurement noise and rapid variations in the performance of the threads. The advantage of the proposed learning scheme is the ability to easily incorporate any multi-objective criterion and easily adapt to performance variations during runtime. Our objective is to demonstrate that this framework is appropriate for supervising parallel processes and intervening with respect to better resource allocation. Under the multi-objective criterion of maximizing total completed instructions per second (i.e., both computational and memory-access instructions), we compare the performance of the proposed scheme with the Linux operating system scheduler. We have observed that performance improvement could be significant especially under limited availability of resources and under irregular memory-access patterns.

Original languageEnglish
Title of host publicationProceedings - 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2019
PublisherIEEE
Pages1-8
Number of pages8
ISBN (Electronic)9781728116440
ISBN (Print)9781728116457
DOIs
Publication statusPublished - 21 Mar 2019
Event27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2019 - Pavia, Italy
Duration: 13 Feb 201915 Feb 2019

Publication series

Name2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP)
ISSN (Print)1066-6192

Conference

Conference27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2019
CountryItaly
CityPavia
Period13/02/1915/02/19

Fingerprint Dive into the research topics of 'Learning-Based Dynamic Pinning of Parallelized Applications in Many-Core Systems'. Together they form a unique fingerprint.

  • Cite this

    Chasparis, G. C., Janjic, V., Rossbory, M., & Hammond, K. (2019). Learning-Based Dynamic Pinning of Parallelized Applications in Many-Core Systems. In Proceedings - 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2019 (pp. 1-8). [8671569] (2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP)). IEEE. https://doi.org/10.1109/EMPDP.2019.8671569