Repository logo
 

A compiler for hierarchical task-based programming on distributed-memory

Simple item page
dc.contributor.authorDubois, Alexandre, author
dc.contributor.authorPouchet, Louis-Noël, advisor
dc.contributor.authorRajopadhye, Sanjay, committee member
dc.contributor.authorWilson, James, committee member
dc.date.accessioned2022-05-30T10:21:45Z
dc.date.available2022-05-30T10:21:45Z
dc.date.issued2022
dc.description.abstractToday, computation intensive applications are run on heterogeneous clusters of machines and use the Message Passing Interface (MPI), which provides a library interface for message-passing between non-shared memory computational resources but comes at a high application development cost. Task-based programming, such as the Concurrent Collection (CnC) model, makes parallelism implicit by only describing task dependencies. This model has recently been extended to model programs with a hierarchical task-based representation, which allows to view tasks at different levels of decomposition, allowing to dispatch tasks of different level optimally to the different available architectures. This thesis main work was to design an algorithm following a graph-based approach to transform a restricted class of single-level regular kernel to a two-level representation in the CnC model extended with hierarchical concepts. This transformation will alleviate performance boost by reducing communication cost and allowing the use of optimized tasks implementation at a coarse level. After describing the CnC programming model concepts, the structure of the proposed graph based tiling algorithm will be developed. Then, the compiler implementing this algorithm on an Intermediate Representation representing a CnC program and generating a C++ version of the kernel using a new hierarchical CnC runtime. Finally, the overhead of this runtime on a shared memory system for a 3D synthetic benchmark representing a classic linear-algebra dependency pattern. This characterization is done to help the user choose the target volume of tasks tile that has to be given as input of the tiling algorithm. The main recommendation is to target a minimization of the number of super- tasks in the runtime while keeping the number of sub-tasks in every super-task under the order of 10000 sub-tasks.
dc.format.mediumborn digital
dc.format.mediummasters theses
dc.identifierDubois_colostate_0053N_17207.pdf
dc.identifier.urihttps://hdl.handle.net/10217/235247
dc.languageEnglish
dc.language.isoeng
dc.publisherColorado State University. Libraries
dc.relation.ispartof2020-
dc.rightsCopyright and other restrictions may apply. User is responsible for compliance with all applicable laws. For information about copyright law, please see https://libguides.colostate.edu/copyright.
dc.subjectcontrol data flow graph
dc.subjecttiling
dc.subjecttask-based programming
dc.subjectcompiler
dc.titleA compiler for hierarchical task-based programming on distributed-memory
dc.typeText
dcterms.rights.dplaThis Item is protected by copyright and/or related rights (https://rightsstatements.org/vocab/InC/1.0/). You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).
thesis.degree.disciplineComputer Science
thesis.degree.grantorColorado State University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science (M.S.)

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Dubois_colostate_0053N_17207.pdf
Size:
1.02 MB
Format:
Adobe Portable Document Format
Download

Collections

2020-
Theses and Dissertations