POSE: Phase I: FOREST: Fostering an Open-source Runtime Eco-system for the Task-based System PaRSEC

University Of Tennessee Knoxville, Knoxville TN

Investigators

Abstract

This Pathways to Enable Open-Source Ecosystems (POSE) project establishes a sustainable open-source ecosystem for the PArallel Runtime Scheduler and Execution Controller (PaRSEC) software framework. PaRSEC is an execution environment designed for scientific applications running on advanced, large-scale high-performance computers. It orchestrates the execution of computing tasks, manages data movement, and allocates the resources needed to efficiently run scientific applications on supercomputers. PaRSEC improves the performance and scaling of demanding, large-scale applications in areas that include advanced materials modeling, seismology, and artificial intelligence. It also supports research into novel mathematical algorithms that underlie a wide array of scientific computing problems. This project cultivates a sustainable, openly governed, open-source ecosystem around the PaRSEC software so that it can be supported by a broad community of contributors and users. Ultimately, widespread adoption of the PaRSEC runtime system promotes more efficient use of national computational resources and accelerates scientific and technological progress for the benefit of society. This POSE project will establish a pathway for the PaRSEC project to transition from its current centralized development model to an open-source, distributed community ecosystem. PaRSEC works by describing applications as parameterized task graphs. At runtime, a directed acyclic graph (DAG) of execution tasks is generated, where nodes represent computing tasks and edges represent the flow of data between them. This approach eliminates unnecessary synchronization points and enables full utilization of computing resources, freeing application developers from the burden of explicitly managing communication. The PaRSEC runtime system has been successfully applied in domains ranging from quantum chemistry to seismology. Although PaRSEC was originally developed in a centralized manner at a single institution, its developer and user bases have since expanded to multiple institutions. This project will support further community growth by establishing development standards, best practices, and onboarding materials to better support open community development and governance models and to build a sustainable open-source ecosystem for PaRSEC. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.