Section: Partnerships and Cooperations

National Initiatives

Project Acronym:

OverFlow.

Project Title:

Workflow Data Management as a Service for Multisite Applications.

Coordinator:

Alexandru Costan.

Duration:

Octobre 2015–October 2019.

Other Partners:

None (Young Researcher Project).

External collaborators:

Kate Keahey (University of Chicago and Argonne National Laboratory), Bogdan Nicolae (Argonne National Lab).

Abstract:

This JCJC project led by Alexandru Costan investigates approaches to data management enabling an efficient execution of geographically distributed workflows running on multi-site clouds.

In 2018, we focused on the challenges of executing workflows on hybrid environments combining the Cloud and the Edge. First, processing live data sources at the Edge can offer a potential solution that deals with the explosion of data sizes, as the data is filtered and aggregated locally, before it gets a chance to accumulate. Then, partial results instead of full data are sent to the Cloud for stream processing. In this context, we designed Planner, a middleware for uniform and transparent stream processing across Edge and Cloud. Planner automatically selects which parts of the execution graph will be executed at the Edge in order to minimize the network cost. We also focused on understanding the conditions that enable the usage of Edge or Cloud to improve the performance or reduce costs of an application.

Project Acronym:

HPC-BigData

Project Title:

The HPC-BigData Inria Project Lab

Coordinator:

Bruno Raffin.

Duration:

2018–2022.

Abstract:

The goal of this HPC-BigData IPL is to gather teams from the HPC, Big Data and Machine Learning (ML) areas to work at the intersection between these domains. Research is organized along three main axes: high performance analytics for scientific computing applications, high performance analytics for big data applications, infrastructure and resource management. Gabriel Antoniu is a member of the Advisory Board and leader of the Frameworks work package.

Project Acronym:

ADT Damaris

Project Title:

Technology development action for te Damaris environment.

Coordinator:

Alexandru Costan.

Duration:

2016–2018.

Abstract:

This action aims to support the development of the Damaris software. Inria's Technological Development Office (D2T, Direction du Développement Technologique) provided 2 years of funding support for a senior engineer.

Hadi Salimi has been funded through this project to document, test and extend the Damaris software and make it a safely distributable product.

In 2018, the main goal was to enforce the support Damaris provides for HDF5 storage.