Section: Partnerships and Cooperations

International Initiatives

Inria Associate Teams

DALHIS

• Title: Data Analysis on Large Heterogeneous Infrastructures for Science

• Inria principal investigator: Christine Morin

• International Partner:

  • Lawrence Berkeley National Laboratory (United States) - Advanced Computing for Science department led by Deb Agarwal

• Duration: 2013 - 2015

• See also: http://project.inria.fr/dalhis

• The worldwide scientific community is generating large datasets at increasing rates causing data analysis to emerge as one of the primary modes of science. Existing data analysis methods, tools and infrastructure are often difficult to use and unable to handle the “data deluge”. A scientific data analysis environment needs to address three key challenges: a) programmability: easily user composable and reusable programming environments for analysis algorithms and pipeline execution, b) agility: software that can adapt quickly to changing demands and resources, and, c) scalability: take advantage of all available resource environments including desktops, clusters, grids, clouds and HPC environments. The goal of the DALHIS associated team is to coordinate research and create together a software ecosystem to facilitate data analysis seamlessly across desktops, HPC and cloud environments. Specifically, our end goal is to build a dynamic environment that is user-friendly, scalable, energy-efficient and fault tolerant through coordination of existing projects. We plan to design a programming environment for scientific data analysis workflows that will allow users to easily compose their workflows in a programming environment such as Python and execute them on diverse high-performance computing (HPC) and cloud resources. We will develop an orchestration layer for coordinating resource and application characteristics. The adaptation model will use real-time data mining to support elasticity, fault-tolerance, energy efficiency and provenance. We will investigate how to provide execution environments that allow users to seamlessly execute their dynamic data analysis workflows in various research environments.

Inria International Partners

Informal International Partners

We collaborate on cloud computing with Stephen Scott, Professor at Tennessee Tech University (TTU) and researcher at Oak Ridge National Laboratory (ORNL). He visited Myriads team in September 2013 to investigate research directions for future joint work on cloud computing for scientific applications. We also collaborate on cloud computing with Kate Keahey from Argonne National Laboratory. She chairs the Contrail European project scientific advisory board. Nikos Parlavantzas is involved in an informal collaboration with Héctor Duran Limon, Professor at the University of Guadalajara, Mexico, who came for a 1 week visit in February 2013.

Inria International Labs

Christine Morin was the Inria@Silicon Valley scientific manager until August 2013. She co-organized with Eric Darve, professor at Stanford University and the Inria international relations department the Berkeley-Inria-Stanford workshop (BIS 2013) held at Stanford University in May 2013. Several Myriads team members (Eugen Feller, Christine Morin, Anne-Cécile Orgerie, Cédric Tedeschi) are involved in the DALHIS associate team on data analysis on large-scale heterogeneous infrastructures for science, which is part of the Inria@SiliconValley program. She was also involved in an informal collaboration with the CITRIS Social Apps Lab, led by James Holston and Greg Niemeyer from UC Berkeley. Collaboration opportunities between Inria and the Social Apps Lab on smart cities and social sustainability were investigated.