DATALAKES

Heterogeneous data platform for operational modelling and forecasting of Swiss lakes

Started
February 1, 2019
Status
Completed
Share this project

Abstract

The objective of this project is to advance the forecasting capabilities of the data-driven hydrological and ecological lake modeling algorithms using methodologies inspired by data science and accelerated by high performance computing.

We aim to develop a parallel framework interfacing high resolution 3D numerical solvers for the underlying lake dynamics with modern numerical Markov Chain Monte Carlo sampling methods for Bayesian inference, with particular interest in investigating particle filtering and multi-level variance reduction methodologies. The resulting framework aims at accurate data assimilation and uncertainty quantification in both model parameters and the associated forecasts.

DATALAKES project is a collaboration with the Swiss Data Science Center (SDSC), EPF Lausanne and ETH Zurich, aiming at a sensor-to-frontend data platform providing and analyzing the dynamics of lake ecosystems at high spatial and temporal resolutions. Current version of the existing framework can be found at meteolakes.ch.

People

Collaborators

SDSC Team:
Eric Bouillet
Firat Ozdemir
Fernando Perez-Cruz
Fotis Georgatos
Emma Jablonski

PI | Partners:

Eawag, Scientific Computing Group:

  • Dr. Jonas Sukys
  • Dr. Artur Safin
  • James Runnalls

More info

Eawag, Aquatic Physics:

  • Dr. Damien Bouffard

More info

EPFL, Aquatic Systems Laboratory:

  • Prof. Dr. Alfred Johny Wüest

More info

description

Problem:

  • Increasing pressure on lakes needs scientific support
  • 3D numerical simulations of lakes require input data – uncertainty quantification in parameters & forecast
  • New L’EXPLORE platform in Lake Geneva – increasing availability of high resolution data

Solution:

  • Sensor-to-frontend open data platform
  • Physics-driven hydrodynamic models
  • Data-driven modeling of input data processes
  • Parallel Bayesian inference – MCMC with ABC or PF
  • Multi-level speedup – hierarchical numerical models
  • Powered by Renku, the SDSC-developed platform for transparency and reproducibility in science
  • A neural network with uncertainty quantification properties in order to more accurately aggregate data from satellite imagery into the Bayesian inference

Impact

  • Real time monitoring & future forecast of lakes
  • Platform for large-scale interdisciplinary collaborations
  • Research in hydrological / ecological lake modeling
  • Scientifically grounded water resources management

Gallery

Annexe

Publications

  • D. Bouffard, J Runnalls, T Baracchini, E Bouillet, H E Chmiel, T Doda, B Fernández Castro, F Georgatos, S Lavanchy, C Minaudo, F Ozdemir, D Odermatt, M-E Perga, P Perolo, S Piccolroaz, M Plüss, L Råman Vinnå, M Schmid, A Safin, J Šukys, V Tran-Khac, H N. Ulloa, C L. Ramón, A Wüest. Datalakes, a data platform for Swiss lakes. In prep for Earth System Data Science
  • Safin, A., Bouffard, D., Ozdemir, F., Ramón, C. L., Runnalls, J., Georgatos, F., Minaudo, C., and Šukys, J.: A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1, Geosci. Model Dev., 15, 7715–7730, A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1 , 2022

Bibliography

Publications

Tagasovska, N.; Ozdemir, F.; Brando, A.; Ruiz, F.; Dy, J.; van de Meent, J. "Retrospective Uncertainties for Deep Models using Vine Copulas" Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, 206 7528–7539 2023 View publication
Safin, A.; Bouffard, D.; Ozdemir, F.; Ramon, C. L.; Runnalls, J.; Georgatos, F.; Minaudo, C.; Šukys, J. "A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1" Geoscientific Model Development, 15 20.0 7715-7730 2022 View publication
Safin, A.; Bouffard, D.; Runnalls, J.; Georgatos, F.; Bouillet, E.; Ozdemir, F.; Perez Cruz, F.; Šukys, J. "Data assimilation in lake Geneva using the SPUX framework" EGU General Assembly Conference Abstracts, 19564 2020 View publication

Related Pages

More projects

ML-L3DNDT

Completed
Robust and scalable Machine Learning algorithms for Laue 3-Dimensional Neutron Diffraction Tomography
Big Science Data

BioDetect

Completed
Deep Learning for Biodiversity Detection and Classification
Energy, Climate & Environment

IRMA

In Progress
Interpretable and Robust Machine Learning for Mobility Analysis
Engineering

FLBI

In Progress
Feature Learning for Bayesian Inference
No items found.

News

Latest news

AIXD | Generative AI toolbox for architects and engineers
January 22, 2025

AIXD | Generative AI toolbox for architects and engineers

AIXD | Generative AI toolbox for architects and engineers

Introducing AIXD (AI-eXtended Design), a toolbox for forward and inverse modeling for exhaustive design exploration.
Smartair | An active learning algorithm for real-time acquisition and regression of flow field data
May 1, 2024

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

Smartair | An active learning algorithm for real-time acquisition and regression of flow field data

We’ve developed a smart solution for wind tunnel testing that learns as it works, providing accurate results faster. It provides an accurate mean flow field and turbulence field reconstruction while shortening the sampling time.
The Promise of AI in Pharmaceutical Manufacturing
April 22, 2024

The Promise of AI in Pharmaceutical Manufacturing

The Promise of AI in Pharmaceutical Manufacturing

Innovation in pharmaceutical manufacturing raises key questions: How will AI change our operations? What does this mean for the skills of our workforce? How will it reshape our collaborative efforts? And crucially, how can we fully leverage these changes?

Contact us

Let’s talk Data Science

Do you need our services or expertise?
Contact us for your next Data Science project!