CLIMIS4AVAL

Real-time cleansing of snow and weather data for operational avalanche forecasting

Started
October 19, 2022
Status
In Progress
Share this project

Abstract

Avalanche forecasting relies on snow, snow cover and weather data – for expert evaluation as well as for machine learning based support tools. The data need to be accessible in high quality as soon as these become available. Any measurement errors, anomalies and data gaps diminish forecast accuracy.

Avalanche forecasting, physical snow models, hydrological predictions and many other Alpine scientific activities are largely data-driven; therefore, consistent and accurate data are fundamental for high-quality outputs. With increasing data volumes and the increased need for timely and accurate forecasts, preferably automated location-based forecasts, it becomes imperative to clean these essential data on the fly.

People

Collaborators

SDSC Team:
Corinne Jones
Michele Volpi

PI | Partners:

SLF / WSL:

  • Prof. Dr. Jürg Schweizer
  • Dr. Massimiliano Zappa
  • Dr. Jan Svoboda
  • Marc Ruesch
  • David Liechti
  • Dr. Frank Techel
  • Florian Lustenberger

More info

description

Introduction:

The backbone of the Swiss avalanche forecast infrastructure are the data of the Intercantonal Measurement and Information System (IMIS), which currently consists of 187 automated snow and weather stations. They are distributed throughout the Swiss Alps and in most cases are situated in the high alpine region above the tree line. The stations continuously record the snow and weather conditions, transmit data to the SLF every hour and provide the national avalanche warning service of the SLF as well as local avalanche services responsible for public safety in settlements and on roads with the crucial information for danger assessment. Public products such as new snow or snow height maps also rely on these data.

Therefore, the objective is the development of algorithms that allow real-time detection of anomalies in the time series, but also the detection of outliers, and impute missing data by applying state-of-the-art machine learning approaches.

This real-time data cleansing will solve a long-standing issue with the IMIS data that are known to be contaminated with data anomalies and has hindered automated processing. Hence, the completion of the proposed research will have a major impact, in particular for the application of numerical avalanche prediction models such as we recently developed in collaboration with the SDSC.

Problem:

This project aims to perform anomaly detection, outlier detection, and imputation on IMIS station data both retrospectively and in real time. In particular, the project focuses on the measurements of snow depth, wind speed and direction, air temperature, precipitation, and a maintenance model.

Proposed approach:

The SDSC is working with SLF to apply time-series-based statistical and machine learning-based methods for anomaly detection, outlier detection, and imputation in the given context.

Impact:

Numerical avalanche prediction and other models used at SLF will be more accurate with the cleaned data. The cleaned data will also be made openly available in the data portal of SLF, and will therefore benefit the numerous downstream users of the data.

Weather station at SLF

Gallery

Annexe

Additionnal resources

Bibliography

  1. Bavay, M. and Egger, T.: MeteoIO 2.4.2: a preprocessing library for meteorological data, Geosci. Model Dev., 7, 3135–3151, https://doi.org/10.5194/gmd-7-3135-2014, 2014.
  2. Pérez-Guillén, C., Techel, F., Hendrick, M., Volpi, M., van Herwijnen, A., Olevski, T., Obozinski, G., Pérez-Cruz, F., and Schweizer, J.: Data-driven automated predictions of the avalanche danger level for dry-snow conditions in Switzerland, Nat. Hazards Earth Syst. Sci., 22, 2031–2056, https://doi.org/10.5194/nhess-22-2031-2022, 2022.

Publications

Related Pages

More projects

ML4FCC

In Progress
Machine Learning for the Future Circular Collider Design
Big Science Data

SEMIRAMIS

Completed
AI-augmented architectural design
Energy, Climate & Environment

4D-Brains

In Progress
Extracting activity from large 4D whole-brain image datasets
Biomedical Data Science

deepLNAfrica

In Progress
Deep statistical learning-based image analysis for measurement of socioeconomic development in sub-Saharan Africa using high-resolution satellite images, and geo-referenced household survey data
Energy, Climate & Environment

News

Latest news

The Promise of AI in Pharmaceutical Manufacturing
April 22, 2024

The Promise of AI in Pharmaceutical Manufacturing

The Promise of AI in Pharmaceutical Manufacturing

Innovation in pharmaceutical manufacturing raises key questions: How will AI change our operations? What does this mean for the skills of our workforce? How will it reshape our collaborative efforts? And crucially, how can we fully leverage these changes?
Efficient and scalable graph generation through iterative local expansion
March 20, 2024

Efficient and scalable graph generation through iterative local expansion

Efficient and scalable graph generation through iterative local expansion

Have you ever considered the complexity of generating large-scale, intricate graphs akin to those that represent the vast relational structures of our world? Our research introduces a pioneering approach to graph generation that tackles the scalability and complexity of creating such expansive, real-world graphs.
RAvaFcast | Automating regional avalanche danger prediction in Switzerland
March 6, 2024

RAvaFcast | Automating regional avalanche danger prediction in Switzerland

RAvaFcast | Automating regional avalanche danger prediction in Switzerland

RAvaFcast is a data-driven model pipeline developed for automated regional avalanche danger forecasting in Switzerland. It combines a recently proposed classifier for avalanche danger prediction at weather stations with a spatial interpolation model and a novel aggregation strategy to estimate the danger levels in predefined wider warning regions, ultimately assembled as an avalanche bulletin.

Contact us

Let’s talk Data Science

Do you need our services or expertise?
Contact us for your next Data Science project!