BISTOM
Bayesian Parameter Inference for Stochastic Models
Abstract
For a multitude of different field sciences, determining the underlying mechanistic models is important in order to further our understanding. An accurate estimation of the parameters of such mechanistic models through data can be computationally prohibitive. This project exploits neural networks in order to learn minimal and near sufficient summary statistics as latent embeddings on simulated data for multiple stochastic models. This is corroborated with sharp model parameter posteriors observed through approximate Bayesian computation experiments.
People
Collaborators
Fernando Perez-Cruz received a PhD. in Electrical Engineering from the Technical University of Madrid. He is Titular Professor in the Computer Science Department at ETH Zurich and Head of Machine Learning Research and AI at Spiden. He has been a member of the technical staff at Bell Labs and a Machine Learning Research Scientist at Amazon. Fernando has been a visiting professor at Princeton University under a Marie Curie Fellowship and an associate professor at University Carlos III in Madrid. He held positions at the Gatsby Unit (London), Max Planck Institute for Biological Cybernetics (Tuebingen), and BioWulf Technologies (New York). Fernando Perez-Cruz has served as Chief Data Scientist at the SDSC from 2018 to 2023, and Deputy Executive Director of the SDSC from 2022 to 2023
Firat completed his undergraduate studies in Electronics Engineering at Sabanci University. He later received his MSc. in Electrical and Electronics Engineering from EPFL. He conducted his doctoral studies on medical image segmentation in Computer Vision Lab at ETH Zurich. In between, he visited INRIA (Sophia Antipolis, France) and ABB Corporate Research Center (Baden, Switzerland). His research interests revolve around computer vision and machine learning, with a focus on the medical domain. He has been with SDSC since 2019.
description
Goal:
Reliably estimating parameters of mechanistic models from data (Bayesian inference) is computationally expensive if (i) the data is big or (ii) the model is stochastic. Stochastic models are needed for reliable predictions.
Impact:
The developed methodology can be applied in many fields of science and engineering, wherever system understanding (mechanistic model) needs to be combined with data, for advancing domain knowledge and making more reliable predictions.
Solution:
Advances in algorithms as well as parallel computing infrastructure allow for Bayesian inference to be applied to a large class of stochastic models and to be scaled up to big data. We developed neural network based framework which can learn minimal and near sufficient summary statistics as latent embeddings on simulated data for multiple stochastic models. Experiments with approximate Bayesian computation yield sharp model parameter posteriors. For both stochastic models, developed solution finds near sufficient summary statistics.
Presentation
Gallery
Annexe
Publications
- Stephan Allenspach, Pascal Puphal, Joosep Link, Ivo Heinmaa, Ekaterina Pomjakushina, Cornelius Krellner, Jakob Lass, Gregory S. Tucker, Christof Niedermayer, Shusaku Imajo, Yoshimitsu Kohama, Koichi Kindo, Steffen Krämer, Mladen Horvatić, Marcelo Jaime, Alexander Madsen, Antonietta Mira, Nicolas Laflorencie, Frédéric Mila, Bruce Normand, Christian Rüegg, Raivo Stern, and Franziska Weickert. “Revealing three-dimensional quantum criticality by Sr substitution in Han purple”. Physical Review Research 3.2 (2021): 023177. doi: 10.1103/PhysRevResearch.3.023177
- David J. Warne, Anthony Ebert, Christopher Drovandi, Wenbiao Hu, Antonietta Mira, and Kerrie Mengersen. "Hindsight is 2020 vision: a characterisation of the global response to the COVID-19 pandemic." BMC public health 20, no. 1 (2020): 1-14. doi: 10.1186/s12889-020-09972-z
- Louis Raynal, Sixing Chen, Antonietta Mira, and Jukka-Pekka Onnela. "Scalable Approximate Bayesian Computation for Growing Network Models via Extrapolated and Sampled Summaries." Bayesian Anal. Advance Publication 1 - 28, 2021. doi: 10.1214/20-BA1248
- K. Guratinder, M. Schmidt, H. C. Walker, R. Bewley, M. Wörle, D. Cabra, S. A. Osorio, M. Villalba, A. K. Madsen, L. Keller, A. Wildes, P. Puphal, A. Cervellino, Ch. Rüegg, and O. Zaharko. "Magnetic correlations in the triangular antiferromagnet FeGa 2 S 4." Physical Review B 104.6 (2021): 064412. doi: 10.1103/PhysRevB.104.064412
- Carlo Albert, Antonio Ferriz-Mas, Filippo Gaia, and Simone Ulzega. “Can Stochastic Resonance explain Recurrence of Grand Minima?”, The Astrophysical Journal Letters 916.2 (2021): L9. doi: 10.3847/2041-8213/ac0fd6
- Carlo Albert, Simone Ulzega, Firat Ozdemir, Fernando Perez-Cruz, and Antonietta Mira. “Learning Summary Statistics for Bayesian Inference with Autoencoders”, SciPost Physics Core, vol. 5, no. 3, p. 043, Sep. 2022, doi: 10.21468/SciPostPhysCore.5.3.043.
Additional resources
Bibliography
Publications
Related Pages
More projects
ML-L3DNDT
BioDetect
IRMA
FLBI
News
Latest news
Smartair | An active learning algorithm for real-time acquisition and regression of flow field data
Smartair | An active learning algorithm for real-time acquisition and regression of flow field data
The Promise of AI in Pharmaceutical Manufacturing
The Promise of AI in Pharmaceutical Manufacturing
Efficient and scalable graph generation through iterative local expansion
Efficient and scalable graph generation through iterative local expansion
Contact us
Let’s talk Data Science
Do you need our services or expertise?
Contact us for your next Data Science project!