Physics-informed machine learning
Contents
Machine Learning for Theoretical Physics
(seminars by Andriy Graboviy and Vadim Strijov)
Goals
The course consists of a series of group discussions devoted to various aspects of data modeling in continuous spaces. It will reduce the gap between the models of theoretical physics and the noisy measurements, performed under complex experimental circumstances. To show the selected neural network is an adequate parametrization of the modeled phenomenon, we use a geometrical axiomatic approach. We discuss the role of manifolds, tensors, and differential forms in the neural network-based model selection.
The basics for the course are the book Geometric Deep Learning: April 2021 by Michael Bronstein et al. and the paper Physics-informed Machine Learning// Nature: May 2021 by George Em Karniadakis et al.
Structure of the talk
The talk is based on a two-page essay ([template]).
- Field and goals of a method or a model
- An overview of the method
- Notable authors and references
- Rigorous description, the theoretical part
- Algorithm and link to the code
- Application with plots
Grading
Each student presents two talks. Each talk lasts 25 minutes and concludes with a five-minute written test. A seminar presentation gives 1 point, a formatted seminar text gives 1 point, a test gives 1 point, a reasonable test response gives 0.1 point. Bonus 1 point for a great talk.
Test
Todo: how to make a test creative, not automated? Here is the test format.
Themes
- Spherical harmonics for mechanical motion modeling
- Tensor representations of the Brain-computer interfaces
- Multi-view, kernels, and metric spaces for the BCI and Brain Imaging
- Continuous-Time Representation and Legendre Memory Units for BCI
- Riemannian geometry on Shapes and diffeomorphisms for fMRI
- The affine connection setting for transformation groups for fMRI
- Strain, rotation, and stress tensors modeling with examples
- Differential forms and fibre bundles with examples
- Modelling gravity with machine learning approaches
- Geometric manifolds, the Levi-Chivita connection, and curvature tensors
- Flows and topological spaces
- Application for Normalizing flow models (stress on spaces, not statistics)
- Alignment in higher dimensions with RNN
- Navier-Stokes equations and viscous flow
- Newtonian and Non-Newtonian Fluids in Pipe Flows Using Neural Networks [1], [2]
- Applications of Geometric Algebra and experior product
- High-order splines
- Forward and Backward Fourier transform and iPhone lidar imaging analysis
- Fourier, cosine, and Laplace transform for 2,3,4D and higher dimensions
- Spectral analysis on meshes
- Graph convolution and continuous Laplace operators
Schedule
Thursdays at 12:30 at m1p.org/go_zoom
- September 2 9 16 23 30
- October 7 14 21 28
- November 4 11 18 25
- December 2 9
Date | Theme | Speaker | Links |
---|---|---|---|
September 2 | Course introduction and motivation | Vadim Strijov | GDL paper, Physics-informed |
9 | |||
9 | |||
16 | |||
16 | |||
23 | |||
23 | |||
30 | |||
30 | |||
October 7 | |||
7 | |||
14 | |||
14 | |||
21 | |||
21 | |||
28 | |||
28 | |||
November 4 | |||
4 | |||
11 | |||
11 | |||
18 | |||
18 | |||
25 | |||
25 | |||
December 2 | |||
2 | |||
9 | Final discussion and grading | Andriy Graboviy |
References
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges by Michael M. Bronstein, Joan Bruna, Taco Cohen, and Petar Veličković, 2021
- Functional data analysis
- Mathematics for Physical Science and Engineering by Frank E. Harris, 2014