Podcasts Technology Austrian Artificial Intelligence Podcast 14. Marco Mondelli - IST: Getting to the bottom of gradient descent methods

14. Marco Mondelli - IST: Getting to the bottom of gradient descent methods

Published: Sept. 27, 2021, 7:20 p.m.

# Intro

\n

Marco Mondelli is a group leader at the IST Austrian, focusing on theoretical machine learning and in particular on properties and behaviour of gradient descent methods when used to train overparameterized deep neural networks.

\n

In this interview Marco describes his reasons to start a theoretical machine learning research Group at the IST Austria and several aspects of the IST PhD program.

\n

In the second part of the interview we discuss the research done in his groups and recent publications investigating the reasons behind the efficiency of gradient descent algorithms in optimising deep neural networks.

\n


\n

# References

\n

Marco Mondelli - http://marcomondelli.com/

\n

Mondelli group at IST: https://ist.ac.at/en/research/mondelli-group/

\n

Mean-field particle methods: https://en.wikipedia.org/wiki/Mean-field_particle_methods

\n

Landscape connectivity and dropout stability of SGD solutions for overparameterized neural networks : https://research-explorer.app.ist.ac.at/record/9198

\n


\n

# Interview Timings

\n

03:30 Personal intro & career development

\n

15:47 The Mondelli research group at the IST

\n

32:00 Main research focus

\n

39:00 Recent Publication on the connectivity of loss landscape

\n

56:00 Future research interests