Seminar - Advanced Topics in Machine Learning

Quick Facts

Abstract

The seminar concentrates on reviewing the latest developments in machine learning by reviewing topics and papers from the last few NIPS, ICML and AISTATS conferences. The seminar is focused on PhD students but outstanding master students are also welcome to join. There will be different topics presented by groups of 2 - 3 team members. The presentation of each topic should take approximately 60 - 90 minutes and should also include a review of the relevant background that are needed to understand the presented topics. PhD students should present once a year (every second semester).

Topics

Each participant is asked to send at least 3 topics he is interested to Jan Peters by Monday the 19th of October. We will then assign the teams, where each master student will be paired with a post-doc who will become his "coach" for the presentation. You can choose from the following topics:

• Reproducing Kernel Hilbert Spaces: Papers from: A. Gretton, K. Fukumizu, L. Song
• Deep Neural Networks: Work from Bengio, Hinton, etc... Could be multiple sub-topics
• Sampling for Bayesian Learning: Work on Slice Sampling and papers by Max. Welling (Fisher scoring)
• Recent advances for GPs and Local Regression Methods: Phillip Henning and Titsias
• Recent work on Bandits, Linear Bandits: G. Neu, O. Maillard, R. Munos...
• Recent work Decision and Regression Trees: Have to search for papers...
• Recent work on Boosting: Have to search for papers...
• Bounds in Reinforcement Learning: C. Csevaspari, R, Munos
• Copula's: Have to search for papers...
• Causality: Have to search for papers...
• New Developments in Stochastic Gradient Descent: Papers by F. Bach
• Online Learning

Current Preferred Topics

• Roberto Calandra: Deep learning, Online learning, Variational Inference / Causality [Prefers to present in winter semester due to internship].
• Marco Ewerton: Deep Neural Networks, Reproducing Kernel Hilbert Spaces, (Stochastic) Variational Inference [Prefers to present in winter semester].
• Jochen Gast: Stochastic Variational Inference, Using Discrete Optimization to Learn and Sample from Energy Models, Deep Neural Networks
• Alex Paraschos: Structured Prediction, Reproducing Kernel Hilbert Spaces, Variational Inference [winter]
• Filipe Veiga: Deep learning, (Stochastic) Variational Inference, Reproducing Kernel Hilbert Spaces, copula's/causality [prefer winter semester].
• Simone Parisi: Deep Learning, Recent Work on Bandits, Reproducing Kernel Hilbert Spaces [Winter]
• Herke van Hoof: Stochastic variational inference, Sampling, Structured prediction, Reproducing kernel hilbert spaces [winter]
• Christian Daniel: Recent work Decision and Regression Trees, Structured Prediction, Deep Neural Networks [Winter]
• Rudolf Lioutikov: (Stochastic) Variational Inference, Recent work on Bandits, Deep Neural Networks [Winter]
• Anne Wannenwetsch: Bounds in Reinforcement Learning, Online Learning, Recent work on Bandits, Linear Bandits [Winter]
• Junhwa Hur: Recent work Decision and Regression Trees, Deep Neural Networks, Sampling for Bayesian Learning [Winter]
• Daniel Tanneberg: Deep Neural Networks, Sampling for Bayesian Learning, Recent advances for GPs and Local Regression Methods
• Sanket Shinde <sanketpratapshinde@gmail.com>: Deep Neural Networks, Linear Bandit Problem, Bounds in reinforcement learning

Past Preferred Topics of Participants

• Oleg Arenz: Structured Prediction, Reproducing Kernel Hilbert Spaces, Deep Neural Networks
• Gregor Gebhardt: Deep Neural Networks, Stochastic Variational Inference, Sampling for Bayesian Learning [Prefers to present in winter semester]
• Riad Akrour: Sampling by Optimization, Recent advances for GPs and Local Regression Methods, (Stochastic) Variational Inference
• Takayuki Osa: Deep Neural Networks, Reproducing Kernel Hilbert Spaces, (Stochastic) Variational Inference [Prefers to present in winter semester]
• Tobias Plötz: Stochastic Variational Inference, Sampling by Optimization, Recent work Decision and Regression Trees

Schedule WS2015/16

Schedule SS2015