Curriculum Vitae

Current Position
Since 2016Postdoctoral Fellow, Reasoning and Learning Lab and Mobile Robotics Lab
School of Computer Science, McGill University, Montreal, Canada
The fellowship focuses on allowing robots to learn new tasks more efficiently using prior knowledge about robotics and experience with similar tasks. This research is performed in collaboration with Professors J. Pineau, D. Meger and G. Dudek.
2011-2016Ph.D. in Computer Science (with distinction)
Intelligent Autonomous Systems Group, Technische Universität Darmstadt, Germany
Thesis: Machine Learning through Exploration for Perception-Drive Robotics (2016)
Committee: Prof. Dr. J. Peters (Supervisor), Prof. Dr. M. Toussaint (U. Stuttgart), Prof.
Dr. S. Roth, Prof. Dr. von Stryk, Prof. Dr. J. Fu?rnkranz and Prof. Dr. C. Rothkopf.
2008-2011Master of Science in Artificial Intelligence (with honors)
“Autonomous Perceptive Systems” track, University of Groningen, the Netherlands.
Thesis: Interaction between Face Detection and Learning Tracking Systems for
Autonomous Robots (2011).
Dr. T. van der Zant, Dr. M. Wiering, Dr. P.F. Dominey and Prof. Dr. L. Schomaker.
2005-2008Bachelor of Science in Artificial Intelligence (with honors)
University of Groningen, the Netherlands.
Thesis: Using Different Methods to Direct a Robot's Attention (2008).
Supervisors: G. Kootstra and S. de Jong.
Internships and Visitorships
2015Visiting Graduate Student
Biomimetic Robotics and Machine Learning lab, Technische Universität Mu?nchen, Germany
Topic: Policy search for manipulation with tactile feedback.
2010Research intern
Robot Cognition Laboratory, INSERM U846, Lyon, France.
Invited Talks
Scaling Up Reinforcement Learning Workshop, ECML 2017.
Informatics Institute, Universiteit of Amsterdam, 2017. Host: M. Welling.
Delft Center for Systems and Control, TU Delft, 2016. Host: J. Kober.
RLL & MRL labs, McGill University, 2016. Host: J. Pineau, G. Dudek, D. Meger.
CSAIL, Massachusetts Institute of Technology, 2016. Host: L. Kaelbling.
Alice Institute, Rijksuniversiteit Groningen, 2016. Host: M. Wiering.
Max Planck Institute for Intelligent Systems, 2015. Host: B. Schölkopf, S. Schaal.
Robot Learning Lab, UC Berkeley, 2015. Host: P. Abbeel.
RESL & CLMS labs, University of Souther California, 2015. Host: K. Hausman, G. Sukhatme, S. Schaal.
Machine Learning and Robotics Lab, Universität Stuttgart, 2014. Host: S. Otte, M. Toussaint.
Department of Computing, Imperial College London, 2014. Host: M. Deisenroth.
Robotics and Biology Group, TU Berlin, 2013. Host: S. Höfer, O. Brock.
Supervision and Mentoring
V. Marg, Bachelor Thesis: “Reinforcement Learning for In-Hand Manipulation Tasks”, 2016.
J. Reubold, Master Thesis: “3D Object Reconstruction from Partial Views”, 2014. (Co-mentoring).
M. Smyk, Bachelor Thesis: “Learning Generalizable Models for Compliant Robots”, 2014.
N. Huhnstock, Bachelor Thesis: “Tactile Sensing for Manipulation”, 2014. (Co-mentoring).
S. Schoengen, Bachelor Thesis: “Visual Feature Learning for Interactive Segmentation”, 2013.
D. Notz, Bachelor Thesis: “Reinforcement Learning for Planning in High-Dimensional Domains”, 2013.
Guest lecturer, McGill University, Montreal, Canada
Winter 2017Machine Learning - 'Kalman filtering and friends'
Winter 2017Reinforcement Learning - 'Advanced policy search methods'
Guest lecturer, Technische Universität Darmstadt, Germany
2014-2015“Technical Foundations of Computer Science” course.
Teaching Assistant, Technische Universität Darmstadt, Germany
2014-2015“Technical Foundations of Computer Science” course.
2013-2014“Computational Engineering” course.
2013“Machine Learning I” master course.
2012-2013“Robot learning” master course.
2011-2016“Robot learning” practical course: Supervision of 1-2 project groups per year.
Teaching assistant, Rijksuniversiteit Groningen, the Netherlands
2011“Multi-agent systems” master course.
2010-2011“Robotics” master course.
2008-2009“Introduction to Logic” course.
2008-2009“Language and Speech technology” course.
Event Organization
2017Workflow co-chair, International Conference on Machine Learning (ICML)
2016Co-organization of R:SS Workshop on Robot-Environment Interaction for
Perception and Manipulation.
2014Co-organization of Humanoids Workshop on Active Learning in Robotics.
Program Committee and Reviewing
Associate EditorIEEE International Conference on Intelligent Robots and Systems (IROS) (2017)
JournalsJournal of Artificial Intelligence Research (JAIR), 2017
Systems, Man and Cybernetics: Systems (2017)
Transactions on Automation Science and Engineering (2016)
Journal on Machine Learning Research (JMLR) (2014)
Autonomous Robots (AURO), Special Issue 'Beyond Grasping' (2013)
ConferencesAAAI Conference on Artificial Intelligence (2015)
Conference on Robot Learning (CoRL), (2017)
IEEE International Conference on Intelligent Robots and Systems (IROS) (2014, 2015, 2017)
IEEE International Conference on Robotics and Automation (ICRA) (2012, 2014, 2015)
IEEE International Conference on Humanoid Robots (Humanoids) (2016, 2017)
International Joint Conference on Artificial Intelligence (IJCAI) (PC 2013, PC 2016, PC 2017)
International Symposium on Experimental Robotics (ISER) (2016)
Neural Information Processing Systems (NIPS) (2013, 2014, 2015,2017)
Robotics: Science and Systems (R:SS) (2015, 2016, 2017)
Extracurricular Activities
2010-2011Member of RoboCup-team “BORG”.
2008-2010Team leader RoboCup-team “the little green BATS“.
A full list of publications is given on the publications page