Reyhane Askari Hemmat

I'm a PhD candidate at Mila lab, Université de Montréal. I work under the supervision of Ioannis Mitliagkas and Nicolas Le Roux. Prior to my PhD, I received my Masters in Computer Science from Université de Montréal and worked for two years at Mila on several open-source software for deep learning such as Theano, Orion and Cortex. I also did my bachelors in Computer Engineering at Amirkabir University of Technology (Tehran Polytechnic).

My research interests are in the intersection of machine learning, large scale optimization and game theory. I am the winner of Borealis AI Graduate Fellowship, and the FRQNT three years 'Bourse de doctorat en recherche'.

I co-organized the Bridging Game Theory and Deep Learning workshop at NeurIPS 2019. I also co-organize Mila's Deep Learning Theory Group and MTL MLOpt.

Twitter  /  GitHub  /  Google Scholar


LEAD: Least-Action Dynamics for Min-Max Optimization

We propose LEAD (Least-Action Dynamics), a second-order optimizer that uses the principle of least-action from physics to discover an efficient optimizer for min-max games. We subsequently provide convergence analysis of our optimizer in quadratic minmax games using the Lyapunov theory.

Negative Momentum for Improved Game Dynamics

In this paper, we analyze gradient-based methods with momentum on simple games. We prove that alternating updates are more stable than simultaneous updates. Next, we show both theoretically and empirically that alternating gradient updates with a negative momentum term achieves convergence in a difficult toy adversarial problem, but also on the notoriously difficult to train, saturating GANs.

Oríon: Experiment Version Control for Efficient Hyperparameter Optimization

Oríon is a new black-box optimization tool currently in development that is designed to adapt to the workflow of machine learning researchers for minimal obstruction.

Auto Encoders in PyTorch

A quick implementation of Auto Encoder, Denoising Auto Encoders and Variational Auto Encoders in PyTorch.

This was cool :)