Mengye Ren
PhD Student
Department of Computer Science
University of Toronto
Email: mren@cs.toronto.edu
PhD Student
Department of Computer Science
University of Toronto
Email: mren@cs.toronto.edu
Mengye Ren is a PhD student in the machine learning group of the Department of Computer Science at the University of Toronto, working with Prof. Richard Zemel. From 2017 to 2021, he was also a research scientist at Uber Advanced Technologies Group (ATG), working with Prof. Raquel Urtasun. His research focuses on making machines learn in more natural environments with less labeled data.
Areas: machine learning, computer vision, meta-learning, representation learning, few-shot learning, brain & cognitively inspired learning, robot learning, self-driving vehicles
My key research question is: how do we enable human-like, agent-based machine intelligence to continually learn, reason, and adapt in naturalistic environments? Towards this goal of building a more general and flexible AI, my research has centered on developing meta-learning and representation learning algorithms.
Some recent research highlights include:
Naturalistic paradigms for learning novel classes, i.e. few-shot learning (FSL): semi-supervised FSL, incremental FSL, online contextualized FSL, flexible FSL
Meta-learning algorithms: contextual prototypical memory, learning regularization functions, learning to reweight examples, graph hypernetworks
Brain and cognitively inspired representation learning: learning to imitate drawing, self-supervised learning from video, local unsupervised learning, recurrent attention, divisive normalization
SketchEmbedNet: Learning novel concepts by imitating drawings. Alexander Wang*, Mengye Ren*, Richard Zemel. ICML, 2021. [arxiv]
Wandering within a world: Online contextualized few-shot learning. Mengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard Zemel. ICLR, 2021. [arxiv][code]
Self-supervised representation learning from flow equivariance. Yuwen Xiong, Mengye Ren, Wenyuan Zeng, Raquel Urtasun. arXiv preprint 2101.06553, 2021. [arxiv]
Flexible few-shot learning of contextual similarity. Mengye Ren*, Eleni Triantafillou*, Kuan-Chieh Wang*, James Lucas*, Jake Snell, Xaq Pitkow, Andreas S. Tolias, Richard Zemel. arXiv preprint 2012.05895, 2020. [arxiv]
LoCo: Local contrastive representation learning. Yuwen Xiong, Mengye Ren, Raquel Urtasun. NeurIPS, 2020. [arxiv]
Multi-agent routing value iteration networks. Quinlan Sykora*, Mengye Ren*, Raquel Urtasun. ICML, 2020. [arxiv][code]
Incremental few-shot learning with attention attractor networks. Mengye Ren, Renjie Liao, Ethan Fetaya, Richard S. Zemel. NeurIPS, 2019. [arxiv][code]
Graph hypernetworks for neural architecture search. Chris Zhang, Mengye Ren, Raquel Urtasun. ICLR, 2019. [arxiv]
Learning to reweight examples for robust deep learning. Mengye Ren, Wenyuan Zeng, Bin Yang, Raquel Urtasun. ICML, 2018. [arxiv][code] [video]
Meta-learning for semi-supervised few-shot classification. Mengye Ren, Eleni Triantafillou*, Sachin Ravi*, Jake Snell, Kevin Swersky, Joshua B. Tenenbaum, Hugo Larochelle, Richard S. Zemel. ICLR, 2018. [link][arxiv] [code]
End-to-end instance segmentation with recurrent attention. Mengye Ren, Richard S. Zemel. CVPR, 2017. [link][arxiv] [code][video]
Exploring models and data for image question answering. Mengye Ren, Ryan Kiros, Richard S. Zemel. NIPS, 2015. [link][arxiv] [results][dataset] [code][code2]
Towards continual and compositional few-shot learning. Stanford University. Stanford, CA, USA. 2020/10.
Towards continual and compositional few-shot learning. Brown University. Providence, RI, USA. 2020/09.
Towards continual and compositional few-shot learning. MIT. Cambridge, MA, USA. 2020/09.
Towards continual and compositional few-shot learning. Mila. Montréal, Québec, Canada. 2020/08.
Meta-learning for more human-like learning algorithms. Columbia University. New York, NY, USA. 2019/10. [slides]
Meta-learning for weakly supervised learning. INRIA Grenoble Rhône-Alpes. Grenoble, France. 2018/07. [slides]
Meta-learning and learning to reweight examples. Max Planck Institute for Intelligent Systems. Tübingen, Germany. 2018/06. [slides]
Meta-learning for weakly supervised learning. NEC Laboratories America. Princeton, NJ, USA. 2018/06. [slides]