Florian Shkurti

Assistant Professor, Computer Science

Department of Computer Science, University of Toronto
Faculty Member, UofT Robotics Institute
Faculty Affiliate, Vector Institute

I direct the Robot Vision and Learning (RVL) lab at the University of Toronto. My research spans mobile robotics, computer vision, machine learning, planning and control. My goal is to develop methods that enable efficient and safe robot learning, particularly in outdoor environments and alongside humans. When human supervision and human-robot interaction are necessary, I want to enable people to effectively specify the desired behavior of their robots through as few interactive demonstrations as possible, without requiring them to write code. I am interested in:

Autonomous robots for environmental monitoring and scientific exploration
  • Learning visual attention operators for exploration and navigation
  • Active learning and information gathering
  • Informed visual search
  • Visual navigation
  • Field robotics
Machine learning and computer vision for planning and control
Safety guarantees during robot learning
The main applications of my research so far have been in environmental monitoring by robots that autonomously operate in the field and collect useful data for environmental scientists. Human-robot collaboration, learning from a few demonstrations, and robust navigation in 3D are critical in these outdoor domains. I have also worked on vision-based simultaneous mapping, localization, and navigation for ground, aerial, and underwater robots. I was a member of the McGill Mobile Robotics Lab and the NSERC Canadian Field Robotics Network. I am currently cross-appointed in engineering at UTIAS.


I am looking for postdocs, PhD, MSc, and undergraduate students with computer science or engineering backgrounds. Feel free to email me with your CV, unofficial transcript, and research interests. Prospective graduate students should apply through CS.




Publications

Students

Teaching

Software

CV




Contact Info

x@cs.toronto.edu, x=florian

UTM Campus:
3359 Mississauga Road
Deerfield Hall, Office 3066
Mathematical & Computational Sciences
University of Toronto Mississauga
Mississauga, ON, L5L 1C6


St George Campus:
6 King's College Road
D.L. Pratt Building, Office 283E
Department of Computer Science
University of Toronto
Toronto, ON, M5S 3H5

Students

Graduate Students

Homanga Bharadhwaj (with Animesh Garg)
Dhruv Sharma
Kevin Xie (with Sanja Fidler)
Ke Dong (with Angela Schoellig)
Skylar Hao

Undergraduates

Philip Huang
Sherry Chen
Salar Hosseini
Sally Chen
Chris Agia
Kamran Ramji
Ali Kuwajerwala
Hongyi Sun
Stephen Zhao (with Yang Xu)

Alumni

Melissa Mozifian
Zihan Wang (next: Stanford CS)
Siyun Li (next: Stanford CS)
Julia Chae
Fengjia Zhang
Cathlyn Chen
Andrei Ivanovic
Zidong Weng (next: Intel)
Shichen Lu (next: UTIAS)
Yuchen Wu (next: UTIAS)
Yasasa Abeysirigoonawardena (next: Unity Game Engine)


Teaching

CSC413: Neural Networks and Deep Learning, Winter 2021
CSC2626: Imitation Learning for Robotics, Winter 2021
CSC477: Introduction to Mobile Robotics, Fall 2020
CSC2621: Imitation Learning for Robotics, Winter 2019
CSC477: Introduction to Mobile Robotics, Fall 2019


Selected Publications

Continual Model-Based Reinforcement Learning with Hypernetworks
Yizhou Huang, Kevin Xie, Homanga Bharadhwaj, Florian Shkurti. Under review. pdf, bibtex

Conservative Safety Critics for Exploration
Homanga Bharadhwaj, Aviral Kumar, Nicholas Rhinehart, Sergey Levine, Florian Shkurti, Animesh Garg. Under review. pdf, project page

GradSim: Differentiable physics and rendering engines for parameter estimation from video
Krishna Jatavallabhula, Miles Macklin, Florian Golemo, Vikram Voleti, Linda Petrini, Martin Weiss, Breandan Considine, Jerome Parent-Levesque, Kevin Xie, Kenny Erleben, Liam Paull, Florian Shkurti, Sanja Fidler, Derek Nowrouzezahrai. Under review. pdf

One-Shot Informed Robotic Visual Search in the Wild
Karim Koreitem, Florian Shkurti, Travis Manderson, Wei-Di Chang, Juan Camilo Gamboa Higuera, and Gregory Dudek. IEEE International Conference on Intelligent Robots and Systems (IROS '20), Las Vegas, USA. pdf, bibtex, video

Vision-Based Goal-Conditioned Policies for Underwater Navigation in the Presence of Obstacles
Travis Manderson, Juan Camilo Gamboa Higuera, Stefan Wapnick, Jean-François Tremblay, Florian Shkurti, David Meger, and Gregory Dudek. Robotics: Science and Systems (RSS '20), Corvallis, Oregon, USA. pdf, bibtex, project page, video

DIBS: Diversity-Inducing Information Bottleneck in Model Ensembles
Samarth Sinha, Homanga Bharadhwaj, Anirudh Goyal, Hugo Larochelle, Animesh Garg, and Florian Shkurti. Under review. pdf, bibtex

LEAF: Latent Exploration Along the Frontier
Homanga Bharadhwaj, Animesh Garg, and Florian Shkurti. Under review. pdf, bibtex

Shaping Rewards for Combined Reinforcement and Imitation Learning using Generative Models
Yuchen Wu, Melissa Mozifian, and Florian Shkurti. Under review. pdf, bibtex

Catch the Ball: Accurate High-Speed Motions for Mobile Manipulators via Inverse Dynamics Learning
Ke Dong, Karime Pereida, Florian Shkurti, and Angela Schoellig. IEEE International Conference on Intelligent Robots and Systems (IROS '20), Las Vegas, USA. pdf, bibtex, video

Model-Predictive Control via Cross-Entropy and Gradient-Based Optimization
Homanga Bharadhwaj*, Kevin Xie*, and Florian Shkurti. Learning for Dynamics and Control (L4DC '20), Berkeley, USA. pdf, bibtex

Generating Adversarial Driving Scenarios in High-Fidelity Simulators
Yasasa Abeysirigoonawardena, Florian Shkurti, and Gregory Dudek. IEEE International Conference on Robotics and Automation (ICRA '19), Montreal, Canada. pdf, bibtex, project page

Model-Based Probabilistic Pursuit via Inverse Reinforcement Learning
Florian Shkurti, Nikhil Kakodkar, and Gregory Dudek, IEEE International Conference on Robotics and Automation (ICRA '18), Brisbane, Australia. pdf, bibtex, video

Synthetically Trained 3D Visual Tracker of Underwater Vehicles
Karim Koreitem, Jimmy Li, Ian Karp, Travis Manderson, Florian Shkurti, Gregory Dudek. IEEE OCEANS'18. pdf, bibtex

Underwater Multi-Robot Convoying using Visual Tracking by Detection
Florian Shkurti, Wei-Di Chang, Peter Henderson, Jahidul Islam, Juan Camilo Gamboa Higuera, Jimmy Li, Travis Manderson, Anqi Xu, Gregory Dudek, and Junaed Sattar, IEEE International Conference on Robotics and Intelligent Systems (IROS '17), Vancouver, Canada. pdf, bibtex, project page

Topologically-Distinct Trajectory Predictions for Probabilistic Pursuit
Florian Shkurti and Gregory Dudek, IEEE International Conference on Robotics and Intelligent Systems (IROS '17), Vancouver, Canada. pdf, bibtex, project page

Benchmark Environments for Multitask Learning in Continuous Domains
Peter Henderson, Wei-Di Chang, Florian Shkurti, Johanna Hansen, David Meger, and Gregory Dudek, Workshop on Lifelong Learning at the International Conference on Machine Learning (ICML '17), Sydney, Australia. pdf, bibtex

Texture-Aware SLAM Using Stereo Imagery and Inertial Information
Travis Manderson, Florian Shkurti, and Gregory Dudek, Conference on Computer and Robot Vision (CRV '16), Victoria, Canada. pdf, bibtex, project page

3D Trajectory Synthesis and Control for a Legged Swimming Robot
David Meger, Florian Shkurti, David Cortes Poza, Philippe Giguere, and Gregory Dudek, IEEE International Conference on Robotics and Intelligent Systems (IROS '14), Chicago, USA. pdf, bibtex, project page

Ear-based Exploration on Hybrid Metric/Topological Maps
Qiwen Zhang, David Whitney, Florian Shkurti, Ioannis Rekleitis, IEEE International Conference on Robotics and Intelligent Systems (IROS '14), Chicago, USA. pdf, bibtex

Asymmetric Rendezvous Search at Sea
Malika Meghjani, Florian Shkurti, Juan Camilo Gamboa Higuera, Arnold Kalmbach, David Whitney, and Gregory Dudek G, Computer and Robot Vision (CRV '14), Montreal, Canada. pdf, bibtex

Maximizing Visibility in Collaborative Trajectory Planning
Florian Shkurti and Gregory Dudek, IEEE International Conference on Robotics and Automation (ICRA ’14), Hong-Kong. pdf, bibtex

On the Complexity of Searching for an Evader with a Faster Pursuer
Florian Shkurti and Gregory Dudek, IEEE International Conference on Robotics and Automation (ICRA ’13), Karlsruhe, Germany. pdf, bibtex

Multi-Domain Monitoring of Marine Environments Using a Heterogeneous Robot Team
Florian Shkurti, Anqi Xu, Malika Meghjani, Juan Camilo Gamboa Higuera, Yogesh Girdhar, Philippe Giguere, Bikram Dey, Jimmy Li, Arnold Kalmbach, Chris Prahacs, Katrine Turgeon, Ioannis Rekleitis, and Gregory Dudek, IEEE International Conference on Intelligent Robots and Systems (IROS ’12), Algarve, Portugal. pdf, bibtex, project page

Socially-Driven Collective Path Planning for Robot Missions
Juan Camilo Gamboa Higuera, Anqi Xu, Florian Shkurti, Gregory Dudek, Conference on Robot Vision (CRV '12), Toronto, Canada. pdf, bibtex

State Estimation for an Underwater Robot using Visual and Inertial Information
Florian Shkurti, Ioannis Rekleitis, Milena Scaccia, and Gregory Dudek, IEEE International Conference on Intelligent Robots and Systems (IROS ’11), San Francisco, USA. pdf, bibtex

MARE: Marine Autonomous Robotic Explorer
Yogesh Girdhar, Anqi Xu, Bikram Dey, Malika Meghjani, Florian Shkurti, Ioannis Rekleitis, and Gregory Dudek, IEEE International Conference on Intelligent Robots and Systems (IROS ’11), San Francisco, USA. pdf, bibtex

Feature Tracker Evaluation For Pose Estimation In Underwater Environments
Florian Shkurti, Ioannis Rekleitis, and Gregory Dudek, Conference on Robot Vision (CRV '11), St. John’s, Newfoundland. pdf, bibtex