Welcome to the Perception, Action, & Learning Research Group at UPenn. The central focus of our research program is versatile robotic control through tight integration with visual perception and other general-purpose high-bandwidth sensing modalities such as touch. Through this research, we aim to enable robots to operate usefully in our homes, workplaces, and everyday lives.

This is an exciting research area that lies at the intersection of computer vision, machine learning, and robotic control. On the one hand, cameras and data-driven computer vision algorithms can recover actionable information useful to a large variety of robots across diverse environments. On the other hand, we believe that robotic action by itself can also help to address many of the challenges of computer vision, e.g., through collecting informative training data and evidence.

I highlight some of the directions we are working on, in this AAAI New Faculty Highlight Talk from February 2021.

Current Students

  • Aurora Qian
  • Edward Hu
  • Jason Ma (with Osbert Bastani)
  • Leon Kim (with Michael Posa)
  • Pratik Kunapuli (with Vijay Kumar)
  • Kun Huang (MS)
  • Tasos Panagopoulos (undergraduate)
  • Esther Xu (undergraduate)

Visiting Students

  • Jingxi Xu (PhD student at Columbia University)
  • Andrew Shen (undergraduate at the University of Melbourne)
  • Lloyd Acquaye Thomson (African Masters in Machine Intelligence program)

Past Students

  • Srinath Rajagopalan (now at Amazon Robotics)
  • Adarsh Modh (now at NEC Research Labs America)

Principal Investigator

  • Dinesh Jayaraman