picture of me Paul B. Reverdy
Postdoctoral Fellow

Kod*lab, a subsidiary of the Penn Engineering GRASP Lab
Department of Electrical and Systems Engineering
University of Pennsylvania
Philadelphia, PA 19104
USA

Email: preverdy at seas.upenn.edu
Phone: +1 (215) 898-2442
Office: 461 Levine Hall

My CV, Google Scholar Profile, and Publications

Research Interests:
Human-in-the-loop control systems
Statistical learning
Engineering design
Vehicle dynamics and control

Research summary:
I study how humans and automated systems can work together to complete physical tasks. Often these tasks are expressed as optimization problems. The humans interact with the automated system by defining the objective function to be optimized, by providing information about the structure of the problem, and sometimes by approving and implementing the actions recommended by the automated system. By combining the ability of humans to learn structure from experience and the ability of automated algorithms to carry out computation and process data, I develop systems that achieve higher performance than either humans or automation could achieve on their own.

Brief bio:
I got my Ph.D. from the Department of Mechanical and Aerospace Engineering at Princeton University in 2014. I did my undergraduate studies at UC Berkeley, where I majored in Engineering Physics and Applied Mathematics. In engineering, I was most affiliated with the Department of Mechanical Engineering. I spent a year studying at the Ecole Polytechnique, France, where I interned at the Hydrodynamics Laboratory, LadHyX. From 2007-2009, I was a Research Assistant for the Risk Analysis section at the Federal Reserve Board of Governors, Washington, DC. Since September 2014 I have been a postdoctoral fellow with Kod*lab, part of the GRASP lab at the University of Pennsylvania.

My Ph.D. thesis

My publications
Recent Papers:
A dynamical system for prioritizing and coordinating motivations
Submitted; preprint available on arXiv.

Satisficing in multi-armed bandit problems
IEEE Transactions on Automatic Control, August 2017 (to appear, with V. Srivastava and N.E. Leonard)

Parameter estimation in softmax decision-making models with linear objective functions
IEEE Transactions on Automation Science and Engineering, 13(1), 54-67. (with N.E. Leonard)

Algorithmic models of human decision making in Gaussian multi-armed bandit problems
Proc. of the European Control Conference, 2210-2215, 2014. (with V. Srivastava and N.E. Leonard)
Recipient of the Best Student Paper Award, ECC 2014.

Modeling human decision-making in generalized Gaussian multi-armed bandits
Proceedings of the IEEE, April 2014

Modeling human decision-making in multi-armed bandits
Multidisciplinary Conf. on Reinforcement Learning and Decision Making, Princeton, NJ, USA, October 2013

On optimal foraging and multi-armed bandits
Proc. 51st Annual Allerton Conference on Communication, Control and Computing, 2013

Towards optimization of a human-inspired heuristic for solving explore-exploit problems
Proc. IEEE Conference on Decision and Control, 2012

Resources:
Underwater robotics at the Dynamical Systems Control Laboratory, Princeton
MAE Generals Binders
Investing for Technical Majors article, October 2010 revision.