Oleh Rybkin

I am a Ph.D. student in the GRASP laboratory at the University of Pennsylvania, where I work on computer vision and deep learning with Kostas Daniilidis.

Previously, I received my bachelor's degree from Czech Technical University in Prague, where I worked as an undergraduate researcher advised by Tomas Pajdla. During this project, I've spent two summers at INRIA and TiTech, with Josef Sivic and Akihiko Torii respectively.

Google Scholar  /  GitHub  /  Email  /  CV  /  LinkedIn

Research

I am broadly interested in artificial intelligence, computer vision, and cognitive robotics. Recently, I've been working on making machines understand motion and intuitive physics in a way that is a little bit closer to human understanding. During my bachelor's, I also worked on camera geometry for structure from motion.

Unsupervised Learning of Sensorimotor Affordances by Stochastic Future Prediction
Oleh Rybkin*, Karl Pertsch*, Andrew Jaegle, Kosta Derpanis, Kostas Daniilidis
ArXiv, 2018
project page / arXiv / poster

The method learns the degrees of freedom of a robot from pure video data. This can be used e.g. to transplant a trajectory of actions from one video into another.

Hover the mouse (or tap the screen) here to see the video.

Predicting the Future with Transformational States
Andrew Jaegle, Oleh Rybkin, Kosta Derpanis, Kostas Daniilidis
ArXiv, 2018
project page / arXiv

The model predicts future video frames by learning to represent the present state of a system together with a high-level transformation that is used to produce its future state.

Hover the mouse (or tap the screen) here to see the video.

Blog

The reasonable ineffectiveness of pixel metrics for future prediction
2018

MSE loss and its variants are commonly used for training and evaluation of future prediction. But is this the right thing to do?

Hover the mouse (or tap the screen) here to see the video.


This guy has a cool website