top of page

Selected Research Projects

2014-2021

2022

Highlights

SMART: SELF-SUPERVISED MULTI-TASK PRETRAINING WITH CONTROL TRANSFORMERS

smart.PNG

In this work, we formulate a general pretraining-finetuning pipeline for sequential decision making, under which we propose a generic pretraining framework Self-supervised Multi-task pretrAining with contRol Transformer (SMART). By systematically investigating pretraining regimes, we carefully design a Control Transformer (CT) coupled with a novel control-centric pretraining objective in a self-supervised manner.

ego4d.PNG

EgoMotion-COMPASS

 

2nd International Ego4D Workshop @ ECCV 2022

2nd Place: Object State Change Classification 

2nd Place: PNR Temporal Localization 

bottom of page