Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets

Karol Hausman, Yevgen Chebotar, Stefan Schaal, Gaurav Sukhatme, Joseph J. Lim

NIPS 2017, Long Beach, California. [arXiv]

Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos

De-An Huang, Joseph J. Lim, Li Fei-Fei, Juan Carlos Niebles

CVPR 2017, Honolulu, Hawaii. [PDF]

Knowledge Acquisition for Visual Question Answering via Iterative Querying

Yuke Zhu, Joseph J. Lim, Li Fei-Fei

CVPR 2017, Honolulu, Hawaii. [PDF]

Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning

Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi

ICRA 2017, Singapore. [arXiv] [video]

High-Fidelity Facial and Speech Animation for VR HMDs

Kyle Olszewski, Joseph J. Lim, Shunsuke Saito, Hao Li

SIGGRAPH Asia 2016, Macau, China. [PDF]

Single Image 3D Interpreter Network

Jiajun Wu*, Tianfan Xue*, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman (* - indicates equal contribution)

ECCV 2016, Amsterdam, Netherlands. [PDF] [arXiv] [Project Page]

Physics 101: Learning Physical Object Properties from Unlabeled Videos

Jiajun Wu, Joseph J. Lim, Hongyi Zhang, Joshua B. Tenenbaum, William T. Freeman

BMVC 2016, York, UK. [PDF] [Project Page]

Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning

Jiajun Wu*, Ilker Yildirim*, Joseph J. Lim, William T. Freeman, Joshua B. Tenenbaum. (* - indicates equal contribution)

NIPS 2015, Montreal, Canada. [PDF] [Project Page]

Discovering States and Transformations in Image Collections

Phillip Isola*, Joseph J. Lim*, Edward H. Adelson. (* - indicates equal contribution)

CVPR 2015, Boston, Massachusetts. [PDF] [Project Page]

FPM: Fine pose Parts-based Model with 3D CAD models

Joseph J. Lim, Aditya Khosla, Antonio Torralba.

ECCV 2014, Zurich, Switzerland. [PDF]

Looking Beyond the Visible Scene

Aditya Khosla*, Byoungkwon An*, Joseph J. Lim*, Antonio Torralba. (* - indicates equal contribution)

CVPR 2014, Columbus, Ohio. [PDF] [Project Page]

Parsing IKEA Objects: Fine Pose Estimation

Joseph J. Lim, Hamed Pirsiavash, Antonio Torralba.

ICCV 2013, Sydney, Australia. [PDF] [Project Page]

Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection

Joseph J. Lim, C. Lawrence Zitnick, and Piotr Dollar.

CVPR 2013, Portland, Oregon. [PDF] [Code github, zip]

Transfer Learning by Borrowing Examples for Multiclass Object Detection

Joseph J. Lim, Ruslan Salakhutdinov, and Antonio Torralba.

NIPS 2011, Granada, Spain. [PDF] [Project Page]

Experimental Evaluation of Support Vector Machine-based and Correlation-based Approaches to Automatic Particle Selection

Pablo Arbelaez, Bong-Gyoon Han, Dieter Typke, Joseph J. Lim, Robert M. Glaeser, Jitendra Malik.

Journal of Structural Biology 2011. doi:10.1016/j.jsb.2011.05.017. [PDF] [Project Page] [Code]

Exploiting Hierarchical Context on a Large Database of Object Categories

Myung Jin Choi, Joseph J. Lim, Antonio Torralba, and Alan S. Willsky.

CVPR 2010, San Francisco, California. [PDF] [Project Page]

Context by Region Ancestry

Joseph J. Lim, Pablo Arbelaez, Chunhui Gu, Jitendra Malik.

ICCV 2009, Kyoto, Japan. [PDF]

Recognition using Regions

Chunhui Gu, Joseph J. Lim, Pablo Arbelaez, Jitendra Malik.

CVPR 2009, Miami, Florida. [PDF]

A Distributed Message Passing Algorithm for Sensor Localization

Max Welling and Joseph J. Lim.

ICANN 2007, Porto, Portugal. [PDF] June '08, mistake corrected in Alg. Box 3I.


  • Course Instructor (Winter 2014). 6.S093 Visual Recognition through Machine Learning Competition
  • Teaching Assistant (Spring 2010). 6.869: Advances in Computer Vision
  • NSF Graduate Research Fellowship (2009-2014)
  • Organization: Workshop on Object Understanding for Interaction (ICCV 2015), CMT Assistant (CVPR 2015)
  • Reviewer: ICCV (2011-2015), ECCV (2012-2016), CVPR (2011-2015), ACCV (2012,2014), IJCAI (2016), NIPS (2016), SIGGRAPH (2016), IJCV, TPAMI
  • Program Committee: SUN workshop - CVPR (2013), Story Telling workshop - ECCV (2014), 3D from a single image workshop - CVPR (2015)


  • MIT's Computer Vision Link
  • UC Berkeley's Computer Vision Link