Google Scholar  ·  DBLP

J. Wu, R. Antonova, A. Kan, M. Lepert, A. Zeng, S. Song, J. Bohg, S. Rusinkiewicz, T. Funkhouser
TidyBot: Personalized Robot Assistance with Large Language Models
Autonomous Robots - Special Issue: Large Language Models in Robotics (AuRo 2023)
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)
Paper ·  Project Webpage

F. Wei, T. Funkhouser, S. Rusinkiewicz
Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting
International Conference on Computer Vision (ICCV 2023)
Paper ·  Project Webpage

J. Wu, X. Sun, A. Zeng, S. Song, S. Rusinkiewicz, T. Funkhouser
Learning Pneumatic Non-Prehensile Manipulation with a Mobile Blower
IEEE Robotics and Automation Letters (RA-L 2022)
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022)
Paper ·  Project Webpage

K. Genova, X. Yin, A. Kundu, C. Pantofaru, F. Cole, A. Sud, B. Brewington, B. Shucker, T. Funkhouser
Learning 3D Semantic Segmentation with only 2D Image Supervision
International Conference on 3D Vision (3DV 2021)
Oral Presentation ·  Paper

J. Wu, X. Sun, A. Zeng, S. Song, S. Rusinkiewicz, T. Funkhouser
Spatial Intention Maps for Multi-Agent Mobile Manipulation
IEEE International Conference on Robotics and Automation (ICRA 2021)
Paper ·  Project Webpage

F. Wei, E. Sizikova, A. Sud, S. Rusinkiewicz, T. Funkhouser
Learning to Infer Semantic Parameters for 3D Shape Editing
IEEE International Conference on 3D Vision (3DV 2020)
Paper

K. Genova, F. Cole, A. Sud, A. Sarna, T. Funkhouser
Local Deep Implicit Functions for 3D Shape
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
Oral Presentation ·  Paper ·  Project Webpage

J. Wu, X. Sun, A. Zeng, S. Song, J. Lee, S. Rusinkiewicz, T. Funkhouser
Spatial Action Maps for Mobile Manipulation
Robotics: Science and Systems (RSS 2020)
Paper ·  Project Webpage

K. Genova, F. Cole, D. Vlasic, A. Sarna, W. T. Freeman, T. Funkhouser
Learning Shape Templates with Structured Implicit Functions
International Conference on Computer Vision (ICCV 2019)
Paper

J. Huang, Y. Zhou, T. Funkhouser, L. Guibas
FrameNet: Learning Local Canonical Frames of 3D Surfaces from a Single RGB Image
International Conference on Computer Vision (ICCV 2019)
Paper ·  Project Webpage ·  Code

M. Halber, Y. Shi, K. Xu, T. Funkhouser
Rescan: Inductive Instance Segmentation for Indoor RGBD Scans
International Conference on Computer Vision (ICCV 2019)
Paper ·  Project Webpage ·  Data ·  Code

A. Zeng, S. Song, K. Yu, E. Donlon, F. R. Hogan, M. Bauza, D. Ma, O. Taylor, M. Liu, E. Romo, N. Fazeli, F. Alet, N. C. Dafle, R. Holladay, I. Morona, P. Q. Nair, D. Green, I. Taylor, W. Liu, T. Funkhouser, A. Rodriguez
Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching
International Journal of Robotics Research (IJRR 2019)
Paper ·  Project Webpage ·  Source Code

A. Zeng, S. Song, J. Lee, A. Rodriguez, T. Funkhouser
TossingBot: Learning to Throw Arbitrary Objects with Residual Physics
Robotics: Science and Systems (RSS 2019)
Best Systems Paper Award ·  Paper ·  Project Webpage ·  Google AI Blog ·  New York Times

J. Huang, H. Zhang, L. Yi, T. Funkhouser, M. Niessner, and L. Guibas
TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)
Oral Presentation ·  Paper ·  Project Webpage

S. Song and T. Funkhouser
NeuralIllumination: Lighting Prediction for Indoor Environments
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)
Best Paper Finalist ·  Paper ·  Project Webpage

E. Balashova, A. H Bermano, V. G. Kim, S. DiVerdi, A. Hertzmann, T. Funkhouser
Learning A Stroke-Based Representation for Fonts
Computer Graphics Forum 2018 (to be presented at Eurographics 2019)
Paper ·  Dataset

E. Balashova, V. Singh, B. Teixeira, J. Wang, T. Chen, T. Funkhouser.
Structure-Aware Shape Synthesis
IEEE International Conference on 3D Vision (3DV 2018)
Paper

Y. Zhang, S. Khamis, C. Rhemann, J. Valentin, A. Kowdle, V. Tankovich, M. Schoenberg, S. Izadi, T. Funkhouser, S. Fanello
ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systems
European Conference on Computer Vision (ECCV 2018)
Oral Presentation ·  Paper ·  Project Webpage

Y. Shi, K. Xu, M. Niessner, S. Rusinkiewicz, T. Funkhouser
PlaneMatch: Patch Coplanarity Prediction for Robust RGB-D Reconstruction
European Conference on Computer Vision (ECCV 2018)
Oral Presentation ·  Paper ·  Project Webpage ·  Source Code (Github)

A. Zeng, S. Song, S. Welker, J. Lee, A. Rodriguez, T. Funkhouser
Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learning
IEEE International Conference on Intelligent Robots and Systems (IROS 2018)
Cognitive Robotics Best Paper Award Finalist ·  Paper ·  Project Webpage ·  Source Code (Github)

S. Song, A. Zeng, A. X. Chang, M. Savva, S. Savarese, T. Funkhouser
Im2Pano3D: Extrapolating 360° Structure and Semantics Beyond the Field of View
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
Oral Presentation ·  Paper ·  Project Webpage

Y. Zhang, T. Funkhouser
Deep Depth Completion of a Single RGB-D Image
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
Spotlight Presentation ·  Paper ·  Project Webpage

K. Genova, F. Cole, A. Maschinot, A. Sarna, D. Vlasic, W. Freeman
Unsupervised Training for 3D Morphable Model Regression
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
Spotlight Presentation ·  Paper (coming soon)

B. Teixeira, V. Singh, K. Ma, B. Tamersoy, T. Chen, Y. Wu, E. Balashova, D. Comaniciu
Generating Synthetic X-ray Images of a Person from the Surface Geometry
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
Paper

M. Savva, A. X. Chang, A. Dosovitskiy, T. Funkhouser, V. Koltun
MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
arXiv:1712.03931 [cs.LG] (11 Dec 2017)
Paper ·  Project Webpage

A. Zeng, S. Song, K.T. Yu, E. Donlon, F.R. Hogan, M. Bauza, D. Ma, O. Taylor, M. Liu, E. Romo, N. Fazeli, F. Alet, N.C. Dafle, R. Holladay, I. Morona, P.Q. Nair, D. Green, I. Taylor, W. Liu, T. Funkhouser, and A. Rodriguez
Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching
IEEE International Conference on Robotics and Automation (ICRA 2018)
Amazon Best Systems Paper Award ·  Paper ·  Project Webpage ·  Source Code

Y. Zhang, M. Bai, P. Kohli, S. Izadi, and J. Xiao
DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding
IEEE International Conference on Computer Vision (ICCV 2017)
Paper ·  Project Webpage

A. Chang, A. Dai, T. Funkhouser, M. Halber, M. Niessner, M. Savva, S. Song, A. Zeng, and Y. Zhang
Matterport3D: Learning from RGB-D Data in Indoor Environments
IEEE International Conference on 3D Vision (3DV 2017)
Paper ·  Project Webpage ·  Source Code

K. Genova, M. Savva, A. X. Chang, T. Funkhouser
Learning Where to Look: Data-Driven Viewpoint Set Selection for 3D Scenes
arXiv:1704.02393 [cs.CV] (7 Apr 2017)
Paper

J. Liu, F. Yu, and T. Funkhouser
Interactive 3D Modeling with a Generative Adversarial Network
IEEE International Conference on 3D Vision (3DV 2017)
Paper

S. Song, F.Yu, A. Zeng, A. Chang, M. Savva, and T. Funkhouser
Semantic Scene Completion from a Single Depth Image
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Oral Presentation ·  Paper ·  Project Webpage

A. Zeng, S. Song, M. Nießner, M. Fisher, J. Xiao, and T. Funkhouser
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Oral Presentation ·  Paper ·  Project Webpage ·  Source Code

H. Xu, Y. Gao, F. Yu, and T. Darrell
End-to-end Learning of Driving Models from Large-scale Video Datasets
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Oral Presentation ·  Paper

A. Dai, A. Chang, M. Savva, M. Halber, T. Funkhouser, and M. Nießner
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Spotlight Presentation ·  Paper ·  Project Webpage ·  Source Code

M. Halber and T. Funkhouser
Fine-To-Coarse Global Registration of RGB-D Scans
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Paper ·  Project Webpage

Y. Zhang*, S. Song*, E. Yumer, M. Savva, J. Lee, H. Jin, and T. Funkhouser
Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Paper ·  Project Webpage

F. Yu, V. Koltun, and T. Funkhouser
Dilated Residual Networks
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Paper

P. Sangkloy, J. Lu, C. Fang, F. Yu, and J. Hays
Scribbler: Controlling Deep Image Synthesis with Sketch and Color
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017)
Paper ·  Project Webpage

A. Zeng, K.T. Yu, S. Song, D. Suo, E. Walker Jr., A. Rodriguez, and J. Xiao
Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge
IEEE International Conference on Robotics and Automation (ICRA 2017)
Paper ·  Project Webpage and Dataset ·  Source Code

A. Seff and J. Xiao.
Learning from Maps: Visual Common Sense for Autonomous Driving
arxiv:1611.08583 [cs.2016] (25 Nov 2016)
Paper ·  Project Webpage ·  Source Code

S. Song, and J. Xiao
Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images
Proceedings of 29th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016)
Spotlight Presentation ·  Paper ·  Project Webpage and Source Code

F. Yu and V. Koltun
Multi-Scale Context Aggregation by Dilated Convolutions
International Conference on Learning Representations (ICLR 2016)
Paper ·  Code

C. Chen, A. Seff, A. Kornhauser and J. Xiao.
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Proceedings of 15th IEEE International Conference on Computer Vision (ICCV 2015)
Paper ·  Project Webpage, Source Code, and Dataset

A. Chang, T. Funkhouser, L. Guibas, P. Hanrahan, Q. Huang, Z. Li, S. Savarese, M. Savva, S. Song, H. Su, J. Xiao, L. Yi, and F. Yu.
ShapeNet: An Information-Rich 3D Model Repository
arXiv:1512.03012 [cs.CV] 9 Dec 2015
Paper ·  ShapeNet dataset

S. Song, L. Zhang, and J. Xiao.
Robot In a Room: Toward Perfect Object Recognition in Closed Environments
arXiv:1507.02703 [cs.CV] 9 Jul 2015
Paper ·  Project Webpage and Source Code

Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang and J. Xiao
3D ShapeNets: A Deep Representation for Volumetric Shapes
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015)
Oral Presentation ·  Paper ·  Source Code and Project Webpage ·  Princeton ModelNet Dataset

S. Song, S. Lichtenberg, and J. Xiao
SUN RGB-D: A RGB-D Scene Understanding Benchmark Suite
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015)
Oral Presentation ·  Paper ·  Dataset and Project Webpage

F. Yu, A. Seff, Y. Zhang, S. Song, T. Funkhouser and J. Xiao.
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
arXiv:1506.03365 [cs.CV] 10 Jun 2015
Paper ·  LSUN dataset

F. Yu, J. Xiao, and T. Funkhouser
Semantic Alignment of City-Scale LiDAR Data
Proceedings of 28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015)
Paper ·  Supplementary Materials ·  Project Webpage

P. Xu, K. A. Ehinger, Y. Zhang, A. Finkelstein, S. R. Kulkarni, and J. Xiao.
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
arXiv:1504.06755 [cs.CV] 25 Apr 2015
Paper ·  Project Webpage, Source Code, and iSUN dataset

S. Song and J. Xiao
Sliding Shapes for 3D Object Detection in Depth Images
Proceedings of the 13th European Conference on Computer Vision (ECCV 2014)
Oral Presentation ·  Paper ·  Source Code and Data and Project Webpage

Y. Zhang, S. Song, P. Tan, and J. Xiao
PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding
Proceedings of the 13th European Conference on Computer Vision (ECCV 2014)
Oral Presentation ·  Paper ·  Source Code and Data and Project Webpage

S. Song and J. Xiao
Tracking Revisited using RGBD Camera: Unified Benchmark and Baselines
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV 2013)
Paper ·  Project Webpage, Data, Source Code and Evaluation Server  ·  Poster  ·  Spotlight  ·  Talk Slides  ·  Video

J. Xiao, A. Owens and A. Torralba
SUN3D: A Database of Big Spaces Reconstructed using SfM and Object Labels
Proceedings of 14th IEEE International Conference on Computer Vision (ICCV 2013)
Paper ·  Project Webpage, Data and Source Code  ·  Poster  ·  Spotlight  ·  Talk Slides  ·  Video (HighRes, YouTube)

B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva
Learning Deep Features for Scene Recognition using Places Database
Advances in Neural Information Processing Systems 27 (NIPS 2014)
Paper ·  Project Webpage, Data, and Demo

J. Xiao, K. A. Ehinger, J. Hays, A. Torralba, and A. Oliva
SUN Database: Exploring a Large Collection of Scene Categories
International Journal of Computer Vision (IJCV)
Paper  ·  Database Webpage  ·  Scene Classification Benchmark Webpage

J. Xiao, K. A. Ehinger, A. Oliva and A. Torralba
Recognizing Scene Viewpoint using Panoramic Place Representation
Proceedings of 25th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012)
Paper ·  Project Webpage (Dataset and Source Code)

We gratefully acknolwedge the generous support of Intel, Amazon, Ford, National Science Foundation, Google, MERL, Facebook, Microsoft, ABB, and NVIDIA for our research.