Preprints

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding
Baoxiong Jia^*, Yixin Chen^*, Huangyue Yu, Yan Wang, Xuesong Niu, Tengyu Liu, Qing Li, Siyuan Huang
* Equal contributions
ArXiv
Paper / Project / Code / Data released!

Publication

Scaling Up Dynamic Human-Scene Interaction Modeling
Nan Jiang^*, Zhiyuan Zhang^*, Hongjie Li, Xiaoxuan Ma, Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Siyuan Huang
* Equal contributions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024.
Paper / Project / Code / Live Demo

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance
Zan Wang, Yixin Chen, Baoxiong Jia, Puhao Li, Jinlu Zhang, Jingze Zhang, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024.
Paper / Project / Code

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture
Yixin Chen^*, Junfeng Ni^*, Nan Jiang, Yaowei Zhang, Yixin Zhu, Siyuan Huang
* Equal contributions
International Conference on 3D Vision (3DV) 2024.
Paper / Project / Code

Full-Body Articulated Human-Object Interaction
Nan Jiang^*, Tengyu Liu^*, Zhexuan Cao, Jieming Cui, Zhiyuan Zhang, Yixin Chen, He Wang, Yixin Zhu, Siyuan Huang
* Equal contributions
The IEEE International Conference on Computer Vision (ICCV) 2023.
Paper / Project / Code

3D-VISTA: Pre-trained Transformer for 3D Vision and Text Alignment
Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li
The IEEE International Conference on Computer Vision (ICCV) 2023.
Paper / Project / Code

Detecting Human-Object Contact in Images
Yixin Chen, Sai Kumar Dwivedi, Michael J. Black, Dimitrios Tzionas
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023.
Paper / Project / Code

HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes
Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang
Neural Information Processing Systems (NeurIPS) 2022.
Paper / Project / Code

YouRefIt: Embodied Reference Understanding with Language and Gesture
Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Tao Gao, Yixin Zhu, Song-Chun Zhu, Siyuan Huang
The IEEE International Conference on Computer Vision (ICCV) 2021 (Oral).
Paper / Project / Code

Top-down Attention in End-to-end Spoken Language Understanding
Yixin Chen^*, Weiyi Lu, Alejandro Mottini, Li Erran Li, Jasha Droppo, Zheng Du, Belinda Zeng
* Work performed while interning at Amazon, supervised by Li Erran Li
The International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2021.
Paper

LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
Baoxiong Jia, Yixin Chen, Siyuan Huang, Yixin Zhu, Song-Chun Zhu
European Conference on Computer Vision (ECCV) 2020.
Paper / Project / Code

Closed Loop Neural-Symbolic Learning viaIntegrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
Qing Li, Siyuan Huang, Yining Hong, Yixin Chen, Yingnian Wu, Song-Chun Zhu
International Conference on Machine Learning (ICML) 2020.
Best Paper Award in Workshop on Bridge Between Perception and Reasoning: Graph Neural Networks & Beyond.
Paper / Supplementary / Project / Code / Bibtex

3D Object Detection from a Single RGB Image via Perspective Points
Siyuan Huang, Yixin Chen, Tao Yuan, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
Neural Information Processing Systems (NeurIPS) 2019.
Paper

Holistic⁺⁺ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense
Yixin Chen^*, Siyuan Huang^*, Tao Yuan, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
* Equal contributions
The IEEE International Conference on Computer Vision (ICCV) 2019.
Paper / Supplementary / Project / Code / Bibtex

Inferring Shared Attention in Social Scene Videos
Lifeng Fan *, Yixin Chen *, Ping Wei, Wenguan Wang, Song-Chun Zhu
* Equal contributions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.
Paper / Project / Bibtex