About Me

I am a Research Scientist at Beijing Institute for General Artificial Intelligence (BIGAI). I received my Ph.D. in the Department of Statistics at the University of California, Los Angeles (UCLA). I believe the ability to comprehensively perceive the world is central to next-step general AI. Thus, my research focuses on enabling human-like vision capabilities for machines, particularly in the areas of 3D scene understanding, e.g., reconstruction, grounding, human motion and human-object interaction.

Previously, I interned at Perceiving Systems, MPI for Intelligent Systems advised by Prof. Michael Black and Prof. Dimitrios Tzionas, and Amazon supervised by Li Erran Li.

News

New! 2024-10: PhyRecon accepted in NeurIPS 2024, which integrates physical simulation with neural scene rendering. Congrats Junfeng et al.

New! 2024-10: One paper accepted in SIGGRAPH Asia 2024, which continously pushes the boundaries of 3D human-scene interaction. Congrats Nan et al.

2024-07: Three papers accepted in ECCV 2024, including SceneVerse and PQ3D (congrats Ziyu et al.) on 3D VL, and SlotLifter (congrats Yu et al.) on object-centric learning.

2024-03: Two papers about 3D human motion and HSI accepted in CVPR 2024. Congrats Nan et al. and Zan et al.!

2023-06: We organize the 4th 3D Scene Understanding for Vision, Graphics and Robotics at CVPR 2023. Check out the workshop page!

2023-03: One paper about human-object contact accepted in CVPR 2023.

Preprints

SYNERGAI: Perception Alignment for Human-Robot Collaboration
Yixin Chen^*, Guoxi Zhang^*, Yaowei Zhang^*, Hongming Xu^*, Peiyuan Zhi, Qing Li, Siyuan Huang
* Equal contributions
ArXiv
Paper / Project

Publication

PhyRecon: Physically Plausible Neural Scene Reconstruction
Junfeng Ni^*, Yixin Chen^*, Bohan Jing, Nan Jiang, Bin Wang, Bo Dai, Puhao Li, Yixin Zhu, Song-Chun Zhu, Siyuan Huang
* Equal contributions
Neural Information Processing Systems (NeurIPS) 2024.
Paper / Project / Code

Autonomous Character-Scene Interaction Synthesis from Text Instruction
Nan Jiang^*, Zimo He^*, Zi Wang, Hongjie Li, Yixin Chen, Siyuan Huang, Yixin Zhu
* Equal contributions
SIGGRAPH Asia 2024.
Paper / Project

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding
Baoxiong Jia^*, Yixin Chen^*, Huangyue Yu, Yan Wang, Xuesong Niu, Tengyu Liu, Qing Li, Siyuan Huang
* Equal contributions
European Conference on Computer Vision (ECCV) 2024.
Paper / Project / Code / Data, processing scripts, code, checkpoints all released!

Unifying 3D Vision-Language Understanding via Promptable Queries
Ziyu Zhu, Zhuofan Zhang, Xiaojian Ma, Xuesong Niu, Yixin Chen, Baoxiong Jia, Zhidong Deng, Siyuan Huang, Qing Li
European Conference on Computer Vision (ECCV) 2024.
Paper / Project / Code

SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields
Yu Liu, Baoxiong Jia, Yixin Chen, Siyuan Huang
European Conference on Computer Vision (ECCV) 2024.
Paper / Project

Scaling Up Dynamic Human-Scene Interaction Modeling
Nan Jiang^*, Zhiyuan Zhang^*, Hongjie Li, Xiaoxuan Ma, Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Siyuan Huang
* Equal contributions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (Highlight).
Paper / Project / Code / Live Demo

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance
Zan Wang, Yixin Chen, Baoxiong Jia, Puhao Li, Jinlu Zhang, Jingze Zhang, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024 (Highlight).
Paper / Project / Code

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture
Yixin Chen^*, Junfeng Ni^*, Nan Jiang, Yaowei Zhang, Yixin Zhu, Siyuan Huang
* Equal contributions
International Conference on 3D Vision (3DV) 2024.
Paper / Project / Code

Full-Body Articulated Human-Object Interaction
Nan Jiang^*, Tengyu Liu^*, Zhexuan Cao, Jieming Cui, Zhiyuan Zhang, Yixin Chen, He Wang, Yixin Zhu, Siyuan Huang
* Equal contributions
The IEEE International Conference on Computer Vision (ICCV) 2023.
Paper / Project / Code

3D-VISTA: Pre-trained Transformer for 3D Vision and Text Alignment
Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li
The IEEE International Conference on Computer Vision (ICCV) 2023.
Paper / Project / Code

Detecting Human-Object Contact in Images
Yixin Chen, Sai Kumar Dwivedi, Michael J. Black, Dimitrios Tzionas
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023.
Paper / Project / Code

HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes
Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang
Neural Information Processing Systems (NeurIPS) 2022.
Paper / Project / Code

PartAfford: Part-level Affordance Discovery from 3D Objects
Chao Xu, Yixin Chen, He Wang, Song-Chun Zhu, Yixin Zhu, Siyuan Huang
ECCV 2022 Visual Object-oriented Learning meets Interaction (VOLI) Workshop.
Paper

YouRefIt: Embodied Reference Understanding with Language and Gesture
Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Tao Gao, Yixin Zhu, Song-Chun Zhu, Siyuan Huang
The IEEE International Conference on Computer Vision (ICCV) 2021 (Oral).
Paper / Project / Code

Top-down Attention in End-to-end Spoken Language Understanding
Yixin Chen^*, Weiyi Lu, Alejandro Mottini, Li Erran Li, Jasha Droppo, Zheng Du, Belinda Zeng
* Work performed while interning at Amazon, supervised by Li Erran Li
The International Conference on Acoustics, Speech, & Signal Processing (ICASSP) 2021.
Paper

LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
Baoxiong Jia, Yixin Chen, Siyuan Huang, Yixin Zhu, Song-Chun Zhu
European Conference on Computer Vision (ECCV) 2020.
Paper / Project / Code

Closed Loop Neural-Symbolic Learning viaIntegrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
Qing Li, Siyuan Huang, Yining Hong, Yixin Chen, Yingnian Wu, Song-Chun Zhu
International Conference on Machine Learning (ICML) 2020.
Best Paper Award in Workshop on Bridge Between Perception and Reasoning: Graph Neural Networks & Beyond.
Paper / Supplementary / Project / Code / Bibtex

3D Object Detection from a Single RGB Image via Perspective Points
Siyuan Huang, Yixin Chen, Tao Yuan, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
Neural Information Processing Systems (NeurIPS) 2019.
Paper

Holistic⁺⁺ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation
Yixin Chen^*, Siyuan Huang^*, Tao Yuan, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
* Equal contributions
The IEEE International Conference on Computer Vision (ICCV) 2019.
Paper / Supplementary / Project / Code / Bibtex

Inferring Shared Attention in Social Scene Videos
Lifeng Fan *, Yixin Chen *, Ping Wei, Wenguan Wang, Song-Chun Zhu
* Equal contributions
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.
Paper / Project / Bibtex