Visual Chain-of-Thought Prompting for Knowledge-based Visual Reasoning
- Zhenfang Chen
- Qinhong Zhou
- et al.
- 2024
- AAAI 2024
Bio
I am a researcher at MIT-IBM Watson AI Lab in Cambridge, MA, USA. I received my Ph.D. degree from the Department of Computer Science at The University of Hong Kong. My interests are centered around machine learning and its applications to computer vision and natural language processing. My ultimate research goal is to develop an AI system that can perceive and reason about the physical world, and communicate with humans in natural language.
Publications
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision
- Zhiqing Sun
- Yikang Shen
- et al.
- 2023
- NeurIPS 2023
3D-LLM: Injecting the 3D World into Large Language Models
- Yining Hong
- Haoyu Zhen
- et al.
- 2023
- NeurIPS 2023
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
- Hsiao-yu Tung
- Mingyu Ding
- et al.
- 2023
- NeurIPS 2023
3D Concept Learning and Reasoning from Multi-View Images
- Yining Hong
- Chunru Lin
- et al.
- 2023
- CVPR 2023
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners
- Zitian Chen
- Yikang Shen
- et al.
- 2023
- CVPR 2023
Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
- Mingyu Ding
- Yikang Shen
- et al.
- 2023
- CVPR 2023
Deep Face Video Inpainting via UV Mapping
- Wenqi Yang
- Zhenfang Chen
- et al.
- 2023
- IEEE TIP
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following
- Mingyu Ding
- Yan Xu
- et al.
- 2022
- CORL 2022
S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint
- Wenqi Yang
- Guanying Chen
- et al.
- 2022
- NeurIPS 2022
Projects
Dromedary
Training language models to better follow user intentions and make them more truthful
Top collaborators
DC
David D. Cox
VP, AI Models; IBM Director, MIT-IBM Watson AI Lab
YS
Yikang Shen
Research Staff Member
DG
Dan Gutfreund
Principal Research Staff Member, Manager, AI Models Science