Xiaoyang Wu

Biography

I am a second-year Ph.D student in the Department of Computer Science, The University of Hong Kong (HKU), supervised by Dr. Hengshuang Zhao. Before that, I obtained a Bachelor of Science in Mathematics from Sun Yat-sen University, supervised by Dr. Guanbin Li. I have spent wonderful times as an intern with Dr. Kaicheng Yu at Alibaba, and Prof. Wanli Ouyang at Shanghai AI Lab.

My long-term aspiration is to create innovations that might change human life. With this vision in mind, I have embarked on a journey in the realm of 3D, a modality that extends beyond traditional human perception. My current research interests and focus: 1. 3D Representation and Perception; 2. Combination of 3D Perception and Robotic; 3. Combination of 3D Vision and LLM. More experiences about me please refer to my publications and my Google Scholar. Reach out to me over email for discussion or any opportunities.

News

• Apr 2024: PTv3 is selected as one of the 90 Oral (3.3% accepted paper, 0.78% submissions) by CVPR'24.

• Feb 2024: Eight submissions are all accepted by CVPR'24! I serve as the first author in two of them (PPT, PTv3).

• Sep 2023: I am also named as one of the NeurIPS 2023 Top Reviewers!

• May 2023: I am named as one of the CVPR 2023 Outstanding Reviewers!

• Mar 2023: We release our highly optimized codebase Pointcept, available for point cloud perception.

• Feb 2023: Four papers are accepted by CVPR'23!

• Sep 2022: My first papar PTv2 is accepted by NeurIPS'22.

Awards

• NeurIPS Top Reviewer Award

  2023

• CVPR Outstanding Reviewer Award

  2023

• NeurIPS Scholar Award

  2022

Projects

Pointcept: A Codebase for Point Cloud Perception Research
Pointcept Contributors
[Code] [Bib] -

SAM3D: Segment Anything in 3D Scenes
Yunhan Yang, Xiaoyang Wu, Tong He, Hengshuang Zhao, Xihui Liu
[Report] [Code] [Bib] -

Publications

Point Transformer V3: Simpler, Faster, Stronger
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024 - Oral (0.78% acceptance rate)
[Paper] [Code] [Bib] -

Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -

OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentation
Bohao Peng, Xiaoyang Wu, Li Jiang, Yukang Chen, Hengshuang Zhao, Zhuotao Tian, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -

GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding
Chengyao Wang, Li Jiang, Xiaoyang Wu, Zhuotao Tian, Bohao Peng, Hengshuang Zhao, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -

DreamComposer: Controllable 3D Object Generation via Multi-View Conditions
Yunhan Yang, Yukun Huang, Xiaoyang Wu, Yuan-Chen Guo, Song-Hai Zhang, Hengshuang Zhao, Tong He, Xihui Liu
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib]

GPT4Point: A Unified Framework for Point-Language Understanding and Generation
Zhangyang Qi, Ye Fang, Zeyi Sun, Xiaoyang Wu, Tong Wu, Jiaqi Wang, Dahua Lin, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024 - Hightlight (2.8% acceptance rate)
[Paper] [Code] [Bib] -

UniPAD: A Universal Pre-training Paradigm for Autonomous Driving
Honghui Yang, Sha Zhang, Di Huang, Xiaoyang Wu, Haoyi Zhu, Tong He, Shixiang Tang, Hengshuang Zhao, Qibo Qiu, Binbin Lin, Xiaofei He, Wanli Ouyang
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib]

Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning
Xiaoyang Wu, Xin Wen, Xihui Liu, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib] -

Hierarchical Dense Correlation Distillation for Few-Shot Segmentation
Bohao Peng, Zhuotao Tian, Xiaoyang Wu, Chengyao Wang, Shu Liu, Jingyong Su, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2023 - Hightlight (2.5% acceptance rate)
[Paper] [Code] [Bib]

MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds
Jiahui Liu*, Chirui Chang*, Jianhui Liu, Xiaoyang Wu, Lan Ma, Xiaojuan Qi
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib]

Understanding Imbalanced Semantic Segmentation Through Neural Collapse
Zhisheng Zhong*, Jiequan Cui*, Yibo Yang*, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib] -

Point Transformer V2: Grouped Vector Attention and Partition-based Pooling
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao
Neural Information Processing Systems (NeurIPS) 2022
[Paper] [Code] [Bib] -

Experiences

Activities

• Conference Reviewer:
  

  IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

  IEEE International Conference on Computer Vision (ICCV)

  European Conference on Computer Vision (ECCV)

  Conference on Neural Information Processing Systems (NeurIPS)

  International Conference on Learning Representations (ICLR)

  International Conference on Machine Learning (ICML)

  AAAI Conference on Artificial Intelligence (AAAI)

  IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

• Journal Reviewer:
  

  IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

  IEEE Transactions on Cognitive and Developmental Systems (TCDS)