Xiaoyang Wu
Ph.D Student
Department of Computer Science
The University of Hong Kong
Email: [email protected]
Ph.D Student
Department of Computer Science
The University of Hong Kong
Email: [email protected]
I am a second-year Ph.D student in the Department of Computer Science, The University of Hong Kong (HKU), supervised by Dr. Hengshuang Zhao. Before that, I obtained a Bachelor of Science in Mathematics from Sun Yat-sen University, supervised by Dr. Guanbin Li.
Currently, I am also a research scientist intern with The Surreal team at Meta Reality Labs, working with Dr. Julian Straub on large-scale pre-training technology for 3D perception. Before that, I have spent wonderful times as an intern with Dr. Kaicheng Yu at Alibaba, and Prof. Wanli Ouyang at Shanghai AI Lab.
My long-term aspiration is to create innovations that might change human life. With this vision in mind, I have embarked on a journey in the realm of 3D, a data modality that extends beyond traditional human perception. My current research interests and focus are on developing a unified representation system for 3D perception, reconstruction, and interaction. I hope my research efforts can contribute to future applications related to spatial intelligence. More experiences about me please refer to my publications and my Google Scholar. Reach out to me over email for discussion or any opportunities.
Apr 2024: PTv3 is selected as one of the 90 Oral (3.3% accepted paper, 0.78% submissions) by CVPR'24.
Feb 2024: Eight submissions are all accepted by CVPR'24! I serve as the first author in two of them (PPT, PTv3).
Sep 2023: I am also named as one of the NeurIPS 2023 Top Reviewers!
May 2023: I am named as one of the CVPR 2023 Outstanding Reviewers!
Mar 2023: We release our highly optimized codebase Pointcept, available for point cloud perception.
Feb 2023: Four papers are accepted by CVPR'23!
Sep 2022: My first papar PTv2 is accepted by NeurIPS'22.
The Arthur and Louise May Memorial Fund Scholarship
2023 ~ 2024
NeurIPS Top Reviewer Award
2023
CVPR Outstanding Reviewer Award
2023
NeurIPS Scholar Award
2022
Pointcept: A Codebase for Point Cloud Perception Research
Pointcept Contributors
[Code] [Bib] -
SAM3D: Segment Anything in 3D Scenes
Yunhan Yang, Xiaoyang Wu, Tong He, Hengshuang Zhao, Xihui Liu
[Report] [Code] [Bib] -
Point Transformer V3: Simpler, Faster, Stronger
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024 - Oral (0.78% acceptance rate)
Ranked 1st Place on 2024 Waymo Open Dataset Challenge in Semantic Segmentation
[Paper] [Code] [Bib] [Cert.] -
Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -
OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentation
Bohao Peng, Xiaoyang Wu, Li Jiang, Yukang Chen, Hengshuang Zhao, Zhuotao Tian, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -
GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding
Chengyao Wang, Li Jiang, Xiaoyang Wu, Zhuotao Tian, Bohao Peng, Hengshuang Zhao, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib] -
DreamComposer: Controllable 3D Object Generation via Multi-View Conditions
Yunhan Yang, Yukun Huang, Xiaoyang Wu, Yuan-Chen Guo, Song-Hai Zhang, Hengshuang Zhao, Tong He, Xihui Liu
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib]
GPT4Point: A Unified Framework for Point-Language Understanding and Generation
Zhangyang Qi, Ye Fang, Zeyi Sun, Xiaoyang Wu, Tong Wu, Jiaqi Wang, Dahua Lin, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2024 - Hightlight (2.8% acceptance rate)
[Paper] [Code] [Bib] -
UniPAD: A Universal Pre-training Paradigm for Autonomous Driving
Honghui Yang, Sha Zhang, Di Huang, Xiaoyang Wu, Haoyi Zhu, Tong He, Shixiang Tang, Hengshuang Zhao, Qibo Qiu, Binbin Lin, Xiaofei He, Wanli Ouyang
Computer Vision and Pattern Recognition (CVPR) 2024
[Paper] [Code] [Bib]
Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning
Xiaoyang Wu, Xin Wen, Xihui Liu, Hengshuang Zhao
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib] -
Hierarchical Dense Correlation Distillation for Few-Shot Segmentation
Bohao Peng, Zhuotao Tian, Xiaoyang Wu, Chengyao Wang, Shu Liu, Jingyong Su, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2023 - Hightlight (2.5% acceptance rate)
[Paper] [Code] [Bib]
MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds
Jiahui Liu*, Chirui Chang*, Jianhui Liu, Xiaoyang Wu, Lan Ma, Xiaojuan Qi
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib]
Understanding Imbalanced Semantic Segmentation Through Neural Collapse
Zhisheng Zhong*, Jiequan Cui*, Yibo Yang*, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia
Computer Vision and Pattern Recognition (CVPR) 2023
[Paper] [Code] [Bib] -
Point Transformer V2: Grouped Vector Attention and Partition-based Pooling
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao
Neural Information Processing Systems (NeurIPS) 2022
[Paper] [Code] [Bib] -
The University of Hong Kong
Ph.D Student, Computer Science, 2022 ~ 2026
The University of California, Berkeley
Exchange Student, 2018 ~ 2019
Sun Yet-sen University
B.S, Mathematics, 2016 ~ 2021
Conference Reviewer:
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE International Conference on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)
Conference on Neural Information Processing Systems (NeurIPS)
International Conference on Learning Representations (ICLR)
International Conference on Machine Learning (ICML)
AAAI Conference on Artificial Intelligence (AAAI)
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Journal Reviewer:
IEEE Transactions on Transactions on Image Processing (TIP)
IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
IEEE Transactions on Visualization and Computer Graphics (TVCG)
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
IEEE Transactions on Cognitive and Developmental Systems (TCDS)
