Xiaowei Hu

胡枭玮

Research Scientist

37F-128, Shanghai AI Laboratory,
701 Yunjin Road, Xuhui District,
Shanghai, China.

Email: huxiaowei@pjlab.org.cn
            xwhu@cse.cuhk.edu.hk


Biography

I am currently working as a research scientist in Shanghai AI Laboratory. Before that, I was a postdoctoral fellow in the Chinese University of Hong Kong. I obtained my Ph.D. degree in Department of Computer Science and Engineering, The Chinese University of Hong Kong (CUHK) in 2020, supervised by Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu, and obtained my B. Eng. degree in School of Computer Science and Engineering, South China University of Technology (SCUT) in 2016.

My research interests cover computer vision, deep learning, and low-level vision. Specifically, we focus on 1) designing learning algorithms to solve vision problems under adverse weather and lighting conditions (e.g., shadow image analysis, rain/haze removal); 2) developing intelligent perception methods for general computer vision tasks (e.g., classification, detection, and segmentation); 3) building the next-generation computer vision models to process multiple tasks with various supervisions to better understand and create the visual world.

I am looking for self-motivated Postdoc/RA/Interns, who are interested in artificial intelligence for computer vision, machine learning, and high/low-level vision. The salaries will be highly competitive. Welcome to drop me an email with your CV. Remote collaboration is also welcome!

News

    [08/2022] Winner at ECCV-MIPI 2022 Challenge on Under-display Camera Image Restoration (Congrats to Yurui) [certificate]
    [06/2022] One paper accepted to PAMI (Congrats to Tianyu)
    [12/2021] Achieved Excellence in the Hong Kong Young Scientist Award

Publications [Google Scholar]

Summary: TPAMI, CVPR, ICCV & ECCV (10), IEEE Transactions (16).

2022

  • Instance Shadow Detection with A Single-Stage Detector
    Tianyu Wang, Xiaowei Hu*, Pheng-Ann Heng, and Chi-Wing Fu. (* corresponding author)
    IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), accepted, 2022.
    [paper] [arXiv] [code] [SOBA dataset]

  • Learning Shadow Correspondence for Video Shadow Detection
    Xinpeng Ding, Jingwen Yang, Xiaowei Hu, and Xiaomeng Li.
    European Conference on Computer Vision (ECCV), accepted, 2022.
    [arXiv] [code]

  • Enhanced Coarse-to-Fine Network for Image Restoration
    Yurui Zhu, Xi Wang, Xueyang Fu, and Xiaowei Hu.
    1st Mobile Intelligent Photography & Imaging Workshop @ ECCV 2022, accepted, 2022.
    [certificate] [code]

  • Enhancing Pseudo Label Quality for Semi-Supervised Domain-Generalized Medical Image Segmentation
    Huifeng Yao, Xiaowei Hu, and Xiaomeng Li.
    AAAI Conference on Artificial Intelligence (AAAI), pp. 3099-3107, 2022.
    [paper] [arXiv] [code]

  • Representative Feature Alignment for Adaptive Object Detection
    Shan Xu, Huaidong Zhang, Xuemiao Xu, Xiaowei Hu, Yangyang Xu, Liangui Dai, Kup-Sze Choi, and Pheng-Ann Heng.
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT), accepted, 2022.

2021

  • Revisiting Shadow Detection: A New Benchmark Dataset for Complex World
    Xiaowei Hu, Tianyu Wang, Chi-Wing Fu, Yitong Jiang, Qiong Wang, and Pheng-Ann Heng.
    IEEE Transactions on Image Processing (IEEE TIP), vol. 30, pp. 1925-1934, 2021.
    [paper] [arXiv] [CUHK-Shadow dataset] [evaluation function] [code]

  • Single-Image Real-Time Rain Removal Based on Depth-Guided Non-Local Features
    Xiaowei Hu, Lei Zhu, Tianyu Wang, Chi-Wing Fu, and Pheng-Ann Heng.
    IEEE Transactions on Image Processing (IEEE TIP), vol. 30, pp. 1759-1770, 2021.
    [paper] [code] [RainCityscapes dataset]

  • Single-Stage Instance Shadow Detection with Bidirectional Relation Learning
    Tianyu Wang^, Xiaowei Hu^, Chi-Wing Fu, and Pheng-Ann Heng. (^ joint first authors)
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-11, 2021. (Oral)
    [paper] [supp.] [video] [code] [poster]

  • SAC-Net: Spatial Attenuation Context for Salient Object Detection
    Xiaowei Hu, Chi-Wing Fu, Lei Zhu, Tianyu Wang, and Pheng-Ann Heng.
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT), vol. 31, no. 3, pp. 1079-1090, 2021.
    [paper] [arXiv] [supp.] [code] [results]

  • Deep Texture-Aware Features for Camouflaged Object Detection
    Jingjing Ren^, Xiaowei Hu^, Lei Zhu, Xuemiao Xu, Yangyang Xu, Weiming Wang, Zijun Deng, and Pheng-Ann Heng. (^ joint first authors)
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT), accepted, 2021.
    [paper]

  • Rotation-oriented Collaborative Self-supervised Learning for Retinal Disease Diagnosis
    Xiaomeng Li, Xiaowei Hu, Xiaojuan Qi, Lequan Yu, Wei Zhao, Pheng-Ann Heng, and Lei Xing.
    IEEE Transactions on Medical Imaging (IEEE TMI), vol. 40, no. 9, pp. 2284-2294, 2021. (TMI Popular Paper)
    [paper] [code]

  • SALMNet: A Structure-Aware Lane Marking Detection Network
    Xuemiao Xu, Tianfei Yu, Xiaowei Hu, Wing W. Y. Ng, and Pheng-Ann Heng.
    IEEE Transactions on Intelligent Transportation Systems (IEEE TITS), vol. 22, no. 8, pp. 4986-4997, 2021.
    [paper]

  • Learning Gated Non-Local Residual for Single-Image Rain Streak Removal
    Lei Zhu, Zijun Deng, Xiaowei Hu, Haoran Xie, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng.
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT), vol. 31, no. 6, pp. 2147-2159, 2021.
    [paper]

  • Learning Semantic Context from Normal Samples for Unsupervised Anomaly Detection
    Xudong Yan, Huaidong Zhang, Xuemiao Xu, Xiaowei Hu, and Pheng-Ann Heng.
    AAAI Conference on Artificial Intelligence (AAAI), vol. 35, no. 4, pp. 3110-3118, 2021.
    [paper] [code]

  • Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images
    Cheng Xue, Lei Zhu, Huazhu Fu, Xiaowei Hu, Xiaomeng Li, Hai Zhang, and Pheng-Ann Heng.
    Medical Image Analysis (MedIA), vol. 70, article no. 101989, 2021.
    [paper]

2020

  • Direction-Aware Spatial Context Features for Shadow Detection and Removal
    Xiaowei Hu, Chi-Wing Fu, Lei Zhu, Jing Qin, and Pheng-Ann Heng.
    IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), vol. 42, no. 11, pp. 2795-2808, 2020.
    [paper] [arXiv] [supp.] [code]

  • Instance Shadow Detection
    Tianyu Wang^, Xiaowei Hu^, Qiong Wang, Pheng-Ann Heng, and Chi-Wing Fu. (^ joint first authors)
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1880-1889, 2020.
    [paper] [arXiv] [code] [SOBA dataset] [results] [video]

  • Saliency-Aware Texture Smoothing
    Lei Zhu^, Xiaowei Hu^, Chi-Wing Fu, Jing Qin, and Pheng-Ann Heng. (^ joint first authors)
    IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), vol. 26, no. 7, pp. 2471-2484, 2020.
    [paper] [code] [SDTS dataset]

  • Ψ-Net: Stacking Densely Convolutional LSTMs for Sub-cortical Brain Structure Segmentation
    Lihao Liu^, Xiaowei Hu^, Lei Zhu, Chi-Wing Fu, Jing Qin, and Pheng-Ann Heng. (^ joint first authors)
    IEEE Transactions on Medical Imaging (IEEE TMI), vol. 39, no. 9, pp. 2806-2817, 2020.
    [paper] [code]

  • CANet: Cross-disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading
    Xiaomeng Li, Xiaowei Hu, Lequan Yu, Lei Zhu, Chi-Wing Fu, and Pheng-Ann Heng.
    IEEE Transactions on Medical Imaging (IEEE TMI), vol. 39, no. 5, pp. 1483-1493, 2020.
    [paper] [code]

  • GrabAR: Occlusion-aware Grabbing Virtual Objects in AR
    Xiao Tang, Xiaowei Hu, Chi-Wing Fu, and Daniel Cohen-Or.
    ACM Symposium on User Interface Software and Technology (UIST), pp. 697-708, 2020.
    [paper] [arXiv] [project]

  • Aggregating Attentional Dilated Features for Salient Object Detection
    Lei Zhu, Jiaxing Chen, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng.
    IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT), vol. 30, no. 10, pp. 3358-3371, 2020.
    [paper] [code] [results]

2019

  • Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data
    Xiaowei Hu, Yitong Jiang, Chi-Wing Fu, and Pheng-Ann Heng.
    IEEE International Conference on Computer Vision (ICCV), pp. 2472-2481, 2019.
    [paper] [arXiv] [code] [USR dataset] [poster]

  • Deep Multi-Model Fusion for Single-Image Dehazing
    Zijun Deng, Lei Zhu, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Qing Zhang, Jing Qin, and Pheng-Ann Heng.
    IEEE International Conference on Computer Vision (ICCV), pp. 2453-2462, 2019.
    [paper] [code] [results]

  • Depth-Attentional Features for Single-Image Rain Removal
    Xiaowei Hu, Chi-Wing Fu, Lei Zhu, and Pheng-Ann Heng.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8022-8031, 2019.
    [paper] [supp.] [code] [RainCityscapes dataset] [poster]

  • SINet: A Scale-Insensitive Convolutional Neural Network for Fast Vehicle Detection
    Xiaowei Hu, Xuemiao Xu, Yongjie Xiao, Hao Chen, Shengfeng He, Jing Qin, and Pheng-Ann Heng.
    IEEE Transactions on Intelligent Transportation Systems (IEEE TITS), vol. 20, no. 3, pp. 1010-1019, 2019.
    ESI Highly Cited Paper
    [paper] [arXiv] [code] [LSVH dataset (Google)] [LSVH dataset (Baidu)]

  • Probabilistic Multilayer Regularization Network for Unsupervised 3D Brain Image Registration
    Lihao Liu, Xiaowei Hu, Lei Zhu, and Pheng-Ann Heng.
    International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), pp. 346-354, 2019.
    [paper] [arXiv] [code]

  • Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound
    Yi Wang, Haoran Dou, Xiaowei Hu, Lei Zhu, Xin Yang, Ming Xu, Jing Qin, Pheng-Ann Heng, Tianfu Wang, and Dong Ni.
    IEEE Transactions on Medical Imaging (IEEE TMI), vol. 38, no. 12, pp. 2768-2778, 2019.
    [paper] [arXiv] [code]

  • Enhancing Augmented VR Interaction via Egocentric Scene Analysis
    Yang Tian, Chi-Wing Fu, Shengdong Zhao, Ruihui Li, Xiao Tang, Xiaowei Hu, and Pheng-Ann Heng.
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (Ubicomp),
    vol. 3, no. 3, article no. 105, 2019.
    [paper]

  • CATARACTS: Challenge on Automatic Tool Annotation for cataRACT Surgery
    Hassan Al Hajj, Mathieu Lamard, Pierre-Henri Conze, Soumali Roychowdhury, Xiaowei Hu, et al.
    Medical Image Analysis (MedIA), vol. 52, pp. 24-41, 2019.
    [paper]

2018 & before

  • Direction-Aware Spatial Context Features for Shadow Detection
    Xiaowei Hu, Lei Zhu, Chi-Wing Fu, Jing Qin, and Pheng-Ann Heng.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7454-7462, 2018. (Oral)
    [paper] [arXiv] [supp.] [code] [results] [poster] [slides] [video]

  • Recurrently Aggregating Deep Features for Salient Object Detection
    Xiaowei Hu, Lei Zhu, Jing Qin, Chi-Wing Fu, and Pheng-Ann Heng.
    AAAI Conference on Artificial Intelligence (AAAI), pp. 6943-6950, 2018. (Spotlight)
    [paper] [supp.] [code] [results] [poster]

  • R3Net: Recurrent Residual Refinement Network for Saliency Detection
    Zijun Deng^, Xiaowei Hu^, Lei Zhu, Xuemiao Xu, Jing Qin, Guoqiang Han, and Pheng-Ann Heng. (^ joint first authors)
    International Joint Conference on Artificial Intelligence (IJCAI), pp. 684-690, 2018. (Oral)
    [paper] [code] [results] [poster] [slides]

  • Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection
    Lei Zhu, Zijun Deng, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng.
    European Conference on Computer Vision (ECCV), pp. 122-137, 2018.
    [paper] [code] [poster]

  • Deep Attentional Features for Prostate Segmentation in Ultrasound
    Yi Wang, Zijun Deng, Xiaowei Hu, Lei Zhu, Xin Yang, Xuemiao Xu, Pheng-Ann Heng, and Dong Ni.
    International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), pp. 523-530, 2018.
    [paper] [code]

  • AGNet: Attention-Guided Network for Surgical Tool Presence Detection
    Xiaowei Hu, Lequan Yu, Hao Chen, Jing Qin, and Pheng-Ann Heng.
    Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pp. 186-194, 2017.
    [paper] [code]

Honors & Awards

  • Achieved Excellence in the Hong Kong Young Scientist Award (two winners in Engineering Science in Hong Kong)
    2021
  • Hong Kong Ph.D. Fellowship (the highest scholarship for students studying in Hong Kong)
    2016-2020
  • CVPR Doctoral Consortium Award (31 awardees globally)
    2020
  • Best Oral Presentation Award of Hong Kong Computer Vision Workshop (the only winner)
    2019
  • ICCV Outstanding Reviewer Award (top 3.6%)
    2019
  • Excellent Teaching Assistant at CSE Department, CUHK
    2018
  • Top 10 Outstanding Students at SCUT (rank 1st, the highest award for students at SCUT)
    2016
  • Gold Award of Pan-Pearl-River-Delta University IT Project Competition in China
    2016
  • Google Excellence Scholarship (one of 58 winners in China)
    2015
  • Tencent Outstanding Scholarship (the only undergraduate winner at SCUT)
    2015
  • National Scholarship (the highest national wide scholarship for undergraduate students in China)
    2013
  • First Prize of Adolescents Science & Technology Innovation Contest in Hebei Province
    2011

Students

  • Current Students:

    Tianyu Wang (Research Intern, PhD Student at CUHK)
    Jiaqi Xu (Research Intern, PhD Student at CUHK)
    Zhenchao Jin (Research Intern, PhD Student at HKU)
    Sitong Wu (Research Intern, PhD Student at CAS)
    Xuanyu Yang (Research Intern, Undergraduate Student at SJTU)
    Yurui Zhu (Research Intern, PhD Student at USTC)
    Chuanjun Zheng (Research Intern, MPhil Student at SZU)
    Weiyun Wang (Research Intern, incoming PhD Student at Fudan)
    Min Shi (Research Intern, MPhil Student at HUST)
    Zhenghao Xing (Research Assistant at CUHK)

  • Previous Mentorship:

    Lihao Liu (MPhil at CUHK) (now, PhD student at University of Cambridge)
    Xiao Tang (PhD at CUHK)
    Zijun Deng (MPhil at SCUT)
    Yitong Jiang (Undergraduate at CUHK) (now, Researcher at SenseTime)

Professional Activities

  • Invited Talks

    • Shadow Detection and Removal with Deep Learning
      at Shanghai AI Laboratory, October, 2021.
      at TechBeat, August 2021. [video link] [video link (bilibili)] [report]
      at Nanjing University, May 2021.
      at Nanjing University of Science and Technology, May 2021.
      at Nanjing University of Aeronautics and Astronautics, April 2021.
      at Institute of Computing Technology, Chinese Academy of Sciences, March 2021.
      at Peng Cheng Laboratory Overseas Young Scientist Forum, July 2020.
      at Shantou University, December 2019.

    • Instance Segmentation and Instance Shadow Detection
      at Nanjing University of Aeronautics and Astronautics, October 2021.

    • Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data
      at Hong Kong Computer Vision Workshop, October 2019. (Best Oral Presentation Award)

    • Direction-Aware Spatial Context Features for Shadow Detection
      at AI Research Club, July 2018.
      [video link1] [video link2] [report]

  • Conference Reviews

    SIGGRAPH Asia'22, ECCV'22, CVPR'22, ACM MM'22, AAAI'22, ICCV'21, CVPR'21, ACM MM'21, AAAI'21, PG'21, MICCAI'21, ECCV'20, CVPR'20, AAAI'20, PG'20, MICCAI'20, ICCV'19 (Outstanding Reviewer), CVPR'19, MICCAI'19.

  • Journal Reviews

    IEEE TPAMI, IJCV, IEEE TIP, IEEE TMM, IEEE TITS, IEEE TMI, IEEE TCSVT, IEEE TVT, Neurocomputing, JBHI, JMLC, CUIV, Artificial Intelligence Review, The Visual Computer, Computers & Graphics, IEEE CG&A, IEEE Access.

  • Reading List on Deep Learning [link]

  • My Undergraduate Experiences (Chinese)

    Report 1, Report 2, Report 3, Report 4, Report 5