Huiyu Wang


I am a research scientist at FAIR, Meta. Before that I received my Ph.D. in Computer Science at Johns Hopkins University, advised by Bloomberg Distinguished Professor Alan Yuille. I obtained M.S. in Electrical Engineering from University of California, Los Angeles and B.S. in Information Engineering from Shanghai Jiao Tong University. I also spent two years as a student researcher at Google. I had wonderful summers at Allen Institute for Artificial Intelligence and TuSimple.

My research interest is computer vision with focuses on recognition and segmentation of images and videos.

News

  • 3 / 3 papers accepted to ECCV 2022.
  • 3 / 3 papers accepted to CVPR 2022.
  • iBOT for masked image modeling with an online tokenizer is accepted to ICLR 2022.
  • DeepLab2 has been released, with MaX-DeepLab and Axial-DeepLab officially re-implemented in TensorFlow2.
  • MaX-DeepLab, accepted to CVPR 2021, proposes Mask Xformers for end-to-end panoptic segmentation.
  • CO2 is accepted to ICLR 2021.
  • Axial-DeepLab, the first architecture with global attention in all layers, is accepted to ECCV 2020.

Selected Publications

k-means Mask Transformer
Qihang Yu, Huiyu Wang, Siyuan Qiao, Maxwell Collins, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2022
arXiv | Code | Google AI Blog

iBOT: Image BERT Pre-Training with Online Tokenizer
Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
In International Conference on Learning Representations (ICLR), 2022
arXiv | Code

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2021
arXiv | Code | Poster | Slides | Video | Google AI Blog

Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Huiyu Wang, Yukun Zhu, Bradley Green, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2020 (Spotlight)
arXiv | Official Code | PyTorch Code | Slides | Video | Google AI Blog

ELASTIC: Improving CNNs with Dynamic Scaling Policies
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan Yuille, Mohammad Rastegari
In Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
arXiv | Code | Poster | Video

Full List of Publications

k-means Mask Transformer
Qihang Yu, Huiyu Wang, Siyuan Qiao, Maxwell Collins, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2022
arXiv | Code | Google AI Blog

CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentation
Feng Wang, Huiyu Wang, Chen Wei, Alan Yuille, Wei Shen
In European Conference on Computer Vision (ECCV), 2022
arXiv | Code

In Defense of Image Pre-Training for Spatiotemporal Recognition
Xianhang Li, Huiyu Wang, Chen Wei, Jieru Mei, Alan Yuille, Yuyin Zhou, Cihang Xie
In European Conference on Computer Vision (ECCV), 2022
arXiv | Code

CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation
Qihang Yu, Huiyu Wang, Dahun Kim, Siyuan Qiao, Maxwell Collins, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)
arXiv | Video | Google AI Blog

TubeFormer-DeepLab: Video Mask Transformer
Dahun Kim, Jun Xie, Huiyu Wang, Siyuan Qiao, Qihang Yu, Hong-Seok Kim, Hartwig Adam, In So Kweon, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv | Visualization

A Simple Data Mixing Prior for Improving Self-Supervised Learning
Sucheng Ren, Huiyu Wang, Zhengqi Gao, Shengfeng He, Alan Yuille, Yuyin Zhou, Cihang Xie
In Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv | Code

iBOT: Image BERT Pre-Training with Online Tokenizer
Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
In International Conference on Learning Representations (ICLR), 2022
arXiv | Code

Searching for TrioNet: Combining Convolution with Local and Global Self-Attention
Huaijin Pi, Huiyu Wang, Yingwei Li, Zizhang Li, Alan Yuille
In British Machine Vision Conference (BMVC), 2021
arXiv | Code

DeepLab2: A TensorFlow Library for Deep Labeling
Mark Weber*, Huiyu Wang*, Siyuan Qiao*, Jun Xie, Maxwell D. Collins, Yukun Zhu, Liangzhe Yuan, Dahun Kim, Qihang Yu, Daniel Cremers, Laura Leal-Taixe, Alan L. Yuille, Florian Schroff, Hartwig Adam, Liang-Chieh Chen
In arXiv preprint, 2021
arXiv | Code

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2021
arXiv | Code | Poster | Slides | Video | Google AI Blog

SpecTr: Spectral Transformer for Hyperspectral Pathology Image Segmentation
Boxiang Yun, Yan Wang, Jieneng Chen, Huiyu Wang, Wei Shen, Qingli Li
In arXiv preprint, 2021
arXiv | Code

CO2: Consistent Contrast for Unsupervised Visual Representation Learning
Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
In International Conference on Learning Representations (ICLR), 2021
arXiv

Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Huiyu Wang, Yukun Zhu, Bradley Green, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2020 (Spotlight)
arXiv | Official Code | PyTorch Code | Slides | Video | Google AI Blog

Scaling Wide Residual Networks for Panoptic Segmentation
Liang-Chieh Chen, Huiyu Wang, Siyuan Qiao
In arXiv preprint, 2020
arXiv | Code

Rethinking Normalization and Elimination Singularity in Neural Networks
Siyuan Qiao, Huiyu Wang, Chenxi Liu, Wei Shen, Alan Yuille
In arXiv preprint, 2019
arXiv | Code

Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusion
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille
In Winter Conference on Applications of Computer Vision (WACV), 2020 (Spotlight)
arXiv

Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image Retrieval
Qing Liu, Lingxi Xie, Huiyu Wang, Alan Yuille
In International Conference on Computer Vision (ICCV), 2019
arXiv | Code

Weight Standardization
Siyuan Qiao, Huiyu Wang, Chenxi Liu, Wei Shen, Alan Yuille
In arXiv preprint, 2019
arXiv | Code

ELASTIC: Improving CNNs with Dynamic Scaling Policies
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan Yuille, Mohammad Rastegari
In Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
arXiv | Code | Poster | Video

Semantic Mapping for Safe and Comfortable Navigation of a Brain-Controlled Wheelchair
Zhixuan Wei, Weidong Chen, Jingchuan Wang, Huiyu Wang, Kang Li
In International Conference on Intelligent Robotics and Applications (ICIRA), 2013
Paper