Huiyu Wang


I am a research scientist at Facebook (Meta) AI Research. Before that I received my Ph.D. in Computer Science at Johns Hopkins University, advised by Bloomberg Distinguished Professor Alan Yuille. I obtained M.S. in Electrical Engineering from University of California, Los Angeles and B.S. in Information Engineering from Shanghai Jiao Tong University. I also spent two years as a student researcher at Google and had wonderful summers at Allen Institute for Artificial Intelligence, and TuSimple.

My research interest is computer vision with focuses on long-range modeling.

News

  • 3 papers accepted to CVPR 2022.
  • iBOT for masked image modeling with an online tokenizer is accepted to ICLR 2022.
  • DeepLab2 has been released, with MaX-DeepLab and Axial-DeepLab officially re-implemented in TensorFlow2.
  • MaX-DeepLab, accepted to CVPR 2021, proposes Mask Xformers for end-to-end panoptic segmentation.
  • CO2 is accepted to ICLR 2021.
  • Axial-DeepLab, the first architecture with global attention in all layers, is accepted to ECCV 2020.

Selected Publications

iBOT: Image BERT Pre-Training with Online Tokenizer
Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
In International Conference on Learning Representations (ICLR), 2022
arXiv | Code

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2021
arXiv | Code | Poster | Slides | Video | Google AI Blog

Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Huiyu Wang, Yukun Zhu, Bradley Green, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2020 (Spotlight)
arXiv | Official Code | PyTorch Code | Slides | Video | Google AI Blog

ELASTIC: Improving CNNs with Dynamic Scaling Policies
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan Yuille, Mohammad Rastegari
In Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
arXiv | Code | Poster | Video

Full List of Publications

iBOT: Image BERT Pre-Training with Online Tokenizer
Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
In International Conference on Learning Representations (ICLR), 2022
arXiv | Code

Searching for TrioNet: Combining Convolution with Local and Global Self-Attention
Huaijin Pi, Huiyu Wang, Yingwei Li, Zizhang Li, Alan Yuille
In British Machine Vision Conference (BMVC), 2021
arXiv | Code

DeepLab2: A TensorFlow Library for Deep Labeling
Mark Weber*, Huiyu Wang*, Siyuan Qiao*, Jun Xie, Maxwell D. Collins, Yukun Zhu, Liangzhe Yuan, Dahun Kim, Qihang Yu, Daniel Cremers, Laura Leal-Taixe, Alan L. Yuille, Florian Schroff, Hartwig Adam, Liang-Chieh Chen
In arXiv preprint, 2021
arXiv | Code

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In Conference on Computer Vision and Pattern Recognition (CVPR), 2021
arXiv | Code | Poster | Slides | Video | Google AI Blog

Scaling Wide Residual Networks for Panoptic Segmentation
Liang-Chieh Chen, Huiyu Wang, Siyuan Qiao
In arXiv preprint, 2020
arXiv | Code

CO2: Consistent Contrast for Unsupervised Visual Representation Learning
Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
In International Conference on Learning Representations (ICLR), 2021
arXiv

Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Huiyu Wang, Yukun Zhu, Bradley Green, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
In European Conference on Computer Vision (ECCV), 2020 (Spotlight)
arXiv | Official Code | PyTorch Code | Slides | Video | Google AI Blog

Rethinking Normalization and Elimination Singularity in Neural Networks
Siyuan Qiao, Huiyu Wang, Chenxi Liu, Wei Shen, Alan Yuille
In arXiv preprint, 2019
arXiv | Code

Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusion
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille
In Winter Conference on Applications of Computer Vision (WACV), 2020 (Spotlight)
arXiv

Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image Retrieval
Qing Liu, Lingxi Xie, Huiyu Wang, Alan Yuille
In International Conference on Computer Vision (ICCV), 2019
arXiv | Code

Weight Standardization
Siyuan Qiao, Huiyu Wang, Chenxi Liu, Wei Shen, Alan Yuille
In arXiv preprint, 2019
arXiv | Code

ELASTIC: Improving CNNs with Dynamic Scaling Policies
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan Yuille, Mohammad Rastegari
In Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
arXiv | Code | Poster | Video

Semantic Mapping for Safe and Comfortable Navigation of a Brain-Controlled Wheelchair
Zhixuan Wei, Weidong Chen, Jingchuan Wang, Huiyu Wang, Kang Li
In International Conference on Intelligent Robotics and Applications (ICIRA), 2013
Paper