YEHUI
profile photo

Yehui Tang (唐业辉)

I am a senior researcher at Huawei Noah’s Ark Lab working with Yunhe Wang. Before that, I obtained PhD from school of artifical intelligence in Peking University, supervised by Prof. Chao Xu. During my PhD, I study neural architecture design and model compression. Now I focus on construing large language/multimodal models and their efficient training/inference methods.

Email  /  Google Scholar  /  DBLP

Publications

  • Rethinking Optimization and Architecture for Tiny Language Models
    Yehui Tang, Fangcheng Liu, Yunsheng Ni, Yuchuan Tian, Zheyuan Bai, Yi-Qi Hu, Sichao Li, Shangling Jui, Kai Han, Yunhe Wang
    paper

  • PanGu-Pi: Enhancing Language Model Architectures via Nonlinearity Compensation
    Yunhe Wang, Hanting Chen, Yehui Tang, Tianyu Guo, Kai Han, Ying Nie, Xutao Wang, Hailin Hu, Zheyuan Bai, Yun Wang, Fangcheng Liu, Zhicheng Liu, Jianyuan Guo, Sinan Zeng, Yinchen Zhang, Qinghua Xu, Qun Liu, Jun Yao, Chao Xu, Dacheng Tao
    paper

  • One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation
    Zhiwei Hao, Jianyuan Guo, Kai Han, Yehui Tang, Han Hu, Yunhe Wang, Chang Xu
    NeurIPS 2023 Highlight | paper

  • Masked Image Modeling with Local Multi-Scale Reconstruction
    Haoqing Wang, Yehui Tang, Yunhe Wang, Jianyuan Guo, Zhi-Hong Deng, Kai Han
    CVPR 2023 Highlight | paper | code

  • Network Expansion for Practical Training Acceleration
    Ning Ding, Yehui Tang, Kai Han, Chao Xu, Yunhe Wang
    CVPR 2023 | paper | code

  • GhostNetV2: Enhance Cheap Operation with Long-Range Attention.
    Yehui Tang, Kai Han, Jianyuan Guo, Chang Xu, Chao Xu, Yunhe Wang
    NeurIPS 2022 Spotlight | paper | code | MindSpore code

  • An Image Patch is a Wave: Quantum Inspired Vision MLP (WaveMLP).
    Yehui Tang, Kai Han, Jianyuan Guo, Chang Xu, Yanxi Li, Chao Xu, Yunhe Wang
    CVPR 2022 Oral | paper

  • Patch Slimming for Efficient Vision Transformers.
    Yehui Tang, Kai Han, Yunhe Wang, Chang Xu, Jianyuan Guo, Chao Xu, Dacheng Tao
    CVPR 2022 | paper

  • Hire-MLP: Vision MLP via Hierarchical Rearrangement.
    Jianyuan Guo*, Yehui Tang*, Kai Han, Xinghao Chen, Han Wu, Chao Xu, Chang Xu, Yunhe Wang
    CVPR 2022 (* equal contribution) | paper

  • CMT: Convolutional Neural Networks Meet Vision Transformers.
    Jianyuan Guo, Kai Han, Han Wu, Chang Xu, Yehui Tang, Chunjing Xu, Yunhe Wang
    CVPR 2022 | paper

  • Source-Free Domain Adaptation via Distribution Estimation
    Ning Ding, Yixing Xu, Yehui Tang, Chao Xu, Yunhe Wang, Dacheng Tao
    CVPR 2022

  • Augmented Shortcuts for Vision Transformers
    Yehui Tang, Kai Han, Chang Xu, An Xiao, Yiping Deng, Chao Xu, Yunhe Wang
    NeurIPS 2021 | paper | MindSpore code

  • Manifold Regularized Dynamic Network Pruning
    Yehui Tang, Yunhe Wang, Yixing Xu, Yiping Deng, Chao Xu, Dacheng Tao, Chang Xu
    CVPR 2021 | paper | code | MindSpore code

  • SCOP: Scientific Control for Reliable Neural Network Pruning
    Yehui Tang, Yunhe Wang, Yixing Xu, Dacheng Tao, Chunjing Xu, Chao Xu, Chang Xu
    NeurIPS 2020 | paper | code

  • A Semi-Supervised Assessor of Neural Architectures
    Yehui Tang, Yunhe Wang, Yixing Xu, Hanting Chen, Boxin Shi, Chao Xu, Chunjing Xu, Qi Tian, Chang Xu
    CVPR 2020 | paper

  • Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks
    Yehui Tang, Yunhe Wang, Yixing Xu, Boxin Shi, Chao Xu, Chunjing Xu, Chang Xu
    AAAI 2020 | paper | code

  • Reborn filters: Pruning convolutional neural networks with limited data
    Yehui Tang, Shan You, Chang Xu, Jin Han, Chen Qian, Boxin Shi, Chao Xu, Changshui Zhang
    AAAI 2020 | paper

  • Homogeneous Architecture Augmentation for Neural Predictor
    Yuqiao Liu*, Yehui Tang*, Yanan Sun
    ICCV 2021 (* equal contribution) | paper

  • Learning frequency domain approximation for binary neural networks
    Yixing Xu, Kai Han, Chang Xu, Yehui Tang, Chunjing Xu, Yunhe Wang
    NeurIPS 2021 | paper | MindSpore code

  • ReNAS: Relativistic Evaluation of Neural Architecture Search
    Yixing Xu, Yunhe Wang, Kai Han, Yehui Tang, Shangling Jui, Chunjing Xu, Chang Xu
    CVPR 2021 Oral | paper | MindSpore code

  • Neuromorphic Camera Guided High Dynamic Range Imaging
    Jin Han, Chu Zhou, Peiqi Duan, Yehui Tang, Chang Xu, Chao Xu, Tiejun Huang, Boxin Shi
    CVPR 2020 | paper

  • Frequency Domain Compact 3D Convolutional Neural Networks
    Hanting Chen, Yunhe Wang, Han Shu, Yehui Tang, Chunjing Xu, Boxin Shi, Chao Xu, Qi Tian, Chang Xu
    CVPR 2020 | paper

  • A Survey on Vision Transformer
    Kai Han, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang, An Xiao, Chunjing Xu, Yixing Xu, Zhaohui Yang, Yiman Zhang, Dacheng Tao
    IEEE T-PAMI 2022 | paper

  • Services

  • Senior Program Committee Members of IJCAI 2021.

  • Program Committee Members of CVPR 2022, ICLR 2022, AAAI 2022, NeurIPS 2021, ICCV 2021, ICML 2021, CVPR 2021, ICLR 2021, etc.

  • Journal Reviewers of IEEE T-PAMI, IEEE T-NNLS, Pattern Recognition, Neurocomputing, etc.

  • Awards

  • 2020, President's PhD Scholarship, Peking University.

  • 2020, National Scholarship (top 1%), Chinese Ministry of Education.

  • 2020, Pacemaker to Merit Student (top 1%), Peking University.

  • 2016, National Scholarship (top 1%), Chinese Ministry of Education.

  • 2015, National Scholarship (top 1%), Chinese Ministry of Education.

  • This website is based on the source code shared by Dr. Yunhe Wang. Thanks.