Zhang SHENGYU   ZJU100 Young Professor（百人计划研究员） School of Software Technology & Lab of Artificial Intelligence Zhejiang University Zhejiang, China. 310000. Address: Room 205, Zetong Building, Yuquan Campus Email: sy_zhang αt zju dοt edu dοt cn

Biography

I obtained my Ph.D in the College of Computer Science and Technology at Zhejiang University, advised by Prof. Fei Wu. I was so lucky to work with Prof. Zhou Zhao and Prof. Kun Kuang at Zhejiang University. From March 2021 to September 2022, I become a visiting research scholar of NExT++ Research Center, National University of Singapore, advised by Prof. Tat-seng Chua. I feel grateful to work with Prof. Fuli Feng at University of Science and Technology of China.

As an AI researcher with a specialization in machine learning, my work revolves around the cutting-edge domain of device-cloud collaborative learning, multi-media analysis, and data mining. My research endeavors are driven by a deep interest in the development and deployment of machine learning models that operate collaboratively across both edge devices and cloud servers. Specifically, my research seeks to address the unique challenges associated with the seamless integration of heterogeneous models in these diverse computational environments. Through the design and evaluation of these models, I seek to improve the scalability, reliability, and real-time performance of machine learning systems in a wide range of applications.

News

• Feb. 2024: One paper was accepted by ICLR about out-of-domain knowledge distillation without access to source domain.
  
• Feb. 2024: One paper was accepted by WWW about on-device model uncertainty detection for intelligent cloud request.
  
• Mar. 2024: One paper was accepted by TOIS about out-of-domain model transfer without acess to target domain.
  
• 2023

  Jul. 2023: Three paper was accepted by CICAI, among which the work about causality-inspired structure learning for recsys has been granted the Best Paper Award.

  Jul. 2023: Two paper was accepted by ACM MM.

  Jul. 2023: One paper was accepted by TOIS.

  Jul. 2023: One paper was accepted by TKDE about causal distillation of heterogeneous models.

  May. 2023: Two papers was accepted by ACL 2023.

  Mar. 2023: One papers was accepted by SIGIR 2023 on disentangled music representation learning.

  Mar. 2023: Two papers were accepted by CVPR 2023.

  Feb. 2023: One paper was accepted by TPAMI on causality-inspired disentangled representation learning for recsys.

  Jan. 2023: One paper was accepted by WWW 2023 on edge-cloud collaborative recommendation.

Publications

^* denotes co-first authors, ^✉ denotes the corresponding author, ^# denotes (co-)supervised students

Highlights

• ModelGPT: Unleashing LLM’s Capabilities for Tailored Model Generation   |   [GitHub]   |   [知乎]
  User description + A few data + ModelGPT   =(Inference)   Off-the-shelf AI Model
  Zihao Tang, Zheqi Lv, Shengyu Zhang, Fei Wu, Kun Kuang
  Arxiv, 2024
  
• Instruction tuning for large language models: A survey   |   [GitHub]
  Shengyu Zhang, Linfeng Dong, Xiaoya Li, Sen Zhang, Xiaofei Sun, Shuhe Wang, Jiwei Li, Runyi Hu, Tianwei Zhang, Fei Wu, Guoyin Wang
  Arxiv, 2023
  

2024

• Transferring Causal Mechanism over Meta-representations for Target-unknown Cross-domain Recommendation
  Shengyu Zhang, Qiaowei Miao, Ping Nie, Mengze Li, Zhengyu Chen, Fuli Feng, Kun Kuang, Fei Wu
  ACM Transactions on Information Systems (TOIS), 2024
  
• AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation   |   [GitHub]
  Zihao Tang, Zheqi Lv, Shengyu Zhang^✉, Yifan Zhou, Xinyu Duan, Fei Wu, Kun Kuang
  The International Conference on Learning Representations (ICLR), 2024
  
• Intelligent Model Update Strategy for Sequential Recommendation
  Zheqi Lv, Wenqiao Zhang, Zhengyu Chen, Shengyu Zhang^✉, Kun Kuang
  The Web Conference (WWW), 2024
  
• MPOD123: One Image to 3D Content Generation Using Mask-enhanced Progressive Outline-to-Detail Optimization  |   [Demo]
  Jimin Xu, Tianbao Wang, Tao Jin, Shengyu Zhang^✉, Dongjie Fu, Zhe Wang, Jiangjing Lyu, Chengfei Lv, Chaoyue Niu, Zhou Yu, Zhou Zhao, Fei Wu
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  
• CoreRec: A Counterfactual Correlation Inference for Next Set Recommendation
  Kexin Li, Chengjiang Long, Shengyu Zhang, Xudong Tang, Zhichao Zhai, Kun Kuang, Jun Xiao
  AAAI Conference on Artificial Intelligence (AAAI), 2024
  

2023

• Causal Distillation for Alleviating Performance Heterogeneity in Recommender Systems
  Shengyu Zhang, Ziqi Jiang, Jiangchao Yao, Fuli Feng, Kun Kuang, Zhou Zhao, Shuo Li, Hongxia Yang, Tat-seng Chua, and Fei Wu
  IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023
  
• SLED: Structure Learning based Denoising for Recommendation
  Shengyu Zhang, Tan Jiang, Kun Kuang, Fuli Feng, Jin Yu, Jianxin Ma, Zhou Zhao, Jianke Zhu, Hongxia Yang, Tat-sen Chua, Fei Wu
  ACM Transactions on Information Systems (TOIS), 2023
  
• Reconnecting the Broken Civilization: Patchwork Integration of Fragments from Ancient Manuscripts
  Yuqing Zhang^#, Zhou Fang, Xinyu Yang, Shengyu Zhang^✉, Baoyi He, Huaiyong Dou, Junchi Yan, Yongquan Zhang, Fei Wu
  ACM International Conference on Multimedia (ACM MM), 2023
  
• Unsupervised Domain Adaptation for Video Object Grounding with Cascaded Debiasing Learning
  Mengze Li, Haoyu Zhang, Juncheng Li, Zhou Zhao, Wenqiao Zhang, Shengyu Zhang^✉, Shiliang Pu, Yueting Zhuang, Fei Wu
  ACM International Conference on Multimedia (ACM MM), 2023
  
• DisCover: Disentangled Music Representation Learning for Cover Song Identification
  Jiahao Xun^#,Shengyu Zhang^✉, Yanting Yang, Jieming Zhu, Liqun Deng, Zhou Zhao, Zhenhua Dong, Ruiqi Li, Lichao Zhang and Fei Wu
  International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023
  
• WINNER: Weakly-supervised hIerarchical decompositioN and aligNment for spatio-tEmporal video gRounding
  Mengze Li^#, Han Wang, Wenqiao Zhang, Jiaxu Miao, Wei Ji, Zhou Zhao, Shengyu Zhang^✉, Fei Wu
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  
• Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning
  Wei Ji, Renjie Liang, Zhedong Zheng, Wenqiao Zhang, Shengyu Zhang, Juncheng Li, Mengze Li, Tat-Seng Chua,
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  
• Personalized Latent Structure Learning for Recommendation
  Shengyu Zhang, Fuli Feng, Kun Kuang, Wenqiao Zhang, Zhou Zhao, Hongxia Yang, Tat-Seng Chua, Fei Wu,
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
  
• Video-Audio Domain Generalization via Confounder Disentanglement
  Shengyu Zhang, Xusheng Feng, Wenyan Fan, Wenjing Fang, Fuli Feng, Wei Ji, Shuo Li, Li Wang, Shanshan Zhao, Zhou Zhao, Tat-Seng Chua, Fei Wu
  AAAI Conference on Artificial Intelligence (AAAI), 2023
  
• End-to-End Optimization of Quantization-based Structure Learning and Interventional Next-item Recommendation
  Kairui Fu, Qiaowei Miao, Shengyu Zhang^✉, Kun Kuang, Fei wu
  The 3rd CAAI International Conference on Artificial Intelligence (CICAI), 2023, BEST PAPER AWARD
  
• Multi-trends Enhanced Dynamic Micro-video Recommendation
  Yujie Lu, Yingxuan Huang, Shengyu Zhang^✉, Wei Han, Hui Chen, Zhou Zhao, Fei Wu
  The 3rd CAAI International Conference on Artificial Intelligence (CICAI), 2023
  
• DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization
  Zheqi Lv, Wenqiao Zhang, Shengyu Zhang, Kun Kuang, Feng Wang, Yongwei Wang, Zhengyu Chen, Tao Shen, Hongxia Yang, Beng Chin Ooi and Fei Wu
  The Web Conference (WWW), 2023
  
• Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning
  Ye Wang, Wang Lin, Shengyu Zhang, Tao Jin, Linjun Li, Xize Cheng and Zhou Zhao
  The Annual Meeting of the Association for Computational Linguistics (ACL), 2023
  
• Multi-modal Action Chain Abductive Reasoning
  Mengze Li^#, Tianbao Wang, Jiahe Xu, Kairong Han, Shengyu Zhang, Zhou Zhao, Jiaxu Miao, wenqiao zhang, Shiliang Pu and Fei Wu
  The Annual Meeting of the Association for Computational Linguistics (ACL), 2023
  
• Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling
  Zheqi Lv^*, Feng Wang^*, Shengyu Zhang^*, Kun Kuang, Hongxia Yang, Fei Wu
  The 3rd CAAI International Conference on Artificial Intelligence (CICAI), 2023
  

2022

• MIC:Model-agnostic Integrated Cross-channel Recommender
  Ping Nie, Yujie Lu, Shengyu Zhang, Ming Zhao, Ruobing Xie, William Yang Wang and Yi Ren
  ACM International Conference on Information and Knowledge Management (CIKM), 2022
  
• Weakly-supervised Disentanglement Network for Video Fingerspelling Detection
  Ziqi Jiang^#, Shengyu Zhang^✉, Siyuan Yao, Wenqiao Zhang, Sihan Zhang, Juncheng Li, Zhou Zhao, Fei Wu
  ACM International Conference on Multimedia (MM) , 2022
  
• HERO: Hierarchical Spatio-temporal reasoning with Contrastive Action Correspondence for Video Object Grounding
  Mengze Li^#, Tianbao Wang, Haoyu Zhang, Shengyu Zhang, Zhou Zhao, Wenqiao Zhang, Jiaxu Miao, Shiliang Pu, Fei Wu
  ACM International Conference on Multimedia (MM) , 2022
  
• Dilated Context Integrated Network with Cross-Modal Consensus for Temporal Emotion Localization in Videos
  Juncheng Li, Junlin Xie, Linchao Zhu, Long Qian, Siliang Tang, Wenqiao Zhang, Haochen Shi, Shengyu Zhang, Longhui Wei, Qi Tian, Yueting Zhuang
  ACM International Conference on Multimedia (MM) , 2022
  
• Edge-Cloud Polarization and Collaboration: A Comprehensive Survey
  Jiangchao Yao, Shengyu Zhang, Yang Yao, Feng Wang, Jianxin Ma, Jianwei Zhang, Yunfei Chu, Luo ji, Kunyang Jia, Tao Shen, Anpeng Wu, Fengda Zhang, Ziqi Tan, Kun Kuang, Chao Wu, Fei Wu
  IEEE Transactions on Knowledge and Data Engineering (TKDE) , 2022.
  
• Intelligent Request Strategy Design in Recommender System
  Xufeng Qian, Yue Xu, Fuyu Lv, Shengyu Zhang^✉, Ziwen Jiang, Qingwen Liu, Xiaoyi Zeng, Tat-Seng Chua, Fei Wu
  The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) , 2022.
  
• BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotation | [GitHub]
  Wenqiao Zhang, Lei Zhu, James Hallinan, Shengyu Zhang, Andrew Makmur, Qingpeng Cai, Beng Chin Ooi
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR) , 2022.
  
• End-to-End Modeling via Information Tree for One-Shot Natural Language Spatial Video Grounding
  Mengze Li^#, Tianbao Wang, Haoyu Zhang, Shengyu Zhang, Zhou Zhao, Jiaxu Miao, Wenqiao Zhang, Wenming Tan, Jin Wang, PENG WANG, Shiliang Pu, Fei Wu
  Annual Meeting of the Association for Computational Linguistics (ACL) , 2022.
  
• Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation ｜ [GitHub]
  Shengyu Zhang, Lingxiao Yang, Dong Yao, Yujie Lu, Fuli Feng, Zhou Zhao, Tat-Seng Chua and Fei Wu
  International World Wide Web Conferences (WWW), 2022
  
• Contrastive Learning Adopting Positive-Negative Frame Mask for Music Representation | [GitHub]
  Dong Yao^#, Zhou Zhao, Shengyu Zhang^✉, Jieming Zhu, Yudong Zhu, Rui Zhang and Xiuqiang He
  International World Wide Web Conferences (WWW) , 2022
  
• MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning
  Wenqiao Zhang, Haochen Shi, Jiannan Guo, Shengyu Zhang, Qingpeng Cai, Juncheng Li, Sihui Luo, Yueting Zhuang
  Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI) , 2022.
  
• Uncovering Causal Effects of Online Short Videos on Consumer Behaviors
  Ziqi Tan^#, Shengyu Zhang, Nuanxin Hong, Kun Kuang, Yifan Yu, Zhou Zhao, Jin Yu, Hongxia Yang, Shiyuan Pan, Jingren Zhou, Fei Wu
  The Fifteenth International Conference on Web Search and Data Mining (WSDM), 2022.
  

2021

• Why Do We Click: Visual Impression-aware News Recommendation | [GitHub]
  Jiahao Xun^*#, Shengyu Zhang^*, Zhou Zhao, Jieming Zhu, Qi Zhang, Jingjie Li, Xiuqiang He, Xiaofei He, Tat-Seng Chua, and Fei Wu
  ACM International Conference on Multimedia (MM) , 2021. Oral Presentation
  
• CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation | [GitHub]
  Shengyu Zhang, Dong Yao, Zhou Zhao, Tat-Seng Chua, and Fei Wu
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) , 2021
• Future-Aware Diverse Trends Framework for Recommendation | [GitHub]
  Yujie Lu^*, Shengyu Zhang^*, Yingxuan Huang^*, Xinyao Yu, Luyao Wang, Zhou Zhao and Fei Wu
  International World Wide Web Conferences (WWW) , 2021

2020 and prior

• DeVLBert: Learning Deconfounded Visio-Linguistic Representations | [GitHub]
  Shengyu Zhang, Tan Jiang, Tan Wang, Kun Kuang, Zhou Zhao, Jianke Zhu, Jin Yu, Hongxia Yang, and Fei Wu
  ACM International Conference on Multimedia (MM) , 2020
  
• Poet: Product-oriented Video Captioner for E-commerce | [Dataset]
  Shengyu Zhang, Ziqi Tan, Jin Yu, Zhou Zhao, Kun Kuang, Jie Liu, Jingren Zhou, Hongxia Yang, and Fei Wu
  ACM International Conference on Multimedia (MM) , 2020, Oral Presentation
  
• Comprehensive Information Integration Modeling Framework for Video Titling | [Dataset]
  Shengyu Zhang, Ziqi Tan, Jin Yu, Zhou Zhao, Kun Kuang, Tan Jiang, Jingren Zhou, Hongxia Yang, and Fei Wu
  In SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2020.
  
• Text-to-Image Synthesis via Visual-Memory Creative Adversarial Network
  Shengyu Zhang, Hao Dong, Wei Hu, Yike Guo, Chao Wu, Di Xie, Fei Wu
  In Pacific Rim Conference on Multimedia (PCM), 2018
• Temporality-enhanced knowledge memory network for factoid question answering
  Xin-yu Duan, Si-liang Tang, Shengyu Zhang, Yin Zhang, Zhou Zhao, Jian-ru Xue, Yue-ting Zhuang, Fei Wu
  Frontiers of Information Technology & Electronic Engineering, 2018

Workshop & Short Papers

• Stable Prediction on Graphs with Agnostic Distribution Shift
  Shengyu Zhang, Kun Kuang, Jiezhong Qiu, Jin Yu, Zhou Zhao, Hongxia Yang, Zhongfei Zhang, Fei Wu
  The 2023 ACM SIGKDD Workshop on Causal Discovery, Prediction and Decision , 2023
  
• Grounded and Controllable Image Completion by Incorporating Lexical Semantics
  Shengyu Zhang, Tan Jiang, Qinghao Huang, Ziqi Tan, Zhou Zhao, Siliang Tang, Jin Yu, Hongxia Yang, Yi Yang, Fei Wu
  CVPR 2021 Causality in Vision Workshop , 2021
  
• DeVLBert: Out-of-distribution Visio-Linguistic Pretraining with Causality
  Shengyu Zhang, Tan Jiang, Tan Wang, Kun Kuang, Zhou Zhao, Jianke Zhu, Jin Yu, Hongxia Yang, and Fei Wu
  CVPR 2021 Causality in Vision Workshop , 2021
  
• Modeling High-order Interactions across Multi-interests for Micro-video Reommendation
  Dong Yao, Shengyu Zhang, Zhou Zhao, Wenyan Fan, Jieming Zhu, Xiuqiang He and Fei Wu
  Association for the Advancement of Artificial Intelligence , 2021 (Student Abstract)
  
• Multi-label Community-based Question Classification via Personalized Sequence Memory Network Learning
  Xinyu Duan, Shengyu Zhang, Zhou Zhao, Fei Wu
  Association for the Advancement of Artificial Intelligence , 2018 (Student Abstract)
  

Selected Honors Awarded

National Scholarship for PhD Student, China, 2021

WAIC Yunfan Award (World Artificial Intelligence Conference), 2021, Report

Outstanding Intern in Alibaba AZFT (First Prize, Rank 1st), 2020

Doctoral Research Rising Star Award (Zhejiang University), 2020

First Prize in China Collegiate Computing Contest – AI Innovation Contest, 2018

Doctoral Outstanding Freshman Scholarship

Talks

• Causality-inspired Deep Learning Algorithms for Device-cloud Collaboration
  CCIG (中国图像图形大会), May 11, 2023
• Multi-modal Understanding and Sequential Modeling in Recommender Systems
  Huawei Noah's Ark Lab, Jun. 2022
• Causal Multi-modal Understanding and Recommendation
  National University of Singapore, Feb. 2022

Academic Service

Journal Reviewer: IEEE Transactions on Knowledge and Data Engineering (TKDE), ACM Transactions on Information Systems (TOIS), IEEE Transactions on Multimedia (TMM), IEEE Transactions on Neural Networks and Learning Systems (TNNLS), Computers in Human Behavior, Neurocomputing, IEEE Transactions on Cybernetics (TCYB), Frontiers of Information Technology & Electronic Engineering, Multimedia Systems, etc.

Conference Reviewer: NeurIPS 2023|2024 PC Member, ECCV 2024 PC Member, SIGIR 2023|2024 PC Member, KDD 2023|2024 PC Member, IJCAI 2023|2024 PC Member, AAAI 2023|2024 PC Member, ACM MM 2023 PC Member, WSDM 2023 PC Member; ARR 2022 Reviewer, SIGIR 2022 sub-reviewer, WWW 2022 sub-reviewer, CVPR Causality in Vision Workshop 2021.