Haoyu Zhang

Hi, welcome to my webpage! zhang.hy.2019@gmail.com


About Me

I’m Haoyu Zhang (张昊宇), and I am currently a PhD Student at the School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), advised by Prof. Liqiang Nie and Prof. Meng Liu. Also I am a Co-culture Student at Pengcheng Laboratory under the supervision of Prof. Yaowei Wang. Before that, I received my M.E. degree in the School of Computer Science and Technology from Shandong University, advised by Prof. Liqiang Nie and Prof. Meng Liu. My research interests include Egocentric VideoQA, Multimodal Dialog, and Person Re-identification.

Education

Harbin Institute of Technology, Shenzhen, China
  • School of Computer Science and Technology, Sep 2023 - Now
  • Doctor, Advisor: Prof. Liqiang Nie and Prof. Meng Liu
Shandong University, Qingdao, China
  • School of Computer Science and Technology, Sep 2020 - Jun 2023
  • Master, Advisor: Prof. Liqiang Nie and Prof. Meng Liu
Shandong University of Science and Technology, Qingdao, China            
  • School of Computer Science and Engineering, Sep 2016 - Jun 2020
  • Bachelor, Graduated with Excellent Thesis Award

Experience

Pengcheng Laboratory, Shenzhen, China (Sep 2023 - Now)            
  • Co-culture Student, in Department of Network Intelligence
  • Advisor: Prof. Yaowei Wang
Kuaishou Technology, Beijing, China (Jul 2024 - Jun 2025)            
  • Academic Intern, in Community Science
  • Project: Multimodal Large Language Model
Alibaba Group, Hangzhou, China (Wed 2022 - Jul 2022)            
  • Academic Intern, in Alibaba Cloud Intelligence
  • Project: Partial Person Re-identification

Publications

Haoyu Zhang, Yuquan Xie, Yisen Feng, Zaijing Li, Meng Liu, Liqiang Nie. “HCQA @ Ego4D EgoSchema Challenge 2024”. IEEE/CVF Conference on Computer Vision and Pattern Recognition EgoVis Workshop (Technical Report), 2024.
[Paper] [Code] [BibTex]

Yisen Feng, Haoyu Zhang, Yuquan Xie, Zaijing Li, Meng Liu, Liqiang Nie. “ObjectNLQ @ Ego4D Episodic Memory Challenge 2024”. IEEE/CVF Conference on Computer Vision and Pattern Recognition EgoVis Workshop (Technical Report), 2024.
[Paper] [Code] [BibTex]

Haoyu Zhang, Meng Liu, Zixin Liu, Xuemeng Song, Yaowei Wang, Liqiang Nie. “Multi-Factor Adaptive Vision Selection for Egocentric Video Question Answering”. International Conference on Machine Learning (ICML), CCF-A, Full Paper, 2024.
[Paper] [Code] [BibTex]

Haoyu Zhang, Meng Liu, Yaowei Wang, Da Cao, Weili Guan, Liqiang Nie. “Uncovering Hidden Connections: Iterative Search and Reasoning for Video-grounded Dialog”. arXiv preprint, arXiv:2310.07259, 2023.
[Paper] [Code] [BibTex]

Haoyu Zhang, Meng Liu, Yuhong Li, Ming Yan, Zan Gao, Xiaojun Chang, Liqiang Nie. “Attribute-guided Collaborative Learning for Partial Person Re-identification”. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), CCF-A, SCI-1, IF 23.6, 2023.
[Paper] [Code] [BibTex]

Weili Guan, Xuemeng Song, Haoyu Zhang, Meng Liu, Chung-Hsing Yeh, Xiaojun Chang. “Bi-directional Heterogeneous Graph Hashing towards Efficient Outfit Recommendation”. ACM International Conference on Multimedia (ACM MM), CCF-A, Oral, 2022.
[Paper] [Code] [BibTex]

Haoyu Zhang, Meng Liu, Zan Gao, Xiaoqiang Lei, Yinglong Wang, Liqiang Nie. “Multimodal Dialog System: Relational Graph-based Context-aware Question Understanding”. ACM International Conference on Multimedia (ACM MM), CCF-A, Full Paper, 2021.
[Paper] [Code] [BibTex]

Professional Services

Conference Reviewer: CVPR 2025, NeurIPS 2022-2024, ICML 2023-2024, ICLR 2024-2025, ACM MM 2022-2024, AAAI 2025, IJCAI 2024, PRCV 2023-2024, ISCAS 2024, ECAI 2024.

Journal Reviewer: Information Sciences, IEEE TCSVT, IEEE TMM, IEEE TKDE.

Volunteer: ICML 2024.

Awards

ICML Travel Award, 2024

Third Prize at the Xinchuang and Digital Economy Postdoctoral Haihe Academic Event, 2023

Outstanding Graduates of Shandong University, 2023

National Scholarship, 2021

Outstanding Graduate Student of Shandong University, 2021

ACM MM Student Travel Award, 2021

Outstanding Graduates of Shandong Province, 2020

Outstanding Graduates from Shandong University of Science and Technology, 2020

Top 10 Outstanding Students in the School of Computer Science and Engineering, 2019

Provincial Government Encouragement Scholarship, 2018

National Encouragement Scholarship, 2017

First Class Academic Scholarship, 2016-2020

Competitions

Kaggle EgoSchema Competition, Rank 1st, 2024

CVPR Ego4D Challenge-EgoSchema Track, Rank 1st, 2024

CVPR Ego4D Challenge-Natural Language Query Track, Rank 2nd, 2024

CVPR Ego4D Challenge-Goal Step Track, Rank 3rd, 2024

WSDM Cup-Toloka Visual Question Answering Challenge, Rank 6th, 2023