👋 Hello!

I am currently a Research Associate at Multimedia & Vision Group @ QMUL, working with Prof. Dimitrios Kollias on AI-Enabled Face Analysis in the Wild. In parallel, I also a Research Associate at the University of Exeter, focusing on Fairness in Personality Analysis, in collaboration with Prof. Zeyu Fu and Prof. Siyang Song.

I am a final-year Ph.D. candidate at Xi’an Jiaotong University, supervised by Prof. Xinyu Yang. From 2023 to 2024, I was a visiting researcher at Queen Mary University of London, under the supervision of Prof. Dimitrios Kollias.

🔥 I’m open to Postdoctoral Research opportunities starting in 2025/2026 — feel free to reach out!

🎯 Research Interests

My research centers on human affective behavior understanding and generation, trustworthy AI, and multimodal and multi-task learning, with the goal of enabling interpretable, fair, and robust systems for human-centered interaction.

Affective Analysis

Facial & Body Behavior

  • Expressions Recognition
  • Action-Unit (AU) Detection
  • Valence-Arousal (VA) Estimation
  • Gesture & Pose Analysis

Featured Works: [4], [6], [7], [12], [13], [15]

Multi-Task Modeling

  • Unified Affective Analysis Framework
  • Shared representation learning & task-specific adaptation

Featured Works: [12]

Trustworthy AI

Fairness & Consistent

  • Fair & Consistent Analysis
  • Domain-Generalized & Bias-Resilient Modeling
  • Fairness in Continuous Tasks

Featured Works: [2], [3], [5], [8], [10]

Causal & Explainability

  • Counterfactual Reasoning
  • Causal Discovery
  • Interpretable Affective Modeling

Featured Works: [under review]

Multimodal Learning

VLMS

  • Representation Learning
  • Prompt Learning
  • Visual-Language Alignment

Featured Works: [1], [6]

Multimodal Fusion & Alignment

  • Audio, Visual & Language
  • Prototype-based multimodal representation learning
  • Body–Facial Behavior Fusion

Featured Works: [1], [4], [7], [11], [14], [15]

Behavior Generation

Talking Head Generation

  • StyleGAN, Diffusion, NeRF
  • Controllable Facial and Head Motion Transfer
  • Multi-view and identity-preserving generation

Featured Works: [Second Prize]

Reaction Generation

  • Generation of Facial Reactions to Stimuli
  • Personalized and Affect-aware Response

Featured Works: [9]

✨ News

  • 2025.07:   🎉 One conference paper accepted at ACM MM 2025 !
  • 2025.07:   📢 Our work presented at the BMVA Symposium on AI Security !
  • 2025.06:   👨‍💻 Served as Program Chair, Session Chair & Data Chair of the 9th ABAW Workshop and Competition at ICCV 2025 !
  • 2025.04:   🎉 One journal paper accepted by IEEE Transactions on Biometrics, Behavior, and Identity Science (TBIOM) !
  • 2025.01:   👨‍💻 Served as Program Chair, Session Chair & Data Chair of the 8th ABAW Workshop and Competition at IEEE CVPR 2025 !
  • 2024.08:   🏆 Honored with the Best Reviewed Paper Award at IEEE FG 2024 !
  • 2024.08:   🎉 One conference paper accepted at IEEE IJCB 2024 !
  • 2024.08:   🎉 Two workshop papers accepted at ECCV 2024 [1] [2] !
  • 2024.05:   👨‍💻 Served as Program Chair, Session Chair & Data Chair of the 7th ABAW Workshop and Competition at ECCV 2024 !
  • 2025.07:   🎉 One journal paper accepted at JAMIA 2025 !
  • 2024.04:   🎉 One workshop paper accepted at IEEE CVPR 2024 !
  • 2024.03:   🎉 One conference paper accepted at IEEE FG 2024 !
  • 2024.01:   👨‍💻 Served as Program Chair, Session Chair & Data Chair of the 6th ABAW Workshop and Competition at IEEE CVPR 2024 !

📝 Selected Publications

Guanyu Hu, Dimitrios Kollias, Xinyu Yang
ACM MM 2025
Lian Tangzheng, Guanyu Hu, Dimitrios Kollias, Xinyu Yang, and Oya Celiktutan
AAAI 2026 (Under Review)
Guanyu Hu, Dimitrios Kollias, E. Papadopoulou, P. Tzouveli, Jie Wei, and Xinyu Yang
IEEE TBIOM 2025
Dimitrios Kollias, Stefanos Zafeiriou, Irene Kotsia, ..., Guanyu Hu
ICCV 2025
Guanyu Hu, Dimitrios Kollias, and Xinyu Yang
IEEE TAFFC 2025 (Under Review)
Guanyu Hu, Dimitrios Kollias, and Xinyu Yang
IEEE TIP 2025 (Under Review)
D. Kollias, P. Tzirakis, A. Cowen, S. Zafeiriou, ..., Guanyu Hu, ....
CVPR 2025
Guanyu Hu, Eleni Papadopoulou, Dimitrios Kollias, Paraskevi Tzouveli, Jie Wei, Xinyu Yang
IEEE FG 2025
Guanyu Hu, Jie Wei, Siyang Song, Dimitrios Kollias, Xinyu Yang, Zhonglin Sun, O. Kaloidas
IEEE IJCB 2024
Xiaoran Lu, Chen Yang, Lu Liang, Guanyu Hu, Ziyi Zhong, Zihao Jiang
Journal of the American Medical Informatics Association (JAMIA) 2024
Wei Jie, Guanyu Hu, Xinyu Yang, Anh Tuan Luu, and Yuzhuo Dong
Expert Systems with Applications (ESA) 2024
Dimitrios Kollias, Stefanos Zafeiriou, I. Kotsia, A. Dhall, S. Ghosh, C. Shao, Guanyu Hu
ECCV 2024
Dimitrios Kollias, P, Tzirakis, A, Cowen, S, Zafeiriou, ..., Guanyu Hu
IEEE CVPR 2024
Wei Jie, Guanyu Hu, Luu Anh Tuan, Xinyu Yang, and Wenjing Zhu
ICASSP 2023
Wei Jie, Guanyu Hu, Xinyu Yang, Anh Tuan Luu, and Yizhuo Dong
INTERSPEECH 2022

GitHub icon Published Databases

Towards Fair and Consistent Affect Analysis

🔗 Access Data & Code on GitHub

Evaluating affective computing methods remains challenging due to inconsistencies in database partitioning and evaluation protocols, which often result in unfair or biased performance comparisons. While many studies report steady performance gains, our analysis questions the validity of such claims. Motivated by these insights, we introduce a unified evaluation protocol to ensure fairness and comparability across benchmarks.

Specifically, for six widely used affective datasets, we provide comprehensive demographic annotations—including race, gender, and age—alongside standardized evaluation metrics and a shared protocol for expression recognition, action unit detection, and valence-arousal estimation.

Additionally, we release multiple pre-trained models (ranging from baselines to state-of-the-art systems) trained under this unified protocol. A dedicated leaderboard is also introduced to encourage future research with a stronger emphasis on fairness, consistency, and reproducibility.

🏆 Honors and Awards

  • 🏅 Best Reviewed Paper | IEEE FG 2024 Bridging the Gap: Protocol Towards Fair and Consistent Affect Analysis.
  • 💰 Innovative Talents International Cooperative Training Project Scholarship | 2023 Fully-funded one-year overseas research visit.
  • 💰 Academic Scholarship | 2023 | Xi’an Jiaotong University
  • 🏆 Second Prize | 2022 | China National Radio and Television Administration Artificial Intelligence Application Innovation Competition Local Language IP Broadcasting Integration Platform Based on NeRF.
  • 🏆 Excellence Award ``| 2022 | China National Radio and Television Administration New Video Technology Application Innovation Competition Intelligent Media Activation System for Video Scenarios in the Petrochemical Industry.
  • 🎖️ Outstanding Student Cadre | 2022, 2023 | Xi’an Jiaotong University
  • 🎖️ Outstanding Student | 2022, 2023 | Xi’an Jiaotong University
  • 🎖️ Outstanding Student Scholarship | 2023 | Xi’an Jiaotong University
  • 🏆 Second Prize | 2021 | China National Radio and Television Administration Artificial Intelligence Application Innovation Competition Audio-Visual Content Editing AI Platform Based on “Silk Road Cloud”.
  • 🏆 Second Prize | 2021 | China National Radio and Television Administration New Video Technology Application Innovation Competition Ultra-HD Program Intelligent Production Project Based on Multimodal Fusion.
  • 💰 National Encouragement Scholarship | 2016 | China Ministry of Education (MoE)

📝 Patents