I am a 3rd year Ph.D. student at the Department of Computer Science, Rutgers University, advised by Prof. Dimitris N. Metaxas.
Previously, I received my bachelor's degrees from Zhejiang University (ZJU) and the University of Illinois Urbana-Champaign (UIUC), majoring in Computer Engineering. During my undergraduate years, I was very fortunate to work with Prof. Tarek F. Abdelzaher at UIUC (working closely with Prof. Ruijie Wang), and Prof. Hongwei Wang at ZJU.
Research Interests: Transformer Architectures (LLM, Diffusion Transformer), Trustworthy and Robust AI, 3D Generation, Video Generation, LLM Agents, and Recommender Systems.
My research focuses on efficient foundation models, with an emphasis on understanding and improving the internals of Transformer architectures. I study attention and activation pathologies, long-context modeling, efficient reasoning, and low-precision optimization. My work spans LLMs and LLM agents, as well as graph learning and recommender systems. More recently, I have been extending this line of research beyond language models to Diffusion Transformers for 3D and video generation.
Education
-
Rutgers UniversityPh.D. in Computer ScienceSep. 2024 - Present -
Zhejiang UniversityB.E. in Electronics and Computer EngineeringSep. 2020 - Jun. 2024 -
University of Illinois Urbana-ChampaignB.S. in Computer EngineeringSep. 2020 - May. 2024
Professional Activities
- Area Chair: ES-Reasoning@ICLR (2026), MMRAgI@CVPR (2026)
- Journal Reviewer: ACM TOIS
- PC Member: ICLR (2026, 2027), ACL (2026), ICWSM (2026), EACL (2026), ACM CAIS (2026), EMNLP (2026), HCRS@WWW (2026)
- Conference Reviewer: SIGIR (2025), CIKM (2024), RecSys (2024)
Honors & Awards
-
Outstanding Graduate, Zhejiang University2024
🔥 News
Selected Publications (view all )
Attention Sinks and Outliers in Attention Residuals
Haozheng Luo⭐️, Haoran Dai⭐️, Ching-Yuen Huang⭐️, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang, Yan Chen
The 40th Annual Conference on Neural Information Processing Systems (NeurIPS) 2026 2 citations
Attention Sinks and Outliers in Attention Residuals
Haozheng Luo⭐️, Haoran Dai⭐️, Ching-Yuen Huang⭐️, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang, Yan Chen
The 40th Annual Conference on Neural Information Processing Systems (NeurIPS) 2026 2 citations
MemRec: Collaborative Memory-Augmented Agentic Recommender System
Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang
The 64th Annual Meeting of the Association for Computational Linguistics (ACL) 2026 22 citations
🏆 Recognized as "the strongest competitor" among LLM-based methods by Meta's MARS paper.
MemRec: Collaborative Memory-Augmented Agentic Recommender System
Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang
The 64th Annual Meeting of the Association for Computational Linguistics (ACL) 2026 22 citations
🏆 Recognized as "the strongest competitor" among LLM-based methods by Meta's MARS paper.
Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents
Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, Yongfeng Zhang
The 13th International Conference on Learning Representations (ICLR) 2025 500 citations
Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents
Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, Yongfeng Zhang
The 13th International Conference on Learning Representations (ICLR) 2025 500 citations