I am a Ph.D. student at the Department of Computer Science, Rutgers University, advised by Prof. Dimitris N. Metaxas.
Previously, I received my bachelor's degrees from Zhejiang University (ZJU) and the University of Illinois Urbana-Champaign (UIUC), majoring in Computer Engineering. During my undergraduate years, I was very fortunate to work with Prof. Tarek F. Abdelzaher at UIUC (worked closely with Prof. Ruijie Wang), and Prof. Hongwei Wang at ZJU.
Research Interests: Transformer Architectures (LLM, Diffusion Transformer), Trustworthy and Robust AI, 3D Generation, Video Generation, and LLM Agents.
My research focuses on efficient generative models, with an emphasis on understanding and improving the internals of Transformer architectures. I study attention and activation pathologies, long-context modeling, efficient reasoning, and low-precision optimization. My work spans LLMs and LLM agents, as well as graph learning. More recently, I have been extending this line of research beyond language models to Diffusion Transformers for 3D and video generation.
I am seeking Research Scientist and Applied Scientist internship opportunities for Summer 2027. If a position seems like a good fit, please feel free to email me.
Research Highlights
Efficient 3D Generative Models
Developing efficient low-bit quantization methods for 3D generative diffusion transformers.
Manuscript under review.
Advised by Prof. Dimitris Metaxas
Education
-
Rutgers UniversityPh.D. in Computer ScienceSep. 2024 - Present -
Zhejiang UniversityB.E. in Electronics and Computer EngineeringSep. 2020 - Jun. 2024 -
University of Illinois Urbana-ChampaignB.S. in Computer EngineeringSep. 2020 - May. 2024
Professional Activities
- Area Chair: ES-Reasoning@ICLR (2026), MMRAgI@CVPR (2026)
- Journal Reviewer: ACM TOIS
- PC Member: ICLR (2026, 2027), CVPR (2027), NAACL (2027), ACL (2026), EACL (2026, 2027), EMNLP (2026), IJCAI (2027), ICWSM (2026), ACM CAIS (2026), HCRS@WWW (2026, 2027), LAUI@AAAI (2027)
- Conference Reviewer: SIGIR (2025), CIKM (2024), RecSys (2024)
Honors & Awards
-
Outstanding Graduate, Zhejiang University2024
🔥 News
Selected Publications (view all )

Attention Sinks and Outliers in Attention Residuals
Haozheng Luo⭐️, Haoran Dai⭐️, Ching-Yuen Huang⭐️, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang, Yan Chen
The 40th Annual Conference on Neural Information Processing Systems (NeurIPS) 2026 3 citations
Attention Sinks and Outliers in Attention Residuals
Haozheng Luo⭐️, Haoran Dai⭐️, Ching-Yuen Huang⭐️, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang, Yan Chen
The 40th Annual Conference on Neural Information Processing Systems (NeurIPS) 2026 3 citations

Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents
Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, Yongfeng Zhang
The 13th International Conference on Learning Representations (ICLR) 2025 728 citations
Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents
Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, Yongfeng Zhang
The 13th International Conference on Learning Representations (ICLR) 2025 728 citations