Yang Zhou

Yang Zhou 周旸

PhD student in Electrical and Computer Engineering

Carnegie Mellon University

Email:

I am a PhD student in Electrical and Computer Engineering at Carnegie Mellon University, advised by Prof. Beidi Chen. Previously, I worked with Prof. Diana Marculescu on edge AI and Prof. Kurt Keutzer on model quantization. I received my bachelor's degree in Electrical and Computer Engineering from The University of Texas at Austin.

My research focuses on efficient post-training and inference for large language models, with an emphasis on reasoning, long-context generation, and reinforcement learning. I welcome conversations and collaborations in these areas.

Research

Efficient training, evaluation, and inference for reasoning models.

Efficient Reinforcement Learning explores practical training when efficient rollout actors differ substantially from the policy being trained, including budgeted rejection sampling and selective rollouts in Jackpot, GRESO, and Sparrow.

Long-context Reasoning scales up synthetic data generation to study how language models behave as context length and reasoning complexity increase, with controllable evaluation across both dimensions through GSM-Infinite, and MagicPIG.

Efficient LLM Inference reduces the computation and memory required for language-model inference while preserving capability, spanning contextual sparsity and system-level analysis in Vortex, Sirius, LLM Inference Unveiled, Kinetics, HexGen, and DQRM.

(Early in Undergraduate) Edge AI studies efficient deployment and training on resource-constrained systems through Play It Cool, and ANT.

Publications

* denotes equal contribution.

/ / / /
Kinetics scaling law overview

Kinetics: Rethinking Test-Time Scaling Laws

Ranajoy Sadhukhan, Zhuoming Chen, Haizhong Zheng, Yang Zhou, Emma Strubell, Beidi Chen

NeurIPS, 2025 TTODLer-FM at ICML, 2025 Best Paper Award TTODLer-FM at ICML, 2025 Oral

A test-time scaling law that accounts for both computation and memory-access costs and motivates sparse attention for efficient scaling.

MagicPIG project overview

MagicPIG: LSH Sampling for Efficient LLM Generation

Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, Yang Zhou, Jianyu Zhang, Niklas Nolte, Yuandong Tian, Matthijs Douze, Leon Bottou, Zhihao Jia, Beidi Chen

ICLR, 2025 Spotlight

An LSH-based heterogeneous system that samples attention with theoretical guarantees for efficient long-context generation.

LLM Inference Unveiled overview

LLM Inference Unveiled: Survey and Roofline Model Insights

Zhihang Yuan*, Yuzhang Shang*, Yang Zhou*, Zhen Dong, Zhe Zhou, Chenhao Xue, Bingzhe Wu, Zhikai Li, Qingyi Gu, Yong Jae Lee, Yan Yan, Beidi Chen, Guangyu Sun, Kurt Keutzer

Preprint, 2024

A survey of algorithm, system, and hardware techniques for LLM inference, accompanied by a roofline modeling tool for analyzing deployment bottlenecks. Cited over **200 times** (2026.07).

Service

Reviewer for ECCV 2023, MLSys 2024, and NeurIPS 2025. Selected as a Top Reviewer at NeurIPS 2025, free trip ✈️ yayyy!