IR
Anthology
Community
Peizhuang
Cong
2025
doi
dblp
BATON: Enhancing Batch-wise Inference Efficiency for Large Language Models via Dynamic Re-batching.
Peizhuang Cong
|
Qizhi Chen
|
Haochen Zhao
|
Tong Yang
Proceedings of the ACM on Web Conference 2025, WWW 2025, Sydney, NSW, Australia, 28 April 2025- 2 May 2025