LLaMCAT: Optimizing Large Language Model Inference with Cache Arbitration and Throttling

Z. Zhou, C. Lai, W. Zhang
January 2025
Type
Conference paper
Publication
ICPP 2025