Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Publications
33 results for Chen Wang
Towards Efficient Key-Value Cache Management for Prefix Prefilling in LLM Inference
- Yue Zhu
- Hao Yu
- et al.
- 2025
- CLOUD 2025
Voice-based AI Agents: Filling the Economic Gaps in Digital Health Delivery
A Practical Guide To Benchmarking AI and GPU Workloads in Kubernetes
- Chen Wang
- Yuan Chen
- 2025
- KubeCon EU 2025
Cloud-native Workflow Scheduling using a Hybrid Priority Rule, Dynamic Resource Allocation, and Dynamic Task Partition
- Jungeun Shin
- Diana Arroyo
- et al.
- 2024
- SoCC 2024
Dexter: A Performance-Cost Efficient Resource Allocation Manager for Serverless Data Analytics
- Anna Maria Nestorov
- Diego Marron
- et al.
- 2024
- Middleware 2024
Optimizing GPU Multiplexing for Efficient and Cost-Effective Access to Diverse Large Language Models in GPU Clusters
- Yue Zhu
- Chen Wang
- et al.
- 2024
- MASCOTS 2024
O˜(T−1) Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games
- Weichao Mao
- Haoran Qiu
- et al.
- 2024
- L4DC 2024
Optimizing simultaneous autoscaling for serverless cloud computing
- Harold Ship
- Evgeny Shindin
- et al.
- 2024
- CLOUD 2024
When Green Computing Meets Performance and Resilience SLOs
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- DSN 2024