Networking for Stateful LLM Inference
- Junchen Jiang
- Yuhan Liu
- et al.
- 2025
- SIGCOMM 2025
Publications
35 results for Chen Wang
Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Towards Efficient Key-Value Cache Management for Prefix Prefilling in LLM Inference
- Yue Zhu
- Hao Yu
- et al.
- 2025
- CLOUD 2025
Voice-based AI Agents: Filling the Economic Gaps in Digital Health Delivery
A Practical Guide To Benchmarking AI and GPU Workloads in Kubernetes
- Chen Wang
- Yuan Chen
- 2025
- KubeCon EU 2025
A House United Within Itself: SLO-Awareness for On-Premises Containerized ML Inference Clusters via Faro
- Beomyeol Jeon
- Chen Wang
- et al.
- 2025
- EuroSys 2025
Cloud-native Workflow Scheduling using a Hybrid Priority Rule, Dynamic Resource Allocation, and Dynamic Task Partition
- Jungeun Shin
- Diana Arroyo
- et al.
- 2024
- SoCC 2024
Dexter: A Performance-Cost Efficient Resource Allocation Manager for Serverless Data Analytics
- Anna Maria Nestorov
- Diego Marron
- et al.
- 2024
- Middleware 2024
Optimizing GPU Multiplexing for Efficient and Cost-Effective Access to Diverse Large Language Models in GPU Clusters
- Yue Zhu
- Chen Wang
- et al.
- 2024
- MASCOTS 2024
O˜(T−1) Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games
- Weichao Mao
- Haoran Qiu
- et al.
- 2024
- L4DC 2024