Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
- Pol G. Recasens
- Ferran Agullo
- et al.
- 2025
- CLOUD 2025
Publications
205 results for Hybrid Cloud Infrastructure
Routing Strategies for RoCE Networks in AI Clouds
- Alim Alim
- Ali Sydney
- et al.
- 2025
- CLOUD 2025
Towards Efficient Key-Value Cache Management for Prefix Prefilling in LLM Inference
- Yue Zhu
- Hao Yu
- et al.
- 2025
- CLOUD 2025
Scalable and Efficient LLM Serving with the vLLM Production Stack
- Junchen Jiang
- Yue Zhu
- 2025
- OSSNA 2025
How Low Can LoRA Go: System-Level Throughput, Energy, and Model Quality Tradeoffs when Fine-Tuning Adapters
- Connor Espenshade
- Umesh Deshpande
- et al.
- 2025
- ISCA 2025
A Near-DRAM Accelerator for Compiler-Generated Fully Homomorphic Encryption Applications
- 2025
- ISCA 2025
Reimagining Cloud-Native Networks: The Critical Role of DRA
- Sunyanan Choochotkaew
- Lionel Jouin
- 2025
- KubeCon Japan 2025
Page Migration for Hardware Memory Disaggregation Across a Network
- Archit Patke
- Christian Pinto
- et al.
- 2025
- ICS 2025
Characterization of Interfacial Fracture Strength in Hybrid Bonded Wafers: A Novel Approach for High-Resolution Spatial Profiling
- Sathya Raghavan
- Ben Yang
- et al.
- 2025
- ECTC 2025
Fast And Accurate Machine Learning Prediction of Back-End-Of-Line Thermal Resistances in Backside Power Delivery and Chiplet Architectures
- Prabudhya Roy Chowdhury
- Aakrati Jain
- et al.
- 2025
- ECTC 2025