Offloading KV Cache to Secondary Memory: A Three-Tier Hierarchy Emulator using vLLM
- Chen Wang
- Mengmei Ye
- et al.
- 2026
- PyTorch Conference 2026
Poster
Publications
10 results for Mengmei Ye
Where the Blocks Live: Tier-Aware KV-Cache Routing for vLLM at Scale
- Mengmei Ye
- Bongwoo Bak
- 2026
- PyTorch Conference 2026
PostervLLM in Confidential CPU-GPU Enclaves: Does it Perform?
- Mengmei Ye
- Apoorve Mohan
- et al.
- 2024
- AICS 2024
PosterFrom Confidential Computing to Zero Trust, Come Along for the (Bumpy?) Ride
- Mengmei Ye
- Sandhya Koteshwara
- et al.
- 2024
- MICRO 2024
Workshop paperRemote attestation of confidential VMs using ephemeral vTPMs
- Vikram Narayanan
- Claudio Siqueira de Carvalho
- et al.
- 2023
- ACSAC 2023
Conference paperThe Cost of Flexibility and Security in Cloud-Based HPC - A Case Study Running EDA Workloads With Confidential Computing Technology
- Mengmei Ye
- Derren Dunn
- 2023
- SC 2023
TalkWorkshop on Zero Trust Hardware Architectures (ZTHA)
- Sandhya Koteshwara
- Mengmei Ye
- et al.
- 2023
- ICCAD 2023
WorkshopFree the Turtles: Removing Nested Virtualization for Performance and Confidentiality in the Cloud
- Mengmei Ye
- Angelo Ruocco
- et al.
- 2023
- CLOUD 2023
Short paperZero Trust Hardware Architectures: when we “never trust”, what can we do to “always verify?”
- Mengmei Ye
- Sandhya Koteshwara
- 2022
- WISE 2022
Invited talkNo More Turtles: The SecondaryVM Framework - An Alternative to Nested Virtualization
- Mengmei Ye
- Angelo Ruocco
- 2022
- KVM Forum 2022
Talk