Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- SoCC 2024
Conference paper
Publications
3 results at SoCC 2024
MoEsaic: Shared Mixture of Experts
- Umesh Deshpande
- Travis Janssen
- et al.
- 2024
- SoCC 2024
Conference paperCloud-native Workflow Scheduling using a Hybrid Priority Rule, Dynamic Resource Allocation, and Dynamic Task Partition
- Jungeun Shin
- Diana Arroyo
- et al.
- 2024
- SoCC 2024
Conference paper