Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding
- Ziyao Wang
- Muneeza Azmat
- et al.
- 2025
- ICML 2025
Publications
57 results for Scaling AI
Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead
- Rickard Gabrielsson
- Jiacheng Zhu
- et al.
- 2025
- ICML 2025
A Hitchhiker's Guide to Scaling Law Estimation
- Leshem Choshen
- Yang Zhang
- et al.
- 2025
- ICML 2025
Scalable and Efficient LLM Serving with the vLLM Production Stack
- Junchen Jiang
- Yue Zhu
- 2025
- OSSNA 2025
Designing and implementing LLM guardrails components in production environments
- Mateus Do Amor Devino Pereira
- Evaline Ju
- et al.
- 2025
- CAIN 2025
Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference
- Matthew Riemer
- Gopeshh Subbaraj
- et al.
- 2025
- ICLR 2025
Handling Delay in Real-Time Reinforcement Learning
- Ivan Anokin
- Rishav Rishav
- et al.
- 2025
- ICLR 2025
Epigraph Based Multilevel Optimization (EMO) for Enhancing Chain-of-Thought Reasoning Capabilities
- Songtao Lu
- Yanna Ding
- et al.
- 2025
- ICASSP 2025
Efficient multi-prompt evaluation of LLMs
- Felipe Maia Polo
- Ronald Xu
- et al.
- 2024
- NeurIPS 2024
Advanced Physics-AI Models for Rain Enhancement in Arid Regions
- Lloyd Treinish
- Mukul Tewari
- et al.
- 2024
- AGU 2024