Publications

57 results for Scaling AI

Queue Management for Large Language Model Serving
- - Archit Patke
  - Dhemath Reddy
  - et al.
- 2024
- SoCC 2024
MoEsaic: Shared Mixture of Experts
- - Umesh Deshpande
  - Travis Janssen
  - et al.
- 2024
- SoCC 2024
Incremental GPU Slicing in Action
- - Abhishek Malvankar
  - Olivier Tardieu
- 2024
- CNCF-hosted Co-located Events North America 2024
From Ethics to Implementation: Shaping the Future of AI Governance
- - Vyoma Gajjar
- 2024
- DSS SF 2024
Achieving Platform Portability for vLLM by using Triton Autotuning and Remembering it
- - Burkhard Ringlein
  - Thomas Parnell
- 2024
- Ray Summit 2024
tinyBenchmarks: evaluating LLMs with fewer examples
- - Felipe Maia Polo
  - Lucas Weber
  - et al.
- 2024
- ICML 2024
Online Learning and Model Pruning Against Concept Drifts in Edge Devices
- - Simone Magnani
  - Seshu Tirupathi
  - et al.
- 2024
- NetSoft 2024
Deep neural network inference with a 64-core in-memory compute chip based on phase-change memory
- - Manuel Le Gallo
- 2024
- CIMTEC 2024
Resource- Efficient Transformer Pruning for Finetuning of Large Models
- - Fatih Ilhan
  - Gong Su
  - et al.
- 2024
- CVPR 2024
Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI
- - Elron Bandel
  - Yotam Perlitz
  - et al.
- 2024
- NAACL 2024