Foundation Models on the Edge

Abstract

Deploying and running foundation models (FM) at the edge of the network present some unique challenges related to resource constraint on the edge server. In this talk, we present a PoV on the business use cases that are driving some of the requirements for running FM on the Edge and how this is different from the Cloud.