Automated authoring of coherent multimedia discourse in conversation systems

Abstract

We are building a full-fledged multimedia conversation framework called Responsive Information Architect (RIA), using a combination of AI and multimedia techniques. Here we describe RIA's capability of automated authoring of a coherent multimedia discourse, which is used by RIA to express itself when conversing with a user. Specifically, we focus on explaining three unique features of our automated authoring approach: automated authoring of multimedia interaction acts, dynamic insertion of multimedia punctuation acts, and systematic design of cross-media acts.