About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Conference paper
A NEW INTERFACE PARADIGM: AUTOMATIC RECOGNITION OF INTEGRATED SPEECH AND HANDWRITING INFORMATION
Abstract
Because of the difficulties inherent to the analysis of such complex processes as speaking and (hand)wriling, the machine recognition of the two most natural ways of communicating has so far met with only limited success. In this paper we consider a new paradigm: llic integrated use of speech and handwriting information to improve llic overall accuracy of an automatic recognizer. This approach is made possible by lhe complementarity of the Iwo sources of information yielding the acoustic and pen stroke evidence. It leads to the development of ISWI, the Integrated Speech and Writing Interface. Preliminary resulte indicate llic viability of ISWI, particularly in applications such as human factor studies. These results also bring useful insights into lite feasibility of ISWI given the present level of speech and handwriting recognition performance. It seems reasonable to expect ISWI to become the logical choice for the ultimate user-friendly man-machine interface.