Investigating "Touch and Talk" for Blind and Low Vision People: Science Communication Assistance Through Exploring Multiple Tactile Objects

Tactile exploration is extremely important for blind and low vision (BLV) users to understand concepts. Although Interactive 3D Models that integrate modalities such as audio and vibration have been developed to create self-directed tactile exploration experiences, they depend on pre-defined commands and fixed interaction flows, which limit opportunities for adaptive guidance. In this study, we examine how interactive dialogue and temporal dynamics can enhance tactile learning experiences, particularly in the context of science communication where BLV users frequently encounter abstract and spatially complex topics. We conducted interviews with 22 tactile guidance experts to identify effective explanation techniques and communication strategies. We then employed a technology probe that combines multiple tactile models with a voice-based "Touch and Talk"system, using a Wizard-of-Oz approach with 10 BLV participants. The experiment revealed strategies that support understanding and foster curiosity. Based on findings, we propose a set of design implications aimed at supporting BLV users in autonomously exploring complex scientific content.