ABSTRACT
We present a Wizard of Oz evaluation of dual--purpose speech, a technique designed to provide support during a face--to--face conversation by leveraging a user's conversational speech for input. With a dual--purpose speech interaction, the user's speech is meaningful in the context of a human--to--human conversation while providing useful input to a computer. For our experiment, we evaluate the ability to schedule appointments with our calendaring application, the Calendar Navigator Agent. We examine the relative difference between using speech for input compared to traditional pen input on a PDA. We found that speech is more direct and our participants can use their conversational speech for computer input. In doing so, we reduce the manual input needed to operate a PDA while engaged in a calendaring conversation.
- J. Gould, J. Conti, and T. Hovanyecz. Composing letters with a simulated listening typewriter. Communications of the ACM, 26(4), April 1983. Google ScholarDigital Library
- S. G. Hart and L. E. Staveland. Human mental workload, chapter Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. North-Holland, 1988.Google Scholar
- K. Lyons, C. Skeels, T. Starner, C. M. Snoeck, B. A. Wong, and D. Ashbrook. Augmenting conversations using dual--purpose speech. In Proceedings of UIST 2004, 2004. Google ScholarDigital Library
- R. Panko. Managerial communication patterns. Journal of Organisational Computing, 1992.Google ScholarCross Ref
- T. Starner, C. M. Snoeck, B. A. Wong, and R. M. McGuire. Use of mobile appointment scheduling devices. In Proceedings of CHI. ACM Press, 2004. Google ScholarDigital Library
- S. Whittaker, D. Frohlich, and O. Daly-Jones. Informal workplace communication: what is it like and how might we support it? In Proceedings of the CHI, 1994. Google ScholarDigital Library
Index Terms
- Providing support for mobile calendaring conversations: a wizard of oz evaluation of dual--purpose speech
Recommendations
Augmenting conversations using dual-purpose speech
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technologyIn this paper, we explore the concept of dual-purpose speech: speech that is socially appropriate in the context of a human-to-human conversation which also provides meaningful input to a computer. We motivate the use of dual-purpose speech and explore ...
Investigating prosodic entrainment from global conversations to local turns and tones in Mandarin conversations
Highlights- This is the first journal submission describing in considerable detail acoustic-prosodic entrainment (the tendency of speakers to speak like one another in ...
AbstractPrevious research on acoustic entrainment has paid less attention to tones than to other prosodic features. This study sets a hierarchical framework by three layers of conversations, turns and tone units, investigates prosodic ...
Misrecognized Utterance Identification in Support Systems for Daily Human-to-Human Conversations
Artificial Intelligence in HCIAbstractTo support smooth conversation between people, we are developing a support system that provides appropriate conversation topics when the speaker cannot immediately think of a topic. The problem with this system is that speech recognition errors ...
Comments