Abstract
This article proposes a framework that will help analyze current and future output multimodal user interfaces. We first define an output multimodal system. We then present our framework that identifies several different combinations of modalities and their characteristics. This framework assists in the selection of the most appropriate modalities for achieving efficient multimodal presentations. The discussion is illustrated with MulTab (Multimodal Table), an output multimodal system for managing large tables of numerical data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allen, J.: Maintaining Knowledge about Temporal Intervals. Communications of the ACM, Vol. 26, No. 11, (1983) 832–843
André, E., Finkler, W., Graf, W., Rist, T., Schauder, A., Wahlster, W.:WIP: The Automatic Synthesis of Multimodal Presentations. In Maybury, M. T. (ed.): Intelligent Multimedia Interfaces. AAAI Press/MIT Press, Cambridge, Ma. (1993) 73–90
Arens, Y., Miller, L., Sondheimer, N.: Presentation Design Using an Integrated Knowledge Base. In Sullivan J., Tyler, S. (eds.): Intelligent User Interfaces. Frontier Series. New York: ACM Press (1991) 241–258
Beaudouin-Lafon, M., Gaver, W.: ENO: Synthesizing Structured Sound Spaces. Proceedings of UIST’94. ACM Press (1994) 49–57
Bernsen N.: A revised generation of the taxonomy of output modalities. Esprit Project AMODEUS. Working Paper RP5-TM-WP11 (1994)
Blattner, M. M, Dannenberg, R. G.: CHI’90 Workshop on multimedia and multimodal interface design. SIGCHI Bulletin 22, 2, (Oct. 1990) 54–58
Coutaz, J., Nigay, L., Salber, D.: The MSM framework: A Design Space for Multi-Sensori-Motor Systems. Proceedings of EWHCI’93. Lecture Notes in Computer Science, Vol. 753. Springer-Verlag, Berlin Heidelberg New York (1993) 231–241
Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., Young R.: Four easy pieces for assessing the usability of multimodal interaction: The CARE properties. Proceedings of Interact’95 (1995) 115–120
Coutaz et al.: CoMedi: Using Computer Vision to Support Awareness and Privacy in Mediaspaces. Proceedings (Extended Abstract) of CHI’99. ACM Press (1999) 13–16
Fitzmaurice, G., Ishii, H., Buxton, W.: Bricks: Laying the Foundations for Graspable User Interfaces. Proceedings of CHI’95. ACM Press (1995) 442–449
Furnas, G.: Generalized fisheye views. Proceedings of CHI’86. ACM Press (1986) 16–23
Gram, C., Cockton G. (ed.): Design Principles for Interactive Software. Chapter 2. Chapman & Hall (1984) 25–51
Hovy, E., Arens, Y.: On the Knowledge Underlying Multimedia Presentations. In Maybury, M. T. (ed.): Intelligent Multimedia Interfaces. AAAI Press/MIT Press, Cambridge, Ma. (1993) 280–306
Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. Proceedings of CHI’97. ACM Press (1997) 234–241
Lamping, J., Rao R., Pirolli P.: A focus+context technique based on hyperbolic geometry for visualizing large hierarchies. Proceedings of CHI’95. ACM Press (1995) 401–408
Leung, Y., Apperley M.: A Review and Taxonomy of Distortion-Oriented Presentation Techniques. ACM Transactions on Computer-Human Interaction. Vol. 1, No. 2, (June 1994) 126–160.
Martin, J. C.: Six primitive types of cooperation for observing, evaluating and specifying cooperations. Proceedings of AAAI (1999)
May, J., Scott, S., Barnard, P.: Structuring Displays: a psychological guide. Eurographics Tutorial Notes Series. EACG: Geneva (1995)
Maybury, M. T. (Ed.): Intelligent Multimedia Interfaces. AAAI Press/MIT Press, Cambridge, Ma. (1993)
Neal, G., Shapiro, S. C.: Intelligent Multi-Media Interface Technology. In Sullivan J., Tyler, S. (eds.): Intelligent User Interfaces. Frontier Series. New York: ACM Press (1991) 11–43
Nigay, L., Coutaz, J.: A design space for multimodal interfaces: concurrent processing and data fusion. Proceedings of INTERCHI’93. ACM Press (1993) 172–178
Nigay, L., Coutaz, J.: A Generic Platform for Addressing the Multimodal Challenge. Proceedings of CHI’95. ACM Press (1995) 98–105
Nigay, L., Vernier, F.: Design Method of Interaction Techniques for Large Information Spaces. Proceedings of AVI’98. ACM Press (1998)
Oviatt, S.: Then myths of multimodal interaction. Communications of the ACM, Vol. 42, No. 11, (1999) 74–81
Stone, M., Fishkin, K., Bier E.: The Movable filter as a user interface tool. Proceedings of CHI’94. ACM Press (1994) 306–312
Vernier, F., Lachenal, C., Nigay, L., Coutaz, J.: Interface Augmentée par effet Miroir, Proceedings of IHM’99. Cepadues (1999) 158–165
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vernier, F., Nigay, L. (2001). A Framework for the Combination and Characterization of Output Modalities. In: Palanque, P., Paternò, F. (eds) Interactive Systems Design, Specification, and Verification. DSV-IS 2000. Lecture Notes in Computer Science, vol 1946. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44675-3_3
Download citation
DOI: https://doi.org/10.1007/3-540-44675-3_3
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41663-0
Online ISBN: 978-3-540-44675-0
eBook Packages: Springer Book Archive