Abstract
Shareable interfaces, those that can be interacted simultaneously by several users, are a common tool used both in CSCW research and in real world applications. They tend however to lack a capability that has been traditionally relevant to the usefulness of computing systems: multi-tasking. In this paper we explain why a combination of the multi-user features of shareable interfaces and the multi-tasking capabilities of general-purpose computing, could be relevant for building useful systems, and why these features are not present today in most of the current prototypes and systems. We also discuss possible approaches for solving the problems that prevent shareable interfaces to fully support multi-tasking, and we present a novel approach based on a distributed, application-centered, content-based gesture disambiguation. We describe how an already existing framework, GestureAgents, implements this new approach, focusing on expanding the description of the relevant elements related to this problem, and conclude with some example applications and a discussion.
Similar content being viewed by others
References
Ackad, Christopher James, Anthony Collins, Judy Kay (2010). Switch: exploring the design of application and configuration switching at tabletops. ITS’10: ACM Int. Conf. Interact. Tabletops Surfaces. Saarbrücken, Germany. New York: ACM Press, pp. 95–104.
AlAgha, Iyad, Andrew Hatch, Linxiao Ma, Liz Burd (2010). Towards a teacher-centric approach for multi-touch surfaces in classrooms. ITS’10: ACM Int. Conf. Interact. Tabletops Surfaces. Saarbrücken, Germany. New York: ACM Press, pp. 187–196.
Ballendat, Till, Nicolai Marquardt, Saul Greenberg (2010). Proxemic interaction. ITS’10: ACM Int. Conf. Interact. Tabletops Surfaces. Saarbrücken, Germany. New York: ACM Press, pp. 121–130.
Beauchamp, Gary (2004). Teacher use of the interactive whiteboard in primary schools: towards an effective transition framework. Technology, Pedagogy and Education, vol. 13, no. 3, pp. 327–348.
Bowie, Muriel, Oliver Schmid, Agnes Lisowska Masson, Béat Hirsbrunner (2011). Web-based multipointer interaction on shared displays. CSCW’11: Proc. ACM 2011 Conf. Comput. Support. Coop. Work. Hangzhou, China. New York: ACM Press, pp. 609–612.
Caramiaux, Baptiste, Atau Tanaka (2013). Machine Learning of Musical Gestures. NIME 2013: Proc. 2013 Conf. New Interfaces Music. Expr. Daejeon & Seoul, pp. 27–30.
Catalá, Alejandro, Javier Jaen, Betsy van Dijk, Sergi Jordà (2012). Exploring tabletops as an effective tool to foster creativity traits. TEI’12: Proc. Sixth Int. Conf. Tangible, Embed. Embodied Interact. Kingston, Ontario, Canada. New York: ACM Press, pp. 143–150.
Echtler, Florian, Andreas Butz (2012). GISpL: Gestures Made Easy. TEI’12: Proc. Sixth Int. Conf. Tangible, Embed. Embodied Interact. Kingston, Ontario, Canada. New York: ACM Press, pp. 233–240.
Elias, John Greer, Wayne Carl Westerman, Myra Mary Haggerty (2007). Multi-touch gesture dictionary. US Patent 7,840,912 B2.
Ellis, Clarence A, Simon J Gibbs (1989). Concurrency control in groupware systems. SIGMOD’89: Proc. 1989 ACM SIGMOD Int. Conf. Manag. Data. Seattle, Washington, USA. pp. 399–407.
Fishkin, Kenneth P (2004). A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing, vol. 8, no. 5, pp. 347–358.
Fitzmaurice, George W (1996). Graspable user interfaces. Ph.D. dissertation. University of Toronto: Graduate Department of Computer Science.
Fitzmaurice, George W, Hiroshi Ishii, William AS Buxton (1995). Bricks: laying the foundations for graspable user interfaces. CHI’95: Proc. SIGCHI Conf. Hum. Factors Comput. Syst. Denver, Colorado, USA. New York:ACM Press/Addison-Wesley Publishing Co., pp. 442–449.
Gaggi, Ombretta, Marco Regazzo (2013). An environment for fast development of tabletop applications. ITS’13: Proc. 2013 ACM Int. Conf. Interact. tabletops surfaces. St. Andrews, United Kingdom. New York: ACM Press, pp. 413–416.
Gómez, Emilia, Maarten Grachten, Alan Hanjalic, et al. (2013). PHENICX: Performances as Highly Enriched aNd Interactive Concert Experiences. Open access
Hornecker, Eva, Jacob Buur (2006). Getting a grip on tangible interaction: a framework on physical space and social interaction. Proc. CHI’06: SIGCHI Conf. Hum. Factors Comput. Syst. Montréal, Québec, Canada, New York: ACM Press, pp. 437–446.
Hotelling, Steve, Joshua A Strickon, Brian Q Huppi, et al. (2004). Gestures for touch sensitive input devices. US Patent 8,479,122 B2.
Hutterer, Peter, Bruce H Thomas (2007). Groupware support in the windowing system. Eighth Australas. User Interface Conf. Ballarat, Australia. Australian Computer Society, Inc., pp. 39–46.
Hutterer, Peter, Bruce H Thomas (2008). Enabling co-located ad-hoc collaboration on shared displays. Ninth Australas. User Interface Conf. Wollongong, NSW, Australia. Australian Computer Society, Inc., pp. 43–50.
Izadi, Shahram, Harry Brignull, Tom Rodden, et al. (2003). Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media. UIST’03: Proc. 16th Annu. ACM Symp. User interface Softw. Technol. Vancouver, BC, Canada. pp. 159–168.
Jordà, Sergi (2008). On Stage: the Reactable and other Musical Tangibles go Real. International Journal of Arts and Technology, vol. 1, no. 3/4, pp. 268–287.
Jordà, Sergi, Martin Kaltenbrunner, Günter Geiger, Ross Bencina (2005). The reactable*. ICMC 2005: Proc. Int. Comput. Music Conf. Barcelona, Spain. pp. 579–582.
Jordà, Sergi, Carles F Julià, Daniel Gallardo (2010). Interactive surfaces and tangibles. XRDS: Crossroads, The ACM Magazine for Students, vol. 16, no. 4, pp. 21–28.
Julià, Carles F, Daniel Gallardo (2007). TDesktop?: Disseny i implementació d’un sistema gràfic tangible. Degree thesis. Universitat Pompeu Fabra.
Julià, Carles F, Nicolas Earnshaw, Sergi Jorda (2013). GestureAgents: an agent-based framework for concurrent multi-task multiuser interaction. Proc. 7th Int. Conf. Tangible, Embed. Embodied Interact. Barcelona, Spain. pp. 207–214.
Kammer, Dietrich, Georg Freitag, Mandy Keck, Markus Wacker (2010a). Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope and Features. Workshop Eng. Patterns Multitouch Interfaces
Kammer, Dietrich, Jan Wojdziak, Mandy Keck, et al. (2010b). Towards a formalization of multi-touch gestures. ITS’10: ACM Int. Conf. Interact. Tabletops Surfaces. Saarbrücken, Germany. New York: ACM Press, pp. 49–58.
Kim, Henna, Sara Snow (2013). Collaboration on a large-scale, multi-touch display: asynchronous interaction and multiple-input use. CSCW’13. San Antonio. pp. 165–168.
Kin, Kenrick, Björn Hartmann, Tony DeRose, Maneesh Agrawala (2012). Proton: Multitouch Gestures as Regular Expressions. CHI’12: Proc. SIGCHI Conf. Hum. Factors Comput. Syst. Austin, Texas, USA. New York: ACM Press pp. 2885–2894.
Krueger, Myron W, Thomas Gionfriddo, Katrin Hinrichsen (1985). VIDEOPLACE An artificial reality. CHI’85. New York: ACM Press pp. 35–40.
Mackenzie, Russell, Kirstie Hawkey, Kellogg S Booth, et al. (2012). LACOME: a Multi-User Collaboration System for Shared Large Displays. CSCW’12, Washington. New York: ACM Press, pp. 267–268.
Marr, Stefan, Thierry Renaux, Lode Hoste, Wolfgang De Meuter (2014). Parallel gesture recognition with soft real-time guarantees. Science of Computer Programming, vol. 98, no. 2, pp. 159–183.
Marshall, Paul, Yvonne Rogers, Eva Hornecker (2007). Are Tangible Interfaces Really Any Better Than Other Kinds of Interfaces? CHI’07 workshop on Tangible User Interfaces in Context & Theory, 28 April 2007, San Jose, California, USA.
Rogers, Yvonne, Youn-kyung Lim, William Hazlewood, Paul Marshall (2009). Equal Opportunities: Do Shareable Interfaces Promote More Group Participation Than Single User Displays? Human-Computer Interaction, vol. 24, no. 1, pp. 79–116.
Scheifler, Robert W, Jim Gettys (1990). The X window system. Software: Practice and Experience, vol. 20, no. S2, pp. S5–S34.
Schmidt, Kjeld, Liam Bannon (1992). Taking CSCW seriously. Computer Supported Cooperative Work (CSCW), vol. 1, no. 1–2, pp. 7–40.
Scholliers, Christophe, Lode Hoste, Beat Signer, Wolfgang De Meuter (2011). Midas: a declarative multi-touch interaction framework. TEI’11: Proc. fifth Int. Conf. Tangible, Embed. embodied Interact. Funchal, Portugal. New York: ACM Press, pp. 49–56.
Scott, Stacey D, Karen D Grant, Regan L Mandryk (2003). System guidelines for co-located, collaborative work on a tabletop display. ECSCW 2003: Proc. Eighth Eur. Conf. Comput. Support. Coop. Work. Helsinki, Finland. Springer, pp. 159–178.
Shaer, Orit, Eva Hornecker (2010). Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction, vol. 3, no. 1–2, pp. 1–137.
Sharlin, Ehud, Benjamin Watson, Yoshifumi Kitamura, et al. (2004). On tangible user interfaces, humans and spatiality. Personal and Ubiquitous Computing, vol. 8, no. 5, pp. 338–346.
Stanton, Danae, Tony Pridmore, Victor Bayon, et al. (2001). Classroom collaboration in the design of tangible interfaces for storytelling. CHI’01: Proc. SIGCHI Conf. Hum. factors Comput. Syst. Seattle, Washington, USA. New York: ACM Press, pp. 482–489.
Strauss, Anselm (1985). Work and the Division of Labor. The Sociological Quarterly, vol. 26, no. 1, pp. 1–19.
Tuddenham, Philip, Ian Davies, Peter Robinson (2009). WebSurface. ITS’09: Proc. ACM Int. Conf. Interact. Tabletops Surfaces. Banff, Alberta, Canada. New York: ACM Press, pp. 181–188.
Verma, Himanshu, Flaviu Roman, Silvia Magrelli, et al. (2013). Complementarity of input devices to achieve knowledge sharing in meetings. CSCW’13: Proc. 2013 Conf. Comput. Support. Coop. Work. San Antonio, Texas, USA. ACM, pp. 701–703.
Vernier, Frédéric, Neal Lesh, Chia Shen (2002). Visualization techniques for circular tabletop interfaces. AVI’02: Proc. Work. Conf. Adv. Vis. Interfaces Trento, Italy. New York: ACM Press, pp. 257–266.
West, Joel, Michael Mace (2010). Browsing as the killer app: Explaining the rapid success of Apple’s iPhone. Telecommunications Policy, vol. 34, no. 5–6, pp. 270–286.
Wobbrock, Jacob O, Andrew D Wilson, Yang Li (2007). Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. UIST’07: Proc. 20th Annu. ACM Symp. User interface Softw. Technol. Newport, Rhode Island, USA. New York: ACM Press, pp. 159–168.
Xambó, Anna, Eva Hornecker, Paul Marshall, et al. (2013). Let’s jam the reactable. ACM Transactions on Computer-Human Interaction, vol. 20, no. 6, pp. 1–34.
Acknowledgments
The research leading to these results has received funding from the European Union Seventh Framework Programme FP7 / 2007–2013 through PHENICX project under grant agreement n° 601166.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Julià, C.F., Jordà, S. Towards Concurrent Multi-Tasking in Shareable Interfaces. Comput Supported Coop Work 24, 79–108 (2015). https://doi.org/10.1007/s10606-015-9218-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10606-015-9218-5