Affordance-Derived Declarative Interaction Models for Context Adaptation | SpringerLink
Skip to main content
Springer Nature Link
Log in

Affordance-Derived Declarative Interaction Models for Context Adaptation

  • Conference paper
  • First Online:
Sense, Feel, Design (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13198))

Included in the following conference series:

  • 958 Accesses

Abstract

Automatically adapting an interactive application to its use context is highly dependent on the existence of a declarative model. The Model-Based User Interface Development research made important progress in fully declarative specifications on interactive applications. However, the Abstract User Interface declarative models, such as task-based or communication-based models, are unfamiliar to designers and developers. This paper presents early explorations into a research program aimed at achieving fully declarative interactive applications: outlining a static concrete user interface and deriving the interaction from its affordances. The basic assumption is that for a well-designed user interface, the UI function can be derived from its form through affordance mechanisms. As the static aspects like the UI initial form are already being described declaratively in industrial practice, fully declarative interactive applications would result from the new research program.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11439
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14299
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Beaudouin-Lafon, M., Mackay, M.: Prototyping Tools and Techniques, pp. 1006–1031. Lawrence Erlbaum Associates Inc., USA (2002)

    Google Scholar 

  2. Bogdan, C., et al.: Generating an abstract user interface from a discourse model inspired by human communication. In: Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008), p. 36 (2008)

    Google Scholar 

  3. Bogdan, C.: IT Design for Amateur Communities. Ph.D. thesis, KTH, Numerical Analysis and Computer Science, NADA (2003). (qC 20100420 NR 20140805)

    Google Scholar 

  4. Bogdan, C., Mayer, R.: Makumba: The role of the technology for the sustainability of amateur programming practice and community. In: Proceedings of the Fourth International Conference on Communities and Technologies. pp. 205–214. Association for Computing Machinery, New York, NY, USA (2009)

    Google Scholar 

  5. Bowen, J., Reeves, S.: Generating obligations, assertions and tests from UI models. In: Proceedings of ACM Human-Computer Interaction 1 (EICS), June 2017. https://doi.org/10.1145/3095807

  6. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003). Computer-Aided Design of User Interface

    Article  Google Scholar 

  7. Coyette, A., Vanderdonckt, J.: A sketching tool for designing Anyuser, Anyplatform, anywhere user interfaces. In: Costabile, M.F., Paternò, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 550–564. Springer, Heidelberg (2005). https://doi.org/10.1007/11555261_45

    Chapter  Google Scholar 

  8. Crandall, B., Klein, G.A., Hoffman, R.R.: Working Minds: A Practitioner’s Guide to Cognitive Task Analysis. The MIT Press, Cambridge (2006)

    Book  Google Scholar 

  9. Facebook: React reconciliation (2021). https://reactjs.org/docs/reconciliation.html. Accessed 9 Apr 2021

  10. Finis, J.P., Raiber, M., Augsten, N., Brunel, R., Kemper, A., Färber, F.: RWS-diff: flexible and efficient change detection in hierarchical data. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, pp. 339–348. CIKM 2013, Association for Computing Machinery, New York, NY, USA (2013)

    Google Scholar 

  11. Forbrig, P., Dittmar, A., Kühn, M.: A textual domain specific language for task models: generating code for coTAL, CTTE, and HAMSTERS. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. EICS 2018, Association for Computing Machinery, New York, NY, USA (2018)

    Google Scholar 

  12. Garfinkel, H.: Studies in Ethnomethodology. Prentice-Hall, Englewood Cliffs (1967)

    Google Scholar 

  13. Ghiani, G., Manca, M., Paternò, F., Rett, J., Vaibhav, A.: Adaptive multimodal web user interfaces for smart work environments. J. Amb. Intell. Smart. Environ. 7(6), 701–717 (2015)

    Google Scholar 

  14. Gibson, J.J.: The Ecological Approach to Visual Perception. Houghton Mifflin, Boston (1979)

    Google Scholar 

  15. Hou, S., Zhang, S., Fei, C.: Rhetorical structure theory: a comprehensive review of theory, parsing methods and applications. Expert Syst. App. 157, 113421 (2020)

    Article  Google Scholar 

  16. Kis, F., Bogdan, C.: Lightweight low-level query-centric user interface modeling. In: 2013 46th Hawaii International Conference on System Sciences, pp. 440–449 (2013)

    Google Scholar 

  17. Kis, F., Bogdan, C.: Declarative setup-free web application prototyping combining local and cloud datastores. In: 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 115–123 (2016)

    Google Scholar 

  18. Kis, F., Bogdan, C., Kaindl, H., Falb, J.: Towards fully declarative high-level interaction models: an approach facilitating automated GUI generation. In: 2014 47th Hawaii International Conference on System Sciences, pp. 412–421 (2014)

    Google Scholar 

  19. Kis, F., Bogdan, C.: Generating interactive prototypes from query annotated discourse models. i-com 14(3), 205–219 (2015)

    Article  Google Scholar 

  20. Koch, J., Oulasvirta, A.: Computational layout perception using gestalt laws. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1423–1429. CHI EA 2016, Association for Computing Machinery, New York, NY, USA (2016)

    Google Scholar 

  21. Martinie, C., Palanque, P.: Task models based engineering of interactive systems. In: Companion Proceedings of the 12th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. EICS 2020 Companion, Association for Computing Machinery, New York, NY, USA (2020)

    Google Scholar 

  22. Meixner, G., Orfgen, M., Kümmerling, M.: Evaluation of user interface description languages for model-based user interface development in the German automotive industry. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8004, pp. 411–420. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39232-0_45

    Chapter  Google Scholar 

  23. Meixner, G., Paternò, F., Vanderdonckt, J.: Past, present, and future of model-based user interface development. i-com 10(3), 2–11 (2011)

    Article  Google Scholar 

  24. Myers, B., Hudson, S.E., Pausch, R.: Past, present, and future of user interface software tools. ACM Trans. Comput. Hum. Interact. 7(1), 3–28 (2000)

    Article  Google Scholar 

  25. Myers, B.A., Rosson, M.B.: Survey on user interface programming. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 195–202. CHI 1992, Association for Computing Machinery, New York, NY, USA (1992)

    Google Scholar 

  26. Nebeling, M., Paternò, F., Maurer, F., Nichols, J.: Systems and tools for cross-device user interfaces. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 300–301. EICS 2015, Association for Computing Machinery, New York, NY, USA (2015)

    Google Scholar 

  27. Norman, D.A.: The Design of Everyday Things. Basic Books, New York (2002)

    Google Scholar 

  28. Palanque, P., Martinie, C., Winckler, M.: Designing and assessing interactive systems using task models. In: Bernhaupt, R., et al. (eds.) INTERACT 2017. LNCS, vol. 10516, pp. 383–386. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68059-0_35

    Chapter  Google Scholar 

  29. Paterno, F., Mancini, C., Meniconi, S.: ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models, pp. 362–369. Springer, Boston (1997). https://doi.org/10.1007/978-0-387-35175-9_58

    Book  Google Scholar 

  30. Paternò, F., Santoro, C., Spano, L.D.: MARIA: a universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments. ACM Trans. Comput. Hum. Interact. 16(4), 1–30 (2009)

    Article  Google Scholar 

  31. Pawlik, M., Augsten, N.: Tree edit distance: robust and memory-efficient. Inf. Syst. 56, 157–173 (2016)

    Article  Google Scholar 

  32. Rock, I., Palmer, S.: The legacy of gestalt psychology. Sci. Am. 263(6), 84–90 (1990)

    Article  Google Scholar 

  33. Schegloff, E.A., Sacks, H.: Opening up closings. Semiotica 8(4), 289–327 (1973)

    Article  Google Scholar 

  34. Sermuga Pandian, V.P., Suleri, S., Jarke, P.D.M.: UISketch: a large-scale dataset of UI element sketches. In: Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3411764.3445784

  35. Silva-Rodríguez, V., Nava-Muñoz, S.E., Martínez-Pérez, F.E., Pérez-González, H.G.: How to select the appropriate pattern of human-computer interaction?: a case study with junior programmers. In: 2018 6th International Conference in Software Engineering Research and Innovation (CONISOFT), pp. 66–71 (2018)

    Google Scholar 

  36. Todi, K., Bailly, G., Leiva, L.A., Oulasvirta, A.: Adapting user interfaces with model-based reinforcement learning. In: CHI Conference on Human Factors in Computing Systems (CHI 2021), Yokohama, Japan, May 2021. https://hal.sorbonne-universite.fr/hal-03160272

  37. Westerlund, B.: Form is function. In: Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. pp. 117–124. DIS 2002, Association for Computing Machinery, New York, NY, USA (2002)

    Google Scholar 

  38. Yigitbas, E., Grün, S., Sauer, S., Engels, G.: Model-driven context management for self-adaptive user interfaces. In: Ochoa, S.F., Singh, P., Bravo, J. (eds.) UCAmI 2017. LNCS, vol. 10586, pp. 624–635. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67585-5_61

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. KTH Royal Institute of Technology, Stockholm, Sweden

    Cristian Bogdan

Authors
  1. Cristian Bogdan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cristian Bogdan .

Editor information

Editors and Affiliations

  1. Polytechnic University of Bari, Bari, Italy

    Carmelo Ardito

  2. University of Bari Aldo Moro, Bari, Italy

    Rosa Lanzilotti

  3. Computer Science Department, University of Pisa, Pisa, Italy

    Alessio Malizia

  4. Reykjavik University, Reykjavik, Iceland

    Marta Larusdottir

  5. University of Cagliari, Caglieri, Italy

    Lucio Davide Spano

  6. Department of Information, University of Minho, Braga, Portugal

    José Campos

  7. Department of Communication, University of Copenhagen, Copenhagen, Denmark

    Morten Hertzum

  8. Fachbereich Informatik, Trier University of Applied Sciences, Trier, Germany

    Tilo Mentler

  9. ITI/Larsys, University of West London, London, UK

    José Abdelnour Nocera

  10. Knowledge Media Institute, Open University, Milton Keynes, UK

    Lara Piccolo

  11. University of Paderborn, Paderborn, Germany

    Stefan Sauer

  12. Faculty of Sciences, Department of Computer Science, Vrije Universiteit, Amsterdam, The Netherlands

    Gerrit van der Veer

Rights and permissions

Reprints and permissions

Copyright information

© 2022 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bogdan, C. (2022). Affordance-Derived Declarative Interaction Models for Context Adaptation. In: Ardito, C., et al. Sense, Feel, Design. INTERACT 2021. Lecture Notes in Computer Science, vol 13198. Springer, Cham. https://doi.org/10.1007/978-3-030-98388-8_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-98388-8_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-98387-1

  • Online ISBN: 978-3-030-98388-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation