Abstract
This paper reports the results of novel quantitative research on multiple people’s personal note-taking in meetings with the long-term aim of aiding the creation of innovative meeting understanding applications. We present three experiments using a large number of group meetings taken from the Augmented Multi-party Interaction meeting corpus. Statistical techniques were employed for this work. Our findings suggest that temporal note-taking overlap information and the semantic content of the written private notes taken by many meeting participants both point to the majority of the most informative meeting events. Thus, the characteristics of note-taking can be seen as a contributing feature for new automatic meeting summarisation approaches and for the development of future meeting browser environments that better support the needs of individuals and organisations.
Similar content being viewed by others
References
3M Online Survey (1998) 3M Online Survey [online]. http://www.3m.com/meetingnetwork/. Accessed 06 Dec 2006
Arons B (1994). Pitch-based emphasis detection for segmenting speech recordings. In: Proceedings of ICSLP, pp 1931–1934
Arons B (1997) Speech skimmer: a system for interactively skimming recorded speech. In: ACM, pp 3–38
Banerjee S, Rudnicky A (2004) Using simple speech-based features to detect the state of a meeting and the roles of the meeting participants. In: Proceedings of ICSLP
Banerjee S, Rose C, Rudnicky A (2005) The necessity of a meeting recording and playback system, and the benefit of topic level annotations to meeting browsing. In: Proceedings of HCI interaction conference, pp 643–656
Banerjee S, Rudnicky A (2006) You are what you say: using meeting participants’ speech to detect their roles and expertise. In: Proceedings of the analyzing conversations in text and speech workshop at HLT-NAACL, pp 23–30
Banerjee S, Rudnicky A (2007) Segmenting meetings into agenda items by extracting implicit supervision from human note-taking. In: Proceedings of IUI, Honolulu, USA, pp 151–159
Banerjee S, Rudnicky A (2009) Detecting the noteworthiness of utterances in human meetings. In: Proceedings of SIGDIAL, London, UK, pp 71–78
Barzilay R, Elhadad M (1997) Using lexical chains for text summarisation. In: Proceedings of ACL/EACL, Madrid, Spain
Bett M, Gross R, Yu H, Zhu X, Pan Y, Yang J, Waibel A (2000) Multimodal meeting tracker. In: Proceedings of RIAO, Paris, France
Bothin A, Clough P (2010) Quantitative analysis of individual differences in note-taking and talking behaviour in meetings. In: Proceedings of IADIS ICT, Society and Human Beings (ICT Humans) conference, part of MCCSIS, Freiburg, Germany
Carletta J (2006) Announcing the AMI meeting corpus. ELRA Newsl 11(1):3–5
Castronovo S, Frey J, Poller P (2008) A generic layout-tool for summaries of meetings in a constraint-based approach. In: Proceedings of MLMI, Utrecht, The Netherlands, pp 248–259
Chiu P, Kapuskar A, Reitmeier S, Wilcox L (1999) NoteLook: taking notes in meetings with digital video and ink. In: Proceedings of ACM multimedia, Orlando, USA, pp 149–158
Edmundson HP (1969) New methods in automatic extracting. J Assoc Comput Mach 16(2):264–285
Ehlen P, Purver M, Niekrasz J (2007) A meeting browser that learns. In: Proceedings of the AAAI spring symposium on interaction challenges for intelligent assistants
Fernandez R, Frampton M, Ehlen P, Purver M, Peters S (2008) Modelling and detecting decisions in multi-party dialogue. In: Proceedings of the 9th SIGDIAL workshop on discourse and dialogue, Columbus, USA, pp 156–163
Field A (2005) Discovering statistics using SPSS. Sage, London
Galley M, McKeown K, Hirschberg J, Shriberg E (2004) Identifying agreement and disagreement in conversational speech: use of Bayesian networks to model pragmatic dependencies. In: Proceedings of ACL
George JA, Rodger JA (2010) Smart data: enterprise performance optimization strategy. Wiley-Blackwell, New York
Germesin S, Wilson T (2009) Agreement detection in multi-party conversation. In: Proceedings of ICMI-MLMI, Cambridge, USA, pp 7–13
Hillard D, Ostendorf M, Shriberg E (2003) Detection of agreement vs. disagreement in meetings: training data with unlabeled data. In: Proceedings of NAACL HLT
Hsueh P-Y, Moore J (2007) What decisions have you made: automatic decision detection in conversational speech. In: Proceedings of NAACL HLT, Rochester, USA, pp 25–32
Hsueh P-Y, Moore J (2009) Improving meeting summarisation by focusing on user needs: a task-oriented evaluation. In: Proceedings of IUI, Sanibel Island, USA
ICT Results (2010) The Internet of meetings. Science Daily. [Online]. http://sciencedaily.com/releases/2010/04/100423215026.htm. Accessed 23 Aug 2010
Jackson T, Dawson R, Wilson D (2003) Understanding email interaction increases organisational productivity. Commun ACM 46(8):80–84
Kalnikaite V, Whittaker S (2007) Software or wetware? Discovering when and why people use digital prosthetic memory. In: Proceedings of CHI, New York, USA
Kalnikaite V, Whittaker S (2008a) Temporal tagging: implicit behaviour identifies points of interest in complex event recordings. In: AAAI social information processing symposium
Kalnikaite V, Whittaker S (2008b) Social summarisation: does social feedback improve access to speech data? In: Proceedings of CSCW, San Diego, USA
Kennedy L, Ellis D (2003) Pitch-based emphasis detection for characterization of meeting recordings. In: Proceedings of ICASSP
Khan F (1992) A survey of note-taking practices. Technical report, Hewlett Packard Laboratories
Kupiec J, Pedersen J, Chen F (1995) A trainable document summariser. In: SIGIR
Landay J, Davis R (1999) Making sharing pervasive: ubiquitous computing for shared note taking. IBM Syst J 38(4):531–550
Lisowska A, Popescu-Belis A, Armstrong S (2004) User query analysis for the specification and evaluation of a dialogue processing and retrieval system. In: Proceedings of LREC, Lisbon, Portugal
Luhn HP (1958) The automatic creation of literature abstracts. IBM J Res Dev 2(2):159–165
Mani I (2001) Automatic summarisation. John Benjamins Publishing Company, Amsterdam
Marcu D (2000) The theory and practice of discourse parsing and summarisation. The MIT Press, Cambridge
Morgan W, Chang P, Gupta S, Brenier J (2006) Automatically detecting action items in audio meeting recordings. In: Proceedings of the 7th SIGDIAL workshop on discourse and dialogue, pp 96–103
Murray G, Renals S (2006) Dialogue act compression via pitch contour preservation. In: Proceedings of the 9th international conference on spoken language processing, Pittsburgh, USA
Murray G, Renals S (2007) Term-weighting for summarisation of multi-party spoken dialogues. In: Proceedings of MLMI
Murray G, Kleinbauer T, Poller P, Renals S, Kilgour J, Becker T (2008) Extrinsic summarisation evaluation: a decision audit task. In: Proceedings of MLMI, Utrecht, The Netherlands, pp 349–361
Murray G, Renals S (2008a) Detecting action items in meetings. In: Proceedings of MLMI, Utrecht, The Netherlands, pp 208–213
Murray G, Renals S (2008b) Meta comments for summarising meeting speech. In: Proceedings of MLMI, Utrecht, The Netherlands, pp 236–247
Piolat A, Olive T, Kellogg R (2005) Cognitive effort during note-taking. Appl Cogn Psychol 19:291–312
Purver M, Ehlen P, Niekrasz J (2006) Shallow discourse structure for action item detection. In: Proceedings of the ACTS workshop at HLT-NAACL, pp 31–34
Renals S (2010) Recognition and understanding of meetings. In: Proceedings of HLT, Los Angeles, USA, pp 1–9
Rodger JA, George JA (2010) Adapting the task-technology-fit model and smart data to validate end-user acceptance of the voice-activated medical tracking application (VAMTA). In: Neustein A (ed) Visions of speech: exploring new voice apps in mobile environments, call centers and clinics. Springer, Norwell
Salton G, Singhal A, Mitra M, Buckley C (1997) Automatic text structuring and summarisation. Inf Process Manage 33(2):193–207
Spira J, Feintuch J (2005) The cost of not paying attention: how interruptions impact knowledge worker productivity. Basex report
Stifelman L, Arons B, Schmandt C (2001) The audio notebook—paper and pen interaction with structured speech. In: Proceedings of CHI, pp 182–189
Tucker S, Whittaker S (2005) Novel techniques for time-compressing speech: an exploratory study. In: Proceedings of ICASSP
Waibel A, Bett M, Finke M, Stiefelhagen R (1998) Meeting browser: tracking and summarizing meetings. In: Proceedings of the DARPA broadcast news workshop
Wellner P, Flynn M, Guillemot M (2004) Browsing recorded meetings with ferret. In: Proceedings of MLMI, Martigny, Switzerland, pp 12–21
Whittaker S, Hyland P, Wiley M (1994) Filochat: handwritten notes provide access to recorded conversations. In: Proceedings of CHI, Boston, USA, pp 271–277
Whittaker S, Laban R, Tucker S (2005) Analysing meeting records: an ethnographic study and technological implications. In: Proceedings of MLMI, Edinburgh, Scotland, UK
Whittaker S, Tucker S, Swampillai K, Laban R (2008) Design and evaluation of systems to support interaction capture and retrieval. Pers Ubiquit Comput 12:197–221
Wilcox L, Schilit B, Sawhney N (1997) Dynomite: a dynamically organised ink and audio notebook. In: Proceedings of CHI, pp 186–193
Wolf C, Rhyne J, Briggs L (1992) Communication and information retrieval with a pen-based meeting support tool. In: CSCW 1992 proceedings, pp 322–329
Wrede B, Shriberg E (2003a) Spotting “hotspots” in meetings: human judgments and prosodic cues. In: Proceedings of the European conference on speech communication and technology (Eurospeech), Geneva, Switzerland, pp 2805–2808
Wrede B, Shriberg E (2003b) The relationship between dialogue acts and hot spots in meetings. In: Workshop on automatic speech recognition and understanding, pp 180–185
Yu Z, Nakamura Y (2010) Smart meeting systems: a survey of state-of-the-art and open issues. ACM Comput Surv 42(2):8:1–8:20
Zechner K (2002) Summarisation of spoken language—challenges, methods, and prospects. In: Speech technology expert eZine
Acknowledgments
We would like to thank the creators of the AMI meeting corpus for providing us with meeting recordings and annotations. We also wish to thank the anonymous reviewers for their valuable comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bothin, A., Clough, P. Participants’ personal note-taking in meetings and its value for automatic meeting summarisation. Inf Technol Manag 13, 39–57 (2012). https://doi.org/10.1007/s10799-011-0112-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10799-011-0112-7