Computational research with continuous representations depends on obtaining continuous representations from human labellers. The main method used for that purpose is tracing. Tracing raises a range of challenging issues, both psychological and statistical. Naive assumptions about these issues are easy to make, and can lead to inappropriate requirements and uses. The natural function of traces is to capture perceived affect, and as such they belong in long traditions of research on both perception and emotion. Experiments on several types of material provide information about their characteristics, particularly the ratings on which people tend to agree. Disagreement is not necessarily a problem in the technique. It may correctly show that people\u2019s impressions of emotion diverge more than commonly thought. A new system, Gtrace, is designed to let rating studies capitalise on a decade of experience and address the research questions that are opened up by the data now available.<\/p>","DOI":"10.4018\/jse.2012010101","type":"journal-article","created":{"date-parts":[[2012,8,13]],"date-time":"2012-08-13T12:49:06Z","timestamp":1344862146000},"page":"1-17","source":"Crossref","is-referenced-by-count":50,"title":["Tracing Emotion"],"prefix":"10.4018","volume":"3","author":[{"given":"Roddy","family":"Cowie","sequence":"first","affiliation":[{"name":"Queen\u2019s University Belfast, UK"}]},{"given":"Gary","family":"McKeown","sequence":"additional","affiliation":[{"name":"Queen\u2019s University Belfast, UK"}]},{"given":"Ellen","family":"Douglas-Cowie","sequence":"additional","affiliation":[{"name":"Queen\u2019s University Belfast, UK"}]}],"member":"2432","reference":[{"key":"jse.2012010101-0","article-title":"Rhetoric","author":"R.Aristotle","year":"1941","journal-title":"The basic works of Aristotle"},{"key":"jse.2012010101-1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0030-8"},{"key":"jse.2012010101-2","unstructured":"Cauldwell, R. T. (2000). Where did the anger go? The role of context in interpreting emotion in speech. In Proceedings of the ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland."},{"key":"jse.2012010101-3","unstructured":"Cowie, R., Camurri, A., & Glowinski, D. (2011). SIEMPRE deliverable D4.1 - Results from the first series of experiments and first evaluation report. Retrieved from http:\/\/www.siempre.infomus.org\/assets\/Deliverables\/WP4\/SIEMPRE-D41.pdf"},{"key":"jse.2012010101-4","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00071-7"},{"key":"jse.2012010101-5","first-page":"213","article-title":"Issues in data labelling","author":"R.Cowie","year":"2010","journal-title":"Emotion-oriented systems: The humaine handbook"},{"key":"jse.2012010101-6","unstructured":"Cowie, R., Douglas-Cowie, E., Savvidou, S., McMahon, E., Sawey, M., & Schroder, M. (2000). \u201cFEELTRACE\u201d: An instrument for recording perceived emotion in real time. In Proceedings of the ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland."},{"key":"jse.2012010101-7","doi-asserted-by":"publisher","DOI":"10.1109\/79.911197"},{"key":"jse.2012010101-8","unstructured":"Cowie, R., & McKeown, G. (2010). Statistical analysis of data from initial labelled database and recommendations for an economical coding scheme. Retrieved from http:\/\/www.semaine-project.eu\/"},{"key":"jse.2012010101-9","unstructured":"Cowie, R., & Sawey, M. (2011). GTrace [Software Manual]. Retrieved from The HUMAINE Portal website: http:\/\/emotion-research.net\/toolbox\/toolboxlabellingtool.2011-07-08.0084929013"},{"key":"jse.2012010101-10","unstructured":"Devillers, L., Cowie, R., & Martin, J. (2006). Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches. In Proceedings of the 5th International Conference on Language Resources and Evaluation, Genoa, Italy."},{"key":"jse.2012010101-11","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00070-5"},{"key":"jse.2012010101-12","doi-asserted-by":"crossref","unstructured":"Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., et al. (2007). The HUMAINE database: Addressing the collection and annotation of naturalistic and induced emotional data. In A. C. R. Paiva, R. Prada, & R. W. Picard (Eds.), Proceedings of the Second International Conference on Affective Computing and Intelligent Interaction (LNCS 4738, p. 450-488).","DOI":"10.1007\/978-3-540-74889-2_43"},{"key":"jse.2012010101-13","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8721.00003"},{"key":"jse.2012010101-14","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2007.02024.x"},{"key":"jse.2012010101-15","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.53.1.53"},{"key":"jse.2012010101-16","author":"W. R.Garner","year":"1974","journal-title":"The processing of information and structure"},{"key":"jse.2012010101-17","unstructured":"Grandjean, D., Torres-Eliard, K., & Labbe, C. (2011). SIEMPRE deliverable D2.1 - First series of experiments. Retrieved from http:\/\/www.linkedheritage.eu\/getFile.php?id=229"},{"key":"jse.2012010101-18","unstructured":"Hanratty, J. M. (2010). Individual and situational differences in emotional expression (Unpublished doctoral dissertation). Queen's University, Belfast, UK."},{"key":"jse.2012010101-19","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.03.004"},{"key":"jse.2012010101-20","doi-asserted-by":"publisher","DOI":"10.1037\/1196-1961.51.4.336"},{"key":"jse.2012010101-21","author":"J. E.LeDoux","year":"1998","journal-title":"The emotional brain: the mysterious underpinnings of emotional life"},{"key":"jse.2012010101-22","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.45.3.587"},{"key":"jse.2012010101-23","doi-asserted-by":"publisher","DOI":"10.1177\/0305735607079714"},{"key":"jse.2012010101-24","doi-asserted-by":"publisher","DOI":"10.1016\/S0160-2896(99)00016-1"},{"key":"jse.2012010101-25","doi-asserted-by":"crossref","unstructured":"McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schr\u00f6der, M. (2012). The SEMAINE database: annotated multimodal records of emotionally coloured conversations between a person and a limited agent. IEEE Transactions on Affective Computing, 3(1). doi:10.1109\/T-AFFC.2011.20","DOI":"10.1109\/T-AFFC.2011.20"},{"key":"jse.2012010101-26","doi-asserted-by":"publisher","DOI":"10.1007\/BF02686918"},{"key":"jse.2012010101-27","doi-asserted-by":"publisher","DOI":"10.1007\/s10919-008-0048-8"},{"key":"jse.2012010101-28","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193159"},{"key":"jse.2012010101-29","year":"2003","journal-title":"The polygraph and lie detection"},{"key":"jse.2012010101-30","doi-asserted-by":"crossref","unstructured":"Osherenko, A., Andre, E., & Vogt, T. (2009). Affect sensing in speech: Studying fusion of linguistic and acoustic features. In Proceedings of the IEEE International Conference on Affective Computing and Intelligent Interfaces, Amsterdam, The Netherlands.","DOI":"10.1109\/ACII.2009.5349559"},{"key":"jse.2012010101-31","first-page":"1","article-title":"Expressive writing connections to physical and mental health","author":"J. W.Pennebaker","year":"2011","journal-title":"Oxford handbook of health psychology"},{"key":"jse.2012010101-32","author":"P.Petta","year":"2010","journal-title":"Emotion-oriented systems: The humaine handbook"},{"key":"jse.2012010101-33","first-page":"141","article-title":"A structuralist reconstruction of Wundt's three-dimensional theory of emotion","author":"R.Reisenzein","year":"1992","journal-title":"The structuralist program in psychology: Foundations and applications"},{"key":"jse.2012010101-34","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.67.3.525"},{"key":"jse.2012010101-35","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198529613.003.0005","article-title":"Conducting judgment studies: Some methodological issues","author":"R.Rosenthal","year":"2005","journal-title":"New handbook of methods in nonverbal behavior research"},{"key":"jse.2012010101-36","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195169157.003.0018","article-title":"Continuous measurement of emotion: The affect rating dial","author":"A. M.Ruef","year":"2007","journal-title":"Handbook of emotion elicitation and assessment"},{"key":"jse.2012010101-37","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.37.3.345"},{"key":"jse.2012010101-38","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"jse.2012010101-39","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.03.001"},{"key":"jse.2012010101-40","unstructured":"Savvidou, S. (2011). Validation of the FEELtrace tool for recording impressions of expressed emotion (Unpublished doctoral dissertation). School of Psychology, Queen's University, Belfast, UK."},{"issue":"6","key":"jse.2012010101-41","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1037\/h0061489","article-title":"A scale for the judgment of facial expressions.","volume":"29","author":"H.Schlosberg","year":"1941","journal-title":"Journal of Experimental Psychology. General"},{"key":"jse.2012010101-42","doi-asserted-by":"crossref","unstructured":"Schr\u00f6der, M., Bevacqua, E., Cowie, R., Eyben, F., Gunes, H., Heylen, D., Maat, M. T., et al. (2012). Building autonomous sensitive artificial listeners. IEEE Transactions on Affective Computing doi:10.1109\/T-AFFC.2011.34","DOI":"10.1109\/T-AFFC.2011.34"},{"key":"jse.2012010101-43","doi-asserted-by":"publisher","DOI":"10.1080\/00049539908255353"},{"key":"jse.2012010101-44","unstructured":"Schubert, E. (2007). Real time cognitive response recording. In Proceedings of the International Conference on Music Communication Science, Sydney, Australia."},{"key":"jse.2012010101-45","first-page":"223","article-title":"Continuous self-report methods","author":"E.Schubert","year":"2010","journal-title":"Handbook of music and emotion"},{"key":"jse.2012010101-46","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(00)00028-5"},{"key":"jse.2012010101-47","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0014679"},{"key":"jse.2012010101-48","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.06.001"},{"key":"jse.2012010101-49","doi-asserted-by":"publisher","DOI":"10.1037\/h0045795"},{"issue":"8","key":"jse.2012010101-50","first-page":"ii","article-title":"An emotional snapshot.","volume":"24","author":"J.Sutton","year":"2011","journal-title":"The Psychologist"}],"container-title":["International Journal of Synthetic Emotions"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=66086","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,28]],"date-time":"2024-04-28T11:04:27Z","timestamp":1714302267000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jse.2012010101"}},"subtitle":["An Overview"],"short-title":[],"issued":{"date-parts":[[2012,1,1]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,1]]}},"URL":"https:\/\/doi.org\/10.4018\/jse.2012010101","relation":{},"ISSN":["1947-9093","1947-9107"],"issn-type":[{"value":"1947-9093","type":"print"},{"value":"1947-9107","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1,1]]}}}