{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T13:48:30Z","timestamp":1744897710180},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,8,3]],"date-time":"2016-08-03T00:00:00Z","timestamp":1470182400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2016,8,3]]},"abstract":"\n There are a large number of computer-based systems that aim to train and improve social skills. However, most of these do not resemble the training regimens used by human instructors. In this article, we propose a computer-based training system that follows the procedure of social skills training (SST), a well-established method to decrease human anxiety and discomfort in social interaction, and acquire social skills. We attempt to automate the process of SST by developing a dialogue system named the\n automated social skills trainer<\/jats:italic>\n , which teaches social communication skills through human-agent interaction. The system includes a virtual avatar that recognizes user speech and language information and gives feedback to users. Its design is based on conventional SST performed by human participants, including defining target skills, modeling, role-play, feedback, reinforcement, and homework. We performed a series of three experiments investigating (1) the advantages of using computer-based training systems compared to human-human interaction (HHI) by subjectively evaluating nervousness, ease of talking, and ability to talk well; (2) the relationship between speech language features and human social skills; and (3) the effect of computer-based training using our proposed system. Results of our first experiment show that interaction with an avatar decreases nervousness and increases the user's subjective impression of his or her ability to talk well compared to interaction with an unfamiliar person. The experimental evaluation measuring the relationship between social skill and speech and language features shows that these features have a relationship with social skills. Finally, experiments measuring the effect of performing SST with the proposed application show that participants significantly improve their skill, as assessed by separate evaluators, by using the system for 50 minutes. A user survey also shows that the users thought our system is useful and easy to use, and that interaction with the avatar felt similar to HHI.\n <\/jats:p>","DOI":"10.1145\/2937757","type":"journal-article","created":{"date-parts":[[2016,8,4]],"date-time":"2016-08-04T13:26:34Z","timestamp":1470317194000},"page":"1-26","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["Teaching Social Communication Skills Through Human-Agent Interaction"],"prefix":"10.1145","volume":"6","author":[{"given":"Hiroki","family":"Tanaka","sequence":"first","affiliation":[{"name":"Nara Institute of Science and Technology, Ikoma-shi, Nara, Japan"}]},{"given":"Sakti","family":"Sakriani","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Ikoma-shi, Nara, Japan"}]},{"given":"Graham","family":"Neubig","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Ikoma-shi, Nara, Japan"}]},{"given":"Tomoki","family":"Toda","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Ikoma-shi, Nara, Japan"}]},{"given":"Hideki","family":"Negoro","sequence":"additional","affiliation":[{"name":"Nara University of Education, Takabatake-cho, Nara-shi, Nara, Japan"}]},{"given":"Hidemi","family":"Iwasaka","sequence":"additional","affiliation":[{"name":"Nara University of Education, Takabatake-cho, Nara-shi, Nara, Japan"}]},{"given":"Satoshi","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Ikoma-shi, Nara, Japan"}]}],"member":"320","published-online":{"date-parts":[[2016,8,3]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Yaser Adi Amanda Kiloran Kulsum Janmohamed and Sarah Stewart-Brown. 2007. Systematic Review of the Effectiveness of Interventions to Promote Mental Wellbeing in Primary Schools. Report 1: Universal approaches: Non-Violence Related Outcomes. Coventry University of Warwick. Yaser Adi Amanda Kiloran Kulsum Janmohamed and Sarah Stewart-Brown. 2007. Systematic Review of the Effectiveness of Interventions to Promote Mental Wellbeing in Primary Schools. Report 1: Universal approaches: Non-Violence Related Outcomes. Coventry University of Warwick."},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders (DSM-5\u00ae). Author. American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders (DSM-5\u00ae). Author.","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2002.1206"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005653411471"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1016378718278"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Amy L. Baylor and Yanghee Kim. 2004. Pedagogical agent design: The impact of agent realism gender ethnicity and instructional role. In Intelligent Tutoring Systems. Springer Berlin Germany 592--603. Amy L. Baylor and Yanghee Kim. 2004. Pedagogical agent design: The impact of agent realism gender ethnicity and instructional role. In Intelligent Tutoring Systems. Springer Berlin Germany 592--603.","DOI":"10.1007\/978-3-540-30139-4_56"},{"key":"e_1_2_1_7_1","unstructured":"Alan S. Bellack. 2004. Social Skills Training for Schizophrenia: A Step-by-Step Guide. Guilford Press New York NY. Alan S. Bellack. 2004. Social Skills Training for Schizophrenia: A Step-by-Step Guide. Guilford Press New York NY."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.0266-4909.2003.00057.x"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 13th Annual Conference of the International Speech Communication Association (INTERSPEECH'12)","author":"Bone Daniel","year":"2012"},{"key":"e_1_2_1_10_1","first-page":"237","article-title":"Abnormal speech spectrum and increased pitch variability in young autistic children","volume":"4","author":"Bonneh Yoram S.","year":"2010","journal-title":"Frontiers in Human Neuroscience"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Jacob Cohen Patricia Cohen Stephen G. West and Leona S. Aiken. 2013. Applied Multiple Regression\/Correlation Analysis for the Behavioral Sciences. Routledge. Jacob Cohen Patricia Cohen Stephen G. West and Leona S. Aiken. 2013. Applied Multiple Regression\/Correlation Analysis for the Behavioral Sciences. Routledge.","DOI":"10.4324\/9780203774441"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 3rd International Conference on Narrative and Interactive Learning Environments.","author":"Davis M."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1961.10482090"},{"key":"e_1_2_1_14_1","unstructured":"Nancy Eisenberg William Damon and Richard M. Lerner. 2006. Social Emotional and Personality Development. John Wiley & Sons. Nancy Eisenberg William Damon and Richard M. Lerner. 2006. Social Emotional and Personality Development. John Wiley & Sons."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2014.05.056"},{"key":"e_1_2_1_16_1","unstructured":"M. H. Hanson. 1995. Glottal Characteristics of Female Speakers. Ph.D. Dissertation. Harvard University Cambridge MA. M. H. Hanson. 1995. Glottal Characteristics of Female Speakers. Ph.D. Dissertation. Harvard University Cambridge MA."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1944506.1944551"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493502"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2014.98"},{"key":"e_1_2_1_20_1","first-page":"217","article-title":"Autistic disturbances of affective contact","volume":"2","author":"Kanner Leo","year":"1943","journal-title":"Nervous Child"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 14th Annual Conference of the International Speech Communication Association (INTERSPEECH'13)","author":"Kiss G\u00e9za"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 13th Annual Conference of the International Speech Communication Association (INTERSPEECH'12)","author":"Kiss G\u00e9za"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems","volume":"1","author":"Lee Jina","year":"2010"},{"key":"e_1_2_1_24_1","unstructured":"R. P. Liberman and C. J. Wallace. 1990. Social and Independent Living Skills: Basic Conversation Skills Module. Robert Paul Liberman Camarillo CA. R. P. Liberman and C. J. Wallace. 1990. Social and Independent Living Skills: Basic Conversation Skills Module. Robert Paul Liberman Camarillo CA."},{"key":"e_1_2_1_25_1","unstructured":"Robert Paul Liberman. 1987. Social and Independent Living Skills. UCLA Psychiatric Rehabilitation Consultants Northridge CA. Robert Paul Liberman. 1987. Social and Independent Living Skills. UCLA Psychiatric Rehabilitation Consultants Northridge CA."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/1368282031000154204"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/13558000050138452"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163127"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2788.2002.00425.x"},{"key":"e_1_2_1_30_1","unstructured":"James W. Pennebaker Roger J. Booth and Martha E. Francis. 2007. Linguistic Inquiry and Word Count: LIWC {Computer Software}. Available at http:\/\/liwc.wpengine.com. James W. Pennebaker Roger J. Booth and Martha E. Francis. 2007. Linguistic Inquiry and Word Count: LIWC {Computer Software}. Available at http:\/\/liwc.wpengine.com."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Toni Rietveld and Roeland Van Hout. 1993. Statistical Techniques for the Study of Language and Language Behaviour. Walter de Gruyter. Toni Rietveld and Roeland Van Hout. 1993. Statistical Techniques for the Study of Language and Language Behaviour. Walter de Gruyter.","DOI":"10.1515\/9783110871609"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the Conference of the Association for Computational Linguistics. 709","author":"Rouhizadeh Masoud","year":"2013"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/aur.1301"},{"key":"e_1_2_1_34_1","unstructured":"Bj\u00f6rn Schuller Erik Marchi Simon Baron-Cohen Helen O'Reilly Delia Pigat Peter Robinson and Ian Daves. 2014. The state of play of ASC-inclusion: An integrated Internet-based environment for social inclusion of children with autism spectrum conditions. arXiv:1403.5912. Bj\u00f6rn Schuller Erik Marchi Simon Baron-Cohen Helen O'Reilly Delia Pigat Peter Robinson and Ian Daves. 2014. The state of play of ASC-inclusion: An integrated Internet-based environment for social inclusion of children with autism spectrum conditions. arXiv:1403.5912."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361301005003007"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2744195"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702385"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3211"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701368"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8624.2009.01320.x"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-005-0061-2"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1093\/schbul\/6.1.42"},{"key":"e_1_2_1_43_1","unstructured":"Donna Williams. 1992. Nobody Nowhere. Doubleday. Donna Williams. 1992. Nobody Nowhere. Doubleday."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2937757","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,31]],"date-time":"2022-12-31T08:02:59Z","timestamp":1672473779000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2937757"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,3]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,8,3]]}},"alternative-id":["10.1145\/2937757"],"URL":"https:\/\/doi.org\/10.1145\/2937757","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,8,3]]},"assertion":[{"value":"2015-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-08-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}