{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T13:25:37Z","timestamp":1733318737278,"version":"3.30.1"},"update-to":[{"updated":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T00:00:00Z","timestamp":1730419200000},"DOI":"10.1371\/journal.pcbi.1011948","type":"new_version","source":"publisher","label":"New version"}],"reference-count":43,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T00:00:00Z","timestamp":1729555200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of University and Research","award":["PNC0000007"]},{"name":"Extended Partnership Neuroscience and Neuropharmacology"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"Coordinating with others is part of our everyday experience. Previous studies using sensorimotor coordination games suggest that human dyads develop coordination strategies that can be interpreted as Nash equilibria. However, if the players are uncertain about what their partner is doing, they develop coordination strategies which are robust to the actual partner\u2019s actions. This has suggested that humans select their actions based on an explicit prediction of what the partner will be doing\u2014a partner model\u2014which is probabilistic by nature. However, the mechanisms underlying the development of a joint coordination over repeated trials remain unknown. Very much like sensorimotor adaptation of individuals to external perturbations (eg force fields or visual rotations), dynamical models may help to understand how joint coordination develops over repeated trials. Here we present a general computational model\u2014based on game theory and Bayesian estimation\u2014designed to understand the mechanisms underlying the development of a joint coordination over repeated trials. Joint tasks are modeled as quadratic games, where each participant\u2019s task is expressed as a quadratic cost function. Each participant predicts their partner\u2019s next move (partner model) by optimally combining predictions and sensory observations, and selects their actions through a stochastic optimization of its expected cost, given the partner model. The model parameters include perceptual uncertainty (sensory noise), partner representation (retention rate and internale noise), uncertainty in action selection and its rate of decay (which can be interpreted as the action\u2019s learning rate). The model can be used in two ways: (i) to simulate interactive behaviors, thus helping to make specific predictions in the context of a given joint action scenario; and (ii) to analyze the action time series in actual experiments, thus providing quantitative metrics that describe individual behaviors during an actual joint action. We demonstrate the model in a variety of joint action scenarios. In a sensorimotor version of the Stag Hunt game, the model predicts that different representations of the partner lead to different Nash equilibria. In a joint two via-point (2-VP) reaching task, in which the actions consist of complex trajectories, the model captures well the observed temporal evolution of performance. For this task we also estimated the model parameters from experimental observations, which provided a comprehensive characterization of individual dyad participants. Computational models of joint action may help identifying the factors preventing or facilitating the development of coordination. They can be used in clinical settings, to interpret the observed behaviors in individuals with impaired interaction capabilities. They may also provide a theoretical basis to devise artificial agents that establish forms of coordination that facilitate neuromotor recovery.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011948","type":"journal-article","created":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T17:38:33Z","timestamp":1729618713000},"page":"e1011948","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Computational joint action: Dynamical models to understand the development of joint coordination"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7200-0892","authenticated-orcid":true,"given":"Cecilia","family":"De Vicariis","sequence":"first","affiliation":[]},{"given":"Vinil T.","family":"Chackochan","sequence":"additional","affiliation":[]},{"given":"Laura","family":"Bandini","sequence":"additional","affiliation":[]},{"given":"Eleonora","family":"Ravaschio","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8746-3136","authenticated-orcid":true,"given":"Vittorio","family":"Sanguineti","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2024,10,22]]},"reference":[{"issue":"2","key":"pcbi.1011948.ref001","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.tics.2005.12.009","article-title":"Joint action: bodies and minds moving together","volume":"10","author":"N Sebanz","year":"2006","journal-title":"Trends Cogn Sci"},{"issue":"8-9","key":"pcbi.1011948.ref002","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1016\/j.neunet.2010.06.002","article-title":"A minimal architecture for joint action","volume":"23","author":"C Vesper","year":"2010","journal-title":"Neural Netw"},{"issue":"2","key":"pcbi.1011948.ref003","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s13164-011-0062-3","article-title":"Editorial: Joint Action: What Is Shared?","volume":"2","author":"SA Butterfill","year":"2011","journal-title":"Review of Philosophy and Psychology"},{"key":"pcbi.1011948.ref004","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.cognition.2017.04.008","article-title":"Drawn together: When motor representations ground joint actions","volume":"165","author":"F Della Gatta","year":"2017","journal-title":"Cognition"},{"key":"pcbi.1011948.ref005","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.cortex.2022.03.007","article-title":"Sharing motor plans while acting jointly: A TMS study","volume":"151","author":"G Barchiesi","year":"2022","journal-title":"Cortex"},{"issue":"2","key":"pcbi.1011948.ref006","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1111\/j.1756-8765.2009.01023.x","article-title":"Joint action: neurocognitive mechanisms supporting human interaction","volume":"1","author":"H Bekkering","year":"2009","journal-title":"Top Cogn Sci"},{"issue":"5","key":"pcbi.1011948.ref007","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1111\/j.1467-9280.2006.01712.x","article-title":"Haptically linked dyads: are two motor-control systems better than one?","volume":"17","author":"K Reed","year":"2006","journal-title":"Psychol Sci"},{"key":"pcbi.1011948.ref008","doi-asserted-by":"crossref","first-page":"3824","DOI":"10.1038\/srep03824","article-title":"Two is better than one: physical interactions improve motor performance in humans","volume":"4","author":"G Ganesh","year":"2014","journal-title":"Sci Rep"},{"issue":"8","key":"pcbi.1011948.ref009","doi-asserted-by":"crossref","first-page":"e1000468","DOI":"10.1371\/journal.pcbi.1000468","article-title":"Nash equilibria in multi-agent motor interactions","volume":"5","author":"DA Braun","year":"2009","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"pcbi.1011948.ref010","doi-asserted-by":"crossref","first-page":"0054","DOI":"10.1038\/s41562-017-0054","article-title":"Physically interacting individuals estimate the partner\u2019s goal to enhance their movements","volume":"1","author":"A Takagi","year":"2017","journal-title":"Nature Human Behaviour"},{"issue":"12","key":"pcbi.1011948.ref011","doi-asserted-by":"crossref","first-page":"e1006385","DOI":"10.1371\/journal.pcbi.1006385","article-title":"Incomplete information about the partner affects the development of collaborative strategies in joint action","volume":"15","author":"VT Chackochan","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"6805","key":"pcbi.1011948.ref012","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1038\/35037588","article-title":"Learning of action through adaptive combination of motor primitives","volume":"407","author":"KA Thoroughman","year":"2000","journal-title":"Nature"},{"issue":"2","key":"pcbi.1011948.ref013","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1152\/jn.2001.86.2.971","article-title":"Learning to move amid uncertainty","volume":"86","author":"RA Scheidt","year":"2001","journal-title":"J Neurophysiol"},{"issue":"3","key":"pcbi.1011948.ref014","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/s00221-006-0391-0","article-title":"Dissociable effects of the implicit and explicit memory systems on learning control of reaching","volume":"173","author":"EJ Hwang","year":"2006","journal-title":"Exp Brain Res"},{"issue":"6","key":"pcbi.1011948.ref015","doi-asserted-by":"crossref","first-page":"e179","DOI":"10.1371\/journal.pbio.0040179","article-title":"Interacting adaptive processes with different timescales underlie short-term motor learning","volume":"4","author":"MA Smith","year":"2006","journal-title":"PLoS Biol"},{"issue":"5","key":"pcbi.1011948.ref016","doi-asserted-by":"crossref","first-page":"2809","DOI":"10.1152\/jn.00943.2004","article-title":"Intact ability to learn internal models of arm dynamics in Huntington\u2019s disease but not cerebellar degeneration","volume":"93","author":"MA Smith","year":"2005","journal-title":"J Neurophysiol"},{"issue":"3","key":"pcbi.1011948.ref017","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1177\/1352458507085068","article-title":"Abnormal sensorimotor control, but intact force field adaptation, in multiple sclerosis subjects with no clinical disability","volume":"14","author":"M Casadio","year":"2008","journal-title":"Mult Scler"},{"issue":"3","key":"pcbi.1011948.ref018","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/TNSRE.2012.2190827","article-title":"Learning, retention, and slacking: a model of the dynamics of recovery in robot therapy","volume":"20","author":"M Casadio","year":"2012","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"key":"pcbi.1011948.ref019","article-title":"Game theory and partner representation in joint action: toward a computational theory of joint agency","author":"C De Vicariis","year":"2022","journal-title":"Phenomenology and the Cognitive Sciences"},{"issue":"5232","key":"pcbi.1011948.ref020","doi-asserted-by":"crossref","first-page":"1880","DOI":"10.1126\/science.7569931","article-title":"An internal model for sensorimotor integration","volume":"269","author":"DM Wolpert","year":"1995","journal-title":"Science"},{"issue":"6971","key":"pcbi.1011948.ref021","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1038\/nature02169","article-title":"Bayesian integration in sensorimotor learning","volume":"427","author":"KP K\u00f6rding","year":"2004","journal-title":"Nature"},{"issue":"3-4","key":"pcbi.1011948.ref022","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1007\/s00221-011-2642-y","article-title":"Motor coordination: when two have to act as one","volume":"211","author":"DA Braun","year":"2011","journal-title":"Exp Brain Res"},{"issue":"2","key":"pcbi.1011948.ref023","doi-asserted-by":"crossref","first-page":"286","DOI":"10.2307\/1969529","article-title":"Non-Cooperative Games","volume":"54","author":"J Nash","year":"1951","journal-title":"Annals of Mathematics"},{"issue":"87","key":"pcbi.1011948.ref024","doi-asserted-by":"crossref","first-page":"20130554","DOI":"10.1098\/rsif.2013.0554","article-title":"The effect of model uncertainty on cooperation in sensorimotor interactions","volume":"10","author":"J Grau-Moya","year":"2013","journal-title":"J R Soc Interface"},{"issue":"1","key":"pcbi.1011948.ref025","doi-asserted-by":"crossref","first-page":"20779","DOI":"10.1038\/s41598-021-99428-0","article-title":"Nash equilibria in human sensorimotor interactions explained by Q-learning with intrinsic costs","volume":"11","author":"C Lindig-Le\u00f3n","year":"2021","journal-title":"Sci Rep"},{"issue":"1","key":"pcbi.1011948.ref026","first-page":"374","article-title":"Iterative solution of games by fictitious play","volume":"13","author":"GW Brown","year":"1951","journal-title":"Act Anal Prod Allocation"},{"volume-title":"The theory of learning in games","year":"1998","author":"D Fudenberg","key":"pcbi.1011948.ref027"},{"issue":"11","key":"pcbi.1011948.ref028","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1038\/nn963","article-title":"Optimal feedback control as a theory of motor coordination","volume":"5","author":"E Todorov","year":"2002","journal-title":"Nat Neurosci"},{"key":"pcbi.1011948.ref029","volume-title":"Dynamic noncooperative game theory","author":"T Ba\u015far","year":"1999","edition":"2"},{"issue":"9","key":"pcbi.1011948.ref030","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1038\/nn1309","article-title":"Optimality principles in sensorimotor control","volume":"7","author":"E Todorov","year":"2004","journal-title":"Nat Neurosci"},{"issue":"1","key":"pcbi.1011948.ref031","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1006\/game.1995.1023","article-title":"Quantal response equilibria for normal form games","volume":"10","author":"RD McKelvey","year":"1995","journal-title":"Games and economic behavior"},{"issue":"12","key":"pcbi.1011948.ref032","doi-asserted-by":"crossref","first-page":"e1000254","DOI":"10.1371\/journal.pcbi.1000254","article-title":"Game theory of mind","volume":"4","author":"W Yoshida","year":"2008","journal-title":"PLoS Comput Biol"},{"issue":"6","key":"pcbi.1011948.ref033","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1023\/A:1020639132471","article-title":"On Adaptive Emergence of Trust Behavior in the Game of Stag Hunt","volume":"11","author":"C Fang","year":"2002","journal-title":"Group Decision and Negotiation"},{"key":"pcbi.1011948.ref034","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.future.2018.05.053","article-title":"Stag hunt and trust emergence in social networks","volume":"88","author":"L Zhou","year":"2018","journal-title":"Future Generation Computer Systems"},{"issue":"5","key":"pcbi.1011948.ref035","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.3758\/s13423-017-1393-6","article-title":"Predictive joint-action model: A hierarchical predictive approach to human cooperation","volume":"25","author":"A Pesquita","year":"2018","journal-title":"Psychon Bull Rev"},{"issue":"1-3","key":"pcbi.1011948.ref036","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.jphysparis.2006.10.001","article-title":"A free energy principle for the brain","volume":"100","author":"K Friston","year":"2006","journal-title":"J Physiol Paris"},{"key":"pcbi.1011948.ref037","doi-asserted-by":"crossref","first-page":"2421","DOI":"10.3389\/fpsyg.2018.02421","article-title":"A Predictive Processing Model of Perception and Action for Self-Other Distinction","volume":"9","author":"S Kahl","year":"2018","journal-title":"Front Psychol"},{"key":"pcbi.1011948.ref038","article-title":"An Active-Inference Approach to Second-Person Neuroscience","author":"K Lehmann","year":"2023","journal-title":"Perspect Psychol Sci"},{"key":"pcbi.1011948.ref039","doi-asserted-by":"crossref","unstructured":"Heins C, Millidge B, da Costa L, Mann R, Friston K, Couzin I. Collective behavior from surprise minimization. arXiv. 2023;2307.14804.","DOI":"10.1073\/pnas.2320239121"},{"issue":"8-9","key":"pcbi.1011948.ref040","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/s00422-012-0512-8","article-title":"Active inference and agency: optimal control without cost functions","volume":"106","author":"K Friston","year":"2012","journal-title":"Biol Cybern"},{"issue":"3","key":"pcbi.1011948.ref041","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1016\/S0014-2921(98)00011-7","article-title":"Learning in games","volume":"42","author":"D Fudenberg","year":"1998","journal-title":"European Economic Review"},{"issue":"5","key":"pcbi.1011948.ref042","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1038\/s43588-021-00069-0","article-title":"A probabilistic graphical model foundation for enabling predictive digital twins at scale","volume":"1","author":"MG Kapteyn","year":"2021","journal-title":"Nature Computational Science"},{"issue":"1","key":"pcbi.1011948.ref043","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0028-3932(71)90067-4","article-title":"The assessment and analysis of handedness: the Edinburgh inventory","volume":"9","author":"RC Oldfield","year":"1971","journal-title":"Neuropsychologia"}],"updated-by":[{"updated":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T00:00:00Z","timestamp":1730419200000},"DOI":"10.1371\/journal.pcbi.1011948","type":"new_version","source":"publisher","label":"New version"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T17:36:25Z","timestamp":1730482585000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011948"}},"subtitle":[],"editor":[{"given":"Lusha","family":"Zhu","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,10,22]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10,22]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011948","relation":{},"ISSN":["1553-7358"],"issn-type":[{"type":"electronic","value":"1553-7358"}],"subject":[],"published":{"date-parts":[[2024,10,22]]}}}