Incorporating Rich Social Interactions Into MDPs
Much of what we do as humans is engage socially with other agents, a skill that robots must also eventually possess. We demonstrate that a rich theory of social interactions originating from microso- ciology and economics can be formalized by extending a nested MDP where agents reason about arbitrar...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Published: |
Center for Brains, Minds and Machines (CBMM), International Conference on Robotics and Automation (ICRA)
2022
|
| Online Access: | https://hdl.handle.net/1721.1/141363 |
| _version_ | 1811089442954280960 |
|---|---|
| author | Tejwani, Ravi Kuo, Yen-Ling Shu, Tianmin Stankovits, Bennett Gutfreund, Dan Tenenbaum, Joshua B. Katz, Boris Barbu, Andrei |
| author_facet | Tejwani, Ravi Kuo, Yen-Ling Shu, Tianmin Stankovits, Bennett Gutfreund, Dan Tenenbaum, Joshua B. Katz, Boris Barbu, Andrei |
| author_sort | Tejwani, Ravi |
| collection | MIT |
| description | Much of what we do as humans is engage socially with other agents, a skill that robots must also eventually possess. We demonstrate that a rich theory of social interactions originating from microso- ciology and economics can be formalized by extending a nested MDP where agents reason about arbitrary functions of each other’s hidden rewards. This extended Social MDP allows us to encode the five basic interactions that underlie microsociology: cooperation, conflict, coercion, competition, and exchange. The result is a robotic agent capable of executing social interactions zero-shot in new environments; like humans it can engage socially in novel ways even without a single example of that social interaction. Moreover, the judgments of these Social MDPs align closely with those of humans when considering which social interaction is taking place in an environment. This method both sheds light on the nature of social interactions, by providing concrete mathematical definitions, and brings rich social interactions into a mathematical framework that has proven to be natural for robotics, MDPs. |
| first_indexed | 2024-09-23T14:19:15Z |
| format | Article |
| id | mit-1721.1/141363 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T14:19:15Z |
| publishDate | 2022 |
| publisher | Center for Brains, Minds and Machines (CBMM), International Conference on Robotics and Automation (ICRA) |
| record_format | dspace |
| spelling | mit-1721.1/1413632022-03-25T03:12:32Z Incorporating Rich Social Interactions Into MDPs Tejwani, Ravi Kuo, Yen-Ling Shu, Tianmin Stankovits, Bennett Gutfreund, Dan Tenenbaum, Joshua B. Katz, Boris Barbu, Andrei Much of what we do as humans is engage socially with other agents, a skill that robots must also eventually possess. We demonstrate that a rich theory of social interactions originating from microso- ciology and economics can be formalized by extending a nested MDP where agents reason about arbitrary functions of each other’s hidden rewards. This extended Social MDP allows us to encode the five basic interactions that underlie microsociology: cooperation, conflict, coercion, competition, and exchange. The result is a robotic agent capable of executing social interactions zero-shot in new environments; like humans it can engage socially in novel ways even without a single example of that social interaction. Moreover, the judgments of these Social MDPs align closely with those of humans when considering which social interaction is taking place in an environment. This method both sheds light on the nature of social interactions, by providing concrete mathematical definitions, and brings rich social interactions into a mathematical framework that has proven to be natural for robotics, MDPs. This work was supported by the Center for Brains, Minds and Machines (CBMM), funded by NSF STC award CCF – 1231216. 2022-03-24T17:27:15Z 2022-03-24T17:27:15Z 2022-02-07 Article Technical Report Working Paper https://hdl.handle.net/1721.1/141363 CBMM Memo;133 application/pdf Center for Brains, Minds and Machines (CBMM), International Conference on Robotics and Automation (ICRA) |
| spellingShingle | Tejwani, Ravi Kuo, Yen-Ling Shu, Tianmin Stankovits, Bennett Gutfreund, Dan Tenenbaum, Joshua B. Katz, Boris Barbu, Andrei Incorporating Rich Social Interactions Into MDPs |
| title | Incorporating Rich Social Interactions Into MDPs |
| title_full | Incorporating Rich Social Interactions Into MDPs |
| title_fullStr | Incorporating Rich Social Interactions Into MDPs |
| title_full_unstemmed | Incorporating Rich Social Interactions Into MDPs |
| title_short | Incorporating Rich Social Interactions Into MDPs |
| title_sort | incorporating rich social interactions into mdps |
| url | https://hdl.handle.net/1721.1/141363 |
| work_keys_str_mv | AT tejwaniravi incorporatingrichsocialinteractionsintomdps AT kuoyenling incorporatingrichsocialinteractionsintomdps AT shutianmin incorporatingrichsocialinteractionsintomdps AT stankovitsbennett incorporatingrichsocialinteractionsintomdps AT gutfreunddan incorporatingrichsocialinteractionsintomdps AT tenenbaumjoshuab incorporatingrichsocialinteractionsintomdps AT katzboris incorporatingrichsocialinteractionsintomdps AT barbuandrei incorporatingrichsocialinteractionsintomdps |