Effective Teamwork Using a Theory of Mind Over Plans
When agents execute a task, their minds focus on the plans, that is, what plans lead to the successful completion of the task, and what plans they are executing with the rest of the team. When there is no guarantee that agents have common knowledge of the task and can observe each other's actio...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2024
|
| Online Access: | https://hdl.handle.net/1721.1/153887 |
| _version_ | 1826207949912014848 |
|---|---|
| author | Zhang, Yuening |
| author2 | Williams, Brian C. |
| author_facet | Williams, Brian C. Zhang, Yuening |
| author_sort | Zhang, Yuening |
| collection | MIT |
| description | When agents execute a task, their minds focus on the plans, that is, what plans lead to the successful completion of the task, and what plans they are executing with the rest of the team. When there is no guarantee that agents have common knowledge of the task and can observe each other's actions, agents' beliefs about plans can often be incorrect or misaligned, causing them to make uninformed choices of actions that lead to task failure. My research investigates how an agent can be effective within a team, where an agent may be a teammate or a coach.
Previous work has proposed agents that achieve effective coordination by reasoning about a shared flexible plan, assuming common knowledge and full observability of actions, or by reasoning about each other's beliefs about states when those assumptions do not apply. I claim that to be effective in teamwork, agents must reason about the beliefs of their teammates about plans. By recognizing when misconceptions and misalignment in their beliefs about plans might lead to failure and aligning their beliefs as necessary, agents can ensure execution success while minimizing the need for communication.
This thesis provides: (1) A novel modeling framework based on dynamic epistemic logic to represent agents' nested beliefs about plans. This complements existing frameworks that focus on beliefs about states, so that agents can explicitly communicate about plans during coordination. (2) EPike, a computational model for an agent teammate that collaborates with others to execute a task, assuming that agents can observe each other's actions. By planning its actions online in a receding-horizon fashion using an MCTS algorithm, EPike dynamically adapts its actions to its teammates and communicates to align their beliefs. (3) TARS, a computational model for a team coordinator that monitors the team and intervenes when needed to ensure the team's success, when agents may not observe all the actions. By framing the intervention problem as a CC-POMDP, TARS maintains a probabilistic belief about the team's mental state, and only intervenes when the team's risk of failure exceeds a specified threshold. I show the effectiveness of EPike and TARS both in the empirical evaluation and in a VirtualHome simulation testbed. |
| first_indexed | 2024-09-23T13:57:30Z |
| format | Thesis |
| id | mit-1721.1/153887 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T13:57:30Z |
| publishDate | 2024 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1538872024-03-22T03:30:51Z Effective Teamwork Using a Theory of Mind Over Plans Zhang, Yuening Williams, Brian C. Kaelbling, Leslie P. Sussman, Gerald J. Robertson, Paul Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science When agents execute a task, their minds focus on the plans, that is, what plans lead to the successful completion of the task, and what plans they are executing with the rest of the team. When there is no guarantee that agents have common knowledge of the task and can observe each other's actions, agents' beliefs about plans can often be incorrect or misaligned, causing them to make uninformed choices of actions that lead to task failure. My research investigates how an agent can be effective within a team, where an agent may be a teammate or a coach. Previous work has proposed agents that achieve effective coordination by reasoning about a shared flexible plan, assuming common knowledge and full observability of actions, or by reasoning about each other's beliefs about states when those assumptions do not apply. I claim that to be effective in teamwork, agents must reason about the beliefs of their teammates about plans. By recognizing when misconceptions and misalignment in their beliefs about plans might lead to failure and aligning their beliefs as necessary, agents can ensure execution success while minimizing the need for communication. This thesis provides: (1) A novel modeling framework based on dynamic epistemic logic to represent agents' nested beliefs about plans. This complements existing frameworks that focus on beliefs about states, so that agents can explicitly communicate about plans during coordination. (2) EPike, a computational model for an agent teammate that collaborates with others to execute a task, assuming that agents can observe each other's actions. By planning its actions online in a receding-horizon fashion using an MCTS algorithm, EPike dynamically adapts its actions to its teammates and communicates to align their beliefs. (3) TARS, a computational model for a team coordinator that monitors the team and intervenes when needed to ensure the team's success, when agents may not observe all the actions. By framing the intervention problem as a CC-POMDP, TARS maintains a probabilistic belief about the team's mental state, and only intervenes when the team's risk of failure exceeds a specified threshold. I show the effectiveness of EPike and TARS both in the empirical evaluation and in a VirtualHome simulation testbed. Ph.D. 2024-03-21T19:13:43Z 2024-03-21T19:13:43Z 2024-02 2024-02-21T17:19:22.059Z Thesis https://hdl.handle.net/1721.1/153887 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Zhang, Yuening Effective Teamwork Using a Theory of Mind Over Plans |
| title | Effective Teamwork Using a Theory of Mind Over Plans |
| title_full | Effective Teamwork Using a Theory of Mind Over Plans |
| title_fullStr | Effective Teamwork Using a Theory of Mind Over Plans |
| title_full_unstemmed | Effective Teamwork Using a Theory of Mind Over Plans |
| title_short | Effective Teamwork Using a Theory of Mind Over Plans |
| title_sort | effective teamwork using a theory of mind over plans |
| url | https://hdl.handle.net/1721.1/153887 |
| work_keys_str_mv | AT zhangyuening effectiveteamworkusingatheoryofmindoverplans |