Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI
<jats:p>Across a wide variety of domains, artificial agents that can adapt and personalize to users have potential to improve and transform how social services are provided. Because of the need for personalized interaction data to drive this process, long-term (or longitudinal) interactions be...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media SA
2021
|
| Online Access: | https://hdl.handle.net/1721.1/135433 |
| _version_ | 1811084135511359488 |
|---|---|
| author | Spaulding, Samuel Shen, Jocelyn Park, Hae Won Breazeal, Cynthia |
| author_facet | Spaulding, Samuel Shen, Jocelyn Park, Hae Won Breazeal, Cynthia |
| author_sort | Spaulding, Samuel |
| collection | MIT |
| description | <jats:p>Across a wide variety of domains, artificial agents that can adapt and personalize to users have potential to improve and transform how social services are provided. Because of the need for personalized interaction data to drive this process, long-term (or longitudinal) interactions between users and agents, which unfold over a series of distinct interaction sessions, have attracted substantial research interest. In recognition of the expanded scope and structure of a long-term interaction, researchers are also adjusting the personalization models and algorithms used, orienting toward “continual learning” methods, which do not assume a stationary modeling target and explicitly account for the temporal context of training data. In parallel, researchers have also studied the effect of “multitask personalization,” an approach in which an agent interacts with users over multiple different tasks contexts throughout the course of a long-term interaction and learns personalized models of a user that are <jats:italic>transferrable</jats:italic> across these tasks. In this paper, we unite these two paradigms under the framework of “Lifelong Personalization,” analyzing the effect of multitask personalization applied to dynamic, non-stationary targets. We extend the multi-task personalization approach to the more complex and realistic scenario of modeling dynamic learners over time, focusing in particular on interactive scenarios in which the modeling agent plays an active role in teaching the student whose knowledge the agent is simultaneously attempting to model. Inspired by the way in which agents use active learning to select new training data based on domain context, we augment a Gaussian Process-based multitask personalization model with a mechanism to actively and continually manage its own training data, allowing a modeling agent to remove or reduce the weight of observed data from its training set, based on interactive context cues. We evaluate this method in a series of simulation experiments comparing different approaches to continual and multitask learning on simulated student data. We expect this method to substantially improve learning in Gaussian Process models in dynamic domains, establishing Gaussian Processes as another flexible modeling tool for Long-term Human-Robot Interaction (HRI) Studies.</jats:p> |
| first_indexed | 2024-09-23T12:45:29Z |
| format | Article |
| id | mit-1721.1/135433 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T12:45:29Z |
| publishDate | 2021 |
| publisher | Frontiers Media SA |
| record_format | dspace |
| spelling | mit-1721.1/1354332021-10-28T04:01:00Z Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI Spaulding, Samuel Shen, Jocelyn Park, Hae Won Breazeal, Cynthia <jats:p>Across a wide variety of domains, artificial agents that can adapt and personalize to users have potential to improve and transform how social services are provided. Because of the need for personalized interaction data to drive this process, long-term (or longitudinal) interactions between users and agents, which unfold over a series of distinct interaction sessions, have attracted substantial research interest. In recognition of the expanded scope and structure of a long-term interaction, researchers are also adjusting the personalization models and algorithms used, orienting toward “continual learning” methods, which do not assume a stationary modeling target and explicitly account for the temporal context of training data. In parallel, researchers have also studied the effect of “multitask personalization,” an approach in which an agent interacts with users over multiple different tasks contexts throughout the course of a long-term interaction and learns personalized models of a user that are <jats:italic>transferrable</jats:italic> across these tasks. In this paper, we unite these two paradigms under the framework of “Lifelong Personalization,” analyzing the effect of multitask personalization applied to dynamic, non-stationary targets. We extend the multi-task personalization approach to the more complex and realistic scenario of modeling dynamic learners over time, focusing in particular on interactive scenarios in which the modeling agent plays an active role in teaching the student whose knowledge the agent is simultaneously attempting to model. Inspired by the way in which agents use active learning to select new training data based on domain context, we augment a Gaussian Process-based multitask personalization model with a mechanism to actively and continually manage its own training data, allowing a modeling agent to remove or reduce the weight of observed data from its training set, based on interactive context cues. We evaluate this method in a series of simulation experiments comparing different approaches to continual and multitask learning on simulated student data. We expect this method to substantially improve learning in Gaussian Process models in dynamic domains, establishing Gaussian Processes as another flexible modeling tool for Long-term Human-Robot Interaction (HRI) Studies.</jats:p> 2021-10-27T20:23:27Z 2021-10-27T20:23:27Z 2021 2021-07-15T13:18:45Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/135433 en 10.3389/frobt.2021.683066 Frontiers in Robotics and AI Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf Frontiers Media SA Frontiers |
| spellingShingle | Spaulding, Samuel Shen, Jocelyn Park, Hae Won Breazeal, Cynthia Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title | Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title_full | Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title_fullStr | Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title_full_unstemmed | Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title_short | Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI |
| title_sort | lifelong personalization via gaussian process modeling for long term hri |
| url | https://hdl.handle.net/1721.1/135433 |
| work_keys_str_mv | AT spauldingsamuel lifelongpersonalizationviagaussianprocessmodelingforlongtermhri AT shenjocelyn lifelongpersonalizationviagaussianprocessmodelingforlongtermhri AT parkhaewon lifelongpersonalizationviagaussianprocessmodelingforlongtermhri AT breazealcynthia lifelongpersonalizationviagaussianprocessmodelingforlongtermhri |