Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development
Learning how to move is one of the most fundamental milestones humans achieve during their development, through complex interactions between neural control, biomechanics, and the environment. However, not every human learns to locomote the same way: babies exhibit remarkable variance in the stages t...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2024
|
| Online Access: | https://hdl.handle.net/1721.1/155896 |
| _version_ | 1811094084255744000 |
|---|---|
| author | Patel, Nikasha G. |
| author2 | Seethapathi, Nidhi |
| author_facet | Seethapathi, Nidhi Patel, Nikasha G. |
| author_sort | Patel, Nikasha G. |
| collection | MIT |
| description | Learning how to move is one of the most fundamental milestones humans achieve during their development, through complex interactions between neural control, biomechanics, and the environment. However, not every human learns to locomote the same way: babies exhibit remarkable variance in the stages they undergo before crawling and walking. While there exist years of empirical research quantifying and qualifying developmental stages in infant locomotion, we lack a computational model to understand how variations during the developmental stages affect overall crawling and walking behavior, thereby allowing us to test hypotheses in simulation. In order to better understand how infants learn to move, a testable model of infant locomotion would complement experimental studies allowing for model-guided interpretations of observed phenomena. This thesis work fulfills the gap in research by introducing Baby Gym, a library for probing emerged behavior through reinforcement learning (RL) on an infant-like agent with the capacity to crawl and walk, compatible with both the OpenAI Gymnasium and DM Control APIs. Baby Gym will serve as a first step in enabling a cross-disciplinary open-source ecosystem of computational models to understand infant motor development.
The work consists of the following: an extensive literature review that justifies the foundations for a baby RL environment; a Python-based infrastructure for cross-compatibility between Gymnasium and DM Control; a reproducible RL environment with several new reward functions that yield human-like locomotor development stages; and initial methods for evaluating the "human-likeness" of the emerged locomotion. |
| first_indexed | 2024-09-23T15:54:51Z |
| format | Thesis |
| id | mit-1721.1/155896 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T15:54:51Z |
| publishDate | 2024 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1558962024-08-02T03:05:43Z Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development Patel, Nikasha G. Seethapathi, Nidhi Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Learning how to move is one of the most fundamental milestones humans achieve during their development, through complex interactions between neural control, biomechanics, and the environment. However, not every human learns to locomote the same way: babies exhibit remarkable variance in the stages they undergo before crawling and walking. While there exist years of empirical research quantifying and qualifying developmental stages in infant locomotion, we lack a computational model to understand how variations during the developmental stages affect overall crawling and walking behavior, thereby allowing us to test hypotheses in simulation. In order to better understand how infants learn to move, a testable model of infant locomotion would complement experimental studies allowing for model-guided interpretations of observed phenomena. This thesis work fulfills the gap in research by introducing Baby Gym, a library for probing emerged behavior through reinforcement learning (RL) on an infant-like agent with the capacity to crawl and walk, compatible with both the OpenAI Gymnasium and DM Control APIs. Baby Gym will serve as a first step in enabling a cross-disciplinary open-source ecosystem of computational models to understand infant motor development. The work consists of the following: an extensive literature review that justifies the foundations for a baby RL environment; a Python-based infrastructure for cross-compatibility between Gymnasium and DM Control; a reproducible RL environment with several new reward functions that yield human-like locomotor development stages; and initial methods for evaluating the "human-likeness" of the emerged locomotion. M.Eng. 2024-08-01T19:05:56Z 2024-08-01T19:05:56Z 2024-02 2024-07-11T15:29:40.520Z Thesis https://hdl.handle.net/1721.1/155896 0009-0003-8196-1910 Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) Copyright retained by author(s) https://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Patel, Nikasha G. Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title | Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title_full | Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title_fullStr | Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title_full_unstemmed | Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title_short | Baby Gym: Bridging the Gap between Reinforcement Learning and Human Infant Locomotor Development |
| title_sort | baby gym bridging the gap between reinforcement learning and human infant locomotor development |
| url | https://hdl.handle.net/1721.1/155896 |
| work_keys_str_mv | AT patelnikashag babygymbridgingthegapbetweenreinforcementlearningandhumaninfantlocomotordevelopment |