Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task
Although recent advances in robotics enable the automation of manual tasks in manufacturing, integrating robots into a factory remains time and resource intensive, as it requires conventional robot programming and robot experts. In order to increase the feasibility of robot integration into industri...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/144770 |
| _version_ | 1826201765297520640 |
|---|---|
| author | Illandara, Thavishi |
| author2 | Shah, Julie A. |
| author_facet | Shah, Julie A. Illandara, Thavishi |
| author_sort | Illandara, Thavishi |
| collection | MIT |
| description | Although recent advances in robotics enable the automation of manual tasks in manufacturing, integrating robots into a factory remains time and resource intensive, as it requires conventional robot programming and robot experts. In order to increase the feasibility of robot integration into industrial processes, the programming of robots must be easily accessible to domain experts with little to no experience in robotics. In this thesis, we present Active Keyframe Learning (AKL) for learning the task specification as an ordered sequence of keyframes to capture the physical interactions and geometric constraints from a single demonstration of a task given by a nonexpert. We learn the least restrictive task specification that maximizes the flexibility given to a motion planner by learning the human intent for demonstrated constrained motion online and performing interaction-based and constraint-based segmentation offline. We conduct a user study to evaluate the keyframe, pose, constraint accuracies, workload, and teaching efficiency of AKL against two state-of-the-art techniques in keyframe and constraint learning and demonstrate the significant benefits of utilizing AKL to teach tasks to robots. |
| first_indexed | 2024-09-23T11:56:44Z |
| format | Thesis |
| id | mit-1721.1/144770 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T11:56:44Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1447702022-08-30T03:37:38Z Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task Illandara, Thavishi Shah, Julie A. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Although recent advances in robotics enable the automation of manual tasks in manufacturing, integrating robots into a factory remains time and resource intensive, as it requires conventional robot programming and robot experts. In order to increase the feasibility of robot integration into industrial processes, the programming of robots must be easily accessible to domain experts with little to no experience in robotics. In this thesis, we present Active Keyframe Learning (AKL) for learning the task specification as an ordered sequence of keyframes to capture the physical interactions and geometric constraints from a single demonstration of a task given by a nonexpert. We learn the least restrictive task specification that maximizes the flexibility given to a motion planner by learning the human intent for demonstrated constrained motion online and performing interaction-based and constraint-based segmentation offline. We conduct a user study to evaluate the keyframe, pose, constraint accuracies, workload, and teaching efficiency of AKL against two state-of-the-art techniques in keyframe and constraint learning and demonstrate the significant benefits of utilizing AKL to teach tasks to robots. S.M. 2022-08-29T16:10:32Z 2022-08-29T16:10:32Z 2022-05 2022-06-21T19:25:49.184Z Thesis https://hdl.handle.net/1721.1/144770 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Illandara, Thavishi Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title | Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title_full | Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title_fullStr | Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title_full_unstemmed | Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title_short | Active Keyframe Learning (AKL): Learning Interaction and Constraint Keyframes from a Single Demonstration of a Task |
| title_sort | active keyframe learning akl learning interaction and constraint keyframes from a single demonstration of a task |
| url | https://hdl.handle.net/1721.1/144770 |
| work_keys_str_mv | AT illandarathavishi activekeyframelearningakllearninginteractionandconstraintkeyframesfromasingledemonstrationofatask |