Interactive Touch for Manipulation
Towards helping people in daily life, robots need to better interact with our physical world and inevitably make contact with various objects. Touch provides contact geometry and forces information during interactions, which can be challenging to observe from vision due to occlusions or inherent lim...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2023
|
| Online Access: | https://hdl.handle.net/1721.1/147267 https://orcid.org/ 0000-0003-0853-7649 |
| _version_ | 1826215247683256320 |
|---|---|
| author | Wang, Shaoxiong |
| author2 | Adelson, Edward H. |
| author_facet | Adelson, Edward H. Wang, Shaoxiong |
| author_sort | Wang, Shaoxiong |
| collection | MIT |
| description | Towards helping people in daily life, robots need to better interact with our physical world and inevitably make contact with various objects. Touch provides contact geometry and forces information during interactions, which can be challenging to observe from vision due to occlusions or inherent limitations.
This thesis will focus on how to let robots leverage touch for manipulation in interactive means. We demonstrate several hardware platforms equipped with tactile sensing and integrated perception and control frameworks to apply interactive touch to real-world manipulation tasks. (1) We use touch for manipulating deformable objects like cables, using real-time tactile feedback during sliding. The robot can slide and pull the cable into different directions based on the tactile feedback to prevent falling. (2) We perform tactile exploration for learning the physical features of unknown objects. The extracted physical features are further applied to predict the forward model and swing up the in-hand object to a target pose by dynamic motions. (3) We embed tactile sensing with active rollers and design a 6-DoF roller grasper for better in-hand tactile dexterity. We demonstrate that the tactile-enabled roller grasper can robustly perform manipulation tasks for various objects, such as planar object reorientation, rolling along cables with tension, picking and singulating thin objects, etc. We hope applying interactive touch for manipulation can lead us closer to intelligent robot automation and the transformation of our physical world. |
| first_indexed | 2024-09-23T16:20:08Z |
| format | Thesis |
| id | mit-1721.1/147267 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T16:20:08Z |
| publishDate | 2023 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1472672023-01-20T03:03:54Z Interactive Touch for Manipulation Wang, Shaoxiong Adelson, Edward H. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Towards helping people in daily life, robots need to better interact with our physical world and inevitably make contact with various objects. Touch provides contact geometry and forces information during interactions, which can be challenging to observe from vision due to occlusions or inherent limitations. This thesis will focus on how to let robots leverage touch for manipulation in interactive means. We demonstrate several hardware platforms equipped with tactile sensing and integrated perception and control frameworks to apply interactive touch to real-world manipulation tasks. (1) We use touch for manipulating deformable objects like cables, using real-time tactile feedback during sliding. The robot can slide and pull the cable into different directions based on the tactile feedback to prevent falling. (2) We perform tactile exploration for learning the physical features of unknown objects. The extracted physical features are further applied to predict the forward model and swing up the in-hand object to a target pose by dynamic motions. (3) We embed tactile sensing with active rollers and design a 6-DoF roller grasper for better in-hand tactile dexterity. We demonstrate that the tactile-enabled roller grasper can robustly perform manipulation tasks for various objects, such as planar object reorientation, rolling along cables with tension, picking and singulating thin objects, etc. We hope applying interactive touch for manipulation can lead us closer to intelligent robot automation and the transformation of our physical world. Ph.D. 2023-01-19T18:41:35Z 2023-01-19T18:41:35Z 2022-09 2022-10-19T19:10:41.656Z Thesis https://hdl.handle.net/1721.1/147267 https://orcid.org/ 0000-0003-0853-7649 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Wang, Shaoxiong Interactive Touch for Manipulation |
| title | Interactive Touch for Manipulation |
| title_full | Interactive Touch for Manipulation |
| title_fullStr | Interactive Touch for Manipulation |
| title_full_unstemmed | Interactive Touch for Manipulation |
| title_short | Interactive Touch for Manipulation |
| title_sort | interactive touch for manipulation |
| url | https://hdl.handle.net/1721.1/147267 https://orcid.org/ 0000-0003-0853-7649 |
| work_keys_str_mv | AT wangshaoxiong interactivetouchformanipulation |