Tactile-Based Insertion for Dense Box-Packing

We study the problem of using high-resolution tactile sensors to control the insertion of objects in a box-packing scenario. In this paper, we propose an insertion strategy that leverages tactile sensing to: 1) safely probe the box with the grasped object while monitoring incipient slip to maintain...

Full description

Bibliographic Details
Main Authors: Dong, Siyuan, Rodriguez, Alberto
Other Authors: Massachusetts Institute of Technology. Department of Mechanical Engineering
Format: Article
Language:English
Published: IEEE 2021
Online Access:https://hdl.handle.net/1721.1/129786
_version_ 1811085008583000064
author Dong, Siyuan
Rodriguez, Alberto
author2 Massachusetts Institute of Technology. Department of Mechanical Engineering
author_facet Massachusetts Institute of Technology. Department of Mechanical Engineering
Dong, Siyuan
Rodriguez, Alberto
author_sort Dong, Siyuan
collection MIT
description We study the problem of using high-resolution tactile sensors to control the insertion of objects in a box-packing scenario. In this paper, we propose an insertion strategy that leverages tactile sensing to: 1) safely probe the box with the grasped object while monitoring incipient slip to maintain a stable grasp on the object. 2) estimate and correct for residual position uncertainties to insert the object into a designated gap without disturbing the environment. Our proposed methodology is based on two neural networks that estimate the error direction and error magnitude, from a stream of tactile imprints, acquired by two GelSlim fingers, during the insertion process. The system is trained on four objects with basic geometric shapes, which we show generalizes to four other common objects. Based on the estimated positional errors, a heuristic controller iteratively adjusts the position of the object and eventually inserts it successfully without requiring prior knowledge of the geometry of the object. The key insight is that dense tactile feedback contains useful information with respect to the contact interaction between the grasped object and its environment. We achieve high success rate and show that unknown objects can be inserted with an average of 6 attempts of the probe-correct loop. The method's ability to generalize to novel objects makes it a good fit for box packing in warehouse automation.
first_indexed 2024-09-23T13:01:31Z
format Article
id mit-1721.1/129786
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T13:01:31Z
publishDate 2021
publisher IEEE
record_format dspace
spelling mit-1721.1/1297862024-02-13T21:02:42Z Tactile-Based Insertion for Dense Box-Packing Dong, Siyuan Rodriguez, Alberto Massachusetts Institute of Technology. Department of Mechanical Engineering We study the problem of using high-resolution tactile sensors to control the insertion of objects in a box-packing scenario. In this paper, we propose an insertion strategy that leverages tactile sensing to: 1) safely probe the box with the grasped object while monitoring incipient slip to maintain a stable grasp on the object. 2) estimate and correct for residual position uncertainties to insert the object into a designated gap without disturbing the environment. Our proposed methodology is based on two neural networks that estimate the error direction and error magnitude, from a stream of tactile imprints, acquired by two GelSlim fingers, during the insertion process. The system is trained on four objects with basic geometric shapes, which we show generalizes to four other common objects. Based on the estimated positional errors, a heuristic controller iteratively adjusts the position of the object and eventually inserts it successfully without requiring prior knowledge of the geometry of the object. The key insight is that dense tactile feedback contains useful information with respect to the contact interaction between the grasped object and its environment. We achieve high success rate and show that unknown objects can be inserted with an average of 6 attempts of the probe-correct loop. The method's ability to generalize to novel objects makes it a good fit for box packing in warehouse automation. 2021-02-17T16:22:47Z 2021-02-17T16:22:47Z 2019-11 2019-09 2020-08-03T17:20:00Z Article http://purl.org/eprint/type/ConferencePaper 9781728140049 https://hdl.handle.net/1721.1/129786 Dong, Siyuan and Alberto Rodriguez "Tactile-based insertion for dense box-packing." IEEE Proceedings of the International Conference on Intelligent Robots and Systems, Macau, China, (November 2019). International Conference on Intelligent Robots and Systems, 2019 © 2019 IEEE. en 10.1109/IROS40897.2019.8968204 IEEE Proceedings of the International Conference on Intelligent Robots and Systems Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf IEEE arXiv
spellingShingle Dong, Siyuan
Rodriguez, Alberto
Tactile-Based Insertion for Dense Box-Packing
title Tactile-Based Insertion for Dense Box-Packing
title_full Tactile-Based Insertion for Dense Box-Packing
title_fullStr Tactile-Based Insertion for Dense Box-Packing
title_full_unstemmed Tactile-Based Insertion for Dense Box-Packing
title_short Tactile-Based Insertion for Dense Box-Packing
title_sort tactile based insertion for dense box packing
url https://hdl.handle.net/1721.1/129786
work_keys_str_mv AT dongsiyuan tactilebasedinsertionfordenseboxpacking
AT rodriguezalberto tactilebasedinsertionfordenseboxpacking