Robust object pose estimation with point clouds from vision and touch
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2017
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/111867 |
| _version_ | 1811090363163607040 |
|---|---|
| author | Izatt, Gregory (Gregory Russell) |
| author2 | Russ Tedrake. |
| author_facet | Russ Tedrake. Izatt, Gregory (Gregory Russell) |
| author_sort | Izatt, Gregory (Gregory Russell) |
| collection | MIT |
| description | Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. |
| first_indexed | 2024-09-23T14:44:23Z |
| format | Thesis |
| id | mit-1721.1/111867 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:44:23Z |
| publishDate | 2017 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1118672019-04-12T11:16:53Z Robust object pose estimation with point clouds from vision and touch Izatt, Gregory (Gregory Russell) Russ Tedrake. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 75-81). We present a study of object pose estimation performed with hybrid visuo-tactile sensing in mind. We propose that a tactile sensor can be treated as a source of dense local geometric information, and hence consider it to be a point cloud source analogous to an RGB-D camera. We incorporate the tactile geometric information directly into a conventional point-cloud-based articulated object tracker based on signed-distance functions. This tracker runs at 12 Hz using an online depth reconstruction algorithm for the GelSight tactile sensor and a modified second-order update for the tracking algorithm. The tracker provides robust pose estimates of small objects throughout manipulation, even when the objects are occluded by the robot's end effector. To address limitations in this tracker, we additionally present a formulation of the underlying point-cloud correspondence problem as a mixed-integer convex program, which we efficiently solve to optimality with an off-the-shelf branch and bound solver. We show that reasoning about object pose estimation in this way allows natural extension to point-to-mesh correspondence, multiple object estimation, and outlier rejection without losing the ability to obtain a globally optimal solution. We probe the extent to which rich problem-specific formulations typically tackled with unreliable nonlinear optimization can be rigorously treated in a global optimization framework. by Gregory Izatt. S.M. 2017-10-18T14:42:52Z 2017-10-18T14:42:52Z 2017 2017 Thesis http://hdl.handle.net/1721.1/111867 1005701037 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 81 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Izatt, Gregory (Gregory Russell) Robust object pose estimation with point clouds from vision and touch |
| title | Robust object pose estimation with point clouds from vision and touch |
| title_full | Robust object pose estimation with point clouds from vision and touch |
| title_fullStr | Robust object pose estimation with point clouds from vision and touch |
| title_full_unstemmed | Robust object pose estimation with point clouds from vision and touch |
| title_short | Robust object pose estimation with point clouds from vision and touch |
| title_sort | robust object pose estimation with point clouds from vision and touch |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/111867 |
| work_keys_str_mv | AT izattgregorygregoryrussell robustobjectposeestimationwithpointcloudsfromvisionandtouch |