System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors

The pose determination between nanosatellites and the cooperative spacecraft is essential for swarm in-orbit services. Time-of–flight (ToF) sensors are one of the most promising sensors to achieve the tasks. This paper presented an end-to-end assessment of how these sensors were used for pose estima...

Full description

Bibliographic Details
Main Authors: Wenshan Zhu, Jinzhen Mu, Changbao Shao, Jiaqian Hu, Beichao Wang, Zhongkai Wen, Fei Han, Shuang Li
Format: Article
Language:English
Published: American Association for the Advancement of Science (AAAS) 2022-01-01
Series:Space: Science & Technology
Online Access:http://dx.doi.org/10.34133/2022/9763198
_version_ 1798035540058046464
author Wenshan Zhu
Jinzhen Mu
Changbao Shao
Jiaqian Hu
Beichao Wang
Zhongkai Wen
Fei Han
Shuang Li
author_facet Wenshan Zhu
Jinzhen Mu
Changbao Shao
Jiaqian Hu
Beichao Wang
Zhongkai Wen
Fei Han
Shuang Li
author_sort Wenshan Zhu
collection DOAJ
description The pose determination between nanosatellites and the cooperative spacecraft is essential for swarm in-orbit services. Time-of–flight (ToF) sensors are one of the most promising sensors to achieve the tasks. This paper presented an end-to-end assessment of how these sensors were used for pose estimation. First, an embedded system was designed based on the ToF camera with lasers as a driven light source. Gray and depth images were collected to detect and match the cooperative spacecraft in real time, obtaining the pose information. A threshold-based segmentation was proposed to find a small set of the pixels belonging to reflector markers. Only operating on the defined active pixel set reduced computational resources. Then, morphological detection combined with an edge following-based ellipse detection extracted the centroid coordinate of the circular marker, while the center-of-heart rate was calculated as the recognition condition. Next, the marker matching was completed using a deterministic annealing algorithm, obtaining two sets of 3D coordinates. A singular value decomposition (SVD) algorithm estimated the relative pose between the nanosatellite and the spacecraft. In the experiments, the pose calculated by the TOF camera reached an accuracy of 0.13 degrees and 2 mm. It accurately identified the markers and determined the pose, verifying the feasibility of the ToF camera for rendezvous and docking.
first_indexed 2024-04-11T20:59:36Z
format Article
id doaj.art-db6d0db3319647cc9d901e4a5a0c3a5b
institution Directory Open Access Journal
issn 2692-7659
language English
last_indexed 2024-04-11T20:59:36Z
publishDate 2022-01-01
publisher American Association for the Advancement of Science (AAAS)
record_format Article
series Space: Science & Technology
spelling doaj.art-db6d0db3319647cc9d901e4a5a0c3a5b2022-12-22T04:03:33ZengAmerican Association for the Advancement of Science (AAAS)Space: Science & Technology2692-76592022-01-01202210.34133/2022/9763198System Design for Pose Determination of Spacecraft Using Time-of-Flight SensorsWenshan Zhu0Jinzhen Mu1Changbao Shao2Jiaqian Hu3Beichao Wang4Zhongkai Wen5Fei Han6Shuang Li7Advanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; Shanghai Key Laboratory of Space Intelligent Control Technology, Shanghai 201109, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; Shanghai Key Laboratory of Space Intelligent Control Technology, Shanghai 201109, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaShanghai Key Laboratory of Space Intelligent Control Technology, Shanghai 201109, ChinaAdvanced Space Technology Laboratory, College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, ChinaThe pose determination between nanosatellites and the cooperative spacecraft is essential for swarm in-orbit services. Time-of–flight (ToF) sensors are one of the most promising sensors to achieve the tasks. This paper presented an end-to-end assessment of how these sensors were used for pose estimation. First, an embedded system was designed based on the ToF camera with lasers as a driven light source. Gray and depth images were collected to detect and match the cooperative spacecraft in real time, obtaining the pose information. A threshold-based segmentation was proposed to find a small set of the pixels belonging to reflector markers. Only operating on the defined active pixel set reduced computational resources. Then, morphological detection combined with an edge following-based ellipse detection extracted the centroid coordinate of the circular marker, while the center-of-heart rate was calculated as the recognition condition. Next, the marker matching was completed using a deterministic annealing algorithm, obtaining two sets of 3D coordinates. A singular value decomposition (SVD) algorithm estimated the relative pose between the nanosatellite and the spacecraft. In the experiments, the pose calculated by the TOF camera reached an accuracy of 0.13 degrees and 2 mm. It accurately identified the markers and determined the pose, verifying the feasibility of the ToF camera for rendezvous and docking.http://dx.doi.org/10.34133/2022/9763198
spellingShingle Wenshan Zhu
Jinzhen Mu
Changbao Shao
Jiaqian Hu
Beichao Wang
Zhongkai Wen
Fei Han
Shuang Li
System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
Space: Science & Technology
title System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
title_full System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
title_fullStr System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
title_full_unstemmed System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
title_short System Design for Pose Determination of Spacecraft Using Time-of-Flight Sensors
title_sort system design for pose determination of spacecraft using time of flight sensors
url http://dx.doi.org/10.34133/2022/9763198
work_keys_str_mv AT wenshanzhu systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT jinzhenmu systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT changbaoshao systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT jiaqianhu systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT beichaowang systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT zhongkaiwen systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT feihan systemdesignforposedeterminationofspacecraftusingtimeofflightsensors
AT shuangli systemdesignforposedeterminationofspacecraftusingtimeofflightsensors