Vision-Based Jigsaw Puzzle Solving with a Robotic Arm
This study proposed two algorithms for reconstructing jigsaw puzzles by using a color compatibility feature. Two realistic application cases were examined: one involved using the original image, while the other did not. We also calculated the transformation matrix to obtain the real positions of eac...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/15/6913 |
| _version_ | 1797585976792449024 |
|---|---|
| author | Chang-Hsian Ma Chien-Liang Lu Huang-Chia Shih |
| author_facet | Chang-Hsian Ma Chien-Liang Lu Huang-Chia Shih |
| author_sort | Chang-Hsian Ma |
| collection | DOAJ |
| description | This study proposed two algorithms for reconstructing jigsaw puzzles by using a color compatibility feature. Two realistic application cases were examined: one involved using the original image, while the other did not. We also calculated the transformation matrix to obtain the real positions of each puzzle piece and transmitted the positional information to the robotic arm, which then put each puzzle piece in its correct position. The algorithms were tested on 35-piece and 70-piece puzzles, achieving an average success rate of 87.1%. Compared with the human visual system, the proposed methods demonstrated enhanced accuracy when handling more complex textural images. |
| first_indexed | 2024-03-11T00:16:38Z |
| format | Article |
| id | doaj.art-93264adfc18449789161a83cb2fcd40a |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T00:16:38Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-93264adfc18449789161a83cb2fcd40a2023-11-18T23:36:06ZengMDPI AGSensors1424-82202023-08-012315691310.3390/s23156913Vision-Based Jigsaw Puzzle Solving with a Robotic ArmChang-Hsian Ma0Chien-Liang Lu1Huang-Chia Shih2Department of Electrical Engineering, Yuan Ze University, Taoyuan 32003, TaiwanDepartment of Electrical Engineering, Yuan Ze University, Taoyuan 32003, TaiwanDepartment of Electrical Engineering, Yuan Ze University, Taoyuan 32003, TaiwanThis study proposed two algorithms for reconstructing jigsaw puzzles by using a color compatibility feature. Two realistic application cases were examined: one involved using the original image, while the other did not. We also calculated the transformation matrix to obtain the real positions of each puzzle piece and transmitted the positional information to the robotic arm, which then put each puzzle piece in its correct position. The algorithms were tested on 35-piece and 70-piece puzzles, achieving an average success rate of 87.1%. Compared with the human visual system, the proposed methods demonstrated enhanced accuracy when handling more complex textural images.https://www.mdpi.com/1424-8220/23/15/6913edge similarityHausdorff distancepatch reconstructionpuzzle solvingrobotic armtemplate matching |
| spellingShingle | Chang-Hsian Ma Chien-Liang Lu Huang-Chia Shih Vision-Based Jigsaw Puzzle Solving with a Robotic Arm Sensors edge similarity Hausdorff distance patch reconstruction puzzle solving robotic arm template matching |
| title | Vision-Based Jigsaw Puzzle Solving with a Robotic Arm |
| title_full | Vision-Based Jigsaw Puzzle Solving with a Robotic Arm |
| title_fullStr | Vision-Based Jigsaw Puzzle Solving with a Robotic Arm |
| title_full_unstemmed | Vision-Based Jigsaw Puzzle Solving with a Robotic Arm |
| title_short | Vision-Based Jigsaw Puzzle Solving with a Robotic Arm |
| title_sort | vision based jigsaw puzzle solving with a robotic arm |
| topic | edge similarity Hausdorff distance patch reconstruction puzzle solving robotic arm template matching |
| url | https://www.mdpi.com/1424-8220/23/15/6913 |
| work_keys_str_mv | AT changhsianma visionbasedjigsawpuzzlesolvingwitharoboticarm AT chienlianglu visionbasedjigsawpuzzlesolvingwitharoboticarm AT huangchiashih visionbasedjigsawpuzzlesolvingwitharoboticarm |