A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning
Surface/shape inspection is a common and highly repetitive task in the factory production line. Using robots to automate the inspection process could help to reduce the costs and improve the productivities. In robotized surface/shape inspection application, the planning problem is to find a near-opt...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2018-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8476296/ |
| _version_ | 1818927914832363520 |
|---|---|
| author | Wei Jing Chun Fan Goh Mabaran Rajaraman Fei Gao Sooho Park Yong Liu Kenji Shimada |
| author_facet | Wei Jing Chun Fan Goh Mabaran Rajaraman Fei Gao Sooho Park Yong Liu Kenji Shimada |
| author_sort | Wei Jing |
| collection | DOAJ |
| description | Surface/shape inspection is a common and highly repetitive task in the factory production line. Using robots to automate the inspection process could help to reduce the costs and improve the productivities. In robotized surface/shape inspection application, the planning problem is to find a near-optimal sequence of robotic actions that inspect the surface areas of the target objects in a minimum cycle time, while satisfying the coverage requirement. In this paper, we propose a novel computational framework to automatically generate efficient robotic path online for surface/shape inspection application. Within the computational framework, a Markov decision process (MDP) formulation is proposed for the coverage planning problem in the industrial surface inspection with a robotic manipulator. A reinforcement learning-based search algorithm is also proposed in the computational framework to generate planning policy online with the MDP formulation of the robotic inspection problem for robotic inspection applications. Several case studies are conducted to validate the effectiveness of the proposed method. It is observed that the proposed method could automatically generate the inspection path online for different target objects to meet the coverage requirement, with the presence of pose variation of the target object. In addition, the inspection cycle time reduction is observed to be 24% on average compared to the previous approaches during these test instances. |
| first_indexed | 2024-12-20T03:20:35Z |
| format | Article |
| id | doaj.art-f08af70658f84e50ae56dba97bd9dceb |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-20T03:20:35Z |
| publishDate | 2018-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-f08af70658f84e50ae56dba97bd9dceb2022-12-21T19:55:14ZengIEEEIEEE Access2169-35362018-01-016548545486410.1109/ACCESS.2018.28726938476296A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement LearningWei Jing0https://orcid.org/0000-0003-3286-5925Chun Fan Goh1Mabaran Rajaraman2Fei Gao3Sooho Park4Yong Liu5Kenji Shimada6Department of Computing Science, Institute of High Performance Computing, SingaporeDepartment of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USADept. of Mech. Eng., Carnegie Mellon Univ., Pittsburgh, PA, USADepartment of Computing Science, Institute of High Performance Computing, SingaporeDepartment of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USADepartment of Computing Science, Institute of High Performance Computing, SingaporeDepartment of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USASurface/shape inspection is a common and highly repetitive task in the factory production line. Using robots to automate the inspection process could help to reduce the costs and improve the productivities. In robotized surface/shape inspection application, the planning problem is to find a near-optimal sequence of robotic actions that inspect the surface areas of the target objects in a minimum cycle time, while satisfying the coverage requirement. In this paper, we propose a novel computational framework to automatically generate efficient robotic path online for surface/shape inspection application. Within the computational framework, a Markov decision process (MDP) formulation is proposed for the coverage planning problem in the industrial surface inspection with a robotic manipulator. A reinforcement learning-based search algorithm is also proposed in the computational framework to generate planning policy online with the MDP formulation of the robotic inspection problem for robotic inspection applications. Several case studies are conducted to validate the effectiveness of the proposed method. It is observed that the proposed method could automatically generate the inspection path online for different target objects to meet the coverage requirement, with the presence of pose variation of the target object. In addition, the inspection cycle time reduction is observed to be 24% on average compared to the previous approaches during these test instances.https://ieeexplore.ieee.org/document/8476296/Roboticsplanningartificial intelligencereinforcement learning |
| spellingShingle | Wei Jing Chun Fan Goh Mabaran Rajaraman Fei Gao Sooho Park Yong Liu Kenji Shimada A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning IEEE Access Robotics planning artificial intelligence reinforcement learning |
| title | A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning |
| title_full | A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning |
| title_fullStr | A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning |
| title_full_unstemmed | A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning |
| title_short | A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning |
| title_sort | computational framework for automatic online path generation of robotic inspection tasks via coverage planning and reinforcement learning |
| topic | Robotics planning artificial intelligence reinforcement learning |
| url | https://ieeexplore.ieee.org/document/8476296/ |
| work_keys_str_mv | AT weijing acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT chunfangoh acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT mabaranrajaraman acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT feigao acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT soohopark acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT yongliu acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT kenjishimada acomputationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT weijing computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT chunfangoh computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT mabaranrajaraman computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT feigao computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT soohopark computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT yongliu computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning AT kenjishimada computationalframeworkforautomaticonlinepathgenerationofroboticinspectiontasksviacoverageplanningandreinforcementlearning |