Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction
In the field of construction, human-robot collaboration and mixed reality (MR) open new possibilities. However, safety and reliability issues persist. The lack of flexibility and adaptability in current preprogrammed systems hampers real-time human-robot collaboration. A key gap in this area lies in...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Buildings |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-5309/13/8/1965 |
| _version_ | 1827730129654120448 |
|---|---|
| author | Luis Felipe González-Böhme Eduardo Valenzuela-Astudillo |
| author_facet | Luis Felipe González-Böhme Eduardo Valenzuela-Astudillo |
| author_sort | Luis Felipe González-Böhme |
| collection | DOAJ |
| description | In the field of construction, human-robot collaboration and mixed reality (MR) open new possibilities. However, safety and reliability issues persist. The lack of flexibility and adaptability in current preprogrammed systems hampers real-time human-robot collaboration. A key gap in this area lies in the ability of the robot to interpret and accurately execute operations based on the real-time visual instructions and restrictions provided by the human collaborator and the working environment. This paper focuses on an MR-based human-robot collaboration method through visual feedback from a vision-based collaborative industrial robot system for use in wood stereotomy which we are developing. This method is applied to an alternating workflow in which a skilled carpenter lays out the joinery on the workpiece, and the robot cuts it. Cutting operations are instructed to the robot only through lines and conventional “carpenter’s marks”, which are drawn on the timbers by the carpenter. The robot system’s accuracy in locating and interpreting marks as cutting operations is evaluated by automatically constructing a 3D model of the cut shape from the vision system data. A digital twin of the robot allows the carpenter to previsualize all motions that are required by the robot for task validation and to know when to enter the collaborative workspace. Our experimental results offer some insights into human-robot communication requirements for collaborative robot system applications in timber frame construction. |
| first_indexed | 2024-03-11T00:04:51Z |
| format | Article |
| id | doaj.art-d07330fb08004fbda8ad6d6b87565294 |
| institution | Directory Open Access Journal |
| issn | 2075-5309 |
| language | English |
| last_indexed | 2024-03-11T00:04:51Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Buildings |
| spelling | doaj.art-d07330fb08004fbda8ad6d6b875652942023-11-19T00:29:06ZengMDPI AGBuildings2075-53092023-08-01138196510.3390/buildings13081965Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame ConstructionLuis Felipe González-Böhme0Eduardo Valenzuela-Astudillo1Department of Architecture, Universidad Técnica Federico Santa María, Valparaíso 2390123, ChileDepartment of Architecture, Universidad Técnica Federico Santa María, Valparaíso 2390123, ChileIn the field of construction, human-robot collaboration and mixed reality (MR) open new possibilities. However, safety and reliability issues persist. The lack of flexibility and adaptability in current preprogrammed systems hampers real-time human-robot collaboration. A key gap in this area lies in the ability of the robot to interpret and accurately execute operations based on the real-time visual instructions and restrictions provided by the human collaborator and the working environment. This paper focuses on an MR-based human-robot collaboration method through visual feedback from a vision-based collaborative industrial robot system for use in wood stereotomy which we are developing. This method is applied to an alternating workflow in which a skilled carpenter lays out the joinery on the workpiece, and the robot cuts it. Cutting operations are instructed to the robot only through lines and conventional “carpenter’s marks”, which are drawn on the timbers by the carpenter. The robot system’s accuracy in locating and interpreting marks as cutting operations is evaluated by automatically constructing a 3D model of the cut shape from the vision system data. A digital twin of the robot allows the carpenter to previsualize all motions that are required by the robot for task validation and to know when to enter the collaborative workspace. Our experimental results offer some insights into human-robot communication requirements for collaborative robot system applications in timber frame construction.https://www.mdpi.com/2075-5309/13/8/1965mixed realityhuman-robot collaborationdigital twinrobotic manufacturingdigital wood stereotomytimber frame construction |
| spellingShingle | Luis Felipe González-Böhme Eduardo Valenzuela-Astudillo Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction Buildings mixed reality human-robot collaboration digital twin robotic manufacturing digital wood stereotomy timber frame construction |
| title | Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction |
| title_full | Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction |
| title_fullStr | Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction |
| title_full_unstemmed | Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction |
| title_short | Mixed Reality for Safe and Reliable Human-Robot Collaboration in Timber Frame Construction |
| title_sort | mixed reality for safe and reliable human robot collaboration in timber frame construction |
| topic | mixed reality human-robot collaboration digital twin robotic manufacturing digital wood stereotomy timber frame construction |
| url | https://www.mdpi.com/2075-5309/13/8/1965 |
| work_keys_str_mv | AT luisfelipegonzalezbohme mixedrealityforsafeandreliablehumanrobotcollaborationintimberframeconstruction AT eduardovalenzuelaastudillo mixedrealityforsafeandreliablehumanrobotcollaborationintimberframeconstruction |