Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins

The visibility available to an equipment operator on a dynamic construction site can often be blocked by various obstacles such as materials, temporary or permanent facilities, other equipment, and workers. Equipment monitoring in real-time digital twins can thus play a crucial role in accident prev...

Full description

Bibliographic Details
Main Authors: Sanat A. Talmaki, Vineet R. Kamat
Format: Article
Language:English
Published: MDPI AG 2022-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/19/7635
_version_ 1797476799722029056
author Sanat A. Talmaki
Vineet R. Kamat
author_facet Sanat A. Talmaki
Vineet R. Kamat
author_sort Sanat A. Talmaki
collection DOAJ
description The visibility available to an equipment operator on a dynamic construction site can often be blocked by various obstacles such as materials, temporary or permanent facilities, other equipment, and workers. Equipment monitoring in real-time digital twins can thus play a crucial role in accident prevention. This paper develops a scalable technical approach and presents a prototype application framework for transmitting real world sensor data to update 3D equipment models inside a graphical digital twin for concurrent visualization of a monitored construction operation. The developed framework and workflow can be extended to visualize any construction operation, as it occurs, inside a dynamic 3D world simply by outfitting the real equipment with appropriate sensors and connecting them to their virtual counterparts. The implemented proof-of-concept interface is described in the context of a real-time 3D digital twin for assisting excavator operators prevent unintended strikes with underground utilities. Experiments to validate the proposed technical approach by simulating the real-time motion of a backhoe loader’s articulated arm using orientation sensors installed on its boom, stick, and bucket are described. The experimental results characterize the scope and potential reasons for spatio-temporal discrepancies that can occur between a monitored real operation and its replicated digital twin. The effect of an operator warning mechanism based on preset safety thresholds is also investigated and described.
first_indexed 2024-03-09T21:08:50Z
format Article
id doaj.art-139ccdf734d349bfb27d5ab1914c5325
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T21:08:50Z
publishDate 2022-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-139ccdf734d349bfb27d5ab1914c53252023-11-23T21:52:22ZengMDPI AGSensors1424-82202022-10-012219763510.3390/s22197635Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital TwinsSanat A. Talmaki0Vineet R. Kamat1Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI 48109-2125, USADepartment of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI 48109-2125, USAThe visibility available to an equipment operator on a dynamic construction site can often be blocked by various obstacles such as materials, temporary or permanent facilities, other equipment, and workers. Equipment monitoring in real-time digital twins can thus play a crucial role in accident prevention. This paper develops a scalable technical approach and presents a prototype application framework for transmitting real world sensor data to update 3D equipment models inside a graphical digital twin for concurrent visualization of a monitored construction operation. The developed framework and workflow can be extended to visualize any construction operation, as it occurs, inside a dynamic 3D world simply by outfitting the real equipment with appropriate sensors and connecting them to their virtual counterparts. The implemented proof-of-concept interface is described in the context of a real-time 3D digital twin for assisting excavator operators prevent unintended strikes with underground utilities. Experiments to validate the proposed technical approach by simulating the real-time motion of a backhoe loader’s articulated arm using orientation sensors installed on its boom, stick, and bucket are described. The experimental results characterize the scope and potential reasons for spatio-temporal discrepancies that can occur between a monitored real operation and its replicated digital twin. The effect of an operator warning mechanism based on preset safety thresholds is also investigated and described.https://www.mdpi.com/1424-8220/22/19/7635digital twinmonitoringvisualizationearthmovingexcavation safety
spellingShingle Sanat A. Talmaki
Vineet R. Kamat
Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
Sensors
digital twin
monitoring
visualization
earthmoving
excavation safety
title Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
title_full Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
title_fullStr Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
title_full_unstemmed Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
title_short Sensor Acquisition and Allocation for Real-Time Monitoring of Articulated Construction Equipment in Digital Twins
title_sort sensor acquisition and allocation for real time monitoring of articulated construction equipment in digital twins
topic digital twin
monitoring
visualization
earthmoving
excavation safety
url https://www.mdpi.com/1424-8220/22/19/7635
work_keys_str_mv AT sanatatalmaki sensoracquisitionandallocationforrealtimemonitoringofarticulatedconstructionequipmentindigitaltwins
AT vineetrkamat sensoracquisitionandallocationforrealtimemonitoringofarticulatedconstructionequipmentindigitaltwins