Detecting Maritime Obstacles Using Camera Images

Aqua farms will be the most frequently encountered obstacle when autonomous ships sail along the coastal area of Korea. We used YOLOv5 to create a model that detects aquaculture buoys. The distances between the buoys and the camera were calculated based on monocular and stereo vision using the detec...

Full description

Bibliographic Details
Main Authors: Byung-Sun Kang, Chang-Hyun Jung
Format: Article
Language:English
Published: MDPI AG 2022-10-01
Series:Journal of Marine Science and Engineering
Subjects:
Online Access:https://www.mdpi.com/2077-1312/10/10/1528
_version_ 1827649571160850432
author Byung-Sun Kang
Chang-Hyun Jung
author_facet Byung-Sun Kang
Chang-Hyun Jung
author_sort Byung-Sun Kang
collection DOAJ
description Aqua farms will be the most frequently encountered obstacle when autonomous ships sail along the coastal area of Korea. We used YOLOv5 to create a model that detects aquaculture buoys. The distances between the buoys and the camera were calculated based on monocular and stereo vision using the detected image coordinates and compared with those from a laser distance sensor and radar. A dataset containing 2700 images of aquaculture buoys was divided between training and testing data in the ratio of 8:2. The trained model had precision, recall, and mAP of 0.936%, 0.903%, and 94.3%, respectively. Monocular vision calculates the distance based on camera position estimation and water surface coordinates of maritime objects, while stereo vision calculates the distance by finding corresponding points using SSD, NCC, and ORB and then calculating the disparity. The stereo vision had small error rates of −3.16% and −14.81% for short (NCC) and long distances (ORB); however, large errors were detected for objects located at a far distance. Monocular vision had error rates of 2.86% and −4.00% for short and long distances, respectively. Monocular vision is more effective than stereo vision for detecting maritime obstacles and can be employed as auxiliary sailing equipment along with radar.
first_indexed 2024-03-09T20:00:35Z
format Article
id doaj.art-0a95e3f7bc0140028ee795af82cb2ec6
institution Directory Open Access Journal
issn 2077-1312
language English
last_indexed 2024-03-09T20:00:35Z
publishDate 2022-10-01
publisher MDPI AG
record_format Article
series Journal of Marine Science and Engineering
spelling doaj.art-0a95e3f7bc0140028ee795af82cb2ec62023-11-24T00:45:36ZengMDPI AGJournal of Marine Science and Engineering2077-13122022-10-011010152810.3390/jmse10101528Detecting Maritime Obstacles Using Camera ImagesByung-Sun Kang0Chang-Hyun Jung1Department of Maritime Transportation System, Mokpo National Maritime University, Mokpo 58628, KoreaDivision of Navigation Science, Mokpo National Maritime University, Mokpo 58628, KoreaAqua farms will be the most frequently encountered obstacle when autonomous ships sail along the coastal area of Korea. We used YOLOv5 to create a model that detects aquaculture buoys. The distances between the buoys and the camera were calculated based on monocular and stereo vision using the detected image coordinates and compared with those from a laser distance sensor and radar. A dataset containing 2700 images of aquaculture buoys was divided between training and testing data in the ratio of 8:2. The trained model had precision, recall, and mAP of 0.936%, 0.903%, and 94.3%, respectively. Monocular vision calculates the distance based on camera position estimation and water surface coordinates of maritime objects, while stereo vision calculates the distance by finding corresponding points using SSD, NCC, and ORB and then calculating the disparity. The stereo vision had small error rates of −3.16% and −14.81% for short (NCC) and long distances (ORB); however, large errors were detected for objects located at a far distance. Monocular vision had error rates of 2.86% and −4.00% for short and long distances, respectively. Monocular vision is more effective than stereo vision for detecting maritime obstacles and can be employed as auxiliary sailing equipment along with radar.https://www.mdpi.com/2077-1312/10/10/1528autonomous shipobject detectionYOLOv5monocular visionstereo vision
spellingShingle Byung-Sun Kang
Chang-Hyun Jung
Detecting Maritime Obstacles Using Camera Images
Journal of Marine Science and Engineering
autonomous ship
object detection
YOLOv5
monocular vision
stereo vision
title Detecting Maritime Obstacles Using Camera Images
title_full Detecting Maritime Obstacles Using Camera Images
title_fullStr Detecting Maritime Obstacles Using Camera Images
title_full_unstemmed Detecting Maritime Obstacles Using Camera Images
title_short Detecting Maritime Obstacles Using Camera Images
title_sort detecting maritime obstacles using camera images
topic autonomous ship
object detection
YOLOv5
monocular vision
stereo vision
url https://www.mdpi.com/2077-1312/10/10/1528
work_keys_str_mv AT byungsunkang detectingmaritimeobstaclesusingcameraimages
AT changhyunjung detectingmaritimeobstaclesusingcameraimages