Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor

This paper describes a new method for the detection of moving objects from moving camera image sequences using an inertial measurement unit (IMU) sensor. Motion detection systems with vision sensors have become a global research subject recently. However, detecting moving objects from a moving camer...

Full description

Bibliographic Details
Main Authors: Sukwoo Jung, Youngmok Cho, Doojun Kim, Minho Chang
Format: Article
Language:English
Published: MDPI AG 2019-12-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/1/268
_version_ 1818515728424239104
author Sukwoo Jung
Youngmok Cho
Doojun Kim
Minho Chang
author_facet Sukwoo Jung
Youngmok Cho
Doojun Kim
Minho Chang
author_sort Sukwoo Jung
collection DOAJ
description This paper describes a new method for the detection of moving objects from moving camera image sequences using an inertial measurement unit (IMU) sensor. Motion detection systems with vision sensors have become a global research subject recently. However, detecting moving objects from a moving camera is a difficult task because of egomotion. In the proposed method, the interesting points are extracted by a Harris detector, and the background and foreground are classified by epipolar geometry. In this procedure, an IMU sensor is used to calculate the initial fundamental matrix. After the feature point classification, a transformation matrix is obtained from matching background feature points. Image registration is then applied to the consecutive images, and a difference map is extracted to find the foreground region. Finally, a minimum bounding box is applied to mark the detected moving object. The proposed method is implemented and tested with numerous real-world driving videos, which show that it outperforms the previous work.
first_indexed 2024-12-11T00:32:41Z
format Article
id doaj.art-adf16fec90ec460fb74835dc1ad96750
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-12-11T00:32:41Z
publishDate 2019-12-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-adf16fec90ec460fb74835dc1ad967502022-12-22T01:27:17ZengMDPI AGApplied Sciences2076-34172019-12-0110126810.3390/app10010268app10010268Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit SensorSukwoo Jung0Youngmok Cho1Doojun Kim2Minho Chang3Department of Mechanical Engineering, Korea University, Seoul 02841, KoreaDepartment of Mechanical Engineering, Korea University, Seoul 02841, KoreaDepartment of Mechanical Engineering, Korea University, Seoul 02841, KoreaDepartment of Mechanical Engineering, Korea University, Seoul 02841, KoreaThis paper describes a new method for the detection of moving objects from moving camera image sequences using an inertial measurement unit (IMU) sensor. Motion detection systems with vision sensors have become a global research subject recently. However, detecting moving objects from a moving camera is a difficult task because of egomotion. In the proposed method, the interesting points are extracted by a Harris detector, and the background and foreground are classified by epipolar geometry. In this procedure, an IMU sensor is used to calculate the initial fundamental matrix. After the feature point classification, a transformation matrix is obtained from matching background feature points. Image registration is then applied to the consecutive images, and a difference map is extracted to find the foreground region. Finally, a minimum bounding box is applied to mark the detected moving object. The proposed method is implemented and tested with numerous real-world driving videos, which show that it outperforms the previous work.https://www.mdpi.com/2076-3417/10/1/268moving cameramotion estimationmoving object detectionimage processing
spellingShingle Sukwoo Jung
Youngmok Cho
Doojun Kim
Minho Chang
Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
Applied Sciences
moving camera
motion estimation
moving object detection
image processing
title Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
title_full Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
title_fullStr Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
title_full_unstemmed Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
title_short Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor
title_sort moving object detection from moving camera image sequences using an inertial measurement unit sensor
topic moving camera
motion estimation
moving object detection
image processing
url https://www.mdpi.com/2076-3417/10/1/268
work_keys_str_mv AT sukwoojung movingobjectdetectionfrommovingcameraimagesequencesusinganinertialmeasurementunitsensor
AT youngmokcho movingobjectdetectionfrommovingcameraimagesequencesusinganinertialmeasurementunitsensor
AT doojunkim movingobjectdetectionfrommovingcameraimagesequencesusinganinertialmeasurementunitsensor
AT minhochang movingobjectdetectionfrommovingcameraimagesequencesusinganinertialmeasurementunitsensor