Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions

Self-driving cars, i.e., fully automated cars, will spread in the upcoming two decades, according to the representatives of automotive industries; owing to technological breakthroughs in the fourth industrial revolution, as the introduction of deep learning has completely changed the concept of auto...

Full description

Bibliographic Details
Main Authors: Mohammad Junaid, Zsolt Szalay, Árpád Török
Format: Article
Language:English
Published: MDPI AG 2021-11-01
Series:Energies
Subjects:
Online Access:https://www.mdpi.com/1996-1073/14/21/7172
_version_ 1797512607624593408
author Mohammad Junaid
Zsolt Szalay
Árpád Török
author_facet Mohammad Junaid
Zsolt Szalay
Árpád Török
author_sort Mohammad Junaid
collection DOAJ
description Self-driving cars, i.e., fully automated cars, will spread in the upcoming two decades, according to the representatives of automotive industries; owing to technological breakthroughs in the fourth industrial revolution, as the introduction of deep learning has completely changed the concept of automation. There is considerable research being conducted regarding object detection systems, for instance, lane, pedestrian, or signal detection. This paper specifically focuses on pedestrian detection while the car is moving on the road, where speed and environmental conditions affect visibility. To explore the environmental conditions, a pedestrian custom dataset based on Common Object in Context (COCO) is used. The images are manipulated with the inverse gamma correction method, in which pixel values are changed to make a sequence of bright and dark images. The gamma correction method is directly related to luminance intensity. This paper presents a flexible, simple detection system called Mask R-CNN, which works on top of the Faster R-CNN (Region Based Convolutional Neural Network) model. Mask R-CNN uses one extra feature instance segmentation in addition to two available features in the Faster R-CNN, called object recognition. The performance of the Mask R-CNN models is checked by using different Convolutional Neural Network (CNN) models as a backbone. This approach might help future work, especially when dealing with different lighting conditions.
first_indexed 2024-03-10T06:04:10Z
format Article
id doaj.art-f1f9e9c877b7479cb9d8fb39972ec0c9
institution Directory Open Access Journal
issn 1996-1073
language English
last_indexed 2024-03-10T06:04:10Z
publishDate 2021-11-01
publisher MDPI AG
record_format Article
series Energies
spelling doaj.art-f1f9e9c877b7479cb9d8fb39972ec0c92023-11-22T20:44:41ZengMDPI AGEnergies1996-10732021-11-011421717210.3390/en14217172Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance ConditionsMohammad Junaid0Zsolt Szalay1Árpád Török2Faculty of Transportation Engineering and Vehicle Engineering, Budapest University of Technology and Economics, Sztoczek Str. 6, J. Building, V. Floor, 1111 Budapest, HungaryFaculty of Transportation Engineering and Vehicle Engineering, Budapest University of Technology and Economics, Sztoczek Str. 6, J. Building, V. Floor, 1111 Budapest, HungaryFaculty of Transportation Engineering and Vehicle Engineering, Budapest University of Technology and Economics, Sztoczek Str. 6, J. Building, V. Floor, 1111 Budapest, HungarySelf-driving cars, i.e., fully automated cars, will spread in the upcoming two decades, according to the representatives of automotive industries; owing to technological breakthroughs in the fourth industrial revolution, as the introduction of deep learning has completely changed the concept of automation. There is considerable research being conducted regarding object detection systems, for instance, lane, pedestrian, or signal detection. This paper specifically focuses on pedestrian detection while the car is moving on the road, where speed and environmental conditions affect visibility. To explore the environmental conditions, a pedestrian custom dataset based on Common Object in Context (COCO) is used. The images are manipulated with the inverse gamma correction method, in which pixel values are changed to make a sequence of bright and dark images. The gamma correction method is directly related to luminance intensity. This paper presents a flexible, simple detection system called Mask R-CNN, which works on top of the Faster R-CNN (Region Based Convolutional Neural Network) model. Mask R-CNN uses one extra feature instance segmentation in addition to two available features in the Faster R-CNN, called object recognition. The performance of the Mask R-CNN models is checked by using different Convolutional Neural Network (CNN) models as a backbone. This approach might help future work, especially when dealing with different lighting conditions.https://www.mdpi.com/1996-1073/14/21/7172Mask R-CNNtransfer learninginverse gamma correctionilluminationinstance segmentationpedestrian custom dataset
spellingShingle Mohammad Junaid
Zsolt Szalay
Árpád Török
Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
Energies
Mask R-CNN
transfer learning
inverse gamma correction
illumination
instance segmentation
pedestrian custom dataset
title Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
title_full Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
title_fullStr Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
title_full_unstemmed Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
title_short Evaluation of Non-Classical Decision-Making Methods in Self Driving Cars: Pedestrian Detection Testing on Cluster of Images with Different Luminance Conditions
title_sort evaluation of non classical decision making methods in self driving cars pedestrian detection testing on cluster of images with different luminance conditions
topic Mask R-CNN
transfer learning
inverse gamma correction
illumination
instance segmentation
pedestrian custom dataset
url https://www.mdpi.com/1996-1073/14/21/7172
work_keys_str_mv AT mohammadjunaid evaluationofnonclassicaldecisionmakingmethodsinselfdrivingcarspedestriandetectiontestingonclusterofimageswithdifferentluminanceconditions
AT zsoltszalay evaluationofnonclassicaldecisionmakingmethodsinselfdrivingcarspedestriandetectiontestingonclusterofimageswithdifferentluminanceconditions
AT arpadtorok evaluationofnonclassicaldecisionmakingmethodsinselfdrivingcarspedestriandetectiontestingonclusterofimageswithdifferentluminanceconditions