Scene-Aware Deep Networks for Semantic Segmentation of Images

Scene classification and semantic segmentation are two important research directions in computer vision. They are widely used in the research of automatic driving and human-computer interaction. The purpose of the scene classification is to use the image classification to determine the category of t...

Full description

Bibliographic Details
Main Authors: Zhike Yi, Tao Chang, Shuai Li, Ruijun Liu, Jing Zhang, Aimin Hao
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8721677/
_version_ 1819169305936265216
author Zhike Yi
Tao Chang
Shuai Li
Ruijun Liu
Jing Zhang
Aimin Hao
author_facet Zhike Yi
Tao Chang
Shuai Li
Ruijun Liu
Jing Zhang
Aimin Hao
author_sort Zhike Yi
collection DOAJ
description Scene classification and semantic segmentation are two important research directions in computer vision. They are widely used in the research of automatic driving and human-computer interaction. The purpose of the scene classification is to use the image classification to determine the category of the scene in an image by analyzing the background and the target object, while semantic segmentation aims to classify the image at the pixel level and mark the position and semantic information of the scene unit. In this paper, we aimed to train the semantic segmentation neural network in different scenarios to obtain the models with the same number of scene categories, which they are used to process the images. During the process of the actual test, the semantic segmentation dataset was firstly divided into three categories based on the scene classification algorithm. Then the semantic segmentation neural network is trained under three scenarios, and three semantic segmentation network models are obtained accordingly. To test the property of our methods, the semantic segmentation models we got were selected to treat other pictures, and the results obtained from the performance of scene-aware semantic segmentation were much better than semantic segmentation without considering categories. Our study provided an essential improvement of semantic segmentation by adding category information into consideration, which will be helpful to obtain more precise models for further picture analysis.
first_indexed 2024-12-22T19:17:24Z
format Article
id doaj.art-3c554ca16091482f9a4de920a410d521
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-22T19:17:24Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-3c554ca16091482f9a4de920a410d5212022-12-21T18:15:29ZengIEEEIEEE Access2169-35362019-01-017691846919310.1109/ACCESS.2019.29187008721677Scene-Aware Deep Networks for Semantic Segmentation of ImagesZhike Yi0https://orcid.org/0000-0002-2831-375XTao Chang1Shuai Li2Ruijun Liu3Jing Zhang4Aimin Hao5State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, ChinaBeijing Key Laboratory of Big Data Technology for Food Safety, Beijing Technology and Business University, Beijing, ChinaCollege of Software, Beihang University, Beijing, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, ChinaScene classification and semantic segmentation are two important research directions in computer vision. They are widely used in the research of automatic driving and human-computer interaction. The purpose of the scene classification is to use the image classification to determine the category of the scene in an image by analyzing the background and the target object, while semantic segmentation aims to classify the image at the pixel level and mark the position and semantic information of the scene unit. In this paper, we aimed to train the semantic segmentation neural network in different scenarios to obtain the models with the same number of scene categories, which they are used to process the images. During the process of the actual test, the semantic segmentation dataset was firstly divided into three categories based on the scene classification algorithm. Then the semantic segmentation neural network is trained under three scenarios, and three semantic segmentation network models are obtained accordingly. To test the property of our methods, the semantic segmentation models we got were selected to treat other pictures, and the results obtained from the performance of scene-aware semantic segmentation were much better than semantic segmentation without considering categories. Our study provided an essential improvement of semantic segmentation by adding category information into consideration, which will be helpful to obtain more precise models for further picture analysis.https://ieeexplore.ieee.org/document/8721677/Semantic segmentationscene classificationconvolutional neural network
spellingShingle Zhike Yi
Tao Chang
Shuai Li
Ruijun Liu
Jing Zhang
Aimin Hao
Scene-Aware Deep Networks for Semantic Segmentation of Images
IEEE Access
Semantic segmentation
scene classification
convolutional neural network
title Scene-Aware Deep Networks for Semantic Segmentation of Images
title_full Scene-Aware Deep Networks for Semantic Segmentation of Images
title_fullStr Scene-Aware Deep Networks for Semantic Segmentation of Images
title_full_unstemmed Scene-Aware Deep Networks for Semantic Segmentation of Images
title_short Scene-Aware Deep Networks for Semantic Segmentation of Images
title_sort scene aware deep networks for semantic segmentation of images
topic Semantic segmentation
scene classification
convolutional neural network
url https://ieeexplore.ieee.org/document/8721677/
work_keys_str_mv AT zhikeyi sceneawaredeepnetworksforsemanticsegmentationofimages
AT taochang sceneawaredeepnetworksforsemanticsegmentationofimages
AT shuaili sceneawaredeepnetworksforsemanticsegmentationofimages
AT ruijunliu sceneawaredeepnetworksforsemanticsegmentationofimages
AT jingzhang sceneawaredeepnetworksforsemanticsegmentationofimages
AT aiminhao sceneawaredeepnetworksforsemanticsegmentationofimages