Human action recognition based on comparative similarity

Human action recognition is a key issue in computer vision. This thesis aims to solve the problem of human action recognition, especially when there are few or no positive examples. This case is very important due to the intrinsic long-tailed distribution of categories in real world, which...

Full description

Bibliographic Details
Main Author: Cao, Zhiguang
Other Authors: School of Electrical and Electronic Engineering
Format: Thesis
Language:English
Published: 2013
Subjects:
Online Access:http://hdl.handle.net/10356/54714
_version_ 1811695816648163328
author Cao, Zhiguang
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Cao, Zhiguang
author_sort Cao, Zhiguang
collection NTU
description Human action recognition is a key issue in computer vision. This thesis aims to solve the problem of human action recognition, especially when there are few or no positive examples. This case is very important due to the intrinsic long-tailed distribution of categories in real world, which means that for some categories, there are actually only few examples. It also indicates that the traditional classifiers could not work well for this situation because most of them should be trained based on sufficient positive examples for each category if they want to achieve a satisfactory accuracy rate. This thesis employs comparative similarity to tackle this problem, because human seem to manage with few or no visual examples by being told what an action is "like" and "dislike", thus a new action category could be defined in terms of existing ones. Through comparing with other actions, a better recognizing result could be obtained when there are not enough positive examples. In this thesis, human action is recognized based on videos rather than images, and to the best knowledge, it is the first time that comparative similarity are implied on video-based human action recognition. The whole experiments are performed on three popular action datasets, and two main steps are taken as follows: human action representation and classification. For a strong representation, interest points in each video are detected, described by HOGHOF feature, and then converted to visual-words to represent each video; for classification, two conventional SVM kernel machines are trained as baselines for comparison. Two other baselines related with the comparative similarity machine are also assumed. Relative results are shown in each chapter respectively. The final result indicates that when there are fair enough positive examples for each action category, they all could obtain satisfactory results. But when there are no or only a few positive examples for some categories, the classifier based on comparative similarity could achieve much higher accuracy rate than the other methods, justifying the performance of comparative similarity for case of few or no positive examples in human action recognition.
first_indexed 2024-10-01T07:29:29Z
format Thesis
id ntu-10356/54714
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:29:29Z
publishDate 2013
record_format dspace
spelling ntu-10356/547142023-07-04T15:33:28Z Human action recognition based on comparative similarity Cao, Zhiguang School of Electrical and Electronic Engineering Wang Gang DRNTU::Engineering::Electrical and electronic engineering Human action recognition is a key issue in computer vision. This thesis aims to solve the problem of human action recognition, especially when there are few or no positive examples. This case is very important due to the intrinsic long-tailed distribution of categories in real world, which means that for some categories, there are actually only few examples. It also indicates that the traditional classifiers could not work well for this situation because most of them should be trained based on sufficient positive examples for each category if they want to achieve a satisfactory accuracy rate. This thesis employs comparative similarity to tackle this problem, because human seem to manage with few or no visual examples by being told what an action is "like" and "dislike", thus a new action category could be defined in terms of existing ones. Through comparing with other actions, a better recognizing result could be obtained when there are not enough positive examples. In this thesis, human action is recognized based on videos rather than images, and to the best knowledge, it is the first time that comparative similarity are implied on video-based human action recognition. The whole experiments are performed on three popular action datasets, and two main steps are taken as follows: human action representation and classification. For a strong representation, interest points in each video are detected, described by HOGHOF feature, and then converted to visual-words to represent each video; for classification, two conventional SVM kernel machines are trained as baselines for comparison. Two other baselines related with the comparative similarity machine are also assumed. Relative results are shown in each chapter respectively. The final result indicates that when there are fair enough positive examples for each action category, they all could obtain satisfactory results. But when there are no or only a few positive examples for some categories, the classifier based on comparative similarity could achieve much higher accuracy rate than the other methods, justifying the performance of comparative similarity for case of few or no positive examples in human action recognition. Master of Science (Signal Processing) 2013-07-25T03:55:51Z 2013-07-25T03:55:51Z 2012 2012 Thesis http://hdl.handle.net/10356/54714 en 85 p. application/pdf
spellingShingle DRNTU::Engineering::Electrical and electronic engineering
Cao, Zhiguang
Human action recognition based on comparative similarity
title Human action recognition based on comparative similarity
title_full Human action recognition based on comparative similarity
title_fullStr Human action recognition based on comparative similarity
title_full_unstemmed Human action recognition based on comparative similarity
title_short Human action recognition based on comparative similarity
title_sort human action recognition based on comparative similarity
topic DRNTU::Engineering::Electrical and electronic engineering
url http://hdl.handle.net/10356/54714
work_keys_str_mv AT caozhiguang humanactionrecognitionbasedoncomparativesimilarity