Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map
Anomalous human trajectory detection is a critical task in security surveillance in working areas. To identify anomalous human trajectories, understanding features of their movement plays an important role. Therefore, in this work, a Transformer encoder and self-organizing map-based model called TEN...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10325466/ |
| _version_ | 1797321069547225088 |
|---|---|
| author | Doi Thi Lan Seokhoon Yoon |
| author_facet | Doi Thi Lan Seokhoon Yoon |
| author_sort | Doi Thi Lan |
| collection | DOAJ |
| description | Anomalous human trajectory detection is a critical task in security surveillance in working areas. To identify anomalous human trajectories, understanding features of their movement plays an important role. Therefore, in this work, a Transformer encoder and self-organizing map-based model called TENSO is proposed to learn trajectory characteristics for detecting anomalies. In particular, the proposed model learns the internal characteristics of normal trajectories and clusters of normal trajectory representations in a latent space. To learn the internal characteristics of normal trajectories, the encoder of Transformer with a self-attention mechanism first encodes trajectories into sequences of embedding vectors of trajectory points in the latent space. Then, a decoder reconstructs the trajectories from the latent space. In addition, to learn clusters of normal trajectory representations in the latent space, the self-organizing map (SOM) layer is used, which gets its input as the output of the Transformer encoder. In the training phase, the TENSO model is trained using a total loss of trajectory reconstruction and SOM losses. In the anomaly detection phase, a test trajectory is evaluated to determine whether it is an anomaly based on trajectory reconstruction errors and the quantization error on the SOM. In this phase, a new metric is proposed which, namely WS, is the weighted sum of recall and precision to choose the appropriate threshold for detecting anomalies. The TENSO model-based framework is evaluated using two real trajectory datasets: MIT Badge and sCREEN. Experimental results show that the proposed framework identifies anomalies effectively and outperforms the baselines. |
| first_indexed | 2024-03-08T04:52:13Z |
| format | Article |
| id | doaj.art-0257d567bf174313aeedc3cc953e98b9 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T04:52:13Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-0257d567bf174313aeedc3cc953e98b92024-02-08T00:01:28ZengIEEEIEEE Access2169-35362023-01-011113184813186510.1109/ACCESS.2023.333566510325466Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing MapDoi Thi Lan0https://orcid.org/0000-0001-6250-2987Seokhoon Yoon1https://orcid.org/0000-0003-1384-3405Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan, South KoreaDepartment of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan, South KoreaAnomalous human trajectory detection is a critical task in security surveillance in working areas. To identify anomalous human trajectories, understanding features of their movement plays an important role. Therefore, in this work, a Transformer encoder and self-organizing map-based model called TENSO is proposed to learn trajectory characteristics for detecting anomalies. In particular, the proposed model learns the internal characteristics of normal trajectories and clusters of normal trajectory representations in a latent space. To learn the internal characteristics of normal trajectories, the encoder of Transformer with a self-attention mechanism first encodes trajectories into sequences of embedding vectors of trajectory points in the latent space. Then, a decoder reconstructs the trajectories from the latent space. In addition, to learn clusters of normal trajectory representations in the latent space, the self-organizing map (SOM) layer is used, which gets its input as the output of the Transformer encoder. In the training phase, the TENSO model is trained using a total loss of trajectory reconstruction and SOM losses. In the anomaly detection phase, a test trajectory is evaluated to determine whether it is an anomaly based on trajectory reconstruction errors and the quantization error on the SOM. In this phase, a new metric is proposed which, namely WS, is the weighted sum of recall and precision to choose the appropriate threshold for detecting anomalies. The TENSO model-based framework is evaluated using two real trajectory datasets: MIT Badge and sCREEN. Experimental results show that the proposed framework identifies anomalies effectively and outperforms the baselines.https://ieeexplore.ieee.org/document/10325466/Anomalous trajectory detectionindoor human trajectorytransformer encoderself-organizing map |
| spellingShingle | Doi Thi Lan Seokhoon Yoon Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map IEEE Access Anomalous trajectory detection indoor human trajectory transformer encoder self-organizing map |
| title | Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map |
| title_full | Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map |
| title_fullStr | Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map |
| title_full_unstemmed | Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map |
| title_short | Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map |
| title_sort | anomalous indoor human trajectory detection based on the transformer encoder and self organizing map |
| topic | Anomalous trajectory detection indoor human trajectory transformer encoder self-organizing map |
| url | https://ieeexplore.ieee.org/document/10325466/ |
| work_keys_str_mv | AT doithilan anomalousindoorhumantrajectorydetectionbasedonthetransformerencoderandselforganizingmap AT seokhoonyoon anomalousindoorhumantrajectorydetectionbasedonthetransformerencoderandselforganizingmap |