Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks

Evidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA...

Full description

Bibliographic Details
Main Authors: Marcus Lim, Azween Abdullah, NZ Jhanjhi, Muhammad Khurram Khan
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8939364/
_version_ 1819275714637070336
author Marcus Lim
Azween Abdullah
NZ Jhanjhi
Muhammad Khurram Khan
author_facet Marcus Lim
Azween Abdullah
NZ Jhanjhi
Muhammad Khurram Khan
author_sort Marcus Lim
collection DOAJ
description Evidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA) tools capable of uncovering with speed, probable key hidden relationships (links/edges) and players (nodes) in order to anticipate, undermine and cripple organised crime syndicates and activities. The development of link prediction models for network orientated domains is based on Social Network Analysis (SNA) methods and models. The key objective of this research is to develop a link prediction model that incorporates a fusion of metadata (i.e. environment data sources such as arrest warrants, judicial judgement, wiretap records and police station proximity) with a time-evolving criminal dataset in order to be aware of real-world situations to improve the quality of link prediction. Based on the review of related work, most of the models are constructed by leveraging on classical machine learning (ML) techniques such as support vector machine (SVM) without metadata fusion. The problem with the use of classical ML techniques is the lack of available domain dataset which is sufficiently large for training purpose. Compared to sociaI network, criminal network dataset by nature tends to relatively much smaller. In view of this, deep reinforcement learning (DRL) technique which could improve the training of models with the self-generated dataset is leveraged upon to construct the model. In this research, a purely time-evolving DRL model (TDRL-CNA) without metadata fusion is designed as a baseline for comparison with the metadata fusion model (FDRL-CNA). The experimental results show that the predictive accuracy of new and recurrent links by the FDRL-CNA model is higher than the baseline TDRL-CNA model that does not factor data fusion from different data sources.
first_indexed 2024-12-23T23:28:43Z
format Article
id doaj.art-697b8ee2cb7547fd827bff9cf4920e50
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-23T23:28:43Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-697b8ee2cb7547fd827bff9cf4920e502022-12-21T17:26:08ZengIEEEIEEE Access2169-35362020-01-018165501655910.1109/ACCESS.2019.29618058939364Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal NetworksMarcus Lim0https://orcid.org/0000-0003-2790-3720Azween Abdullah1https://orcid.org/0000-0003-4425-8604NZ Jhanjhi2Muhammad Khurram Khan3https://orcid.org/0000-0001-6636-0533School of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaSchool of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaSchool of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaCenter of Excellence in Information Assurance, King Saud University, Riyadh, Saudi ArabiaEvidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA) tools capable of uncovering with speed, probable key hidden relationships (links/edges) and players (nodes) in order to anticipate, undermine and cripple organised crime syndicates and activities. The development of link prediction models for network orientated domains is based on Social Network Analysis (SNA) methods and models. The key objective of this research is to develop a link prediction model that incorporates a fusion of metadata (i.e. environment data sources such as arrest warrants, judicial judgement, wiretap records and police station proximity) with a time-evolving criminal dataset in order to be aware of real-world situations to improve the quality of link prediction. Based on the review of related work, most of the models are constructed by leveraging on classical machine learning (ML) techniques such as support vector machine (SVM) without metadata fusion. The problem with the use of classical ML techniques is the lack of available domain dataset which is sufficiently large for training purpose. Compared to sociaI network, criminal network dataset by nature tends to relatively much smaller. In view of this, deep reinforcement learning (DRL) technique which could improve the training of models with the self-generated dataset is leveraged upon to construct the model. In this research, a purely time-evolving DRL model (TDRL-CNA) without metadata fusion is designed as a baseline for comparison with the metadata fusion model (FDRL-CNA). The experimental results show that the predictive accuracy of new and recurrent links by the FDRL-CNA model is higher than the baseline TDRL-CNA model that does not factor data fusion from different data sources.https://ieeexplore.ieee.org/document/8939364/Data fusiontime-evolving networkcriminal network analysisdeep reinforcement learningnode similarity
spellingShingle Marcus Lim
Azween Abdullah
NZ Jhanjhi
Muhammad Khurram Khan
Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
IEEE Access
Data fusion
time-evolving network
criminal network analysis
deep reinforcement learning
node similarity
title Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
title_full Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
title_fullStr Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
title_full_unstemmed Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
title_short Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
title_sort situation aware deep reinforcement learning link prediction model for evolving criminal networks
topic Data fusion
time-evolving network
criminal network analysis
deep reinforcement learning
node similarity
url https://ieeexplore.ieee.org/document/8939364/
work_keys_str_mv AT marcuslim situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks
AT azweenabdullah situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks
AT nzjhanjhi situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks
AT muhammadkhurramkhan situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks