Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks
Evidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8939364/ |
_version_ | 1819275714637070336 |
---|---|
author | Marcus Lim Azween Abdullah NZ Jhanjhi Muhammad Khurram Khan |
author_facet | Marcus Lim Azween Abdullah NZ Jhanjhi Muhammad Khurram Khan |
author_sort | Marcus Lim |
collection | DOAJ |
description | Evidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA) tools capable of uncovering with speed, probable key hidden relationships (links/edges) and players (nodes) in order to anticipate, undermine and cripple organised crime syndicates and activities. The development of link prediction models for network orientated domains is based on Social Network Analysis (SNA) methods and models. The key objective of this research is to develop a link prediction model that incorporates a fusion of metadata (i.e. environment data sources such as arrest warrants, judicial judgement, wiretap records and police station proximity) with a time-evolving criminal dataset in order to be aware of real-world situations to improve the quality of link prediction. Based on the review of related work, most of the models are constructed by leveraging on classical machine learning (ML) techniques such as support vector machine (SVM) without metadata fusion. The problem with the use of classical ML techniques is the lack of available domain dataset which is sufficiently large for training purpose. Compared to sociaI network, criminal network dataset by nature tends to relatively much smaller. In view of this, deep reinforcement learning (DRL) technique which could improve the training of models with the self-generated dataset is leveraged upon to construct the model. In this research, a purely time-evolving DRL model (TDRL-CNA) without metadata fusion is designed as a baseline for comparison with the metadata fusion model (FDRL-CNA). The experimental results show that the predictive accuracy of new and recurrent links by the FDRL-CNA model is higher than the baseline TDRL-CNA model that does not factor data fusion from different data sources. |
first_indexed | 2024-12-23T23:28:43Z |
format | Article |
id | doaj.art-697b8ee2cb7547fd827bff9cf4920e50 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-23T23:28:43Z |
publishDate | 2020-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-697b8ee2cb7547fd827bff9cf4920e502022-12-21T17:26:08ZengIEEEIEEE Access2169-35362020-01-018165501655910.1109/ACCESS.2019.29618058939364Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal NetworksMarcus Lim0https://orcid.org/0000-0003-2790-3720Azween Abdullah1https://orcid.org/0000-0003-4425-8604NZ Jhanjhi2Muhammad Khurram Khan3https://orcid.org/0000-0001-6636-0533School of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaSchool of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaSchool of Computing and IT (SoCIT), Taylor’s University, Subang Jaya, MalaysiaCenter of Excellence in Information Assurance, King Saud University, Riyadh, Saudi ArabiaEvidently, criminal network activities have shown an increasing trend in terms of complexity and frequency, particularly with the advent of social media and modern telecommunication systems. In these circumstances, law enforcement agencies have to be armed with advance criminal network analysis (CNA) tools capable of uncovering with speed, probable key hidden relationships (links/edges) and players (nodes) in order to anticipate, undermine and cripple organised crime syndicates and activities. The development of link prediction models for network orientated domains is based on Social Network Analysis (SNA) methods and models. The key objective of this research is to develop a link prediction model that incorporates a fusion of metadata (i.e. environment data sources such as arrest warrants, judicial judgement, wiretap records and police station proximity) with a time-evolving criminal dataset in order to be aware of real-world situations to improve the quality of link prediction. Based on the review of related work, most of the models are constructed by leveraging on classical machine learning (ML) techniques such as support vector machine (SVM) without metadata fusion. The problem with the use of classical ML techniques is the lack of available domain dataset which is sufficiently large for training purpose. Compared to sociaI network, criminal network dataset by nature tends to relatively much smaller. In view of this, deep reinforcement learning (DRL) technique which could improve the training of models with the self-generated dataset is leveraged upon to construct the model. In this research, a purely time-evolving DRL model (TDRL-CNA) without metadata fusion is designed as a baseline for comparison with the metadata fusion model (FDRL-CNA). The experimental results show that the predictive accuracy of new and recurrent links by the FDRL-CNA model is higher than the baseline TDRL-CNA model that does not factor data fusion from different data sources.https://ieeexplore.ieee.org/document/8939364/Data fusiontime-evolving networkcriminal network analysisdeep reinforcement learningnode similarity |
spellingShingle | Marcus Lim Azween Abdullah NZ Jhanjhi Muhammad Khurram Khan Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks IEEE Access Data fusion time-evolving network criminal network analysis deep reinforcement learning node similarity |
title | Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks |
title_full | Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks |
title_fullStr | Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks |
title_full_unstemmed | Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks |
title_short | Situation-Aware Deep Reinforcement Learning Link Prediction Model for Evolving Criminal Networks |
title_sort | situation aware deep reinforcement learning link prediction model for evolving criminal networks |
topic | Data fusion time-evolving network criminal network analysis deep reinforcement learning node similarity |
url | https://ieeexplore.ieee.org/document/8939364/ |
work_keys_str_mv | AT marcuslim situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks AT azweenabdullah situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks AT nzjhanjhi situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks AT muhammadkhurramkhan situationawaredeepreinforcementlearninglinkpredictionmodelforevolvingcriminalnetworks |