Open source intelligence gathering and topic modelling on cyber security incidents
This paper aims to demonstrate the use of Open Source Intelligence (OSINT) techniques to gather publicly available data on cyber risks and to predict current attack trends. The paper will start off by first introducing the current threat landscape. It will talk about the current state of the threat...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/138004 |
| _version_ | 1826129301651587072 |
|---|---|
| author | Ang, Chuan Kai |
| author2 | Anwitaman Datta |
| author_facet | Anwitaman Datta Ang, Chuan Kai |
| author_sort | Ang, Chuan Kai |
| collection | NTU |
| description | This paper aims to demonstrate the use of Open Source Intelligence (OSINT) techniques to gather publicly available data on cyber risks and to predict current attack trends. The paper will start off by first introducing the current threat landscape. It will talk about the current state of the threat landscape, how the landscape will continuously evolve and the use of OSINT techniques to combat these upcoming rising threats. The paper will then move on to showcase the approach and methodology of using OSINT techniques. Using the defined approach, implementations will be performed accordingly. The implementation will start off by generating a list of publicly available online data sources. These sources will then be crawled using web spiders. The crawled data will then undergo processing. Processing will cleanse the crawled data of invalid data and format the crawled data into a suitable format for storing. The stored data will be queried for analysis. Findings from the analysis will then be displayed using visualization tools. From these findings, inferences are made and discussed. Recommendations deriving from the inferences will be given to the affected industry and businesses to help fight against the threats. |
| first_indexed | 2024-10-01T07:38:23Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/138004 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:38:23Z |
| publishDate | 2020 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1380042020-04-21T10:32:55Z Open source intelligence gathering and topic modelling on cyber security incidents Ang, Chuan Kai Anwitaman Datta School of Computer Science and Engineering anwitaman@ntu.edu.sg Engineering::Computer science and engineering::Computer applications This paper aims to demonstrate the use of Open Source Intelligence (OSINT) techniques to gather publicly available data on cyber risks and to predict current attack trends. The paper will start off by first introducing the current threat landscape. It will talk about the current state of the threat landscape, how the landscape will continuously evolve and the use of OSINT techniques to combat these upcoming rising threats. The paper will then move on to showcase the approach and methodology of using OSINT techniques. Using the defined approach, implementations will be performed accordingly. The implementation will start off by generating a list of publicly available online data sources. These sources will then be crawled using web spiders. The crawled data will then undergo processing. Processing will cleanse the crawled data of invalid data and format the crawled data into a suitable format for storing. The stored data will be queried for analysis. Findings from the analysis will then be displayed using visualization tools. From these findings, inferences are made and discussed. Recommendations deriving from the inferences will be given to the affected industry and businesses to help fight against the threats. Bachelor of Engineering (Computer Science) 2020-04-21T10:32:55Z 2020-04-21T10:32:55Z 2020 Final Year Project (FYP) https://hdl.handle.net/10356/138004 en SCSE19-0210 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computer applications Ang, Chuan Kai Open source intelligence gathering and topic modelling on cyber security incidents |
| title | Open source intelligence gathering and topic modelling on cyber security incidents |
| title_full | Open source intelligence gathering and topic modelling on cyber security incidents |
| title_fullStr | Open source intelligence gathering and topic modelling on cyber security incidents |
| title_full_unstemmed | Open source intelligence gathering and topic modelling on cyber security incidents |
| title_short | Open source intelligence gathering and topic modelling on cyber security incidents |
| title_sort | open source intelligence gathering and topic modelling on cyber security incidents |
| topic | Engineering::Computer science and engineering::Computer applications |
| url | https://hdl.handle.net/10356/138004 |
| work_keys_str_mv | AT angchuankai opensourceintelligencegatheringandtopicmodellingoncybersecurityincidents |