Publication details

Big Data Sanitization and Cyber Situational Awareness: A Network Telescope Perspective

Authors

BOU-HARB Elias HUSÁK Martin DEBBABI Mourad ASSI Chadi

Year of publication 2019
Type Article in Periodical
Magazine / Source IEEE Transactions on Big Data
MU Faculty or unit

Institute of Computer Science

Citation
Web https://ieeexplore.ieee.org/document/7968317
Doi http://dx.doi.org/10.1109/TBDATA.2017.2723398
Field Informatics
Keywords Darknet sanitization;Time series analytics;Security analytics;Cyber threat intelligence
Description This paper addresses the problems of data sanitization and cyber situational awareness by analyzing 910 GB of real Internet-scale traffic, which has been passively collected by monitoring close to 16.5 million darknet IP addresses from a /8 and a /13 network telescopes. First, the paper offers a novel probabilistic darknet preprocessing model, which aims at sanitizing darknet data to prepare it for effective use in the task of cyber threat intelligence generation. Such model has been engineered using a distributed multithreaded approach, rendering it highly effective on darknet big data. Second, the paper further contributes by presenting an innovative approach to infer large-scale orchestrated probing campaigns by leveraging darknet data, for Internet cyber situational awareness. The approach uniquely reduces the dimensionality of such big data by utilizing its artifacts, instead of processing the actual raw data. This is accomplished by extracting and analyzing probing time series using formal methods rooted in Fourier transform and Kalman filtering. Thorough empirical evaluations indeed validate the accuracy and the performance of the proposed methods. We assert that such approaches are of significant value, given their highly applicable nature to the field of Internet measurements for cyber security in the era of big data.

You are running an old browser version. We recommend updating your browser to its latest version.

More info