Publication details
Cloud Native Data Platform for Network Telemetry and Analytics
| Authors | |
|---|---|
| Year of publication | 2021 |
| Type | Article in Proceedings |
| Conference | 17th International Conference on Network and Service Management |
| MU Faculty or unit | |
| Citation | |
| Web | https://dl.ifip.org/db/conf/cnsm/cnsm2021/1570760135.pdf |
| Doi | http://dx.doi.org/10.23919/CNSM52442.2021.9615568 |
| Keywords | Data Lakehouse;Network Flows;Log Data |
| Attached files | |
| Description | In this manuscript, we present a prototype of a modular data platform that is able to continuously ingest, process, retain, and analyse large amounts of network telemetry data in a scalable and straightforward manner. It follows a recently proposed Data Lakehouse architectural pattern, which is an evolution of two well-known approaches used in this area -- data warehouses and data lakes. The platform is based on open standards and open-source components, and it follows cloud native principles in order to be able to run in modern computing environments such as public, private, and hybrid clouds. The primary focus of the prototype is network telemetry and analytics over traffic flows and infrastructure logs for the purposes of cyber-security digital forensics and incident response. During the demonstration part, we will further describe internal workings of the presented data platform and showcase its capabilities and possible applications on a public dataset. |
| Related projects: |