Visible to the public Counting Distinct Elements over Sliding Windows

TitleCounting Distinct Elements over Sliding Windows
Publication TypeConference Paper
Year of Publication2017
AuthorsAssaf, Eran, Basat, Ran Ben, Einziger, Gil, Friedman, Roy, Kassner, Yaron
Conference NameProceedings of the 10th ACM International Systems and Storage Conference
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-5035-8
Keywordscomposability, Metrics, pubcrawl, resilience, Resiliency, security, Windows operating system
Abstract

In Distributed Denial of Service (DDoS) attacks, an attacker tries to disable a service with a flood of seemingly legitimate requests from multiple devices; this is usually accompanied by a sharp spike in the number of distinct IP addresses / flows accessing the system in a short time frame. Hence, the number of distinct elements over sliding windows is a fundamental signal in DDoS identification. Additionally, assessing whether a specific flow has recently accessed the system, known as the Set Membership problem, can help us identify the attacking parties. Here, we show how to extend the functionality of a state of the art algorithm for set membership over a W elements sliding window. We now also support estimation of the distinct flow count, using as little as log2 (W) additional bits.

URLhttps://dl.acm.org/citation.cfm?doid=3078468.3078491
DOI10.1145/3078468.3078491
Citation Keyassaf_counting_2017