Visible to the public Pattern Mining Based Compression of IoT Data

TitlePattern Mining Based Compression of IoT Data
Publication TypeConference Paper
Year of Publication2018
AuthorsRamijak, Dusan, Pal, Amitangshu, Kant, Krishna
Conference NameProceedings of the Workshop Program of the 19th International Conference on Distributed Computing and Networking
PublisherACM
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-6397-6
Keywordscomposability, Compression, data provenance, Human Behavior, Internet of Things, IoT, Metrics, Provenance, pubcrawl, Resiliency, time series representation
AbstractThe increasing proliferation of the Internet of Things (IoT) devices and systems result in large amounts of highly heterogeneous data to be collected. Although at least some of the collected sensor data is often consumed by the real-time decision making and control of the IoT system, that is not the only use of such data. Invariably, the collected data is stored, perhaps in some filtered or downselected fashion, so that it can be used for a variety of lower-frequency operations. It is expected that in a smart city environment with numerous IoT deployments, the volume of such data can become enormous. Therefore, mechanisms for lossy data compression that provide a trade-off between compression ratio and data usefulness for offline statistical analysis becomes necessary. In this paper, we discuss several simple pattern mining based compression strategies for multi-attribute IoT data streams. For each method, we evaluate the compressibility of the method vs. the level of similarity between original and compressed time series in the context of the home energy management system.
URLhttp://doi.acm.org/10.1145/3170521.3170533
DOI10.1145/3170521.3170533
Citation Keyramijak_pattern_2018