| Title | A Crawling Approach to Facilitate Open IoT Data Archiving and Reuse |
| Publication Type | Conference Paper |
| Year of Publication | 2019 |
| Authors | Pflanzner, T., Feher, Z., Kertesz, A. |
| Conference Name | 2019 Sixth International Conference on Internet of Things: Systems, Management and Security (IOTSMS) |
| Date Published | oct |
| Keywords | automated Web crawling service, cloud computing, compositionality, Computational modeling, Crawlers, data management services, Data models, data retrieval, Databases, information retrieval systems, Information Reuse and Security, Internet of Things, IoT trace archiving service, IoT-cloud systems, open IoT data archiving, pubcrawl, Resiliency, sensor data, simulation environments, simulation experiments, smart cities, SUMMON, visualization, web services |
| Abstract | Several cloud providers have started to offer specific data management services by responding to the new trend called the Internet of Things (IoT). In recent years, we have already seen that cloud computing has managed to serve IoT needs for data retrieval, processing and visualization transparent for the user side. IoT-Cloud systems for smart cities and smart regions can be very complex, therefore their design and analysis should be supported by means of simulation. Nevertheless, the models used in simulation environments should be as close as to the real world utilization to provide reliable results. To facilitate such simulations, in earlier works we proposed an IoT trace archiving service called SUMMON that can be used to gather real world datasets, and to reuse them for simulation experiments. In this paper we provide an extension to SUMMON with an automated web crawling service that gathers IoT and sensor data from publicly available websites. We introduce the architecture and operation of this approach, and exemplify it utilization with three use cases. The provided archiving solution can be used by simulators to perform realistic evaluations. |
| DOI | 10.1109/IOTSMS48152.2019.8939248 |
| Citation Key | pflanzner_crawling_2019 |
A Crawling Approach to Facilitate Open IoT Data Archiving and Reuse