Importance of Repeatable Setups for Reproducible Experimental Results in IoT
| Title | Importance of Repeatable Setups for Reproducible Experimental Results in IoT |
| Publication Type | Conference Paper |
| Year of Publication | 2016 |
| Authors | Papadopoulos, Georgios Z., Gallais, Antoine, Schreiner, Guillaume, Noël, Thomas |
| Conference Name | Proceedings of the 13th ACM Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, & Ubiquitous Networks |
| Publisher | ACM |
| Conference Location | New York, NY, USA |
| ISBN Number | 978-1-4503-4505-7 |
| Keywords | Collaboration, compositionality, experimentation testbeds, Internet of Things, large scale, open platform, performance evaluation, privacy, protocol verification, pubcrawl, repeatability, reproducibility, Wireless sensor networks |
| Abstract | Performance analysis of newly designed solutions is essential for efficient Internet of Things and Wireless Sensor Network (WSN) deployments. Simulation and experimental evaluation practices are vital steps for the development process of protocols and applications for wireless technologies. Nowadays, the new solutions can be tested at a very large scale over both simulators and testbeds. In this paper, we first discuss the importance of repeatable experimental setups for reproducible performance evaluation results. To this aim, we present FIT IoT-LAB, a very large-scale and experimental testbed, i.e., consists of 2769 low-power wireless devices and 127 mobile robots. We then demonstrate through a number of experiments conducted on FIT IoT-LAB testbed, how to conduct meaningful experiments under real-world conditions. Finally, we discuss to what extent results obtained from experiments could be considered as scientific, i.e., reproducible by the community. |
| URL | http://doi.acm.org/10.1145/2989293.2989300 |
| DOI | 10.1145/2989293.2989300 |
| Citation Key | papadopoulos_importance_2016 |