Franck Le Gall, Sophie Vallet Chevillard, Alex Gluhak, Nils Walravens, Zhang Xueli and Hend Ben Hadji, Benchmarking Internet of Things Deployment: Frameworks, Best Practices and Experiences in Modeling and Processing for Next-Generation Big-Data Technologies, Springer series, ISBN 978-3-319-06262-4, April 2014

IoT deployments generate data of the real world in an automated fashion without direct user involvement. With increasing scale of these IoT deployments the extraction of the right knowledge about the real world from a vast amount of IoT data and efficient decisions is a challenging endeavor. While solutions to deal with large amounts of IoT data are slowly emerging, potential users of IoT solutions, or policy makers find it difficult to assess the actual usefulness of investing in IoT deployments or selecting adequate deployment strategies for a particular business domain.

Despite the recent hype generated by consultancy companies and IoT vendors about the IoT, there is still a lack of experience in assessing the utility and benefits of IoT deployments as many IoT deployments are still in their early stages. In order to capture such experience quicker and derive best practices for IoT deployments, systematic tools, or methodologies are required in order to allow the assessment of the goodness or usefulness of IoT deployments and a comparison between emerging IoT deployments to be performed.

This chapter addresses the existing gap and proposes a novel benchmarking framework for IoT deployments. The proposed framework is complementary to the emerging tools for the analysis of big data as it allows various stakeholders to develop a deeper understanding of the surrounding IoT business ecosystem in a respective problem domain and the value proposition that the deployment of an IoT infrastructure may bring. It also allows a better decision making for policy makers for regulatory frameworks.