Quality-Impact Assessment of Software Products and Services in a Future Internet Platform

Abstract: The idea of a Future Internet platform is to deliver reusable and common functionalities to facilitate making wide ranges of software products and services.  The Future Internet platform, introduced by the Future Internet Public Private Partnership (FI-PPP) project, makes the common functionalities available through so-called Enablers to be instantly integrated into software products and services with less cost and complexity rather than a development from scratch.Quality assessment of software products and services and gaining insights into whether the quality fulfills users’ expectations within the platform are challenging. The challenges are due to the propagation of quality in the heterogeneous composite software that uses Enablers and infrastructure developed by third parties. The practical problem is how to assess the quality of such composite software as well as the impacts of the quality on users’ Quality of Experience (QoE).The research objective is to study an analytics-driven Quality-Impact approach identifying how software quality analytics together with their impact on QoE of users can be used for the assessment of software products and services in a Future Internet platform.The research was conducted with one systematic mapping study, two solution proposals, and one empirical study. The systematic mapping study is contributed to produce a map overviewing important analytics for managing a software ecosystem. The thesis also proposes a solution to introduce a holistic software-human analytics approach in a Future Internet platform. As the core of the solution, it proposes a Quality-Impact inquiry approach exemplified with a real practice. In the early validation of the proposals, a mixed qualitative-quantitative empirical research is conducted with the aim of designing a tool for the inquiry of user feedback. This research studies the effect of the instrumented feedback tool on QoE of a software product.The findings of the licentiate thesis show that satisfaction, performance, and freedom from risks analytics are important groups of analytics for assessing software products and services.  The proposed holistic solution takes up the results by describing how to measure the analytics and how to assess them practically using a composition model during the lifecycle of products and services in a Future Internet platform. As the core of the holistic approach, the Quality-Impact assessment approach could elicit relationships between software quality and impacts of the quality on stakeholders. Moreover, the early validation of the Quality-Impact approach parameterized suitable characteristics of a feedback tool. We found that disturbing feedback tools have negligible impacts on the perceived QoE of software products.The Quality-Impact approach is helpful to acquire insight into the success of software products and services contributing to the health and sustainability of the platform. This approach was adopted as a part of the validation of FI-PPP project. Future works will address the validation of the Quality-Impact approach in the FI-PPP or other real practices.