Application of Quality And Testing Standards in Different Phases of Software Testing

The purpose of the exploratory development project was to study and develop the application of different quality and testing standards in different phases of software testing from the consulting point of view. The project was carried out as an exploratory development project for Qentinel Ltd. The research problem was to find out how different quality and testing standards can be used and applied in the different phases of software testing. The research problem was approached from a project management (PMBOK), software maturity model (CMM) and software testing standard (ISO 29119) aspects.

The theoretical context of the study consisted of the following: total quality management, quality assurance, Deming cycle, ISO 29119-2 test process, software maturity model, project management standard, testing V-model, value creation, value shop and standard’s effect of consulting business.

Research material was collected from Qentinel staff and customer firms by questionnaires. The material was analyzed by using a thematic approach. The main themes were: the knowledge and application of standards, experiences of standard usage, usage of standards in different testing models and the integration of standards into corporate daily life.

The study showed that project management and software maturity model standards are compatible with testing standards and the testing V-model. The study showed also that project management and maturity model standards don’t expect certain content from test phases but don’t either exclude the content requirements set by the testing standard. Testing standards offer more different kinds of aids and document templates to testing phases than project management and software maturity model standards.

According to research material almost a hundred testing related standards were known and they were divided relatively equally between ISO, IEEE and other standard groups. Only a few had standard usage experience but overall the attitude towards standards was positive. Standards were used in the V-model more than in agile models. Integrating standards into daily life had been challenging due to the low level of application experience. Standard know-how and application according to corporate needs aids standard integration.

As a development idea it was suggested that Qentinel should collect standard application usage experiences from customer projects. Additionally, it was proposed that a case-study about standard integration should be conducted when some customer company takes standards into use. A follow-up research study of how quality award models define testing was suggested. Competence development, management of intellectual capital and value creation in consulting business and value measuring would be good follow-up items, preferably by using a practical case–study.

Key words: Value creation, expertise service, consulting, quality assurance, added value, testing v-model and knowledge intensive business service (KIBS).