PA 5.3 SG 2 – New testing technologies are evaluated to determine their impact on the testing process

New testing technologies such as tools, methods, techniques or technical innovations are identified, selected and evaluated to determine their effect on the organisation’s standard test process.

Introduction

This Specific Goal is concerned with ensuring that the organisation continually investigates new technologies with the purpose of identifying whether or not they would make a suitable addition to (or replacement for) the current tool-set.

Specific Practices

SP 2.1 Identify and analyse new testing technologies

The Specific Practice, SP 1.1 Collect and analyse test process improvements, analyses proposals that are collected internally. The purpose of the Specific Practice SP 2.1 is to actively search externally for innovative and new testing technologies.

Examples of investigative activities include the following:

  • Systematically maintain awareness of leading technical work and trends, e.g., by visiting conferences, attending webinars and studying literature
  • Periodically searching for commercially available innovative and new testing technologies
  • Studying new testing standards for their applicability in the organisation
  • Systematically reviewing test processes, tools and methods used externally and comparing them to those currently used in the organisation
  • Benchmarking test process performance against industry performance data
  • Reviewing examples of test process improvements that were successfully adopted elsewhere
  • Participating in special interest groups in testing
  • Collaborating with other improvement initiatives in the organisation to find opportunities that could also be beneficial to testing

SP 2.2 Pilot new testing technologies

SP 2.3 Select new testing technologies for deployment

Costs and benefits of any candidates for improvement should be analysed.

When selecting new technologies for deployment, the candidates should be prioritised based on the estimated return on investment. Criteria that can be used in this prioritisation process include:

  • Contribution to meeting test performance objectives
  • Alignment with a maturity model (e.g., trying to formally achieve a Maturity Level)
  • Visibility of testing technologies
  • Cost
  • Ease of implementation
  • Expected acceptance (some may cause severe resistance initially)
  • Risk mitigation as a result of implementation

Deployment notes

  • Are new test technologies identified and considered?
  • Is there, or have there been any pilot schemes to prove a new testing tool?