PA 2.1 SG 2 – Establish a test strategy

An organisation-wide or programme-wide test strategy is established and deployed, identifying and defining the test levels to be performed.

Introduction

This Specific Goal seeks to ensure that the organisation has a document that identifies and defines the test levels to be performed,with the objectives, responsibilities and tasks needed, that a generic risk assessment is carried out, that and that it is all reviewed with stakeholders.

Specific Practices

SP 2.1 Perform a generic product risk assessment

SP 2.2 Define test strategy

  • The test strategy is drafted as a generic document that contains all defined elements of how testing will be undertaken in order to satisfy the test policy and test goals.
  • It is the overall approach to test effort and provides the required framework.
  • Some subjects that should be covered are:
    • Generic risks of the products being developed
    • Overall test model (for example V-model, incremental life cycle) as a way to mitigate the risks
    • Test levels (for example, unit, integration, system or acceptance test)
    • Objectives, responsibilities and main tasks at each test level. For example: for unit testing
      • verifying that the unit operates as specified in the unit design
      • a certain level of code coverage is achieved
    • for integration testing
      • verifying that the units operate together as specified in the global design
      • verifying that the interfaces operate as specified in the interface specifications
    • for system testing
      • verifying that the system operates as specified in the requirements specification
      • a certain level of system requirements coverage is achieved
    • for acceptance testing
      • verifying that the system satisfies acceptance criteria
      • validating whether the system is ‘fit for use’
      • a certain level of user requirements coverage is achieved
    • Test case design techniques to be used at each test level
    • Test types to be carried out at each test level
    • Entry and exit criteria for each test level
    • Standards that must be complied with Level of independence
    • Environment in which the tests will be executed
    • Approach to automation at each test level
    • Approach to regression testing

SP 2.2 Distribute the test strategy to stakeholders

Deployment notes

  • Has a generic product risk assessment been undertaken?
  • Has the organisation (at programme or organisational level) defined the required strategy / approach / framework to provide clear guidance on how the test function will undertake testing and debugging to satisfy the policy and goals?
  • Are test levels, objectives, activities, roles, responsibilities, main tasks, entry / exit criteria defined in the test strategy (the overall approach of how to satisfy the ‘what’)?
  • Does the test strategy / approach outline how to approach testing activities with other associated elements such as approach to risk and regression testing?
  • Is the test strategy reviewed with stakeholders?
  • Is the test strategy publicised to, and discussed with, stakeholders?