Maturity Level 4 – Measured

Achieving the Goals of TMMi Levels 2 and 3 has the benefits of putting into place a technical, managerial and staffing infrastructure capable of thorough testing and providing support for test process improvement.

With this infrastructure in place, testing can become a measured process to encourage further growth and accomplishment. In TMMi Level 4 organisations, testing is a thoroughly defined, well-founded and measurable process.

Testing is perceived as evaluation, consisting of all life cycle activities concerned with checking products and related work products. Peer reviews as a defect detection technique is transformed into a product quality measurement technique in line with the Process Area Product Quality Evaluation.

TMMi level 4 also covers establishing a coordinated test approach between peer reviews (static testing) and dynamic testing and the usage of peer reviews results and data to optimise the test approach with both aiming at making testing more effective and more efficient.

Peer reviews are now fully integrated with the dynamic testing process, being part of the test strategy, test plan and test approach.

There are 3 Process Areas in this Level.

• PA 4.1 Test Measurement
  • An organisation-wide test measurement program will be in place that can be used to evaluate the quality of the testing process, to assess productivity, and to monitor improvements.
  • Measures are incorporated into the organisation’s measurement repository to support fact-based decision making.
  • The test measurement program will support predictions relating to test performance and cost.
  • With respect to product quality, the presence of a measurement program allows an organisation to implement a product quality evaluation process by defining quality needs, quality attributes and quality metrics.
• PA 4.2 Product Quality Evaluation
  • Work products are evaluated using quantitative criteria for quality attributes such as
    • reliability
    • usability and
    • maintainability.
  • Product quality is understood in quantitative terms and is managed to the defined objectives throughout the life-cycle.
• PA 4.3 Advanced Reviews
  • Reviews and inspections are considered to be an integral part of the test process
  • They are used to measure product quality early in the life cycle and to formally control quality gates.