A very complete picture of the defects associated with the System Test resides in this section. The analysis is displayed in numerous graphs and charts for easy identification. Defect count by severity, a graph of defect severity and status, a chart outlining defects by root cause, a breakdown of all invalid defects, and a deferred defects summary. Attached here will also be a complete defect list. Any business, operational, or technical risks associated with deferred defects are identified here.

The test schedule in the System Test Plan is reused here and updated with a breakdown of a testing phase and their associated planned and actual start and end dates. The test coverage is captured with a table of the number of test cases per module or functional area. Any downtime that affected the schedule is presented here with reasons for the downtime and the effects it had on lost days or hours. All test results (passed/failed/incomplete) will be broken down in this section, taken from Quality Center or similar test case tracking software.

This section details specific ‘pain points’ associated with the system test such as insufficient time, delayed builds, or unplanned test executions. Lessons learned during the system test are described to help both the client and QA Mentor in future endeavors. Examples include adding extra time for data setup or requiring detailed scenarios up front. Project recommendations are provided by our experienced staff and relate to their personal experiences during the System Test and aim to help the client with maintenance or future releases.