Details
-
Suggestion
-
Status: New
-
Resolution: Unresolved
-
None
Description
Users must be able to configure a dashboard widget which shows test run statistics for a list of tests. The gadget would ideally load the tests from either a saved filter or from a Test Set issue ID.
The following columns must be provided (one row per test):
- Issue (issue number of the Test issue, as a hyperlink)
- Summary (Summary of the Test issue, maybe also a hyperlink?)
- Linked Requirements
- Pass (number of test runs with a PASS result)
- Fail (number of test runs with a FAIL result)
- etc... columns for all test run result statuses configured in the system, including custom ones.
- Total Runs (total count of all test runs, which will be the sum of all the previous columns. Need to take into account whether non-final statuses are included)
- Success Rate (% of test runs contributing to the OK status of requirements, such as the PASS status)
- Last Run (most recent test run result. Need to take into account whether non-final statuses are included)
Example:
Issue | Summary | Linked Requirements | Total Runs | Pass | Fail | ... | Success Rate | Last Run |
---|---|---|---|---|---|---|---|---|
CALC-1 | Test sum of two positive numbers | CALC-100 | 30 | 20 | 10 | .. | 67% | Fail (View Details) |
CALC-2 | Test sum of two negative numbers | CALC-130, CALC-242 | 10 | 2 | 8 | ... | 20% | Pass (View Details) |
Filters:
- saved filter for Tests (for selecting Test issues)
- saved filter for Test Executions (for selecting Test Executions and related Test issues)
- test run's assignee, executedby
Chart Title: by default "Test Runs Statistics" but may be customized
Also, a pie chart must be provided by Xray grouping Test Runs by status.