Details
-
Suggestion
-
Status: New
-
Resolution: Unresolved
-
Xray Cloud 13.0.0
-
None
-
None
-
UI
Description
Description
As a User, I would like to use a validator to verify the Test Run associated with a work item.
By running the validation process, users could identify missing, failed, or inconsistent test executions, ensuring the work item complies with quality and traceability requirements before progressing to the next stage of the workflow.
User friction
Users currently need to manually review all Test Executions linked to a work item to confirm that the required tests have been executed successfully and that no execution records are missing or inconsistent. This process is time-consuming, error-prone, and difficult to scale for work items associated with multiple test cases.
Steps to reproduce (right now) / Actual Result:
1. Open a work item associated with one or more Test Executions.
2. Review each linked Test Execution individually.
3. Manually verify:
- Required Test Executions exist.
- Execution results meet the expected criteria.
- No failed, missing, or outdated executions are present.
4. Determine manually whether the work item satisfies the quality requirements.
Actual Result:
There is no automated validation mechanism. Users must manually inspect Test Executions.
IMPACT
What would improve if solved:
- Faster verification of work item readiness.
- Reduced manual effort during reviews and approvals.
- Improved consistency in validation processes.
- Earlier detection of missing or failed Test Executions.
Impact on stakeholders:
- Faster and more reliable validation of testing activities.
- Clear visibility of Test Run status before promoting the work item.
- Increased confidence in release readiness and compliance.
- Improved traceability and validation evidence.
Current workaround:
Users manually review all linked Test Executions and cross-check their status against project requirements before approving or progressing a work item.
CONTEXT & EXAMPLES:
Concrete example:
A User Story requires five associated test cases. Before moving the work item to a "Ready for Release" state, the user must verify that:
- All five Test Executions exist.
- All executions have been completed.
- No execution has a failed status.
- The execution results are linked correctly to the work item.
A validator could automatically perform these checks and would make it easier to identify any issues.
Workaround risk:
- Missing failed or incomplete Test Executions.
- Human error during manual verification.
- Inconsistent validation criteria across teams.
- Delays caused by manual review activities.