Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
Xray R3.2.0 S4
-
Description
Here's how to replicate the problem:
* Make sure the 'Enable Hierarchical Test organization' option is checked on the 'Xray Global Settings'; * Create the Test Plan 'TP1'; * Create the following Tests: ** 1. Add article to cart ** 2. Pay ** 3. Select payment ** 4. Search article ** 5. Login to shop ** 6. Enter voucher number Add the 'Test' issues to the 'Test Plan' in the following order: ** 1. Add article to cart ** 2. Pay ** 3. Select payment ** 4. Search article ** 5. Login to shop ** 6. Enter voucher number Navigate to the 'Test Plan Board' for Test Plan 'TP1', create the Board 'Ordered TestCases', and sort them like this: ** 5. Login to shop ** 4. Search article ** 1. Add article to cart ** 6. Enter voucher number ** 3. Select payment ** 2. Pay On the 'Test Plan' issue, 'Create Test Execution -> All tests...', and navigate to the newly created 'Test Execution' issue. The Tests will be sorted like on the Test Plan: ** 5. Login to shop ** 4. Search article ** 1. Add article to cart ** 6. Enter voucher number ** 3. Select payment ** 2. Pay Execute them like this: # Login to shop => PASS # Search article => PASS # Add article to cart => FAIL # Enter voucher number => BLOCKED # Select payment => BLOCKED # Pay => BLOCKED Return to the 'Test Plan' issue, 'Create Test Execution -> With status...', and navigate to the newly created 'Test Execution' issue. The Tests will be sorted like this: ** 1. Add article to cart ** 2. Pay ** 3. Select payment ** 6. Enter voucher number And they should be sorted like this instead: ** 1. Add article to cart ** 6. Enter voucher number ** 3. Select payment ** 2. Pay
Summarizing:
On the Test Plan issue page with Hierarchical Test organization, if I use the option Create Test Execution -> All tests... the given Hierarchical Test organization will be maintained on the created Test Execution Tests table, as expected
However, if I use the option Create Test Execution -> With status... instead, the Hierarchical Test organization will be ignored and the Tests table will be sorted by their rank on the Test Plan (order the tests were added to the Test Plan), which is not expected.