Uploaded image for project: 'Xray for Jira'
  1. Xray for Jira
  2. XRAY-9124

dynamic test plan dont respect filter order nor show a consistent ranking

    XporterXMLWordPrintable

Details

    • Xray 2023 S13, Xray 2023 S14, Xray 2023 S15, Xray 2023 S16, Xray 2023 S17
    • OK

    Description

      In the dynamic test plans, having a filter configured with ranking (e.g., ), the issues order is not respected. More, on the Test Plan board, Tests are shown in completely different orders if we look at the "all" and the "orphans" folders.

       

       

      Expected order: CALC-13, 14, 15, ... ,22, 23, 24

       

      However...

      1. on the Test Plan issue screen it shows it like this:

       

      2. on the Test Plan board, All folder..

       

      3. on the Test Plan board, "Orphans" folder..

       

       

       

      The recommendation is that whenever using Dynamic Test Plans, the initial state (i.e., the order/ranking of the list of tests) of the Test Plan should have the ranking of the issues coming from the saved filter. That filter ranking (e.g., defined by the "order" statement) should be used to 1) initially define the ranking of the Tests in the Test Plan and 2) should also be use to define the order of the Tests in the "All" metafolder in the Board.

      Note that ranking is an important concept in test planning and is used to defined the order by which tests should be executed. Besides, in the case of TCD, the order of the generated tests is relevant for the coverage matrix reports provided in TCD where we can analyze coverage up to x number of the generated tests (in TCD, the generated test scenarios order is relevant).

      To summarize:

      1. With the test plan board (Hierarchical organization enabled on settings)
        1. Static test plan:
          1. follows the order in the test plan tests table
        2. With a dynamic test plan
          1. Folder All: sorted according to test table sort
          2. Folder Orphan: sorted according to filter
          3. Other folders: sorted by user
      2. Test plan test table:
        1. with a hierarchical organization:
          1. sorted according to test plan board folders
        2. without test plan board (Hierarchical organization disabled on settings):
          1. static test plan: allows user organization
          2. Dynamic test plan: according to filter it is not possible to the user to order the tests

       

      Attachments

        Issue Links

          Activity

            People

              pedro.teixeira Pedro Daniel Moreira Teixeira
              smsf Sergio Freire
              Marco Guedes
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 2 weeks, 6 hours, 44 minutes
                  2w 6h 44m