Shuffle order of tests via smoke.py

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Duplicate
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Testing Infrastructure
    • None
    • Fully Compatible
    • Quint Iteration 3
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      We'd like to have smoke.py shuffle the tests in a suite. It should take a seed as a parameter to use for randomizing the shuffle. If a seed isn't provided, it should use the current git hash. This way, each build that buildbot runs has a different shuffle for running tests within a suite, but it is still easily reproducible.

            Assignee:
            Max Hirschhorn
            Reporter:
            Eric Milkie
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: