Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4839

Add a feature to python testsuite to run a random subset of tests

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT3.2.1, 4.3.1, 4.2.0-rc2
    • Affects Version/s: None
    • Component/s: None
    • None
    • 3
    • Storage Engines 2019-06-17
    • v4.2

      We have over 6000 test scenarios that the whole python test suite executes. It takes considerable time to run them all. It will be worthwhile to add a feature to the suite, where we can pick every Nth test (randomly) and execute a smaller subset of the whole suite.

      This could be useful when we want to quickly execute a small number of tests before creating the pull request.

      This could be a command line argument to run.py.

      For instance, the following will run every 10th test (from a randomly picked list of all test scenarios):

      ./run.py --Nth 10
      

      The following will run every 3rd test (from a randomly picked list of all timestamp test scenarios):

      ./run.py --Nth 10 timestamp
      

            Assignee:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Reporter:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: