Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-95585

Create linter for test hierarchy tool

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Testing Infrastructure
    • None
    • Replication

      After SERVER-94816, tests will only be run in the most complex suite in an ancestral chain of suites on patch builds. We need to make sure that when a suite is disabled but not deleted, this doesn't cause the test hierarchy tool to incorrectly calculate which tests can be run. For example, if suiteAB > suiteA in terms of complexity, then some test t running on suiteAB need not run on suiteA.

      However, suppose we temporarily disable suiteAB in the Evergreen YAML file without deleting the original suite YAML file. The test hierarchy tool shouldn't incorrectly stop running t on suiteA because it assumes that t will be run on suiteAB.

      We need a linter to prevent this scenario - any suites in the hierarchy definition should be running on Evg.

            Assignee:
            Unassigned Unassigned
            Reporter:
            vishnu.kaushik@mongodb.com Vishnu Kaushik
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: