Only run timing tests on Ubuntu

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: Testing
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Timing-related tests such as the spec and prose tests for CSOT tend to be far more flaky on Mac and Windows OSes. Per this PR discussion, to reduce noise from failing tests, it may be prudent to add a new flag for timing-related tests (maybe in the form of an environment variable + mtest configuration) and just skip those tests on those OSes. While this may reduce test coverage, timing failures rarely represent actual bugs in driver code, so these recurrent failures are not particularly helpful and can be difficult/time-consuming to fix.

            Assignee:
            Unassigned
            Reporter:
            Benji Rewis (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: