-
Type: Improvement
-
Resolution: Done
-
Priority: Critical - P2
-
Affects Version/s: None
-
Component/s: Testing Infrastructure
-
None
-
Fully Compatible
-
Quint Iteration 3.1.2, Quint Iteration 3
Split out the passthrough tests into separate suites. This allows the generated report.json file to record the success/failure of each individual test.
Support parallel execution of C++ unit tests, dbtests, and jstests: (--jobs=N)
- C++ unit tests will "just work"
- dbtests require separate dbpaths
- jstests should dispatch to independent MongoDB deployments
Support grouping different kinds of tests (e.g. C++ unit tests, dbtests, and jstests) so that they can be run together. This allows for customizability in specifying what tests to execute when changes are made to a particular part of the code.
Support including and excluding jstests from suites by using tags. For example, a "no-sharding" tag that appears in the file would prevent it from being run as a part of the sharding jsCore passthrough.
/** * This test should not be run in sharding because <reason>. * @tags: [ no-sharding, # SERVER-XXX * ] */
Support running a set of tests multiple times, or until some test fails. (--repeat=N)
Support randomizing the order in which tests execute. (--shuffle)
- depends on
-
SERVER-17947 Invariant failure when running oplogstart dbtest with mmapv1
- Closed
-
SERVER-18256 mongod crashes with assert when trying to copy to filename with >= 260 characters on windows
- Closed
- is depended on by
-
SERVER-17526 option to allow disabling job object creation in resmoke.py for win32
- Closed
-
SERVER-18389 Post-commit resmoke.py tasks
- Closed
-
SERVER-18268 Support running sharding and replication tests in parallel
- Closed
- is duplicated by
-
SERVER-14870 smoke.py should show mongod startup logs if mongod startup fails
- Closed
-
SERVER-17445 Extend ASAN leak detection to all test suites
- Closed
-
SERVER-5736 Shuffle order of tests via smoke.py
- Closed
- is related to
-
SERVER-10910 Mongobridge does not support SSL
- Closed
-
SERVER-11207 smoke.py expand wildcards on Windows
- Closed
-
SERVER-4959 Check exit code when killing servers in tests
- Closed
-
SERVER-10909 Replace jstest calls to MongodRunner
- Closed
- related to
-
SERVER-32343 dbtest repl suite restores ReplicationCoordinator settings on tear down.
- Closed
-
SERVER-32344 register DropPendingCollectionReaper before running dbtests
- Closed
-
SERVER-18263 apply_ops1.js fails if run alone against a master slave deployment.
- Closed
-
SERVER-18264 index_many.js fails if run alone against a master slave deployment.
- Closed