-
Type: Improvement
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: None
-
(copied to CRM)
-
13
-
Storage NYC 2019-01-14, Storage NYC 2019-01-28, Storage NYC 2019-02-25, Storage Engines 2019-06-03, Storage Engines 2019-06-17
-
v4.2, v4.0
WT moving pages in and out of lookaside has had bugs that have caused failures in MongoDB testing. However, MongoDB testing often randomizes which tests are run concurrently that make it hard to line up a "heavy workload" test that results in cache pressure and lookaside activity to run with the test that observes a symptom caused by a lookaside bug. This makes reproducing and isolating test failures difficult.
Furthermore, I suspect organic cache pressure creates biases with respect to which pages eviction will write out to lookaside. Because MongoDB creates WT tables for meta-information, there may be additional cases where, despite creating lookaside activity in general, not all of the MongoDB code paths are affected.
If WT could be configured to choose to write more pages out to lookaside, even when there's no cache pressure, this would ease the effort required to reproduce problems. My assumption is that an easy implementation would still be susceptible to biases in which page gets written out. A bonus would be writing pages out to lookaside where each table has an equal chance of having its blocks being written to lookaside. The bonus feature is just a nice to have. If it's not trivial, that should be dropped as a goal; if lookaside is engaged in low-cache pressure scenarios, MongoDB can more easily have the tables it cares about be the primary ones being accessed.
- causes
-
WT-4895 Fix debug eviction mode so it chooses skew more randomly
- Closed
- is related to
-
WT-4750 Sweep can remove active lookaside records when files are closed and re-opened
- Closed
- related to
-
SERVER-38824 Investigate dropped collections coming back into existence
- Backlog
-
SERVER-42011 Create concurrency suites to enable WiredTiger eviction debugging mode
- Closed
-
WT-4296 Add aggressive mode to sweep server
- Closed