Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-14063

Implement a preliminary WiredTiger performance test.

    • Storage Engines
    • 8
    • StorEng - 2025-02-14

      To get early signal, and to uncover any surprises we should implement a live restore performance test of sorts. The test will run as follows:

      1. A database will be populated with 500m records. Is will serve as both the database to live restore from and the database to apply CRUD operations to.
      2. Given the database perform two runs of CRUD operations, one run without live restore (which means that it is simply crud on top of an already populated databases) and a second run which live restores from the database while performing CRUD operations. Therefore we can compare the read and write latency metrics between the two.

      The metrics should be uploaded as part of an evergreen task so that change point analysis can be performed on them.

      At this stage the metrics outputted by the live restore run will serve as a baseline going into the future, additionally if they look particularly bad a performance investigation may be required.

      To avoid reinventing the wheel leverage the btree-500m wtperf tests.

        1. Screenshot 2025-02-07 at 2.14.33 pm.png
          Screenshot 2025-02-07 at 2.14.33 pm.png
          163 kB
        2. lr-fg-server-complete-worker-writes.png
          lr-fg-server-complete-worker-writes.png
          393 kB
        3. lr-fg-server-complete-worker-reads.png
          lr-fg-server-complete-worker-reads.png
          335 kB
        4. lr-fg-server-complete-eviction-writes.png
          lr-fg-server-complete-eviction-writes.png
          460 kB
        5. lr-fg-server-complete.png
          lr-fg-server-complete.png
          411 kB
        6. lr-fg-server.svg
          601 kB
        7. lr-fg-no-server-worker-writes.png
          lr-fg-no-server-worker-writes.png
          418 kB
        8. lr-fg-no-server-worker-reads.png
          lr-fg-no-server-worker-reads.png
          345 kB
        9. lr-fg-no-server-eviction-writes.png
          lr-fg-no-server-eviction-writes.png
          446 kB
        10. lr-fg-no-server.svg
          374 kB
        11. lr-fg-no-server.png
          lr-fg-no-server.png
          689 kB

            Assignee:
            sean.watt@mongodb.com Sean Watt
            Reporter:
            luke.pearson@mongodb.com Luke Pearson
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: