Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6251

Fix splits to reduce the size of index files

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT10.0.0, 4.4.0-rc7, 4.7.0
    • Affects Version/s: None
    • Component/s: None
    • None
    • 8
    • Storage - Ra 2020-06-01

      WT-6082 worked towards storing the validity window on the data files only when really needed. The driving workload behind that improvement was WiredTiger's simple operations using wtperf. wtperf doesn't use timestamps and only relies on the txn-ids. We noticed that we were storing txn-ids on the data files all the time, causing a performance hit and much larger data file sizes. Having fixed WT-6082, we got the expected simple operation's performance back and reduced the data file sizes.

      Before WT-6082, in 4.4-rc5 mark.callaghan reported _id index sizes that were 3 to 4 times larger than 4.2.6. After WT-6082, in 4.4-rc6 the reported _id index size is 2 to 3 times larger. We need more work in investigating why we still have a larger index size than 4.2.6 and if we can do something to resolve that. I have filed this ticket to look into this issue.

        1. image-2020-05-18-09-30-44-631.png
          image-2020-05-18-09-30-44-631.png
          54 kB
        2. ftdc.rc6.linkbench.tar
          20.39 MB
        3. ftdc.rc6.ibench.tar
          60.21 MB

            Assignee:
            michael.cahill@mongodb.com Michael Cahill (Inactive)
            Reporter:
            sulabh.mahajan@mongodb.com Sulabh Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: