Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-69396

Modify time-series inserts to use damages instead of full-document updates

XMLWordPrintableJSON

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Execution

      Running TSBS with the default granularity of "seconds" yielded a slight decrease in throughput but a very large improvement in I/O reduction from WiredTiger if we use damages.

      To achieve this it requires certain conditions:

      • Modify the time-series inserts code paths to use damages instead of performing full-document updates. This will require work on index management (done in SERVER-69365) and discovering if indices need to be updated (done in SERVER-69368).
      • Avoid materializing the full-document changes to the bucket as they will not be needed.
      • Reuse cursors used by the operations to avoid repositioning in WiredTiger (it will cause full-document materialization). This API is exposed in SERVER-69355.
      • Avoid cursor repositioning for unordered inserts as per SERVER-69362.
      • Wait until WT-9668 is merged to fix overlap detection in WT_MODIFY.

            Assignee:
            backlog-server-execution [DO NOT USE] Backlog - Storage Execution Team
            Reporter:
            jordi.olivares-provencio@mongodb.com Jordi Olivares Provencio
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: