Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-13502

Compaction can prevent backups

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Backup, Compaction
    • None
    • Storage Engines
    • StorEng - Defined Pipeline

      In HELP-63834 a compaction prevented a backup cursor (at a high level) from being opened (on MongoDB 5.0.x).

      At a higher level, MongoDB gets the checkpoint timestamp before opening a backup cursor, then opens the WT backup cursor, and then queries the checkpoint timestamp a 2nd time. If they match, the system can be assured that the backup is at that timestamp for point-in-time restores. If they don't match the system closes the backup cursor and retries several times for the timestamps to match and then finally gives an error.

      In the ticket, a compaction prevented the backup from happening because WT does a lot of checkpoints internally which will keep moving the checkpoint timestamp.

      This ticket should consider if the introduction of background compaction will exacerbate this potential issue. If so, how can we mitigate it?

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            sue.loverso@mongodb.com Susan LoVerso
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

              Created:
              Updated: