Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-61557

Get rid of top chunk migration

    • Type: Icon: Task Task
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Sharding
    • Sharding EMEA
    • Sharding EMEA 2023-02-20, Sharding EMEA 2023-03-06, Sharding EMEA 2023-03-20
    • 3

      The top chunk migration was thought as a way to distribute the write load for applications inserting a lot of documents with non-hashed incremental shard keys.

      It turns out that for heavy workloads it could cause more harm than good:

      • Trying to move the right-most chunk while writing on it could result in very long migrations that can't reach the catch-up phase and eventually fail after hours.
      • In a balanced environment, it results in ping-pong (moving continuously the top chunk on another shard, then split, then move back) that can bring to increased migrations unavailability due to the waiting for overlapping range deletions to finish on the receiver.

            Assignee:
            pierlauro.sciarelli@mongodb.com Pierlauro Sciarelli
            Reporter:
            pierlauro.sciarelli@mongodb.com Pierlauro Sciarelli
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: