Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-60982

Evaluate the performance of the new migration protocol

    • Type: Icon: Task Task
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Sharding
    • None
    • Sharding EMEA 2021-11-01, Sharding EMEA 2021-11-15

      The goal of this task is to evaluate the performance impact of acquiring the critical section on the recipient as part of the new migration protocol.

      More specifically, we would like to know:

      1. How long are we holding the CS on the donor and recipient compared to the previous implementation.
      2. Impact of the optimization proposed by Andy on the technical design document (i.e. skipping one hop).
      3. Are we overlapping the execution of the refresh of the filtering information on the donor with the one on the recipient?

      The proposed workload is to create a sharded collection with N chunks: N-1 chunks will be empty except one that will have some data (Q: should it be an input of the workload? IMO it could be interesting but not at the beginning).  Once everything is properly set up, the workload should move this chunk from the donor shard to another shard and get some metrics. We will repeat this process M times.

      Some considerations:

      • The baseline of the comparison should be master without our changes (i.e. we are going to compare the old migration protocol against the new one). We can take 5.2 without the feature flag, so we don't have any problem with the recent changes we did on the chunksize.

            Assignee:
            jordi.serra-torrens@mongodb.com Jordi Serra Torrens
            Reporter:
            sergi.mateo-bellido@mongodb.com Sergi Mateo Bellido
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: