Loading...

XML

Word

Printable

JSON

Type: Improvement
Resolution: Fixed
Priority: Major - P3
Fix Version/s: 4.2.25, 4.4.25, 5.0.22, 6.0.11, 7.0.3
Affects Version/s: 4.2.24, 4.4.24, 5.0.20
Component/s: Sharding
Labels:

Assigned Teams:

Sharding EMEA
Backwards Compatibility:
Fully Compatible
Backport Requested:

v7.1, v7.0, v6.0, v5.0, v4.4, v4.2
Sprint:
Sharding EMEA 2023-09-18, Sharding EMEA 2023-10-02, Sharding EMEA 2023-10-16, Sharding EMEA 2023-10-30
Case:
Confidence Status:
None
Work Order:
3

Aha! Reference:
None
Tracking Level:
None
Risk Status:
None
Exec Notes:
None
Goal Name:
None
Goal Link:
None

On every round the sharding balancer constructs a histogram of where the chunks are places across the cluster. This histogram is produced through linear scan over all chunks in the chunk manager and because of this as the number of chunks grows, so grows its complexity.

Without redesigning how this histogram is maintained, we could still get significant performance boost if we switch it to use KeyString like the ChunkManager.

causes

SERVER-82325 Config server could invariant during balancer round

Closed

is duplicated by

SERVER-37810 Optimise balancer performance with zone sharding

Closed

related to

SERVER-82365 Optimize the construction of the balancer's collection distribution status histogram (2nd attempt)

Closed

Assignee:: Tommaso Tocci
Reporter:: Kaloian Manassiev
Participants:: Githook User, Kaloian Manassiev, Pierlauro Sciarelli, Tommaso Tocci
Votes:: 1 Vote for this issue
Watchers:: 14 Start watching this issue

Created:: Apr 03 2019 12:07:38 PM UTC
Updated:: Dec 21 2023 07:51:49 PM UTC
Resolved:: Oct 19 2023 05:02:10 PM UTC
Confidence Status Last Update:: 13/Sep/23 11:02 AM

Details

Description

Attachments

Issue Links

Activity

People

Dates