Scale BucketCatalog memory limit based on RAM size

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Major - P3
    • 5.2.0, 5.0.6
    • Affects Version/s: None
    • Component/s: None
    • v5.1, v5.0
    • Execution Team 2021-11-15, Execution Team 2021-11-29, Execution Team 2021-12-13
    • 50
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      Currently the BucketCatalog has a fixed threshold of 100MB before it will begin to evict idle buckets. While this is an appropriate limit for machines with ~4GB of RAM or less, it's less than ideal for larger instances. We want to consider increasing it to 2% or 3% of system RAM so that we can use vertical scaling to handle high-cardinality use cases.

            Assignee:
            Dan Larkin-York
            Reporter:
            Dan Larkin-York
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: