Uploaded image for project: 'Compass '
  1. Compass
  2. COMPASS-6702

Investigate changes in PM-2724: Improving Time-Series Scalability

    • Type: Icon: Investigation Investigation
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • No version
    • Affects Version/s: None
    • Component/s: None
    • None
    • Not Needed

      Original Downstream Change Summary

      There will be some required changes to documentation on a few subjects, specifically collection creation options and indexing options for time-series collections. We are planning to sync up with the docs team (Nick Villahermosa) when we complete the work for the new options and behaviors.

      Description of Linked Ticket

      Epic Summary

      Summary

      Add additional scalability features to better handle scalability challenges in Time Series collections and provide users with more flexibility options based on their use case such as: 

      • Bucket re-opening to ensure better dynamic bucketing and support more use cases such as high cardinality or high cardinality with asymmetric ingestion rates
      • Fixed time-range bucketing to provide users with more storage modeling flexibility and better index usage for use cases that rely on fixed period roll-ups and do not need handling for overlapping buckets/out-of-order data to avoid overlapping buckets
      • A command to support rewrites for merge/split/consolidation of buckets
      • Unique indexing to support duplicate data protection at the database layer

      Motivation

      Time Series data by nature is demanding and challenging. While almost all users have time series use cases, creating a solution that generally supports these demands, challenges, and use cases with the scalability needed both dynamically and at the users control is something that will allow us to support many more customers requirements and move closer to a full-replacement TSDB

      Documentation

      Scope Document
      Technical Design Document
      Docs Update

            Assignee:
            Unassigned Unassigned
            Reporter:
            backlog-server-pm Backlog - Core Eng Program Management Team
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: