Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-89233

cache pressure causes one bucket per single document with time series collections

    • Storage Execution
    • Fully Compatible
    • ALL
    • v8.0
    • Hide

      In a sharded mongodb cluster (in my case 7.0.4).
      Insert time-series collection into a sharded database. Either keep inserting, or in my case, delete the one, and re-insert the same time-series collection.
      The bucket count equals the document count.

      Show
      In a sharded mongodb cluster (in my case 7.0.4). Insert time-series collection into a sharded database. Either keep inserting, or in my case, delete the one, and re-insert the same time-series collection. The bucket count equals the document count.
    • Execution Team 2024-04-29, Execution Team 2024-05-13, Execution Team 2024-06-10, Execution Team 2024-06-24, Execution Team 2024-07-08, Execution Team 2024-07-22, Execution Team 2024-09-16, Execution Team 2024-09-30, Execution Team 2024-10-14
    • 0

      A while (several days usually) after starting up the database (sharded cluster), newly inserted time series collection will have exactly (as far as I personally observed) as many buckets as documents, regardless of granularity or metafield settings. The stats() command shows that the buckets were closed due to cache pressure (numBucketsClosedDueToCachePressure).

      I also experience the issue with after deleting a time series collection, and inserting either the same or other collections.

      This behavior has also been documented/observed in:
      https://www.mongodb.com/community/forums/t/suboptimal-bucket-creation-in-timeseries-collection-due-to-cache-pressure/249863
      https://dba.stackexchange.com/questions/336013/mongodb-timeseries-data-at-high-load-causes-cache-pressure-in-time
      https://www.mongodb.com/community/forums/t/why-timeseries-bucket-count-is-different-on-2-independent-environment-with-same-data/265066/

            Assignee:
            henrik.edin@mongodb.com Henrik Edin
            Reporter:
            zongli@amzracing.ch Zongji Li
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: