Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-36099

FTDC for mongos is unworkably large for large installations

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 3.6.14, 4.1.12, 4.0.11
    • Affects Version/s: None
    • Component/s: Diagnostics
    • None
    • ALL
    • v4.0, v3.6
    • Security 2018-09-10, Service Arch 2019-04-22, Service Arch 2019-05-06, Service Arch 2019-05-20, Service Arch 2019-06-03

      For installations with hundreds of nodes, the number of metrics collected by mongos FTDC can be unworkably large. For example one cluster with ~500 nodes collects ~20k metrics (per sample), mostly due to connPoolStats. This creates problems for downstream consumers of this information, and also will severely limit the retention period for FTDC data.

      This is because connPoolStats records several metrics per (pool, host) pair. Some possible solutions

      • aggregate the information in some way before recording it to avoid the combinatorial explosion
      • remove this information altogether
      • add an option to remove it (off by default to avoid catching customers unawares?)

            Assignee:
            jesse@mongodb.com A. Jesse Jiryu Davis
            Reporter:
            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            15 Start watching this issue

              Created:
              Updated:
              Resolved: