Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-19136

oplog seems to slow down everything

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.0.1, 3.0.3
    • Component/s: Performance, WiredTiger
    • None
    • ALL

      We are using mongodb v3.0.1 and v3.0.3 for two different replSets, each consisting of 3 physical members. Both are using wiredTiger with defaults settings. After some weeks of normal operation, we observed that queries became significantly slower.

      By analyzing the log files with mlogvis, we found an unusal high amount of operations on the oplog which did not exists before the slowdown. The longest oplog queries took up to 12 seconds!
      Our "solution" was to stepDown the primary, which immediately brought back the replSet to normal speed. 90 minutes later we elected the old (slow) primary again to see whether the problem is reproduceable or not. Until now all is running fast as usual.

      Please see attached two screenshots produced by mlogvis. On the first you can clearly see the long during queries on local.oplog.rs, the stepDown and the re-election. The second screenshot shows the analyzed log file of yesterday, where all was still normal as usual.
      We can provide the log files if they are kept confidentially.

        1. _25-06-2015_19-14.jpeg
          _25-06-2015_19-14.jpeg
          248 kB
        2. _25-06-2015_19-15.jpeg
          _25-06-2015_19-15.jpeg
          165 kB

            Assignee:
            ramon.fernandez@mongodb.com Ramon Fernandez Marina
            Reporter:
            kay.agahd@idealo.de Kay Agahd
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: