Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-36823

SeqFault on ReplicaSet Vanilla Setup

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: 4.0.1
    • Component/s: Stability
    • None
    • ALL
    • Hide

      Create a 3 node rs-cluster (using the official docker container 4.0.1)

      config used

      processManagement:
        fork: false
      net:
        port: 27017
        bindIp: 0.0.0.0
        ipv6: false
      storage:
        engine: wiredTiger
      operationProfiling:
        slowOpThresholdMs: 100
        mode: off
      replication:
        replSetName: rs0
      cloud:
        monitoring:
          free:
            state: off
      

      after rs.init is called, all nodes crash, one after eachother

       

      Show
      Create a 3 node rs-cluster (using the official docker container 4.0.1) config used processManagement: fork: false net: port: 27017 bindIp: 0.0.0.0 ipv6: false storage: engine: wiredTiger operationProfiling: slowOpThresholdMs: 100 mode: off replication: replSetName: rs0 cloud: monitoring: free: state: off after rs.init is called, all nodes crash, one after eachother  

      Disabling the free monitoring feature in the configuration, crashes the process when the instance tries to switch to Primary role

       

      2018-08-23T08:47:10.511+0000 F -        [rsSync-0] Invalid access at address: 0x18
      2018-08-23T08:47:10.530+0000 F -        [rsSync-0] Got signal: 11 (Segmentation fault).
       0x55a0bcdc5bf1 0x55a0bcdc4e09 0x55a0bcdc5476 0x7f155aeab890 0x7f155aea2fa0 0x55a0bb8b1530 0x55a0bb8b180a 0x55a0bb6ff8b6 0x55a0bb702053 0x55a0bb744859 0x55a0bb7ec5b8 0x55a0bb7ed089 0x55a0bb7dd5d6 0x55a0bc6499c3 0x55a0bc64a0ab 0x55a0bc5bc31c 0x55a0bc5bc81c 0x55a0bc5bd206 0x55a0bced50b0 0x7f155aea06db 0x7f155abc988f
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"55A0BAA48000","o":"237DBF1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"55A0BAA48000","o":"237CE09"},{"b":"55A0BAA48000","o":"237D476"},{"b":"7F155AE99000","o":"12890"},{"b":"7F155AE99000","o":"9FA0","s":"pthread_mutex_lock"},{"b":"55A0BAA48000","o":"E69530","s":"_ZN5mongo17FreeMonController8_enqueueESt10shared_ptrINS_14FreeMonMessageEE"},{"b":"55A0BAA48000","o":"E6980A","s":"_ZN5mongo17FreeMonController27notifyOnTransitionToPrimaryEv"},{"b":"55A0BAA48000","o":"CB78B6","s":"_ZN5mongo4repl39ReplicationCoordinatorExternalStateImpl34_shardingOnTransitionToPrimaryHookEPNS_16OperationContextE"},{"b":"55A0BAA48000","o":"CBA053","s":"_ZN5mongo4repl39ReplicationCoordinatorExternalStateImpl21onTransitionToPrimaryEPNS_16OperationContextEb"},{"b":"55A0BAA48000","o":"CFC859","s":"_ZN5mongo4repl26ReplicationCoordinatorImpl19signalDrainCompleteEPNS_16OperationContextEx"},{"b":"55A0BAA48000","o":"DA45B8","s":"_ZN5mongo4repl8SyncTail17_oplogApplicationEPNS0_11OplogBufferEPNS0_22ReplicationCoordinatorEPNS1_14OpQueueBatcherE"},{"b":"55A0BAA48000","o":"DA5089","s":"_ZN5mongo4repl8SyncTail16oplogApplicationEPNS0_11OplogBufferEPNS0_22ReplicationCoordinatorE"},{"b":"55A0BAA48000","o":"D955D6"},{"b":"55A0BAA48000","o":"1C019C3","s":"_ZN5mongo8executor22ThreadPoolTaskExecutor11runCallbackESt10shared_ptrINS1_13CallbackStateEE"},{"b":"55A0BAA48000","o":"1C020AB"},{"b":"55A0BAA48000","o":"1B7431C","s":"_ZN5mongo10ThreadPool10_doOneTaskEPSt11unique_lockISt5mutexE"},{"b":"55A0BAA48000","o":"1B7481C","s":"_ZN5mongo10ThreadPool13_consumeTasksEv"},{"b":"55A0BAA48000","o":"1B75206","s":"_ZN5mongo10ThreadPool17_workerThreadBodyEPS0_RKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE"},{"b":"55A0BAA48000","o":"248D0B0"},{"b":"7F155AE99000","o":"76DB"},{"b":"7F155AAA8000","o":"12188F","s":"clone"}],"processInfo":{ "mongodbVersion" : "4.0.1", "gitVersion" : "54f1582fc6eb01de4d4c42f26fc133e623f065fb", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.14.63-coreos", "version" : "#1 SMP Wed Aug 15 22:26:16 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "55A0BAA48000", "elfType" : 3, "buildId" : "277667F916B0411F06935B33EDB63802E236E5DA" }, { "b" : "7FFEF4915000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "7086491A8D34E558A8815B2170EAC44C3D5778CB" }, { "b" : "7F155C377000", "path" : "/usr/lib/x86_64-linux-gnu/libcurl.so.4", "elfType" : 3, "buildId" : "6AF728F07FFCDB4DAABE4F4CFC6EDB1401755DC7" }, { "b" : "7F155C15C000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "390E9CC4C215314B6D8ADE6D6E28F8518418039C" }, { "b" : "7F155BCE4000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.1", "elfType" : 3, "buildId" : "DA6345B41E06A9001B5C51DEAF0784BE9D49810D" }, { "b" : "7F155BA7A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.1", "elfType" : 3, "buildId" : "9787FF1FFFE8D82268D89F6BFA3AF07B3E9D140F" }, { "b" : "7F155B876000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "25AD56E902E23B490A9CCDB08A9744D89CB95BCC" }, { "b" : "7F155B66E000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "9826FBDF57ED7D6965131074CB3C08B1009C1CD8" }, { "b" : "7F155B2D0000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "A33761AB8FB485311B3C85BF4253099D7CABE653" }, { "b" : "7F155B0B8000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "039AE85FEF075EC14FE3528762A0645C8CF73B29" }, { "b" : "7F155AE99000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "28C6AADE70B2D40D1F0F3D0A1A0CAD1AB816448F" }, { "b" : "7F155AAA8000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B417C0BA7CC5CF06D1D1BED6652CEDB9253C60D0" }, { "b" : "7F155C5F6000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "64DF1B961228382FE18684249ED800AB1DCEAAD4" }, { "b" : "7F155A883000", "path" : "/usr/lib/x86_64-linux-gnu/libnghttp2.so.14", "elfType" : 3, "buildId" : "4F00E5207693FDC249DA42EC6472ACA6A7B929AE" }, { "b" : "7F155A666000", "path" : "/usr/lib/x86_64-linux-gnu/libidn2.so.0", "elfType" : 3, "buildId" : "BA5BF9A5C44F48C647E9D8270A5421AE81CCAD61" }, { "b" : "7F155A44A000", "path" : "/usr/lib/x86_64-linux-gnu/librtmp.so.1", "elfType" : 3, "buildId" : "69465D8AA6B19086ABF2455A703F9168BF82A69F" }, { "b" : "7F155A23C000", "path" : "/usr/lib/x86_64-linux-gnu/libpsl.so.5", "elfType" : 3, "buildId" : "CDAF1F1946846941F9D06414EC8C812D131A168E" }, { "b" : "7F1559FF1000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "451E2EC02C8F974B21D1CE47F5D2C21A21C16A9F" }, { "b" : "7F1559D9F000", "path" : "/usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2", "elfType" : 3, "buildId" : "0CDDF9D1F87FE7FF07D73DBE1D7CB57EE5BA802C" }, { "b" : "7F1559B91000", "path" : "/usr/lib/x86_64-linux-gnu/liblber-2.4.so.2", "elfType" : 3, "buildId" : "DD2893FC0AA3C58798F805D4C88EE086564D2EEB" }, { "b" : "7F1559974000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "EF3E006DFE3132A41D4D4DC0E407D6EA658E11C4" }, { "b" : "7F15595F6000", "path" : "/usr/lib/x86_64-linux-gnu/libunistring.so.2", "elfType" : 3, "buildId" : "62A44D226F3A74CF720305A52D3E876E214C248A" }, { "b" : "7F1559291000", "path" : "/usr/lib/x86_64-linux-gnu/libgnutls.so.30", "elfType" : 3, "buildId" : "F67AAC89381F6ACFE9979B24D4002668C4F70ABE" }, { "b" : "7F155905D000", "path" : "/usr/lib/x86_64-linux-gnu/libhogweed.so.4", "elfType" : 3, "buildId" : "842BDF0B0EAAB82E19F1EABFC38769F4040FBE31" }, { "b" : "7F1558E27000", "path" : "/usr/lib/x86_64-linux-gnu/libnettle.so.6", "elfType" : 3, "buildId" : "C20D4B3BA13FCDCC3BF6857689BA9FC70BE3F6A5" }, { "b" : "7F1558BA6000", "path" : "/usr/lib/x86_64-linux-gnu/libgmp.so.10", "elfType" : 3, "buildId" : "D40EA9B5EC5BC46799E4A412319617BD38BE9341" }, { "b" : "7F15588D0000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.3", "elfType" : 3, "buildId" : "AFF9A2A2B6ACB066BF450CC4A0772B9DC04299CB" }, { "b" : "7F155869E000", "path" : "/usr/lib/x86_64-linux-gnu/libk5crypto.so.3", "elfType" : 3, "buildId" : "04AADCB371B97A570756D69A0D5B3B0E6737E349" }, { "b" : "7F155849A000", "path" : "/lib/x86_64-linux-gnu/libcom_err.so.2", "elfType" : 3, "buildId" : "9E885FB7F54DA464A3D2A978C71C1178A6EC7512" }, { "b" : "7F155828F000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5support.so.0", "elfType" : 3, "buildId" : "27A5983855C50A37EFA526BB12EA48CDAE3B5FCA" }, { "b" : "7F1558074000", "path" : "/usr/lib/x86_64-linux-gnu/libsasl2.so.2", "elfType" : 3, "buildId" : "ABB7E3F40302E6509DAD1F91DFB1F04B6A5FD072" }, { "b" : "7F1557E33000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi.so.3", "elfType" : 3, "buildId" : "A1A98DB481968073636BBAECB561A3EA8ED198AE" }, { "b" : "7F1557B04000", "path" : "/usr/lib/x86_64-linux-gnu/libp11-kit.so.0", "elfType" : 3, "buildId" : "8DBD451EA5651283905E16FA7DFA9908688893A3" }, { "b" : "7F15578F1000", "path" : "/usr/lib/x86_64-linux-gnu/libtasn1.so.6", "elfType" : 3, "buildId" : "6036B89A3BB671B32E01464C0C82BFA016186352" }, { "b" : "7F15576ED000", "path" : "/lib/x86_64-linux-gnu/libkeyutils.so.1", "elfType" : 3, "buildId" : "F463E107B099910463BC32E837C73D341A52C27B" }, { "b" : "7F15574E4000", "path" : "/usr/lib/x86_64-linux-gnu/libheimntlm.so.0", "elfType" : 3, "buildId" : "C2376C5B831991591F1A67B976758185F86896D8" }, { "b" : "7F1557257000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.26", "elfType" : 3, "buildId" : "69BDEE5FA0FEEDF317308BE850F78761861D520A" }, { "b" : "7F1556FB5000", "path" : "/usr/lib/x86_64-linux-gnu/libasn1.so.8", "elfType" : 3, "buildId" : "315D74995AAA32DE4D15BA25F335066988B1B230" }, { "b" : "7F1556D7F000", "path" : "/usr/lib/x86_64-linux-gnu/libhcrypto.so.4", "elfType" : 3, "buildId" : "6673972A1C24A89EBAFBAE696188A4CB26C6DDEB" }, { "b" : "7F1556B69000", "path" : "/usr/lib/x86_64-linux-gnu/libroken.so.18", "elfType" : 3, "buildId" : "430827C33259C12248CF44B91A9A9821114376F5" }, { "b" : "7F1556961000", "path" : "/usr/lib/x86_64-linux-gnu/libffi.so.6", "elfType" : 3, "buildId" : "3555B5F599C9787DFDDBF9E8DF6F706B9044D985" }, { "b" : "7F1556738000", "path" : "/usr/lib/x86_64-linux-gnu/libwind.so.0", "elfType" : 3, "buildId" : "93A0931B1C2818F0EA224CE6FE5E31E84A9B55BB" }, { "b" : "7F1556529000", "path" : "/usr/lib/x86_64-linux-gnu/libheimbase.so.1", "elfType" : 3, "buildId" : "669D4CCE42FA4382796EFFCF0C16F459F4382C4C" }, { "b" : "7F15562DF000", "path" : "/usr/lib/x86_64-linux-gnu/libhx509.so.5", "elfType" : 3, "buildId" : "4B80C543356EE0AF9039EFE7C9EA1CC1F74C426A" }, { "b" : "7F1555FD6000", "path" : "/usr/lib/x86_64-linux-gnu/libsqlite3.so.0", "elfType" : 3, "buildId" : "9FD7B69263297314C83BB205234E182BD4D8B86A" }, { "b" : "7F1555D9E000", "path" : "/lib/x86_64-linux-gnu/libcrypt.so.1", "elfType" : 3, "buildId" : "810686AF0D5FD350A4FB1CC4B5AFF44A05C102CB" } ] }}
       mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x55a0bcdc5bf1]
       mongod(+0x237CE09) [0x55a0bcdc4e09]
       mongod(+0x237D476) [0x55a0bcdc5476]
       libpthread.so.0(+0x12890) [0x7f155aeab890]
       libpthread.so.0(pthread_mutex_lock+0x0) [0x7f155aea2fa0]
       mongod(_ZN5mongo17FreeMonController8_enqueueESt10shared_ptrINS_14FreeMonMessageEE+0x40) [0x55a0bb8b1530]
       mongod(_ZN5mongo17FreeMonController27notifyOnTransitionToPrimaryEv+0x8A) [0x55a0bb8b180a]
       mongod(_ZN5mongo4repl39ReplicationCoordinatorExternalStateImpl34_shardingOnTransitionToPrimaryHookEPNS_16OperationContextE+0x2C6) [0x55a0bb6ff8b6]
       mongod(_ZN5mongo4repl39ReplicationCoordinatorExternalStateImpl21onTransitionToPrimaryEPNS_16OperationContextEb+0xF3) [0x55a0bb702053]
       mongod(_ZN5mongo4repl26ReplicationCoordinatorImpl19signalDrainCompleteEPNS_16OperationContextEx+0x1D9) [0x55a0bb744859]
       mongod(_ZN5mongo4repl8SyncTail17_oplogApplicationEPNS0_11OplogBufferEPNS0_22ReplicationCoordinatorEPNS1_14OpQueueBatcherE+0xC48) [0x55a0bb7ec5b8]
       mongod(_ZN5mongo4repl8SyncTail16oplogApplicationEPNS0_11OplogBufferEPNS0_22ReplicationCoordinatorE+0x189) [0x55a0bb7ed089]
       mongod(+0xD955D6) [0x55a0bb7dd5d6]
       mongod(_ZN5mongo8executor22ThreadPoolTaskExecutor11runCallbackESt10shared_ptrINS1_13CallbackStateEE+0x1B3) [0x55a0bc6499c3]
       mongod(+0x1C020AB) [0x55a0bc64a0ab]
       mongod(_ZN5mongo10ThreadPool10_doOneTaskEPSt11unique_lockISt5mutexE+0x14C) [0x55a0bc5bc31c]
       mongod(_ZN5mongo10ThreadPool13_consumeTasksEv+0xBC) [0x55a0bc5bc81c]
       mongod(_ZN5mongo10ThreadPool17_workerThreadBodyEPS0_RKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x96) [0x55a0bc5bd206]
       mongod(+0x248D0B0) [0x55a0bced50b0]
       libpthread.so.0(+0x76DB) [0x7f155aea06db]
       libc.so.6(clone+0x3F) [0x7f155abc988f]
      -----  END BACKTRACE  -----
      
      

            Assignee:
            kelsey.schubert@mongodb.com Kelsey Schubert
            Reporter:
            zyclonite Lukas Prettenthaler
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: