Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-22615

Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO when doing new replicaset member initialsync

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.4.12
    • Component/s: Storage
    • None
    • ALL
    • Hide

      Primary running. Add new secondary. Start new secondary and primary crashed with logs below.

      Show
      Primary running. Add new secondary. Start new secondary and primary crashed with logs below.

      We use sharded cluster of MongoDB.
      When i start initialSync of new member os first shard i get an crash and error on primary:
      Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      And new secondary get status "SECONDARY" with 12 datafiles instead of 3000+.
      What i need to do next?

      Mon Feb 15 07:00:37.148 [repl writer worker 1] Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      0xdea5b1 0xdabd7b 0xdac2bc 0x6ee71f 0x6fb76c 0xacb1cb 0xa96d38 0xa9a6bc 0xa9c8d7 0xa756e8 0xc32823 0xc31f68 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xdabd7b]
      /usr/bin/mongod() [0xdac2bc]
      /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x5bf) [0x6ee71f]
      /usr/bin/mongod(_ZN5mongo7BSONObjC1EPKc+0x3c) [0x6fb76c]
      /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x6b) [0xacb1cb]
      /usr/bin/mongod() [0xa96d38]
      /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d1c) [0xa9a6bc]
      /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa9c8d7]
      /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0x628) [0xa756e8]
      /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x713) [0xc32823]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x48) [0xc31f68]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      Mon Feb 15 07:00:37.208 [repl writer worker 1] ERROR: writer worker caught exception: BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      on: { ts: Timestamp 1455501634000|47, h: 4868822648138918134, v: 2, op: "i", ns: "grid_fs.fs.chunks", fromMigrate: true, o:
      { _id: ObjectId('51bc7682d5d30701318599d0'), n: 0, data: BinData , files_id: ObjectId('51bc71a5f7c07966503f15f8') }
      }
      Mon Feb 15 07:00:37.208 [repl writer worker 1] Fatal Assertion 16360
      0xdea5b1 0xdaa433 0xc3204c 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xdaa433]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc3204c]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      Mon Feb 15 07:00:37.210 [repl writer worker 1]
      ***aborting after fassert() failure
      Mon Feb 15 07:00:37.210 Got signal: 6 (Aborted).
      Mon Feb 15 07:00:37.213 Backtrace:
      0xdea5b1 0x6d0f29 0x7fabc2d554f0 0x7fabc2d55475 0x7fabc2d586f0 0xdaa46e 0xc3204c 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6d0f29]
      /lib/x86_64-linux-gnu/libc.so.6(+0x324f0) [0x7fabc2d554f0]
      /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7fabc2d55475]
      /lib/x86_64-linux-gnu/libc.so.6(abort+0x180) [0x7fabc2d586f0]
      /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xdaa46e]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc3204c]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      

            Assignee:
            Unassigned Unassigned
            Reporter:
            metikovvadim Metikov Vadim
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: