2018-03-19T10:19:03.556+0300 I NETWORK  [conn1518606] end connection 10.0.0.61:45984 (424 connections now open)
2018-03-19T10:19:03.556+0300 I NETWORK  [conn1518715] end connection 10.0.0.61:48648 (423 connections now open)
2018-03-19T10:19:03.556+0300 I NETWORK  [conn1518393] end connection 10.0.0.61:34434 (422 connections now open)
2018-03-19T10:19:04.496+0300 I NETWORK  [listener] connection accepted from 10.0.0.66:60734 #1518749 (423 connections now open)
2018-03-19T10:19:04.530+0300 I NETWORK  [listener] connection accepted from 10.0.0.109:60032 #1518750 (424 connections now open)
2018-03-19T10:19:04.568+0300 I ACCESS   [conn1518749]  authenticate db: $external { authenticate: 1, user: "mongo-exporter", mechanism: "MONGODB-X509", $db: "$external" }
2018-03-19T10:19:04.571+0300 I NETWORK  [conn1518750] received client metadata from 10.0.0.109:60032 conn: { driver: { name: "NetworkInterfaceASIO-ShardRegistry", version: "3.6.3" }, os: { type: "Linux", name: "Ubuntu", architecture: "x86_64", version: "16.04" } }
2018-03-19T10:19:04.571+0300 I ACCESS   [conn1518750]  authenticate db: $external { authenticate: 1, mechanism: "MONGODB-X509", user: "sh0-rs3-0", $db: "$external" }
2018-03-19T10:19:04.572+0300 I SHARDING [conn1518750] Refreshing chunks for collection deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 based on version 0|0||000000000000000000000000
2018-03-19T10:19:04.581+0300 I SHARDING [ConfigServerCatalogCacheLoader-7850] Cache loader remotely refreshed for collection deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 from collection version 0|0||000000000000000000000000 and found collection version 1|3||5aaf6468b34d08a08930feda
2018-03-19T10:19:04.581+0300 I SHARDING [ConfigServerCatalogCacheLoader-7850] Cache loader found enqueued metadata from 1|0||5aaf6468b34d08a08930feda to 1|3||5aaf6468b34d08a08930feda and no persisted metadata, GTE cache version 0|0||000000000000000000000000
2018-03-19T10:19:04.581+0300 I SHARDING [ConfigServerCatalogCacheLoader-7850] Refresh for collection deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 took 9 ms and found version 1|3||5aaf6468b34d08a08930feda
2018-03-19T10:19:04.582+0300 I SHARDING [conn1518750] Marking collection deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 as sharded with collection version: 1|3||5aaf6468b34d08a08930feda, shard version: 0|0||5aaf6468b34d08a08930feda
2018-03-19T10:19:04.582+0300 I SHARDING [migrateThread] Starting receiving end of migration of chunk { startDate: MinKey } -> { startDate: -4611686018427387900 } for collection deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 from sh0-rs3/sh0-rs3-0.ohm.pw:27021,sh0-rs3-1.ohm.pw:27021,sh0-rs3-2.ohm.pw:27021 at epoch 5aaf6468b34d08a08930feda with session id sh0-rs3_rs0_5aaf64688825cf763e77eb9c
2018-03-19T10:19:04.584+0300 I STORAGE  [migrateThread] createCollection: deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 with provided UUID: 1b30b336-aaee-408b-bb73-91dba50bd291
2018-03-19T10:19:04.584+0300 I STORAGE  [ShardServerCatalogCacheLoader-7860] createCollection: config.cache.chunks.deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 with generated UUID: 1b8beb11-b369-4658-96bc-962de2d94d12
2018-03-19T10:19:04.597+0300 I NETWORK  [conn1518749] end connection 10.0.0.66:60734 (423 connections now open)
2018-03-19T10:19:04.625+0300 I INDEX    [migrateThread] build index on: deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 properties: { v: 2, key: { startDate: 1 }, name: "startDate_1", ns: "deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1", background: true }
2018-03-19T10:19:04.625+0300 I INDEX    [migrateThread]          building index using bulk method; build may temporarily use up to 2049 megabytes of RAM
2018-03-19T10:19:04.629+0300 I INDEX    [ShardServerCatalogCacheLoader-7860] build index on: config.cache.chunks.deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 properties: { v: 2, key: { lastmod: 1 }, name: "lastmod_1", ns: "config.cache.chunks.deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1" }
2018-03-19T10:19:04.629+0300 I INDEX    [ShardServerCatalogCacheLoader-7860]     building index using bulk method; build may temporarily use up to 8196 megabytes of RAM
2018-03-19T10:19:04.633+0300 I INDEX    [migrateThread] build index on: deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 properties: { v: 2, key: { endDate: 1 }, name: "endDate_1", ns: "deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1", background: true }
2018-03-19T10:19:04.633+0300 I INDEX    [migrateThread]          building index using bulk method; build may temporarily use up to 2049 megabytes of RAM
2018-03-19T10:19:04.635+0300 I INDEX    [ShardServerCatalogCacheLoader-7860] build index done.  scanned 0 total records. 0 secs
2018-03-19T10:19:04.639+0300 I INDEX    [migrateThread] build index on: deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 properties: { v: 2, key: { accountId: 1 }, name: "accountId_1", ns: "deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1", background: true }
2018-03-19T10:19:04.639+0300 I INDEX    [migrateThread]          building index using bulk method; build may temporarily use up to 2049 megabytes of RAM
2018-03-19T10:19:04.643+0300 I INDEX    [migrateThread] build index on: deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 properties: { v: 2, key: { startDate: "hashed" }, name: "startDate_hashed", ns: "deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1", background: true }
2018-03-19T10:19:04.643+0300 I INDEX    [migrateThread]          building index using bulk method; build may temporarily use up to 2049 megabytes of RAM
2018-03-19T10:19:04.644+0300 I SHARDING [migrateThread] Scheduling deletion of any documents in deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 range [{ startDate: MinKey }, { startDate: -4611686018427387900 }) before migrating in a chunk covering the range
2018-03-19T10:19:04.644+0300 I SHARDING [Collection Range Deleter] No documents remain to delete in deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 range [{ startDate: MinKey }, { startDate: -4611686018427387900 })
2018-03-19T10:19:04.644+0300 I SHARDING [migrateThread] Finished deleting deliveryclub.ancore_adwords_crm_adgroup_audience_daily_v1 range [{ startDate: MinKey }, { startDate: -4611686018427387900 })
2018-03-19T10:19:04.645+0300 I ASIO     [NetworkInterfaceASIO-ShardRegistry-0] Connecting to sh0-rs3-0.ohm.pw:27021
2018-03-19T10:19:04.645+0300 I SHARDING [migrateThread] Waiting for replication to catch up before entering critical section
2018-03-19T10:19:04.685+0300 I ASIO     [NetworkInterfaceASIO-ShardRegistry-0] Successfully connected to sh0-rs3-0.ohm.pw:27021, took 40ms (1 connections now open to sh0-rs3-0.ohm.pw:27021)
2018-03-19T10:19:04.732+0300 F -        [sessionCatalogMigration-sh0-rs3_rs0_5aaf64688825cf763e77eb9c] Invariant failure oplogEntry.getWallClockTime() src/mongo/db/s/session_catalog_migration_destination.cpp 246
2018-03-19T10:19:04.733+0300 F -        [sessionCatalogMigration-sh0-rs3_rs0_5aaf64688825cf763e77eb9c]

***aborting after invariant() failure


2018-03-19T10:19:04.928+0300 F -        [sessionCatalogMigration-sh0-rs3_rs0_5aaf64688825cf763e77eb9c] Got signal: 6 (Aborted).

 0x563c9f0ed071 0x563c9f0ec289 0x563c9f0ec76d 0x7f1897060390 0x7f1896cba428 0x7f1896cbc02a 0x563c9d86525c 0x563c9df0dca8 0x563c9f1fc170 0x7f18970566ba 0x7f1896d8c41d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"563C9CEDB000","o":"2212071","s":"_ZN5mongo15printStackTraceERSo"},{"b":"563C9CEDB000","o":"2211289"},{"b":"563C9CEDB000","o":"221176D"},{"b":"7F189704F000","o":"11390"},{"b":"7F1896C85000","o":"35428","s":"gsignal"},{"b":"7F1896C85000","o":"3702A","s":"abort"},{"b":"563C9CEDB000","o":"98A25C","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"563C9CEDB000","o":"1032CA8","s":"_ZN5mongo34SessionCatalogMigrationDestination31_retrieveSessionStateFromSourceEPNS_14ServiceContextE"},{"b":"563C9CEDB000","o":"2321170"},{"b":"7F189704F000","o":"76BA"},{"b":"7F1896C85000","o":"10741D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.6.3", "gitVersion" : "9586e557d54ef70f9ca4b43c26892cd55257e1a5", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.4.0-112-generic", "version" : "#135-Ubuntu SMP Fri Jan 19 11:48:36 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "563C9CEDB000", "elfType" : 3, "buildId" : "7A0DE17E89E4F8A85A88DD691D5A6B4053CB0C42" }, { "b" : "7FFD131C7000", "elfType" : 3, "buildId" : "FA97F4849697BBE252BA1F7FB2316979E93E61DE" }, { "b" : "7F1898244000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "6EF73266978476EF9F2FD2CF31E57F4597CB74F8" }, { "b" : "7F1897FDB000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "DCF10134B91ED2139E3E8C72564668F5CDBA8522" }, { "b" : "7F1897B97000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "1649272BE0CA9FA22F082DC86372B6C9959779B0" }, { "b" : "7F189798F000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "89C34D7A182387D76D5CDA1F7718F5D58824DFB3" }, { "b" : "7F189778B000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "8CC8D0D119B142D839800BFF71FB71E73AEA7BD4" }, { "b" : "7F1897482000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "DFB85DE42DAFFD09640C8FE377D572DE3E168920" }, { "b" : "7F189726C000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434" }, { "b" : "7F189704F000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "CE17E023542265FC11D9BC8F534BB4F070493D30" }, { "b" : "7F1896C85000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B5381A457906D279073822A5CEB24C4BFEF94DDB" }, { "b" : "7F189845F000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "5D7B6259552275A3C17BD4C3FD05F5A6BF40CAA5" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x563c9f0ed071]
 mongod(+0x2211289) [0x563c9f0ec289]
 mongod(+0x221176D) [0x563c9f0ec76d]
 libpthread.so.0(+0x11390) [0x7f1897060390]
 libc.so.6(gsignal+0x38) [0x7f1896cba428]
 libc.so.6(abort+0x16A) [0x7f1896cbc02a]
 mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0x0) [0x563c9d86525c]
 mongod(_ZN5mongo34SessionCatalogMigrationDestination31_retrieveSessionStateFromSourceEPNS_14ServiceContextE+0x22A8) [0x563c9df0dca8]
 mongod(+0x2321170) [0x563c9f1fc170]
 libpthread.so.0(+0x76BA) [0x7f18970566ba]
 libc.so.6(clone+0x6D) [0x7f1896d8c41d]
-----  END BACKTRACE  -----