2018-10-04T11:54:37.110-0400 I CONTROL [initandlisten] MongoDB starting : pid=23299 port=9007 dbpath=/tmp/mms-automation/test/output/data/process9007 64-bit host=jazzstep-2.local 2018-10-04T11:54:37.110-0400 I CONTROL [initandlisten] db version v4.0.3-rc0 2018-10-04T11:54:37.111-0400 I CONTROL [initandlisten] git version: 7ea530946fa7880364d88c8d8b6026bbc9ffa48c 2018-10-04T11:54:37.111-0400 I CONTROL [initandlisten] allocator: system 2018-10-04T11:54:37.112-0400 I CONTROL [initandlisten] modules: none 2018-10-04T11:54:37.112-0400 I CONTROL [initandlisten] build environment: 2018-10-04T11:54:37.113-0400 I CONTROL [initandlisten] distarch: x86_64 2018-10-04T11:54:37.113-0400 I CONTROL [initandlisten] target_arch: x86_64 2018-10-04T11:54:37.114-0400 I CONTROL [initandlisten] options: { config: "/tmp/mms-automation/test/output/data/process9007/automation-mongod.conf", net: { bindIp: "0.0.0.0", port: 9007 }, processManagement: { fork: true }, replication: { oplogSizeMB: 64, replSetName: "csrs" }, sharding: { clusterRole: "configsvr" }, storage: { dbPath: "/tmp/mms-automation/test/output/data/process9007", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", path: "/tmp/mms-automation/test/logs/run9007" } } 2018-10-04T11:54:37.115-0400 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=7680M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress), 2018-10-04T11:54:37.620-0400 I STORAGE [initandlisten] WiredTiger message [1538668477:620563][23299:0x7fff8d0db380], txn-recover: Set global recovery timestamp: 0 2018-10-04T11:54:37.679-0400 I RECOVERY [initandlisten] WiredTiger recoveryTimestamp. Ts: Timestamp(0, 0) 2018-10-04T11:54:37.741-0400 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2018-10-04T11:54:37.742-0400 I CONTROL [initandlisten] 2018-10-04T11:54:37.743-0400 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2018-10-04T11:54:37.744-0400 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2018-10-04T11:54:37.745-0400 I CONTROL [initandlisten] 2018-10-04T11:54:37.754-0400 I STORAGE [initandlisten] createCollection: local.startup_log with generated UUID: 47705803-a98b-462a-aa95-8f21d0c5c878 2018-10-04T11:54:37.798-0400 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/tmp/mms-automation/test/output/data/process9007/diagnostic.data' 2018-10-04T11:54:37.809-0400 I SHARDING [thread1] creating distributed lock ping thread for process ConfigServer (sleeping for 30000ms) 2018-10-04T11:54:37.809-0400 I SHARDING [shard registry reload] Periodic reload of shard registry failed :: caused by :: ReadConcernMajorityNotAvailableYet: could not get updated shard list from config server :: caused by :: Read concern majority reads are currently not possible.; will retry after 30s 2018-10-04T11:54:37.809-0400 I STORAGE [initandlisten] createCollection: local.replset.oplogTruncateAfterPoint with generated UUID: 313389e0-0274-42b9-a393-96f3c375b5ce 2018-10-04T11:54:37.854-0400 I STORAGE [initandlisten] createCollection: local.replset.minvalid with generated UUID: 16eb8238-5cb2-4f4a-9870-c82bac74956b 2018-10-04T11:54:37.900-0400 I REPL [initandlisten] Did not find local voted for document at startup. 2018-10-04T11:54:37.901-0400 I REPL [initandlisten] Did not find local Rollback ID document at startup. Creating one. 2018-10-04T11:54:37.902-0400 I STORAGE [initandlisten] createCollection: local.system.rollback.id with generated UUID: a7d1e2cc-c405-41f4-9e2a-bd758abecd9e 2018-10-04T11:54:37.943-0400 I REPL [initandlisten] Initialized the rollback ID to 1 2018-10-04T11:54:37.944-0400 I REPL [initandlisten] Did not find local replica set configuration document at startup; NoMatchingDocument: Did not find replica set configuration document in local.system.replset 2018-10-04T11:54:37.945-0400 I NETWORK [initandlisten] waiting for connections on port 9007 2018-10-04T11:54:37.945-0400 I SH_REFR [ConfigServerCatalogCacheLoader-0] Refresh for database config took 0 ms and found { _id: "config", primary: "config", partitioned: true } 2018-10-04T11:54:37.947-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Cannot create config.system.sessions until there are shards, will try again at the next refresh interval 2018-10-04T11:54:37.948-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Cannot create config.system.sessions until there are shards 2018-10-04T11:54:39.601-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58844 #1 (1 connection now open) 2018-10-04T11:54:39.602-0400 I ACCESS [conn1] SASL SCRAM-SHA-1 authentication failed for __system on local from client 10.1.25.36:58844 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:39.603-0400 I NETWORK [conn1] end connection 10.1.25.36:58844 (0 connections now open) 2018-10-04T11:54:39.605-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58845 #2 (1 connection now open) 2018-10-04T11:54:39.605-0400 I ACCESS [conn2] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:39.606-0400 I ACCESS [conn2] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 10.1.25.36:58845 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:39.607-0400 I NETWORK [conn2] end connection 10.1.25.36:58845 (0 connections now open) 2018-10-04T11:54:39.608-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58846 #3 (1 connection now open) 2018-10-04T11:54:39.626-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58853 #4 (2 connections now open) 2018-10-04T11:54:39.627-0400 I ACCESS [conn4] SASL SCRAM-SHA-1 authentication failed for __system on local from client 127.0.0.1:58853 ; AuthenticationFailed: It is not possible to authenticate as the __system user on servers started without a --keyFile parameter 2018-10-04T11:54:39.627-0400 I NETWORK [conn4] end connection 127.0.0.1:58853 (1 connection now open) 2018-10-04T11:54:39.628-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58854 #5 (2 connections now open) 2018-10-04T11:54:39.629-0400 I ACCESS [conn5] Supported SASL mechanisms requested for unknown user 'testuser@admin' 2018-10-04T11:54:39.629-0400 I ACCESS [conn5] SASL SCRAM-SHA-1 authentication failed for testuser on admin from client 127.0.0.1:58854 ; UserNotFound: Could not find user testuser@admin 2018-10-04T11:54:39.630-0400 I NETWORK [conn5] end connection 127.0.0.1:58854 (1 connection now open) 2018-10-04T11:54:39.630-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58855 #6 (2 connections now open) 2018-10-04T11:54:39.631-0400 I REPL [conn6] replSetInitiate admin command received from client 2018-10-04T11:54:39.635-0400 I REPL [conn6] replSetInitiate config object with 3 members parses ok 2018-10-04T11:54:39.636-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T11:54:39.636-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T11:54:39.639-0400 I REPL [conn6] ****** 2018-10-04T11:54:39.639-0400 I REPL [conn6] creating replication oplog of size: 64MB... 2018-10-04T11:54:39.640-0400 I STORAGE [conn6] createCollection: local.oplog.rs with generated UUID: 3445041f-fa87-4ad8-9d09-3e52c2093ad9 2018-10-04T11:54:39.640-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58860 #11 (3 connections now open) 2018-10-04T11:54:39.641-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58861 #12 (4 connections now open) 2018-10-04T11:54:39.641-0400 I NETWORK [conn11] received client metadata from 10.1.25.36:58860 conn11: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:39.647-0400 I NETWORK [conn12] received client metadata from 10.1.25.36:58861 conn12: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:39.654-0400 I STORAGE [conn6] Starting OplogTruncaterThread local.oplog.rs 2018-10-04T11:54:39.657-0400 I STORAGE [conn6] The size storer reports that the oplog contains 0 records totaling to 0 bytes 2018-10-04T11:54:39.658-0400 I STORAGE [conn6] Scanning the oplog to determine where to place markers for truncation 2018-10-04T11:54:39.736-0400 I REPL [conn6] ****** 2018-10-04T11:54:39.739-0400 I STORAGE [conn6] createCollection: local.system.replset with generated UUID: 202b69c6-1017-4f30-9c05-a45a3970a18d 2018-10-04T11:54:39.783-0400 I STORAGE [conn6] createCollection: admin.system.version with provided UUID: e7fcf9ad-9db8-444c-8c5f-7916f7ba4aba 2018-10-04T11:54:39.821-0400 I COMMAND [conn6] setting featureCompatibilityVersion to 4.0 2018-10-04T11:54:39.822-0400 I NETWORK [conn6] Skip closing connection for connection # 12 2018-10-04T11:54:39.822-0400 I NETWORK [conn6] Skip closing connection for connection # 11 2018-10-04T11:54:39.823-0400 I NETWORK [conn6] Skip closing connection for connection # 6 2018-10-04T11:54:39.823-0400 I NETWORK [conn6] Skip closing connection for connection # 3 2018-10-04T11:54:39.824-0400 I REPL [conn6] New replica set config in use: { _id: "csrs", version: 1, configsvr: true, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "jazzstep-2.local:9007", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "jazzstep-2.local:9008", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "jazzstep-2.local:9009", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('5bb637bf290d7fa45d18bef1') } } 2018-10-04T11:54:39.824-0400 I REPL [conn6] This node is jazzstep-2.local:9007 in the config 2018-10-04T11:54:39.825-0400 I REPL [conn6] transition to STARTUP2 from STARTUP 2018-10-04T11:54:39.826-0400 I REPL [conn6] Starting replication storage threads 2018-10-04T11:54:39.826-0400 I REPL [replexec-0] Member jazzstep-2.local:9008 is now in state STARTUP 2018-10-04T11:54:39.827-0400 I REPL [replexec-1] Member jazzstep-2.local:9009 is now in state STARTUP 2018-10-04T11:54:39.828-0400 I REPL [conn6] transition to RECOVERING from STARTUP2 2018-10-04T11:54:39.828-0400 I REPL [conn6] Starting replication fetcher thread 2018-10-04T11:54:39.829-0400 I REPL [conn6] Starting replication applier thread 2018-10-04T11:54:39.829-0400 I REPL [conn6] Starting replication reporter thread 2018-10-04T11:54:39.829-0400 I REPL [rsSync-0] Starting oplog application 2018-10-04T11:54:39.830-0400 I COMMAND [conn6] command local.system.replset command: replSetInitiate { replSetInitiate: { _id: "csrs", members: [ { priority: 1.0, tags: {}, slaveDelay: 0, votes: 1, host: "jazzstep-2.local:9007", hidden: false, arbiterOnly: false, buildIndexes: true, _id: 0 }, { tags: {}, _id: 1, arbiterOnly: false, hidden: false, slaveDelay: 0, host: "jazzstep-2.local:9008", buildIndexes: true, votes: 1, priority: 1.0 }, { host: "jazzstep-2.local:9009", arbiterOnly: false, buildIndexes: true, hidden: false, _id: 2, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], configsvr: true }, $readPreference: { mode: "secondaryPreferred" }, $db: "admin" } numYields:0 reslen:267 locks:{ Global: { acquireCount: { r: 15, w: 6, W: 2 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 51 } }, Database: { acquireCount: { r: 2, w: 3, W: 3 } }, Collection: { acquireCount: { r: 1, w: 2 } }, oplog: { acquireCount: { r: 1, w: 3 } } } protocol:op_query 198ms 2018-10-04T11:54:39.831-0400 I REPL [rsSync-0] transition to SECONDARY from RECOVERING 2018-10-04T11:54:39.832-0400 I REPL [rsSync-0] Resetting sync source to empty, which was :27017 2018-10-04T11:54:41.656-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58862 #13 (5 connections now open) 2018-10-04T11:54:41.657-0400 I NETWORK [conn13] end connection 10.1.25.36:58862 (4 connections now open) 2018-10-04T11:54:41.658-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58864 #14 (5 connections now open) 2018-10-04T11:54:41.659-0400 I NETWORK [conn14] end connection 10.1.25.36:58864 (4 connections now open) 2018-10-04T11:54:41.832-0400 I REPL [replexec-1] Member jazzstep-2.local:9008 is now in state STARTUP2 2018-10-04T11:54:41.835-0400 I REPL [replexec-0] Member jazzstep-2.local:9009 is now in state STARTUP2 2018-10-04T11:54:42.073-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58868 #15 (5 connections now open) 2018-10-04T11:54:42.075-0400 I NETWORK [conn15] received client metadata from 10.1.25.36:58868 conn15: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:42.084-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58869 #16 (6 connections now open) 2018-10-04T11:54:42.089-0400 I NETWORK [conn16] received client metadata from 10.1.25.36:58869 conn16: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:42.146-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58870 #17 (7 connections now open) 2018-10-04T11:54:42.150-0400 I NETWORK [conn17] received client metadata from 10.1.25.36:58870 conn17: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:42.158-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58871 #18 (8 connections now open) 2018-10-04T11:54:42.164-0400 I NETWORK [conn18] received client metadata from 10.1.25.36:58871 conn18: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:42.333-0400 I REPL [replexec-0] Member jazzstep-2.local:9008 is now in state SECONDARY 2018-10-04T11:54:42.336-0400 I REPL [replexec-0] Member jazzstep-2.local:9009 is now in state SECONDARY 2018-10-04T11:54:50.915-0400 I REPL [replexec-0] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-10-04T11:54:50.916-0400 I REPL [replexec-0] conducting a dry run election to see if we could be elected. current term: 0 2018-10-04T11:54:50.918-0400 I REPL [replexec-1] VoteRequester(term 0 dry run) received a yes vote from jazzstep-2.local:9008; response message: { term: 0, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538668479, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('000000000000000000000000') }, lastCommittedOpTime: Timestamp(0, 0), $clusterTime: { clusterTime: Timestamp(1538668479, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T11:54:50.919-0400 I REPL [replexec-1] dry election run succeeded, running for election in term 1 2018-10-04T11:54:50.919-0400 I STORAGE [replexec-1] createCollection: local.replset.election with generated UUID: e9e56bfa-00e9-446b-b091-db6c08132edc 2018-10-04T11:54:51.024-0400 I REPL [replexec-0] VoteRequester(term 1) received a yes vote from jazzstep-2.local:9009; response message: { term: 1, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538668479, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('000000000000000000000000') }, lastCommittedOpTime: Timestamp(0, 0), $clusterTime: { clusterTime: Timestamp(1538668479, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T11:54:51.025-0400 I REPL [replexec-0] election succeeded, assuming primary role in term 1 2018-10-04T11:54:51.032-0400 I REPL [replexec-0] transition to PRIMARY from SECONDARY 2018-10-04T11:54:51.039-0400 I REPL [replexec-0] Resetting sync source to empty, which was :27017 2018-10-04T11:54:51.044-0400 I REPL [replexec-0] Entering primary catch-up mode. 2018-10-04T11:54:51.049-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T11:54:51.057-0400 I REPL [replexec-0] Caught up to the latest optime known via heartbeats after becoming primary. 2018-10-04T11:54:51.057-0400 I REPL [replexec-0] Exited primary catch-up mode. 2018-10-04T11:54:51.058-0400 I REPL [replexec-0] Stopping replication producer 2018-10-04T11:54:52.085-0400 I NETWORK [conn15] end connection 10.1.25.36:58868 (7 connections now open) 2018-10-04T11:54:52.158-0400 I NETWORK [conn17] end connection 10.1.25.36:58870 (6 connections now open) 2018-10-04T11:54:52.858-0400 I STORAGE [rsSync-0] createCollection: config.chunks with generated UUID: 4acf8dfb-4484-4099-9f1f-ef02aa9c289f 2018-10-04T11:54:52.919-0400 I INDEX [rsSync-0] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:52.923-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:52.931-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:52.951-0400 I INDEX [rsSync-0] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, shard: 1, min: 1 }, name: "ns_1_shard_1_min_1", ns: "config.chunks" } 2018-10-04T11:54:52.955-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:52.964-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:52.989-0400 I INDEX [rsSync-0] build index on: config.chunks properties: { v: 2, unique: true, key: { ns: 1, lastmod: 1 }, name: "ns_1_lastmod_1", ns: "config.chunks" } 2018-10-04T11:54:52.993-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.001-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.011-0400 I STORAGE [rsSync-0] createCollection: config.migrations with generated UUID: 2c153a2c-409d-4354-af8d-2da4c3dbabcb 2018-10-04T11:54:53.068-0400 I INDEX [rsSync-0] build index on: config.migrations properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.migrations" } 2018-10-04T11:54:53.072-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.079-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.080-0400 I STORAGE [rsSync-0] createCollection: config.shards with generated UUID: 83541a41-5a83-4aaf-82e6-75a98c3b8535 2018-10-04T11:54:53.135-0400 I INDEX [rsSync-0] build index on: config.shards properties: { v: 2, unique: true, key: { host: 1 }, name: "host_1", ns: "config.shards" } 2018-10-04T11:54:53.138-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.144-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.145-0400 I STORAGE [rsSync-0] createCollection: config.locks with generated UUID: 9cd77010-8190-4320-9dc5-4063826f18a2 2018-10-04T11:54:53.206-0400 I INDEX [rsSync-0] build index on: config.locks properties: { v: 2, key: { ts: 1 }, name: "ts_1", ns: "config.locks" } 2018-10-04T11:54:53.210-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.219-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.249-0400 I INDEX [rsSync-0] build index on: config.locks properties: { v: 2, key: { state: 1, process: 1 }, name: "state_1_process_1", ns: "config.locks" } 2018-10-04T11:54:53.253-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.261-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.262-0400 I STORAGE [rsSync-0] createCollection: config.lockpings with generated UUID: 96955f75-9ab8-4b7a-9866-f90df07eda5e 2018-10-04T11:54:53.341-0400 I INDEX [rsSync-0] build index on: config.lockpings properties: { v: 2, key: { ping: 1 }, name: "ping_1", ns: "config.lockpings" } 2018-10-04T11:54:53.345-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.353-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.354-0400 I STORAGE [rsSync-0] createCollection: config.tags with generated UUID: 5c9b63ea-58bf-4bf6-b6f7-43dc7c12ac98 2018-10-04T11:54:53.417-0400 I INDEX [rsSync-0] build index on: config.tags properties: { v: 2, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.tags" } 2018-10-04T11:54:53.421-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.428-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.447-0400 I INDEX [rsSync-0] build index on: config.tags properties: { v: 2, key: { ns: 1, tag: 1 }, name: "ns_1_tag_1", ns: "config.tags" } 2018-10-04T11:54:53.451-0400 I INDEX [rsSync-0] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-10-04T11:54:53.458-0400 I INDEX [rsSync-0] build index done. scanned 0 total records. 0 secs 2018-10-04T11:54:53.459-0400 I STORAGE [rsSync-0] createCollection: config.version with generated UUID: 4653338a-2d1f-4b0d-be38-d33757459d0b 2018-10-04T11:54:53.503-0400 I STORAGE [rsSync-0] createCollection: config.transactions with generated UUID: 7e00fbae-25f1-43a1-a523-94d4c94e331a 2018-10-04T11:54:53.503-0400 I SHARDING [Balancer] CSRS balancer is starting 2018-10-04T11:54:53.544-0400 I REPL [rsSync-0] transition to primary complete; database writes are now permitted 2018-10-04T11:54:54.263-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58879 #20 (7 connections now open) 2018-10-04T11:54:54.264-0400 I NETWORK [conn20] received client metadata from 10.1.25.36:58879 conn20: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:54.273-0400 I STORAGE [conn20] Triggering the first stable checkpoint. Initial Data: Timestamp(1538668479, 1) PrevStable: Timestamp(0, 0) CurrStable: Timestamp(1538668492, 1) 2018-10-04T11:54:54.306-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58880 #21 (8 connections now open) 2018-10-04T11:54:54.310-0400 I NETWORK [conn21] received client metadata from 10.1.25.36:58880 conn21: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:54:54.612-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58881 #22 (9 connections now open) 2018-10-04T11:54:54.631-0400 I NETWORK [listener] connection accepted from 127.0.0.1:58884 #23 (10 connections now open) 2018-10-04T11:54:55.338-0400 I SHARDING [Balancer] CSRS balancer thread is recovering 2018-10-04T11:54:55.340-0400 I SHARDING [Balancer] CSRS balancer thread is recovered 2018-10-04T11:54:55.342-0400 I STORAGE [monitoring keys for HMAC] createCollection: admin.system.keys with generated UUID: 62bf9df9-59de-4f87-9f5e-10442108a0e0 2018-10-04T11:54:55.782-0400 I COMMAND [monitoring keys for HMAC] command admin.system.keys command: insert { insert: "system.keys", bypassDocumentValidation: false, ordered: true, documents: [ { _id: 6608530856820604950, purpose: "HMAC", key: BinData(0, 37B58BC1F135D30BF4A427E5D5CF6D2725CA8637), expiresAt: Timestamp(1546444493, 0) } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, $db: "admin" } ninserted:1 keysInserted:1 numYields:0 reslen:339 locks:{ Global: { acquireCount: { r: 6, w: 5 } }, Database: { acquireCount: { r: 1, w: 2, W: 3 } }, Collection: { acquireCount: { r: 1, w: 2 } }, oplog: { acquireCount: { w: 2 } } } protocol:op_msg 439ms 2018-10-04T11:55:00.980-0400 I ASIO [Replication] Ending connection to host jazzstep-2.local:9008 due to bad connection status; 1 connections to that host remain open 2018-10-04T11:55:07.833-0400 W SHARDING [replSetDistLockPinger] pinging failed for distributed lock pinger :: caused by :: LockStateChangeFailed: findAndModify query predicate didn't match any lock document 2018-10-04T11:55:19.954-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58969 #24 (11 connections now open) 2018-10-04T11:55:19.954-0400 I NETWORK [conn24] received client metadata from 10.1.25.36:58969 conn24: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.960-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58971 #25 (12 connections now open) 2018-10-04T11:55:19.961-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58972 #26 (13 connections now open) 2018-10-04T11:55:19.961-0400 I NETWORK [conn25] received client metadata from 10.1.25.36:58971 conn25: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.961-0400 I NETWORK [conn26] received client metadata from 10.1.25.36:58972 conn26: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.967-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58974 #27 (14 connections now open) 2018-10-04T11:55:19.968-0400 I NETWORK [conn27] received client metadata from 10.1.25.36:58974 conn27: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:19.980-0400 I STORAGE [conn27] createCollection: config.mongos with generated UUID: a968e6e5-dc3c-4cad-b545-d2e970cbad2b 2018-10-04T11:55:20.038-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58982 #28 (15 connections now open) 2018-10-04T11:55:20.045-0400 I NETWORK [conn28] received client metadata from 10.1.25.36:58982 conn28: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.054-0400 I NETWORK [conn25] Starting new replica set monitor for foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 2018-10-04T11:55:20.062-0400 I NETWORK [conn25] Successfully connected to jazzstep-2.local:9002 (1 connections now open to jazzstep-2.local:9002 with a 5 second timeout) 2018-10-04T11:55:20.063-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9001 (1 connections now open to jazzstep-2.local:9001 with a 5 second timeout) 2018-10-04T11:55:20.074-0400 I NETWORK [conn25] Successfully connected to jazzstep-2.local:9003 (1 connections now open to jazzstep-2.local:9003 with a 5 second timeout) 2018-10-04T11:55:20.076-0400 I ASIO [AddShard-TaskExecutor] Connecting to jazzstep-2.local:9001 2018-10-04T11:55:20.089-0400 I COMMAND [conn27] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538668519975), up: 0, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538668519, 1), signature: { hash: BinData(0, 31A880DB4C571B14B5313BD7A9E2EE0BB89D0A0E), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538668519, 1), t: 1 } }, $db: "config" } numYields:0 reslen:625 locks:{ Global: { acquireCount: { r: 5, w: 5 } }, Database: { acquireCount: { w: 4, W: 1 } }, Collection: { acquireCount: { w: 2 } }, oplog: { acquireCount: { w: 2 } } } protocol:op_msg 109ms 2018-10-04T11:55:20.131-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58990 #33 (16 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58992 #34 (17 connections now open) 2018-10-04T11:55:20.132-0400 I NETWORK [conn33] received client metadata from 10.1.25.36:58990 conn33: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.133-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58994 #35 (18 connections now open) 2018-10-04T11:55:20.133-0400 I NETWORK [conn34] received client metadata from 10.1.25.36:58992 conn34: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.140-0400 I NETWORK [conn35] received client metadata from 10.1.25.36:58994 conn35: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.159-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58997 #36 (19 connections now open) 2018-10-04T11:55:20.160-0400 I NETWORK [listener] connection accepted from 10.1.25.36:58999 #37 (20 connections now open) 2018-10-04T11:55:20.160-0400 I NETWORK [conn36] received client metadata from 10.1.25.36:58997 conn36: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.161-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59001 #38 (21 connections now open) 2018-10-04T11:55:20.161-0400 I NETWORK [conn37] received client metadata from 10.1.25.36:58999 conn37: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.163-0400 I NETWORK [conn38] received client metadata from 10.1.25.36:59001 conn38: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.163-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59003 #39 (22 connections now open) 2018-10-04T11:55:20.176-0400 I NETWORK [conn38] end connection 10.1.25.36:59001 (21 connections now open) 2018-10-04T11:55:20.179-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59004 #40 (22 connections now open) 2018-10-04T11:55:20.179-0400 I NETWORK [conn39] received client metadata from 10.1.25.36:59003 conn39: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.182-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59005 #41 (23 connections now open) 2018-10-04T11:55:20.182-0400 I NETWORK [conn40] received client metadata from 10.1.25.36:59004 conn40: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.185-0400 I NETWORK [conn37] end connection 10.1.25.36:58999 (22 connections now open) 2018-10-04T11:55:20.185-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59006 #42 (23 connections now open) 2018-10-04T11:55:20.185-0400 I NETWORK [conn39] end connection 10.1.25.36:59003 (22 connections now open) 2018-10-04T11:55:20.185-0400 I NETWORK [conn41] received client metadata from 10.1.25.36:59005 conn41: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.187-0400 I NETWORK [listener] connection accepted from 10.1.25.36:59008 #43 (23 connections now open) 2018-10-04T11:55:20.187-0400 I NETWORK [conn42] received client metadata from 10.1.25.36:59006 conn42: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.188-0400 I NETWORK [conn41] end connection 10.1.25.36:59005 (22 connections now open) 2018-10-04T11:55:20.189-0400 I NETWORK [conn43] received client metadata from 10.1.25.36:59008 conn43: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:55:20.198-0400 I SHARDING [conn25] going to insert new entry for shard into config.shards: { _id: "shard1", host: "foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003", state: 1 } 2018-10-04T11:55:20.202-0400 I STORAGE [conn25] createCollection: config.changelog with generated UUID: 42c8c7b6-7f0a-4c5f-9b62-509e01fed92f 2018-10-04T11:55:20.303-0400 I COMMAND [conn25] command config.changelog command: create { create: "changelog", capped: true, size: 209715200, writeConcern: { w: "majority", wtimeout: 15000 }, $db: "config" } numYields:0 reslen:272 locks:{ Global: { acquireCount: { r: 6, w: 4 } }, Database: { acquireCount: { r: 2, w: 3, W: 1 } }, Collection: { acquireCount: { r: 2, w: 1 } }, Mutex: { acquireCount: { r: 1, W: 1 } }, oplog: { acquireCount: { w: 2 } } } protocol:op_msg 100ms 2018-10-04T11:55:20.305-0400 I SHARDING [conn25] about to log metadata event into changelog: { _id: "jazzstep-2.local-2018-10-04T11:55:20.304-0400-5bb637e8290d7fa45d18c0e9", server: "jazzstep-2.local", clientAddr: "10.1.25.36:58971", time: new Date(1538668520304), what: "addShard", ns: "", details: { name: "shard1", host: "foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003" } } 2018-10-04T11:55:20.328-0400 I COMMAND [conn25] command admin.$cmd command: _configsvrAddShard { _configsvrAddShard: "foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003", name: "shard1", writeConcern: { w: "majority", wtimeout: 60000 }, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538668520, 1), signature: { hash: BinData(0, 99EC4F7B288BED4BF8B68762FD50B4CCD61FE237), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538668519, 1), t: 1 } }, $db: "admin" } numYields:0 reslen:501 locks:{ Global: { acquireCount: { r: 9, w: 6 } }, Database: { acquireCount: { r: 3, w: 5, W: 1 } }, Collection: { acquireCount: { r: 3, w: 2 } }, Metadata: { acquireCount: { W: 1 } }, Mutex: { acquireCount: { r: 1, W: 1 } }, oplog: { acquireCount: { w: 3 } } } protocol:op_msg 274ms 2018-10-04T11:55:20.361-0400 I SHARDING [conn25] distributed lock 'a' acquired for 'enableSharding', ts : 5bb637e8290d7fa45d18c103 2018-10-04T11:55:20.361-0400 I ASIO [ShardRegistry] Connecting to jazzstep-2.local:9001 2018-10-04T11:55:20.370-0400 I SHARDING [conn25] Registering new database { _id: "a", primary: "shard1", partitioned: false, version: { uuid: UUID("4ea91b7e-b5f4-4d24-b56f-6d5acdaad219"), lastMod: 1 } } in sharding catalog 2018-10-04T11:55:20.371-0400 I STORAGE [conn25] createCollection: config.databases with generated UUID: fe6cb2e2-5c5f-4138-a534-6174c0056936 2018-10-04T11:55:20.488-0400 I SHARDING [conn25] Enabling sharding for database [a] in config db 2018-10-04T11:55:20.503-0400 I SHARDING [conn25] distributed lock with ts: 5bb637e8290d7fa45d18c103' unlocked. 2018-10-04T11:55:20.503-0400 I COMMAND [conn25] command admin.$cmd command: _configsvrEnableSharding { _configsvrEnableSharding: "a", writeConcern: { w: "majority", wtimeout: 60000 }, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538668520, 8), signature: { hash: BinData(0, 99EC4F7B288BED4BF8B68762FD50B4CCD61FE237), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538668520, 8), t: 1 } }, $db: "admin" } numYields:0 reslen:478 locks:{ Global: { acquireCount: { r: 13, w: 12 } }, Database: { acquireCount: { r: 1, w: 10, W: 1 } }, Collection: { acquireCount: { r: 1, w: 5 } }, oplog: { acquireCount: { w: 5 } } } protocol:op_msg 152ms 2018-10-04T11:55:20.683-0400 I SHARDING [conn25] distributed lock 'a' acquired for 'shardCollection', ts : 5bb637e8290d7fa45d18c136 2018-10-04T11:55:20.708-0400 I SHARDING [conn25] distributed lock 'a.b' acquired for 'shardCollection', ts : 5bb637e8290d7fa45d18c140 2018-10-04T11:55:20.717-0400 I NETWORK [conn25] Successfully connected to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 (1 connections now open to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 with a 0 second timeout) 2018-10-04T11:55:20.786-0400 I NETWORK [conn40] end connection 10.1.25.36:59004 (21 connections now open) 2018-10-04T11:55:20.786-0400 I NETWORK [ShardRegistry] Marking host jazzstep-2.local:9001 as failed :: caused by :: HostUnreachable: Connection was closed 2018-10-04T11:55:20.786-0400 I NETWORK [conn36] end connection 10.1.25.36:58997 (20 connections now open) 2018-10-04T11:55:20.787-0400 I NETWORK [conn34] end connection 10.1.25.36:58992 (19 connections now open) 2018-10-04T11:55:20.795-0400 I ASIO [ShardRegistry] Ending connection to host jazzstep-2.local:9001 due to bad connection status; 0 connections to that host remain open 2018-10-04T11:55:20.795-0400 I NETWORK [conn25] Detected bad connection created at 1538668520058139 microSec, clearing pool for jazzstep-2.local:9001 of 0 connections 2018-10-04T11:55:20.814-0400 I NETWORK [conn25] Dropping all pooled connections to jazzstep-2.local:9001(with timeout of 5 seconds) 2018-10-04T11:55:20.816-0400 I NETWORK [conn25] Ending connection to host jazzstep-2.local:9001(with timeout of 5 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T11:55:20.819-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:21.326-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:21.833-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:22.340-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:22.846-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:23.351-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:23.857-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:24.363-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:24.866-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:25.366-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:25.374-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:25.869-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:25.879-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:26.378-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:26.382-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:26.883-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:26.887-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:27.387-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:27.391-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:27.895-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:28.399-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:28.903-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:29.407-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:29.910-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:30.413-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:30.919-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:31.423-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:31.933-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:32.437-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:32.941-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:33.446-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:33.953-0400 I ASIO [ShardRegistry] Connecting to jazzstep-2.local:9003 2018-10-04T11:55:33.959-0400 I ASIO [ShardRegistry] Connecting to jazzstep-2.local:9003 2018-10-04T11:55:34.009-0400 I NETWORK [conn33] end connection 10.1.25.36:58990 (17 connections now open) 2018-10-04T11:55:34.009-0400 I NETWORK [conn42] end connection 10.1.25.36:59006 (18 connections now open) 2018-10-04T11:55:34.009-0400 I NETWORK [ShardRegistry] Marking host jazzstep-2.local:9003 as failed :: caused by :: HostUnreachable: Connection was closed 2018-10-04T11:55:34.012-0400 I ASIO [ShardRegistry] Ending connection to host jazzstep-2.local:9003 due to bad connection status; 1 connections to that host remain open 2018-10-04T11:55:34.514-0400 I NETWORK [conn25] Detected bad connection created at 1538668520066516 microSec, clearing pool for jazzstep-2.local:9003 of 0 connections 2018-10-04T11:55:34.515-0400 I NETWORK [conn25] Dropping all pooled connections to jazzstep-2.local:9003(with timeout of 5 seconds) 2018-10-04T11:55:34.516-0400 I NETWORK [conn25] Ending connection to host jazzstep-2.local:9003(with timeout of 5 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T11:55:34.518-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:35.024-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:35.528-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:36.033-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:36.536-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:37.040-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:37.544-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:38.050-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:38.559-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:39.064-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:39.572-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:40.075-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:40.579-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:41.084-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:41.592-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:42.100-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:42.608-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:43.112-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:43.616-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:43.975-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:44.119-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:44.480-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:44.624-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:44.984-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:45.128-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:45.487-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:45.632-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:45.990-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:46.137-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:46.495-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:46.645-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:47.000-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:47.150-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:47.504-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:47.656-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:48.006-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:48.165-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:48.512-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:48.674-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:49.019-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:49.178-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:49.523-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:49.683-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:50.026-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:50.081-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:55:50.190-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:50.533-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:50.696-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:51.041-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:51.201-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:51.550-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:51.708-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:52.055-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:52.213-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:52.564-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:52.717-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:53.068-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:53.222-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:53.576-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:53.726-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:54.083-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:54.233-0400 W NETWORK [conn25] Unable to reach primary for set foo 2018-10-04T11:55:54.254-0400 I SHARDING [conn25] distributed lock with ts: 5bb637e8290d7fa45d18c140' unlocked. 2018-10-04T11:55:54.269-0400 I SHARDING [conn25] distributed lock with ts: 5bb637e8290d7fa45d18c136' unlocked. 2018-10-04T11:55:54.273-0400 I COMMAND [conn25] command admin.$cmd command: _configsvrShardCollection { _configsvrShardCollection: "a.b", key: { key1: 1 }, unique: false, numInitialChunks: 0, getUUIDfromPrimaryShard: true, writeConcern: { w: "majority", wtimeout: 60000 }, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538668520, 14), signature: { hash: BinData(0, 99EC4F7B288BED4BF8B68762FD50B4CCD61FE237), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538668520, 13), t: 1 } }, $db: "admin" } numYields:0 ok:0 errMsg:"Could not find host matching read preference { mode: \"primary\" } for set foo" errName:FailedToSatisfyReadPreference errCode:133 reslen:621 locks:{ Global: { acquireCount: { r: 10, w: 8 } }, Database: { acquireCount: { r: 2, w: 8 } }, Collection: { acquireCount: { r: 2, w: 4 } }, Mutex: { acquireCount: { W: 1 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 33612ms 2018-10-04T11:55:54.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:55.104-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:55.616-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:56.120-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:56.623-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:57.128-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:57.632-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:58.136-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:58.639-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:59.143-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:55:59.648-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:00.151-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:00.656-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:01.160-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:01.667-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:02.174-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:02.679-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:03.184-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:03.688-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:04.196-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:04.197-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:56:04.198-0400 I STORAGE [Balancer] createCollection: config.actionlog with generated UUID: c5416714-1761-4e21-a2d0-8b64bb1c0cfc 2018-10-04T11:56:04.301-0400 I COMMAND [Balancer] command config.actionlog command: create { create: "actionlog", capped: true, size: 20971520, writeConcern: { w: "majority", wtimeout: 15000 }, $db: "config" } numYields:0 reslen:272 locks:{ Global: { acquireCount: { r: 34, w: 2 } }, Database: { acquireCount: { r: 32, w: 1, W: 1 } }, Collection: { acquireCount: { r: 32 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 102ms 2018-10-04T11:56:04.303-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:56:04.302-0400-5bb63814290d7fa45d18c20b", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668564302), what: "balancer.round", ns: "", details: { executionTimeMillis: 20225, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:56:14.333-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:14.839-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:15.344-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:15.855-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:16.360-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:16.864-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:17.367-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:17.872-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:18.375-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:18.887-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:19.390-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:19.896-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:20.084-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:20.199-0400 I ASIO [AddShard-TaskExecutor] Dropping all pooled connections to jazzstep-2.local:9001 due to HostUnreachable: Connection was closed 2018-10-04T11:56:20.399-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:20.906-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:21.412-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:21.918-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:22.423-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:22.930-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:23.434-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:23.943-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:24.448-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:24.951-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:25.454-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:25.962-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:26.466-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:26.972-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:27.476-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:27.983-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:28.488-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:28.993-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:29.499-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:30.007-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:30.515-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:31.032-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:31.536-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:32.046-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:32.550-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:33.056-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:33.561-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:33.972-0400 I ASIO [ShardRegistry] Dropping all pooled connections to jazzstep-2.local:9003 due to HostUnreachable: Connection was closed 2018-10-04T11:56:34.066-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:34.575-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:34.576-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:56:34.577-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:56:34.576-0400-5bb63832290d7fa45d18c28a", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668594576), what: "balancer.round", ns: "", details: { executionTimeMillis: 20244, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:56:44.599-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:45.104-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:45.608-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:46.112-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:46.617-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:47.120-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:47.624-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:48.132-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:48.638-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:49.143-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:49.649-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:49.979-0400 I NETWORK [conn26] end connection 10.1.25.36:58972 (16 connections now open) 2018-10-04T11:56:50.087-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:56:50.153-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:50.288-0400 I NETWORK [conn27] end connection 10.1.25.36:58974 (15 connections now open) 2018-10-04T11:56:50.660-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:51.166-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:51.671-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:52.175-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:52.682-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:53.190-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:53.699-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:54.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:54.706-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:55.210-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:55.723-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:56.226-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:56.732-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:57.239-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:57.744-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:58.249-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:58.761-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:59.266-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:56:59.774-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:00.282-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:00.791-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:01.296-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:01.800-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:02.304-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:02.808-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:03.314-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:03.817-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:04.320-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:04.823-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:04.824-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:57:04.825-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:57:04.825-0400-5bb63850290d7fa45d18c302", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668624825), what: "balancer.round", ns: "", details: { executionTimeMillis: 20228, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:57:14.848-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:15.356-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:15.861-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:16.365-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:16.873-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:17.378-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:17.882-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:18.389-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:18.896-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:19.405-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:19.909-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:20.094-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:20.416-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:20.920-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:21.424-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:21.932-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:22.440-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:22.949-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:23.457-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:23.965-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:24.471-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:24.976-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:25.480-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:25.987-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:26.495-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:27.005-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:27.508-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:28.013-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:28.520-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:29.031-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:29.538-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:30.043-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:30.545-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:31.056-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:31.563-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:32.075-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:32.580-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:33.087-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:33.594-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:34.097-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:34.606-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:35.112-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:35.113-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:57:35.114-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:57:35.114-0400-5bb6386f290d7fa45d18c37b", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668655114), what: "balancer.round", ns: "", details: { executionTimeMillis: 20268, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:57:45.133-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:45.640-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:46.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:46.653-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:47.159-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:47.665-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:48.169-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:48.677-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:49.182-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:49.685-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:50.104-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:57:50.189-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:50.693-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:51.198-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:51.701-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:52.207-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:52.712-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:53.218-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:53.725-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:54.232-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:54.740-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:55.248-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:55.760-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:56.264-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:56.768-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:57.272-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:57.779-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:58.282-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:58.791-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:59.298-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:57:59.800-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:00.306-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:00.810-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:01.322-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:01.830-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:02.336-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:02.843-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:03.348-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:03.857-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:04.365-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:04.872-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:05.381-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:05.382-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:58:05.383-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:58:05.382-0400-5bb6388d290d7fa45d18c3f2", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668685382), what: "balancer.round", ns: "", details: { executionTimeMillis: 20251, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:58:15.410-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:15.915-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:16.418-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:16.927-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:17.431-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:17.939-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:18.444-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:18.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:19.451-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:19.955-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:20.114-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:20.461-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:20.965-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:21.481-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:21.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:22.495-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:23.005-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:23.511-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:24.018-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:24.522-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:25.026-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:25.529-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:26.034-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:26.541-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:27.047-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:27.553-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:28.061-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:28.565-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:29.071-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:29.580-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:30.083-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:30.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:31.095-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:31.598-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:32.114-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:32.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:33.127-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:33.631-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:34.137-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:34.641-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:35.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:35.656-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:35.657-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:58:35.658-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:58:35.658-0400-5bb638ab290d7fa45d18c46b", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668715658), what: "balancer.round", ns: "", details: { executionTimeMillis: 20251, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:58:45.685-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:46.189-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:46.695-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:47.198-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:47.702-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:48.207-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:48.715-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:49.220-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:49.727-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:50.120-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:58:50.232-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:50.737-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:51.244-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:51.748-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:52.257-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:52.765-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:53.270-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:53.775-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:54.281-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:54.784-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:55.289-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:55.798-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:56.303-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:56.809-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:57.314-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:57.823-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:58.326-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:58.831-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:59.336-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:58:59.842-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:00.347-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:00.855-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:01.358-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:01.864-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:02.381-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:02.890-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:03.397-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:03.906-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:04.410-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:04.914-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:05.417-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:05.926-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:05.927-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:59:05.928-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:59:05.927-0400-5bb638c9290d7fa45d18c4e4", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668745927), what: "balancer.round", ns: "", details: { executionTimeMillis: 20245, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:59:15.950-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:16.454-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:16.956-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:17.462-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:17.964-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:18.467-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:18.975-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:19.481-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:19.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:20.128-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:20.496-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:21.004-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:21.513-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:22.018-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:22.527-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:23.032-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:23.540-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:24.047-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:24.554-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:25.057-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:25.561-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:26.068-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:26.573-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:27.076-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:27.580-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:28.083-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:28.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:29.092-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:29.597-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:30.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:30.611-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:31.118-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:31.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:32.138-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:32.647-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:33.150-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:33.654-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:34.158-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:34.664-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:35.167-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:35.673-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:36.177-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:36.178-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T11:59:36.179-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T11:59:36.178-0400-5bb638e8290d7fa45d18c563", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668776178), what: "balancer.round", ns: "", details: { executionTimeMillis: 20231, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T11:59:37.972-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config' acquired for 'shardCollection', ts : 5bb638e9290d7fa45d18c572 2018-10-04T11:59:37.988-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config.system.sessions' acquired for 'shardCollection', ts : 5bb638e9290d7fa45d18c57c 2018-10-04T11:59:37.989-0400 I NETWORK [LogicalSessionCacheRefresh] Starting new replica set monitor for csrs/jazzstep-2.local:9007,jazzstep-2.local:9008,jazzstep-2.local:9009 2018-10-04T11:59:38.005-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49309 #50 (16 connections now open) 2018-10-04T11:59:38.006-0400 I NETWORK [conn50] received client metadata from 10.1.25.36:49309 conn50: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:59:38.006-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to jazzstep-2.local:9008 (1 connections now open to jazzstep-2.local:9008 with a 5 second timeout) 2018-10-04T11:59:38.006-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9007 (1 connections now open to jazzstep-2.local:9007 with a 5 second timeout) 2018-10-04T11:59:38.009-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to jazzstep-2.local:9009 (1 connections now open to jazzstep-2.local:9009 with a 5 second timeout) 2018-10-04T11:59:38.010-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to csrs/jazzstep-2.local:9007,jazzstep-2.local:9008,jazzstep-2.local:9009 (1 connections now open to csrs/jazzstep-2.local:9007,jazzstep-2.local:9008,jazzstep-2.local:9009 with a 0 second timeout) 2018-10-04T11:59:38.012-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49311 #53 (17 connections now open) 2018-10-04T11:59:38.012-0400 I NETWORK [conn53] received client metadata from 10.1.25.36:49311 conn53: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T11:59:38.014-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:38.518-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:39.033-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:39.537-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:40.041-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:40.545-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:41.053-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:41.563-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:42.070-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:42.577-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:43.080-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:43.587-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:44.094-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:44.598-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:45.104-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:45.609-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:46.113-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:46.202-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:46.618-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:46.710-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:47.126-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:47.214-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:47.630-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:47.717-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:48.133-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:48.225-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:48.637-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:48.732-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:49.142-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:49.236-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:49.646-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:49.745-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:50.135-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T11:59:50.150-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:50.248-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:50.655-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:50.755-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:51.158-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:51.264-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:51.663-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:51.773-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:52.168-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:52.280-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:52.673-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T11:59:52.674-0400 I NETWORK [LogicalSessionCacheRefresh] Ending connection to host foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003(with timeout of 0 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T11:59:52.694-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb638e9290d7fa45d18c57c' unlocked. 2018-10-04T11:59:52.711-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb638e9290d7fa45d18c572' unlocked. 2018-10-04T11:59:52.714-0400 I COMMAND [LogicalSessionCacheRefresh] command admin.$cmd command: _configsvrShardCollection { _configsvrShardCollection: "config.system.sessions", key: { _id: 1 }, unique: false, numInitialChunks: 0, getUUIDfromPrimaryShard: true, writeConcern: { w: "majority", wtimeout: 60000 }, $db: "admin" } numYields:0 ok:0 errMsg:"Could not find host matching read preference { mode: \"primary\", tags: [ {} ] } for set foo" errName:FailedToSatisfyReadPreference errCode:133 reslen:429 locks:{ Global: { acquireCount: { r: 9, w: 8 } }, Database: { acquireCount: { r: 1, w: 8 } }, Collection: { acquireCount: { r: 1, w: 4 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 14763ms 2018-10-04T11:59:52.715-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo, will try again at the next refresh interval 2018-10-04T11:59:52.715-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo 2018-10-04T11:59:52.784-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:53.291-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:53.797-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:54.305-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:54.809-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:55.313-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:55.822-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:56.327-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:56.829-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:57.332-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:57.840-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:58.347-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:58.859-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:59.363-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T11:59:59.872-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:00.380-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:00.883-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:01.392-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:01.897-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:02.401-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:02.907-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:03.410-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:03.915-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:04.419-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:04.928-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:05.431-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:05.940-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:06.444-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:06.444-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:00:06.445-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:00:06.445-0400-5bb63906290d7fa45d18c60b", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668806445), what: "balancer.round", ns: "", details: { executionTimeMillis: 20245, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:00:07.078-0400 I NETWORK [conn3] end connection 10.1.25.36:58846 (16 connections now open) 2018-10-04T12:00:07.079-0400 I NETWORK [conn22] end connection 10.1.25.36:58881 (15 connections now open) 2018-10-04T12:00:07.079-0400 I NETWORK [conn6] end connection 127.0.0.1:58855 (14 connections now open) 2018-10-04T12:00:07.079-0400 I NETWORK [conn23] end connection 127.0.0.1:58884 (13 connections now open) 2018-10-04T12:00:16.469-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:16.977-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:17.485-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:17.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:18.492-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:18.994-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:19.498-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:20.006-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:20.142-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:00:20.203-0400 I ASIO [AddShard-TaskExecutor] Dropping all pooled connections to jazzstep-2.local:9001 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:00:20.512-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:20.677-0400 I NETWORK [conn28] end connection 10.1.25.36:58982 (12 connections now open) 2018-10-04T12:00:20.801-0400 I ASIO [ShardRegistry] Dropping all pooled connections to jazzstep-2.local:9001 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:00:21.015-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:21.521-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:22.026-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:22.529-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:23.032-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:23.536-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:24.040-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:24.545-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:25.049-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:25.551-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:26.053-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:26.560-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:27.067-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:27.574-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:28.080-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:28.585-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:29.089-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:29.597-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:30.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:30.608-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:31.112-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:31.615-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:32.118-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:32.621-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:33.123-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:33.626-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:34.015-0400 I ASIO [ShardRegistry] Dropping all pooled connections to jazzstep-2.local:9003 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:00:34.128-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:34.634-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:35.136-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:35.639-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:36.142-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:36.645-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:36.646-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:00:36.647-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:00:36.647-0400-5bb63924290d7fa45d18c682", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668836647), what: "balancer.round", ns: "", details: { executionTimeMillis: 20179, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:00:46.736-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:47.243-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:47.748-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:48.251-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:48.769-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:49.273-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:49.778-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:50.150-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:00:50.281-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:50.785-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:51.290-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:51.793-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:52.296-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:52.800-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:53.306-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:53.812-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:54.316-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:54.819-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:55.327-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:55.830-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:56.333-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:56.836-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:57.343-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:57.847-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:58.354-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:58.857-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:59.361-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:00:59.864-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:00.368-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:00.871-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:01.377-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:01.885-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:02.393-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:02.897-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:03.399-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:03.907-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:04.409-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:04.912-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:05.418-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:05.920-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:06.427-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:06.929-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:06.930-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:01:06.930-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:01:06.930-0400-5bb63942290d7fa45d18c6fa", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668866930), what: "balancer.round", ns: "", details: { executionTimeMillis: 20195, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:01:16.946-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:17.449-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:17.956-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:18.460-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:18.963-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:19.469-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:19.972-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:19.994-0400 I NETWORK [listener] connection accepted from 10.1.25.36:51567 #54 (13 connections now open) 2018-10-04T12:01:19.994-0400 I NETWORK [conn54] received client metadata from 10.1.25.36:51567 conn54: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:01:20.156-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:20.479-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:20.981-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:21.484-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:21.989-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:22.498-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:23.002-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:23.506-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:24.009-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:24.515-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:25.022-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:25.527-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:26.031-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:26.539-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:27.044-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:27.547-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:28.055-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:28.559-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:29.073-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:29.579-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:30.082-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:30.590-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:31.094-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:31.596-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:32.111-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:32.615-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:33.119-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:33.627-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:34.130-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:34.637-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:35.145-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:35.649-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:36.153-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:36.656-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:37.159-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:37.160-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:01:37.161-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:01:37.160-0400-5bb63961290d7fa45d18c773", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668897160), what: "balancer.round", ns: "", details: { executionTimeMillis: 20216, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:01:47.178-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:47.681-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:48.184-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:48.689-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:49.194-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:49.697-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:50.159-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:01:50.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:50.709-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:51.215-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:51.722-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:52.228-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:52.733-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:53.239-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:53.744-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:54.247-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:54.753-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:55.256-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:55.759-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:56.262-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:56.765-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:57.267-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:57.773-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:58.275-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:58.777-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:59.280-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:01:59.783-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:00.289-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:00.794-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:01.297-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:01.802-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:02.305-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:02.807-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:03.310-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:03.813-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:04.317-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:04.820-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:05.322-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:05.827-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:06.329-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:06.833-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:07.339-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:07.340-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:02:07.341-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:02:07.341-0400-5bb6397f290d7fa45d18c7e8", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668927341), what: "balancer.round", ns: "", details: { executionTimeMillis: 20165, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:02:17.365-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:17.868-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:18.372-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:18.877-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:19.384-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:19.888-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:19.998-0400 I NETWORK [conn25] end connection 10.1.25.36:58971 (12 connections now open) 2018-10-04T12:02:20.163-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:20.394-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:20.900-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:21.403-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:21.905-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:22.408-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:22.915-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:23.418-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:23.925-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:24.427-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:24.930-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:25.433-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:25.938-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:26.445-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:26.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:27.450-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:27.953-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:28.456-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:28.959-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:29.462-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:29.966-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:30.469-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:30.972-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:31.475-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:31.977-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:32.487-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:32.992-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:33.497-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:34.002-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:34.504-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:35.007-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:35.510-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:36.013-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:36.516-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:37.020-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:37.523-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:37.524-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:02:37.525-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:02:37.524-0400-5bb6399d290d7fa45d18c85f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668957524), what: "balancer.round", ns: "", details: { executionTimeMillis: 20161, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:02:47.553-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:48.056-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:48.559-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:49.063-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:49.565-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:50.068-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:50.164-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:02:50.572-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:51.082-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:51.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:52.090-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:52.596-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:53.099-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:53.602-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:54.107-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:54.610-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:55.112-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:55.615-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:56.133-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:56.639-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:57.144-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:57.649-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:58.152-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:58.657-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:59.162-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:02:59.665-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:00.169-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:00.671-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:01.173-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:01.676-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:02.178-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:02.684-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:03.188-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:03.690-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:04.193-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:04.697-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:05.199-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:05.704-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:06.206-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:06.710-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:07.212-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:07.715-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:07.716-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:03:07.717-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:03:07.717-0400-5bb639bb290d7fa45d18c8d7", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538668987717), what: "balancer.round", ns: "", details: { executionTimeMillis: 20165, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:03:17.731-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:18.235-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:18.740-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:19.249-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:19.754-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:20.168-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:20.261-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:20.765-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:21.271-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:21.775-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:22.277-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:22.780-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:23.283-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:23.786-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:24.289-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:24.791-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:25.295-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:25.797-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:26.300-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:26.803-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:27.307-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:27.810-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:28.313-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:28.817-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:29.320-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:29.822-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:30.325-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:30.827-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:31.329-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:31.832-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:32.334-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:32.837-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:33.339-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:33.842-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:34.344-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:34.846-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:35.350-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:35.853-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:36.361-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:36.864-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:37.368-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:37.870-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:37.871-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:03:37.872-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:03:37.871-0400-5bb639d9290d7fa45d18c94f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669017871), what: "balancer.round", ns: "", details: { executionTimeMillis: 20141, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:03:47.906-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:48.409-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:48.913-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:49.418-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:49.922-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:50.170-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:03:50.424-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:50.928-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:51.433-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:51.940-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:52.442-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:52.946-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:53.450-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:53.954-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:54.458-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:54.961-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:55.463-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:55.966-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:56.469-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:56.971-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:57.474-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:57.976-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:58.483-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:58.987-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:59.492-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:03:59.995-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:00.498-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:01.001-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:01.505-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:02.010-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:02.512-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:03.014-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:03.517-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:04.019-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:04.524-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:05.031-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:05.536-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:06.038-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:06.546-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:07.048-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:07.552-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:08.057-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:08.057-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:04:08.058-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:04:08.058-0400-5bb639f8290d7fa45d18c9c9", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669048058), what: "balancer.round", ns: "", details: { executionTimeMillis: 20153, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:04:18.084-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:18.586-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:19.089-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:19.595-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:20.098-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:20.172-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:20.600-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:21.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:21.605-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:22.108-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:22.612-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:23.114-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:23.617-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:24.121-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:24.627-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:25.130-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:25.637-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:26.139-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:26.641-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:27.144-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:27.647-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:28.150-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:28.653-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:29.155-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:29.658-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:30.162-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:30.669-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:31.172-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:31.674-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:32.177-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:32.680-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:33.183-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:33.686-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:34.189-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:34.696-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:35.199-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:35.702-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:36.206-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:36.708-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:37.211-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:37.713-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:37.954-0400 I SH_REFR [ConfigServerCatalogCacheLoader-1] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:04:38.005-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config' acquired for 'shardCollection', ts : 5bb63a15290d7fa45d18ca40 2018-10-04T12:04:38.034-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config.system.sessions' acquired for 'shardCollection', ts : 5bb63a16290d7fa45d18ca4a 2018-10-04T12:04:38.045-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 (1 connections now open to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 with a 0 second timeout) 2018-10-04T12:04:38.047-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:38.219-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:38.220-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:04:38.221-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:04:38.220-0400-5bb63a16290d7fa45d18ca5f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669078220), what: "balancer.round", ns: "", details: { executionTimeMillis: 20138, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:04:38.550-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:39.053-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:39.556-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:40.060-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:40.565-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:41.069-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:41.571-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:42.076-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:42.580-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:43.082-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:43.586-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:44.090-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:44.592-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:45.097-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:45.599-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:46.102-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:46.606-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:47.108-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:47.611-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:48.113-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:48.235-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:48.616-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:48.749-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:49.119-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:49.251-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:49.621-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:49.754-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:50.126-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:50.176-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:04:50.260-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:50.630-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:50.762-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:51.134-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:51.266-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:51.636-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:51.768-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:52.142-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:52.272-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:52.646-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:04:52.647-0400 I NETWORK [LogicalSessionCacheRefresh] Ending connection to host foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003(with timeout of 0 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T12:04:52.658-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb63a16290d7fa45d18ca4a' unlocked. 2018-10-04T12:04:52.682-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb63a15290d7fa45d18ca40' unlocked. 2018-10-04T12:04:52.685-0400 I COMMAND [LogicalSessionCacheRefresh] command admin.$cmd command: _configsvrShardCollection { _configsvrShardCollection: "config.system.sessions", key: { _id: 1 }, unique: false, numInitialChunks: 0, getUUIDfromPrimaryShard: true, writeConcern: { w: "majority", wtimeout: 60000 }, $db: "admin" } numYields:0 ok:0 errMsg:"Could not find host matching read preference { mode: \"primary\", tags: [ {} ] } for set foo" errName:FailedToSatisfyReadPreference errCode:133 reslen:429 locks:{ Global: { acquireCount: { r: 8, w: 8 } }, Database: { acquireCount: { w: 8 } }, Collection: { acquireCount: { w: 4 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 14730ms 2018-10-04T12:04:52.685-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo, will try again at the next refresh interval 2018-10-04T12:04:52.686-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo 2018-10-04T12:04:52.777-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:53.281-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:53.784-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:54.287-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:54.789-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:55.292-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:55.796-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:56.298-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:56.802-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:57.311-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:57.814-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:58.317-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:58.824-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:59.326-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:04:59.829-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:00.333-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:00.836-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:01.339-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:01.847-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:02.351-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:02.855-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:03.359-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:03.864-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:04.368-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:04.872-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:05.375-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:05.879-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:06.382-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:06.887-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:07.392-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:07.895-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:08.399-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:08.402-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:05:08.403-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:05:08.403-0400-5bb63a34290d7fa45d18cae4", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669108403), what: "balancer.round", ns: "", details: { executionTimeMillis: 20170, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:05:18.416-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:18.922-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:19.428-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:19.932-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:20.178-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:05:20.437-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:20.942-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:21.446-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:21.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:22.451-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:22.956-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:23.459-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:23.962-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:24.465-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:24.968-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:25.470-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:25.975-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:26.480-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:26.983-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:27.485-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:27.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:28.490-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:28.993-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:29.496-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:29.999-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:30.505-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:31.010-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:31.512-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:32.018-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:32.523-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:33.032-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:33.535-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:34.041-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:34.544-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:35.048-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:35.551-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:36.055-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:36.558-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:37.063-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:37.566-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:38.071-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:38.574-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:38.574-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:05:38.575-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:05:38.575-0400-5bb63a52290d7fa45d18cb5e", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669138575), what: "balancer.round", ns: "", details: { executionTimeMillis: 20160, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:05:48.595-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:49.106-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:49.611-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:50.118-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:50.181-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:05:50.621-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:51.130-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:51.641-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:52.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:52.658-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:53.162-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:53.667-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:54.175-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:54.683-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:55.188-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:55.692-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:56.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:56.713-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:57.218-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:57.727-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:58.237-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:58.740-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:59.252-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:05:59.760-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:00.263-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:00.766-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:01.278-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:01.788-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:02.297-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:02.805-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:03.311-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:03.821-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:04.325-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:04.830-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:05.338-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:05.842-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:06.348-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:06.852-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:07.358-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:07.862-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:08.372-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:08.875-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:08.875-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:06:08.876-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:06:08.876-0400-5bb63a70290d7fa45d18cbd7", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669168876), what: "balancer.round", ns: "", details: { executionTimeMillis: 20281, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:06:18.888-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:19.393-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:19.901-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:20.191-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:20.408-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:20.911-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:21.422-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:21.925-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:22.428-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:22.938-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:23.443-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:23.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:24.451-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:24.954-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:25.459-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:25.962-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:26.472-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:26.976-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:27.488-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:27.992-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:28.495-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:29.003-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:29.508-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:30.011-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:30.523-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:31.027-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:31.538-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:32.050-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:32.562-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:33.072-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:33.589-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:34.093-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:34.596-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:35.104-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:35.609-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:36.113-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:36.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:37.124-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:37.634-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:38.139-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:38.642-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:39.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:39.149-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:06:39.150-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:06:39.149-0400-5bb63a8f290d7fa45d18cc4f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669199149), what: "balancer.round", ns: "", details: { executionTimeMillis: 20263, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:06:49.173-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:49.676-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:50.179-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:50.195-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:06:50.683-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:51.186-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:51.690-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:52.193-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:52.696-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:53.199-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:53.707-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:54.215-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:54.724-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:55.226-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:55.729-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:56.232-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:56.738-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:57.242-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:57.746-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:58.249-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:58.751-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:59.256-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:06:59.759-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:00.265-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:00.775-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:01.278-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:01.786-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:02.290-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:02.794-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:03.296-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:03.799-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:04.303-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:04.806-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:05.309-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:05.811-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:06.320-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:06.824-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:07.328-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:07.835-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:08.338-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:08.848-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:09.351-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:09.351-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:07:09.352-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:07:09.352-0400-5bb63aad290d7fa45d18ccc8", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669229352), what: "balancer.round", ns: "", details: { executionTimeMillis: 20181, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:07:19.368-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:19.871-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:20.202-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:20.376-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:20.879-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:21.388-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:21.891-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:22.398-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:22.906-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:23.409-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:23.913-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:24.416-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:24.926-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:25.429-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:25.933-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:26.439-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:26.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:27.458-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:27.960-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:28.463-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:28.967-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:29.470-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:29.973-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:30.478-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:30.985-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:31.488-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:31.991-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:32.493-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:33.002-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:33.507-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:34.015-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:34.517-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:35.023-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:35.530-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:36.033-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:36.541-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:37.044-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:37.547-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:38.053-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:38.556-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:39.064-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:39.571-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:39.571-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:07:39.572-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:07:39.572-0400-5bb63acb290d7fa45d18cd3f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669259572), what: "balancer.round", ns: "", details: { executionTimeMillis: 20205, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:07:49.590-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:50.094-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:50.204-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:07:50.598-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:51.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:51.606-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:52.109-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:52.611-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:53.115-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:53.619-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:54.123-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:54.628-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:55.133-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:55.640-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:56.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:56.697-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:57.202-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:57.704-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:58.207-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:58.710-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:59.219-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:07:59.721-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:00.232-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:00.743-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:01.246-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:01.748-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:02.251-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:02.753-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:03.264-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:03.773-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:04.277-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:04.780-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:05.283-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:05.786-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:06.290-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:06.794-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:07.306-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:07.816-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:08.325-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:08.837-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:09.340-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:09.849-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:09.850-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:08:09.851-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:08:09.850-0400-5bb63ae9290d7fa45d18cdb9", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669289850), what: "balancer.round", ns: "", details: { executionTimeMillis: 20262, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:08:19.868-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:20.206-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:20.374-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:20.877-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:21.380-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:21.885-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:22.387-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:22.890-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:23.393-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:23.899-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:24.402-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:24.905-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:25.408-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:25.911-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:26.414-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:26.917-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:27.422-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:27.931-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:28.434-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:28.938-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:29.440-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:29.943-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:30.452-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:30.956-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:31.459-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:31.971-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:32.479-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:32.982-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:33.485-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:33.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:34.500-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:35.004-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:35.516-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:36.023-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:36.528-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:37.038-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:37.543-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:38.049-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:38.553-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:39.060-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:39.563-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:40.073-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:40.073-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:08:40.074-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:08:40.074-0400-5bb63b08290d7fa45d18ce33", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669320074), what: "balancer.round", ns: "", details: { executionTimeMillis: 20207, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:08:50.094-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:50.209-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:08:50.598-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:51.101-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:51.606-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:52.109-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:52.612-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:53.120-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:53.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:54.125-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:54.627-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:55.131-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:55.636-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:56.138-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:56.641-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:57.144-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:57.652-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:58.156-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:58.659-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:59.166-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:08:59.670-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:00.180-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:00.683-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:01.187-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:01.690-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:02.195-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:02.698-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:03.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:03.706-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:04.214-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:04.722-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:05.224-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:05.728-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:06.231-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:06.734-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:07.243-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:07.755-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:08.258-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:08.762-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:09.265-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:09.767-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:10.269-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:10.270-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:09:10.271-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:09:10.270-0400-5bb63b26290d7fa45d18ceab", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669350270), what: "balancer.round", ns: "", details: { executionTimeMillis: 20178, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:09:20.212-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:20.292-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:20.794-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:21.300-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:21.808-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:22.310-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:22.814-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:23.321-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:23.825-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:24.327-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:24.830-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:25.337-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:25.840-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:26.350-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:26.855-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:27.358-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:27.868-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:28.374-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:28.880-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:29.385-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:29.887-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:30.392-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:30.895-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:31.403-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:31.917-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:32.420-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:32.931-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:33.434-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:33.939-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:34.444-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:34.950-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:35.454-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:35.959-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:36.466-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:36.971-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:37.473-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:37.955-0400 I SH_REFR [ConfigServerCatalogCacheLoader-2] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:09:37.965-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config' acquired for 'shardCollection', ts : 5bb63b41290d7fa45d18cf12 2018-10-04T12:09:37.977-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config.system.sessions' acquired for 'shardCollection', ts : 5bb63b41290d7fa45d18cf1b 2018-10-04T12:09:37.978-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 (1 connections now open to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 with a 0 second timeout) 2018-10-04T12:09:37.982-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:38.485-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:39.003-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:39.505-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:40.012-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:40.515-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:40.516-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:09:40.517-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:09:40.516-0400-5bb63b44290d7fa45d18cf33", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669380516), what: "balancer.round", ns: "", details: { executionTimeMillis: 20226, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:09:41.022-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:41.528-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:42.031-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:42.535-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:43.039-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:43.542-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:44.045-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:44.548-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:45.052-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:45.557-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:46.063-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:46.565-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:47.073-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:47.576-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:48.079-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:48.590-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:49.095-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:49.599-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:50.102-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:50.223-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:09:50.534-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:50.605-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:51.044-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:51.107-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:51.548-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:51.610-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:52.051-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:52.118-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:52.555-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:52.620-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:09:52.621-0400 I NETWORK [LogicalSessionCacheRefresh] Ending connection to host foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003(with timeout of 0 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T12:09:52.643-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb63b41290d7fa45d18cf1b' unlocked. 2018-10-04T12:09:52.659-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb63b41290d7fa45d18cf12' unlocked. 2018-10-04T12:09:52.682-0400 I COMMAND [LogicalSessionCacheRefresh] command admin.$cmd command: _configsvrShardCollection { _configsvrShardCollection: "config.system.sessions", key: { _id: 1 }, unique: false, numInitialChunks: 0, getUUIDfromPrimaryShard: true, writeConcern: { w: "majority", wtimeout: 60000 }, $db: "admin" } numYields:0 ok:0 errMsg:"Could not find host matching read preference { mode: \"primary\", tags: [ {} ] } for set foo" errName:FailedToSatisfyReadPreference errCode:133 reslen:429 locks:{ Global: { acquireCount: { r: 8, w: 8 } }, Database: { acquireCount: { w: 8 } }, Collection: { acquireCount: { w: 4 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 14726ms 2018-10-04T12:09:52.682-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo, will try again at the next refresh interval 2018-10-04T12:09:52.683-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo 2018-10-04T12:09:53.059-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:53.562-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:54.065-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:54.568-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:55.071-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:55.575-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:56.083-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:56.595-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:57.107-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:57.610-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:58.114-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:58.622-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:59.133-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:09:59.637-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:00.144-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:00.652-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:01.155-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:01.658-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:02.161-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:02.663-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:03.172-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:03.674-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:04.180-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:04.683-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:05.187-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:05.690-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:06.196-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:06.700-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:07.208-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:07.711-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:08.215-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:08.717-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:09.220-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:09.722-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:10.225-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:10.728-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:10.728-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:10:10.729-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:10:10.729-0400-5bb63b62290d7fa45d18cfb9", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669410729), what: "balancer.round", ns: "", details: { executionTimeMillis: 20196, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:10:20.231-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:20.756-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:21.262-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:21.766-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:22.269-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:22.773-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:23.275-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:23.778-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:24.284-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:24.786-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:25.296-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:25.801-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:26.304-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:26.808-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:27.312-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:27.816-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:28.322-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:28.824-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:29.331-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:29.834-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:30.338-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:30.842-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:31.346-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:31.849-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:32.351-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:32.854-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:33.357-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:33.866-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:34.370-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:34.875-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:35.377-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:35.881-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:36.388-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:36.899-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:37.405-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:37.907-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:38.410-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:38.940-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:39.451-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:39.953-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:40.456-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:40.959-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:40.960-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:10:40.960-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:10:40.960-0400-5bb63b80290d7fa45d18d02c", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669440960), what: "balancer.round", ns: "", details: { executionTimeMillis: 20206, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:10:50.236-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:10:50.986-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:51.494-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:51.997-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:52.500-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:53.004-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:53.507-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:54.012-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:54.533-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:55.037-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:55.540-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:56.043-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:56.549-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:57.060-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:57.569-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:58.072-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:58.583-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:59.090-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:10:59.600-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:00.103-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:00.607-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:01.115-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:01.618-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:02.126-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:02.637-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:03.140-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:03.643-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:04.146-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:04.654-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:05.157-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:05.661-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:06.164-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:06.666-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:07.172-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:07.684-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:08.189-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:08.692-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:09.195-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:09.698-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:10.201-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:10.703-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:11.206-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:11.207-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:11:11.208-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:11:11.207-0400-5bb63b9f290d7fa45d18d09f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538669471207), what: "balancer.round", ns: "", details: { executionTimeMillis: 20223, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:11:20.246-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:11:21.225-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:21.734-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:22.240-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:11:22.743-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:44.974-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9009 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:44.974-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9008 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:22:44.977-0400 I REPL [replexec-15] Member jazzstep-2.local:9008 is now in state RS_DOWN 2018-10-04T12:22:44.977-0400 I NETWORK [conn18] end connection 10.1.25.36:58871 (11 connections now open) 2018-10-04T12:22:44.977-0400 I NETWORK [conn16] end connection 10.1.25.36:58869 (10 connections now open) 2018-10-04T12:22:44.978-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:44.979-0400 I REPL [replexec-15] Member jazzstep-2.local:9009 is now in state RS_DOWN 2018-10-04T12:22:44.983-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:22:44.985-0400 I REPL [replexec-15] can't see a majority of the set, relinquishing primary 2018-10-04T12:22:44.986-0400 I REPL [replexec-15] Stepping down from primary in response to heartbeat 2018-10-04T12:22:44.986-0400 I NETWORK [conn12] end connection 10.1.25.36:58861 (9 connections now open) 2018-10-04T12:22:44.987-0400 I REPL [replexec-15] transition to SECONDARY from PRIMARY 2018-10-04T12:22:44.989-0400 I NETWORK [replexec-15] Skip closing connection for connection # 54 2018-10-04T12:22:44.990-0400 I NETWORK [replexec-15] Skip closing connection for connection # 43 2018-10-04T12:22:44.991-0400 I NETWORK [replexec-15] Skip closing connection for connection # 21 2018-10-04T12:22:44.991-0400 I NETWORK [replexec-15] Skip closing connection for connection # 20 2018-10-04T12:22:44.992-0400 I NETWORK [replexec-15] Skip closing connection for connection # 11 2018-10-04T12:22:44.992-0400 I NETWORK [conn53] end connection 10.1.25.36:49311 (8 connections now open) 2018-10-04T12:22:44.992-0400 I NETWORK [conn35] end connection 10.1.25.36:58994 (6 connections now open) 2018-10-04T12:22:44.992-0400 I NETWORK [conn50] end connection 10.1.25.36:49309 (7 connections now open) 2018-10-04T12:22:44.992-0400 I NETWORK [conn24] end connection 10.1.25.36:58969 (5 connections now open) 2018-10-04T12:22:45.021-0400 I NETWORK [conn11] end connection 10.1.25.36:58860 (4 connections now open) 2018-10-04T12:22:46.889-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62633 #56 (5 connections now open) 2018-10-04T12:22:46.890-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62634 #57 (6 connections now open) 2018-10-04T12:22:46.891-0400 I NETWORK [conn56] received client metadata from 127.0.0.1:62633 conn56: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.892-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62635 #59 (7 connections now open) 2018-10-04T12:22:46.892-0400 I NETWORK [conn57] received client metadata from 127.0.0.1:62634 conn57: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.894-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62636 #60 (8 connections now open) 2018-10-04T12:22:46.894-0400 I NETWORK [conn59] received client metadata from 127.0.0.1:62635 conn59: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.895-0400 I REPL [replexec-11] Member jazzstep-2.local:9009 is now in state SECONDARY 2018-10-04T12:22:46.896-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62638 #61 (9 connections now open) 2018-10-04T12:22:46.896-0400 I NETWORK [conn60] received client metadata from 127.0.0.1:62636 conn60: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.898-0400 I REPL [replexec-12] Member jazzstep-2.local:9008 is now in state SECONDARY 2018-10-04T12:22:46.899-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62641 #62 (10 connections now open) 2018-10-04T12:22:46.899-0400 I NETWORK [conn61] received client metadata from 127.0.0.1:62638 conn61: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.903-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62643 #63 (11 connections now open) 2018-10-04T12:22:46.903-0400 I NETWORK [conn62] received client metadata from 127.0.0.1:62641 conn62: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.910-0400 I NETWORK [listener] connection accepted from 127.0.0.1:62645 #64 (12 connections now open) 2018-10-04T12:22:46.910-0400 I NETWORK [conn63] received client metadata from 127.0.0.1:62643 conn63: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:46.915-0400 I NETWORK [conn64] received client metadata from 127.0.0.1:62645 conn64: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:47.350-0400 I NETWORK [conn21] end connection 10.1.25.36:58880 (10 connections now open) 2018-10-04T12:22:47.350-0400 I NETWORK [conn20] end connection 10.1.25.36:58879 (11 connections now open) 2018-10-04T12:22:47.398-0400 I REPL [replexec-15] Member jazzstep-2.local:9008 is now in state PRIMARY 2018-10-04T12:22:46.294-0400 I REPL [rsBackgroundSync] sync source candidate: jazzstep-2.local:9008 2018-10-04T12:22:46.296-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:49.377-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:22:49.378-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:22:49.379-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:22:49.379-0400-5bb63e59290d7fa45d18d103", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670169379), what: "balancer.round", ns: "", details: { executionTimeMillis: 688156, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:22:49.380-0400 W SHARDING [Balancer] Error encountered while logging config change with ID [jazzstep-2.local-2018-10-04T12:22:49.379-0400-5bb63e59290d7fa45d18d103] into collection actionlog: InterruptedDueToReplStateChange: operation was interrupted 2018-10-04T12:22:49.381-0400 I SHARDING [Balancer] CSRS balancer is now stopped 2018-10-04T12:22:50.106-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62678 #66 (11 connections now open) 2018-10-04T12:22:50.107-0400 I REPL [rsBackgroundSync] Changed sync source from empty to jazzstep-2.local:9008 2018-10-04T12:22:50.108-0400 I NETWORK [conn66] received client metadata from 10.1.25.36:62678 conn66: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:50.109-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:22:53.869-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62747 #68 (12 connections now open) 2018-10-04T12:22:53.872-0400 I NETWORK [conn68] received client metadata from 10.1.25.36:62747 conn68: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:22:53.875-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9007 (1 connections now open to jazzstep-2.local:9007 with a 5 second timeout) 2018-10-04T12:22:53.884-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:22:54.251-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 705822ms ms 2018-10-04T12:23:06.057-0400 I NETWORK [listener] connection accepted from 10.1.25.36:62975 #70 (13 connections now open) 2018-10-04T12:23:06.058-0400 I NETWORK [conn70] received client metadata from 10.1.25.36:62975 conn70: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:23:06.070-0400 I NETWORK [conn43] end connection 10.1.25.36:59008 (12 connections now open) 2018-10-04T12:23:23.887-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:01.968-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9009 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:01.969-0400 I ASIO [Replication] Dropping all pooled connections to jazzstep-2.local:9008 due to NetworkInterfaceExceededTimeLimit: Connection pool has been idle for longer than the host timeout 2018-10-04T12:30:01.969-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:30:01.970-0400 I NETWORK [conn56] end connection 127.0.0.1:62633 (11 connections now open) 2018-10-04T12:30:01.970-0400 I NETWORK [conn60] end connection 127.0.0.1:62636 (10 connections now open) 2018-10-04T12:30:01.971-0400 I REPL [replication-1] Restarting oplog query due to error: NetworkInterfaceExceededTimeLimit: error in fetcher batch callback :: caused by :: timed out. Last fetched optime (with hash): { ts: Timestamp(1538670220, 1), t: 2 }[-9113168510407357519]. Restarts remaining: 1 2018-10-04T12:30:01.972-0400 I REPL [replexec-16] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-10-04T12:30:01.972-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:30:01.973-0400 I ASIO [RS] Ending connection to host jazzstep-2.local:9008 due to bad connection status; 0 connections to that host remain open 2018-10-04T12:30:01.976-0400 I REPL [replication-1] Scheduled new oplog query Fetcher source: jazzstep-2.local:9008 database: local query: { find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538670220, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 2, readConcern: { afterClusterTime: Timestamp(1538670220, 1) } } query metadata: { $replData: 1, $oplogQueryData: 1, $readPreference: { mode: "secondaryPreferred" } } active: 1 findNetworkTimeout: 7000ms getMoreNetworkTimeout: 10000ms shutting down?: 0 first: 1 firstCommandScheduler: RemoteCommandRetryScheduler request: RemoteCommand 1206 -- target:jazzstep-2.local:9008 db:local cmd:{ find: "oplog.rs", filter: { ts: { $gte: Timestamp(1538670220, 1) } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 2000, batchSize: 13981010, term: 2, readConcern: { afterClusterTime: Timestamp(1538670220, 1) } } active: 1 callbackHandle.valid: 1 callbackHandle.cancelled: 0 attempt: 1 retryPolicy: RetryPolicyImpl maxAttempts: 1 maxTimeMillis: -1ms 2018-10-04T12:30:01.977-0400 I REPL [replexec-16] conducting a dry run election to see if we could be elected. current term: 2 2018-10-04T12:30:01.978-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.979-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.979-0400 I NETWORK [conn63] end connection 127.0.0.1:62643 (9 connections now open) 2018-10-04T12:30:01.979-0400 I NETWORK [conn61] end connection 127.0.0.1:62638 (8 connections now open) 2018-10-04T12:30:01.981-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63670 #71 (9 connections now open) 2018-10-04T12:30:01.981-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.982-0400 I ASIO [RS] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:01.985-0400 I NETWORK [conn71] received client metadata from 10.1.25.36:63670 conn71: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:01.985-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9009 2018-10-04T12:30:01.990-0400 I REPL [replexec-12] VoteRequester(term 2 dry run) received a yes vote from jazzstep-2.local:9009; response message: { term: 2, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538670220, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('000000000000000000000000') }, lastCommittedOpTime: Timestamp(1538670220, 1), $clusterTime: { clusterTime: Timestamp(1538670220, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:30:01.991-0400 I REPL [replexec-12] dry election run succeeded, running for election in term 3 2018-10-04T12:30:01.999-0400 W REPL [rsBackgroundSync] Fetcher stopped querying remote oplog with error: InvalidSyncSource: Sync source cannot be behind me, and if I am up-to-date with the sync source, it must have a higher lastOpCommitted. My last fetched oplog optime: { ts: Timestamp(1538670220, 1), t: 2 }, latest oplog optime of sync source: { ts: Timestamp(1538670220, 1), t: 2 }, my lastOpCommitted: { ts: Timestamp(1538670220, 1), t: 2 }, lastOpCommitted of sync source: { ts: Timestamp(1538670220, 1), t: 2 } 2018-10-04T12:30:02.000-0400 I REPL [rsBackgroundSync] Clearing sync source jazzstep-2.local:9008 to choose a new one. 2018-10-04T12:30:02.000-0400 I REPL [rsBackgroundSync] could not find member to sync from 2018-10-04T12:30:02.002-0400 I ASIO [Replication] Connecting to jazzstep-2.local:9008 2018-10-04T12:30:02.004-0400 I NETWORK [conn59] end connection 127.0.0.1:62635 (8 connections now open) 2018-10-04T12:30:02.005-0400 I REPL [replexec-16] Member jazzstep-2.local:9008 is now in state SECONDARY 2018-10-04T12:30:02.110-0400 I REPL [replexec-17] VoteRequester(term 3) received a yes vote from jazzstep-2.local:9009; response message: { term: 3, voteGranted: true, reason: "", ok: 1.0, operationTime: Timestamp(1538670220, 1), $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId('000000000000000000000000') }, lastCommittedOpTime: Timestamp(1538670220, 1), $clusterTime: { clusterTime: Timestamp(1538670220, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } } } 2018-10-04T12:30:02.111-0400 I REPL [replexec-17] election succeeded, assuming primary role in term 3 2018-10-04T12:30:02.113-0400 I REPL [replexec-17] transition to PRIMARY from SECONDARY 2018-10-04T12:30:02.114-0400 I REPL [replexec-17] Resetting sync source to empty, which was :27017 2018-10-04T12:30:02.115-0400 I REPL [replexec-17] Entering primary catch-up mode. 2018-10-04T12:30:02.116-0400 I REPL [replexec-17] Caught up to the latest optime known via heartbeats after becoming primary. 2018-10-04T12:30:02.117-0400 I REPL [replexec-17] Exited primary catch-up mode. 2018-10-04T12:30:02.117-0400 I REPL [replexec-17] Stopping replication producer 2018-10-04T12:30:02.950-0400 I NETWORK [conn57] end connection 127.0.0.1:62634 (7 connections now open) 2018-10-04T12:30:02.950-0400 I NETWORK [conn62] end connection 127.0.0.1:62641 (6 connections now open) 2018-10-04T12:30:01.074-0400 I SHARDING [Balancer] CSRS balancer is starting 2018-10-04T12:30:01.074-0400 I REPL [rsSync-0] transition to primary complete; database writes are now permitted 2018-10-04T12:30:01.077-0400 I SHARDING [Balancer] CSRS balancer thread is recovering 2018-10-04T12:30:01.078-0400 I SHARDING [Balancer] CSRS balancer thread is recovered 2018-10-04T12:30:01.082-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:01.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:02.097-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:02.606-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:03.114-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:03.431-0400 I NETWORK [conn54] end connection 10.1.25.36:51567 (5 connections now open) 2018-10-04T12:30:03.436-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63767 #79 (6 connections now open) 2018-10-04T12:30:03.437-0400 I NETWORK [conn79] received client metadata from 10.1.25.36:63767 conn79: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:03.665-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:04.095-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63783 #80 (7 connections now open) 2018-10-04T12:30:04.104-0400 I NETWORK [conn80] received client metadata from 10.1.25.36:63783 conn80: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.109-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63785 #81 (8 connections now open) 2018-10-04T12:30:04.117-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63784 #82 (9 connections now open) 2018-10-04T12:30:04.117-0400 I NETWORK [conn81] received client metadata from 10.1.25.36:63785 conn81: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.118-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670603425), up: 2083, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670602, 1), signature: { hash: BinData(0, E08B2FF2C619F3342F558E1FC5E3CE48C2EFC5F5), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670220, 1), t: 2 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 679ms 2018-10-04T12:30:04.119-0400 I NETWORK [conn82] received client metadata from 10.1.25.36:63784 conn82: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.143-0400 I NETWORK [listener] connection accepted from 10.1.25.36:63787 #83 (10 connections now open) 2018-10-04T12:30:04.144-0400 I NETWORK [conn83] received client metadata from 10.1.25.36:63787 conn83: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:04.169-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:04.691-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:05.198-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:05.702-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:06.206-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:06.710-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:07.004-0400 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update to jazzstep-2.local:9008: InvalidSyncSource: Sync source was cleared. Was jazzstep-2.local:9008 2018-10-04T12:30:07.036-0400 I NETWORK [ReplicaSetMonitor-TaskExecutor] Successfully connected to jazzstep-2.local:9008 (1 connections now open to jazzstep-2.local:9008 with a 5 second timeout) 2018-10-04T12:30:07.039-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:07.213-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:07.425-0400 W SHARDING [replSetDistLockPinger] Lock pinger for proc: ConfigServer was inactive for 403165ms ms 2018-10-04T12:30:07.720-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:08.223-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:08.727-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:09.235-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:09.741-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:10.244-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:10.749-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:11.252-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:11.757-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:12.264-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:12.768-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:13.271-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:13.780-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:14.287-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:14.791-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:15.295-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:15.798-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:16.302-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:16.807-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:17.312-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:17.833-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:18.336-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:18.839-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:19.247-0400 I NETWORK [listener] connection accepted from 10.1.25.36:64080 #85 (11 connections now open) 2018-10-04T12:30:19.248-0400 I NETWORK [conn85] received client metadata from 10.1.25.36:64080 conn85: { driver: { name: "NetworkInterfaceTL", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:30:19.342-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:19.848-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:20.351-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:20.854-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:21.357-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:21.358-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:30:21.359-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:30:21.358-0400-5bb6401d290d7fa45d18d1c6", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670621358), what: "balancer.round", ns: "", details: { executionTimeMillis: 20279, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:30:31.384-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:31.887-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:32.393-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:32.898-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:33.403-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:33.909-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:34.415-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:34.920-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:35.424-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:35.930-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:36.436-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:36.940-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:37.066-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:30:37.442-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:37.946-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:38.450-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:38.955-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:39.459-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:39.962-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:40.465-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:40.969-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:41.475-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:41.978-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:42.481-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:42.983-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:43.486-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:43.988-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:44.491-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:44.995-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:45.497-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:46.002-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:46.507-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:47.010-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:47.515-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:48.019-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:48.529-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:49.031-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:49.537-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:50.040-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:50.543-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:51.045-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:51.548-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:30:51.549-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:30:51.549-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:30:51.549-0400-5bb6403b290d7fa45d18d23f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670651549), what: "balancer.round", ns: "", details: { executionTimeMillis: 20167, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:31:01.569-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:01.990-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9009 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:31:02.009-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 2 connections to that host remain open 2018-10-04T12:31:02.010-0400 I ASIO [Replication] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:31:02.026-0400 I ASIO [RS] Ending idle connection to host jazzstep-2.local:9008 because the pool meets constraints; 1 connections to that host remain open 2018-10-04T12:31:02.074-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:02.580-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:03.084-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:03.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:04.089-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:04.592-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:05.097-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:05.602-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:06.109-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:06.611-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:07.071-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:07.114-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:07.619-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:08.123-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:08.630-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:09.132-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:09.635-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:10.137-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:10.641-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:11.145-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:11.647-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:12.151-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:12.653-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:13.158-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:13.665-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:14.171-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:14.674-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:15.180-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:15.684-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:16.192-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:16.695-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:17.198-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:17.703-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:18.210-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:18.714-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:19.217-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:19.722-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:20.225-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:20.730-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:21.233-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:21.736-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:21.736-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:31:21.737-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:31:21.737-0400-5bb64059290d7fa45d18d2b7", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670681737), what: "balancer.round", ns: "", details: { executionTimeMillis: 20170, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:31:31.819-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:32.322-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:32.826-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:33.328-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:33.831-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:34.334-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:34.837-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:35.343-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:35.846-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:36.351-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:36.858-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:37.073-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:31:37.366-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:37.928-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:38.431-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:38.937-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:39.440-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:39.948-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:40.451-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:40.954-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:41.464-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:41.970-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:42.473-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:42.978-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:43.482-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:43.985-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:44.489-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:44.993-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:45.497-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:46.003-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:46.509-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:47.014-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:47.517-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:48.030-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:48.534-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:49.037-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:49.544-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:50.048-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:50.551-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:51.055-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:51.559-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:52.062-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:31:52.063-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:31:52.065-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:31:52.064-0400-5bb64078290d7fa45d18d32f", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670712064), what: "balancer.round", ns: "", details: { executionTimeMillis: 20247, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:32:02.143-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:02.647-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:03.151-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:03.653-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:04.159-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:04.661-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:05.165-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:05.672-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:06.709-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:06.945-0400 I SH_REFR [ConfigServerCatalogCacheLoader-3] Refresh for collection config.system.sessions took 0 ms and found the collection is not sharded 2018-10-04T12:32:07.070-0400 I COMMAND [LogicalSessionCacheRefresh] command config.locks command: findAndModify { findAndModify: "locks", query: { _id: "config", state: 0 }, update: { $set: { ts: ObjectId('5bb64086290d7fa45d18d369'), state: 2, who: "ConfigServer:LogicalSessionCacheRefresh", process: "ConfigServer", when: new Date(1538670726946), why: "shardCollection" } }, upsert: true, new: true, writeConcern: { w: "majority", wtimeout: 15000 }, $db: "config" } planSummary: IXSCAN { _id: 1 } keysExamined:1 docsExamined:1 nMatched:1 nModified:1 keysInserted:2 keysDeleted:2 numYields:0 reslen:488 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 124ms 2018-10-04T12:32:07.071-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config' acquired for 'shardCollection', ts : 5bb64086290d7fa45d18d369 2018-10-04T12:32:07.075-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:07.134-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock 'config.system.sessions' acquired for 'shardCollection', ts : 5bb64087290d7fa45d18d374 2018-10-04T12:32:07.140-0400 I NETWORK [listener] connection accepted from 10.1.25.36:49570 #87 (12 connections now open) 2018-10-04T12:32:07.153-0400 I NETWORK [conn87] received client metadata from 10.1.25.36:49570 conn87: { driver: { name: "MongoDB Internal Client", version: "4.0.3-rc0" }, os: { type: "Darwin", name: "Mac OS X", architecture: "x86_64", version: "17.7.0" } } 2018-10-04T12:32:07.154-0400 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 (1 connections now open to foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003 with a 0 second timeout) 2018-10-04T12:32:07.157-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:07.212-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:07.661-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:07.715-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:08.166-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:08.218-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:08.669-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:08.720-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:09.172-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:09.223-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:09.678-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:09.729-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:10.185-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:10.232-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:10.688-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:10.735-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:11.194-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:11.240-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:11.697-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:11.745-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:12.201-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:12.247-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:12.708-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:12.755-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:13.212-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:13.259-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:13.716-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:13.762-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:14.219-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:14.268-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:14.726-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:14.773-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:14.992-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670734748), up: 2214, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670724, 1), signature: { hash: BinData(0, 93B1A3594ED318E31AEDBAAA74F5CD9F2BAB6F49), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670724, 1), t: 3 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 241ms 2018-10-04T12:32:15.230-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:15.493-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:15.733-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:15.996-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:16.239-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:16.499-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:16.745-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:17.003-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:17.251-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:17.510-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:17.754-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:18.015-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:18.259-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:18.520-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:18.762-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:19.023-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:19.265-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:19.528-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:19.770-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:20.031-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:20.272-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:20.643-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:20.776-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:21.146-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:21.278-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:21.651-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:21.782-0400 W NETWORK [LogicalSessionCacheRefresh] Unable to reach primary for set foo 2018-10-04T12:32:21.783-0400 I NETWORK [LogicalSessionCacheRefresh] Ending connection to host foo/jazzstep-2.local:9001,jazzstep-2.local:9002,jazzstep-2.local:9003(with timeout of 0 seconds) due to bad connection status; 0 connections to that host remain open 2018-10-04T12:32:21.846-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb64087290d7fa45d18d374' unlocked. 2018-10-04T12:32:22.029-0400 I COMMAND [LogicalSessionCacheRefresh] command config.locks command: findAndModify { findAndModify: "locks", query: { ts: ObjectId('5bb64086290d7fa45d18d369') }, update: { $set: { state: 0 } }, writeConcern: { w: "majority", wtimeout: 15000 }, $db: "config" } planSummary: IXSCAN { ts: 1 } keysExamined:1 docsExamined:1 nMatched:1 nModified:1 keysInserted:1 keysDeleted:1 numYields:0 reslen:488 locks:{ Global: { acquireCount: { r: 8, w: 8 } }, Database: { acquireCount: { w: 8 } }, Collection: { acquireCount: { w: 4 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 182ms 2018-10-04T12:32:22.119-0400 I SHARDING [LogicalSessionCacheRefresh] distributed lock with ts: 5bb64086290d7fa45d18d369' unlocked. 2018-10-04T12:32:22.121-0400 I COMMAND [LogicalSessionCacheRefresh] command admin.$cmd command: _configsvrShardCollection { _configsvrShardCollection: "config.system.sessions", key: { _id: 1 }, unique: false, numInitialChunks: 0, getUUIDfromPrimaryShard: true, writeConcern: { w: "majority", wtimeout: 60000 }, $db: "admin" } numYields:0 ok:0 errMsg:"Could not find host matching read preference { mode: \"primary\", tags: [ {} ] } for set foo" errName:FailedToSatisfyReadPreference errCode:133 reslen:429 locks:{ Global: { acquireCount: { r: 8, w: 8 } }, Database: { acquireCount: { w: 8 } }, Collection: { acquireCount: { w: 4 } }, oplog: { acquireCount: { w: 4 } } } protocol:op_msg 15174ms 2018-10-04T12:32:22.122-0400 I CONTROL [LogicalSessionCacheRefresh] Failed to create config.system.sessions: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo, will try again at the next refresh interval 2018-10-04T12:32:22.123-0400 I CONTROL [LogicalSessionCacheRefresh] Sessions collection is not set up; waiting until next sessions refresh interval: Could not find host matching read preference { mode: "primary", tags: [ {} ] } for set foo 2018-10-04T12:32:22.154-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:22.155-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:32:22.156-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:32:22.156-0400-5bb64096290d7fa45d18d3cc", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670742156), what: "balancer.round", ns: "", details: { executionTimeMillis: 20014, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:32:25.108-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670745001), up: 2225, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670739, 1), signature: { hash: BinData(0, 5601504657DCA584D86E47035A693A9F67215C5F), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670739, 1), t: 3 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 103ms 2018-10-04T12:32:32.174-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:32.677-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:33.180-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:33.687-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:34.193-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:34.699-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:35.726-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:36.230-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:36.736-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:37.080-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:32:37.244-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:37.747-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:38.264-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:38.769-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:39.273-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:39.775-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:40.278-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:40.786-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:41.289-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:41.796-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:42.299-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:42.803-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:43.309-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:43.813-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:44.320-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:44.826-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:45.331-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:45.834-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:46.161-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670765923), up: 2245, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670755, 1), signature: { hash: BinData(0, 402ABB77B4F9E630CAA46038FDD52591386BC16F), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670755, 1), t: 3 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 235ms 2018-10-04T12:32:46.336-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:46.843-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:47.346-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:47.849-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:48.352-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:48.876-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:49.418-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:49.921-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:50.424-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:50.930-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:51.435-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:51.943-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:52.446-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:32:52.447-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:32:52.448-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:32:52.448-0400-5bb640b4290d7fa45d18d443", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670772448), what: "balancer.round", ns: "", details: { executionTimeMillis: 20276, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:32:52.553-0400 I COMMAND [Balancer] command config.actionlog command: insert { insert: "actionlog", bypassDocumentValidation: false, ordered: true, documents: [ { _id: "jazzstep-2.local-2018-10-04T12:32:52.448-0400-5bb640b4290d7fa45d18d443", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670772448), what: "balancer.round", ns: "", details: { executionTimeMillis: 20276, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, $db: "config" } ninserted:1 keysInserted:1 numYields:0 reslen:339 locks:{ Global: { acquireCount: { r: 21, w: 12 } }, Database: { acquireCount: { r: 9, w: 12 } }, Collection: { acquireCount: { r: 9, w: 6 } }, Metadata: { acquireCount: { W: 6 } }, oplog: { acquireCount: { w: 6 } } } protocol:op_msg 104ms 2018-10-04T12:33:02.560-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:03.064-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:03.570-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:04.073-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:04.575-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:05.078-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:05.581-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:06.083-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:06.587-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:07.083-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:07.093-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:07.597-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:08.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:08.605-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:09.108-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:09.612-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:10.117-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:10.621-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:11.124-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:11.629-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:12.136-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:12.642-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:13.146-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:13.649-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:14.152-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:14.657-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:15.161-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:15.666-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:16.170-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:16.511-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670796332), up: 2276, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670786, 1), signature: { hash: BinData(0, 14809D374079285E9FB02F440D72C83DE65F1DE6), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670786, 1), t: 3 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 176ms 2018-10-04T12:33:16.676-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:17.182-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:17.685-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:18.191-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:18.695-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:19.198-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:19.700-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:20.203-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:20.710-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:21.213-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:21.716-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:22.220-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:22.723-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:22.723-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:33:22.724-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:33:22.724-0400-5bb640d2290d7fa45d18d4b9", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670802724), what: "balancer.round", ns: "", details: { executionTimeMillis: 20166, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:33:32.795-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:33.298-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:33.801-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:34.308-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:34.811-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:35.316-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:35.820-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:36.322-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:36.825-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:37.086-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:33:37.328-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:37.834-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:38.336-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:38.843-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:39.347-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:39.850-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:40.353-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:40.861-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:41.363-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:41.866-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:42.368-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:42.875-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:43.381-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:43.884-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:44.387-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:44.893-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:45.397-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:45.900-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:46.405-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:46.910-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:47.413-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:47.941-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:48.446-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:48.949-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:49.455-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:49.960-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:50.464-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:50.968-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:51.471-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:51.974-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:52.477-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:52.980-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:33:52.981-0400 I SHARDING [Balancer] caught exception while doing balance: Could not find host matching read preference { mode: "primary" } for set foo 2018-10-04T12:33:52.982-0400 I SHARDING [Balancer] about to log metadata event into actionlog: { _id: "jazzstep-2.local-2018-10-04T12:33:52.982-0400-5bb640f0290d7fa45d18d530", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670832982), what: "balancer.round", ns: "", details: { executionTimeMillis: 20189, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } 2018-10-04T12:33:53.092-0400 I COMMAND [Balancer] command config.actionlog command: insert { insert: "actionlog", bypassDocumentValidation: false, ordered: true, documents: [ { _id: "jazzstep-2.local-2018-10-04T12:33:52.982-0400-5bb640f0290d7fa45d18d530", server: "jazzstep-2.local", clientAddr: "", time: new Date(1538670832982), what: "balancer.round", ns: "", details: { executionTimeMillis: 20189, errorOccured: true, errmsg: "Could not find host matching read preference { mode: "primary" } for set foo" } } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, $db: "config" } ninserted:1 keysInserted:1 numYields:0 reslen:339 locks:{ Global: { acquireCount: { r: 27, w: 16 } }, Database: { acquireCount: { r: 11, w: 16 } }, Collection: { acquireCount: { r: 11, w: 8 } }, Metadata: { acquireCount: { W: 8 } }, oplog: { acquireCount: { w: 8 } } } protocol:op_msg 109ms 2018-10-04T12:34:03.097-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:03.600-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:04.102-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:04.610-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:05.113-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:05.616-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:06.118-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:06.621-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:07.088-0400 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set foo 2018-10-04T12:34:07.127-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:07.632-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:08.134-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:08.636-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:09.143-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:09.646-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:10.148-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:10.654-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:11.160-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:11.666-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:12.171-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:12.673-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:13.176-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:13.680-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:14.187-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:14.693-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:15.196-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:15.701-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:16.205-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:16.711-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:17.036-0400 I COMMAND [conn79] command config.$cmd command: update { update: "mongos", bypassDocumentValidation: false, ordered: true, updates: [ { q: { _id: "jazzstep-2.local:9010" }, u: { $set: { _id: "jazzstep-2.local:9010", ping: new Date(1538670856809), up: 2336, waiting: true, mongoVersion: "4.0.3-rc0", advisoryHostFQDNs: [ "jazzstep-2.local" ] } }, multi: false, upsert: true } ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: true, maxTimeMS: 30000, $replData: 1, $clusterTime: { clusterTime: Timestamp(1538670846, 1), signature: { hash: BinData(0, 96F4B0D76583F5CC42A882DF3D103E1682BB4EFD), keyId: 6608530856820604950 } }, $configServerState: { opTime: { ts: Timestamp(1538670846, 1), t: 3 } }, $db: "config" } numYields:0 reslen:560 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 1 } }, oplog: { acquireCount: { w: 1 } } } protocol:op_msg 224ms 2018-10-04T12:34:17.213-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:17.716-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:18.219-0400 W NETWORK [Balancer] Unable to reach primary for set foo 2018-10-04T12:34:18.725-0400 W NETWORK [Balancer] Unable to reach primary for set foo